2024-09-10T17:37:21.779 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T17:37:21.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T17:37:21.896 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428 branch: wip-bharath7-testing-2024-09-10-1409 description: rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} email: skanta@redhat.com first_in_suite: false job_id: '7899428' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'run run randomized correctness test for rados operations on an erasure-coded pool ' - desc: 'object class functional tests ' - desc: 'generate read/write load with rados objects ranging from 1MB to 25MB ' - desc: 'run basic import/export cli tests for rbd ' - desc: 'librbd C and C++ api tests ' - desc: 'librbd python api tests ' name: skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath7-testing-2024-09-10-1409 ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true create_rbd_pool: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - mons down - mon down - MON_DOWN - out of quorum - PG_AVAILABILITY sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: extra_system_packages: - python3-pytest flavor: default sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-bharath7-testing-2024-09-10-1409 sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mds.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 5245 sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath7-testing-2024-09-10-1409 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCqI7zfp/jpARiQs63yFpFINSgQAwCboFTQhdYatyPK2p8WrdjsLf1Lim2iO/S/ZpL0sgHkoNHE+0dD/1mFz8ZM= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2EYLMrPxNtxU7DOw88B2O8sWKJH9CJ9JG5vIu2NqhR0EUcQ7qjJpdjZ01slJc94/Qg5/oM+jrwaKt2qCTJ3iA= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - print: '**** done start installing reef cephadm ...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef - print: '**** done end installing reef cephadm ...' - print: '**** done start cephadm.shell ceph config set mgr...' - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - print: '**** done start telemetry reef...' - workunit: clients: client.0: - test_telemetry_reef.sh - print: '**** done end telemetry reef...' - print: '**** done start parallel' - parallel: - workload - upgrade-sequence - print: '**** done end parallel' - print: '**** done start telemetry x...' - workunit: clients: client.0: - test_telemetry_reef_x.sh - print: '**** done end telemetry x...' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_15:30:27 tube: smithi upgrade-sequence: sequential: - print: '**** done start upgrade, wait' - cephadm.shell: env: - sha1 mon.a: - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - print: '**** done end upgrade, wait...' user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload: full_sequential: - print: '**** done start ec-rados-default.yaml' - rados: clients: - client.0 ec_pool: true objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false - print: '**** done end ec-rados-default.yaml' - print: '**** done start rados_api.yaml' - workunit: branch: reef clients: client.0: - cls - print: '**** done end rados_api.yaml' - print: '**** done start rados_loadgenbig.yaml' - workunit: branch: reef clients: client.0: - rados/load-gen-big.sh - print: '**** done end rados_loadgenbig.yaml' - print: '**** done start rbd_import_export.yaml' - workunit: branch: reef clients: client.1: - rbd/import_export.sh env: RBD_CREATE_ARGS: --new-format - print: '**** done end rbd_import_export.yaml' - print: '**** done start test_rbd_api.yaml' - workunit: branch: reef clients: client.0: - rbd/test_librbd.sh env: RBD_FEATURES: '61' - print: '**** done end test_rbd_api.yaml' - print: '**** done start test_rbd_python.yaml' - workunit: branch: reef clients: client.0: - rbd/test_librbd_python.sh env: RBD_FEATURES: '61' - print: '**** done end test_rbd_python.yaml' 2024-09-10T17:37:21.896 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa; will attempt to use it 2024-09-10T17:37:21.897 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks 2024-09-10T17:37:21.897 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T17:37:21.898 INFO:teuthology.task.internal:Checking packages... 2024-09-10T17:37:21.920 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46' 2024-09-10T17:37:21.920 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T17:37:21.920 INFO:teuthology.packaging:ref: None 2024-09-10T17:37:21.920 INFO:teuthology.packaging:tag: None 2024-09-10T17:37:21.920 INFO:teuthology.packaging:branch: wip-bharath7-testing-2024-09-10-1409 2024-09-10T17:37:21.920 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:37:21.920 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath7-testing-2024-09-10-1409 2024-09-10T17:37:22.063 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4858.gbad1f558 2024-09-10T17:37:22.064 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T17:37:22.071 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T17:37:22.071 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T17:37:22.107 INFO:teuthology.task.internal:Saving configuration 2024-09-10T17:37:22.126 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T17:37:22.132 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T17:37:22.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 17:32:22.001410', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCqI7zfp/jpARiQs63yFpFINSgQAwCboFTQhdYatyPK2p8WrdjsLf1Lim2iO/S/ZpL0sgHkoNHE+0dD/1mFz8ZM='} 2024-09-10T17:37:22.179 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 17:32:22.003232', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2EYLMrPxNtxU7DOw88B2O8sWKJH9CJ9JG5vIu2NqhR0EUcQ7qjJpdjZ01slJc94/Qg5/oM+jrwaKt2qCTJ3iA='} 2024-09-10T17:37:22.180 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T17:37:22.186 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-09-10T17:37:22.186 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-09-10T17:37:22.186 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T17:37:22.292 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f468c1f7be0>, signals=[15]) 2024-09-10T17:37:22.292 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T17:37:22.298 INFO:teuthology.task.internal:Opening connections... 2024-09-10T17:37:22.298 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T17:37:22.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:37:22.388 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-10T17:37:22.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:37:22.465 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T17:37:22.472 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-10T17:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-10T17:37:22.491 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-10T17:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-09-10T17:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-09-10T17:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-09-10T17:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-09-10T17:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-09-10T17:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-09-10T17:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T17:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-09-10T17:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-09-10T17:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T17:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-09-10T17:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T17:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T17:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T17:37:22.553 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-10T17:37:22.573 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-10T17:37:22.593 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-10T17:37:22.593 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T17:37:22.651 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-09-10T17:37:22.652 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T17:37:22.652 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T17:37:22.652 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T17:37:22.652 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-10T17:37:22.673 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T17:37:22.682 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T17:37:22.699 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T17:37:22.699 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-10T17:37:22.702 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-10T17:37:22.718 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T17:37:22.725 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T17:37:22.725 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-10T17:37:22.759 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-10T17:37:22.797 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T17:37:22.851 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T17:37:22.865 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T17:37:22.865 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T17:37:22.866 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T17:37:22.866 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T17:37:22.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T17:37:22.883 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-10T17:37:22.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T17:37:22.884 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-10T17:37:22.941 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-503.el9.x86_64 2024-09-10T17:37:22.941 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-503.el9.x86_64 2024-09-10T17:37:22.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-09-10T17:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-503.el9.x86_64 2024-09-10T17:37:22.943 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.14.0-503.el9.x86_64 2024-09-10T17:37:22.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2024-09-10T17:37:25.196 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-10T17:37:25.292 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-10T17:37:29.180 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-10T17:37:29.543 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-09-10T17:37:34.235 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.5 MB 00:00 2024-09-10T17:37:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-10T17:37:35.711 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-10T17:37:36.465 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-10T17:37:36.772 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-10T17:37:37.551 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-10T17:37:41.845 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-10T17:37:43.240 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-10T17:37:43.860 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T17:37:43.860 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T17:37:43.956 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-10T17:37:43.965 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:37:43.965 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-10T17:37:43.965 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:37:43.965 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-10T17:37:43.965 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T17:37:43.965 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-10T17:37:43.965 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T17:37:43.966 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T17:37:43.966 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T17:37:43.966 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:37:43.966 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-10T17:37:43.966 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:37:43.966 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-10T17:37:43.966 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:37:43.966 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 79 M 2024-09-10T17:37:43.967 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-09-10T17:37:43.967 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-10T17:37:44.347 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 218 kB/s | 23 kB 00:00 2024-09-10T17:37:45.354 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T17:37:45.355 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T17:37:45.453 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-10T17:37:45.464 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:37:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-10T17:37:45.464 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:37:45.464 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-10T17:37:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T17:37:45.464 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-10T17:37:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T17:37:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T17:37:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T17:37:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:37:45.465 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-10T17:37:45.465 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:37:45.465 INFO:teuthology.orchestra.run.smithi012.stdout:Install 4 Packages 2024-09-10T17:37:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:37:45.465 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 79 M 2024-09-10T17:37:45.466 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 126 M 2024-09-10T17:37:45.466 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-10T17:37:45.683 INFO:teuthology.orchestra.run.smithi012.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 232 kB/s | 23 kB 00:00 2024-09-10T17:37:46.091 INFO:teuthology.orchestra.run.smithi012.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-10T17:37:46.508 INFO:teuthology.orchestra.run.smithi012.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-10T17:37:46.825 INFO:teuthology.orchestra.run.smithi012.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-10T17:37:46.826 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-10T17:37:46.826 INFO:teuthology.orchestra.run.smithi012.stdout:Total 58 MB/s | 79 MB 00:01 2024-09-10T17:37:47.531 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-10T17:37:47.912 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-10T17:37:47.912 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-10T17:37:48.347 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 8.4 MB/s | 35 MB 00:04 2024-09-10T17:37:48.872 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-10T17:37:48.872 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-10T17:37:51.097 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.3 MB/s | 16 MB 00:06 2024-09-10T17:37:51.451 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-10T17:37:52.152 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T17:37:52.242 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T17:37:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T17:37:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T17:37:57.171 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.2 MB/s | 29 MB 00:12 2024-09-10T17:37:57.171 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-10T17:37:57.172 INFO:teuthology.orchestra.run.smithi089.stdout:Total 6.0 MB/s | 79 MB 00:13 2024-09-10T17:37:57.855 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-10T17:37:58.207 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-10T17:37:58.207 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-10T17:37:59.171 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-10T17:37:59.171 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-10T17:38:00.287 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T17:38:00.331 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:01.637 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-10T17:38:02.346 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T17:38:02.430 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T17:38:05.298 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T17:38:05.473 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T17:38:10.446 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T17:38:10.493 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:15.304 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:44.692 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T17:38:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T17:38:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T17:38:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:38:45.893 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-10T17:38:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T17:38:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T17:38:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T17:38:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T17:38:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:38:45.894 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-10T17:38:46.219 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T17:38:46.372 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T17:38:46.372 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T17:38:46.372 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T17:38:46.372 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T17:38:46.372 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T17:38:46.373 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T17:38:46.373 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T17:38:46.373 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T17:38:46.431 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T17:38:46.431 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T17:38:46.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2024-09-10T17:38:46.462 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 82.el9 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8274670 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T17:38:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:38:46.464 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T17:38:46.465 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T17:38:46.465 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 5.14.0-505.el9.x86_64 2024-09-10T17:38:46.466 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T17:38:47.066 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-09-10T17:38:48.299 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T17:38:48.331 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-09-10T17:38:48.333 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-10T17:38:48.348 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.Z50UO3pbac 2024-09-10T17:38:48.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Z50UO3pbac 2024-09-10T17:38:48.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.Z50UO3pbac 2024-09-10T17:38:48.556 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.Z50UO3pbac is 6KB 2024-09-10T17:38:48.605 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.Z50UO3pbac 2024-09-10T17:38:48.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T17:38:48.682 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T17:38:48.682 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T17:38:48.682 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T17:38:48.682 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T17:38:48.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T17:38:48.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-09-10T17:38:53.396 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:53.441 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:53.881 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:53.881 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T17:38:53.881 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T17:38:53.881 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:38:54.716 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-10T17:38:55.079 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T17:38:55.168 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T17:38:55.168 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T17:38:55.169 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T17:38:55.169 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T17:38:55.169 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T17:38:55.169 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-10T17:38:55.169 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T17:38:55.169 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T17:38:55.227 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T17:38:55.227 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T17:38:55.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-09-10T17:38:55.259 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-09-10T17:38:55.259 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-09-10T17:38:55.259 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-09-10T17:38:55.259 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 82.el9 2024-09-10T17:38:55.259 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8274670 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-09-10T17:38:55.260 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:38:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T17:38:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T17:38:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T17:38:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-09-10T17:38:55.261 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:38:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T17:38:55.262 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T17:38:55.262 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-505.el9.x86_64 2024-09-10T17:38:55.262 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T17:38:55.920 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-10T17:38:57.245 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T17:38:57.287 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-10T17:38:57.290 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-10T17:38:57.305 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.WBTgYJYbUM 2024-09-10T17:38:57.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WBTgYJYbUM 2024-09-10T17:38:57.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.WBTgYJYbUM 2024-09-10T17:38:57.524 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.WBTgYJYbUM is 6KB 2024-09-10T17:38:57.573 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.WBTgYJYbUM 2024-09-10T17:38:57.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T17:38:57.650 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T17:38:57.650 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T17:38:57.650 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T17:38:57.650 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T17:38:57.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T17:38:57.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-10T17:39:18.862 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T17:39:18.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T17:39:18.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:39:27.829 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T17:39:27.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-10T17:39:27.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:39:37.405 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-10T17:39:46.365 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-10T17:39:46.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T17:39:46.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:39:55.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-10T17:39:55.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:39:58.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-10T17:40:04.801 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-10T17:40:10.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-10T17:40:10.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:40:16.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T17:40:16.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:40:20.306 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-10T17:40:20.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T17:40:20.773 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-10T17:40:20.773 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-10T17:40:20.788 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-505.el9.x86_64 2024-09-10T17:40:20.789 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T17:40:20.789 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T17:40:20.789 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T17:40:21.789 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T17:40:21.790 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T17:40:21.885 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2024-09-10T17:40:21.909 DEBUG:teuthology.parallel:result is None 2024-09-10T17:40:42.242 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-10T17:40:42.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-10T17:40:42.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-10T17:40:42.633 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-10T17:40:42.647 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-505.el9.x86_64 2024-09-10T17:40:42.648 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T17:40:42.648 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T17:40:42.648 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T17:40:43.649 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T17:40:43.649 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T17:40:43.793 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-10T17:40:43.812 DEBUG:teuthology.parallel:result is None 2024-09-10T17:40:43.812 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T17:40:43.838 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T17:40:43.838 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T17:40:43.842 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T17:40:43.860 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T17:40:43.877 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T17:40:43.910 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T17:40:43.910 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T17:40:43.913 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T17:40:43.945 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T17:40:43.951 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T17:40:43.951 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T17:40:43.983 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T17:40:44.007 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T17:40:44.013 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T17:40:44.017 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T17:40:44.025 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T17:40:44.027 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T17:40:44.038 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T17:40:44.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T17:40:44.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T17:40:44.097 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T17:40:44.109 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T17:40:44.109 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T17:40:44.139 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T17:40:44.158 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T17:40:44.248 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T17:40:44.297 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T17:40:44.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T17:40:44.427 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:40:44.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T17:40:44.495 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T17:40:44.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T17:40:44.586 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T17:40:44.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T17:40:44.752 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:40:44.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T17:40:44.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-10T17:40:44.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-10T17:40:44.861 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T17:40:44.996 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T17:40:45.325 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T17:40:45.332 INFO:teuthology.task.internal:Starting timer... 2024-09-10T17:40:45.332 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T17:40:45.380 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T17:40:45.413 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T17:40:45.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-09-10T17:40:45.497 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-09-10T17:40:45.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-09-10T17:40:45.625 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-09-10T17:40:45.627 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T17:40:45.627 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-09-10T17:40:45.648 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-09-10T17:40:45.648 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-09-10T17:40:45.670 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-09-10T17:40:45.670 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2024-09-10T17:40:45.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T17:40:45.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T17:40:45.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T17:40:45.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T17:40:45.744 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T17:40:45.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-09-10T17:40:45.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-09-10T17:40:45.835 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T17:40:45.844 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T17:40:45.856 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T17:40:45.857 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T17:44:30.188 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2024-09-10T17:44:30.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T17:44:30.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:44:30.275 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-10T17:44:30.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T17:44:30.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-10T17:44:30.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T17:44:30.436 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-10T17:44:30.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-10T17:44:30.508 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T17:44:30.518 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T17:44:30.518 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T17:44:30.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T17:44:30.521 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T17:44:30.521 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T17:44:30.549 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T17:44:30.565 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T17:44:30.578 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T17:44:30.591 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-09-10T17:44:30.592 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T17:44:30.603 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-09-10T17:44:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-09-10T17:44:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T17:44:30.627 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-09-10T17:44:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T17:44:30.642 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T17:44:30.655 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T17:44:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-10T17:44:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T17:44:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-10T17:44:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T17:44:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T17:44:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T17:44:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T17:44:30.712 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-10T17:44:30.715 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T17:44:30.715 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-10T17:44:30.715 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T17:44:30.715 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T17:44:30.715 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T17:44:30.715 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T17:44:30.716 INFO:teuthology.run_tasks:Running task pexec... 2024-09-10T17:44:30.726 INFO:teuthology.task.pexec:Executing custom commands... 2024-09-10T17:44:30.727 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T17:44:30.727 DEBUG:teuthology.orchestra.run.smithi012:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-10T17:44:30.727 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi089.front.sepia.ceph.com 2024-09-10T17:44:30.728 DEBUG:teuthology.orchestra.run.smithi089:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-10T17:44:31.103 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-10T17:44:31.104 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-10T17:44:31.114 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:44:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-10T17:44:31.114 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:44:31.114 INFO:teuthology.orchestra.run.smithi012.stdout:Removing: 2024-09-10T17:44:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-10T17:44:31.114 INFO:teuthology.orchestra.run.smithi012.stdout:Removing unused dependencies: 2024-09-10T17:44:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-10T17:44:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:44:31.115 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-10T17:44:31.115 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:44:31.115 INFO:teuthology.orchestra.run.smithi012.stdout:Remove 2 Packages 2024-09-10T17:44:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:44:31.115 INFO:teuthology.orchestra.run.smithi012.stdout:Freed space: 5.5 M 2024-09-10T17:44:31.115 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-10T17:44:31.119 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-10T17:44:31.119 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout:Removing: 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout:Removing unused dependencies: 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout:Remove 2 Packages 2024-09-10T17:44:31.120 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:44:31.121 INFO:teuthology.orchestra.run.smithi089.stdout:Freed space: 5.5 M 2024-09-10T17:44:31.121 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-10T17:44:31.124 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-10T17:44:31.124 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-10T17:44:31.183 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-10T17:44:31.183 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-10T17:44:31.199 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-10T17:44:31.199 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-10T17:44:31.322 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-10T17:44:31.366 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-10T17:44:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-10T17:44:31.447 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-10T17:44:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-10T17:44:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-10T17:44:31.989 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-10T17:44:31.989 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-10T17:44:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-10T17:44:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-10T17:44:32.258 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-10T17:44:32.259 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:44:32.259 INFO:teuthology.orchestra.run.smithi089.stdout:Removed: 2024-09-10T17:44:32.259 INFO:teuthology.orchestra.run.smithi089.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-10T17:44:32.259 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:44:32.259 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-10T17:44:32.272 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-10T17:44:32.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:44:32.272 INFO:teuthology.orchestra.run.smithi012.stdout:Removed: 2024-09-10T17:44:32.272 INFO:teuthology.orchestra.run.smithi012.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-10T17:44:32.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:44:32.272 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-10T17:44:33.085 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:49 ago on Tue 10 Sep 2024 05:43:43 PM UTC. 2024-09-10T17:44:33.138 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:45 ago on Tue 10 Sep 2024 05:43:47 PM UTC. 2024-09-10T17:44:33.218 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-10T17:44:33.218 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:44:33.218 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-10T17:44:33.219 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2024-09-10T17:44:33.220 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:44:33.221 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.0 M 2024-09-10T17:44:33.221 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 9.2 M 2024-09-10T17:44:33.221 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-10T17:44:33.276 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-10T17:44:33.277 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:44:33.277 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-10T17:44:33.277 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:44:33.277 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-10T17:44:33.277 INFO:teuthology.orchestra.run.smithi012.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-10T17:44:33.277 INFO:teuthology.orchestra.run.smithi012.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-10T17:44:33.278 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-10T17:44:33.278 INFO:teuthology.orchestra.run.smithi012.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-10T17:44:33.278 INFO:teuthology.orchestra.run.smithi012.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-10T17:44:33.278 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-10T17:44:33.278 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-10T17:44:33.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:44:33.278 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-10T17:44:33.278 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T17:44:33.279 INFO:teuthology.orchestra.run.smithi012.stdout:Install 6 Packages 2024-09-10T17:44:33.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:44:33.287 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 2.0 M 2024-09-10T17:44:33.287 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 9.2 M 2024-09-10T17:44:33.287 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-10T17:44:33.532 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): nvmetcli-0.7-3.el9.noarch.rpm 258 kB/s | 44 kB 00:00 2024-09-10T17:44:33.557 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): libnvme-1.9-3.el9.x86_64.rpm 536 kB/s | 106 kB 00:00 2024-09-10T17:44:33.616 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.4 MB/s | 84 kB 00:00 2024-09-10T17:44:33.666 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): python3-configshell-1.1.30-1.el9.noarch. 535 kB/s | 72 kB 00:00 2024-09-10T17:44:33.709 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): nvme-cli-2.9.1-6.el9.x86_64.rpm 2.5 MB/s | 906 kB 00:00 2024-09-10T17:44:33.767 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 5.4 MB/s | 837 kB 00:00 2024-09-10T17:44:33.767 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-10T17:44:33.767 INFO:teuthology.orchestra.run.smithi089.stdout:Total 3.7 MB/s | 2.0 MB 00:00 2024-09-10T17:44:33.840 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-10T17:44:33.854 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-10T17:44:33.854 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-10T17:44:33.943 INFO:teuthology.orchestra.run.smithi012.stdout:(1/6): nvmetcli-0.7-3.el9.noarch.rpm 72 kB/s | 44 kB 00:00 2024-09-10T17:44:34.118 INFO:teuthology.orchestra.run.smithi012.stdout:(2/6): libnvme-1.9-3.el9.x86_64.rpm 134 kB/s | 106 kB 00:00 2024-09-10T17:44:34.131 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-10T17:44:34.131 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-10T17:44:34.556 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-10T17:44:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2024-09-10T17:44:34.660 INFO:teuthology.orchestra.run.smithi012.stdout:(3/6): python3-configshell-1.1.30-1.el9.noarch. 100 kB/s | 72 kB 00:00 2024-09-10T17:44:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/6 2024-09-10T17:44:34.716 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/6 2024-09-10T17:44:34.827 INFO:teuthology.orchestra.run.smithi012.stdout:(4/6): python3-kmod-0.9-32.el9.x86_64.rpm 119 kB/s | 84 kB 00:00 2024-09-10T17:44:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/6 2024-09-10T17:44:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-10T17:44:35.060 INFO:teuthology.orchestra.run.smithi012.stdout:(5/6): nvme-cli-2.9.1-6.el9.x86_64.rpm 521 kB/s | 906 kB 00:01 2024-09-10T17:44:35.402 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-10T17:44:35.426 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/6 2024-09-10T17:44:36.311 INFO:teuthology.orchestra.run.smithi012.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 508 kB/s | 837 kB 00:01 2024-09-10T17:44:36.311 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-10T17:44:36.311 INFO:teuthology.orchestra.run.smithi012.stdout:Total 678 kB/s | 2.0 MB 00:03 2024-09-10T17:44:36.395 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-10T17:44:36.411 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-10T17:44:36.411 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-10T17:44:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/6 2024-09-10T17:44:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/6 2024-09-10T17:44:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/6 2024-09-10T17:44:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/6 2024-09-10T17:44:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/6 2024-09-10T17:44:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/6 2024-09-10T17:44:36.680 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-10T17:44:36.681 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-10T17:44:36.768 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2024-09-10T17:44:36.768 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:44:36.768 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-10T17:44:36.769 INFO:teuthology.orchestra.run.smithi089.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-10T17:44:36.769 INFO:teuthology.orchestra.run.smithi089.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-10T17:44:36.769 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-10T17:44:36.769 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:44:36.769 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-10T17:44:37.095 DEBUG:teuthology.parallel:result is None 2024-09-10T17:44:37.125 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-10T17:44:37.223 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2024-09-10T17:44:37.261 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/6 2024-09-10T17:44:37.293 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/6 2024-09-10T17:44:37.520 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/6 2024-09-10T17:44:37.557 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-10T17:44:38.025 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/6 2024-09-10T17:44:38.052 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/6 2024-09-10T17:44:39.028 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/6 2024-09-10T17:44:39.028 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/6 2024-09-10T17:44:39.028 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/6 2024-09-10T17:44:39.028 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/6 2024-09-10T17:44:39.028 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/6 2024-09-10T17:44:39.028 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/6 2024-09-10T17:44:39.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2024-09-10T17:44:39.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:44:39.344 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-10T17:44:39.345 INFO:teuthology.orchestra.run.smithi012.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-10T17:44:39.345 INFO:teuthology.orchestra.run.smithi012.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-10T17:44:39.345 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-10T17:44:39.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:44:39.345 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-10T17:44:39.693 DEBUG:teuthology.parallel:result is None 2024-09-10T17:44:39.693 INFO:teuthology.run_tasks:Running task install... 2024-09-10T17:44:39.702 DEBUG:teuthology.task.install:project ceph 2024-09-10T17:44:39.702 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}} 2024-09-10T17:44:39.702 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'} 2024-09-10T17:44:39.703 INFO:teuthology.task.install:Using flavor: default 2024-09-10T17:44:39.708 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T17:44:39.708 INFO:teuthology.task.install:extra packages: [] 2024-09-10T17:44:39.709 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46', 'tag': None, 'wait_for_package': False} 2024-09-10T17:44:39.709 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T17:44:39.709 INFO:teuthology.packaging:ref: None 2024-09-10T17:44:39.709 INFO:teuthology.packaging:tag: None 2024-09-10T17:44:39.709 INFO:teuthology.packaging:branch: reef 2024-09-10T17:44:39.709 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:44:39.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-10T17:44:39.712 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46', 'tag': None, 'wait_for_package': False} 2024-09-10T17:44:39.712 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T17:44:39.712 INFO:teuthology.packaging:ref: None 2024-09-10T17:44:39.712 INFO:teuthology.packaging:tag: None 2024-09-10T17:44:39.712 INFO:teuthology.packaging:branch: reef 2024-09-10T17:44:39.712 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:44:39.712 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-10T17:44:39.974 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/flavors/default/ 2024-09-10T17:44:39.974 INFO:teuthology.task.install.rpm:Package version is 18.2.4-837.g7a853b17 2024-09-10T17:44:40.011 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/flavors/default/ 2024-09-10T17:44:40.012 INFO:teuthology.task.install.rpm:Package version is 18.2.4-837.g7a853b17 2024-09-10T17:44:40.101 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T17:44:40.101 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:44:40.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T17:44:40.132 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest, python3-pytest, python3-pytest on remote rpm x86_64 2024-09-10T17:44:40.133 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T17:44:40.133 INFO:teuthology.packaging:ref: None 2024-09-10T17:44:40.133 INFO:teuthology.packaging:tag: None 2024-09-10T17:44:40.133 INFO:teuthology.packaging:branch: reef 2024-09-10T17:44:40.133 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:44:40.133 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T17:44:40.138 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T17:44:40.138 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:44:40.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T17:44:40.172 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest, python3-pytest, python3-pytest, python3-pytest on remote rpm x86_64 2024-09-10T17:44:40.172 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T17:44:40.172 INFO:teuthology.packaging:ref: None 2024-09-10T17:44:40.172 INFO:teuthology.packaging:tag: None 2024-09-10T17:44:40.172 INFO:teuthology.packaging:branch: reef 2024-09-10T17:44:40.172 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:44:40.172 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T17:44:40.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T17:44:40.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T17:44:40.280 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T17:44:40.322 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T17:44:40.347 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-09-10T17:44:40.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-09-10T17:44:40.388 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-09-10T17:44:40.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-09-10T17:44:40.586 INFO:teuthology.orchestra.run.smithi012.stdout:45 files removed 2024-09-10T17:44:40.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest python3-pytest python3-pytest python3-pytest 2024-09-10T17:44:40.621 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-09-10T17:44:40.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest python3-pytest python3-pytest python3-pytest 2024-09-10T17:44:41.216 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 256 kB/s | 77 kB 00:00 2024-09-10T17:44:41.242 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 252 kB/s | 77 kB 00:00 2024-09-10T17:44:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 42 kB/s | 11 kB 00:00 2024-09-10T17:44:41.550 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-09-10T17:44:41.842 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 6.9 kB/s | 1.9 kB 00:00 2024-09-10T17:44:41.851 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 7.1 kB/s | 1.9 kB 00:00 2024-09-10T17:44:42.526 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-10T17:44:44.750 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-10T17:44:48.244 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-10T17:44:53.628 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-10T17:44:55.004 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 114 kB/s | 19 kB 00:00 2024-09-10T17:44:55.900 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-10T17:45:01.298 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-10T17:45:03.648 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T17:45:03.649 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T17:45:03.713 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-10T17:45:03.719 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.2.4-837.g7a853b17.el9 ceph 6.5 k 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.2.4-837.g7a853b17.el9 ceph 5.1 M 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.2.4-837.g7a853b17.el9 ceph 853 k 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-837.g7a853b17.el9 ceph 143 k 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.2.4-837.g7a853b17.el9 ceph 1.5 M 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 139 k 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 3.5 M 2024-09-10T17:45:03.720 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 7.4 M 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 49 k 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.2.4-837.g7a853b17.el9 ceph 7.7 M 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.2.4-837.g7a853b17.el9 ceph 40 M 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 226 k 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.2.4-837.g7a853b17.el9 ceph 31 k 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 712 k 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.2.4-837.g7a853b17.el9 ceph 127 k 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.2.4-837.g7a853b17.el9 ceph 161 k 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.2.4-837.g7a853b17.el9 ceph 319 k 2024-09-10T17:45:03.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.2.4-837.g7a853b17.el9 ceph 300 k 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.2.4-837.g7a853b17.el9 ceph 99 k 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.2.4-837.g7a853b17.el9 ceph 87 k 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.2.4-837.g7a853b17.el9 ceph 3.0 M 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.2.4-837.g7a853b17.el9 ceph 172 k 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 3.3 M 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 3.0 M 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.2.4-837.g7a853b17.el9 ceph 18 M 2024-09-10T17:45:03.722 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 24 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.2.4-837.g7a853b17.el9 ceph 2.1 M 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 246 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.2.4-837.g7a853b17.el9 ceph 4.7 M 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.2.4-837.g7a853b17.el9 ceph 17 M 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 16 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.2.4-837.g7a853b17.el9 ceph 25 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T17:45:03.723 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.2.4-837.g7a853b17.el9 ceph 166 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 477 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 4.5 M 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T17:45:03.724 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.2.4-837.g7a853b17.el9 ceph 45 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.2.4-837.g7a853b17.el9 ceph 129 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T17:45:03.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T17:45:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2024-09-10T17:45:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T17:45:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T17:45:03.729 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T17:45:03.730 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T17:45:03.730 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:03.730 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-10T17:45:03.730 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-10T17:45:03.730 INFO:teuthology.orchestra.run.smithi089.stdout:Install 116 Packages 2024-09-10T17:45:03.730 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2024-09-10T17:45:03.730 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:03.730 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 179 M 2024-09-10T17:45:03.731 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-10T17:45:04.216 INFO:teuthology.orchestra.run.smithi089.stdout:(1/118): ceph-18.2.4-837.g7a853b17.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-10T17:45:04.441 INFO:teuthology.orchestra.run.smithi089.stdout:(2/118): ceph-fuse-18.2.4-837.g7a853b17.el9.x86 3.7 MB/s | 853 kB 00:00 2024-09-10T17:45:04.516 INFO:teuthology.orchestra.run.smithi089.stdout:(3/118): ceph-base-18.2.4-837.g7a853b17.el9.x86 12 MB/s | 5.1 MB 00:00 2024-09-10T17:45:04.541 INFO:teuthology.orchestra.run.smithi089.stdout:(4/118): ceph-immutable-object-cache-18.2.4-837 1.4 MB/s | 143 kB 00:00 2024-09-10T17:45:04.617 INFO:teuthology.orchestra.run.smithi089.stdout:(5/118): ceph-mds-18.2.4-837.g7a853b17.el9.x86_ 21 MB/s | 2.1 MB 00:00 2024-09-10T17:45:04.751 INFO:teuthology.orchestra.run.smithi089.stdout:(6/118): ceph-mgr-18.2.4-837.g7a853b17.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-10T17:45:04.868 INFO:teuthology.orchestra.run.smithi089.stdout:(7/118): ceph-mon-18.2.4-837.g7a853b17.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-10T17:45:05.127 INFO:teuthology.orchestra.run.smithi089.stdout:(8/118): ceph-common-18.2.4-837.g7a853b17.el9.x 18 MB/s | 18 MB 00:01 2024-09-10T17:45:05.168 INFO:teuthology.orchestra.run.smithi089.stdout:(9/118): ceph-selinux-18.2.4-837.g7a853b17.el9. 609 kB/s | 25 kB 00:00 2024-09-10T17:45:05.294 INFO:teuthology.orchestra.run.smithi089.stdout:(10/118): ceph-radosgw-18.2.4-837.g7a853b17.el9 18 MB/s | 7.7 MB 00:00 2024-09-10T17:45:05.377 INFO:teuthology.orchestra.run.smithi089.stdout:(11/118): libcephfs-devel-18.2.4-837.g7a853b17. 373 kB/s | 31 kB 00:00 2024-09-10T17:45:05.494 INFO:teuthology.orchestra.run.smithi089.stdout:(12/118): libcephfs2-18.2.4-837.g7a853b17.el9.x 6.0 MB/s | 712 kB 00:00 2024-09-10T17:45:05.561 INFO:teuthology.orchestra.run.smithi089.stdout:(13/118): libcephsqlite-18.2.4-837.g7a853b17.el 2.4 MB/s | 166 kB 00:00 2024-09-10T17:45:05.605 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:19 2024-09-10T17:45:05.728 INFO:teuthology.orchestra.run.smithi089.stdout:(14/118): ceph-osd-18.2.4-837.g7a853b17.el9.x86 17 MB/s | 17 MB 00:00 2024-09-10T17:45:05.753 INFO:teuthology.orchestra.run.smithi089.stdout:(15/118): librados-devel-18.2.4-837.g7a853b17.e 660 kB/s | 127 kB 00:00 2024-09-10T17:45:05.779 INFO:teuthology.orchestra.run.smithi089.stdout:(16/118): libradosstriper1-18.2.4-837.g7a853b17 9.3 MB/s | 477 kB 00:00 2024-09-10T17:45:05.837 INFO:teuthology.orchestra.run.smithi089.stdout:(17/118): python3-ceph-argparse-18.2.4-837.g7a8 772 kB/s | 45 kB 00:00 2024-09-10T17:45:05.921 INFO:teuthology.orchestra.run.smithi089.stdout:(18/118): python3-ceph-common-18.2.4-837.g7a853 1.5 MB/s | 129 kB 00:00 2024-09-10T17:45:05.988 INFO:teuthology.orchestra.run.smithi089.stdout:(19/118): librgw2-18.2.4-837.g7a853b17.el9.x86_ 19 MB/s | 4.5 MB 00:00 2024-09-10T17:45:06.013 INFO:teuthology.orchestra.run.smithi089.stdout:(20/118): python3-cephfs-18.2.4-837.g7a853b17.e 1.7 MB/s | 161 kB 00:00 2024-09-10T17:45:06.038 INFO:teuthology.orchestra.run.smithi089.stdout:(21/118): python3-rados-18.2.4-837.g7a853b17.el 6.2 MB/s | 319 kB 00:00 2024-09-10T17:45:06.072 INFO:teuthology.orchestra.run.smithi089.stdout:(22/118): python3-rbd-18.2.4-837.g7a853b17.el9. 5.0 MB/s | 300 kB 00:00 2024-09-10T17:45:06.097 INFO:teuthology.orchestra.run.smithi089.stdout:(23/118): python3-rgw-18.2.4-837.g7a853b17.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T17:45:06.123 INFO:teuthology.orchestra.run.smithi089.stdout:(24/118): rbd-fuse-18.2.4-837.g7a853b17.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-10T17:45:06.182 INFO:teuthology.orchestra.run.smithi089.stdout:(25/118): rbd-nbd-18.2.4-837.g7a853b17.el9.x86_ 2.9 MB/s | 172 kB 00:00 2024-09-10T17:45:06.240 INFO:teuthology.orchestra.run.smithi089.stdout:(26/118): rbd-mirror-18.2.4-837.g7a853b17.el9.x 21 MB/s | 3.0 MB 00:00 2024-09-10T17:45:06.265 INFO:teuthology.orchestra.run.smithi089.stdout:(27/118): ceph-grafana-dashboards-18.2.4-837.g7 292 kB/s | 24 kB 00:00 2024-09-10T17:45:06.290 INFO:teuthology.orchestra.run.smithi089.stdout:(28/118): ceph-mgr-cephadm-18.2.4-837.g7a853b17 2.7 MB/s | 139 kB 00:00 2024-09-10T17:45:06.516 INFO:teuthology.orchestra.run.smithi089.stdout:(29/118): ceph-mgr-dashboard-18.2.4-837.g7a853b 14 MB/s | 3.5 MB 00:00 2024-09-10T17:45:06.667 INFO:teuthology.orchestra.run.smithi089.stdout:(30/118): ceph-mgr-diskprediction-local-18.2.4- 20 MB/s | 7.4 MB 00:00 2024-09-10T17:45:06.692 INFO:teuthology.orchestra.run.smithi089.stdout:(31/118): ceph-mgr-modules-core-18.2.4-837.g7a8 1.4 MB/s | 246 kB 00:00 2024-09-10T17:45:06.725 INFO:teuthology.orchestra.run.smithi089.stdout:(32/118): ceph-mgr-rook-18.2.4-837.g7a853b17.el 840 kB/s | 49 kB 00:00 2024-09-10T17:45:06.751 INFO:teuthology.orchestra.run.smithi089.stdout:(33/118): ceph-prometheus-alerts-18.2.4-837.g7a 279 kB/s | 16 kB 00:00 2024-09-10T17:45:06.776 INFO:teuthology.orchestra.run.smithi089.stdout:(34/118): cephadm-18.2.4-837.g7a853b17.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-10T17:45:07.193 INFO:teuthology.orchestra.run.smithi089.stdout:(35/118): ceph-test-18.2.4-837.g7a853b17.el9.x8 20 MB/s | 40 MB 00:02 2024-09-10T17:45:07.218 INFO:teuthology.orchestra.run.smithi089.stdout:(36/118): fuse-2.9.9-16.el9.x86_64.rpm 171 kB/s | 80 kB 00:00 2024-09-10T17:45:07.327 INFO:teuthology.orchestra.run.smithi089.stdout:(37/118): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-10T17:45:07.353 INFO:teuthology.orchestra.run.smithi089.stdout:(38/118): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-10T17:45:07.428 INFO:teuthology.orchestra.run.smithi089.stdout:(39/118): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-10T17:45:07.453 INFO:teuthology.orchestra.run.smithi089.stdout:(40/118): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-10T17:45:07.503 INFO:teuthology.orchestra.run.smithi089.stdout:(41/118): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-10T17:45:07.554 INFO:teuthology.orchestra.run.smithi089.stdout:(42/118): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-10T17:45:07.621 INFO:teuthology.orchestra.run.smithi089.stdout:(43/118): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-10T17:45:07.663 INFO:teuthology.orchestra.run.smithi089.stdout:(44/118): boost-program-options-1.75.0-8.el9.x8 985 kB/s | 107 kB 00:00 2024-09-10T17:45:07.688 INFO:teuthology.orchestra.run.smithi089.stdout:(45/118): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-10T17:45:07.730 INFO:teuthology.orchestra.run.smithi089.stdout:(46/118): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-10T17:45:07.780 INFO:teuthology.orchestra.run.smithi089.stdout:(47/118): python3-cryptography-36.0.1-4.el9.x86 2.7 MB/s | 1.2 MB 00:00 2024-09-10T17:45:07.822 INFO:teuthology.orchestra.run.smithi089.stdout:(48/118): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-10T17:45:07.906 INFO:teuthology.orchestra.run.smithi089.stdout:(49/118): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-10T17:45:07.931 INFO:teuthology.orchestra.run.smithi089.stdout:(50/118): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-10T17:45:07.965 INFO:teuthology.orchestra.run.smithi089.stdout:(51/118): openblas-0.3.26-2.el9.x86_64.rpm 1.1 MB/s | 38 kB 00:00 2024-09-10T17:45:08.007 INFO:teuthology.orchestra.run.smithi089.stdout:(52/118): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-10T17:45:08.048 INFO:teuthology.orchestra.run.smithi089.stdout:(53/118): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-10T17:45:08.307 INFO:teuthology.orchestra.run.smithi089.stdout:(54/118): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.6 MB/s | 3.0 MB 00:00 2024-09-10T17:45:08.391 INFO:teuthology.orchestra.run.smithi089.stdout:(55/118): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-10T17:45:08.441 INFO:teuthology.orchestra.run.smithi089.stdout:(56/118): python3-iniconfig-1.1.1-7.el9.noarch. 350 kB/s | 17 kB 00:00 2024-09-10T17:45:08.542 INFO:teuthology.orchestra.run.smithi089.stdout:(57/118): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-10T17:45:08.583 INFO:teuthology.orchestra.run.smithi089.stdout:(58/118): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-10T17:45:08.634 INFO:teuthology.orchestra.run.smithi089.stdout:(59/118): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-10T17:45:08.709 INFO:teuthology.orchestra.run.smithi089.stdout:(60/118): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-10T17:45:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:(61/118): python3-markupsafe-1.1.1-12.el9.x86_6 833 kB/s | 35 kB 00:00 2024-09-10T17:45:09.464 INFO:teuthology.orchestra.run.smithi089.stdout:(62/118): openblas-openmp-0.3.26-2.el9.x86_64.r 3.3 MB/s | 4.9 MB 00:01 2024-09-10T17:45:09.602 INFO:teuthology.orchestra.run.smithi089.stdout:(63/118): python3-babel-2.9.1-2.el9.noarch.rpm 3.8 MB/s | 6.0 MB 00:01 2024-09-10T17:45:09.627 INFO:teuthology.orchestra.run.smithi089.stdout:(64/118): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-10T17:45:09.669 INFO:teuthology.orchestra.run.smithi089.stdout:(65/118): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-10T17:45:09.694 INFO:teuthology.orchestra.run.smithi089.stdout:(66/118): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-10T17:45:09.720 INFO:teuthology.orchestra.run.smithi089.stdout:(67/118): python3-pluggy-0.13.1-7.el9.noarch.rp 821 kB/s | 41 kB 00:00 2024-09-10T17:45:09.745 INFO:teuthology.orchestra.run.smithi089.stdout:(68/118): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-10T17:45:09.812 INFO:teuthology.orchestra.run.smithi089.stdout:(69/118): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-10T17:45:09.904 INFO:teuthology.orchestra.run.smithi089.stdout:(70/118): python3-py-1.10.0-6.el9.noarch.rpm 2.5 MB/s | 477 kB 00:00 2024-09-10T17:45:09.946 INFO:teuthology.orchestra.run.smithi089.stdout:(71/118): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-10T17:45:09.988 INFO:teuthology.orchestra.run.smithi089.stdout:(72/118): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-10T17:45:10.030 INFO:teuthology.orchestra.run.smithi089.stdout:(73/118): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-10T17:45:10.122 INFO:teuthology.orchestra.run.smithi089.stdout:(74/118): python3-pytest-6.2.2-7.el9.noarch.rpm 2.3 MB/s | 519 kB 00:00 2024-09-10T17:45:10.164 INFO:teuthology.orchestra.run.smithi089.stdout:(75/118): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-10T17:45:10.264 INFO:teuthology.orchestra.run.smithi089.stdout:(76/118): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-10T17:45:10.323 INFO:teuthology.orchestra.run.smithi089.stdout:(77/118): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T17:45:10.406 INFO:teuthology.orchestra.run.smithi089.stdout:(78/118): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-09-10T17:45:10.440 INFO:teuthology.orchestra.run.smithi089.stdout:(79/118): fmt-8.1.1-5.el9.x86_64.rpm 947 kB/s | 111 kB 00:00 2024-09-10T17:45:10.490 INFO:teuthology.orchestra.run.smithi089.stdout:(80/118): gperftools-libs-2.9.1-2.el9.x86_64.rp 3.6 MB/s | 309 kB 00:00 2024-09-10T17:45:10.515 INFO:teuthology.orchestra.run.smithi089.stdout:(81/118): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T17:45:10.549 INFO:teuthology.orchestra.run.smithi089.stdout:(82/118): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T17:45:10.576 INFO:teuthology.orchestra.run.smithi089.stdout:(83/118): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T17:45:10.650 INFO:teuthology.orchestra.run.smithi089.stdout:(84/118): libarrow-9.0.0-11.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-10T17:45:10.692 INFO:teuthology.orchestra.run.smithi089.stdout:(85/118): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-10T17:45:10.709 INFO:teuthology.orchestra.run.smithi089.stdout:(86/118): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-09-10T17:45:10.726 INFO:teuthology.orchestra.run.smithi089.stdout:(87/118): python3-cachetools-4.2.4-1.el9.noarch 1.9 MB/s | 32 kB 00:00 2024-09-10T17:45:10.743 INFO:teuthology.orchestra.run.smithi089.stdout:(88/118): python3-certifi-2023.05.07-4.el9.noar 852 kB/s | 14 kB 00:00 2024-09-10T17:45:10.775 INFO:teuthology.orchestra.run.smithi089.stdout:(89/118): python3-asyncssh-2.13.2-5.el9.noarch. 4.3 MB/s | 548 kB 00:00 2024-09-10T17:45:10.800 INFO:teuthology.orchestra.run.smithi089.stdout:(90/118): python3-cheroot-8.6.0-4.el9.noarch.rp 3.0 MB/s | 172 kB 00:00 2024-09-10T17:45:10.825 INFO:teuthology.orchestra.run.smithi089.stdout:(91/118): python3-cherrypy-18.6.1-2.el9.noarch. 7.0 MB/s | 358 kB 00:00 2024-09-10T17:45:10.851 INFO:teuthology.orchestra.run.smithi089.stdout:(92/118): python3-google-auth-2.34.0-1.el9.noar 4.3 MB/s | 220 kB 00:00 2024-09-10T17:45:10.868 INFO:teuthology.orchestra.run.smithi089.stdout:(93/118): python3-jaraco-8.2.1-3.el9.noarch.rpm 254 kB/s | 11 kB 00:00 2024-09-10T17:45:10.884 INFO:teuthology.orchestra.run.smithi089.stdout:(94/118): python3-jaraco-classes-3.2.1-5.el9.no 525 kB/s | 18 kB 00:00 2024-09-10T17:45:10.902 INFO:teuthology.orchestra.run.smithi089.stdout:(95/118): python3-jaraco-collections-3.0.0-8.el 685 kB/s | 23 kB 00:00 2024-09-10T17:45:10.919 INFO:teuthology.orchestra.run.smithi089.stdout:(96/118): python3-jaraco-functools-3.5.0-2.el9. 574 kB/s | 19 kB 00:00 2024-09-10T17:45:10.944 INFO:teuthology.orchestra.run.smithi089.stdout:(97/118): python3-jaraco-text-3.2.0-6.el9.noarc 471 kB/s | 20 kB 00:00 2024-09-10T17:45:10.969 INFO:teuthology.orchestra.run.smithi089.stdout:(98/118): python3-logutils-0.3.5-21.el9.noarch. 1.8 MB/s | 46 kB 00:00 2024-09-10T17:45:10.995 INFO:teuthology.orchestra.run.smithi089.stdout:(99/118): python3-more-itertools-8.12.0-2.el9.n 3.1 MB/s | 79 kB 00:00 2024-09-10T17:45:11.020 INFO:teuthology.orchestra.run.smithi089.stdout:(100/118): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T17:45:11.054 INFO:teuthology.orchestra.run.smithi089.stdout:(101/118): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-10T17:45:11.087 INFO:teuthology.orchestra.run.smithi089.stdout:(102/118): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-10T17:45:11.113 INFO:teuthology.orchestra.run.smithi089.stdout:(103/118): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-10T17:45:11.138 INFO:teuthology.orchestra.run.smithi089.stdout:(104/118): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T17:45:11.163 INFO:teuthology.orchestra.run.smithi089.stdout:(105/118): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-10T17:45:11.189 INFO:teuthology.orchestra.run.smithi089.stdout:(106/118): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T17:45:11.189 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-10T17:45:11.214 INFO:teuthology.orchestra.run.smithi089.stdout:(107/118): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T17:45:11.239 INFO:teuthology.orchestra.run.smithi089.stdout:(108/118): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-10T17:45:11.265 INFO:teuthology.orchestra.run.smithi089.stdout:(109/118): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T17:45:11.290 INFO:teuthology.orchestra.run.smithi089.stdout:(110/118): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T17:45:11.315 INFO:teuthology.orchestra.run.smithi089.stdout:(111/118): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T17:45:11.332 INFO:teuthology.orchestra.run.smithi089.stdout:(112/118): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-10T17:45:11.366 INFO:teuthology.orchestra.run.smithi089.stdout:(113/118): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-10T17:45:11.391 INFO:teuthology.orchestra.run.smithi089.stdout:(114/118): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-10T17:45:11.442 INFO:teuthology.orchestra.run.smithi089.stdout:(115/118): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T17:45:11.642 INFO:teuthology.orchestra.run.smithi089.stdout:(116/118): librados2-18.2.4-837.g7a853b17.el9.x 13 MB/s | 3.3 MB 00:00 2024-09-10T17:45:11.717 INFO:teuthology.orchestra.run.smithi089.stdout:(117/118): librbd1-18.2.4-837.g7a853b17.el9.x86 11 MB/s | 3.0 MB 00:00 2024-09-10T17:45:12.673 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-10T17:45:13.860 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-10T17:45:13.976 INFO:teuthology.orchestra.run.smithi089.stdout:(118/118): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-09-10T17:45:13.981 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-10T17:45:13.981 INFO:teuthology.orchestra.run.smithi089.stdout:Total 17 MB/s | 179 MB 00:10 2024-09-10T17:45:14.741 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-10T17:45:14.839 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-10T17:45:14.840 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-10T17:45:16.445 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-10T17:45:16.445 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-10T17:45:19.533 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T17:45:21.151 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-10T17:45:21.219 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/120 2024-09-10T17:45:21.245 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/120 2024-09-10T17:45:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/120 2024-09-10T17:45:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/120 2024-09-10T17:45:21.765 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.2.4-837.g7a853b17.el9.x86_64 5/120 2024-09-10T17:45:21.890 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.2.4-837.g7a853b17.el9.x86_64 5/120 2024-09-10T17:45:21.923 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.2.4-837.g7a853b17.el9.x86_64 6/120 2024-09-10T17:45:21.967 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T17:45:21.968 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T17:45:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.2.4-837.g7a853b17.el9.x86_64 6/120 2024-09-10T17:45:22.037 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:18.2.4-837.g7a853b17.el9 ceph 6.5 k 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:18.2.4-837.g7a853b17.el9 ceph 5.1 M 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:18.2.4-837.g7a853b17.el9 ceph 853 k 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-837.g7a853b17.el9 ceph 143 k 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:18.2.4-837.g7a853b17.el9 ceph 1.5 M 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 139 k 2024-09-10T17:45:22.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 3.5 M 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 7.4 M 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 49 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:18.2.4-837.g7a853b17.el9 ceph 7.7 M 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:18.2.4-837.g7a853b17.el9 ceph 40 M 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 226 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:18.2.4-837.g7a853b17.el9 ceph 31 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 712 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:18.2.4-837.g7a853b17.el9 ceph 127 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:18.2.4-837.g7a853b17.el9 ceph 161 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:18.2.4-837.g7a853b17.el9 ceph 319 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:18.2.4-837.g7a853b17.el9 ceph 300 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:18.2.4-837.g7a853b17.el9 ceph 99 k 2024-09-10T17:45:22.046 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:18.2.4-837.g7a853b17.el9 ceph 87 k 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:18.2.4-837.g7a853b17.el9 ceph 3.0 M 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:18.2.4-837.g7a853b17.el9 ceph 172 k 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 3.3 M 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 3.0 M 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:18.2.4-837.g7a853b17.el9 ceph 18 M 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 24 k 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:18.2.4-837.g7a853b17.el9 ceph 2.1 M 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 246 k 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:18.2.4-837.g7a853b17.el9 ceph 4.7 M 2024-09-10T17:45:22.047 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:18.2.4-837.g7a853b17.el9 ceph 17 M 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:18.2.4-837.g7a853b17.el9 ceph-noarch 16 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:18.2.4-837.g7a853b17.el9 ceph 25 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:18.2.4-837.g7a853b17.el9 ceph 166 k 2024-09-10T17:45:22.048 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 477 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:18.2.4-837.g7a853b17.el9 ceph 4.5 M 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T17:45:22.049 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:18.2.4-837.g7a853b17.el9 ceph 45 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:18.2.4-837.g7a853b17.el9 ceph 129 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T17:45:22.050 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T17:45:22.051 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T17:45:22.052 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T17:45:22.053 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:45:22.054 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-10T17:45:22.055 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-10T17:45:22.055 INFO:teuthology.orchestra.run.smithi012.stdout:Install 116 Packages 2024-09-10T17:45:22.055 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 2 Packages 2024-09-10T17:45:22.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:45:22.055 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 179 M 2024-09-10T17:45:22.055 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-10T17:45:22.077 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.2.4-837.g7a853b17.el9.x86_64 7/120 2024-09-10T17:45:22.111 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/120 2024-09-10T17:45:22.148 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/120 2024-09-10T17:45:22.175 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.2.4-837.g7a853b17.el9.x86_64 10/120 2024-09-10T17:45:22.268 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.2.4-837.g7a853b17.el9.x86_64 10/120 2024-09-10T17:45:22.293 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.2.4-837.g7a853b17.el9.x86_ 11/120 2024-09-10T17:45:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.2.4-837.g7a853b17.el9.x86_ 11/120 2024-09-10T17:45:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/120 2024-09-10T17:45:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/120 2024-09-10T17:45:22.502 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/120 2024-09-10T17:45:22.525 INFO:teuthology.orchestra.run.smithi012.stdout:(1/118): ceph-18.2.4-837.g7a853b17.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-10T17:45:22.542 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/120 2024-09-10T17:45:22.606 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 16/120 2024-09-10T17:45:22.642 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 17/120 2024-09-10T17:45:22.669 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/120 2024-09-10T17:45:22.738 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 19/120 2024-09-10T17:45:22.742 INFO:teuthology.orchestra.run.smithi012.stdout:(2/118): ceph-fuse-18.2.4-837.g7a853b17.el9.x86 3.8 MB/s | 853 kB 00:00 2024-09-10T17:45:22.792 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 20/120 2024-09-10T17:45:22.825 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 21/120 2024-09-10T17:45:22.851 INFO:teuthology.orchestra.run.smithi012.stdout:(3/118): ceph-base-18.2.4-837.g7a853b17.el9.x86 11 MB/s | 5.1 MB 00:00 2024-09-10T17:45:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 22/120 2024-09-10T17:45:22.876 INFO:teuthology.orchestra.run.smithi012.stdout:(4/118): ceph-immutable-object-cache-18.2.4-837 1.0 MB/s | 143 kB 00:00 2024-09-10T17:45:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 23/120 2024-09-10T17:45:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.2.4-837.g7a853b17.el9 24/120 2024-09-10T17:45:22.951 INFO:teuthology.orchestra.run.smithi012.stdout:(5/118): ceph-mds-18.2.4-837.g7a853b17.el9.x86_ 21 MB/s | 2.1 MB 00:00 2024-09-10T17:45:23.019 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.2.4-837.g7a853b17.el9.x86_64 25/120 2024-09-10T17:45:23.026 INFO:teuthology.orchestra.run.smithi012.stdout:(6/118): ceph-mgr-18.2.4-837.g7a853b17.el9.x86_ 9.7 MB/s | 1.5 MB 00:00 2024-09-10T17:45:23.153 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/120 2024-09-10T17:45:23.213 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/120 2024-09-10T17:45:23.402 INFO:teuthology.orchestra.run.smithi012.stdout:(7/118): ceph-common-18.2.4-837.g7a853b17.el9.x 18 MB/s | 18 MB 00:01 2024-09-10T17:45:23.719 INFO:teuthology.orchestra.run.smithi012.stdout:(8/118): ceph-radosgw-18.2.4-837.g7a853b17.el9. 24 MB/s | 7.7 MB 00:00 2024-09-10T17:45:23.744 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/120 2024-09-10T17:45:23.786 INFO:teuthology.orchestra.run.smithi012.stdout:(9/118): ceph-mon-18.2.4-837.g7a853b17.el9.x86_ 5.6 MB/s | 4.7 MB 00:00 2024-09-10T17:45:23.802 INFO:teuthology.orchestra.run.smithi012.stdout:(10/118): ceph-selinux-18.2.4-837.g7a853b17.el9 301 kB/s | 25 kB 00:00 2024-09-10T17:45:23.826 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/120 2024-09-10T17:45:23.844 INFO:teuthology.orchestra.run.smithi012.stdout:(11/118): libcephfs-devel-18.2.4-837.g7a853b17. 748 kB/s | 31 kB 00:00 2024-09-10T17:45:23.864 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 30/120 2024-09-10T17:45:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 31/120 2024-09-10T17:45:23.933 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 32/120 2024-09-10T17:45:23.944 INFO:teuthology.orchestra.run.smithi012.stdout:(12/118): libcephfs2-18.2.4-837.g7a853b17.el9.x 7.0 MB/s | 712 kB 00:00 2024-09-10T17:45:23.976 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 33/120 2024-09-10T17:45:24.013 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.2.4-837.g7a853b17.el9.x86_64 34/120 2024-09-10T17:45:24.043 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 35/120 2024-09-10T17:45:24.078 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 36/120 2024-09-10T17:45:24.120 INFO:teuthology.orchestra.run.smithi012.stdout:(13/118): ceph-osd-18.2.4-837.g7a853b17.el9.x86 15 MB/s | 17 MB 00:01 2024-09-10T17:45:24.145 INFO:teuthology.orchestra.run.smithi012.stdout:(14/118): libcephsqlite-18.2.4-837.g7a853b17.el 830 kB/s | 166 kB 00:00 2024-09-10T17:45:24.170 INFO:teuthology.orchestra.run.smithi012.stdout:(15/118): librados-devel-18.2.4-837.g7a853b17.e 2.5 MB/s | 127 kB 00:00 2024-09-10T17:45:24.185 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-20.el9.x86_64 37/120 2024-09-10T17:45:24.204 INFO:teuthology.orchestra.run.smithi012.stdout:(16/118): libradosstriper1-18.2.4-837.g7a853b17 8.0 MB/s | 477 kB 00:00 2024-09-10T17:45:24.223 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 38/120 2024-09-10T17:45:24.254 INFO:teuthology.orchestra.run.smithi012.stdout:(17/118): python3-ceph-argparse-18.2.4-837.g7a8 899 kB/s | 45 kB 00:00 2024-09-10T17:45:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:(18/118): librgw2-18.2.4-837.g7a853b17.el9.x86_ 22 MB/s | 4.5 MB 00:00 2024-09-10T17:45:24.397 INFO:teuthology.orchestra.run.smithi012.stdout:(19/118): python3-ceph-common-18.2.4-837.g7a853 909 kB/s | 129 kB 00:00 2024-09-10T17:45:24.422 INFO:teuthology.orchestra.run.smithi012.stdout:(20/118): python3-cephfs-18.2.4-837.g7a853b17.e 3.1 MB/s | 161 kB 00:00 2024-09-10T17:45:24.447 INFO:teuthology.orchestra.run.smithi012.stdout:(21/118): python3-rados-18.2.4-837.g7a853b17.el 6.2 MB/s | 319 kB 00:00 2024-09-10T17:45:24.454 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/120 2024-09-10T17:45:24.472 INFO:teuthology.orchestra.run.smithi012.stdout:(22/118): python3-rbd-18.2.4-837.g7a853b17.el9. 5.8 MB/s | 300 kB 00:00 2024-09-10T17:45:24.506 INFO:teuthology.orchestra.run.smithi012.stdout:(23/118): python3-rgw-18.2.4-837.g7a853b17.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T17:45:24.527 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/120 2024-09-10T17:45:24.531 INFO:teuthology.orchestra.run.smithi012.stdout:(24/118): rbd-fuse-18.2.4-837.g7a853b17.el9.x86 1.4 MB/s | 87 kB 00:00 2024-09-10T17:45:24.558 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 41/120 2024-09-10T17:45:24.594 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 42/120 2024-09-10T17:45:24.640 INFO:teuthology.orchestra.run.smithi012.stdout:(25/118): rbd-mirror-18.2.4-837.g7a853b17.el9.x 22 MB/s | 3.0 MB 00:00 2024-09-10T17:45:24.641 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/120 2024-09-10T17:45:24.665 INFO:teuthology.orchestra.run.smithi012.stdout:(26/118): rbd-nbd-18.2.4-837.g7a853b17.el9.x86_ 1.3 MB/s | 172 kB 00:00 2024-09-10T17:45:24.686 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/120 2024-09-10T17:45:24.690 INFO:teuthology.orchestra.run.smithi012.stdout:(27/118): ceph-grafana-dashboards-18.2.4-837.g7 486 kB/s | 24 kB 00:00 2024-09-10T17:45:24.716 INFO:teuthology.orchestra.run.smithi012.stdout:(28/118): ceph-mgr-cephadm-18.2.4-837.g7a853b17 2.7 MB/s | 139 kB 00:00 2024-09-10T17:45:24.728 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/120 2024-09-10T17:45:24.849 INFO:teuthology.orchestra.run.smithi012.stdout:(29/118): ceph-mgr-dashboard-18.2.4-837.g7a853b 22 MB/s | 3.5 MB 00:00 2024-09-10T17:45:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/120 2024-09-10T17:45:24.908 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/120 2024-09-10T17:45:24.925 INFO:teuthology.orchestra.run.smithi012.stdout:(30/118): ceph-mgr-modules-core-18.2.4-837.g7a8 3.2 MB/s | 246 kB 00:00 2024-09-10T17:45:24.946 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 48/120 2024-09-10T17:45:25.049 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/120 2024-09-10T17:45:25.067 INFO:teuthology.orchestra.run.smithi012.stdout:(31/118): ceph-mgr-diskprediction-local-18.2.4- 21 MB/s | 7.4 MB 00:00 2024-09-10T17:45:25.089 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 50/120 2024-09-10T17:45:25.092 INFO:teuthology.orchestra.run.smithi012.stdout:(32/118): ceph-mgr-rook-18.2.4-837.g7a853b17.el 296 kB/s | 49 kB 00:00 2024-09-10T17:45:25.117 INFO:teuthology.orchestra.run.smithi012.stdout:(33/118): ceph-prometheus-alerts-18.2.4-837.g7a 329 kB/s | 16 kB 00:00 2024-09-10T17:45:25.132 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/120 2024-09-10T17:45:25.143 INFO:teuthology.orchestra.run.smithi012.stdout:(34/118): cephadm-18.2.4-837.g7a853b17.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-10T17:45:25.171 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/120 2024-09-10T17:45:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 53/120 2024-09-10T17:45:25.239 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/120 2024-09-10T17:45:25.268 INFO:teuthology.orchestra.run.smithi012.stdout:(35/118): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-10T17:45:25.279 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 55/120 2024-09-10T17:45:25.310 INFO:teuthology.orchestra.run.smithi012.stdout:(36/118): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-10T17:45:25.360 INFO:teuthology.orchestra.run.smithi012.stdout:(37/118): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-10T17:45:25.401 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 56/120 2024-09-10T17:45:25.437 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-py-1.10.0-6.el9.noarch 57/120 2024-09-10T17:45:25.476 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 58/120 2024-09-10T17:45:25.518 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 59/120 2024-09-10T17:45:25.616 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-packaging-20.9-5.el9.noarch 60/120 2024-09-10T17:45:25.682 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 61/120 2024-09-10T17:45:25.729 INFO:teuthology.orchestra.run.smithi012.stdout:(38/118): ceph-test-18.2.4-837.g7a853b17.el9.x8 20 MB/s | 40 MB 00:01 2024-09-10T17:45:25.761 INFO:teuthology.orchestra.run.smithi012.stdout:(39/118): python3-cffi-1.14.5-5.el9.x86_64.rpm 562 kB/s | 253 kB 00:00 2024-09-10T17:45:25.803 INFO:teuthology.orchestra.run.smithi012.stdout:(40/118): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-09-10T17:45:25.845 INFO:teuthology.orchestra.run.smithi012.stdout:(41/118): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-10T17:45:25.886 INFO:teuthology.orchestra.run.smithi012.stdout:(42/118): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-10T17:45:25.912 INFO:teuthology.orchestra.run.smithi012.stdout:(43/118): python3-ply-3.11-14.el9.noarch.rpm 579 kB/s | 106 kB 00:00 2024-09-10T17:45:25.945 INFO:teuthology.orchestra.run.smithi012.stdout:(44/118): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-10T17:45:26.037 INFO:teuthology.orchestra.run.smithi012.stdout:(45/118): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-10T17:45:26.087 INFO:teuthology.orchestra.run.smithi012.stdout:(46/118): boost-program-options-1.75.0-8.el9.x8 532 kB/s | 107 kB 00:00 2024-09-10T17:45:26.104 INFO:teuthology.orchestra.run.smithi012.stdout:(47/118): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-10T17:45:26.188 INFO:teuthology.orchestra.run.smithi012.stdout:(48/118): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-10T17:45:26.205 INFO:teuthology.orchestra.run.smithi012.stdout:(49/118): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-10T17:45:26.322 INFO:teuthology.orchestra.run.smithi012.stdout:(50/118): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-10T17:45:26.372 INFO:teuthology.orchestra.run.smithi012.stdout:(51/118): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-10T17:45:26.400 INFO:teuthology.orchestra.run.smithi012.stdout:(52/118): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-10T17:45:26.409 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 62/120 2024-09-10T17:45:26.454 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 63/120 2024-09-10T17:45:26.456 INFO:teuthology.orchestra.run.smithi012.stdout:(53/118): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T17:45:26.488 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 64/120 2024-09-10T17:45:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 65/120 2024-09-10T17:45:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 66/120 2024-09-10T17:45:26.680 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 67/120 2024-09-10T17:45:26.715 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 68/120 2024-09-10T17:45:26.902 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.26-2.el9.x86_64 69/120 2024-09-10T17:45:26.934 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 70/120 2024-09-10T17:45:27.012 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/120 2024-09-10T17:45:27.040 INFO:teuthology.orchestra.run.smithi012.stdout:(54/118): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-09-10T17:45:27.215 INFO:teuthology.orchestra.run.smithi012.stdout:(55/118): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-10T17:45:27.282 INFO:teuthology.orchestra.run.smithi012.stdout:(56/118): python3-iniconfig-1.1.1-7.el9.noarch. 263 kB/s | 17 kB 00:00 2024-09-10T17:45:27.424 INFO:teuthology.orchestra.run.smithi012.stdout:(57/118): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-10T17:45:27.474 INFO:teuthology.orchestra.run.smithi012.stdout:(58/118): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-10T17:45:27.524 INFO:teuthology.orchestra.run.smithi012.stdout:(59/118): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-10T17:45:27.650 INFO:teuthology.orchestra.run.smithi012.stdout:(60/118): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T17:45:27.668 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/120 2024-09-10T17:45:27.700 INFO:teuthology.orchestra.run.smithi012.stdout:(61/118): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-10T17:45:27.781 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/120 2024-09-10T17:45:28.026 INFO:teuthology.orchestra.run.smithi012.stdout:(62/118): openblas-openmp-0.3.26-2.el9.x86_64.r 3.0 MB/s | 4.9 MB 00:01 2024-09-10T17:45:28.092 INFO:teuthology.orchestra.run.smithi012.stdout:(63/118): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-10T17:45:28.243 INFO:teuthology.orchestra.run.smithi012.stdout:(64/118): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-10T17:45:28.326 INFO:teuthology.orchestra.run.smithi012.stdout:(65/118): python3-packaging-20.9-5.el9.noarch.r 928 kB/s | 77 kB 00:00 2024-09-10T17:45:28.376 INFO:teuthology.orchestra.run.smithi012.stdout:(66/118): python3-pluggy-0.13.1-7.el9.noarch.rp 831 kB/s | 41 kB 00:00 2024-09-10T17:45:28.427 INFO:teuthology.orchestra.run.smithi012.stdout:(67/118): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-10T17:45:28.702 INFO:teuthology.orchestra.run.smithi012.stdout:(68/118): python3-babel-2.9.1-2.el9.noarch.rpm 2.7 MB/s | 6.0 MB 00:02 2024-09-10T17:45:28.727 INFO:teuthology.orchestra.run.smithi012.stdout:(69/118): python3-py-1.10.0-6.el9.noarch.rpm 1.6 MB/s | 477 kB 00:00 2024-09-10T17:45:28.819 INFO:teuthology.orchestra.run.smithi012.stdout:(70/118): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-10T17:45:28.911 INFO:teuthology.orchestra.run.smithi012.stdout:(71/118): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-10T17:45:28.962 INFO:teuthology.orchestra.run.smithi012.stdout:(72/118): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T17:45:29.012 INFO:teuthology.orchestra.run.smithi012.stdout:(73/118): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T17:45:29.072 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/120 2024-09-10T17:45:29.162 INFO:teuthology.orchestra.run.smithi012.stdout:(74/118): python3-pytest-6.2.2-7.el9.noarch.rpm 1.5 MB/s | 519 kB 00:00 2024-09-10T17:45:29.165 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/120 2024-09-10T17:45:29.229 INFO:teuthology.orchestra.run.smithi012.stdout:(75/118): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-09-10T17:45:29.467 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 76/120 2024-09-10T17:45:29.502 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.2.4-837.g7a853b17.el9.x86_64 77/120 2024-09-10T17:45:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:(76/118): socat-1.7.4.1-6.el9.x86_64.rpm 1.0 MB/s | 304 kB 00:00 2024-09-10T17:45:29.593 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.2.4-837.g7a853b17.el9.x86_64 77/120 2024-09-10T17:45:29.624 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.2.4-837.g7a853b17.el9.x86_64 78/120 2024-09-10T17:45:29.655 INFO:teuthology.orchestra.run.smithi012.stdout:(77/118): xmlstarlet-1.6.1-20.el9.x86_64.rpm 478 kB/s | 64 kB 00:00 2024-09-10T17:45:29.660 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 79/120 2024-09-10T17:45:29.705 INFO:teuthology.orchestra.run.smithi012.stdout:(78/118): fmt-8.1.1-5.el9.x86_64.rpm 2.2 MB/s | 111 kB 00:00 2024-09-10T17:45:29.781 INFO:teuthology.orchestra.run.smithi012.stdout:(79/118): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.5 MB/s | 5.1 MB 00:02 2024-09-10T17:45:29.814 INFO:teuthology.orchestra.run.smithi012.stdout:(80/118): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.8 MB/s | 309 kB 00:00 2024-09-10T17:45:29.848 INFO:teuthology.orchestra.run.smithi012.stdout:(81/118): libarrow-doc-9.0.0-11.el9.noarch.rpm 830 kB/s | 26 kB 00:00 2024-09-10T17:45:29.873 INFO:teuthology.orchestra.run.smithi012.stdout:(82/118): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T17:45:29.898 INFO:teuthology.orchestra.run.smithi012.stdout:(83/118): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T17:45:29.948 INFO:teuthology.orchestra.run.smithi012.stdout:(84/118): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T17:45:29.999 INFO:teuthology.orchestra.run.smithi012.stdout:(85/118): python3-asyncssh-2.13.2-5.el9.noarch. 11 MB/s | 548 kB 00:00 2024-09-10T17:45:30.025 INFO:teuthology.orchestra.run.smithi012.stdout:(86/118): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-10T17:45:30.049 INFO:teuthology.orchestra.run.smithi012.stdout:(87/118): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-09-10T17:45:30.069 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 80/120 2024-09-10T17:45:30.074 INFO:teuthology.orchestra.run.smithi012.stdout:(88/118): python3-certifi-2023.05.07-4.el9.noar 568 kB/s | 14 kB 00:00 2024-09-10T17:45:30.097 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.2.4-837.g7a853b17.el9.x86_64 81/120 2024-09-10T17:45:30.100 INFO:teuthology.orchestra.run.smithi012.stdout:(89/118): python3-cheroot-8.6.0-4.el9.noarch.rp 6.7 MB/s | 172 kB 00:00 2024-09-10T17:45:30.134 INFO:teuthology.orchestra.run.smithi012.stdout:(90/118): python3-cherrypy-18.6.1-2.el9.noarch. 11 MB/s | 358 kB 00:00 2024-09-10T17:45:30.167 INFO:teuthology.orchestra.run.smithi012.stdout:(91/118): python3-google-auth-2.34.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-09-10T17:45:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.2.4-837.g7a853b17.el9.x86_64 81/120 2024-09-10T17:45:30.185 INFO:teuthology.orchestra.run.smithi012.stdout:(92/118): python3-jaraco-8.2.1-3.el9.noarch.rpm 649 kB/s | 11 kB 00:00 2024-09-10T17:45:30.201 INFO:teuthology.orchestra.run.smithi012.stdout:(93/118): python3-jaraco-classes-3.2.1-5.el9.no 1.0 MB/s | 18 kB 00:00 2024-09-10T17:45:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.2.4-837.g7a853b17.el9.x86_64 82/120 2024-09-10T17:45:30.218 INFO:teuthology.orchestra.run.smithi012.stdout:(94/118): python3-jaraco-collections-3.0.0-8.el 1.4 MB/s | 23 kB 00:00 2024-09-10T17:45:30.235 INFO:teuthology.orchestra.run.smithi012.stdout:(95/118): python3-jaraco-functools-3.5.0-2.el9. 1.1 MB/s | 19 kB 00:00 2024-09-10T17:45:30.252 INFO:teuthology.orchestra.run.smithi012.stdout:(96/118): python3-jaraco-text-3.2.0-6.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-10T17:45:30.259 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/120 2024-09-10T17:45:30.323 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/120 2024-09-10T17:45:30.327 INFO:teuthology.orchestra.run.smithi012.stdout:(97/118): libarrow-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-09-10T17:45:30.353 INFO:teuthology.orchestra.run.smithi012.stdout:(98/118): python3-logutils-0.3.5-21.el9.noarch. 1.8 MB/s | 46 kB 00:00 2024-09-10T17:45:30.378 INFO:teuthology.orchestra.run.smithi012.stdout:(99/118): python3-more-itertools-8.12.0-2.el9.n 3.1 MB/s | 79 kB 00:00 2024-09-10T17:45:30.403 INFO:teuthology.orchestra.run.smithi012.stdout:(100/118): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T17:45:30.437 INFO:teuthology.orchestra.run.smithi012.stdout:(101/118): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-10T17:45:30.462 INFO:teuthology.orchestra.run.smithi012.stdout:(102/118): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-10T17:45:30.487 INFO:teuthology.orchestra.run.smithi012.stdout:(103/118): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-10T17:45:30.507 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/120 2024-09-10T17:45:30.513 INFO:teuthology.orchestra.run.smithi012.stdout:(104/118): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T17:45:30.538 INFO:teuthology.orchestra.run.smithi012.stdout:(105/118): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-10T17:45:30.564 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/120 2024-09-10T17:45:30.573 INFO:teuthology.orchestra.run.smithi012.stdout:(106/118): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-10T17:45:30.597 INFO:teuthology.orchestra.run.smithi012.stdout:(107/118): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-10T17:45:30.622 INFO:teuthology.orchestra.run.smithi012.stdout:(108/118): python3-tempora-5.0.0-2.el9.noarch.r 729 kB/s | 36 kB 00:00 2024-09-10T17:45:30.634 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/120 2024-09-10T17:45:30.648 INFO:teuthology.orchestra.run.smithi012.stdout:(109/118): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T17:45:30.673 INFO:teuthology.orchestra.run.smithi012.stdout:(110/118): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T17:45:30.707 INFO:teuthology.orchestra.run.smithi012.stdout:(111/118): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-10T17:45:30.723 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 88/120 2024-09-10T17:45:30.732 INFO:teuthology.orchestra.run.smithi012.stdout:(112/118): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-09-10T17:45:30.757 INFO:teuthology.orchestra.run.smithi012.stdout:(113/118): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-10T17:45:30.783 INFO:teuthology.orchestra.run.smithi012.stdout:(114/118): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-10T17:45:30.833 INFO:teuthology.orchestra.run.smithi012.stdout:(115/118): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T17:45:30.880 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 89/120 2024-09-10T17:45:30.924 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 90/120 2024-09-10T17:45:30.979 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 91/120 2024-09-10T17:45:31.008 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 92/120 2024-09-10T17:45:31.025 INFO:teuthology.orchestra.run.smithi012.stdout:(116/118): librados2-18.2.4-837.g7a853b17.el9.x 14 MB/s | 3.3 MB 00:00 2024-09-10T17:45:31.117 INFO:teuthology.orchestra.run.smithi012.stdout:(117/118): librbd1-18.2.4-837.g7a853b17.el9.x86 11 MB/s | 3.0 MB 00:00 2024-09-10T17:45:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.2.4-837.g7a853b17.el9.noarch 93/120 2024-09-10T17:45:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.2.4-837.g7a853b17.el9.noarch 93/120 2024-09-10T17:45:31.490 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-837.g7a853b17.el 94/120 2024-09-10T17:45:31.577 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-837.g7a853b17.e 95/120 2024-09-10T17:45:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.2.4-837.g7a853b17.el9.x 96/120 2024-09-10T17:45:32.784 INFO:teuthology.orchestra.run.smithi012.stdout:(118/118): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.3 MB/s | 16 MB 00:03 2024-09-10T17:45:32.789 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-10T17:45:32.789 INFO:teuthology.orchestra.run.smithi012.stdout:Total 17 MB/s | 179 MB 00:10 2024-09-10T17:45:33.547 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-10T17:45:33.653 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-10T17:45:33.654 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-10T17:45:33.676 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 97/120 2024-09-10T17:45:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 97/120 2024-09-10T17:45:34.273 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 97/120 2024-09-10T17:45:34.318 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.2.4-837.g7a853b17.el9.x86_64 98/120 2024-09-10T17:45:34.418 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.2.4-837.g7a853b17.el9.x86_64 98/120 2024-09-10T17:45:34.418 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T17:45:34.418 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T17:45:34.418 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:34.479 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.2.4-837.g7a853b17.el9.x86_64 99/120 2024-09-10T17:45:35.371 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-10T17:45:35.372 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-10T17:45:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-10T17:45:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/120 2024-09-10T17:45:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/120 2024-09-10T17:45:40.248 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/120 2024-09-10T17:45:40.589 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/120 2024-09-10T17:45:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:18.2.4-837.g7a853b17.el9.x86_64 5/120 2024-09-10T17:45:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:18.2.4-837.g7a853b17.el9.x86_64 5/120 2024-09-10T17:45:40.829 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:18.2.4-837.g7a853b17.el9.x86_64 6/120 2024-09-10T17:45:40.905 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:18.2.4-837.g7a853b17.el9.x86_64 6/120 2024-09-10T17:45:40.954 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:18.2.4-837.g7a853b17.el9.x86_64 7/120 2024-09-10T17:45:40.984 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/120 2024-09-10T17:45:41.022 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/120 2024-09-10T17:45:41.049 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:18.2.4-837.g7a853b17.el9.x86_64 10/120 2024-09-10T17:45:41.135 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:18.2.4-837.g7a853b17.el9.x86_64 10/120 2024-09-10T17:45:41.158 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:18.2.4-837.g7a853b17.el9.x86_ 11/120 2024-09-10T17:45:41.289 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:18.2.4-837.g7a853b17.el9.x86_ 11/120 2024-09-10T17:45:41.321 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/120 2024-09-10T17:45:41.354 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/120 2024-09-10T17:45:41.391 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/120 2024-09-10T17:45:41.432 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/120 2024-09-10T17:45:41.517 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 16/120 2024-09-10T17:45:41.559 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 17/120 2024-09-10T17:45:41.592 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/120 2024-09-10T17:45:41.664 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 19/120 2024-09-10T17:45:41.717 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 20/120 2024-09-10T17:45:41.754 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 21/120 2024-09-10T17:45:41.797 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 22/120 2024-09-10T17:45:41.840 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 23/120 2024-09-10T17:45:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:18.2.4-837.g7a853b17.el9 24/120 2024-09-10T17:45:41.971 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:18.2.4-837.g7a853b17.el9.x86_64 25/120 2024-09-10T17:45:42.117 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/120 2024-09-10T17:45:42.179 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/120 2024-09-10T17:45:42.896 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/120 2024-09-10T17:45:42.993 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/120 2024-09-10T17:45:43.037 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 30/120 2024-09-10T17:45:43.070 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 31/120 2024-09-10T17:45:43.105 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 32/120 2024-09-10T17:45:43.162 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 33/120 2024-09-10T17:45:43.209 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:18.2.4-837.g7a853b17.el9.x86_64 34/120 2024-09-10T17:45:43.264 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 35/120 2024-09-10T17:45:43.299 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 36/120 2024-09-10T17:45:43.410 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-20.el9.x86_64 37/120 2024-09-10T17:45:43.444 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 38/120 2024-09-10T17:45:43.501 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/120 2024-09-10T17:45:43.574 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/120 2024-09-10T17:45:43.612 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 41/120 2024-09-10T17:45:43.648 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 42/120 2024-09-10T17:45:43.704 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/120 2024-09-10T17:45:43.749 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/120 2024-09-10T17:45:43.791 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/120 2024-09-10T17:45:43.936 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/120 2024-09-10T17:45:43.975 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/120 2024-09-10T17:45:44.017 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 48/120 2024-09-10T17:45:44.125 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/120 2024-09-10T17:45:44.167 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 50/120 2024-09-10T17:45:44.217 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/120 2024-09-10T17:45:44.257 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/120 2024-09-10T17:45:44.284 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 53/120 2024-09-10T17:45:44.321 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/120 2024-09-10T17:45:44.366 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 55/120 2024-09-10T17:45:44.496 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 56/120 2024-09-10T17:45:44.532 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-py-1.10.0-6.el9.noarch 57/120 2024-09-10T17:45:44.571 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 58/120 2024-09-10T17:45:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 59/120 2024-09-10T17:45:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 60/120 2024-09-10T17:45:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 61/120 2024-09-10T17:45:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 62/120 2024-09-10T17:45:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 63/120 2024-09-10T17:45:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 64/120 2024-09-10T17:45:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 65/120 2024-09-10T17:45:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 66/120 2024-09-10T17:45:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 67/120 2024-09-10T17:45:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 68/120 2024-09-10T17:45:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.26-2.el9.x86_64 69/120 2024-09-10T17:45:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 70/120 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.2.4-837.g7a853b17.el9.x86_64 99/120 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-09-10T17:45:46.177 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/120 2024-09-10T17:45:46.251 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-837.g7a853b17.el9.noar 100/120 2024-09-10T17:45:46.928 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/120 2024-09-10T17:45:47.054 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/120 2024-09-10T17:45:47.339 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-837.g7a853b17.el9.noar 100/120 2024-09-10T17:45:47.390 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-837.g7a853b17.el9.no 101/120 2024-09-10T17:45:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-837.g7a853b17.el9.no 101/120 2024-09-10T17:45:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-837.g7a85 102/120 2024-09-10T17:45:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/120 2024-09-10T17:45:48.482 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-837.g7a85 102/120 2024-09-10T17:45:48.515 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/120 2024-09-10T17:45:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-837.g7a853b17.el9 103/120 2024-09-10T17:45:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.2.4-837.g7a853b17.el9.x86_64 104/120 2024-09-10T17:45:48.690 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.2.4-837.g7a853b17.el9.x86_64 104/120 2024-09-10T17:45:48.691 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:45:48.691 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T17:45:48.691 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T17:45:48.691 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T17:45:48.691 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.2.4-837.g7a853b17.el9.noarch 105/120 2024-09-10T17:45:48.830 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 76/120 2024-09-10T17:45:48.868 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:18.2.4-837.g7a853b17.el9.x86_64 77/120 2024-09-10T17:45:48.921 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-837.g7a853b17.el9.noarch 105/120 2024-09-10T17:45:48.943 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.2.4-837.g7a853b17.el9.x86_64 106/120 2024-09-10T17:45:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:18.2.4-837.g7a853b17.el9.x86_64 77/120 2024-09-10T17:45:48.967 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.2.4-837.g7a853b17.el9.x86_64 106/120 2024-09-10T17:45:48.967 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:45:48.968 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T17:45:48.968 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T17:45:48.968 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T17:45:48.968 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:18.2.4-837.g7a853b17.el9.x86_64 78/120 2024-09-10T17:45:49.034 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 79/120 2024-09-10T17:45:49.419 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.2.4-837.g7a853b17.el9.x86_64 107/120 2024-09-10T17:45:49.443 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.2.4-837.g7a853b17.el9.x86_64 107/120 2024-09-10T17:45:49.443 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:45:49.443 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T17:45:49.443 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T17:45:49.443 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T17:45:49.443 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 80/120 2024-09-10T17:45:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:18.2.4-837.g7a853b17.el9.x86_64 81/120 2024-09-10T17:45:49.567 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:18.2.4-837.g7a853b17.el9.x86_64 81/120 2024-09-10T17:45:49.618 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:18.2.4-837.g7a853b17.el9.x86_64 82/120 2024-09-10T17:45:49.685 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/120 2024-09-10T17:45:49.749 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/120 2024-09-10T17:45:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/120 2024-09-10T17:45:49.997 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/120 2024-09-10T17:45:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/120 2024-09-10T17:45:50.185 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 88/120 2024-09-10T17:45:50.329 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 89/120 2024-09-10T17:45:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 90/120 2024-09-10T17:45:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 91/120 2024-09-10T17:45:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-16.el9.x86_64 92/120 2024-09-10T17:45:50.854 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.2.4-837.g7a853b17.el9.x86_64 108/120 2024-09-10T17:45:50.880 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.2.4-837.g7a853b17.el9.x86_64 108/120 2024-09-10T17:45:50.880 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:45:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T17:45:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T17:45:50.881 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T17:45:50.881 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:50.884 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:18.2.4-837.g7a853b17.el9.noarch 93/120 2024-09-10T17:45:50.913 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:18.2.4-837.g7a853b17.el9.noarch 93/120 2024-09-10T17:45:50.944 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-837.g7a853b17.el 94/120 2024-09-10T17:45:51.023 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-837.g7a853b17.e 95/120 2024-09-10T17:45:51.046 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:18.2.4-837.g7a853b17.el9.x 96/120 2024-09-10T17:45:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.2.4-837.g7a853b17.el9.x86_64 109/120 2024-09-10T17:45:51.613 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.2.4-837.g7a853b17.el9.x86_64 110/120 2024-09-10T17:45:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-837.g7a853b17.el9.x86_64 110/120 2024-09-10T17:45:51.637 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:45:51.637 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T17:45:51.637 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T17:45:51.637 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T17:45:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-837.g7a853b 111/120 2024-09-10T17:45:51.704 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-837.g7a853b 111/120 2024-09-10T17:45:51.704 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:45:51.704 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T17:45:51.704 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:51.998 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.2.4-837.g7a853b17.el9.x86_64 112/120 2024-09-10T17:45:52.021 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.2.4-837.g7a853b17.el9.x86_64 112/120 2024-09-10T17:45:52.022 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:45:52.022 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T17:45:52.022 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T17:45:52.022 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T17:45:52.022 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:45:53.197 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 97/120 2024-09-10T17:45:53.226 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 97/120 2024-09-10T17:45:53.794 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 97/120 2024-09-10T17:45:53.837 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:18.2.4-837.g7a853b17.el9.x86_64 98/120 2024-09-10T17:45:53.930 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:18.2.4-837.g7a853b17.el9.x86_64 98/120 2024-09-10T17:45:53.930 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T17:45:53.930 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T17:45:53.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:45:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:18.2.4-837.g7a853b17.el9.x86_64 99/120 2024-09-10T17:45:55.765 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.2.4-837.g7a853b17.el9.x86_64 113/120 2024-09-10T17:45:55.811 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 114/120 2024-09-10T17:45:55.852 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 115/120 2024-09-10T17:45:55.970 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.2.4-837.g7a853b17.el9.x86_64 116/120 2024-09-10T17:45:56.002 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 117/120 2024-09-10T17:45:56.041 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.2.4-837.g7a853b17.el9.x86_6 118/120 2024-09-10T17:45:56.041 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 119/120 2024-09-10T17:45:56.125 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 119/120 2024-09-10T17:45:56.125 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 120/120 2024-09-10T17:46:00.841 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 120/120 2024-09-10T17:46:00.841 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.2.4-837.g7a853b17.el9.x86_64 1/120 2024-09-10T17:46:00.841 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.2.4-837.g7a853b17.el9.x86_64 2/120 2024-09-10T17:46:00.841 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 3/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 4/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-837.g7a853b 5/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.2.4-837.g7a853b17.el9.x86_64 6/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.2.4-837.g7a853b17.el9.x86_64 7/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.2.4-837.g7a853b17.el9.x86_64 8/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.2.4-837.g7a853b17.el9.x86_64 9/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.2.4-837.g7a853b17.el9.x86_64 10/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.2.4-837.g7a853b17.el9.x86_64 11/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.2.4-837.g7a853b17.el9.x86_64 12/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.2.4-837.g7a853b17.el9.x86_6 13/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.2.4-837.g7a853b17.el9.x86_64 14/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.2.4-837.g7a853b17.el9.x86_64 15/120 2024-09-10T17:46:00.842 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.2.4-837.g7a853b17.el9.x86_64 16/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.2.4-837.g7a853b17.el9.x86_ 17/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.2.4-837.g7a853b17.el9.x86_64 18/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.2.4-837.g7a853b17.el9 19/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.2.4-837.g7a853b17.el9.x 20/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.2.4-837.g7a853b17.el9.x86_64 21/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.2.4-837.g7a853b17.el9.x86_64 22/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.2.4-837.g7a853b17.el9.x86_64 23/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.2.4-837.g7a853b17.el9.x86_64 24/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 25/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.2.4-837.g7a853b17.el9.x86_64 26/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.2.4-837.g7a853b17.el9.x86_64 27/120 2024-09-10T17:46:00.843 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-837.g7a853b17.e 28/120 2024-09-10T17:46:00.844 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-837.g7a853b17.el9.noar 29/120 2024-09-10T17:46:00.844 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-837.g7a853b17.el9.no 30/120 2024-09-10T17:46:00.851 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-837.g7a85 31/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-837.g7a853b17.el9 32/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.2.4-837.g7a853b17.el9.noarch 33/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-837.g7a853b17.el 34/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.2.4-837.g7a853b17.el9.noarch 35/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 36/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 37/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 38/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 39/120 2024-09-10T17:46:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 40/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 41/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 42/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 43/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 44/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 45/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 46/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 47/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 48/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/120 2024-09-10T17:46:00.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 53/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 54/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 55/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 56/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 57/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 58/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 59/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 60/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 61/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 62/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 63/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 64/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 65/120 2024-09-10T17:46:00.854 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 66/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 67/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 68/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 70/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 73/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 74/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 76/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 77/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 78/120 2024-09-10T17:46:00.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 79/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 80/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 81/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 82/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 83/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 84/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 85/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 86/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 87/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 88/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 89/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 90/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 91/120 2024-09-10T17:46:00.856 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 92/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 93/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 94/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 95/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 96/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 97/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 98/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 99/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 100/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 101/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 102/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 103/120 2024-09-10T17:46:00.857 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 104/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 105/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 106/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 107/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 108/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 109/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 110/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 111/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 112/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 113/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 114/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-20.el9.x86_64 115/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 116/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.2.4-837.g7a853b17.el9.x86_64 117/120 2024-09-10T17:46:00.858 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 118/120 2024-09-10T17:46:00.859 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.2.4-837.g7a853b17.el9.x86_64 119/120 2024-09-10T17:46:02.841 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 120/120 2024-09-10T17:46:02.841 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:46:02.841 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-09-10T17:46:02.841 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.841 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.841 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-10T17:46:02.841 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:02.842 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T17:46:02.843 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.844 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T17:46:02.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T17:46:02.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T17:46:02.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T17:46:02.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T17:46:02.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T17:46:02.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T17:46:02.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T17:46:02.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T17:46:02.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pluggy-0.13.1-7.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-py-1.10.0-6.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T17:46:02.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytest-6.2.2-7.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T17:46:02.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T17:46:02.850 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.851 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.851 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:02.851 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T17:46:02.851 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T17:46:02.851 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T17:46:02.851 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T17:46:02.851 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:46:02.851 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-10T17:46:03.191 DEBUG:teuthology.parallel:result is None 2024-09-10T17:46:05.839 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:18.2.4-837.g7a853b17.el9.x86_64 99/120 2024-09-10T17:46:05.840 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-09-10T17:46:05.840 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-09-10T17:46:05.840 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-09-10T17:46:05.840 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-09-10T17:46:05.840 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-09-10T17:46:05.840 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-09-10T17:46:05.840 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-09-10T17:46:05.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:05.921 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-837.g7a853b17.el9.noar 100/120 2024-09-10T17:46:07.050 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-837.g7a853b17.el9.noar 100/120 2024-09-10T17:46:07.094 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-837.g7a853b17.el9.no 101/120 2024-09-10T17:46:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-837.g7a853b17.el9.no 101/120 2024-09-10T17:46:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-837.g7a85 102/120 2024-09-10T17:46:08.251 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-837.g7a85 102/120 2024-09-10T17:46:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-837.g7a853b17.el9 103/120 2024-09-10T17:46:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:18.2.4-837.g7a853b17.el9.x86_64 104/120 2024-09-10T17:46:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:18.2.4-837.g7a853b17.el9.x86_64 104/120 2024-09-10T17:46:08.472 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:46:08.472 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T17:46:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T17:46:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T17:46:08.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:08.530 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:18.2.4-837.g7a853b17.el9.noarch 105/120 2024-09-10T17:46:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-837.g7a853b17.el9.noarch 105/120 2024-09-10T17:46:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:18.2.4-837.g7a853b17.el9.x86_64 106/120 2024-09-10T17:46:08.780 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:18.2.4-837.g7a853b17.el9.x86_64 106/120 2024-09-10T17:46:08.780 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:46:08.780 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T17:46:08.780 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T17:46:08.780 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T17:46:08.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:18.2.4-837.g7a853b17.el9.x86_64 107/120 2024-09-10T17:46:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:18.2.4-837.g7a853b17.el9.x86_64 107/120 2024-09-10T17:46:09.264 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:46:09.264 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T17:46:09.264 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T17:46:09.264 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T17:46:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:18.2.4-837.g7a853b17.el9.x86_64 108/120 2024-09-10T17:46:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:18.2.4-837.g7a853b17.el9.x86_64 108/120 2024-09-10T17:46:10.785 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:46:10.785 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T17:46:10.785 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T17:46:10.785 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T17:46:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:18.2.4-837.g7a853b17.el9.x86_64 109/120 2024-09-10T17:46:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:18.2.4-837.g7a853b17.el9.x86_64 110/120 2024-09-10T17:46:11.583 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-837.g7a853b17.el9.x86_64 110/120 2024-09-10T17:46:11.583 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:46:11.584 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T17:46:11.584 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T17:46:11.584 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T17:46:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-837.g7a853b 111/120 2024-09-10T17:46:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-837.g7a853b 111/120 2024-09-10T17:46:11.649 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:46:11.649 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T17:46:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:18.2.4-837.g7a853b17.el9.x86_64 112/120 2024-09-10T17:46:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:18.2.4-837.g7a853b17.el9.x86_64 112/120 2024-09-10T17:46:11.984 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T17:46:11.984 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T17:46:11.984 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T17:46:11.984 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T17:46:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:15.955 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:18.2.4-837.g7a853b17.el9.x86_64 113/120 2024-09-10T17:46:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 114/120 2024-09-10T17:46:16.029 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 115/120 2024-09-10T17:46:16.153 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:18.2.4-837.g7a853b17.el9.x86_64 116/120 2024-09-10T17:46:16.203 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 117/120 2024-09-10T17:46:16.234 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:18.2.4-837.g7a853b17.el9.x86_6 118/120 2024-09-10T17:46:16.234 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 119/120 2024-09-10T17:46:16.326 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 119/120 2024-09-10T17:46:16.326 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 120/120 2024-09-10T17:46:21.328 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 120/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:18.2.4-837.g7a853b17.el9.x86_64 1/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:18.2.4-837.g7a853b17.el9.x86_64 2/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 3/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 4/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-837.g7a853b 5/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:18.2.4-837.g7a853b17.el9.x86_64 6/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:18.2.4-837.g7a853b17.el9.x86_64 7/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:18.2.4-837.g7a853b17.el9.x86_64 8/120 2024-09-10T17:46:21.329 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:18.2.4-837.g7a853b17.el9.x86_64 9/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:18.2.4-837.g7a853b17.el9.x86_64 10/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:18.2.4-837.g7a853b17.el9.x86_64 11/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:18.2.4-837.g7a853b17.el9.x86_64 12/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:18.2.4-837.g7a853b17.el9.x86_6 13/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:18.2.4-837.g7a853b17.el9.x86_64 14/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:18.2.4-837.g7a853b17.el9.x86_64 15/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:18.2.4-837.g7a853b17.el9.x86_64 16/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:18.2.4-837.g7a853b17.el9.x86_ 17/120 2024-09-10T17:46:21.330 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:18.2.4-837.g7a853b17.el9.x86_64 18/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:18.2.4-837.g7a853b17.el9 19/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:18.2.4-837.g7a853b17.el9.x 20/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:18.2.4-837.g7a853b17.el9.x86_64 21/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:18.2.4-837.g7a853b17.el9.x86_64 22/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:18.2.4-837.g7a853b17.el9.x86_64 23/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:18.2.4-837.g7a853b17.el9.x86_64 24/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 25/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:18.2.4-837.g7a853b17.el9.x86_64 26/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:18.2.4-837.g7a853b17.el9.x86_64 27/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-837.g7a853b17.e 28/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-837.g7a853b17.el9.noar 29/120 2024-09-10T17:46:21.331 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-837.g7a853b17.el9.no 30/120 2024-09-10T17:46:21.339 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-837.g7a85 31/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-837.g7a853b17.el9 32/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:18.2.4-837.g7a853b17.el9.noarch 33/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-837.g7a853b17.el 34/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:18.2.4-837.g7a853b17.el9.noarch 35/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 36/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 37/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 38/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 39/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 40/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 41/120 2024-09-10T17:46:21.340 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 42/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 43/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 44/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 45/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 46/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 47/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 48/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 53/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 54/120 2024-09-10T17:46:21.341 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 55/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 56/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 57/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 58/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 59/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 60/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 61/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 62/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 63/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 64/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 65/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 66/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 67/120 2024-09-10T17:46:21.342 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 68/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 70/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 73/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 74/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 76/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 77/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 78/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 79/120 2024-09-10T17:46:21.343 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 80/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 81/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 82/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 83/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 84/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 85/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 86/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 87/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 88/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 89/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 90/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 91/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 92/120 2024-09-10T17:46:21.344 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 93/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 94/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 95/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 96/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 97/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 98/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 99/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 100/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 101/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 102/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 103/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 104/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 105/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 106/120 2024-09-10T17:46:21.345 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 107/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 108/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 109/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 110/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 111/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 112/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 113/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 114/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-20.el9.x86_64 115/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 116/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:18.2.4-837.g7a853b17.el9.x86_64 117/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 118/120 2024-09-10T17:46:21.346 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:18.2.4-837.g7a853b17.el9.x86_64 119/120 2024-09-10T17:46:23.549 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 120/120 2024-09-10T17:46:23.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:23.549 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-09-10T17:46:23.549 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.549 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.549 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:23.550 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:18.2.4-837.g7a853b17.el9.noarch 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T17:46:23.551 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T17:46:23.552 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T17:46:23.553 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T17:46:23.554 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T17:46:23.555 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pluggy-0.13.1-7.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T17:46:23.556 INFO:teuthology.orchestra.run.smithi012.stdout: python3-py-1.10.0-6.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytest-6.2.2-7.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.557 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T17:46:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.559 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.559 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:18.2.4-837.g7a853b17.el9.x86_64 2024-09-10T17:46:23.559 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T17:46:23.559 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T17:46:23.559 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T17:46:23.559 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T17:46:23.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:46:23.559 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-10T17:46:24.023 DEBUG:teuthology.parallel:result is None 2024-09-10T17:46:24.024 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T17:46:24.024 INFO:teuthology.packaging:ref: None 2024-09-10T17:46:24.024 INFO:teuthology.packaging:tag: None 2024-09-10T17:46:24.024 INFO:teuthology.packaging:branch: reef 2024-09-10T17:46:24.024 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:46:24.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-10T17:46:24.290 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T17:46:24.314 INFO:teuthology.orchestra.run.smithi012.stdout:18.2.4-837.g7a853b17.el9 2024-09-10T17:46:24.315 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-837.g7a853b17.el9 2024-09-10T17:46:24.315 INFO:teuthology.task.install:The correct ceph version 18.2.4-837.g7a853b17 is installed. 2024-09-10T17:46:24.317 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T17:46:24.317 INFO:teuthology.packaging:ref: None 2024-09-10T17:46:24.317 INFO:teuthology.packaging:tag: None 2024-09-10T17:46:24.317 INFO:teuthology.packaging:branch: reef 2024-09-10T17:46:24.317 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:46:24.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-10T17:46:24.578 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T17:46:24.604 INFO:teuthology.orchestra.run.smithi089.stdout:18.2.4-837.g7a853b17.el9 2024-09-10T17:46:24.605 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-837.g7a853b17.el9 2024-09-10T17:46:24.605 INFO:teuthology.task.install:The correct ceph version 18.2.4-837.g7a853b17 is installed. 2024-09-10T17:46:24.606 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T17:46:24.607 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:46:24.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T17:46:24.638 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:46:24.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T17:46:24.677 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T17:46:24.678 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:46:24.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T17:46:24.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T17:46:24.775 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:46:24.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T17:46:24.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T17:46:24.873 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T17:46:24.873 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:46:24.873 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T17:46:24.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T17:46:24.969 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:46:24.969 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T17:46:24.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T17:46:25.064 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T17:46:25.065 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:46:25.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T17:46:25.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T17:46:25.162 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:46:25.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T17:46:25.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T17:46:25.255 INFO:teuthology.run_tasks:Running task print... 2024-09-10T17:46:25.266 INFO:teuthology.task.print:**** done install task... 2024-09-10T17:46:25.266 INFO:teuthology.run_tasks:Running task print... 2024-09-10T17:46:25.291 INFO:teuthology.task.print:**** done start installing reef cephadm ... 2024-09-10T17:46:25.292 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T17:46:25.411 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'create_rbd_pool': True, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'mons down', 'mon down', 'MON_DOWN', 'out of quorum', 'PG_AVAILABILITY'], 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'} 2024-09-10T17:46:25.412 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-09-10T17:46:25.412 INFO:tasks.cephadm:Cluster fsid is 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:46:25.412 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T17:46:25.413 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.12', 'mon.c': '[v2:172.21.15.12:3301,v1:172.21.15.12:6790]', 'mon.b': '172.21.15.89'} 2024-09-10T17:46:25.413 INFO:tasks.cephadm:First mon is mon.a on smithi012 2024-09-10T17:46:25.413 INFO:tasks.cephadm:First mgr is y 2024-09-10T17:46:25.413 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T17:46:25.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname $(hostname -s) 2024-09-10T17:46:25.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname $(hostname -s) 2024-09-10T17:46:25.472 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-10T17:46:25.472 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:46:25.614 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82944/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4858-gbad1f558', 'node_name': '172.21.5.32+adami02', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4858.gbad1f558'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 11:29:05.146106', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-bharath7-testing-2024-09-10-1409', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T17:46:25.876 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 7a853b1706d076d58e0da7a5d3b9b9eb36276880 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-10T17:46:25.877 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/x86_64/flavors/default/cephadm 2024-09-10T17:46:25.877 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/x86_64/flavors/default/cephadm 2024-09-10T17:46:25.877 DEBUG:teuthology.orchestra.run.smithi012:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T17:46:26.230 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-r--r--. 1 ubuntu ubuntu 217225 Sep 10 17:46 /home/ubuntu/cephtest/cephadm 2024-09-10T17:46:26.231 DEBUG:teuthology.orchestra.run.smithi089:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T17:46:26.588 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r--. 1 ubuntu ubuntu 217225 Sep 10 17:46 /home/ubuntu/cephtest/cephadm 2024-09-10T17:46:26.588 DEBUG:teuthology.orchestra.run.smithi012:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T17:46:26.609 DEBUG:teuthology.orchestra.run.smithi089:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T17:46:26.642 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-09-10T17:46:26.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-10T17:46:26.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-10T17:46:28.208 INFO:teuthology.orchestra.run.smithi089.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-10T17:46:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-10T17:46:54.914 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:46:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)", 2024-09-10T17:46:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "image_id": "f21ba1eea74eff81ce08338578ea11be73add5627252ff4d00500aa0d1abdd33", 2024-09-10T17:46:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "repo_digests": [ 2024-09-10T17:46:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6" 2024-09-10T17:46:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T17:46:54.915 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:46:56.837 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-10T17:46:56.837 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)", 2024-09-10T17:46:56.837 INFO:teuthology.orchestra.run.smithi089.stdout: "image_id": "f21ba1eea74eff81ce08338578ea11be73add5627252ff4d00500aa0d1abdd33", 2024-09-10T17:46:56.837 INFO:teuthology.orchestra.run.smithi089.stdout: "repo_digests": [ 2024-09-10T17:46:56.837 INFO:teuthology.orchestra.run.smithi089.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6" 2024-09-10T17:46:56.837 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-10T17:46:56.838 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-10T17:46:56.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph 2024-09-10T17:46:56.892 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph 2024-09-10T17:46:56.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /etc/ceph 2024-09-10T17:46:56.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /etc/ceph 2024-09-10T17:46:56.988 INFO:tasks.cephadm:Writing seed config... 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T17:46:56.990 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T17:46:56.991 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:46:56.991 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T17:46:57.021 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9996668a-6f9c-11ef-bcea-c7b262605968 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-10T17:46:57.021 DEBUG:teuthology.orchestra.run.smithi012:mon.a> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T17:46:57.064 DEBUG:teuthology.orchestra.run.smithi012:mgr.y> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T17:46:57.108 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T17:46:57.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.12 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T17:46:57.270 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-10T17:46:57.270 INFO:teuthology.orchestra.run.smithi012.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', '9996668a-6f9c-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.12', '--skip-admin-label'] 2024-09-10T17:46:57.295 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-10T17:46:57.295 INFO:teuthology.orchestra.run.smithi012.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T17:46:57.295 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying podman|docker is present... 2024-09-10T17:46:57.318 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-10T17:46:57.319 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying lvm2 is present... 2024-09-10T17:46:57.319 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying time synchronization is in place... 2024-09-10T17:46:57.326 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T17:46:57.326 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T17:46:57.333 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T17:46:57.333 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-10T17:46:57.340 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-09-10T17:46:57.346 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-09-10T17:46:57.347 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-09-10T17:46:57.347 INFO:teuthology.orchestra.run.smithi012.stdout:Repeating the final host check... 2024-09-10T17:46:57.377 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-10T17:46:57.377 INFO:teuthology.orchestra.run.smithi012.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T17:46:57.378 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl is present 2024-09-10T17:46:57.378 INFO:teuthology.orchestra.run.smithi012.stdout:lvcreate is present 2024-09-10T17:46:57.384 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T17:46:57.384 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T17:46:57.390 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T17:46:57.390 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-10T17:46:57.397 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-09-10T17:46:57.404 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-09-10T17:46:57.404 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-09-10T17:46:57.404 INFO:teuthology.orchestra.run.smithi012.stdout:Host looks OK 2024-09-10T17:46:57.404 INFO:teuthology.orchestra.run.smithi012.stdout:Cluster fsid: 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:46:57.404 INFO:teuthology.orchestra.run.smithi012.stdout:Acquiring lock 140639434210896 on /run/cephadm/9996668a-6f9c-11ef-bcea-c7b262605968.lock 2024-09-10T17:46:57.404 INFO:teuthology.orchestra.run.smithi012.stdout:Lock 140639434210896 acquired on /run/cephadm/9996668a-6f9c-11ef-bcea-c7b262605968.lock 2024-09-10T17:46:57.405 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 3300 ... 2024-09-10T17:46:57.405 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 6789 ... 2024-09-10T17:46:57.405 INFO:teuthology.orchestra.run.smithi012.stdout:Base mon IP(s) is [172.21.15.12:3300, 172.21.15.12:6789], mon addrv is [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-10T17:46:57.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.12 metric 100 2024-09-10T17:46:57.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.12 metric 100 2024-09-10T17:46:57.410 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T17:46:57.410 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T17:46:57.411 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2024-09-10T17:46:57.413 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T17:46:57.413 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T17:46:57.413 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T17:46:57.413 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T17:46:57.413 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-10T17:46:57.414 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T17:46:57.414 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-09-10T17:46:57.414 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-09-10T17:46:57.415 INFO:teuthology.orchestra.run.smithi012.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T17:46:57.415 INFO:teuthology.orchestra.run.smithi012.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T17:46:57.415 INFO:teuthology.orchestra.run.smithi012.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-10T17:46:57.940 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout f21ba1eea74eff81ce08338578ea11be73add5627252ff4d00500aa0d1abdd33 2024-09-10T17:46:57.940 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-09-10T17:46:57.940 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T17:46:57.940 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:2e29467d85d75ffe686857d22f982df26a31cd0c5697869efe4e67bef781fa2e 2024-09-10T17:46:57.941 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T17:46:57.941 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying config sha256:f21ba1eea74eff81ce08338578ea11be73add5627252ff4d00500aa0d1abdd33 2024-09-10T17:46:57.941 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T17:46:58.795 INFO:teuthology.orchestra.run.smithi012.stdout:ceph: stdout ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable) 2024-09-10T17:46:58.795 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph version: ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable) 2024-09-10T17:46:58.795 INFO:teuthology.orchestra.run.smithi012.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T17:46:59.769 INFO:teuthology.orchestra.run.smithi012.stdout:stat: stdout 167 167 2024-09-10T17:46:59.770 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial keys... 2024-09-10T17:47:00.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQAUhuBmd5S1BBAAqX5kGlZEq+svTJvS20JDDQ== 2024-09-10T17:47:01.731 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQAVhuBm+HOIARAA9ZgCVPwZZydjJp1GeqLsvw== 2024-09-10T17:47:02.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQAWhuBm/MdsAxAA3sndBq7WLjDaYhzto6mZiw== 2024-09-10T17:47:02.672 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial monmap... 2024-09-10T17:47:03.577 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool for a [v2:172.21.15.12:3300,v1:172.21.15.12:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = pacific 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: set fsid to 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:47:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mon... 2024-09-10T17:47:04.493 INFO:teuthology.orchestra.run.smithi012.stdout:create mon.a on 2024-09-10T17:47:04.708 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T17:47:04.856 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T17:47:05.035 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9996668a-6f9c-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-9996668a-6f9c-11ef-bcea-c7b262605968.target. 2024-09-10T17:47:05.035 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-9996668a-6f9c-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-9996668a-6f9c-11ef-bcea-c7b262605968.target. 2024-09-10T17:47:05.261 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a 2024-09-10T17:47:05.261 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T17:47:05.437 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9996668a-6f9c-11ef-bcea-c7b262605968.target.wants/ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-9996668a-6f9c-11ef-bcea-c7b262605968@.service. 2024-09-10T17:47:05.977 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:05 smithi012 ceph-mon[26986]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T17:47:05.991 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T17:47:05.991 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-10T17:47:05.999 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T17:47:05.999 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-10T17:47:05.999 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-10T17:47:05.999 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T17:47:05.999 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon to start... 2024-09-10T17:47:05.999 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon... 2024-09-10T17:47:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:05 smithi012 bash[26966]: 9bff08341abb24f4db05de9483f1ecc567d8db367c120d693552cae73eaa17e5 2024-09-10T17:47:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:05 smithi012 systemd[1]: Started Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:47:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:06 smithi012 ceph-mon[26986]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T17:47:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:06 smithi012 ceph-mon[26986]: monmap e1: 1 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T17:47:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:06 smithi012 ceph-mon[26986]: fsmap 2024-09-10T17:47:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:06 smithi012 ceph-mon[26986]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T17:47:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:06 smithi012 ceph-mon[26986]: mgrmap e1: no daemons active 2024-09-10T17:47:08.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:07 smithi012 ceph-mon[26986]: from='client.? 172.21.15.12:0/4042604755' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T17:47:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T17:47:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout id: 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T17:47:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout services: 2024-09-10T17:47:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 1.54718s) 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout data: 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:mon is available 2024-09-10T17:47:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T17:47:17.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:16 smithi012 ceph-mon[26986]: from='client.? 172.21.15.12:0/3323838303' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T17:47:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:16 smithi012 ceph-mon[26986]: from='client.? 172.21.15.12:0/3323838303' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T17:47:19.076 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:19.077 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T17:47:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:19.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T17:47:19.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T17:47:19.079 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T17:47:19.079 INFO:teuthology.orchestra.run.smithi012.stdout:Generating new minimal ceph.conf... 2024-09-10T17:47:19.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:19 smithi012 ceph-mon[26986]: from='client.? 172.21.15.12:0/2206803625' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:47:20.140 INFO:teuthology.orchestra.run.smithi012.stdout:Restarting the monitor... 2024-09-10T17:47:20.458 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:20 smithi012 systemd[1]: Stopping Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:47:20.757 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:20 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a[26981]: 2024-09-10T17:47:20.456+0000 7f2a47487640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T17:47:20.758 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:20 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a[26981]: 2024-09-10T17:47:20.456+0000 7f2a47487640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T17:47:20.758 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:20 smithi012 podman[27226]: 2024-09-10 17:47:20.478237882 +0000 UTC m=+0.143631347 container died 9bff08341abb24f4db05de9483f1ecc567d8db367c120d693552cae73eaa17e5 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, RELEASE=reef-7a853b1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T17:47:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:20 smithi012 podman[27226]: 2024-09-10 17:47:20.856880609 +0000 UTC m=+0.522274074 container cleanup 9bff08341abb24f4db05de9483f1ecc567d8db367c120d693552cae73eaa17e5 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-7a853b1) 2024-09-10T17:47:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:20 smithi012 bash[27226]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a 2024-09-10T17:47:21.425 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 podman[27238]: 2024-09-10 17:47:21.082963587 +0000 UTC m=+0.601815227 container remove 9bff08341abb24f4db05de9483f1ecc567d8db367c120d693552cae73eaa17e5 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-7a853b1, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T17:47:21.426 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T17:47:21.426 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 systemd[1]: Stopped Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:47:21.426 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 systemd[1]: Starting Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 podman[27336]: 2024-09-10 17:47:21.327836298 +0000 UTC m=+0.016327493 image pull f21ba1eea74eff81ce08338578ea11be73add5627252ff4d00500aa0d1abdd33 quay.ceph.io/ceph-ci/ceph:reef 2024-09-10T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 podman[27336]: 2024-09-10 17:47:21.425544652 +0000 UTC m=+0.114035835 container create 2f6698e39d41ac16c2f5802996fc8754dec11b740f542cb1df21a63f848631ee (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=reef-7a853b1) 2024-09-10T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 podman[27336]: 2024-09-10 17:47:21.628187173 +0000 UTC m=+0.316678351 container init 2f6698e39d41ac16c2f5802996fc8754dec11b740f542cb1df21a63f848631ee (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-7a853b1, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 podman[27336]: 2024-09-10 17:47:21.631322118 +0000 UTC m=+0.319813297 container start 2f6698e39d41ac16c2f5802996fc8754dec11b740f542cb1df21a63f848631ee (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=reef-7a853b1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable), process ceph-mon, pid 2 2024-09-10T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: pidfile_write: ignore empty --pid-file 2024-09-10T17:47:21.704 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: load: jerasure load: lrc 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: RocksDB version: 7.9.2 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Git sha 0 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Compile date 2024-09-10 15:58:06 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: DB SUMMARY 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: DB Session ID: DPK6298AAQSON45E5UCW 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: CURRENT file: CURRENT 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 84841 ; 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.error_if_exists: 0 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.create_if_missing: 0 2024-09-10T17:47:21.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.paranoid_checks: 1 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.env: 0x55c0c3ff3bc0 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.info_log: 0x55c0c593ebe0 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.statistics: (nil) 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.use_fsync: 0 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_log_file_size: 0 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T17:47:21.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.allow_fallocate: 1 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.use_direct_reads: 0 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.db_log_dir: 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.wal_dir: 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T17:47:21.707 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.write_buffer_manager: 0x55c0c594c320 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T17:47:21.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.unordered_write: 0 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.row_cache: None 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.wal_filter: None 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T17:47:21.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.two_write_queues: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.wal_compression: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.atomic_flush: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.log_readahead_size: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T17:47:21.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_background_jobs: 2 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_background_compactions: -1 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_subcompactions: 1 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T17:47:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_open_files: -1 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_background_flushes: -1 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Compression algorithms supported: 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: kZSTD supported: 0 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: kXpressCompression supported: 0 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: kBZip2Compression supported: 0 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: kLZ4Compression supported: 1 2024-09-10T17:47:21.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: kZlibCompression supported: 1 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: kSnappyCompression supported: 1 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.merge_operator: 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_filter: None 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T17:47:21.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c0c593e7e0) 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks: 1 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_top_level_index_and_filter: 1 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_type: 0 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_index_type: 0 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_shortening: 1 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: checksum: 4 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: no_block_cache: 0 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache: 0x55c0c5933350 2024-09-10T17:47:21.715 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_name: BinnedLRUCache 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_options: 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: capacity : 536870912 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_shard_bits : 4 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: strict_capacity_limit : 0 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: high_pri_pool_ratio: 0.000 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_compressed: (nil) 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: persistent_cache: (nil) 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size: 4096 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size_deviation: 10 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_restart_interval: 16 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_block_restart_interval: 1 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: metadata_block_size: 4096 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: partition_filters: 0 2024-09-10T17:47:21.716 INFO:journalctl@ceph.mon.a.smithi012.stdout: use_delta_encoding: 1 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: filter_policy: bloomfilter 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: whole_key_filtering: 1 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: verify_compression: 0 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: read_amp_bytes_per_bit: 0 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: format_version: 5 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_index_compression: 1 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_align: 0 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_auto_readahead_size: 262144 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: prepopulate_block_cache: 0 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: initial_auto_readahead_size: 8192 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T17:47:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression: NoCompression 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.num_levels: 7 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T17:47:21.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:47:21.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T17:47:21.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T17:47:21.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T17:47:21.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T17:47:21.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.inplace_update_support: 0 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T17:47:21.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.bloom_locality: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.max_successive_merges: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.ttl: 2592000 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.enable_blob_files: false 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.min_blob_size: 0 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T17:47:21.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f6dd0c20-5756-43ac-ab02-f2077f36cbd9 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990441658113, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990441659010, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81243, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 262, "table_properties": {"data_size": 79393, "index_size": 234, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10297, "raw_average_key_size": 47, "raw_value_size": 73568, "raw_average_value_size": 339, "num_data_blocks": 10, "num_entries": 217, "num_filter_entries": 217, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725990441, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f6dd0c20-5756-43ac-ab02-f2077f36cbd9", "db_session_id": "DPK6298AAQSON45E5UCW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990441659109, "job": 1, "event": "recovery_finished"} 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T17:47:21.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c0c595ee00 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: DB pointer 0x55c0c5a52000 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** DB Stats ** 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:47:21.727 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: L0 2/0 81.20 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: Sum 2/0 81.20 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:47:21.728 INFO:journalctl@ceph.mon.a.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T17:47:21.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T17:47:21.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:47:21.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T17:47:21.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:47:21.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative compaction: 0.00 GB write, 25.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval compaction: 0.00 GB write, 25.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache BinnedLRUCache@0x55c0c5933350#2 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: starting mon.a rank 0 at public addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] at bind addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:21.730 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a@-1(???) e1 preinit fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a@-1(???).mds e1 new map 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a@-1(???).mds e1 print_map 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: e1 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: legacy client fscid: -1 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: No filesystems configured 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T17:47:21.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 bash[27336]: 2f6698e39d41ac16c2f5802996fc8754dec11b740f542cb1df21a63f848631ee 2024-09-10T17:47:21.732 INFO:teuthology.orchestra.run.smithi012.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T17:47:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 systemd[1]: Started Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:47:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T17:47:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: monmap e1: 1 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T17:47:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: fsmap 2024-09-10T17:47:22.015 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T17:47:22.016 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:21 smithi012 ceph-mon[27356]: mgrmap e1: no daemons active 2024-09-10T17:47:22.654 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T17:47:22.676 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T17:47:22.676 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mgr... 2024-09-10T17:47:22.677 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T17:47:22.677 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T17:47:22.921 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y 2024-09-10T17:47:22.921 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y.service: Unit ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y.service not loaded. 2024-09-10T17:47:23.074 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9996668a-6f9c-11ef-bcea-c7b262605968.target.wants/ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y.service → /etc/systemd/system/ceph-9996668a-6f9c-11ef-bcea-c7b262605968@.service. 2024-09-10T17:47:23.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:23 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1718852478' entity='client.admin' 2024-09-10T17:47:23.648 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:23 smithi012 podman[27570]: 2024-09-10 17:47:23.525225222 +0000 UTC m=+0.333078322 container start 46d8d80f1292be4db6e3e9158af6b5cf9102f014d6f2cadc85dcf384a9a010ce (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T17:47:23.649 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:23.646+0000 7f022249f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T17:47:23.931 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:23.704+0000 7f022249f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T17:47:23.932 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:23.861+0000 7f022249f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T17:47:23.932 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:23.929+0000 7f022249f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T17:47:23.962 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T17:47:23.962 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-10T17:47:23.970 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T17:47:23.970 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-10T17:47:23.970 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-10T17:47:23.970 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T17:47:23.979 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T17:47:23.979 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-10T17:47:23.987 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T17:47:23.987 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-10T17:47:23.987 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-10T17:47:23.987 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T17:47:23.987 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr to start... 2024-09-10T17:47:23.987 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr... 2024-09-10T17:47:24.237 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:23 smithi012 bash[27570]: 46d8d80f1292be4db6e3e9158af6b5cf9102f014d6f2cadc85dcf384a9a010ce 2024-09-10T17:47:24.237 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:23 smithi012 systemd[1]: Started Ceph mgr.y for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:47:24.237 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:24.088+0000 7f022249f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:47:24.237 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:24.235+0000 7f022249f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T17:47:24.827 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:24.567+0000 7f022249f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T17:47:24.827 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:24.630+0000 7f022249f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T17:47:25.173 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:24.825+0000 7f022249f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T17:47:25.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:25 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3040439578' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T17:47:25.852 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:25.780+0000 7f022249f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T17:47:25.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:25.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "9996668a-6f9c-11ef-bcea-c7b262605968", 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:25.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T17:47:25.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T17:47:25.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:25.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T17:47:25.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:25.957 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T17:47:05.902150+0000", 2024-09-10T17:47:25.957 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T17:47:25.957 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:25.957 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T17:47:25.957 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-10T17:47:25.957 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (1/15)... 2024-09-10T17:47:26.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:25.850+0000 7f022249f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T17:47:26.880 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:26 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:26.611+0000 7f022249f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T17:47:26.880 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:26 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:26.731+0000 7f022249f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T17:47:27.166 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:26 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:26.877+0000 7f022249f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:47:27.167 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:26 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:26.941+0000 7f022249f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T17:47:27.167 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.094+0000 7f022249f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T17:47:27.167 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.164+0000 7f022249f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T17:47:27.459 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.226+0000 7f022249f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T17:47:27.459 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.389+0000 7f022249f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T17:47:27.459 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.456+0000 7f022249f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T17:47:27.735 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.525+0000 7f022249f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T17:47:27.735 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.611+0000 7f022249f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T17:47:27.736 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.672+0000 7f022249f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T17:47:27.736 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:27.733+0000 7f022249f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T17:47:28.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:28 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1900332885' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T17:47:28.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:28 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:28.571+0000 7f022249f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T17:47:29.455 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:29.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-10T17:47:29.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "9996668a-6f9c-11ef-bcea-c7b262605968", 2024-09-10T17:47:29.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T17:47:29.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T17:47:29.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T17:47:29.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T17:47:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T17:47:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T17:47:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T17:47:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T17:47:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T17:47:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T17:47:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T17:47:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T17:47:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T17:47:05.902150+0000", 2024-09-10T17:47:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T17:47:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T17:47:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-10T17:47:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (2/15)... 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: Activating manager daemon y 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: mgrmap e2: y(active, starting, since 0.00299002s) 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: Manager daemon y is now available 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' 2024-09-10T17:47:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:47:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' 2024-09-10T17:47:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:29 smithi012 ceph-mon[27356]: from='mgr.14100 172.21.15.12:0/3446038059' entity='mgr.y' 2024-09-10T17:47:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:30 smithi012 ceph-mon[27356]: mgrmap e3: y(active, since 1.0075s) 2024-09-10T17:47:31.836 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:31 smithi012 ceph-mon[27356]: mgrmap e4: y(active, since 2s) 2024-09-10T17:47:32.900 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:32 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1265459917' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T17:47:32.905 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:32.905 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "9996668a-6f9c-11ef-bcea-c7b262605968", 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T17:47:32.906 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T17:47:32.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T17:47:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T17:47:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T17:47:05.902150+0000", 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-10T17:47:32.913 INFO:teuthology.orchestra.run.smithi012.stdout:mgr is available 2024-09-10T17:47:33.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:33 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2083819197' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T17:47:34.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-10T17:47:34.036 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T17:47:34.036 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T17:47:34.036 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T17:47:34.036 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling cephadm module... 2024-09-10T17:47:35.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:34 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/579318446' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T17:47:35.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ignoring --setuser ceph since I am not root 2024-09-10T17:47:35.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ignoring --setgroup ceph since I am not root 2024-09-10T17:47:35.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:34.853+0000 7f217ee58040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T17:47:35.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:34.912+0000 7f217ee58040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T17:47:35.338 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:35 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:35.068+0000 7f217ee58040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T17:47:35.338 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:35 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:35.137+0000 7f217ee58040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T17:47:35.338 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:35 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:35.290+0000 7f217ee58040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:47:35.590 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:35 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:35.441+0000 7f217ee58040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T17:47:36.004 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:35 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/579318446' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T17:47:36.004 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:35 smithi012 ceph-mon[27356]: mgrmap e5: y(active, since 6s) 2024-09-10T17:47:36.004 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:35 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:35.770+0000 7f217ee58040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T17:47:36.004 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:35 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:35.837+0000 7f217ee58040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T17:47:36.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:36 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:36.031+0000 7f217ee58040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T17:47:36.581 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-10T17:47:36.581 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T17:47:36.581 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T17:47:36.581 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-10T17:47:36.581 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T17:47:36.581 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-10T17:47:36.581 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-09-10T17:47:36.582 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 5... 2024-09-10T17:47:36.829 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:36 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/314245796' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T17:47:37.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:36 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:36.962+0000 7f217ee58040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T17:47:37.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:37 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:37.033+0000 7f217ee58040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T17:47:38.062 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:37 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:37.791+0000 7f217ee58040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T17:47:38.062 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:37 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:37.912+0000 7f217ee58040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T17:47:38.352 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.060+0000 7f217ee58040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:47:38.352 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.124+0000 7f217ee58040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T17:47:38.352 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.278+0000 7f217ee58040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T17:47:38.352 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.349+0000 7f217ee58040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T17:47:38.647 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.412+0000 7f217ee58040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T17:47:38.647 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.577+0000 7f217ee58040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T17:47:38.647 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.644+0000 7f217ee58040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T17:47:38.927 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.714+0000 7f217ee58040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T17:47:38.927 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.801+0000 7f217ee58040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T17:47:38.927 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.863+0000 7f217ee58040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T17:47:38.927 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:38.925+0000 7f217ee58040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T17:47:40.033 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:39.746+0000 7f217ee58040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: Active manager daemon y restarted 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: Activating manager daemon y 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: mgrmap e6: y(active, starting, since 0.00342649s) 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:47:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: Manager daemon y is now available 2024-09-10T17:47:40.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:40.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:40.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:47:40.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:47:40.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:47:40.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:39 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:47:41.454 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-10T17:47:41.454 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T17:47:41.454 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T17:47:41.454 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-10T17:47:41.454 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 5 is available 2024-09-10T17:47:41.454 INFO:teuthology.orchestra.run.smithi012.stdout:Setting orchestrator backend to cephadm... 2024-09-10T17:47:41.753 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:41 smithi012 ceph-mon[27356]: Found migration_current of "None". Setting to last migration. 2024-09-10T17:47:41.753 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:41 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:41.754 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:41 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:41.754 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:41 smithi012 ceph-mon[27356]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T17:47:41.754 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:41 smithi012 ceph-mon[27356]: mgrmap e7: y(active, since 1.00575s) 2024-09-10T17:47:41.754 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:41 smithi012 ceph-mon[27356]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:42.276+0000 7f20ec303640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:17:47:42] ENGINE Error in HTTPServer.serve 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: Traceback (most recent call last): 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._connections.run(self.expiration_interval) 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._run(expiration_interval) 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:47:42.391 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: s = self.context.wrap_socket( 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: return self.sslsocket_class._create( 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self.do_handshake() 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._sslobj.do_handshake() 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:47:42.392 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:43.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:47:43.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:43.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:47:43.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: [10/Sep/2024:17:47:42] ENGINE Bus STARTING 2024-09-10T17:47:43.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: [10/Sep/2024:17:47:42] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:47:43.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: [10/Sep/2024:17:47:42] ENGINE Error in HTTPServer.serve 2024-09-10T17:47:43.229 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:47:43.230 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: [10/Sep/2024:17:47:42] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: [10/Sep/2024:17:47:42] ENGINE Bus STARTED 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:47:43.231 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:43 smithi012 ceph-mon[27356]: mgrmap e8: y(active, since 2s) 2024-09-10T17:47:43.800 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T17:47:43.800 INFO:teuthology.orchestra.run.smithi012.stdout:Generating ssh key... 2024-09-10T17:47:44.116 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-mon[27356]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:47:45.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:45 smithi012 ceph-mon[27356]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:47:45.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:45 smithi012 ceph-mon[27356]: Generating ssh key... 2024-09-10T17:47:45.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:45 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:45.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:45 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:45.120 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: Generating public/private rsa key pair. 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: Your identification has been saved in /tmp/tmpd8j0ax5c/key 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: Your public key has been saved in /tmp/tmpd8j0ax5c/key.pub 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: The key fingerprint is: 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: SHA256:6dSv4bsXJbj6+b4AW2/hUXW+oFmWzq/+dOAXvqkePZk ceph-9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: The key's randomart image is: 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: +---[RSA 3072]----+ 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | o| 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | .o.| 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | . =. .| 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | o. O.o .| 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | S o+o=.o | 2024-09-10T17:47:45.121 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | o +.+.++.+| 2024-09-10T17:47:45.122 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | o.o =o.Eo| 2024-09-10T17:47:45.122 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | .. *. +.=| 2024-09-10T17:47:45.122 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: | .B***o+ | 2024-09-10T17:47:45.122 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: +----[SHA256]-----+ 2024-09-10T17:47:46.548 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC1uUmd6k94fKxskXkIWXNSp4DsVgQMW2eI2/yxKpsKa2E7IvJ+hu/XkL8hPlE73bbyq2gWek32WsIm33WwVM6LtP0iVM6aDBTg+SAGJYkF2eS7lzKdQvbN6ZZ4aGM849JWpHior+WU8XLd1cVTGdxv8lfy/AvwwBvBGKbwHwG1XtGAtpEzCZAkGIZH0lyobAUHYdETAAk82dt5aL5XtmmK1noezARL5V4BdpU5980EfrK2TKk3cJ1KnUUms0p6dpzmVg9CCLdRliajmZSnm0HgMR/DmUe+OTUChqGEC8MCq+rY7WZUvTak9aNIl88//zo/wp3omiIwXQyGnTlJaPLg32ib+wOexkytybn2zoX/GyUwDHhgt2VgyHadxlnbaIh5FlYHXeFKYlocyTOEMEmXzY/CIJTjmu9+FAYByL8FpheBMaxqCHzb3Mus97Jz5wn/ziIVpOUHYjquaSem+xuQzoJlowHNpYWaF/nIP4YC0nWtSJvB8hefAzLX8YmvS0= ceph-9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:47:46.549 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T17:47:46.549 INFO:teuthology.orchestra.run.smithi012.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T17:47:46.557 INFO:teuthology.orchestra.run.smithi012.stdout:Adding host smithi012... 2024-09-10T17:47:47.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:46 smithi012 ceph-mon[27356]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:47:47.904 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:47 smithi012 ceph-mon[27356]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:47:49.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:48 smithi012 ceph-mon[27356]: Deploying cephadm binary to smithi012 2024-09-10T17:47:51.129 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Added host 'smithi012' with addr '172.21.15.12' 2024-09-10T17:47:51.129 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mon service... 2024-09-10T17:47:51.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:51 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:51.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:51 smithi012 ceph-mon[27356]: Added host smithi012 2024-09-10T17:47:51.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:51 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:47:52.404 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T17:47:52.404 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mgr service... 2024-09-10T17:47:52.977 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:52 smithi012 ceph-mon[27356]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:47:52.978 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:52 smithi012 ceph-mon[27356]: Saving service mon spec with placement count:5 2024-09-10T17:47:52.978 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:52 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:53.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T17:47:54.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:53 smithi012 ceph-mon[27356]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:47:54.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:53 smithi012 ceph-mon[27356]: Saving service mgr spec with placement count:2 2024-09-10T17:47:54.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:53 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:55.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:55 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/780747301' entity='client.admin' 2024-09-10T17:47:55.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:55 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:55.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:55 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:56.488 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling the dashboard module... 2024-09-10T17:47:56.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:56 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/583052365' entity='client.admin' 2024-09-10T17:47:58.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:58.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2486974352' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T17:47:58.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-mon[27356]: from='mgr.14118 172.21.15.12:0/2687081875' entity='mgr.y' 2024-09-10T17:47:58.220 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ignoring --setuser ceph since I am not root 2024-09-10T17:47:58.220 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ignoring --setgroup ceph since I am not root 2024-09-10T17:47:58.221 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:58.159+0000 7f14dc90e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T17:47:58.221 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:58.218+0000 7f14dc90e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T17:47:58.478 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:58.377+0000 7f14dc90e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T17:47:58.478 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:58.446+0000 7f14dc90e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T17:47:58.748 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:58.598+0000 7f14dc90e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:47:58.748 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:58.747+0000 7f14dc90e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T17:47:59.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:59 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2486974352' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T17:47:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:47:59 smithi012 ceph-mon[27356]: mgrmap e9: y(active, since 18s) 2024-09-10T17:47:59.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:59 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:59.073+0000 7f14dc90e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T17:47:59.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:59 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:59.136+0000 7f14dc90e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T17:47:59.694 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:47:59 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:47:59.335+0000 7f14dc90e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T17:48:00.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:00 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/138656649' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T17:48:00.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-10T17:48:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T17:48:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T17:48:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-10T17:48:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T17:48:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-10T17:48:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-09-10T17:48:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 9... 2024-09-10T17:48:00.533 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:00 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:00.266+0000 7f14dc90e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T17:48:00.533 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:00 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:00.335+0000 7f14dc90e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T17:48:01.215 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.095+0000 7f14dc90e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T17:48:01.216 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.214+0000 7f14dc90e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T17:48:01.533 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.362+0000 7f14dc90e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:48:01.533 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.425+0000 7f14dc90e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T17:48:01.875 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.578+0000 7f14dc90e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T17:48:01.875 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.649+0000 7f14dc90e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T17:48:01.875 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.711+0000 7f14dc90e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T17:48:01.875 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.874+0000 7f14dc90e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T17:48:02.159 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:01.942+0000 7f14dc90e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T17:48:02.159 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:02.011+0000 7f14dc90e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T17:48:02.159 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:02.096+0000 7f14dc90e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T17:48:02.159 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:02.158+0000 7f14dc90e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T17:48:02.533 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:02.219+0000 7f14dc90e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T17:48:03.287 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:03.033+0000 7f14dc90e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T17:48:03.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: Active manager daemon y restarted 2024-09-10T17:48:03.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: Activating manager daemon y 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: mgrmap e10: y(active, starting, since 0.00323005s) 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: Manager daemon y is now available 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:48:03.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:48:04.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-10T17:48:04.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T17:48:04.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T17:48:04.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-10T17:48:04.939 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 9 is available 2024-09-10T17:48:04.939 INFO:teuthology.orchestra.run.smithi012.stdout:Generating a dashboard self-signed certificate... 2024-09-10T17:48:05.188 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-mon[27356]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T17:48:05.188 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-mon[27356]: mgrmap e11: y(active, since 1.00565s) 2024-09-10T17:48:05.188 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-mon[27356]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T17:48:05.188 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:05.621 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:05.306+0000 7f1442d98640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:17:48:05] ENGINE Error in HTTPServer.serve 2024-09-10T17:48:05.621 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: Traceback (most recent call last): 2024-09-10T17:48:05.621 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:48:05.622 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._connections.run(self.expiration_interval) 2024-09-10T17:48:05.622 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:48:05.622 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._run(expiration_interval) 2024-09-10T17:48:05.622 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:48:05.622 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:48:05.622 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:48:05.623 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:48:05.623 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:48:05.623 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: s = self.context.wrap_socket( 2024-09-10T17:48:05.623 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:48:05.623 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: return self.sslsocket_class._create( 2024-09-10T17:48:05.623 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:48:05.624 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self.do_handshake() 2024-09-10T17:48:05.624 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:48:05.624 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._sslobj.do_handshake() 2024-09-10T17:48:05.624 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:48:05.624 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:48:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:48:06.186 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T17:48:06.186 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial admin user... 2024-09-10T17:48:06.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: [10/Sep/2024:17:48:05] ENGINE Bus STARTING 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: [10/Sep/2024:17:48:05] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: [10/Sep/2024:17:48:05] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: [10/Sep/2024:17:48:05] ENGINE Bus STARTED 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: [10/Sep/2024:17:48:05] ENGINE Error in HTTPServer.serve 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:48:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: mgrmap e12: y(active, since 2s) 2024-09-10T17:48:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:06.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:06.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:06.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:07.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:07 smithi012 ceph-mon[27356]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:07.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:07 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:08.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$9M1NNQtRsyTgKINVtYDd4erAy.cZhtSBzAJ.SY9H4II/2USNm4TRO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725990487, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T17:48:08.340 INFO:teuthology.orchestra.run.smithi012.stdout:Fetching dashboard port number... 2024-09-10T17:48:09.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:08 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/798077251' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T17:48:09.514 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T17:48:09.525 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T17:48:09.525 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-10T17:48:09.533 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T17:48:09.533 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-10T17:48:09.533 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-10T17:48:09.534 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T17:48:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph Dashboard is now available at: 2024-09-10T17:48:09.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: URL: https://smithi012.front.sepia.ceph.com:8443/ 2024-09-10T17:48:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: User: admin 2024-09-10T17:48:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: Password: 8t6fl6akiz 2024-09-10T17:48:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:09.537 INFO:teuthology.orchestra.run.smithi012.stdout:Saving cluster configuration to /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config directory 2024-09-10T17:48:09.537 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling autotune for osd_memory_target 2024-09-10T17:48:11.094 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:10 smithi012 ceph-mon[27356]: mgrmap e13: y(active, since 6s) 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T17:48:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: ceph telemetry on 2024-09-10T17:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:For more information see: 2024-09-10T17:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T17:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:Bootstrap complete. 2024-09-10T17:48:11.918 INFO:tasks.cephadm:Fetching config... 2024-09-10T17:48:11.918 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:48:11.918 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T17:48:11.934 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T17:48:11.934 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:48:11.935 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T17:48:11.991 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T17:48:11.992 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:48:11.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T17:48:12.057 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T17:48:12.057 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:48:12.058 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T17:48:12.115 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T17:48:12.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC1uUmd6k94fKxskXkIWXNSp4DsVgQMW2eI2/yxKpsKa2E7IvJ+hu/XkL8hPlE73bbyq2gWek32WsIm33WwVM6LtP0iVM6aDBTg+SAGJYkF2eS7lzKdQvbN6ZZ4aGM849JWpHior+WU8XLd1cVTGdxv8lfy/AvwwBvBGKbwHwG1XtGAtpEzCZAkGIZH0lyobAUHYdETAAk82dt5aL5XtmmK1noezARL5V4BdpU5980EfrK2TKk3cJ1KnUUms0p6dpzmVg9CCLdRliajmZSnm0HgMR/DmUe+OTUChqGEC8MCq+rY7WZUvTak9aNIl88//zo/wp3omiIwXQyGnTlJaPLg32ib+wOexkytybn2zoX/GyUwDHhgt2VgyHadxlnbaIh5FlYHXeFKYlocyTOEMEmXzY/CIJTjmu9+FAYByL8FpheBMaxqCHzb3Mus97Jz5wn/ziIVpOUHYjquaSem+xuQzoJlowHNpYWaF/nIP4YC0nWtSJvB8hefAzLX8YmvS0= ceph-9996668a-6f9c-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T17:48:12.192 INFO:teuthology.orchestra.run.smithi012.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC1uUmd6k94fKxskXkIWXNSp4DsVgQMW2eI2/yxKpsKa2E7IvJ+hu/XkL8hPlE73bbyq2gWek32WsIm33WwVM6LtP0iVM6aDBTg+SAGJYkF2eS7lzKdQvbN6ZZ4aGM849JWpHior+WU8XLd1cVTGdxv8lfy/AvwwBvBGKbwHwG1XtGAtpEzCZAkGIZH0lyobAUHYdETAAk82dt5aL5XtmmK1noezARL5V4BdpU5980EfrK2TKk3cJ1KnUUms0p6dpzmVg9CCLdRliajmZSnm0HgMR/DmUe+OTUChqGEC8MCq+rY7WZUvTak9aNIl88//zo/wp3omiIwXQyGnTlJaPLg32ib+wOexkytybn2zoX/GyUwDHhgt2VgyHadxlnbaIh5FlYHXeFKYlocyTOEMEmXzY/CIJTjmu9+FAYByL8FpheBMaxqCHzb3Mus97Jz5wn/ziIVpOUHYjquaSem+xuQzoJlowHNpYWaF/nIP4YC0nWtSJvB8hefAzLX8YmvS0= ceph-9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:48:12.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC1uUmd6k94fKxskXkIWXNSp4DsVgQMW2eI2/yxKpsKa2E7IvJ+hu/XkL8hPlE73bbyq2gWek32WsIm33WwVM6LtP0iVM6aDBTg+SAGJYkF2eS7lzKdQvbN6ZZ4aGM849JWpHior+WU8XLd1cVTGdxv8lfy/AvwwBvBGKbwHwG1XtGAtpEzCZAkGIZH0lyobAUHYdETAAk82dt5aL5XtmmK1noezARL5V4BdpU5980EfrK2TKk3cJ1KnUUms0p6dpzmVg9CCLdRliajmZSnm0HgMR/DmUe+OTUChqGEC8MCq+rY7WZUvTak9aNIl88//zo/wp3omiIwXQyGnTlJaPLg32ib+wOexkytybn2zoX/GyUwDHhgt2VgyHadxlnbaIh5FlYHXeFKYlocyTOEMEmXzY/CIJTjmu9+FAYByL8FpheBMaxqCHzb3Mus97Jz5wn/ziIVpOUHYjquaSem+xuQzoJlowHNpYWaF/nIP4YC0nWtSJvB8hefAzLX8YmvS0= ceph-9996668a-6f9c-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T17:48:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC1uUmd6k94fKxskXkIWXNSp4DsVgQMW2eI2/yxKpsKa2E7IvJ+hu/XkL8hPlE73bbyq2gWek32WsIm33WwVM6LtP0iVM6aDBTg+SAGJYkF2eS7lzKdQvbN6ZZ4aGM849JWpHior+WU8XLd1cVTGdxv8lfy/AvwwBvBGKbwHwG1XtGAtpEzCZAkGIZH0lyobAUHYdETAAk82dt5aL5XtmmK1noezARL5V4BdpU5980EfrK2TKk3cJ1KnUUms0p6dpzmVg9CCLdRliajmZSnm0HgMR/DmUe+OTUChqGEC8MCq+rY7WZUvTak9aNIl88//zo/wp3omiIwXQyGnTlJaPLg32ib+wOexkytybn2zoX/GyUwDHhgt2VgyHadxlnbaIh5FlYHXeFKYlocyTOEMEmXzY/CIJTjmu9+FAYByL8FpheBMaxqCHzb3Mus97Jz5wn/ziIVpOUHYjquaSem+xuQzoJlowHNpYWaF/nIP4YC0nWtSJvB8hefAzLX8YmvS0= ceph-9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:48:12.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T17:48:12.481 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:48:12.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:12 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/579068219' entity='client.admin' 2024-09-10T17:48:15.526 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T17:48:15.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T17:48:16.141 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:15 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/450854456' entity='client.admin' 2024-09-10T17:48:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:48:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi012", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:48:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:18.601 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi089 2024-09-10T17:48:18.602 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:48:18.602 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/etc/ceph/ceph.conf 2024-09-10T17:48:18.623 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:48:18.623 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:48:18.681 INFO:tasks.cephadm:Adding host smithi089 to orchestrator... 2024-09-10T17:48:18.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch host add smithi089 2024-09-10T17:48:18.882 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:48:19.093 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:19.093 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:19.093 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:19.093 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:19.093 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:19.094 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:48:19.094 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:19.094 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:19.094 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:19.094 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:20.116 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:19 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:48:20.116 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:19 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:48:21.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:21 smithi012 ceph-mon[27356]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:22.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:22 smithi012 ceph-mon[27356]: Deploying cephadm binary to smithi089 2024-09-10T17:48:23.755 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi089' with addr '172.21.15.89' 2024-09-10T17:48:24.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:24 smithi012 ceph-mon[27356]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:24.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:24 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:24.377 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:24 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:24.377 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:24 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:24.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T17:48:24.595 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:48:25.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:25 smithi012 ceph-mon[27356]: Added host smithi089 2024-09-10T17:48:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:26 smithi012 ceph-mon[27356]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:26 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:26.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:48:26.390 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.89", "hostname": "smithi089", "labels": [], "status": ""}] 2024-09-10T17:48:26.995 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T17:48:26.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T17:48:27.194 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:48:28.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:48:28.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:28.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:28.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:28.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:28.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:28.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:48:28.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:28.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:29.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:29 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:48:29.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:29 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:29.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:29 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:29.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:29 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:29.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:29 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:29.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:29 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2209558639' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T17:48:29.721 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-09-10T17:48:30.304 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:30 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:48:30.304 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:30 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:48:30.304 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:30 smithi012 ceph-mon[27356]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:30.304 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:30 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2209558639' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T17:48:30.304 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:30 smithi012 ceph-mon[27356]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:30.305 INFO:tasks.cephadm:Adding mon.a on smithi012 2024-09-10T17:48:30.305 INFO:tasks.cephadm:Adding mon.c on smithi012 2024-09-10T17:48:30.305 INFO:tasks.cephadm:Adding mon.b on smithi089 2024-09-10T17:48:30.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi012:172.21.15.12=a;smithi012:[v2:172.21.15.12:3301,v1:172.21.15.12:6790]=c;smithi089:172.21.15.89=b' 2024-09-10T17:48:30.503 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:32.125 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled mon update... 2024-09-10T17:48:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:32 smithi012 ceph-mon[27356]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:32.748 DEBUG:teuthology.orchestra.run.smithi012:mon.c> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T17:48:32.751 DEBUG:teuthology.orchestra.run.smithi089:mon.b> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T17:48:32.754 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T17:48:32.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T17:48:33.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi012:[v2:172.21.15.12:3301,v1:172.21.15.12:6790]=c;smithi089:172.21.15.89=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:33.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi012:[v2:172.21.15.12:3301,v1:172.21.15.12:6790]=c;smithi089:172.21.15.89=b;count:3 2024-09-10T17:48:33.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:33.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:33.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:33.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:33.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:33.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:33.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:33.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: Deploying daemon mon.b on smithi089 2024-09-10T17:48:33.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:33 smithi012 ceph-mon[27356]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:34.263 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:35.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:35 smithi012 ceph-mon[27356]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:35.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:35 smithi089 systemd[1]: Starting Ceph mon.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:48:36.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 podman[31427]: 2024-09-10 17:48:36.41455038 +0000 UTC m=+0.095898441 container create bddaa233c388b8ab15492a58e458aa6cb069ea36804126b49fa8d54cf50078a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T17:48:36.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 podman[31427]: 2024-09-10 17:48:36.334481102 +0000 UTC m=+0.015829125 image pull f21ba1eea74eff81ce08338578ea11be73add5627252ff4d00500aa0d1abdd33 quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6 2024-09-10T17:48:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 podman[31427]: 2024-09-10 17:48:36.784480918 +0000 UTC m=+0.465828942 container init bddaa233c388b8ab15492a58e458aa6cb069ea36804126b49fa8d54cf50078a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-10T17:48:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 podman[31427]: 2024-09-10 17:48:36.788222907 +0000 UTC m=+0.469570927 container start bddaa233c388b8ab15492a58e458aa6cb069ea36804126b49fa8d54cf50078a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=reef-7a853b1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T17:48:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T17:48:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable), process ceph-mon, pid 2 2024-09-10T17:48:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: pidfile_write: ignore empty --pid-file 2024-09-10T17:48:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: load: jerasure load: lrc 2024-09-10T17:48:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: RocksDB version: 7.9.2 2024-09-10T17:48:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Git sha 0 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Compile date 2024-09-10 15:58:06 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: DB SUMMARY 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: DB Session ID: LPGGU7W7E30XEF9OJ3KF 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: CURRENT file: CURRENT 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.error_if_exists: 0 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.create_if_missing: 0 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.paranoid_checks: 1 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T17:48:37.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.env: 0x5613143d4bc0 2024-09-10T17:48:37.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T17:48:37.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.info_log: 0x561314e18be0 2024-09-10T17:48:37.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T17:48:37.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.statistics: (nil) 2024-09-10T17:48:37.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.use_fsync: 0 2024-09-10T17:48:37.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_log_file_size: 0 2024-09-10T17:48:37.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T17:48:37.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T17:48:37.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T17:48:37.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.allow_fallocate: 1 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.use_direct_reads: 0 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.db_log_dir: 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.wal_dir: 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T17:48:37.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.write_buffer_manager: 0x561314e26320 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T17:48:37.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.unordered_write: 0 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.row_cache: None 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.wal_filter: None 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.two_write_queues: 0 2024-09-10T17:48:37.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.wal_compression: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.atomic_flush: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.log_readahead_size: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T17:48:37.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_background_jobs: 2 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_background_compactions: -1 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_subcompactions: 1 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_open_files: -1 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T17:48:37.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_background_flushes: -1 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Compression algorithms supported: 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: kZSTD supported: 0 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: kXpressCompression supported: 0 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: kBZip2Compression supported: 0 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: kLZ4Compression supported: 1 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: kZlibCompression supported: 1 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: kSnappyCompression supported: 1 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T17:48:37.045 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.merge_operator: 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_filter: None 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561314e187e0) 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T17:48:37.046 INFO:journalctl@ceph.mon.b.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_type: 0 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: data_block_index_type: 0 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_shortening: 1 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: checksum: 4 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: no_block_cache: 0 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache: 0x561314e0d350 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_options: 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: capacity : 536870912 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: num_shard_bits : 4 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: strict_capacity_limit : 0 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_compressed: (nil) 2024-09-10T17:48:37.047 INFO:journalctl@ceph.mon.b.smithi089.stdout: persistent_cache: (nil) 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_size: 4096 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_size_deviation: 10 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_restart_interval: 16 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_block_restart_interval: 1 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: metadata_block_size: 4096 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: partition_filters: 0 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: use_delta_encoding: 1 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: filter_policy: bloomfilter 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: whole_key_filtering: 1 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: verify_compression: 0 2024-09-10T17:48:37.048 INFO:journalctl@ceph.mon.b.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout: format_version: 5 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout: enable_index_compression: 1 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_align: 0 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout: max_auto_readahead_size: 262144 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout: prepopulate_block_cache: 0 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout: initial_auto_readahead_size: 8192 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression: NoCompression 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T17:48:37.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.num_levels: 7 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:48:37.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T17:48:37.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T17:48:37.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T17:48:37.053 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.inplace_update_support: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.bloom_locality: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.max_successive_merges: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.ttl: 2592000 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T17:48:37.054 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.enable_blob_files: false 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.min_blob_size: 0 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 86d359c5-09cb-471f-991f-6a5b3482ab8d 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990516815387, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T17:48:37.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990516815936, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725990516, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "86d359c5-09cb-471f-991f-6a5b3482ab8d", "db_session_id": "LPGGU7W7E30XEF9OJ3KF", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990516816074, "job": 1, "event": "recovery_finished"} 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561314e38e00 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: DB pointer 0x561314f2c000 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** DB Stats ** 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:48:37.056 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:48:37.057 INFO:journalctl@ceph.mon.b.smithi089.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: Block cache BinnedLRUCache@0x561314e0d350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T17:48:37.058 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: using public_addr v2:172.21.15.89:0/0 -> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: starting mon.b rank -1 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(???) e0 preinit fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).mds e1 new map 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout: e1 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout: legacy client fscid: -1 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout: No filesystems configured 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T17:48:37.059 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2209558639' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:48:37.060 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2209558639' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi012:[v2:172.21.15.12:3301,v1:172.21.15.12:6790]=c;smithi089:172.21.15.89=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi012:[v2:172.21.15.12:3301,v1:172.21.15.12:6790]=c;smithi089:172.21.15.89=b;count:3 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: Deploying daemon mon.b on smithi089 2024-09-10T17:48:37.061 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:37.062 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:37.062 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 ceph-mon[31467]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T17:48:37.062 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 bash[31427]: bddaa233c388b8ab15492a58e458aa6cb069ea36804126b49fa8d54cf50078a8 2024-09-10T17:48:37.062 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:36 smithi089 systemd[1]: Started Ceph mon.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:48:41.853 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:48:41.854 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","modified":"2024-09-10T17:48:36.841464Z","created":"2024-09-10T17:47:02.984611Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T17:48:41.854 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 2 2024-09-10T17:48:42.172 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:48:42.172 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: mon.a calling monitor election 2024-09-10T17:48:42.172 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.172 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/1332423738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T17:48:42.172 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:42.172 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: mon.b calling monitor election 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-10T17:48:42.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: fsmap 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: mgrmap e13: y(active, since 38s) 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: overall HEALTH_OK 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:42.174 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:41 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: mon.a calling monitor election 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/1332423738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: mon.b calling monitor election 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: fsmap 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: mgrmap e13: y(active, since 38s) 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: overall HEALTH_OK 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:42.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:42.247 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:41 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:43.157 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:42 smithi012 ceph-mon[27356]: Deploying daemon mon.c on smithi012 2024-09-10T17:48:43.157 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:43.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:42 smithi089 ceph-mon[31467]: Deploying daemon mon.c on smithi012 2024-09-10T17:48:43.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:43.422 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T17:48:43.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T17:48:43.628 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:48:44.000 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:43 smithi089 ceph-mon[31467]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:44.188 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:43 smithi012 ceph-mon[27356]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:44.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:44 smithi012 systemd[1]: Starting Ceph mon.c for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:48:45.107 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:44 smithi012 podman[37435]: 2024-09-10 17:48:44.759089483 +0000 UTC m=+0.016611888 image pull f21ba1eea74eff81ce08338578ea11be73add5627252ff4d00500aa0d1abdd33 quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:44 smithi012 podman[37435]: 2024-09-10 17:48:44.881681724 +0000 UTC m=+0.139204159 container create 2ba771d7bc46af4a446218fe1763223153aff98d08439ee645621fe245a99aa9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 podman[37435]: 2024-09-10 17:48:45.075647983 +0000 UTC m=+0.333170383 container init 2ba771d7bc46af4a446218fe1763223153aff98d08439ee645621fe245a99aa9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 podman[37435]: 2024-09-10 17:48:45.079095271 +0000 UTC m=+0.336617667 container start 2ba771d7bc46af4a446218fe1763223153aff98d08439ee645621fe245a99aa9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable), process ceph-mon, pid 2 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pidfile_write: ignore empty --pid-file 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: load: jerasure load: lrc 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: RocksDB version: 7.9.2 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Git sha 0 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Compile date 2024-09-10 15:58:06 2024-09-10T17:48:45.108 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: DB SUMMARY 2024-09-10T17:48:45.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: DB Session ID: 8JLWOLFC4K8UI4NLPHJ1 2024-09-10T17:48:45.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: CURRENT file: CURRENT 2024-09-10T17:48:45.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T17:48:45.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T17:48:45.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-10T17:48:45.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 636 ; 2024-09-10T17:48:45.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.error_if_exists: 0 2024-09-10T17:48:45.110 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.create_if_missing: 0 2024-09-10T17:48:45.110 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.paranoid_checks: 1 2024-09-10T17:48:45.110 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T17:48:45.110 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T17:48:45.110 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T17:48:45.110 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.env: 0x561465fc9bc0 2024-09-10T17:48:45.110 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T17:48:45.110 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.info_log: 0x56146836cbe0 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.statistics: (nil) 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.use_fsync: 0 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_log_file_size: 0 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.allow_fallocate: 1 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.use_direct_reads: 0 2024-09-10T17:48:45.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.db_log_dir: 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.wal_dir: 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.write_buffer_manager: 0x56146837a320 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T17:48:45.112 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.unordered_write: 0 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.row_cache: None 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.wal_filter: None 2024-09-10T17:48:45.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.two_write_queues: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.wal_compression: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.atomic_flush: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.log_readahead_size: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T17:48:45.114 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_background_jobs: 2 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_background_compactions: -1 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_subcompactions: 1 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_open_files: -1 2024-09-10T17:48:45.115 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_background_flushes: -1 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Compression algorithms supported: 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: kZSTD supported: 0 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: kXpressCompression supported: 0 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: kBZip2Compression supported: 0 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: kLZ4Compression supported: 1 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: kZlibCompression supported: 1 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: kSnappyCompression supported: 1 2024-09-10T17:48:45.116 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.merge_operator: 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_filter: None 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56146836c7e0) 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout: cache_index_and_filter_blocks: 1 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T17:48:45.117 INFO:journalctl@ceph.mon.c.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: pin_top_level_index_and_filter: 1 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: index_type: 0 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: data_block_index_type: 0 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: index_shortening: 1 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: checksum: 4 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: no_block_cache: 0 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_cache: 0x561468361350 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_cache_name: BinnedLRUCache 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_cache_options: 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: capacity : 536870912 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: num_shard_bits : 4 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: strict_capacity_limit : 0 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: high_pri_pool_ratio: 0.000 2024-09-10T17:48:45.118 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_cache_compressed: (nil) 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: persistent_cache: (nil) 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_size: 4096 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_size_deviation: 10 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_restart_interval: 16 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: index_block_restart_interval: 1 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: metadata_block_size: 4096 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: partition_filters: 0 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: use_delta_encoding: 1 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: filter_policy: bloomfilter 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: whole_key_filtering: 1 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: verify_compression: 0 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: read_amp_bytes_per_bit: 0 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: format_version: 5 2024-09-10T17:48:45.119 INFO:journalctl@ceph.mon.c.smithi012.stdout: enable_index_compression: 1 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_align: 0 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout: max_auto_readahead_size: 262144 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout: prepopulate_block_cache: 0 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout: initial_auto_readahead_size: 8192 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression: NoCompression 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T17:48:45.120 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T17:48:45.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[27356]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.500 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.num_levels: 7 2024-09-10T17:48:45.500 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:48:45.501 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T17:48:45.502 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T17:48:45.503 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T17:48:45.504 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.inplace_update_support: 0 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.bloom_locality: 0 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.max_successive_merges: 0 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T17:48:45.505 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T17:48:45.506 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.ttl: 2592000 2024-09-10T17:48:45.506 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T17:48:45.506 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T17:48:45.506 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T17:48:45.506 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.enable_blob_files: false 2024-09-10T17:48:45.506 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.min_blob_size: 0 2024-09-10T17:48:45.506 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T17:48:45.506 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T17:48:45.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5233aa9e-2852-44e0-b47e-67dbde59e0e8 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990525107556, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990525107944, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725990525, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5233aa9e-2852-44e0-b47e-67dbde59e0e8", "db_session_id": "8JLWOLFC4K8UI4NLPHJ1", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725990525108043, "job": 1, "event": "recovery_finished"} 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56146838ce00 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: DB pointer 0x561468480000 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout: ** DB Stats ** 2024-09-10T17:48:45.508 INFO:journalctl@ceph.mon.c.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T17:48:45.509 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T17:48:45.510 INFO:journalctl@ceph.mon.c.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout: Block cache BinnedLRUCache@0x561468361350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: using public_addrv [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: starting mon.c rank -1 at public addrs [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] at bind addrs [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(???) e0 preinit fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:48:45.511 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).mds e1 new map 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout: e1 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout: legacy client fscid: -1 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout: No filesystems configured 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T17:48:45.512 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2209558639' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.513 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2209558639' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi012:[v2:172.21.15.12:3301,v1:172.21.15.12:6790]=c;smithi089:172.21.15.89=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi012:[v2:172.21.15.12:3301,v1:172.21.15.12:6790]=c;smithi089:172.21.15.89=b;count:3 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: Deploying daemon mon.b on smithi089 2024-09-10T17:48:45.514 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.a calling monitor election 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/1332423738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.b calling monitor election 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: fsmap 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mgrmap e13: y(active, since 38s) 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: overall HEALTH_OK 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: Deploying daemon mon.c on smithi012 2024-09-10T17:48:45.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:45.517 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.517 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:45.517 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 ceph-mon[37454]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T17:48:45.517 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 bash[37435]: 2ba771d7bc46af4a446218fe1763223153aff98d08439ee645621fe245a99aa9 2024-09-10T17:48:45.517 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:45 smithi012 systemd[1]: Started Ceph mon.c for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:48:45.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:45 smithi089 ceph-mon[31467]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:50.148 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:48:50.148 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":3,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","modified":"2024-09-10T17:48:45.134479Z","created":"2024-09-10T17:47:02.984611Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3301","nonce":0},{"type":"v1","addr":"172.21.15.12:6790","nonce":0}]},"addr":"172.21.15.12:6790/0","public_addr":"172.21.15.12:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T17:48:50.148 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 3 2024-09-10T17:48:50.501 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:48:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: mon.a calling monitor election 2024-09-10T17:48:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: mon.b calling monitor election 2024-09-10T17:48:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/217172582' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T17:48:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:50.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: mon.c calling monitor election 2024-09-10T17:48:50.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:50.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0],c=[v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: fsmap 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: mgrmap e13: y(active, since 47s) 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: overall HEALTH_OK 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:48:50.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: mon.a calling monitor election 2024-09-10T17:48:50.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:50.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: mon.b calling monitor election 2024-09-10T17:48:50.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/217172582' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T17:48:50.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:50.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: mon.c calling monitor election 2024-09-10T17:48:50.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0],c=[v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: fsmap 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: mgrmap e13: y(active, since 47s) 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: overall HEALTH_OK 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.799 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:48:50.799 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: mon.a calling monitor election 2024-09-10T17:48:50.799 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:48:50.799 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: mon.b calling monitor election 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/217172582' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: mon.c calling monitor election 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0],c=[v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: fsmap 2024-09-10T17:48:50.800 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T17:48:50.801 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: mgrmap e13: y(active, since 47s) 2024-09-10T17:48:50.801 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: overall HEALTH_OK 2024-09-10T17:48:50.801 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.801 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.801 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.801 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:50.802 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T17:48:50.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T17:48:51.242 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:48:51.473 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:51 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:51.473 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:51 smithi012 ceph-mon[27356]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:51.473 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:51 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:51.473 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:51 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:51.473 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:51 smithi012 ceph-mon[37454]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:51.473 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:51 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:51.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:51 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:51.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:51 smithi089 ceph-mon[31467]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:51.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:51 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:48:52.421 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.421 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.421 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.421 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.422 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:52.423 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:52.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:52.425 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:52.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:53 smithi012 ceph-mon[37454]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T17:48:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:53 smithi012 ceph-mon[37454]: Reconfiguring daemon mon.a on smithi012 2024-09-10T17:48:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:53 smithi012 ceph-mon[37454]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:53 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:53.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:53 smithi012 ceph-mon[27356]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T17:48:53.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:53 smithi012 ceph-mon[27356]: Reconfiguring daemon mon.a on smithi012 2024-09-10T17:48:53.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:53 smithi012 ceph-mon[27356]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:53.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:53 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:53.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:53 smithi089 ceph-mon[31467]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T17:48:53.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:53 smithi089 ceph-mon[31467]: Reconfiguring daemon mon.a on smithi012 2024-09-10T17:48:53.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:53 smithi089 ceph-mon[31467]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:53.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:53 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:54.352 INFO:teuthology.orchestra.run.smithi012.stdout:# minimal ceph.conf for 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:48:54.352 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-09-10T17:48:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:48:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: mon_host = [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2024-09-10T17:48:54.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[27356]: Reconfiguring mon.c (monmap changed)... 2024-09-10T17:48:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[27356]: Reconfiguring daemon mon.c on smithi012 2024-09-10T17:48:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1480470988' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[37454]: Reconfiguring mon.c (monmap changed)... 2024-09-10T17:48:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[37454]: Reconfiguring daemon mon.c on smithi012 2024-09-10T17:48:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:54 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1480470988' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:54.996 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T17:48:54.996 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:48:54.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T17:48:55.029 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:48:55.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:48:55.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:54 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:54 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:54 smithi089 ceph-mon[31467]: Reconfiguring mon.c (monmap changed)... 2024-09-10T17:48:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:54 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:54 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:54 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:54 smithi089 ceph-mon[31467]: Reconfiguring daemon mon.c on smithi012 2024-09-10T17:48:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:54 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1480470988' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:55.099 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:48:55.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T17:48:55.131 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:48:55.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:48:55.198 INFO:tasks.cephadm:Adding mgr.y on smithi012 2024-09-10T17:48:55.199 INFO:tasks.cephadm:Adding mgr.x on smithi089 2024-09-10T17:48:55.199 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch apply mgr '2;smithi012=y;smithi089=x' 2024-09-10T17:48:55.427 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:48:55.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:55 smithi012 ceph-mon[27356]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:55.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:55 smithi012 ceph-mon[37454]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:55.849 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:55 smithi089 ceph-mon[31467]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:57.007 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:57.007 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:57.007 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:56 smithi089 ceph-mon[31467]: Reconfiguring mon.b (monmap changed)... 2024-09-10T17:48:57.007 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:57.007 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:57.007 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:57.007 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:56 smithi089 ceph-mon[31467]: Reconfiguring daemon mon.b on smithi089 2024-09-10T17:48:57.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[27356]: Reconfiguring mon.b (monmap changed)... 2024-09-10T17:48:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[27356]: Reconfiguring daemon mon.b on smithi089 2024-09-10T17:48:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[37454]: Reconfiguring mon.b (monmap changed)... 2024-09-10T17:48:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:48:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:48:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:56 smithi012 ceph-mon[37454]: Reconfiguring daemon mon.b on smithi089 2024-09-10T17:48:58.210 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled mgr update... 2024-09-10T17:48:58.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[27356]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[37454]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:58 smithi089 ceph-mon[31467]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:58.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:58.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:58.845 DEBUG:teuthology.orchestra.run.smithi089:mgr.x> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T17:48:58.847 DEBUG:tasks.cephadm:set 0 configs 2024-09-10T17:48:58.847 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T17:48:58.848 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:48:58.848 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T17:48:58.868 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T17:48:58.868 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-10T17:48:58.927 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T17:48:58.927 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T17:48:58.927 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 979 Links: 1 2024-09-10T17:48:58.927 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T17:48:58.927 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T17:48:58.928 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-10 17:48:44.581338802 +0000 2024-09-10T17:48:58.928 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-10 17:44:38.147131200 +0000 2024-09-10T17:48:58.928 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-10 17:44:38.147131200 +0000 2024-09-10T17:48:58.928 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-10 17:44:38.147131200 +0000 2024-09-10T17:48:58.928 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T17:48:58.997 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-10T17:48:58.997 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-10T17:48:58.997 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000315796 s, 1.6 MB/s 2024-09-10T17:48:58.999 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T17:48:59.058 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-10T17:48:59.118 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T17:48:59.118 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T17:48:59.118 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 966 Links: 1 2024-09-10T17:48:59.118 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T17:48:59.118 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T17:48:59.118 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-10 17:48:44.581338802 +0000 2024-09-10T17:48:59.119 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-10 17:44:38.144131222 +0000 2024-09-10T17:48:59.119 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-10 17:44:38.144131222 +0000 2024-09-10T17:48:59.119 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-10 17:44:38.144131222 +0000 2024-09-10T17:48:59.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T17:48:59.186 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-10T17:48:59.186 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-10T17:48:59.186 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000230364 s, 2.2 MB/s 2024-09-10T17:48:59.188 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T17:48:59.246 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-10T17:48:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi012=y;smithi089=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: Saving service mgr spec with placement smithi012=y;smithi089=x;count:2 2024-09-10T17:48:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:48:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T17:48:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:48:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: Deploying daemon mgr.x on smithi089 2024-09-10T17:48:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[27356]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi012=y;smithi089=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: Saving service mgr spec with placement smithi012=y;smithi089=x;count:2 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:59.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: Deploying daemon mgr.x on smithi089 2024-09-10T17:48:59.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:48:59 smithi012 ceph-mon[37454]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:59.303 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T17:48:59.303 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T17:48:59.303 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 973 Links: 1 2024-09-10T17:48:59.303 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T17:48:59.303 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T17:48:59.304 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-10 17:48:44.582338795 +0000 2024-09-10T17:48:59.304 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-10 17:44:38.146131208 +0000 2024-09-10T17:48:59.304 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-10 17:44:38.146131208 +0000 2024-09-10T17:48:59.304 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-10 17:44:38.146131208 +0000 2024-09-10T17:48:59.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T17:48:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-10T17:48:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-10T17:48:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000216703 s, 2.4 MB/s 2024-09-10T17:48:59.370 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T17:48:59.428 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 983 Links: 1 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-10 17:48:44.582338795 +0000 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-10 17:44:38.147131200 +0000 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-10 17:44:38.147131200 +0000 2024-09-10T17:48:59.486 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-10 17:44:38.147131200 +0000 2024-09-10T17:48:59.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T17:48:59.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi012=y;smithi089=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:48:59.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: Saving service mgr spec with placement smithi012=y;smithi089=x;count:2 2024-09-10T17:48:59.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:59.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:48:59.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:59.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:48:59.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:48:59.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:48:59.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T17:48:59.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:48:59.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:48:59.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: Deploying daemon mgr.x on smithi089 2024-09-10T17:48:59.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:48:59 smithi089 ceph-mon[31467]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:48:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-10T17:48:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-10T17:48:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000231518 s, 2.2 MB/s 2024-09-10T17:48:59.552 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T17:48:59.610 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:48:59.610 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T17:48:59.626 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T17:48:59.626 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-10T17:48:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T17:48:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T17:48:59.682 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 984 Links: 1 2024-09-10T17:48:59.682 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T17:48:59.682 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T17:48:59.682 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-10 17:48:35.634178537 +0000 2024-09-10T17:48:59.682 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-10 17:44:35.509757332 +0000 2024-09-10T17:48:59.682 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-10 17:44:35.509757332 +0000 2024-09-10T17:48:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-10 17:44:35.509757332 +0000 2024-09-10T17:48:59.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T17:48:59.746 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-10T17:48:59.746 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-10T17:48:59.747 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000211575 s, 2.4 MB/s 2024-09-10T17:48:59.748 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T17:48:59.804 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-10T17:48:59.860 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T17:48:59.860 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T17:48:59.860 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 957 Links: 1 2024-09-10T17:48:59.860 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T17:48:59.860 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T17:48:59.861 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-10 17:48:35.634178537 +0000 2024-09-10T17:48:59.861 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-10 17:44:35.507757378 +0000 2024-09-10T17:48:59.861 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-10 17:44:35.507757378 +0000 2024-09-10T17:48:59.861 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-10 17:44:35.507757378 +0000 2024-09-10T17:48:59.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T17:49:00.004 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-10T17:49:00.005 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-10T17:49:00.005 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000185832 s, 2.8 MB/s 2024-09-10T17:49:00.006 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T17:49:00.021 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-10T17:49:00.083 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T17:49:00.083 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T17:49:00.083 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 971 Links: 1 2024-09-10T17:49:00.083 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T17:49:00.083 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T17:49:00.083 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-10 17:48:59.959628737 +0000 2024-09-10T17:49:00.083 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-10 17:44:35.508757355 +0000 2024-09-10T17:49:00.084 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-10 17:44:35.508757355 +0000 2024-09-10T17:49:00.084 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-10 17:44:35.508757355 +0000 2024-09-10T17:49:00.084 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T17:49:00.183 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-10T17:49:00.183 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-10T17:49:00.183 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000200119 s, 2.6 MB/s 2024-09-10T17:49:00.185 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T17:49:00.200 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-10T17:49:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T17:49:00.257 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T17:49:00.258 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 963 Links: 1 2024-09-10T17:49:00.258 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T17:49:00.258 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T17:49:00.258 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-10 17:49:00.139624671 +0000 2024-09-10T17:49:00.258 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-10 17:44:35.507757378 +0000 2024-09-10T17:49:00.258 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-10 17:44:35.507757378 +0000 2024-09-10T17:49:00.258 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-10 17:44:35.507757378 +0000 2024-09-10T17:49:00.258 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T17:49:00.324 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-10T17:49:00.324 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-10T17:49:00.324 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000185779 s, 2.8 MB/s 2024-09-10T17:49:00.325 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T17:49:00.381 INFO:tasks.cephadm:Deploying osd.0 on smithi012 with /dev/vg_nvme/lv_4... 2024-09-10T17:49:00.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T17:49:00.593 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:49:00.719 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:00 smithi089 ceph-mgr[33211]: -- 172.21.15.89:0/2972107036 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5617c5676d00 con 0x5617c564b400 2024-09-10T17:49:00.974 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:00 smithi089 bash[33155]: d3a723eea923dacb078bccdd608e3a9522a6188f24b0a0b00f6de910e7539e6a 2024-09-10T17:49:00.974 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:00 smithi089 systemd[1]: Started Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:49:00.974 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:00.758+0000 7ff344ec6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T17:49:00.974 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:00.816+0000 7ff344ec6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T17:49:00.974 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:00.972+0000 7ff344ec6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T17:49:01.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:01.043+0000 7ff344ec6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T17:49:01.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:01.212+0000 7ff344ec6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:49:01.622 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:01.350+0000 7ff344ec6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T17:49:01.921 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:01.671+0000 7ff344ec6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T17:49:01.921 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:01.731+0000 7ff344ec6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T17:49:01.921 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:01.921 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:01.921 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:01.921 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:01.922 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:01.922 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-mon[31467]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:02.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:02.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[27356]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:01 smithi012 ceph-mon[37454]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:02.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:01 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:01.919+0000 7ff344ec6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T17:49:03.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:03.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: Reconfiguring mgr.y (unknown last config time)... 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[27356]: Reconfiguring daemon mgr.y on smithi012 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:03.030 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:03.031 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.031 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: Reconfiguring mgr.y (unknown last config time)... 2024-09-10T17:49:03.031 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:49:03.031 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:49:03.031 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:03.031 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:02 smithi012 ceph-mon[37454]: Reconfiguring daemon mgr.y on smithi012 2024-09-10T17:49:03.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:49:03.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_4 2024-09-10T17:49:03.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:02.784+0000 7ff344ec6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T17:49:03.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:02.848+0000 7ff344ec6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T17:49:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: Reconfiguring mgr.y (unknown last config time)... 2024-09-10T17:49:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:49:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:49:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:02 smithi089 ceph-mon[31467]: Reconfiguring daemon mgr.y on smithi012 2024-09-10T17:49:03.715 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:49:03.808 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:03.555+0000 7ff344ec6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T17:49:03.808 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:03.667+0000 7ff344ec6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T17:49:03.808 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:03.806+0000 7ff344ec6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:49:04.081 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:03 smithi089 ceph-mon[31467]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:04.081 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:04.081 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:03.867+0000 7ff344ec6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T17:49:04.081 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.013+0000 7ff344ec6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T17:49:04.081 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.079+0000 7ff344ec6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T17:49:04.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:03 smithi012 ceph-mon[27356]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:04.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:04.152 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:03 smithi012 ceph-mon[37454]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:04.153 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:04.355 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.138+0000 7ff344ec6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T17:49:04.356 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.291+0000 7ff344ec6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T17:49:04.356 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.354+0000 7ff344ec6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T17:49:04.615 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.419+0000 7ff344ec6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T17:49:04.615 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.499+0000 7ff344ec6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T17:49:04.615 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.556+0000 7ff344ec6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T17:49:04.615 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:04.614+0000 7ff344ec6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T17:49:05.783 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:49:05.385+0000 7ff344ec6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T17:49:06.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: Standby manager daemon x started 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:49:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: Standby manager daemon x started 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:49:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:05 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: Standby manager daemon x started 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:49:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:49:06.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:05 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/2578752883' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:49:07.117 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[27356]: mgrmap e14: y(active, since 62s), standbys: x 2024-09-10T17:49:07.117 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:49:07.117 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[27356]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[37454]: mgrmap e14: y(active, since 62s), standbys: x 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[37454]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:07.118 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:06 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:06 smithi089 ceph-mon[31467]: mgrmap e14: y(active, since 62s), standbys: x 2024-09-10T17:49:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:06 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:49:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:06 smithi089 ceph-mon[31467]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:06 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:06 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:06 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:08.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:07 smithi012 ceph-mon[27356]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:08.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:07 smithi012 ceph-mon[37454]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:08.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:07 smithi089 ceph-mon[31467]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2713991808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90"}]: dispatch 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2713991808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90"}]': finished 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[27356]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1938765116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2713991808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90"}]: dispatch 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2713991808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90"}]': finished 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[37454]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T17:49:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:08 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1938765116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:09.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:08 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2713991808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90"}]: dispatch 2024-09-10T17:49:09.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:08 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2713991808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90"}]': finished 2024-09-10T17:49:09.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:08 smithi089 ceph-mon[31467]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T17:49:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:08 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:08 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1938765116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:10.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:09 smithi012 ceph-mon[27356]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:10.283 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:09 smithi012 ceph-mon[37454]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:10.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:09 smithi089 ceph-mon[31467]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:11.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:11 smithi012 ceph-mon[27356]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:11.483 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:11 smithi012 ceph-mon[37454]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:11.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:11 smithi089 ceph-mon[31467]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:13.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:13 smithi012 ceph-mon[27356]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:13.206 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:13 smithi012 ceph-mon[37454]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:13.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:13 smithi089 ceph-mon[31467]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:14.426 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:14 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T17:49:14.426 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:14 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:14.426 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:14 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T17:49:14.426 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:14 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:14 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T17:49:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:14 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:15.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:15 smithi012 ceph-mon[27356]: Deploying daemon osd.0 on smithi012 2024-09-10T17:49:15.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:15 smithi012 ceph-mon[27356]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:15.465 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:15 smithi012 ceph-mon[37454]: Deploying daemon osd.0 on smithi012 2024-09-10T17:49:15.465 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:15 smithi012 ceph-mon[37454]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:15.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:15 smithi089 ceph-mon[31467]: Deploying daemon osd.0 on smithi012 2024-09-10T17:49:15.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:15 smithi089 ceph-mon[31467]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:17 smithi012 ceph-mon[27356]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:17.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:17 smithi012 ceph-mon[37454]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:17.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:17 smithi089 ceph-mon[31467]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:19.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:19.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:19.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:19.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:19.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:19.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:20.282 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:20 smithi012 ceph-mon[27356]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:20.282 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:20 smithi012 ceph-mon[37454]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:20.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:20 smithi089 ceph-mon[31467]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:21.254 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:21 smithi012 ceph-mon[27356]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:21.254 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:21 smithi012 ceph-mon[37454]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:21.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:21 smithi089 ceph-mon[31467]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:22.369 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 0 on host 'smithi012' 2024-09-10T17:49:22.673 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.673 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.673 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:22.673 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:22.673 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.674 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:22.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:22.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T17:49:22.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:22.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:22.972 DEBUG:teuthology.orchestra.run.smithi012:osd.0> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T17:49:22.975 INFO:tasks.cephadm:Deploying osd.1 on smithi012 with /dev/vg_nvme/lv_3... 2024-09-10T17:49:22.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T17:49:23.955 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[27356]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T17:49:23.955 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[27356]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T17:49:23.955 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:23.955 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[27356]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:49:23.955 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[27356]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:23.956 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[37454]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T17:49:23.956 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[37454]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T17:49:23.956 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:23.956 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[37454]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:49:23.956 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:23 smithi012 ceph-mon[37454]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:23 smithi089 ceph-mon[31467]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T17:49:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:23 smithi089 ceph-mon[31467]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T17:49:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:23 smithi089 ceph-mon[31467]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:49:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:23 smithi089 ceph-mon[31467]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:24.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[41356]: 2024-09-10T17:49:24.220+0000 7f834f94e640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T17:49:24.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[41356]: 2024-09-10T17:49:24.225+0000 7f834776f640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T17:49:24.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[27356]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[27356]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[27356]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[37454]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[37454]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:24.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:24 smithi012 ceph-mon[37454]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' 2024-09-10T17:49:24.883 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:49:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:24 smithi089 ceph-mon[31467]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:49:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:24 smithi089 ceph-mon[31467]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T17:49:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:24 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:24 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:24 smithi089 ceph-mon[31467]: from='osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557]' entity='osd.0' 2024-09-10T17:49:25.997 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[27356]: purged_snaps scrub starts 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[27356]: purged_snaps scrub ok 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[27356]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[27356]: osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557] boot 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[27356]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[37454]: purged_snaps scrub starts 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[37454]: purged_snaps scrub ok 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:25.998 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[37454]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:25.999 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[37454]: osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557] boot 2024-09-10T17:49:25.999 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[37454]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T17:49:25.999 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:25 smithi089 ceph-mon[31467]: purged_snaps scrub starts 2024-09-10T17:49:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:25 smithi089 ceph-mon[31467]: purged_snaps scrub ok 2024-09-10T17:49:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:25 smithi089 ceph-mon[31467]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T17:49:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:25 smithi089 ceph-mon[31467]: osd.0 [v2:172.21.15.12:6802/2400757557,v1:172.21.15.12:6803/2400757557] boot 2024-09-10T17:49:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:25 smithi089 ceph-mon[31467]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T17:49:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:49:27.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: Detected new or changed devices on smithi012 2024-09-10T17:49:27.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:27.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi012 to 16068M 2024-09-10T17:49:27.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[37454]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: Detected new or changed devices on smithi012 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi012 to 16068M 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:27.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:27.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:27 smithi012 ceph-mon[27356]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:27.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: Detected new or changed devices on smithi012 2024-09-10T17:49:27.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:27.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi012 to 16068M 2024-09-10T17:49:27.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:27.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:27.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:27.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:27 smithi089 ceph-mon[31467]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:27.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:49:27.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_3 2024-09-10T17:49:28.063 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:49:28.462 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:28 smithi012 ceph-mon[27356]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T17:49:28.462 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:28 smithi012 ceph-mon[37454]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T17:49:28.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:28 smithi089 ceph-mon[31467]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T17:49:29.394 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:29 smithi012 ceph-mon[27356]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:29.395 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:29 smithi012 ceph-mon[37454]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:29.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:29 smithi089 ceph-mon[31467]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:30.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:30 smithi012 ceph-mon[27356]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:30.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:30 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:30.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:30 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:30.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:30 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:30.397 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:30 smithi012 ceph-mon[37454]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:30.397 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:30 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:30.397 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:30 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:30.397 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:30 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:30.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:30 smithi089 ceph-mon[31467]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:30.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:30 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:30.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:30 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:30.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:30 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:31.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:31 smithi012 ceph-mon[27356]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:31.376 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:31 smithi012 ceph-mon[37454]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:31.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:31 smithi089 ceph-mon[31467]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:32.533 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:32 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/658521375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e85fa0bf-c39b-42af-9dc1-fdfa89bff20c"}]: dispatch 2024-09-10T17:49:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:32 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/658521375' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e85fa0bf-c39b-42af-9dc1-fdfa89bff20c"}]': finished 2024-09-10T17:49:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:32 smithi012 ceph-mon[37454]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T17:49:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:32 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:32.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:32 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/658521375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e85fa0bf-c39b-42af-9dc1-fdfa89bff20c"}]: dispatch 2024-09-10T17:49:32.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:32 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/658521375' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e85fa0bf-c39b-42af-9dc1-fdfa89bff20c"}]': finished 2024-09-10T17:49:32.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:32 smithi012 ceph-mon[27356]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T17:49:32.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:32 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:32 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/658521375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e85fa0bf-c39b-42af-9dc1-fdfa89bff20c"}]: dispatch 2024-09-10T17:49:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:32 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/658521375' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e85fa0bf-c39b-42af-9dc1-fdfa89bff20c"}]': finished 2024-09-10T17:49:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:32 smithi089 ceph-mon[31467]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T17:49:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:32 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:33.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:33 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2462607049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:33.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:33 smithi012 ceph-mon[27356]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:33.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:33 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2462607049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:33.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:33 smithi012 ceph-mon[37454]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:33.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:33 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2462607049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:33.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:33 smithi089 ceph-mon[31467]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:35.391 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:35 smithi012 ceph-mon[27356]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:35.391 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:35 smithi012 ceph-mon[37454]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:35 smithi089 ceph-mon[31467]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:37.486 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:37 smithi012 ceph-mon[27356]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:37.487 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:37 smithi012 ceph-mon[37454]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:37.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:37 smithi089 ceph-mon[31467]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:38.415 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T17:49:38.415 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:38.415 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:38 smithi012 ceph-mon[27356]: Deploying daemon osd.1 on smithi012 2024-09-10T17:49:38.416 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T17:49:38.416 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:38.416 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:38 smithi012 ceph-mon[37454]: Deploying daemon osd.1 on smithi012 2024-09-10T17:49:38.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T17:49:38.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:38.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:38 smithi089 ceph-mon[31467]: Deploying daemon osd.1 on smithi012 2024-09-10T17:49:39.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:39 smithi012 ceph-mon[27356]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:39.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:39 smithi012 ceph-mon[37454]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:39.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:39 smithi089 ceph-mon[31467]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:41.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:41 smithi012 ceph-mon[27356]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:41.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:41 smithi012 ceph-mon[37454]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:41.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:41 smithi089 ceph-mon[31467]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:43.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:43.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:43.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:43.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:43.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:43.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:43.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:44.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:43 smithi012 ceph-mon[37454]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:44.159 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:43 smithi012 ceph-mon[27356]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:44.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:43 smithi089 ceph-mon[31467]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:45.257 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:45 smithi012 ceph-mon[27356]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:45.258 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:45 smithi012 ceph-mon[37454]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:45.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:45 smithi089 ceph-mon[31467]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:46.188 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 1 on host 'smithi012' 2024-09-10T17:49:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T17:49:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T17:49:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:46.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:46.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:46.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T17:49:46.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:49:46.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:46.826 DEBUG:teuthology.orchestra.run.smithi012:osd.1> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T17:49:46.829 INFO:tasks.cephadm:Deploying osd.2 on smithi012 with /dev/vg_nvme/lv_2... 2024-09-10T17:49:46.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T17:49:47.744 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[27356]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T17:49:47.745 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[27356]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T17:49:47.745 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:47.745 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[27356]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:49:47.745 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[27356]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:47.745 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[37454]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T17:49:47.745 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[37454]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T17:49:47.745 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:47.746 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[37454]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:49:47.746 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-mon[37454]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:47.746 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[47365]: 2024-09-10T17:49:47.449+0000 7f16dd01d640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T17:49:47.746 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:49:47 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[47365]: 2024-09-10T17:49:47.451+0000 7f16d8e46640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T17:49:47.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:47 smithi089 ceph-mon[31467]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T17:49:47.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:47 smithi089 ceph-mon[31467]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T17:49:47.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:47 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:47.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:47 smithi089 ceph-mon[31467]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:49:47.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:47 smithi089 ceph-mon[31467]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T17:49:48.120 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:49:48.641 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:48 smithi012 ceph-mon[27356]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:49:48.641 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:48 smithi012 ceph-mon[27356]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T17:49:48.642 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:48 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:48.642 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:48 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:48.642 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:48 smithi012 ceph-mon[37454]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:49:48.642 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:48 smithi012 ceph-mon[37454]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T17:49:48.642 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:48 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:48.642 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:48 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:48.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:48 smithi089 ceph-mon[31467]: from='osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:49:48.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:48 smithi089 ceph-mon[31467]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T17:49:48.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:48 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:48.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:48 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[27356]: purged_snaps scrub starts 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[27356]: purged_snaps scrub ok 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[27356]: osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520] boot 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[27356]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[27356]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[37454]: purged_snaps scrub starts 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[37454]: purged_snaps scrub ok 2024-09-10T17:49:49.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[37454]: osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520] boot 2024-09-10T17:49:49.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[37454]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T17:49:49.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:49.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:49 smithi012 ceph-mon[37454]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:49.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:49 smithi089 ceph-mon[31467]: purged_snaps scrub starts 2024-09-10T17:49:49.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:49 smithi089 ceph-mon[31467]: purged_snaps scrub ok 2024-09-10T17:49:49.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:49 smithi089 ceph-mon[31467]: osd.1 [v2:172.21.15.12:6810/284928520,v1:172.21.15.12:6811/284928520] boot 2024-09-10T17:49:49.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:49 smithi089 ceph-mon[31467]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T17:49:49.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:49 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:49:49.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:49 smithi089 ceph-mon[31467]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:50.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T17:49:50.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:50.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:50.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:50.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:50.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T17:49:50.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:49:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:49:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:49:51.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:49:51.708 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_2 2024-09-10T17:49:51.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:51 smithi012 ceph-mon[27356]: Detected new or changed devices on smithi012 2024-09-10T17:49:51.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:51 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi012 to 8034M 2024-09-10T17:49:51.734 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:51 smithi012 ceph-mon[27356]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:51.734 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:51 smithi012 ceph-mon[37454]: Detected new or changed devices on smithi012 2024-09-10T17:49:51.734 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:51 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi012 to 8034M 2024-09-10T17:49:51.734 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:51 smithi012 ceph-mon[37454]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:51.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:51 smithi089 ceph-mon[31467]: Detected new or changed devices on smithi012 2024-09-10T17:49:51.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:51 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi012 to 8034M 2024-09-10T17:49:51.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:51 smithi089 ceph-mon[31467]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:51.915 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:49:53.400 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:53 smithi012 ceph-mon[27356]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:53.400 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:53 smithi012 ceph-mon[37454]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:53.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:53 smithi089 ceph-mon[31467]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:54.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:54 smithi012 ceph-mon[27356]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:54.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:54 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:54.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:54 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:54.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:54 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:54.353 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:54 smithi012 ceph-mon[37454]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:54.353 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:54 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:54.354 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:54 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:54.354 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:54 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:54.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:54 smithi089 ceph-mon[31467]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:49:54.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:54 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:49:54.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:54 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:49:54.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:54 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:49:55.250 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:55 smithi012 ceph-mon[27356]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:55.250 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:55 smithi012 ceph-mon[37454]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:55.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:55 smithi089 ceph-mon[31467]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3224121015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]: dispatch 2024-09-10T17:49:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]: dispatch 2024-09-10T17:49:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]': finished 2024-09-10T17:49:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[27356]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T17:49:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:49:56.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3224121015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]: dispatch 2024-09-10T17:49:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]: dispatch 2024-09-10T17:49:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]': finished 2024-09-10T17:49:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[37454]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T17:49:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:49:56.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:56 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3224121015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]: dispatch 2024-09-10T17:49:56.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:56 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]: dispatch 2024-09-10T17:49:56.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:56 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0123bb74-5ee1-4cae-a398-a3d0f1baa7b0"}]': finished 2024-09-10T17:49:56.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:56 smithi089 ceph-mon[31467]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T17:49:56.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:49:57.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:57 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1503078040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:57.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:57 smithi012 ceph-mon[27356]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:57.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:57 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1503078040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:57.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:57 smithi012 ceph-mon[37454]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:57.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:57 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1503078040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:49:57.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:57 smithi089 ceph-mon[31467]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:59.414 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:49:59 smithi012 ceph-mon[27356]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:59.415 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:49:59 smithi012 ceph-mon[37454]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:49:59.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:49:59 smithi089 ceph-mon[31467]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:00.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:00 smithi012 ceph-mon[27356]: overall HEALTH_OK 2024-09-10T17:50:00.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:00 smithi012 ceph-mon[37454]: overall HEALTH_OK 2024-09-10T17:50:00.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:00 smithi089 ceph-mon[31467]: overall HEALTH_OK 2024-09-10T17:50:01.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:01 smithi012 ceph-mon[27356]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:01.350 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:01 smithi012 ceph-mon[37454]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:01.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:01 smithi089 ceph-mon[31467]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:02.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T17:50:02.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:02 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:02.496 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T17:50:02.496 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:02 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:02.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T17:50:02.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:02 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:03.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:03 smithi012 ceph-mon[27356]: Deploying daemon osd.2 on smithi012 2024-09-10T17:50:03.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:03 smithi012 ceph-mon[27356]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:03.524 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:03 smithi012 ceph-mon[37454]: Deploying daemon osd.2 on smithi012 2024-09-10T17:50:03.524 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:03 smithi012 ceph-mon[37454]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:03 smithi089 ceph-mon[31467]: Deploying daemon osd.2 on smithi012 2024-09-10T17:50:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:03 smithi089 ceph-mon[31467]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:05 smithi012 ceph-mon[27356]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:05 smithi012 ceph-mon[37454]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:05.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:05 smithi089 ceph-mon[31467]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:07 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:07 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:07 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:07 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:07 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:07 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:07.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:07 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:07.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:07 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:07.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:07 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:08.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:08 smithi012 ceph-mon[27356]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:08.509 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:08 smithi012 ceph-mon[37454]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:08.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:08 smithi089 ceph-mon[31467]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:10.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[27356]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:10.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[37454]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:10 smithi089 ceph-mon[31467]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:10.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:10.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:10.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:10.626 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 2 on host 'smithi012' 2024-09-10T17:50:11.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:11 smithi012 ceph-mon[27356]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T17:50:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:11 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:11 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:11 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:11 smithi012 ceph-mon[37454]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T17:50:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:11 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:11 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:11 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:11.350 DEBUG:teuthology.orchestra.run.smithi012:osd.2> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T17:50:11.392 INFO:tasks.cephadm:Deploying osd.3 on smithi012 with /dev/vg_nvme/lv_1... 2024-09-10T17:50:11.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T17:50:11.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:11 smithi089 ceph-mon[31467]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T17:50:11.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:11 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:11.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:11 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:11.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:11 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:50:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[27356]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[27356]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T17:50:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[27356]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T17:50:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[27356]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[37454]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[37454]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T17:50:12.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[37454]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T17:50:12.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:12.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-mon[37454]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:12.286 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[52899]: 2024-09-10T17:50:12.079+0000 7f3dfffc8640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T17:50:12.286 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:12 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[52899]: 2024-09-10T17:50:12.087+0000 7f3dfbdf1640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T17:50:12.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:12 smithi089 ceph-mon[31467]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:12.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:12 smithi089 ceph-mon[31467]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T17:50:12.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:12 smithi089 ceph-mon[31467]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T17:50:12.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:12 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:12.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:12 smithi089 ceph-mon[31467]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:13.161 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:13 smithi012 ceph-mon[27356]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:50:13.161 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:13 smithi012 ceph-mon[27356]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T17:50:13.161 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:13 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:13.161 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:13 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:13.161 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:13 smithi012 ceph-mon[37454]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:50:13.161 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:13 smithi012 ceph-mon[37454]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T17:50:13.162 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:13 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:13.162 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:13 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:13.436 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:13 smithi089 ceph-mon[31467]: from='osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:50:13.436 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:13 smithi089 ceph-mon[31467]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T17:50:13.437 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:13 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:13.437 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:13 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:14.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[27356]: purged_snaps scrub starts 2024-09-10T17:50:14.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[27356]: purged_snaps scrub ok 2024-09-10T17:50:14.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[27356]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:14.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:14.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[27356]: osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892] boot 2024-09-10T17:50:14.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[27356]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[37454]: purged_snaps scrub starts 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[37454]: purged_snaps scrub ok 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[37454]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[37454]: osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892] boot 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[37454]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:14.241 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:14 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:50:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:14 smithi089 ceph-mon[31467]: purged_snaps scrub starts 2024-09-10T17:50:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:14 smithi089 ceph-mon[31467]: purged_snaps scrub ok 2024-09-10T17:50:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:14 smithi089 ceph-mon[31467]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T17:50:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:14 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:14 smithi089 ceph-mon[31467]: osd.2 [v2:172.21.15.12:6818/2631347892,v1:172.21.15.12:6819/2631347892] boot 2024-09-10T17:50:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:14 smithi089 ceph-mon[31467]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T17:50:14.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:14 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:50:14.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:14 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:50:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:50:14.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_1 2024-09-10T17:50:15.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T17:50:15.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[27356]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T17:50:15.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:50:15.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T17:50:15.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[27356]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T17:50:15.383 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T17:50:15.383 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[37454]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T17:50:15.383 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:50:15.383 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T17:50:15.383 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:15 smithi012 ceph-mon[37454]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T17:50:15.527 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:50:15.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:15 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T17:50:15.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:15 smithi089 ceph-mon[31467]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T17:50:15.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:15 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:50:15.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:15 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T17:50:15.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:15 smithi089 ceph-mon[31467]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T17:50:16.236 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:16 smithi012 ceph-mon[27356]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:16.237 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:16 smithi012 ceph-mon[27356]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:50:16.237 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:16 smithi012 ceph-mon[37454]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:16.237 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:16 smithi012 ceph-mon[37454]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:50:16.237 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:50:15 smithi012 sudo[55010]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T17:50:16.237 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:50:15 smithi012 sudo[55010]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:16.237 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:50:15 smithi012 sudo[55010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:16.237 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:50:15 smithi012 sudo[55010]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:50:16 smithi012 sudo[56955]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T17:50:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:50:16 smithi012 sudo[56955]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:50:16 smithi012 sudo[56955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 17:50:16 smithi012 sudo[56955]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:16.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:16 smithi089 ceph-mon[31467]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:16.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:16 smithi089 ceph-mon[31467]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:50:17.010 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:50:16 smithi012 sudo[56968]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T17:50:17.010 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:50:16 smithi012 sudo[56968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:17.010 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:50:16 smithi012 sudo[56968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:17.010 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:50:16 smithi012 sudo[56968]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: Detected new or changed devices on smithi012 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi012 to 5356M 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[27356]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: Detected new or changed devices on smithi012 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi012 to 5356M 2024-09-10T17:50:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:17 smithi012 ceph-mon[37454]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:17.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T17:50:17.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: Detected new or changed devices on smithi012 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi012 to 5356M 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:17 smithi089 ceph-mon[31467]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:17.658 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:50:17 smithi012 sudo[57007]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T17:50:17.658 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:50:17 smithi012 sudo[57007]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:17.658 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:50:17 smithi012 sudo[57007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:17.658 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 17:50:17 smithi012 sudo[57007]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:18.033 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:17 smithi012 sudo[57036]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T17:50:18.034 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:17 smithi012 sudo[57036]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:18.034 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:17 smithi012 sudo[57036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:18.034 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:17 smithi012 sudo[57036]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:18.456 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:18 smithi012 sudo[57127]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T17:50:18.456 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:18 smithi012 sudo[57127]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:18.456 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:18 smithi012 sudo[57127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:18.457 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 17:50:18 smithi012 sudo[57127]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:18.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[27356]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:50:18.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[27356]: Cluster is now healthy 2024-09-10T17:50:18.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[27356]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-10T17:50:18.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[27356]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:50:18.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:50:18.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:50:18.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:18.458 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[37454]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:50:18.458 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[37454]: Cluster is now healthy 2024-09-10T17:50:18.458 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[37454]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-10T17:50:18.458 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[37454]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:50:18.458 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:50:18.458 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:50:18.458 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:18 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:18.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:18 smithi089 ceph-mon[31467]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:50:18.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:18 smithi089 ceph-mon[31467]: Cluster is now healthy 2024-09-10T17:50:18.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:18 smithi089 ceph-mon[31467]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-10T17:50:18.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:18 smithi089 ceph-mon[31467]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:50:18.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:18 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:50:18.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:18 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:50:18.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:18 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:18.715 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 sudo[57204]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T17:50:18.715 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 sudo[57204]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:18.715 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 sudo[57204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:18.715 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:18 smithi012 sudo[57204]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:19.404 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 sudo[57209]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T17:50:19.404 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 sudo[57209]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:19.404 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 sudo[57209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:19.404 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 sudo[57209]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:19.651 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 sudo[33850]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T17:50:19.652 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 sudo[33850]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:19.652 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 sudo[33850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:19.652 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 sudo[33850]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:20.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:20.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:20.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 sudo[33853]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 sudo[33853]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 sudo[33853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 sudo[33853]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:20.533 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 sudo[57258]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T17:50:20.533 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 sudo[57258]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:20.533 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 sudo[57258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:20.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 sudo[57258]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:20.825 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:20.825 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:20.825 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:20.825 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:20.825 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3177949015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a90d703-23ef-4088-a152-f27bce4c3270"}]: dispatch 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3177949015' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a90d703-23ef-4088-a152-f27bce4c3270"}]': finished 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 sudo[57284]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 sudo[57284]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T17:50:20.826 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 sudo[57284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 sudo[57284]: pam_unix(sudo:session): session closed for user root 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3177949015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a90d703-23ef-4088-a152-f27bce4c3270"}]: dispatch 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3177949015' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a90d703-23ef-4088-a152-f27bce4c3270"}]': finished 2024-09-10T17:50:20.827 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T17:50:20.828 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:20 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T17:50:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:50:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:50:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:50:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3177949015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a90d703-23ef-4088-a152-f27bce4c3270"}]: dispatch 2024-09-10T17:50:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T17:50:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3177949015' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a90d703-23ef-4088-a152-f27bce4c3270"}]': finished 2024-09-10T17:50:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T17:50:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:20 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:22.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:21 smithi012 ceph-mon[27356]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:22.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:21 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/4156219844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:50:22.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:21 smithi012 ceph-mon[37454]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:22.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:21 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/4156219844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:50:22.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:21 smithi089 ceph-mon[31467]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:22.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:21 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/4156219844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:50:23.406 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:23 smithi012 ceph-mon[27356]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:23.406 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:23 smithi012 ceph-mon[37454]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:23.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:23 smithi089 ceph-mon[31467]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:25.395 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:25 smithi012 ceph-mon[27356]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T17:50:25.395 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:25 smithi012 ceph-mon[37454]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T17:50:25.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:25 smithi089 ceph-mon[31467]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T17:50:27.012 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:26 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T17:50:27.012 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:26 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:27.012 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:26 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T17:50:27.012 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:26 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:27.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:26 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T17:50:27.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:26 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:28.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:27 smithi012 ceph-mon[27356]: Deploying daemon osd.3 on smithi012 2024-09-10T17:50:28.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:27 smithi012 ceph-mon[27356]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-10T17:50:28.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:27 smithi012 ceph-mon[37454]: Deploying daemon osd.3 on smithi012 2024-09-10T17:50:28.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:27 smithi012 ceph-mon[37454]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-10T17:50:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:27 smithi089 ceph-mon[31467]: Deploying daemon osd.3 on smithi012 2024-09-10T17:50:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:27 smithi089 ceph-mon[31467]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-10T17:50:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:29 smithi012 ceph-mon[37454]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-10T17:50:29.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:29 smithi012 ceph-mon[27356]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-10T17:50:29.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:29 smithi089 ceph-mon[31467]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-10T17:50:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:31 smithi012 ceph-mon[27356]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 75 KiB/s wr, 5 op/s 2024-09-10T17:50:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:31 smithi012 ceph-mon[37454]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 75 KiB/s wr, 5 op/s 2024-09-10T17:50:31.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:31 smithi089 ceph-mon[31467]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 75 KiB/s wr, 5 op/s 2024-09-10T17:50:32.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:32 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:32.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:32 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:32.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:32 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:32.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:32 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:32.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:32 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:32.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:32 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:32 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:32 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:32 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:33.444 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:33 smithi012 ceph-mon[27356]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T17:50:33.445 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:33 smithi012 ceph-mon[37454]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T17:50:33.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:33 smithi089 ceph-mon[31467]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T17:50:34.867 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 3 on host 'smithi012' 2024-09-10T17:50:35.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:35.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:35.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T17:50:35.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T17:50:35.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[37454]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T17:50:35.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T17:50:35.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:35.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:35 smithi012 ceph-mon[27356]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T17:50:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T17:50:35.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T17:50:35.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:35.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:35.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:35 smithi089 ceph-mon[31467]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T17:50:35.541 DEBUG:teuthology.orchestra.run.smithi012:osd.3> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T17:50:35.543 INFO:tasks.cephadm:Deploying osd.4 on smithi089 with /dev/vg_nvme/lv_4... 2024-09-10T17:50:35.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T17:50:35.748 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:50:36.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[27356]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T17:50:36.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[27356]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T17:50:36.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:36.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[27356]: from='osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:36.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[27356]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:36.815 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[37454]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T17:50:36.815 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[37454]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T17:50:36.815 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:36.815 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[37454]: from='osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:36.815 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-mon[37454]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:36.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:36 smithi089 ceph-mon[31467]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T17:50:36.817 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:36 smithi089 ceph-mon[31467]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T17:50:36.817 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:36 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:36.817 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:36 smithi089 ceph-mon[31467]: from='osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:36.817 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:36 smithi089 ceph-mon[31467]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-10T17:50:37.075 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 17:50:36 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[58943]: 2024-09-10T17:50:36.997+0000 7fc2c9bbe640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T17:50:37.075 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[58943]: 2024-09-10T17:50:37.001+0000 7fc2c11c8640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T17:50:37.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:37 smithi089 ceph-mon[31467]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:50:37.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:37 smithi089 ceph-mon[31467]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T17:50:37.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:37 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:37.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:37 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:37.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:37 smithi089 ceph-mon[31467]: from='osd.3 ' entity='osd.3' 2024-09-10T17:50:37.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:37 smithi089 ceph-mon[31467]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:37.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[27356]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:50:37.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[27356]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T17:50:37.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:37.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:37.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[27356]: from='osd.3 ' entity='osd.3' 2024-09-10T17:50:37.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[27356]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:37.954 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[37454]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-10T17:50:37.954 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[37454]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T17:50:37.954 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:37.954 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:37.954 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[37454]: from='osd.3 ' entity='osd.3' 2024-09-10T17:50:37.954 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:37 smithi012 ceph-mon[37454]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T17:50:37.974 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:50:37.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_4 2024-09-10T17:50:38.201 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: purged_snaps scrub starts 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: purged_snaps scrub ok 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557] boot 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: purged_snaps scrub starts 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: purged_snaps scrub ok 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:38.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557] boot 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:38.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:39.019 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: purged_snaps scrub starts 2024-09-10T17:50:39.019 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: purged_snaps scrub ok 2024-09-10T17:50:39.019 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:39.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: osd.3 [v2:172.21.15.12:6826/3917191557,v1:172.21.15.12:6827/3917191557] boot 2024-09-10T17:50:39.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T17:50:39.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:50:39.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:39.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:39.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:39.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:39.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:39.021 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:39.021 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:39.021 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:39.021 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:39.021 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:39.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:39 smithi089 ceph-mon[31467]: Detected new or changed devices on smithi012 2024-09-10T17:50:39.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:39 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi012 to 4017M 2024-09-10T17:50:39.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:39 smithi089 ceph-mon[31467]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:39 smithi012 ceph-mon[27356]: Detected new or changed devices on smithi012 2024-09-10T17:50:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:39 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi012 to 4017M 2024-09-10T17:50:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:39 smithi012 ceph-mon[27356]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:40.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:39 smithi012 ceph-mon[37454]: Detected new or changed devices on smithi012 2024-09-10T17:50:40.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:39 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi012 to 4017M 2024-09-10T17:50:40.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:39 smithi012 ceph-mon[37454]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:40.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:40 smithi089 ceph-mon[31467]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T17:50:40.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:40 smithi089 ceph-mon[31467]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:50:40.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:40 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:50:40.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:40 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:50:40.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:40 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[27356]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[27356]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[37454]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[37454]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:50:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:50:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:40 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:42.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:41 smithi012 ceph-mon[27356]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:42.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:41 smithi012 ceph-mon[37454]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:41 smithi089 ceph-mon[31467]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:43.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/2692653552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]: dispatch 2024-09-10T17:50:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]: dispatch 2024-09-10T17:50:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]': finished 2024-09-10T17:50:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[27356]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T17:50:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/2692653552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]: dispatch 2024-09-10T17:50:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]: dispatch 2024-09-10T17:50:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]': finished 2024-09-10T17:50:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[37454]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T17:50:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:42 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/2692653552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]: dispatch 2024-09-10T17:50:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:42 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]: dispatch 2024-09-10T17:50:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:42 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16019dce-e8f5-47eb-9d6c-e123ad974201"}]': finished 2024-09-10T17:50:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:42 smithi089 ceph-mon[31467]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T17:50:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:44.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:43 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/1026507724' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:50:44.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:43 smithi012 ceph-mon[27356]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:44.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:43 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/1026507724' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:50:44.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:43 smithi012 ceph-mon[37454]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:44.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:43 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/1026507724' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:50:44.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:43 smithi089 ceph-mon[31467]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:45.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:45 smithi012 ceph-mon[27356]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:45.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:45 smithi012 ceph-mon[37454]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:45.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:45 smithi089 ceph-mon[31467]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:47.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:47 smithi089 ceph-mon[31467]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:47.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:47 smithi012 ceph-mon[27356]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:47.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:47 smithi012 ceph-mon[37454]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:48.478 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:48 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T17:50:48.479 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:48 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:48.479 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:48 smithi089 ceph-mon[31467]: Deploying daemon osd.4 on smithi089 2024-09-10T17:50:48.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:48 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T17:50:48.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:48 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:48.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:48 smithi012 ceph-mon[27356]: Deploying daemon osd.4 on smithi089 2024-09-10T17:50:48.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:48 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T17:50:48.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:48 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:48.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:48 smithi012 ceph-mon[37454]: Deploying daemon osd.4 on smithi089 2024-09-10T17:50:49.370 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:49 smithi089 ceph-mon[31467]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:49 smithi012 ceph-mon[27356]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:49.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:49 smithi012 ceph-mon[37454]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:51.412 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:51 smithi089 ceph-mon[31467]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:51.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:51 smithi012 ceph-mon[27356]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:51.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:51 smithi012 ceph-mon[37454]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:52.977 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:52.977 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:52.977 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:53.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:53.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:53.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:53.824 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:53 smithi089 ceph-mon[31467]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:54.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:53 smithi012 ceph-mon[27356]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:54.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:53 smithi012 ceph-mon[37454]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:55.824 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 4 on host 'smithi089' 2024-09-10T17:50:56.137 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.138 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:56 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.400 DEBUG:teuthology.orchestra.run.smithi089:osd.4> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T17:50:56.402 INFO:tasks.cephadm:Deploying osd.5 on smithi089 with /dev/vg_nvme/lv_3... 2024-09-10T17:50:56.403 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:50:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:56.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:56 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:50:57.774 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:57 smithi089 ceph-mon[31467]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T17:50:57.774 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:57 smithi089 ceph-mon[31467]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T17:50:57.774 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:57 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:57.774 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:57 smithi089 ceph-mon[31467]: from='osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:50:57.774 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:57 smithi089 ceph-mon[31467]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:50:57.775 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:57 smithi089 ceph-mon[31467]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:57.775 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 17:50:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[36145]: 2024-09-10T17:50:57.493+0000 7fdfd1aaa640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T17:50:57.775 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 17:50:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[36145]: 2024-09-10T17:50:57.497+0000 7fdfcd8d3640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T17:50:57.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[37454]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T17:50:57.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[37454]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T17:50:57.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:57.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[37454]: from='osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:50:57.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[37454]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:50:57.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[37454]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:57.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[27356]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T17:50:57.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[27356]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T17:50:57.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:57.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[27356]: from='osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:50:57.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[27356]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:50:57.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:57 smithi012 ceph-mon[27356]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T17:50:58.648 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:58 smithi089 ceph-mon[31467]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:50:58.648 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:58 smithi089 ceph-mon[31467]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T17:50:58.648 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:58.648 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:58.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:58 smithi012 ceph-mon[27356]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:50:58.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:58 smithi012 ceph-mon[27356]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T17:50:58.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:58.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:58.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:58 smithi012 ceph-mon[37454]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:50:58.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:58 smithi012 ceph-mon[37454]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T17:50:58.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:58.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:59.532 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: purged_snaps scrub starts 2024-09-10T17:50:59.532 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: purged_snaps scrub ok 2024-09-10T17:50:59.532 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708] boot 2024-09-10T17:50:59.532 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:59.533 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:50:59 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: purged_snaps scrub starts 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: purged_snaps scrub ok 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708] boot 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: purged_snaps scrub starts 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: purged_snaps scrub ok 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: osd.4 [v2:172.21.15.89:6800/4063563708,v1:172.21.15.89:6801/4063563708] boot 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:50:59.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:50:59.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:50:59.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:50:59.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:50:59 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:00.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:00 smithi012 ceph-mon[27356]: Detected new or changed devices on smithi089 2024-09-10T17:51:00.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:00 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-10T17:51:00.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:00 smithi012 ceph-mon[27356]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T17:51:00.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:00 smithi012 ceph-mon[27356]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T17:51:00.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:00 smithi012 ceph-mon[37454]: Detected new or changed devices on smithi089 2024-09-10T17:51:00.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:00 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-10T17:51:00.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:00 smithi012 ceph-mon[37454]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T17:51:00.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:00 smithi012 ceph-mon[37454]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T17:51:00.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:00 smithi089 ceph-mon[31467]: Detected new or changed devices on smithi089 2024-09-10T17:51:00.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:00 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-10T17:51:00.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:00 smithi089 ceph-mon[31467]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T17:51:00.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:00 smithi089 ceph-mon[31467]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T17:51:00.900 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:51:00.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_3 2024-09-10T17:51:01.111 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:51:01.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:01 smithi012 ceph-mon[27356]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:01.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:01 smithi012 ceph-mon[37454]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:01.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:01 smithi089 ceph-mon[31467]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:02.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:02 smithi089 ceph-mon[31467]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T17:51:02.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:02 smithi012 ceph-mon[27356]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T17:51:02.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:02 smithi012 ceph-mon[37454]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T17:51:03.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:03 smithi089 ceph-mon[31467]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T17:51:03.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:03 smithi089 ceph-mon[31467]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:03.692 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:03.692 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:03.692 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:03.692 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:03 smithi089 ceph-mon[31467]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:03.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[27356]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[27356]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[27356]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[37454]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[37454]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:03.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:03.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:03 smithi012 ceph-mon[37454]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/498638277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]: dispatch 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]: dispatch 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]': finished 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[27356]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/498638277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]: dispatch 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]: dispatch 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]': finished 2024-09-10T17:51:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[37454]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T17:51:05.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:04 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:04 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/498638277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]: dispatch 2024-09-10T17:51:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:04 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]: dispatch 2024-09-10T17:51:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:04 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f"}]': finished 2024-09-10T17:51:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:04 smithi089 ceph-mon[31467]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T17:51:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:04 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:05 smithi012 ceph-mon[27356]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-10T17:51:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:05 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/1766509890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:06.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:05 smithi012 ceph-mon[37454]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-10T17:51:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:05 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/1766509890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:06.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:05 smithi089 ceph-mon[31467]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-10T17:51:06.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:05 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/1766509890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:07 smithi012 ceph-mon[27356]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T17:51:07.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:07 smithi012 ceph-mon[37454]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T17:51:07.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:07 smithi089 ceph-mon[31467]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T17:51:09.264 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:09 smithi089 ceph-mon[31467]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T17:51:09.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:09 smithi012 ceph-mon[27356]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T17:51:09.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:09 smithi012 ceph-mon[37454]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T17:51:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T17:51:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T17:51:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T17:51:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:12.077 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:11 smithi089 ceph-mon[31467]: Deploying daemon osd.5 on smithi089 2024-09-10T17:51:12.077 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:11 smithi089 ceph-mon[31467]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T17:51:12.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:11 smithi012 ceph-mon[27356]: Deploying daemon osd.5 on smithi089 2024-09-10T17:51:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:11 smithi012 ceph-mon[27356]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T17:51:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:11 smithi012 ceph-mon[37454]: Deploying daemon osd.5 on smithi089 2024-09-10T17:51:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:11 smithi012 ceph-mon[37454]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T17:51:13.441 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:13 smithi089 ceph-mon[31467]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:51:13.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:13 smithi012 ceph-mon[27356]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:51:13.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:13 smithi012 ceph-mon[37454]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:51:15.453 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:15 smithi089 ceph-mon[31467]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:15.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:15 smithi012 ceph-mon[27356]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:15.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:15 smithi012 ceph-mon[37454]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:16.382 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:16 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:16.382 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:16 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:16.382 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:16 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:16.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:16 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:16.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:16 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:16.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:16 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:16.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:16 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:16.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:16 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:16.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:16 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:17.467 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:17 smithi089 ceph-mon[31467]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:17.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:17 smithi012 ceph-mon[27356]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:17.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:17 smithi012 ceph-mon[37454]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:18.938 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 5 on host 'smithi089' 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:19.517 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.518 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.518 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:19 smithi089 ceph-mon[31467]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[27356]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:19 smithi012 ceph-mon[37454]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:19.537 DEBUG:teuthology.orchestra.run.smithi089:osd.5> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T17:51:19.539 INFO:tasks.cephadm:Deploying osd.6 on smithi089 with /dev/vg_nvme/lv_2... 2024-09-10T17:51:19.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T17:51:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[27356]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T17:51:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[27356]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T17:51:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[27356]: from='osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[27356]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:20.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[37454]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T17:51:20.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[37454]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T17:51:20.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:20.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[37454]: from='osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:20.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:20 smithi012 ceph-mon[37454]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:20.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:20 smithi089 ceph-mon[31467]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T17:51:20.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:20 smithi089 ceph-mon[31467]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T17:51:20.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:20 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:20.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:20 smithi089 ceph-mon[31467]: from='osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:20.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:20 smithi089 ceph-mon[31467]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:20.608 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:51:20.863 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 17:51:20 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[41951]: 2024-09-10T17:51:20.659+0000 7f4bb5972640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T17:51:20.864 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 17:51:20 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[41951]: 2024-09-10T17:51:20.666+0000 7f4bad793640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T17:51:21.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: from='osd.5 ' entity='osd.5' 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: pgmap v126: 1 pgs: 1 unknown; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364] boot 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:51:21.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: from='osd.5 ' entity='osd.5' 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: pgmap v126: 1 pgs: 1 unknown; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364] boot 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T17:51:21.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: from='osd.5 ' entity='osd.5' 2024-09-10T17:51:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: pgmap v126: 1 pgs: 1 unknown; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T17:51:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: osd.5 [v2:172.21.15.89:6808/4007259364,v1:172.21.15.89:6809/4007259364] boot 2024-09-10T17:51:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T17:51:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:51:22.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:22 smithi089 ceph-mon[31467]: purged_snaps scrub starts 2024-09-10T17:51:22.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:22 smithi089 ceph-mon[31467]: purged_snaps scrub ok 2024-09-10T17:51:22.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:22 smithi089 ceph-mon[31467]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T17:51:23.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:22 smithi012 ceph-mon[37454]: purged_snaps scrub starts 2024-09-10T17:51:23.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:22 smithi012 ceph-mon[37454]: purged_snaps scrub ok 2024-09-10T17:51:23.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:22 smithi012 ceph-mon[37454]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T17:51:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:22 smithi012 ceph-mon[27356]: purged_snaps scrub starts 2024-09-10T17:51:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:22 smithi012 ceph-mon[27356]: purged_snaps scrub ok 2024-09-10T17:51:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:22 smithi012 ceph-mon[27356]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T17:51:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T17:51:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: Detected new or changed devices on smithi089 2024-09-10T17:51:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[27356]: pgmap v130: 1 pgs: 1 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: Detected new or changed devices on smithi089 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:23 smithi012 ceph-mon[37454]: pgmap v130: 1 pgs: 1 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: Detected new or changed devices on smithi089 2024-09-10T17:51:24.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:23 smithi089 ceph-mon[31467]: pgmap v130: 1 pgs: 1 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:24.256 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:51:24.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_2 2024-09-10T17:51:24.468 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:51:24.940 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:24 smithi089 ceph-mon[31467]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T17:51:25.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:24 smithi012 ceph-mon[27356]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T17:51:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:24 smithi012 ceph-mon[37454]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T17:51:25.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:25 smithi089 ceph-mon[31467]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T17:51:25.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:25 smithi089 ceph-mon[31467]: pgmap v133: 1 pgs: 1 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:26.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:25 smithi012 ceph-mon[27356]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T17:51:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:25 smithi012 ceph-mon[27356]: pgmap v133: 1 pgs: 1 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:26.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:25 smithi012 ceph-mon[37454]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T17:51:26.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:25 smithi012 ceph-mon[37454]: pgmap v133: 1 pgs: 1 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:26.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:26 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:26 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:26 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:26 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:26 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:26 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:26 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:26 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:26 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:28.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:27 smithi012 ceph-mon[27356]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:28.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:27 smithi012 ceph-mon[27356]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-10T17:51:28.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:27 smithi012 ceph-mon[37454]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:28.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:27 smithi012 ceph-mon[37454]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-10T17:51:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:27 smithi089 ceph-mon[31467]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:27 smithi089 ceph-mon[31467]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-10T17:51:28.933 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:28 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/2127033892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]: dispatch 2024-09-10T17:51:28.933 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:28 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]: dispatch 2024-09-10T17:51:28.933 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:28 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]': finished 2024-09-10T17:51:28.933 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:28 smithi089 ceph-mon[31467]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T17:51:28.933 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:28 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:29.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/2127033892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]: dispatch 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]: dispatch 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]': finished 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[27356]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/2127033892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]: dispatch 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]: dispatch 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cc71b00-da13-40b4-91b2-43218ec8cfea"}]': finished 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[37454]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T17:51:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:28 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:30.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:29 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/937012266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:29 smithi012 ceph-mon[27356]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T17:51:30.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:29 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/937012266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:30.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:29 smithi012 ceph-mon[37454]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T17:51:30.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:29 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/937012266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:30.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:29 smithi089 ceph-mon[31467]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T17:51:31.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:31 smithi012 ceph-mon[27356]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T17:51:31.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:31 smithi012 ceph-mon[37454]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T17:51:31.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:31 smithi089 ceph-mon[31467]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T17:51:33.235 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:33 smithi089 ceph-mon[31467]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T17:51:33.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:33 smithi012 ceph-mon[27356]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T17:51:33.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:33 smithi012 ceph-mon[37454]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T17:51:34.776 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:34 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T17:51:34.776 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:34 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:34.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:34 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T17:51:34.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:34 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:34.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:34 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T17:51:34.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:34 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:35.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:35 smithi089 ceph-mon[31467]: Deploying daemon osd.6 on smithi089 2024-09-10T17:51:35.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:35 smithi089 ceph-mon[31467]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:51:35.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:35 smithi012 ceph-mon[27356]: Deploying daemon osd.6 on smithi089 2024-09-10T17:51:35.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:35 smithi012 ceph-mon[27356]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:51:35.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:35 smithi012 ceph-mon[37454]: Deploying daemon osd.6 on smithi089 2024-09-10T17:51:35.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:35 smithi012 ceph-mon[37454]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:51:37.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:37 smithi012 ceph-mon[27356]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:37.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:37 smithi012 ceph-mon[37454]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:37.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:37 smithi089 ceph-mon[31467]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:39.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:39 smithi012 ceph-mon[27356]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:39.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:39 smithi012 ceph-mon[37454]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:39.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:39 smithi089 ceph-mon[31467]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:40.440 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:40 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:40.440 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:40 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:40.440 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:40 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:40.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:40 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:40.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:40 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:40.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:40 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:40.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:40 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:40.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:40 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:40.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:40 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:41.276 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:41 smithi089 ceph-mon[31467]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:41.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:41 smithi012 ceph-mon[27356]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:41.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:41 smithi012 ceph-mon[37454]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:42.525 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:42.526 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:42.526 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:42.526 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:42.526 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:42 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:42.560 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 6 on host 'smithi089' 2024-09-10T17:51:42.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:42.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:42 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:43.150 DEBUG:teuthology.orchestra.run.smithi089:osd.6> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T17:51:43.153 INFO:tasks.cephadm:Deploying osd.7 on smithi089 with /dev/vg_nvme/lv_1... 2024-09-10T17:51:43.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T17:51:43.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:43 smithi089 ceph-mon[31467]: from='osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T17:51:43.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:43 smithi089 ceph-mon[31467]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T17:51:43.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:43 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:43.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:43 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:43.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:43 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:43.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:43 smithi089 ceph-mon[31467]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[27356]: from='osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T17:51:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[27356]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T17:51:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[27356]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:43.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[37454]: from='osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T17:51:43.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[37454]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T17:51:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:51:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:43 smithi012 ceph-mon[37454]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:44.664 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:44 smithi089 ceph-mon[31467]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T17:51:44.664 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:44 smithi089 ceph-mon[31467]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T17:51:44.664 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:44 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:44.664 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:44 smithi089 ceph-mon[31467]: from='osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:44.664 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:44 smithi089 ceph-mon[31467]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[27356]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[27356]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[27356]: from='osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[27356]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[37454]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[37454]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:44.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[37454]: from='osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:44.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:44 smithi012 ceph-mon[37454]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:51:44.804 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:51:44.929 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 17:51:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[47693]: 2024-09-10T17:51:44.846+0000 7f04eb03f640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T17:51:44.929 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 17:51:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[47693]: 2024-09-10T17:51:44.854+0000 7f04e2e60640 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T17:51:45.506 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:45 smithi089 ceph-mon[31467]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:51:45.506 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:45 smithi089 ceph-mon[31467]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T17:51:45.506 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:45 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:45.506 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:45 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:45.506 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:45 smithi089 ceph-mon[31467]: from='osd.6 ' entity='osd.6' 2024-09-10T17:51:45.506 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:45 smithi089 ceph-mon[31467]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:45.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[37454]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[37454]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[37454]: from='osd.6 ' entity='osd.6' 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[37454]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[27356]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[27356]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:45.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[27356]: from='osd.6 ' entity='osd.6' 2024-09-10T17:51:45.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:45 smithi012 ceph-mon[27356]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T17:51:46.702 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: purged_snaps scrub starts 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: purged_snaps scrub ok 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992] boot 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: osdmap e46: 7 total, 7 up, 7 in 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: Detected new or changed devices on smithi089 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.703 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-10T17:51:46.704 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.704 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:46.704 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:46.704 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.704 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:46 smithi089 ceph-mon[31467]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: purged_snaps scrub starts 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: purged_snaps scrub ok 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992] boot 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: osdmap e46: 7 total, 7 up, 7 in 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: Detected new or changed devices on smithi089 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[27356]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: purged_snaps scrub starts 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: purged_snaps scrub ok 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: osd.6 [v2:172.21.15.89:6816/1083920992,v1:172.21.15.89:6817/1083920992] boot 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: osdmap e46: 7 total, 7 up, 7 in 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:51:46.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: Detected new or changed devices on smithi089 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:51:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:51:46.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:46 smithi012 ceph-mon[37454]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T17:51:47.734 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:47 smithi089 ceph-mon[31467]: pgmap v149: 1 pgs: 1 remapped+peering; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:47.734 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:47 smithi089 ceph-mon[31467]: osdmap e48: 7 total, 7 up, 7 in 2024-09-10T17:51:47.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:47 smithi012 ceph-mon[37454]: pgmap v149: 1 pgs: 1 remapped+peering; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:47.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:47 smithi012 ceph-mon[37454]: osdmap e48: 7 total, 7 up, 7 in 2024-09-10T17:51:47.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:47 smithi012 ceph-mon[27356]: pgmap v149: 1 pgs: 1 remapped+peering; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:47.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:47 smithi012 ceph-mon[27356]: osdmap e48: 7 total, 7 up, 7 in 2024-09-10T17:51:48.002 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-10T17:51:48.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_1 2024-09-10T17:51:48.218 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:51:49.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:49 smithi089 ceph-mon[31467]: osdmap e49: 7 total, 7 up, 7 in 2024-09-10T17:51:49.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:49 smithi089 ceph-mon[31467]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:49.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:49 smithi012 ceph-mon[27356]: osdmap e49: 7 total, 7 up, 7 in 2024-09-10T17:51:49.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:49 smithi012 ceph-mon[27356]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:49.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:49 smithi012 ceph-mon[37454]: osdmap e49: 7 total, 7 up, 7 in 2024-09-10T17:51:49.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:49 smithi012 ceph-mon[37454]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:50.588 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:50 smithi089 ceph-mon[31467]: osdmap e50: 7 total, 7 up, 7 in 2024-09-10T17:51:50.588 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:50 smithi089 ceph-mon[31467]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:50.588 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:50.588 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:50.588 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:50 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:50.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[27356]: osdmap e50: 7 total, 7 up, 7 in 2024-09-10T17:51:50.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[27356]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:50.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:50.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:50.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:50.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[37454]: osdmap e50: 7 total, 7 up, 7 in 2024-09-10T17:51:50.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[37454]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:51:50.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T17:51:50.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T17:51:50.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:50 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:51.636 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:51 smithi089 ceph-mon[31467]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:51.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:51 smithi012 ceph-mon[27356]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:51.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:51 smithi012 ceph-mon[37454]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:51:52.677 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:52 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/479790037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]: dispatch 2024-09-10T17:51:52.678 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:52 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]: dispatch 2024-09-10T17:51:52.678 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:52 smithi089 ceph-mon[31467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]': finished 2024-09-10T17:51:52.678 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:52 smithi089 ceph-mon[31467]: osdmap e51: 8 total, 7 up, 8 in 2024-09-10T17:51:52.678 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:52 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:51:52.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/479790037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]: dispatch 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]: dispatch 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[27356]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]': finished 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[27356]: osdmap e51: 8 total, 7 up, 8 in 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/479790037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]: dispatch 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]: dispatch 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[37454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad1f0c7c-dff5-45a3-baec-17c43d221ef8"}]': finished 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[37454]: osdmap e51: 8 total, 7 up, 8 in 2024-09-10T17:51:52.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:52 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:51:53.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:53 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/581478731' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:53.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:53 smithi012 ceph-mon[27356]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-10T17:51:53.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:53 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/581478731' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:53.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:53 smithi012 ceph-mon[37454]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-10T17:51:53.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:53 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/581478731' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T17:51:53.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:53 smithi089 ceph-mon[31467]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-10T17:51:55.466 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:55 smithi089 ceph-mon[31467]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T17:51:55.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:55 smithi012 ceph-mon[27356]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T17:51:55.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:55 smithi012 ceph-mon[37454]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T17:51:57.402 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:57 smithi089 ceph-mon[31467]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T17:51:57.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:57 smithi012 ceph-mon[27356]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T17:51:57.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:57 smithi012 ceph-mon[37454]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T17:51:58.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T17:51:58.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:58 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:58.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T17:51:58.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:58 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:58.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T17:51:58.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:58 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:51:59.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:59 smithi012 ceph-mon[27356]: Deploying daemon osd.7 on smithi089 2024-09-10T17:51:59.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:51:59 smithi012 ceph-mon[27356]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T17:51:59.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:59 smithi012 ceph-mon[37454]: Deploying daemon osd.7 on smithi089 2024-09-10T17:51:59.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:51:59 smithi012 ceph-mon[37454]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T17:51:59.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:59 smithi089 ceph-mon[31467]: Deploying daemon osd.7 on smithi089 2024-09-10T17:51:59.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:51:59 smithi089 ceph-mon[31467]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T17:52:01.372 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:01 smithi089 ceph-mon[31467]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:52:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:01 smithi012 ceph-mon[27356]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:52:01.533 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:01 smithi012 ceph-mon[37454]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T17:52:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:03.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:03.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:03.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:03.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:03.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:03.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:04.306 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:04 smithi089 ceph-mon[31467]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:04.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:04 smithi012 ceph-mon[27356]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:04.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:04 smithi012 ceph-mon[37454]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:05 smithi089 ceph-mon[31467]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:05.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:05 smithi012 ceph-mon[27356]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:05.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:05 smithi012 ceph-mon[37454]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:05.800 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 7 on host 'smithi089' 2024-09-10T17:52:06.373 DEBUG:teuthology.orchestra.run.smithi089:osd.7> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T17:52:06.375 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-10T17:52:06.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T17:52:06.593 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:07.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:06 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:06 smithi012 ceph-mon[27356]: from='osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T17:52:07.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:06 smithi012 ceph-mon[27356]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T17:52:07.032 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:06 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.032 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:06 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.032 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:06 smithi012 ceph-mon[37454]: from='osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T17:52:07.032 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:06 smithi012 ceph-mon[37454]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T17:52:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:06 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:06 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:06 smithi089 ceph-mon[31467]: from='osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T17:52:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:06 smithi089 ceph-mon[31467]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T17:52:07.891 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:07 smithi089 ceph-mon[31467]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T17:52:07.891 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:07 smithi089 ceph-mon[31467]: osdmap e52: 8 total, 7 up, 8 in 2024-09-10T17:52:07.891 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:07 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:07.892 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:07 smithi089 ceph-mon[31467]: from='osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:52:07.892 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:07 smithi089 ceph-mon[31467]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:52:07.892 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:07 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.892 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:07 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.892 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:07 smithi089 ceph-mon[31467]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:07.994 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[27356]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T17:52:07.994 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[27356]: osdmap e52: 8 total, 7 up, 8 in 2024-09-10T17:52:07.994 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[27356]: from='osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[27356]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[27356]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[37454]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[37454]: osdmap e52: 8 total, 7 up, 8 in 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[37454]: from='osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[37454]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.995 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:07.996 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:07 smithi012 ceph-mon[37454]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-10T17:52:08.529 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 17:52:08 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[53229]: 2024-09-10T17:52:08.236+0000 7f5bce829640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T17:52:08.529 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 17:52:08 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[53229]: 2024-09-10T17:52:08.243+0000 7f5bc664a640 -1 osd.7 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T17:52:08.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:09.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[27356]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:52:09.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[27356]: osdmap e53: 8 total, 7 up, 8 in 2024-09-10T17:52:09.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:09.228 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:09.228 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[27356]: from='osd.7 ' entity='osd.7' 2024-09-10T17:52:09.228 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/4191904151' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T17:52:09.228 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[37454]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:52:09.229 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[37454]: osdmap e53: 8 total, 7 up, 8 in 2024-09-10T17:52:09.229 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:09.229 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:09.229 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[37454]: from='osd.7 ' entity='osd.7' 2024-09-10T17:52:09.229 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:08 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/4191904151' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T17:52:09.253 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":53,"num_osds":8,"num_up_osds":7,"osd_up_since":1725990705,"num_in_osds":8,"osd_in_since":1725990712,"num_remapped_pgs":0} 2024-09-10T17:52:09.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:08 smithi089 ceph-mon[31467]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-10T17:52:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:08 smithi089 ceph-mon[31467]: osdmap e53: 8 total, 7 up, 8 in 2024-09-10T17:52:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:08 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:08 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:08 smithi089 ceph-mon[31467]: from='osd.7 ' entity='osd.7' 2024-09-10T17:52:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:08 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/4191904151' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T17:52:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:09 smithi089 ceph-mon[31467]: purged_snaps scrub starts 2024-09-10T17:52:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:09 smithi089 ceph-mon[31467]: purged_snaps scrub ok 2024-09-10T17:52:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:09 smithi089 ceph-mon[31467]: osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195] boot 2024-09-10T17:52:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:09 smithi089 ceph-mon[31467]: osdmap e54: 8 total, 8 up, 8 in 2024-09-10T17:52:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:09 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:09 smithi089 ceph-mon[31467]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:10.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T17:52:10.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[27356]: purged_snaps scrub starts 2024-09-10T17:52:10.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[27356]: purged_snaps scrub ok 2024-09-10T17:52:10.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[27356]: osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195] boot 2024-09-10T17:52:10.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[27356]: osdmap e54: 8 total, 8 up, 8 in 2024-09-10T17:52:10.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:10.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[27356]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:10.280 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[37454]: purged_snaps scrub starts 2024-09-10T17:52:10.280 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[37454]: purged_snaps scrub ok 2024-09-10T17:52:10.280 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[37454]: osd.7 [v2:172.21.15.89:6824/945164195,v1:172.21.15.89:6825/945164195] boot 2024-09-10T17:52:10.280 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[37454]: osdmap e54: 8 total, 8 up, 8 in 2024-09-10T17:52:10.280 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:52:10.280 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:09 smithi012 ceph-mon[37454]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:10.459 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: osdmap e55: 8 total, 8 up, 8 in 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: Detected new or changed devices on smithi089 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:10.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: osdmap e55: 8 total, 8 up, 8 in 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: Detected new or changed devices on smithi089 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.915 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:10.916 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:10 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:11.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: osdmap e55: 8 total, 8 up, 8 in 2024-09-10T17:52:11.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: Detected new or changed devices on smithi089 2024-09-10T17:52:11.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:11.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:10 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:11.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:11 smithi012 ceph-mon[27356]: osdmap e56: 8 total, 8 up, 8 in 2024-09-10T17:52:11.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:11 smithi012 ceph-mon[27356]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:11.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:11 smithi012 ceph-mon[27356]: osdmap e57: 8 total, 8 up, 8 in 2024-09-10T17:52:11.880 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:11 smithi012 ceph-mon[37454]: osdmap e56: 8 total, 8 up, 8 in 2024-09-10T17:52:11.880 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:11 smithi012 ceph-mon[37454]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:11.880 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:11 smithi012 ceph-mon[37454]: osdmap e57: 8 total, 8 up, 8 in 2024-09-10T17:52:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:12.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:11 smithi089 ceph-mon[31467]: osdmap e56: 8 total, 8 up, 8 in 2024-09-10T17:52:12.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:11 smithi089 ceph-mon[31467]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:12.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:11 smithi089 ceph-mon[31467]: osdmap e57: 8 total, 8 up, 8 in 2024-09-10T17:52:12.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:12 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/994191295' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T17:52:12.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:12 smithi012 ceph-mon[27356]: osdmap e58: 8 total, 8 up, 8 in 2024-09-10T17:52:12.878 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:12 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/994191295' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T17:52:12.878 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:12 smithi012 ceph-mon[37454]: osdmap e58: 8 total, 8 up, 8 in 2024-09-10T17:52:12.900 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1725990728,"num_in_osds":8,"osd_in_since":1725990712,"num_remapped_pgs":0} 2024-09-10T17:52:12.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T17:52:13.148 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:13.186 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:12 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/994191295' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T17:52:13.186 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:12 smithi089 ceph-mon[31467]: osdmap e58: 8 total, 8 up, 8 in 2024-09-10T17:52:14.239 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:13 smithi012 ceph-mon[27356]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:14.240 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:13 smithi012 ceph-mon[37454]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:14.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:13 smithi089 ceph-mon[31467]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:14.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:14.979 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":58,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T17:52:12.709042+0000","last_up_change":"2024-09-10T17:52:08.800071+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6803","nonce":2400757557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6805","nonce":2400757557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6809","nonce":2400757557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6807","nonce":2400757557}]},"public_addr":"172.21.15.12:6803/2400757557","cluster_addr":"172.21.15.12:6805/2400757557","heartbeat_back_addr":"172.21.15.12:6809/2400757557","heartbeat_front_addr":"172.21.15.12:6807/2400757557","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6811","nonce":284928520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6813","nonce":284928520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6817","nonce":284928520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6815","nonce":284928520}]},"public_addr":"172.21.15.12:6811/284928520","cluster_addr":"172.21.15.12:6813/284928520","heartbeat_back_addr":"172.21.15.12:6817/284928520","heartbeat_front_addr":"172.21.15.12:6815/284928520","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6819","nonce":2631347892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6821","nonce":2631347892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6825","nonce":2631347892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6823","nonce":2631347892}]},"public_addr":"172.21.15.12:6819/2631347892","cluster_addr":"172.21.15.12:6821/2631347892","heartbeat_back_addr":"172.21.15.12:6825/2631347892","heartbeat_front_addr":"172.21.15.12:6823/2631347892","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6827","nonce":3917191557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6829","nonce":3917191557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6833","nonce":3917191557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6831","nonce":3917191557}]},"public_addr":"172.21.15.12:6827/3917191557","cluster_addr":"172.21.15.12:6829/3917191557","heartbeat_back_addr":"172.21.15.12:6833/3917191557","heartbeat_front_addr":"172.21.15.12:6831/3917191557","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6801","nonce":4063563708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6803","nonce":4063563708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6807","nonce":4063563708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6805","nonce":4063563708}]},"public_addr":"172.21.15.89:6801/4063563708","cluster_addr":"172.21.15.89:6803/4063563708","heartbeat_back_addr":"172.21.15.89:6807/4063563708","heartbeat_front_addr":"172.21.15.89:6805/4063563708","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6809","nonce":4007259364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6811","nonce":4007259364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6815","nonce":4007259364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6813","nonce":4007259364}]},"public_addr":"172.21.15.89:6809/4007259364","cluster_addr":"172.21.15.89:6811/4007259364","heartbeat_back_addr":"172.21.15.89:6815/4007259364","heartbeat_front_addr":"172.21.15.89:6813/4007259364","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6817","nonce":1083920992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6819","nonce":1083920992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6823","nonce":1083920992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6821","nonce":1083920992}]},"public_addr":"172.21.15.89:6817/1083920992","cluster_addr":"172.21.15.89:6819/1083920992","heartbeat_back_addr":"172.21.15.89:6823/1083920992","heartbeat_front_addr":"172.21.15.89:6821/1083920992","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6825","nonce":945164195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6827","nonce":945164195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6831","nonce":945164195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6829","nonce":945164195}]},"public_addr":"172.21.15.89:6825/945164195","cluster_addr":"172.21.15.89:6827/945164195","heartbeat_back_addr":"172.21.15.89:6831/945164195","heartbeat_front_addr":"172.21.15.89:6829/945164195","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T17:52:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:15 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3947147738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:15 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3947147738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:15.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:15 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3947147738' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:15.556 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T17:50:13.537676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T17:52:15.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T17:52:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:16.242 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:16 smithi012 ceph-mon[27356]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T17:52:16.242 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:16 smithi012 ceph-mon[37454]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T17:52:16.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:16 smithi089 ceph-mon[31467]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-10T17:52:17.389 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:17 smithi012 ceph-mon[27356]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T17:52:17.390 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:17 smithi012 ceph-mon[37454]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T17:52:17.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:17 smithi089 ceph-mon[31467]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T17:52:17.547 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-10T17:52:18.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:18 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/40691399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T17:52:18.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:18 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/40691399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T17:52:18.287 INFO:tasks.cephadm:Adding mds.a on smithi012 2024-09-10T17:52:18.287 INFO:tasks.cephadm:Adding mds.b on smithi089 2024-09-10T17:52:18.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch apply mds all '2;smithi012=a;smithi089=b' 2024-09-10T17:52:18.495 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:52:18.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:18 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/40691399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T17:52:19.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:19 smithi089 ceph-mon[31467]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T17:52:19.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:19 smithi012 ceph-mon[27356]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T17:52:19.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:19 smithi012 ceph-mon[37454]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T17:52:20.097 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled mds.all update... 2024-09-10T17:52:20.770 DEBUG:teuthology.orchestra.run.smithi012:mds.a> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T17:52:20.773 DEBUG:teuthology.orchestra.run.smithi089:mds.b> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T17:52:20.775 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T17:52:20.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T17:52:21.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi012=a;smithi089=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:52:21.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: Saving service mds.all spec with placement smithi012=a;smithi089=b;count:2 2024-09-10T17:52:21.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:21.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[27356]: Deploying daemon mds.a on smithi012 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi012=a;smithi089=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: Saving service mds.all spec with placement smithi012=a;smithi089=b;count:2 2024-09-10T17:52:21.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:21.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:21.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:21.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:21.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:21.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T17:52:21.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T17:52:21.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:21.508 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:21 smithi012 ceph-mon[37454]: Deploying daemon mds.a on smithi012 2024-09-10T17:52:21.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi012=a;smithi089=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:52:21.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: Saving service mds.all spec with placement smithi012=a;smithi089=b;count:2 2024-09-10T17:52:21.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T17:52:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T17:52:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:21 smithi089 ceph-mon[31467]: Deploying daemon mds.a on smithi012 2024-09-10T17:52:21.625 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:22.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:22 smithi012 ceph-mon[27356]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T17:52:22.507 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:22 smithi012 ceph-mon[37454]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T17:52:22.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:22 smithi089 ceph-mon[31467]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T17:52:23.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:23.603 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T17:52:23.603 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 1 2024-09-10T17:52:24.386 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:24 smithi012 ceph-mon[27356]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T17:52:24.386 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:24 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3562190682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:24.386 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:24 smithi012 ceph-mon[37454]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T17:52:24.386 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:24 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3562190682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:24.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:24 smithi089 ceph-mon[31467]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T17:52:24.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:24 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3562190682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:24.636 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 17:52:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[63889]: starting mds.a at 2024-09-10T17:52:24.637 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 17:52:24 smithi012 bash[63858]: 7fbc479159888769c1cf49a8ff5a8753d7c68f615ad59157a973659dd4705e52 2024-09-10T17:52:25.033 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 17:52:24 smithi012 systemd[1]: Started Ceph mds.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:52:25.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: mds.? [v2:172.21.15.12:6834/705014602,v1:172.21.15.12:6835/705014602] up:boot 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: fsmap 1 up:standby 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: Deploying daemon mds.b on smithi089 2024-09-10T17:52:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:25 smithi089 ceph-mon[31467]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T17:52:26.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: mds.? [v2:172.21.15.12:6834/705014602,v1:172.21.15.12:6835/705014602] up:boot 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: fsmap 1 up:standby 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: Deploying daemon mds.b on smithi089 2024-09-10T17:52:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[27356]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: mds.? [v2:172.21.15.12:6834/705014602,v1:172.21.15.12:6835/705014602] up:boot 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: fsmap 1 up:standby 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: Deploying daemon mds.b on smithi089 2024-09-10T17:52:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:25 smithi012 ceph-mon[37454]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T17:52:26.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T17:52:26.633 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:26.785 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:26 smithi089 systemd[1]: Starting Ceph mds.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:52:27.103 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:26 smithi089 podman[57136]: 2024-09-10 17:52:26.687428872 +0000 UTC m=+0.015739659 image pull f21ba1eea74eff81ce08338578ea11be73add5627252ff4d00500aa0d1abdd33 quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6 2024-09-10T17:52:27.104 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:26 smithi089 podman[57136]: 2024-09-10 17:52:26.800152665 +0000 UTC m=+0.128463453 container create b1f6c0623c2ebd999ac0c6de93d3fad853cd19ba3d3fd2a358d333d37d48cd12 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T17:52:27.104 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:27 smithi089 podman[57136]: 2024-09-10 17:52:27.002955051 +0000 UTC m=+0.331265836 container init b1f6c0623c2ebd999ac0c6de93d3fad853cd19ba3d3fd2a358d333d37d48cd12 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=reef-7a853b1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T17:52:27.104 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:27 smithi089 podman[57136]: 2024-09-10 17:52:27.005628764 +0000 UTC m=+0.333939557 container start b1f6c0623c2ebd999ac0c6de93d3fad853cd19ba3d3fd2a358d333d37d48cd12 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, RELEASE=reef-7a853b1, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T17:52:27.104 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:27 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b[57151]: starting mds.b at 2024-09-10T17:52:27.104 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:27 smithi089 bash[57136]: b1f6c0623c2ebd999ac0c6de93d3fad853cd19ba3d3fd2a358d333d37d48cd12 2024-09-10T17:52:27.535 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:27 smithi089 systemd[1]: Started Ceph mds.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:52:28.375 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: mds.? [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] up:boot 2024-09-10T17:52:28.375 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: fsmap 2 up:standby 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: mds.? [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] up:boot 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: fsmap 2 up:standby 2024-09-10T17:52:28.376 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:52:28.377 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:28.377 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.377 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.377 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.377 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.377 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.377 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:28 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:28.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: mds.? [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] up:boot 2024-09-10T17:52:28.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: fsmap 2 up:standby 2024-09-10T17:52:28.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:52:28.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:28.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:28 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:28.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:28.570 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/705014602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":705014602},{"type":"v1","addr":"172.21.15.12:6835","nonce":705014602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3197689939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3197689939},{"type":"v1","addr":"172.21.15.89:6833","nonce":3197689939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-10T17:52:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-09-10T17:52:29.402 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:29 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.402 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:29 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.402 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:29 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.403 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:29 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2904467052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:29.403 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:29 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.403 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:29 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.403 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:29 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.403 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:29 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2904467052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:29.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:29 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:29 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:29 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:29.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:29 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2904467052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:29.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T17:52:30.074 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:30.425 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:30 smithi012 ceph-mon[27356]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:30.426 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:30 smithi012 ceph-mon[37454]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:30.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:30 smithi089 ceph-mon[31467]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:31.462 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.463 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[37454]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:31 smithi012 ceph-mon[27356]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:31.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:52:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:52:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:52:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:52:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:31 smithi089 ceph-mon[31467]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:31.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:31.872 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-10T17:52:31.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T17:52:31.872 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-10T17:52:31.872 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-10T17:52:31.872 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T17:52:31.872 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-10T17:52:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:32 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3187894209' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T17:52:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:32 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3187894209' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T17:52:32.653 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T17:52:32.656 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T17:52:32.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:32 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3187894209' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T17:52:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:33.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:33 smithi012 ceph-mon[27356]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:33.621 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:33 smithi012 ceph-mon[37454]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:33.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:33 smithi089 ceph-mon[31467]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:35.181 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-10T17:52:35.485 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:35 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3299857327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T17:52:35.485 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:35 smithi012 ceph-mon[27356]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:35.486 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:35 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3299857327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T17:52:35.486 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:35 smithi012 ceph-mon[37454]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:35 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3299857327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T17:52:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:35 smithi089 ceph-mon[31467]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:35.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T17:52:36.218 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:36.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:36 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3299857327' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T17:52:36.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:36 smithi012 ceph-mon[27356]: osdmap e59: 8 total, 8 up, 8 in 2024-09-10T17:52:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:36 smithi012 ceph-mon[27356]: osdmap e60: 8 total, 8 up, 8 in 2024-09-10T17:52:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:36 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3299857327' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T17:52:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:36 smithi012 ceph-mon[37454]: osdmap e59: 8 total, 8 up, 8 in 2024-09-10T17:52:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:36 smithi012 ceph-mon[37454]: osdmap e60: 8 total, 8 up, 8 in 2024-09-10T17:52:36.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:36 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3299857327' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T17:52:36.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:36 smithi089 ceph-mon[31467]: osdmap e59: 8 total, 8 up, 8 in 2024-09-10T17:52:36.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:36 smithi089 ceph-mon[31467]: osdmap e60: 8 total, 8 up, 8 in 2024-09-10T17:52:37.486 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:37 smithi012 ceph-mon[27356]: pgmap v187: 33 pgs: 2 creating+peering, 20 unknown, 11 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:37.487 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:37 smithi012 ceph-mon[27356]: osdmap e61: 8 total, 8 up, 8 in 2024-09-10T17:52:37.487 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:37 smithi012 ceph-mon[37454]: pgmap v187: 33 pgs: 2 creating+peering, 20 unknown, 11 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:37.487 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:37 smithi012 ceph-mon[37454]: osdmap e61: 8 total, 8 up, 8 in 2024-09-10T17:52:37.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:37 smithi089 ceph-mon[31467]: pgmap v187: 33 pgs: 2 creating+peering, 20 unknown, 11 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:37.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:37 smithi089 ceph-mon[31467]: osdmap e61: 8 total, 8 up, 8 in 2024-09-10T17:52:38.620 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-10T17:52:38.907 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:38 smithi012 ceph-mon[27356]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:52:38.908 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:38 smithi012 ceph-mon[37454]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:52:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:38 smithi089 ceph-mon[31467]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:52:39.257 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T17:52:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:39.861 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/74159148' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T17:52:39.861 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T17:52:39.861 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T17:52:39.861 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[27356]: osdmap e62: 8 total, 8 up, 8 in 2024-09-10T17:52:39.861 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[27356]: pgmap v190: 97 pgs: 13 creating+peering, 57 unknown, 27 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:39.862 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/74159148' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T17:52:39.862 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T17:52:39.862 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T17:52:39.862 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[37454]: osdmap e62: 8 total, 8 up, 8 in 2024-09-10T17:52:39.862 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:39 smithi012 ceph-mon[37454]: pgmap v190: 97 pgs: 13 creating+peering, 57 unknown, 27 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:39 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/74159148' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T17:52:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:39 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T17:52:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:39 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T17:52:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:39 smithi089 ceph-mon[31467]: osdmap e62: 8 total, 8 up, 8 in 2024-09-10T17:52:40.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:39 smithi089 ceph-mon[31467]: pgmap v190: 97 pgs: 13 creating+peering, 57 unknown, 27 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:40.894 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:40 smithi012 ceph-mon[27356]: osdmap e63: 8 total, 8 up, 8 in 2024-09-10T17:52:40.895 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:40 smithi012 ceph-mon[37454]: osdmap e63: 8 total, 8 up, 8 in 2024-09-10T17:52:41.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:40 smithi089 ceph-mon[31467]: osdmap e63: 8 total, 8 up, 8 in 2024-09-10T17:52:41.366 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T17:52:41.898 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[27356]: osdmap e64: 8 total, 8 up, 8 in 2024-09-10T17:52:41.898 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[27356]: pgmap v193: 97 pgs: 13 creating+peering, 41 unknown, 43 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:41.898 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2474180654' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T17:52:41.898 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[27356]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T17:52:41.898 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[27356]: osdmap e65: 8 total, 8 up, 8 in 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2474180654' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[27356]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[27356]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[37454]: osdmap e64: 8 total, 8 up, 8 in 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[37454]: pgmap v193: 97 pgs: 13 creating+peering, 41 unknown, 43 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2474180654' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[37454]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[37454]: osdmap e65: 8 total, 8 up, 8 in 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2474180654' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[37454]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-09-10T17:52:41.899 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:41 smithi012 ceph-mon[37454]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T17:52:41.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T17:52:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:41 smithi089 ceph-mon[31467]: osdmap e64: 8 total, 8 up, 8 in 2024-09-10T17:52:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:41 smithi089 ceph-mon[31467]: pgmap v193: 97 pgs: 13 creating+peering, 41 unknown, 43 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:52:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:41 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2474180654' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T17:52:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:41 smithi089 ceph-mon[31467]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T17:52:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:41 smithi089 ceph-mon[31467]: osdmap e65: 8 total, 8 up, 8 in 2024-09-10T17:52:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:41 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2474180654' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T17:52:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:41 smithi089 ceph-mon[31467]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-09-10T17:52:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:41 smithi089 ceph-mon[31467]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T17:52:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:42.535 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 17:52:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b[57151]: 2024-09-10T17:52:42.088+0000 7f4c77eaf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T17:52:42.919 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:42 smithi012 ceph-mon[27356]: mds.? [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] up:active 2024-09-10T17:52:42.919 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:42 smithi012 ceph-mon[27356]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:42.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:42 smithi012 ceph-mon[37454]: mds.? [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] up:active 2024-09-10T17:52:42.920 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:42 smithi012 ceph-mon[37454]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:42 smithi089 ceph-mon[31467]: mds.? [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] up:active 2024-09-10T17:52:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:42 smithi089 ceph-mon[31467]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:43.905 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:43 smithi012 ceph-mon[27356]: pgmap v195: 97 pgs: 13 creating+peering, 22 unknown, 62 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 686 B/s wr, 2 op/s 2024-09-10T17:52:43.905 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:43 smithi012 ceph-mon[37454]: pgmap v195: 97 pgs: 13 creating+peering, 22 unknown, 62 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 686 B/s wr, 2 op/s 2024-09-10T17:52:44.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:43 smithi089 ceph-mon[31467]: pgmap v195: 97 pgs: 13 creating+peering, 22 unknown, 62 active+clean; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 686 B/s wr, 2 op/s 2024-09-10T17:52:44.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:44.066 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T17:52:41.361387+0000","last_up_change":"2024-09-10T17:52:08.800071+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T17:52:35.123712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T17:52:38.563420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6803","nonce":2400757557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6805","nonce":2400757557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6809","nonce":2400757557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6807","nonce":2400757557}]},"public_addr":"172.21.15.12:6803/2400757557","cluster_addr":"172.21.15.12:6805/2400757557","heartbeat_back_addr":"172.21.15.12:6809/2400757557","heartbeat_front_addr":"172.21.15.12:6807/2400757557","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6811","nonce":284928520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6813","nonce":284928520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6817","nonce":284928520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6815","nonce":284928520}]},"public_addr":"172.21.15.12:6811/284928520","cluster_addr":"172.21.15.12:6813/284928520","heartbeat_back_addr":"172.21.15.12:6817/284928520","heartbeat_front_addr":"172.21.15.12:6815/284928520","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6819","nonce":2631347892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6821","nonce":2631347892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6825","nonce":2631347892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6823","nonce":2631347892}]},"public_addr":"172.21.15.12:6819/2631347892","cluster_addr":"172.21.15.12:6821/2631347892","heartbeat_back_addr":"172.21.15.12:6825/2631347892","heartbeat_front_addr":"172.21.15.12:6823/2631347892","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6827","nonce":3917191557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6829","nonce":3917191557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6833","nonce":3917191557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6831","nonce":3917191557}]},"public_addr":"172.21.15.12:6827/3917191557","cluster_addr":"172.21.15.12:6829/3917191557","heartbeat_back_addr":"172.21.15.12:6833/3917191557","heartbeat_front_addr":"172.21.15.12:6831/3917191557","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6801","nonce":4063563708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6803","nonce":4063563708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6807","nonce":4063563708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6805","nonce":4063563708}]},"public_addr":"172.21.15.89:6801/4063563708","cluster_addr":"172.21.15.89:6803/4063563708","heartbeat_back_addr":"172.21.15.89:6807/4063563708","heartbeat_front_addr":"172.21.15.89:6805/4063563708","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6809","nonce":4007259364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6811","nonce":4007259364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6815","nonce":4007259364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6813","nonce":4007259364}]},"public_addr":"172.21.15.89:6809/4007259364","cluster_addr":"172.21.15.89:6811/4007259364","heartbeat_back_addr":"172.21.15.89:6815/4007259364","heartbeat_front_addr":"172.21.15.89:6813/4007259364","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6817","nonce":1083920992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6819","nonce":1083920992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6823","nonce":1083920992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6821","nonce":1083920992}]},"public_addr":"172.21.15.89:6817/1083920992","cluster_addr":"172.21.15.89:6819/1083920992","heartbeat_back_addr":"172.21.15.89:6823/1083920992","heartbeat_front_addr":"172.21.15.89:6821/1083920992","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6825","nonce":945164195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6827","nonce":945164195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6831","nonce":945164195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6829","nonce":945164195}]},"public_addr":"172.21.15.89:6825/945164195","cluster_addr":"172.21.15.89:6827/945164195","heartbeat_back_addr":"172.21.15.89:6831/945164195","heartbeat_front_addr":"172.21.15.89:6829/945164195","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T17:52:44.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T17:52:45.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:44 smithi012 ceph-mon[27356]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T17:52:45.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:44 smithi012 ceph-mon[27356]: Cluster is now healthy 2024-09-10T17:52:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:44 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1018369213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:45.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:44 smithi012 ceph-mon[37454]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T17:52:45.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:44 smithi012 ceph-mon[37454]: Cluster is now healthy 2024-09-10T17:52:45.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:44 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1018369213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:44 smithi089 ceph-mon[31467]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T17:52:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:44 smithi089 ceph-mon[31467]: Cluster is now healthy 2024-09-10T17:52:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:44 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1018369213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:45.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:45 smithi012 ceph-mon[27356]: pgmap v196: 97 pgs: 97 active+clean; 578 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1023 B/s wr, 6 op/s 2024-09-10T17:52:45.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:45 smithi012 ceph-mon[37454]: pgmap v196: 97 pgs: 97 active+clean; 578 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1023 B/s wr, 6 op/s 2024-09-10T17:52:46.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:45 smithi089 ceph-mon[31467]: pgmap v196: 97 pgs: 97 active+clean; 578 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1023 B/s wr, 6 op/s 2024-09-10T17:52:46.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:46.941 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T17:52:41.361387+0000","last_up_change":"2024-09-10T17:52:08.800071+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T17:52:35.123712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T17:52:38.563420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6803","nonce":2400757557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6805","nonce":2400757557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6809","nonce":2400757557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6807","nonce":2400757557}]},"public_addr":"172.21.15.12:6803/2400757557","cluster_addr":"172.21.15.12:6805/2400757557","heartbeat_back_addr":"172.21.15.12:6809/2400757557","heartbeat_front_addr":"172.21.15.12:6807/2400757557","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6811","nonce":284928520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6813","nonce":284928520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6817","nonce":284928520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6815","nonce":284928520}]},"public_addr":"172.21.15.12:6811/284928520","cluster_addr":"172.21.15.12:6813/284928520","heartbeat_back_addr":"172.21.15.12:6817/284928520","heartbeat_front_addr":"172.21.15.12:6815/284928520","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6819","nonce":2631347892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6821","nonce":2631347892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6825","nonce":2631347892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6823","nonce":2631347892}]},"public_addr":"172.21.15.12:6819/2631347892","cluster_addr":"172.21.15.12:6821/2631347892","heartbeat_back_addr":"172.21.15.12:6825/2631347892","heartbeat_front_addr":"172.21.15.12:6823/2631347892","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6827","nonce":3917191557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6829","nonce":3917191557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6833","nonce":3917191557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6831","nonce":3917191557}]},"public_addr":"172.21.15.12:6827/3917191557","cluster_addr":"172.21.15.12:6829/3917191557","heartbeat_back_addr":"172.21.15.12:6833/3917191557","heartbeat_front_addr":"172.21.15.12:6831/3917191557","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6801","nonce":4063563708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6803","nonce":4063563708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6807","nonce":4063563708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6805","nonce":4063563708}]},"public_addr":"172.21.15.89:6801/4063563708","cluster_addr":"172.21.15.89:6803/4063563708","heartbeat_back_addr":"172.21.15.89:6807/4063563708","heartbeat_front_addr":"172.21.15.89:6805/4063563708","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6809","nonce":4007259364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6811","nonce":4007259364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6815","nonce":4007259364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6813","nonce":4007259364}]},"public_addr":"172.21.15.89:6809/4007259364","cluster_addr":"172.21.15.89:6811/4007259364","heartbeat_back_addr":"172.21.15.89:6815/4007259364","heartbeat_front_addr":"172.21.15.89:6813/4007259364","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6817","nonce":1083920992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6819","nonce":1083920992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6823","nonce":1083920992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6821","nonce":1083920992}]},"public_addr":"172.21.15.89:6817/1083920992","cluster_addr":"172.21.15.89:6819/1083920992","heartbeat_back_addr":"172.21.15.89:6823/1083920992","heartbeat_front_addr":"172.21.15.89:6821/1083920992","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6825","nonce":945164195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6827","nonce":945164195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6831","nonce":945164195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6829","nonce":945164195}]},"public_addr":"172.21.15.89:6825/945164195","cluster_addr":"172.21.15.89:6827/945164195","heartbeat_back_addr":"172.21.15.89:6831/945164195","heartbeat_front_addr":"172.21.15.89:6829/945164195","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T17:52:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:46 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2703199027' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:47.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:46 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2703199027' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:47.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:46 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2703199027' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:47.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T17:52:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:48.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:47 smithi012 ceph-mon[27356]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T17:52:48.084 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:47 smithi012 ceph-mon[37454]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T17:52:48.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:47 smithi089 ceph-mon[31467]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T17:52:49.533 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:49 smithi012 ceph-mon[37454]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T17:52:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:49 smithi012 ceph-mon[27356]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T17:52:49.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:49 smithi089 ceph-mon[31467]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T17:52:50.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:50 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2550112062' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T17:52:50.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:50 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T17:52:50.527 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:50 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2550112062' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T17:52:50.528 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:50 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T17:52:50.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:50 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2550112062' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T17:52:50.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:50 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T17:52:50.889 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T17:52:50.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay false 2024-09-10T17:52:51.102 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:51.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:51 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T17:52:51.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:51 smithi012 ceph-mon[27356]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:51.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:51 smithi012 ceph-mon[27356]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-10T17:52:51.436 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:51 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T17:52:51.436 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:51 smithi012 ceph-mon[37454]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:51.436 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:51 smithi012 ceph-mon[37454]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-10T17:52:51.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:51 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T17:52:51.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:51 smithi089 ceph-mon[31467]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:51.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:51 smithi089 ceph-mon[31467]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-10T17:52:53.487 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:53 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3408364283' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-10T17:52:53.488 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:53 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3408364283' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-10T17:52:53.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:53 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3408364283' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-10T17:52:53.819 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T17:52:53.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T17:52:54.034 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:54.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:54 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3408364283' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-10T17:52:54.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:54 smithi012 ceph-mon[27356]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:54.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:54 smithi012 ceph-mon[27356]: pgmap v200: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-10T17:52:54.378 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:54 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3408364283' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-10T17:52:54.378 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:54 smithi012 ceph-mon[37454]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:54.378 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:54 smithi012 ceph-mon[37454]: pgmap v200: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-10T17:52:54.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:54 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3408364283' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-10T17:52:54.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:54 smithi089 ceph-mon[31467]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:52:54.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:54 smithi089 ceph-mon[31467]: pgmap v200: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-10T17:52:55.441 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:55 smithi012 ceph-mon[27356]: pgmap v201: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 938 B/s wr, 2 op/s 2024-09-10T17:52:55.441 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:55 smithi012 ceph-mon[37454]: pgmap v201: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 938 B/s wr, 2 op/s 2024-09-10T17:52:55.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:55 smithi089 ceph-mon[31467]: pgmap v201: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 938 B/s wr, 2 op/s 2024-09-10T17:52:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:56.026 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/705014602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":705014602},{"type":"v1","addr":"172.21.15.12:6835","nonce":705014602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T17:52:41.361507+0000","modified":"2024-09-10T17:52:53.075075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24340":{"gid":24340,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.89:6833/3197689939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3197689939},{"type":"v1","addr":"172.21.15.89:6833","nonce":3197689939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-10T17:52:56.026 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T17:52:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:56 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2902311551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:56 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2902311551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:56.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:56 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2902311551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:52:56.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T17:52:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:52:57.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:57 smithi012 ceph-mon[27356]: pgmap v202: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-09-10T17:52:57.271 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:57 smithi012 ceph-mon[37454]: pgmap v202: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-09-10T17:52:57.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:57 smithi089 ceph-mon[31467]: pgmap v202: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-09-10T17:52:58.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:52:58.725 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T17:52:41.361387+0000","last_up_change":"2024-09-10T17:52:08.800071+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T17:52:35.123712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T17:52:38.563420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6803","nonce":2400757557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6805","nonce":2400757557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6809","nonce":2400757557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6807","nonce":2400757557}]},"public_addr":"172.21.15.12:6803/2400757557","cluster_addr":"172.21.15.12:6805/2400757557","heartbeat_back_addr":"172.21.15.12:6809/2400757557","heartbeat_front_addr":"172.21.15.12:6807/2400757557","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6811","nonce":284928520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6813","nonce":284928520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6817","nonce":284928520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6815","nonce":284928520}]},"public_addr":"172.21.15.12:6811/284928520","cluster_addr":"172.21.15.12:6813/284928520","heartbeat_back_addr":"172.21.15.12:6817/284928520","heartbeat_front_addr":"172.21.15.12:6815/284928520","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6819","nonce":2631347892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6821","nonce":2631347892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6825","nonce":2631347892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6823","nonce":2631347892}]},"public_addr":"172.21.15.12:6819/2631347892","cluster_addr":"172.21.15.12:6821/2631347892","heartbeat_back_addr":"172.21.15.12:6825/2631347892","heartbeat_front_addr":"172.21.15.12:6823/2631347892","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6827","nonce":3917191557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6829","nonce":3917191557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6833","nonce":3917191557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6831","nonce":3917191557}]},"public_addr":"172.21.15.12:6827/3917191557","cluster_addr":"172.21.15.12:6829/3917191557","heartbeat_back_addr":"172.21.15.12:6833/3917191557","heartbeat_front_addr":"172.21.15.12:6831/3917191557","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6801","nonce":4063563708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6803","nonce":4063563708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6807","nonce":4063563708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6805","nonce":4063563708}]},"public_addr":"172.21.15.89:6801/4063563708","cluster_addr":"172.21.15.89:6803/4063563708","heartbeat_back_addr":"172.21.15.89:6807/4063563708","heartbeat_front_addr":"172.21.15.89:6805/4063563708","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6809","nonce":4007259364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6811","nonce":4007259364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6815","nonce":4007259364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6813","nonce":4007259364}]},"public_addr":"172.21.15.89:6809/4007259364","cluster_addr":"172.21.15.89:6811/4007259364","heartbeat_back_addr":"172.21.15.89:6815/4007259364","heartbeat_front_addr":"172.21.15.89:6813/4007259364","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6817","nonce":1083920992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6819","nonce":1083920992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6823","nonce":1083920992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6821","nonce":1083920992}]},"public_addr":"172.21.15.89:6817/1083920992","cluster_addr":"172.21.15.89:6819/1083920992","heartbeat_back_addr":"172.21.15.89:6823/1083920992","heartbeat_front_addr":"172.21.15.89:6821/1083920992","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6825","nonce":945164195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6827","nonce":945164195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6831","nonce":945164195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6829","nonce":945164195}]},"public_addr":"172.21.15.89:6825/945164195","cluster_addr":"172.21.15.89:6827/945164195","heartbeat_back_addr":"172.21.15.89:6831/945164195","heartbeat_front_addr":"172.21.15.89:6829/945164195","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T17:52:59.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:58 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/733937958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:59.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:58 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/733937958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:59.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:58 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/733937958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:52:59.445 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T17:52:59.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T17:52:59.652 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:00.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:52:59 smithi012 ceph-mon[27356]: pgmap v203: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:00.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:52:59 smithi012 ceph-mon[37454]: pgmap v203: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:52:59 smithi089 ceph-mon[31467]: pgmap v203: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:01.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:53:01.472 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:01 smithi012 ceph-mon[27356]: pgmap v204: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:01.473 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:01 smithi012 ceph-mon[37454]: pgmap v204: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T17:53:01.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:01 smithi089 ceph-mon[31467]: pgmap v204: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:02.301 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-10T17:53:01.095339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":235444,"kb_used_data":6952,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749725772,"statfs":{"total":767960285184,"available":767719190528,"internally_reserved":0,"allocated":7118848,"data_stored":3996391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":233819706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278887+0000","last_change":"2024-09-10T17:52:39.637199+0000","last_active":"2024-09-10T17:52:41.278887+0000","last_peered":"2024-09-10T17:52:41.278887+0000","last_clean":"2024-09-10T17:52:41.278887+0000","last_became_active":"2024-09-10T17:52:39.636912+0000","last_became_peered":"2024-09-10T17:52:39.636912+0000","last_unstale":"2024-09-10T17:52:41.278887+0000","last_undegraded":"2024-09-10T17:52:41.278887+0000","last_fullsized":"2024-09-10T17:52:41.278887+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.373383+0000","last_change":"2024-09-10T17:52:39.640227+0000","last_active":"2024-09-10T17:52:41.373383+0000","last_peered":"2024-09-10T17:52:41.373383+0000","last_clean":"2024-09-10T17:52:41.373383+0000","last_became_active":"2024-09-10T17:52:39.639677+0000","last_became_peered":"2024-09-10T17:52:39.639677+0000","last_unstale":"2024-09-10T17:52:41.373383+0000","last_undegraded":"2024-09-10T17:52:41.373383+0000","last_fullsized":"2024-09-10T17:52:41.373383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277368+0000","last_change":"2024-09-10T17:52:39.634939+0000","last_active":"2024-09-10T17:52:41.277368+0000","last_peered":"2024-09-10T17:52:41.277368+0000","last_clean":"2024-09-10T17:52:41.277368+0000","last_became_active":"2024-09-10T17:52:39.634668+0000","last_became_peered":"2024-09-10T17:52:39.634668+0000","last_unstale":"2024-09-10T17:52:41.277368+0000","last_undegraded":"2024-09-10T17:52:41.277368+0000","last_fullsized":"2024-09-10T17:52:41.277368+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278327+0000","last_change":"2024-09-10T17:52:39.652074+0000","last_active":"2024-09-10T17:52:41.278327+0000","last_peered":"2024-09-10T17:52:41.278327+0000","last_clean":"2024-09-10T17:52:41.278327+0000","last_became_active":"2024-09-10T17:52:39.651762+0000","last_became_peered":"2024-09-10T17:52:39.651762+0000","last_unstale":"2024-09-10T17:52:41.278327+0000","last_undegraded":"2024-09-10T17:52:41.278327+0000","last_fullsized":"2024-09-10T17:52:41.278327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278082+0000","last_change":"2024-09-10T17:52:39.637379+0000","last_active":"2024-09-10T17:52:41.278082+0000","last_peered":"2024-09-10T17:52:41.278082+0000","last_clean":"2024-09-10T17:52:41.278082+0000","last_became_active":"2024-09-10T17:52:39.636370+0000","last_became_peered":"2024-09-10T17:52:39.636370+0000","last_unstale":"2024-09-10T17:52:41.278082+0000","last_undegraded":"2024-09-10T17:52:41.278082+0000","last_fullsized":"2024-09-10T17:52:41.278082+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277862+0000","last_change":"2024-09-10T17:52:39.646980+0000","last_active":"2024-09-10T17:52:41.277862+0000","last_peered":"2024-09-10T17:52:41.277862+0000","last_clean":"2024-09-10T17:52:41.277862+0000","last_became_active":"2024-09-10T17:52:39.645786+0000","last_became_peered":"2024-09-10T17:52:39.645786+0000","last_unstale":"2024-09-10T17:52:41.277862+0000","last_undegraded":"2024-09-10T17:52:41.277862+0000","last_fullsized":"2024-09-10T17:52:41.277862+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277720+0000","last_change":"2024-09-10T17:52:39.648036+0000","last_active":"2024-09-10T17:52:41.277720+0000","last_peered":"2024-09-10T17:52:41.277720+0000","last_clean":"2024-09-10T17:52:41.277720+0000","last_became_active":"2024-09-10T17:52:39.647752+0000","last_became_peered":"2024-09-10T17:52:39.647752+0000","last_unstale":"2024-09-10T17:52:41.277720+0000","last_undegraded":"2024-09-10T17:52:41.277720+0000","last_fullsized":"2024-09-10T17:52:41.277720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:33.327411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364704+0000","last_change":"2024-09-10T17:52:39.645147+0000","last_active":"2024-09-10T17:52:41.364704+0000","last_peered":"2024-09-10T17:52:41.364704+0000","last_clean":"2024-09-10T17:52:41.364704+0000","last_became_active":"2024-09-10T17:52:39.644853+0000","last_became_peered":"2024-09-10T17:52:39.644853+0000","last_unstale":"2024-09-10T17:52:41.364704+0000","last_undegraded":"2024-09-10T17:52:41.364704+0000","last_fullsized":"2024-09-10T17:52:41.364704+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.279060+0000","last_change":"2024-09-10T17:52:39.643055+0000","last_active":"2024-09-10T17:52:41.279060+0000","last_peered":"2024-09-10T17:52:41.279060+0000","last_clean":"2024-09-10T17:52:41.279060+0000","last_became_active":"2024-09-10T17:52:39.642731+0000","last_became_peered":"2024-09-10T17:52:39.642731+0000","last_unstale":"2024-09-10T17:52:41.279060+0000","last_undegraded":"2024-09-10T17:52:41.279060+0000","last_fullsized":"2024-09-10T17:52:41.279060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371230+0000","last_change":"2024-09-10T17:52:39.642693+0000","last_active":"2024-09-10T17:52:41.371230+0000","last_peered":"2024-09-10T17:52:41.371230+0000","last_clean":"2024-09-10T17:52:41.371230+0000","last_became_active":"2024-09-10T17:52:39.642404+0000","last_became_peered":"2024-09-10T17:52:39.642404+0000","last_unstale":"2024-09-10T17:52:41.371230+0000","last_undegraded":"2024-09-10T17:52:41.371230+0000","last_fullsized":"2024-09-10T17:52:41.371230+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371449+0000","last_change":"2024-09-10T17:52:39.641932+0000","last_active":"2024-09-10T17:52:41.371449+0000","last_peered":"2024-09-10T17:52:41.371449+0000","last_clean":"2024-09-10T17:52:41.371449+0000","last_became_active":"2024-09-10T17:52:39.641622+0000","last_became_peered":"2024-09-10T17:52:39.641622+0000","last_unstale":"2024-09-10T17:52:41.371449+0000","last_undegraded":"2024-09-10T17:52:41.371449+0000","last_fullsized":"2024-09-10T17:52:41.371449+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.366083+0000","last_change":"2024-09-10T17:52:39.642779+0000","last_active":"2024-09-10T17:52:41.366083+0000","last_peered":"2024-09-10T17:52:41.366083+0000","last_clean":"2024-09-10T17:52:41.366083+0000","last_became_active":"2024-09-10T17:52:39.642526+0000","last_became_peered":"2024-09-10T17:52:39.642526+0000","last_unstale":"2024-09-10T17:52:41.366083+0000","last_undegraded":"2024-09-10T17:52:41.366083+0000","last_fullsized":"2024-09-10T17:52:41.366083+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:49.705736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365320+0000","last_change":"2024-09-10T17:52:39.642786+0000","last_active":"2024-09-10T17:52:41.365320+0000","last_peered":"2024-09-10T17:52:41.365320+0000","last_clean":"2024-09-10T17:52:41.365320+0000","last_became_active":"2024-09-10T17:52:39.641524+0000","last_became_peered":"2024-09-10T17:52:39.641524+0000","last_unstale":"2024-09-10T17:52:41.365320+0000","last_undegraded":"2024-09-10T17:52:41.365320+0000","last_fullsized":"2024-09-10T17:52:41.365320+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276944+0000","last_change":"2024-09-10T17:52:39.639101+0000","last_active":"2024-09-10T17:52:41.276944+0000","last_peered":"2024-09-10T17:52:41.276944+0000","last_clean":"2024-09-10T17:52:41.276944+0000","last_became_active":"2024-09-10T17:52:39.638816+0000","last_became_peered":"2024-09-10T17:52:39.638816+0000","last_unstale":"2024-09-10T17:52:41.276944+0000","last_undegraded":"2024-09-10T17:52:41.276944+0000","last_fullsized":"2024-09-10T17:52:41.276944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370372+0000","last_change":"2024-09-10T17:52:39.640880+0000","last_active":"2024-09-10T17:52:41.370372+0000","last_peered":"2024-09-10T17:52:41.370372+0000","last_clean":"2024-09-10T17:52:41.370372+0000","last_became_active":"2024-09-10T17:52:39.640599+0000","last_became_peered":"2024-09-10T17:52:39.640599+0000","last_unstale":"2024-09-10T17:52:41.370372+0000","last_undegraded":"2024-09-10T17:52:41.370372+0000","last_fullsized":"2024-09-10T17:52:41.370372+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277110+0000","last_change":"2024-09-10T17:52:39.646904+0000","last_active":"2024-09-10T17:52:41.277110+0000","last_peered":"2024-09-10T17:52:41.277110+0000","last_clean":"2024-09-10T17:52:41.277110+0000","last_became_active":"2024-09-10T17:52:39.646649+0000","last_became_peered":"2024-09-10T17:52:39.646649+0000","last_unstale":"2024-09-10T17:52:41.277110+0000","last_undegraded":"2024-09-10T17:52:41.277110+0000","last_fullsized":"2024-09-10T17:52:41.277110+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277670+0000","last_change":"2024-09-10T17:52:39.651784+0000","last_active":"2024-09-10T17:52:41.277670+0000","last_peered":"2024-09-10T17:52:41.277670+0000","last_clean":"2024-09-10T17:52:41.277670+0000","last_became_active":"2024-09-10T17:52:39.651519+0000","last_became_peered":"2024-09-10T17:52:39.651519+0000","last_unstale":"2024-09-10T17:52:41.277670+0000","last_undegraded":"2024-09-10T17:52:41.277670+0000","last_fullsized":"2024-09-10T17:52:41.277670+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:40.627636+0000","last_change":"2024-09-10T17:52:39.636540+0000","last_active":"2024-09-10T17:52:40.627636+0000","last_peered":"2024-09-10T17:52:40.627636+0000","last_clean":"2024-09-10T17:52:40.627636+0000","last_became_active":"2024-09-10T17:52:39.636034+0000","last_became_peered":"2024-09-10T17:52:39.636034+0000","last_unstale":"2024-09-10T17:52:40.627636+0000","last_undegraded":"2024-09-10T17:52:40.627636+0000","last_fullsized":"2024-09-10T17:52:40.627636+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278883+0000","last_change":"2024-09-10T17:52:39.642764+0000","last_active":"2024-09-10T17:52:41.278883+0000","last_peered":"2024-09-10T17:52:41.278883+0000","last_clean":"2024-09-10T17:52:41.278883+0000","last_became_active":"2024-09-10T17:52:39.642454+0000","last_became_peered":"2024-09-10T17:52:39.642454+0000","last_unstale":"2024-09-10T17:52:41.278883+0000","last_undegraded":"2024-09-10T17:52:41.278883+0000","last_fullsized":"2024-09-10T17:52:41.278883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371826+0000","last_change":"2024-09-10T17:52:39.644420+0000","last_active":"2024-09-10T17:52:41.371826+0000","last_peered":"2024-09-10T17:52:41.371826+0000","last_clean":"2024-09-10T17:52:41.371826+0000","last_became_active":"2024-09-10T17:52:39.644155+0000","last_became_peered":"2024-09-10T17:52:39.644155+0000","last_unstale":"2024-09-10T17:52:41.371826+0000","last_undegraded":"2024-09-10T17:52:41.371826+0000","last_fullsized":"2024-09-10T17:52:41.371826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277103+0000","last_change":"2024-09-10T17:52:39.631587+0000","last_active":"2024-09-10T17:52:41.277103+0000","last_peered":"2024-09-10T17:52:41.277103+0000","last_clean":"2024-09-10T17:52:41.277103+0000","last_became_active":"2024-09-10T17:52:39.631291+0000","last_became_peered":"2024-09-10T17:52:39.631291+0000","last_unstale":"2024-09-10T17:52:41.277103+0000","last_undegraded":"2024-09-10T17:52:41.277103+0000","last_fullsized":"2024-09-10T17:52:41.277103+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277944+0000","last_change":"2024-09-10T17:52:39.635863+0000","last_active":"2024-09-10T17:52:41.277944+0000","last_peered":"2024-09-10T17:52:41.277944+0000","last_clean":"2024-09-10T17:52:41.277944+0000","last_became_active":"2024-09-10T17:52:39.635566+0000","last_became_peered":"2024-09-10T17:52:39.635566+0000","last_unstale":"2024-09-10T17:52:41.277944+0000","last_undegraded":"2024-09-10T17:52:41.277944+0000","last_fullsized":"2024-09-10T17:52:41.277944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364655+0000","last_change":"2024-09-10T17:52:39.641463+0000","last_active":"2024-09-10T17:52:41.364655+0000","last_peered":"2024-09-10T17:52:41.364655+0000","last_clean":"2024-09-10T17:52:41.364655+0000","last_became_active":"2024-09-10T17:52:39.640887+0000","last_became_peered":"2024-09-10T17:52:39.640887+0000","last_unstale":"2024-09-10T17:52:41.364655+0000","last_undegraded":"2024-09-10T17:52:41.364655+0000","last_fullsized":"2024-09-10T17:52:41.364655+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277186+0000","last_change":"2024-09-10T17:52:39.648810+0000","last_active":"2024-09-10T17:52:41.277186+0000","last_peered":"2024-09-10T17:52:41.277186+0000","last_clean":"2024-09-10T17:52:41.277186+0000","last_became_active":"2024-09-10T17:52:39.648476+0000","last_became_peered":"2024-09-10T17:52:39.648476+0000","last_unstale":"2024-09-10T17:52:41.277186+0000","last_undegraded":"2024-09-10T17:52:41.277186+0000","last_fullsized":"2024-09-10T17:52:41.277186+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365545+0000","last_change":"2024-09-10T17:52:39.643794+0000","last_active":"2024-09-10T17:52:41.365545+0000","last_peered":"2024-09-10T17:52:41.365545+0000","last_clean":"2024-09-10T17:52:41.365545+0000","last_became_active":"2024-09-10T17:52:39.643540+0000","last_became_peered":"2024-09-10T17:52:39.643540+0000","last_unstale":"2024-09-10T17:52:41.365545+0000","last_undegraded":"2024-09-10T17:52:41.365545+0000","last_fullsized":"2024-09-10T17:52:41.365545+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371359+0000","last_change":"2024-09-10T17:52:39.650553+0000","last_active":"2024-09-10T17:52:41.371359+0000","last_peered":"2024-09-10T17:52:41.371359+0000","last_clean":"2024-09-10T17:52:41.371359+0000","last_became_active":"2024-09-10T17:52:39.650207+0000","last_became_peered":"2024-09-10T17:52:39.650207+0000","last_unstale":"2024-09-10T17:52:41.371359+0000","last_undegraded":"2024-09-10T17:52:41.371359+0000","last_fullsized":"2024-09-10T17:52:41.371359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370607+0000","last_change":"2024-09-10T17:52:39.641442+0000","last_active":"2024-09-10T17:52:41.370607+0000","last_peered":"2024-09-10T17:52:41.370607+0000","last_clean":"2024-09-10T17:52:41.370607+0000","last_became_active":"2024-09-10T17:52:39.641158+0000","last_became_peered":"2024-09-10T17:52:39.641158+0000","last_unstale":"2024-09-10T17:52:41.370607+0000","last_undegraded":"2024-09-10T17:52:41.370607+0000","last_fullsized":"2024-09-10T17:52:41.370607+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365216+0000","last_change":"2024-09-10T17:52:39.644997+0000","last_active":"2024-09-10T17:52:41.365216+0000","last_peered":"2024-09-10T17:52:41.365216+0000","last_clean":"2024-09-10T17:52:41.365216+0000","last_became_active":"2024-09-10T17:52:39.643999+0000","last_became_peered":"2024-09-10T17:52:39.643999+0000","last_unstale":"2024-09-10T17:52:41.365216+0000","last_undegraded":"2024-09-10T17:52:41.365216+0000","last_fullsized":"2024-09-10T17:52:41.365216+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277113+0000","last_change":"2024-09-10T17:52:39.632927+0000","last_active":"2024-09-10T17:52:41.277113+0000","last_peered":"2024-09-10T17:52:41.277113+0000","last_clean":"2024-09-10T17:52:41.277113+0000","last_became_active":"2024-09-10T17:52:39.632680+0000","last_became_peered":"2024-09-10T17:52:39.632680+0000","last_unstale":"2024-09-10T17:52:41.277113+0000","last_undegraded":"2024-09-10T17:52:41.277113+0000","last_fullsized":"2024-09-10T17:52:41.277113+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278032+0000","last_change":"2024-09-10T17:52:39.648726+0000","last_active":"2024-09-10T17:52:41.278032+0000","last_peered":"2024-09-10T17:52:41.278032+0000","last_clean":"2024-09-10T17:52:41.278032+0000","last_became_active":"2024-09-10T17:52:39.648448+0000","last_became_peered":"2024-09-10T17:52:39.648448+0000","last_unstale":"2024-09-10T17:52:41.278032+0000","last_undegraded":"2024-09-10T17:52:41.278032+0000","last_fullsized":"2024-09-10T17:52:41.278032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:40.627488+0000","last_change":"2024-09-10T17:52:39.634918+0000","last_active":"2024-09-10T17:52:40.627488+0000","last_peered":"2024-09-10T17:52:40.627488+0000","last_clean":"2024-09-10T17:52:40.627488+0000","last_became_active":"2024-09-10T17:52:39.634622+0000","last_became_peered":"2024-09-10T17:52:39.634622+0000","last_unstale":"2024-09-10T17:52:40.627488+0000","last_undegraded":"2024-09-10T17:52:40.627488+0000","last_fullsized":"2024-09-10T17:52:40.627488+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372695+0000","last_change":"2024-09-10T17:52:39.642111+0000","last_active":"2024-09-10T17:52:41.372695+0000","last_peered":"2024-09-10T17:52:41.372695+0000","last_clean":"2024-09-10T17:52:41.372695+0000","last_became_active":"2024-09-10T17:52:39.641786+0000","last_became_peered":"2024-09-10T17:52:39.641786+0000","last_unstale":"2024-09-10T17:52:41.372695+0000","last_undegraded":"2024-09-10T17:52:41.372695+0000","last_fullsized":"2024-09-10T17:52:41.372695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365149+0000","last_change":"2024-09-10T17:52:39.632064+0000","last_active":"2024-09-10T17:52:41.365149+0000","last_peered":"2024-09-10T17:52:41.365149+0000","last_clean":"2024-09-10T17:52:41.365149+0000","last_became_active":"2024-09-10T17:52:39.631529+0000","last_became_peered":"2024-09-10T17:52:39.631529+0000","last_unstale":"2024-09-10T17:52:41.365149+0000","last_undegraded":"2024-09-10T17:52:41.365149+0000","last_fullsized":"2024-09-10T17:52:41.365149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"65'1","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365588+0000","last_change":"2024-09-10T17:52:36.192274+0000","last_active":"2024-09-10T17:52:41.365588+0000","last_peered":"2024-09-10T17:52:41.365588+0000","last_clean":"2024-09-10T17:52:41.365588+0000","last_became_active":"2024-09-10T17:52:36.191998+0000","last_became_peered":"2024-09-10T17:52:36.191998+0000","last_unstale":"2024-09-10T17:52:41.365588+0000","last_undegraded":"2024-09-10T17:52:41.365588+0000","last_fullsized":"2024-09-10T17:52:41.365588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277216+0000","last_change":"2024-09-10T17:52:39.632306+0000","last_active":"2024-09-10T17:52:41.277216+0000","last_peered":"2024-09-10T17:52:41.277216+0000","last_clean":"2024-09-10T17:52:41.277216+0000","last_became_active":"2024-09-10T17:52:39.632048+0000","last_became_peered":"2024-09-10T17:52:39.632048+0000","last_unstale":"2024-09-10T17:52:41.277216+0000","last_undegraded":"2024-09-10T17:52:41.277216+0000","last_fullsized":"2024-09-10T17:52:41.277216+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:03.733364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"65'1","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371664+0000","last_change":"2024-09-10T17:52:36.190911+0000","last_active":"2024-09-10T17:52:41.371664+0000","last_peered":"2024-09-10T17:52:41.371664+0000","last_clean":"2024-09-10T17:52:41.371664+0000","last_became_active":"2024-09-10T17:52:36.190437+0000","last_became_peered":"2024-09-10T17:52:36.190437+0000","last_unstale":"2024-09-10T17:52:41.371664+0000","last_undegraded":"2024-09-10T17:52:41.371664+0000","last_fullsized":"2024-09-10T17:52:41.371664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:40.627965+0000","last_change":"2024-09-10T17:52:36.192952+0000","last_active":"2024-09-10T17:52:40.627965+0000","last_peered":"2024-09-10T17:52:40.627965+0000","last_clean":"2024-09-10T17:52:40.627965+0000","last_became_active":"2024-09-10T17:52:36.192199+0000","last_became_peered":"2024-09-10T17:52:36.192199+0000","last_unstale":"2024-09-10T17:52:40.627965+0000","last_undegraded":"2024-09-10T17:52:40.627965+0000","last_fullsized":"2024-09-10T17:52:40.627965+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364785+0000","last_change":"2024-09-10T17:52:39.646604+0000","last_active":"2024-09-10T17:52:41.364785+0000","last_peered":"2024-09-10T17:52:41.364785+0000","last_clean":"2024-09-10T17:52:41.364785+0000","last_became_active":"2024-09-10T17:52:39.646321+0000","last_became_peered":"2024-09-10T17:52:39.646321+0000","last_unstale":"2024-09-10T17:52:41.364785+0000","last_undegraded":"2024-09-10T17:52:41.364785+0000","last_fullsized":"2024-09-10T17:52:41.364785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277187+0000","last_change":"2024-09-10T17:52:36.194360+0000","last_active":"2024-09-10T17:52:41.277187+0000","last_peered":"2024-09-10T17:52:41.277187+0000","last_clean":"2024-09-10T17:52:41.277187+0000","last_became_active":"2024-09-10T17:52:36.194106+0000","last_became_peered":"2024-09-10T17:52:36.194106+0000","last_unstale":"2024-09-10T17:52:41.277187+0000","last_undegraded":"2024-09-10T17:52:41.277187+0000","last_fullsized":"2024-09-10T17:52:41.277187+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370219+0000","last_change":"2024-09-10T17:52:39.637886+0000","last_active":"2024-09-10T17:52:41.370219+0000","last_peered":"2024-09-10T17:52:41.370219+0000","last_clean":"2024-09-10T17:52:41.370219+0000","last_became_active":"2024-09-10T17:52:39.637615+0000","last_became_peered":"2024-09-10T17:52:39.637615+0000","last_unstale":"2024-09-10T17:52:41.370219+0000","last_undegraded":"2024-09-10T17:52:41.370219+0000","last_fullsized":"2024-09-10T17:52:41.370219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277922+0000","last_change":"2024-09-10T17:52:36.193200+0000","last_active":"2024-09-10T17:52:41.277922+0000","last_peered":"2024-09-10T17:52:41.277922+0000","last_clean":"2024-09-10T17:52:41.277922+0000","last_became_active":"2024-09-10T17:52:36.192223+0000","last_became_peered":"2024-09-10T17:52:36.192223+0000","last_unstale":"2024-09-10T17:52:41.277922+0000","last_undegraded":"2024-09-10T17:52:41.277922+0000","last_fullsized":"2024-09-10T17:52:41.277922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277517+0000","last_change":"2024-09-10T17:52:39.646338+0000","last_active":"2024-09-10T17:52:41.277517+0000","last_peered":"2024-09-10T17:52:41.277517+0000","last_clean":"2024-09-10T17:52:41.277517+0000","last_became_active":"2024-09-10T17:52:39.645661+0000","last_became_peered":"2024-09-10T17:52:39.645661+0000","last_unstale":"2024-09-10T17:52:41.277517+0000","last_undegraded":"2024-09-10T17:52:41.277517+0000","last_fullsized":"2024-09-10T17:52:41.277517+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277757+0000","last_change":"2024-09-10T17:52:36.192408+0000","last_active":"2024-09-10T17:52:41.277757+0000","last_peered":"2024-09-10T17:52:41.277757+0000","last_clean":"2024-09-10T17:52:41.277757+0000","last_became_active":"2024-09-10T17:52:36.192132+0000","last_became_peered":"2024-09-10T17:52:36.192132+0000","last_unstale":"2024-09-10T17:52:41.277757+0000","last_undegraded":"2024-09-10T17:52:41.277757+0000","last_fullsized":"2024-09-10T17:52:41.277757+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277484+0000","last_change":"2024-09-10T17:52:39.641531+0000","last_active":"2024-09-10T17:52:41.277484+0000","last_peered":"2024-09-10T17:52:41.277484+0000","last_clean":"2024-09-10T17:52:41.277484+0000","last_became_active":"2024-09-10T17:52:39.639958+0000","last_became_peered":"2024-09-10T17:52:39.639958+0000","last_unstale":"2024-09-10T17:52:41.277484+0000","last_undegraded":"2024-09-10T17:52:41.277484+0000","last_fullsized":"2024-09-10T17:52:41.277484+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"65'3","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377817+0000","last_change":"2024-09-10T17:52:36.188432+0000","last_active":"2024-09-10T17:52:41.377817+0000","last_peered":"2024-09-10T17:52:41.377817+0000","last_clean":"2024-09-10T17:52:41.377817+0000","last_became_active":"2024-09-10T17:52:36.188019+0000","last_became_peered":"2024-09-10T17:52:36.188019+0000","last_unstale":"2024-09-10T17:52:41.377817+0000","last_undegraded":"2024-09-10T17:52:41.377817+0000","last_fullsized":"2024-09-10T17:52:41.377817+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.366160+0000","last_change":"2024-09-10T17:52:39.642140+0000","last_active":"2024-09-10T17:52:41.366160+0000","last_peered":"2024-09-10T17:52:41.366160+0000","last_clean":"2024-09-10T17:52:41.366160+0000","last_became_active":"2024-09-10T17:52:39.641201+0000","last_became_peered":"2024-09-10T17:52:39.641201+0000","last_unstale":"2024-09-10T17:52:41.366160+0000","last_undegraded":"2024-09-10T17:52:41.366160+0000","last_fullsized":"2024-09-10T17:52:41.366160+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'6","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378744+0000","last_change":"2024-09-10T17:52:36.190637+0000","last_active":"2024-09-10T17:52:41.378744+0000","last_peered":"2024-09-10T17:52:41.378744+0000","last_clean":"2024-09-10T17:52:41.378744+0000","last_became_active":"2024-09-10T17:52:36.190315+0000","last_became_peered":"2024-09-10T17:52:36.190315+0000","last_unstale":"2024-09-10T17:52:41.378744+0000","last_undegraded":"2024-09-10T17:52:41.378744+0000","last_fullsized":"2024-09-10T17:52:41.378744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278626+0000","last_change":"2024-09-10T17:52:39.647058+0000","last_active":"2024-09-10T17:52:41.278626+0000","last_peered":"2024-09-10T17:52:41.278626+0000","last_clean":"2024-09-10T17:52:41.278626+0000","last_became_active":"2024-09-10T17:52:39.646127+0000","last_became_peered":"2024-09-10T17:52:39.646127+0000","last_unstale":"2024-09-10T17:52:41.278626+0000","last_undegraded":"2024-09-10T17:52:41.278626+0000","last_fullsized":"2024-09-10T17:52:41.278626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377709+0000","last_change":"2024-09-10T17:52:36.197133+0000","last_active":"2024-09-10T17:52:41.377709+0000","last_peered":"2024-09-10T17:52:41.377709+0000","last_clean":"2024-09-10T17:52:41.377709+0000","last_became_active":"2024-09-10T17:52:36.196798+0000","last_became_peered":"2024-09-10T17:52:36.196798+0000","last_unstale":"2024-09-10T17:52:41.377709+0000","last_undegraded":"2024-09-10T17:52:41.377709+0000","last_fullsized":"2024-09-10T17:52:41.377709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276995+0000","last_change":"2024-09-10T17:52:39.632963+0000","last_active":"2024-09-10T17:52:41.276995+0000","last_peered":"2024-09-10T17:52:41.276995+0000","last_clean":"2024-09-10T17:52:41.276995+0000","last_became_active":"2024-09-10T17:52:39.632648+0000","last_became_peered":"2024-09-10T17:52:39.632648+0000","last_unstale":"2024-09-10T17:52:41.276995+0000","last_undegraded":"2024-09-10T17:52:41.276995+0000","last_fullsized":"2024-09-10T17:52:41.276995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278098+0000","last_change":"2024-09-10T17:52:36.190919+0000","last_active":"2024-09-10T17:52:41.278098+0000","last_peered":"2024-09-10T17:52:41.278098+0000","last_clean":"2024-09-10T17:52:41.278098+0000","last_became_active":"2024-09-10T17:52:36.190637+0000","last_became_peered":"2024-09-10T17:52:36.190637+0000","last_unstale":"2024-09-10T17:52:41.278098+0000","last_undegraded":"2024-09-10T17:52:41.278098+0000","last_fullsized":"2024-09-10T17:52:41.278098+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278177+0000","last_change":"2024-09-10T17:52:39.637441+0000","last_active":"2024-09-10T17:52:41.278177+0000","last_peered":"2024-09-10T17:52:41.278177+0000","last_clean":"2024-09-10T17:52:41.278177+0000","last_became_active":"2024-09-10T17:52:39.636759+0000","last_became_peered":"2024-09-10T17:52:39.636759+0000","last_unstale":"2024-09-10T17:52:41.278177+0000","last_undegraded":"2024-09-10T17:52:41.278177+0000","last_fullsized":"2024-09-10T17:52:41.278177+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278198+0000","last_change":"2024-09-10T17:52:36.192102+0000","last_active":"2024-09-10T17:52:41.278198+0000","last_peered":"2024-09-10T17:52:41.278198+0000","last_clean":"2024-09-10T17:52:41.278198+0000","last_became_active":"2024-09-10T17:52:36.191743+0000","last_became_peered":"2024-09-10T17:52:36.191743+0000","last_unstale":"2024-09-10T17:52:41.278198+0000","last_undegraded":"2024-09-10T17:52:41.278198+0000","last_fullsized":"2024-09-10T17:52:41.278198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370594+0000","last_change":"2024-09-10T17:52:39.640124+0000","last_active":"2024-09-10T17:52:41.370594+0000","last_peered":"2024-09-10T17:52:41.370594+0000","last_clean":"2024-09-10T17:52:41.370594+0000","last_became_active":"2024-09-10T17:52:39.639840+0000","last_became_peered":"2024-09-10T17:52:39.639840+0000","last_unstale":"2024-09-10T17:52:41.370594+0000","last_undegraded":"2024-09-10T17:52:41.370594+0000","last_fullsized":"2024-09-10T17:52:41.370594+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"65'8","reported_seq":23,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377888+0000","last_change":"2024-09-10T17:52:36.191246+0000","last_active":"2024-09-10T17:52:41.377888+0000","last_peered":"2024-09-10T17:52:41.377888+0000","last_clean":"2024-09-10T17:52:41.377888+0000","last_became_active":"2024-09-10T17:52:36.190916+0000","last_became_peered":"2024-09-10T17:52:36.190916+0000","last_unstale":"2024-09-10T17:52:41.377888+0000","last_undegraded":"2024-09-10T17:52:41.377888+0000","last_fullsized":"2024-09-10T17:52:41.377888+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277825+0000","last_change":"2024-09-10T17:52:39.647318+0000","last_active":"2024-09-10T17:52:41.277825+0000","last_peered":"2024-09-10T17:52:41.277825+0000","last_clean":"2024-09-10T17:52:41.277825+0000","last_became_active":"2024-09-10T17:52:39.647020+0000","last_became_peered":"2024-09-10T17:52:39.647020+0000","last_unstale":"2024-09-10T17:52:41.277825+0000","last_undegraded":"2024-09-10T17:52:41.277825+0000","last_fullsized":"2024-09-10T17:52:41.277825+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"65'1","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365989+0000","last_change":"2024-09-10T17:52:36.194263+0000","last_active":"2024-09-10T17:52:41.365989+0000","last_peered":"2024-09-10T17:52:41.365989+0000","last_clean":"2024-09-10T17:52:41.365989+0000","last_became_active":"2024-09-10T17:52:36.193894+0000","last_became_peered":"2024-09-10T17:52:36.193894+0000","last_unstale":"2024-09-10T17:52:41.365989+0000","last_undegraded":"2024-09-10T17:52:41.365989+0000","last_fullsized":"2024-09-10T17:52:41.365989+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278919+0000","last_change":"2024-09-10T17:52:39.649565+0000","last_active":"2024-09-10T17:52:41.278919+0000","last_peered":"2024-09-10T17:52:41.278919+0000","last_clean":"2024-09-10T17:52:41.278919+0000","last_became_active":"2024-09-10T17:52:39.649271+0000","last_became_peered":"2024-09-10T17:52:39.649271+0000","last_unstale":"2024-09-10T17:52:41.278919+0000","last_undegraded":"2024-09-10T17:52:41.278919+0000","last_fullsized":"2024-09-10T17:52:41.278919+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:48.694829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372123+0000","last_change":"2024-09-10T17:52:36.191958+0000","last_active":"2024-09-10T17:52:41.372123+0000","last_peered":"2024-09-10T17:52:41.372123+0000","last_clean":"2024-09-10T17:52:41.372123+0000","last_became_active":"2024-09-10T17:52:36.191684+0000","last_became_peered":"2024-09-10T17:52:36.191684+0000","last_unstale":"2024-09-10T17:52:41.372123+0000","last_undegraded":"2024-09-10T17:52:41.372123+0000","last_fullsized":"2024-09-10T17:52:41.372123+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278844+0000","last_change":"2024-09-10T17:52:39.648857+0000","last_active":"2024-09-10T17:52:41.278844+0000","last_peered":"2024-09-10T17:52:41.278844+0000","last_clean":"2024-09-10T17:52:41.278844+0000","last_became_active":"2024-09-10T17:52:39.648574+0000","last_became_peered":"2024-09-10T17:52:39.648574+0000","last_unstale":"2024-09-10T17:52:41.278844+0000","last_undegraded":"2024-09-10T17:52:41.278844+0000","last_fullsized":"2024-09-10T17:52:41.278844+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"65'1","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372252+0000","last_change":"2024-09-10T17:52:36.185952+0000","last_active":"2024-09-10T17:52:41.372252+0000","last_peered":"2024-09-10T17:52:41.372252+0000","last_clean":"2024-09-10T17:52:41.372252+0000","last_became_active":"2024-09-10T17:52:36.184643+0000","last_became_peered":"2024-09-10T17:52:36.184643+0000","last_unstale":"2024-09-10T17:52:41.372252+0000","last_undegraded":"2024-09-10T17:52:41.372252+0000","last_fullsized":"2024-09-10T17:52:41.372252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278385+0000","last_change":"2024-09-10T17:52:39.651773+0000","last_active":"2024-09-10T17:52:41.278385+0000","last_peered":"2024-09-10T17:52:41.278385+0000","last_clean":"2024-09-10T17:52:41.278385+0000","last_became_active":"2024-09-10T17:52:39.650072+0000","last_became_peered":"2024-09-10T17:52:39.650072+0000","last_unstale":"2024-09-10T17:52:41.278385+0000","last_undegraded":"2024-09-10T17:52:41.278385+0000","last_fullsized":"2024-09-10T17:52:41.278385+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:40.627968+0000","last_change":"2024-09-10T17:52:36.191363+0000","last_active":"2024-09-10T17:52:40.627968+0000","last_peered":"2024-09-10T17:52:40.627968+0000","last_clean":"2024-09-10T17:52:40.627968+0000","last_became_active":"2024-09-10T17:52:36.190976+0000","last_became_peered":"2024-09-10T17:52:36.190976+0000","last_unstale":"2024-09-10T17:52:40.627968+0000","last_undegraded":"2024-09-10T17:52:40.627968+0000","last_fullsized":"2024-09-10T17:52:40.627968+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278735+0000","last_change":"2024-09-10T17:52:39.643612+0000","last_active":"2024-09-10T17:52:41.278735+0000","last_peered":"2024-09-10T17:52:41.278735+0000","last_clean":"2024-09-10T17:52:41.278735+0000","last_became_active":"2024-09-10T17:52:39.643274+0000","last_became_peered":"2024-09-10T17:52:39.643274+0000","last_unstale":"2024-09-10T17:52:41.278735+0000","last_undegraded":"2024-09-10T17:52:41.278735+0000","last_fullsized":"2024-09-10T17:52:41.278735+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":223,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277781+0000","last_change":"2024-09-10T17:52:12.719807+0000","last_active":"2024-09-10T17:52:41.277781+0000","last_peered":"2024-09-10T17:52:41.277781+0000","last_clean":"2024-09-10T17:52:41.277781+0000","last_became_active":"2024-09-10T17:52:12.719452+0000","last_became_peered":"2024-09-10T17:52:12.719452+0000","last_unstale":"2024-09-10T17:52:41.277781+0000","last_undegraded":"2024-09-10T17:52:41.277781+0000","last_fullsized":"2024-09-10T17:52:41.277781+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_clean_scrub_stamp":"2024-09-10T17:50:14.084625+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277418+0000","last_change":"2024-09-10T17:52:36.195598+0000","last_active":"2024-09-10T17:52:41.277418+0000","last_peered":"2024-09-10T17:52:41.277418+0000","last_clean":"2024-09-10T17:52:41.277418+0000","last_became_active":"2024-09-10T17:52:36.195203+0000","last_became_peered":"2024-09-10T17:52:36.195203+0000","last_unstale":"2024-09-10T17:52:41.277418+0000","last_undegraded":"2024-09-10T17:52:41.277418+0000","last_fullsized":"2024-09-10T17:52:41.277418+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364994+0000","last_change":"2024-09-10T17:52:39.644934+0000","last_active":"2024-09-10T17:52:41.364994+0000","last_peered":"2024-09-10T17:52:41.364994+0000","last_clean":"2024-09-10T17:52:41.364994+0000","last_became_active":"2024-09-10T17:52:39.644205+0000","last_became_peered":"2024-09-10T17:52:39.644205+0000","last_unstale":"2024-09-10T17:52:41.364994+0000","last_undegraded":"2024-09-10T17:52:41.364994+0000","last_fullsized":"2024-09-10T17:52:41.364994+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277694+0000","last_change":"2024-09-10T17:52:36.200242+0000","last_active":"2024-09-10T17:52:41.277694+0000","last_peered":"2024-09-10T17:52:41.277694+0000","last_clean":"2024-09-10T17:52:41.277694+0000","last_became_active":"2024-09-10T17:52:36.199907+0000","last_became_peered":"2024-09-10T17:52:36.199907+0000","last_unstale":"2024-09-10T17:52:41.277694+0000","last_undegraded":"2024-09-10T17:52:41.277694+0000","last_fullsized":"2024-09-10T17:52:41.277694+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:54.483223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276764+0000","last_change":"2024-09-10T17:52:39.632868+0000","last_active":"2024-09-10T17:52:41.276764+0000","last_peered":"2024-09-10T17:52:41.276764+0000","last_clean":"2024-09-10T17:52:41.276764+0000","last_became_active":"2024-09-10T17:52:39.632549+0000","last_became_peered":"2024-09-10T17:52:39.632549+0000","last_unstale":"2024-09-10T17:52:41.276764+0000","last_undegraded":"2024-09-10T17:52:41.276764+0000","last_fullsized":"2024-09-10T17:52:41.276764+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:40.627582+0000","last_change":"2024-09-10T17:52:36.190567+0000","last_active":"2024-09-10T17:52:40.627582+0000","last_peered":"2024-09-10T17:52:40.627582+0000","last_clean":"2024-09-10T17:52:40.627582+0000","last_became_active":"2024-09-10T17:52:36.190261+0000","last_became_peered":"2024-09-10T17:52:36.190261+0000","last_unstale":"2024-09-10T17:52:40.627582+0000","last_undegraded":"2024-09-10T17:52:40.627582+0000","last_fullsized":"2024-09-10T17:52:40.627582+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370615+0000","last_change":"2024-09-10T17:52:39.638839+0000","last_active":"2024-09-10T17:52:41.370615+0000","last_peered":"2024-09-10T17:52:41.370615+0000","last_clean":"2024-09-10T17:52:41.370615+0000","last_became_active":"2024-09-10T17:52:39.638567+0000","last_became_peered":"2024-09-10T17:52:39.638567+0000","last_unstale":"2024-09-10T17:52:41.370615+0000","last_undegraded":"2024-09-10T17:52:41.370615+0000","last_fullsized":"2024-09-10T17:52:41.370615+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278166+0000","last_change":"2024-09-10T17:52:36.193278+0000","last_active":"2024-09-10T17:52:41.278166+0000","last_peered":"2024-09-10T17:52:41.278166+0000","last_clean":"2024-09-10T17:52:41.278166+0000","last_became_active":"2024-09-10T17:52:36.192979+0000","last_became_peered":"2024-09-10T17:52:36.192979+0000","last_unstale":"2024-09-10T17:52:41.278166+0000","last_undegraded":"2024-09-10T17:52:41.278166+0000","last_fullsized":"2024-09-10T17:52:41.278166+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365746+0000","last_change":"2024-09-10T17:52:39.640516+0000","last_active":"2024-09-10T17:52:41.365746+0000","last_peered":"2024-09-10T17:52:41.365746+0000","last_clean":"2024-09-10T17:52:41.365746+0000","last_became_active":"2024-09-10T17:52:39.639996+0000","last_became_peered":"2024-09-10T17:52:39.639996+0000","last_unstale":"2024-09-10T17:52:41.365746+0000","last_undegraded":"2024-09-10T17:52:41.365746+0000","last_fullsized":"2024-09-10T17:52:41.365746+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.123835+0000","last_change":"2024-09-10T17:52:36.193781+0000","last_active":"2024-09-10T17:52:41.123835+0000","last_peered":"2024-09-10T17:52:41.123835+0000","last_clean":"2024-09-10T17:52:41.123835+0000","last_became_active":"2024-09-10T17:52:36.193487+0000","last_became_peered":"2024-09-10T17:52:36.193487+0000","last_unstale":"2024-09-10T17:52:41.123835+0000","last_undegraded":"2024-09-10T17:52:41.123835+0000","last_fullsized":"2024-09-10T17:52:41.123835+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278070+0000","last_change":"2024-09-10T17:52:39.647909+0000","last_active":"2024-09-10T17:52:41.278070+0000","last_peered":"2024-09-10T17:52:41.278070+0000","last_clean":"2024-09-10T17:52:41.278070+0000","last_became_active":"2024-09-10T17:52:39.647630+0000","last_became_peered":"2024-09-10T17:52:39.647630+0000","last_unstale":"2024-09-10T17:52:41.278070+0000","last_undegraded":"2024-09-10T17:52:41.278070+0000","last_fullsized":"2024-09-10T17:52:41.278070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278867+0000","last_change":"2024-09-10T17:52:36.200712+0000","last_active":"2024-09-10T17:52:41.278867+0000","last_peered":"2024-09-10T17:52:41.278867+0000","last_clean":"2024-09-10T17:52:41.278867+0000","last_became_active":"2024-09-10T17:52:36.200402+0000","last_became_peered":"2024-09-10T17:52:36.200402+0000","last_unstale":"2024-09-10T17:52:41.278867+0000","last_undegraded":"2024-09-10T17:52:41.278867+0000","last_fullsized":"2024-09-10T17:52:41.278867+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370827+0000","last_change":"2024-09-10T17:52:39.643072+0000","last_active":"2024-09-10T17:52:41.370827+0000","last_peered":"2024-09-10T17:52:41.370827+0000","last_clean":"2024-09-10T17:52:41.370827+0000","last_became_active":"2024-09-10T17:52:39.642792+0000","last_became_peered":"2024-09-10T17:52:39.642792+0000","last_unstale":"2024-09-10T17:52:41.370827+0000","last_undegraded":"2024-09-10T17:52:41.370827+0000","last_fullsized":"2024-09-10T17:52:41.370827+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"65'1","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.373726+0000","last_change":"2024-09-10T17:52:36.192033+0000","last_active":"2024-09-10T17:52:41.373726+0000","last_peered":"2024-09-10T17:52:41.373726+0000","last_clean":"2024-09-10T17:52:41.373726+0000","last_became_active":"2024-09-10T17:52:36.191662+0000","last_became_peered":"2024-09-10T17:52:36.191662+0000","last_unstale":"2024-09-10T17:52:41.373726+0000","last_undegraded":"2024-09-10T17:52:41.373726+0000","last_fullsized":"2024-09-10T17:52:41.373726+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365710+0000","last_change":"2024-09-10T17:52:39.635594+0000","last_active":"2024-09-10T17:52:41.365710+0000","last_peered":"2024-09-10T17:52:41.365710+0000","last_clean":"2024-09-10T17:52:41.365710+0000","last_became_active":"2024-09-10T17:52:39.635320+0000","last_became_peered":"2024-09-10T17:52:39.635320+0000","last_unstale":"2024-09-10T17:52:41.365710+0000","last_undegraded":"2024-09-10T17:52:41.365710+0000","last_fullsized":"2024-09-10T17:52:41.365710+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378632+0000","last_change":"2024-09-10T17:52:36.194453+0000","last_active":"2024-09-10T17:52:41.378632+0000","last_peered":"2024-09-10T17:52:41.378632+0000","last_clean":"2024-09-10T17:52:41.378632+0000","last_became_active":"2024-09-10T17:52:36.194107+0000","last_became_peered":"2024-09-10T17:52:36.194107+0000","last_unstale":"2024-09-10T17:52:41.378632+0000","last_undegraded":"2024-09-10T17:52:41.378632+0000","last_fullsized":"2024-09-10T17:52:41.378632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277361+0000","last_change":"2024-09-10T17:52:39.631701+0000","last_active":"2024-09-10T17:52:41.277361+0000","last_peered":"2024-09-10T17:52:41.277361+0000","last_clean":"2024-09-10T17:52:41.277361+0000","last_became_active":"2024-09-10T17:52:39.631299+0000","last_became_peered":"2024-09-10T17:52:39.631299+0000","last_unstale":"2024-09-10T17:52:41.277361+0000","last_undegraded":"2024-09-10T17:52:41.277361+0000","last_fullsized":"2024-09-10T17:52:41.277361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277613+0000","last_change":"2024-09-10T17:52:36.200196+0000","last_active":"2024-09-10T17:52:41.277613+0000","last_peered":"2024-09-10T17:52:41.277613+0000","last_clean":"2024-09-10T17:52:41.277613+0000","last_became_active":"2024-09-10T17:52:36.199847+0000","last_became_peered":"2024-09-10T17:52:36.199847+0000","last_unstale":"2024-09-10T17:52:41.277613+0000","last_undegraded":"2024-09-10T17:52:41.277613+0000","last_fullsized":"2024-09-10T17:52:41.277613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365609+0000","last_change":"2024-09-10T17:52:39.643274+0000","last_active":"2024-09-10T17:52:41.365609+0000","last_peered":"2024-09-10T17:52:41.365609+0000","last_clean":"2024-09-10T17:52:41.365609+0000","last_became_active":"2024-09-10T17:52:39.643016+0000","last_became_peered":"2024-09-10T17:52:39.643016+0000","last_unstale":"2024-09-10T17:52:41.365609+0000","last_undegraded":"2024-09-10T17:52:41.365609+0000","last_fullsized":"2024-09-10T17:52:41.365609+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.123664+0000","last_change":"2024-09-10T17:52:36.195088+0000","last_active":"2024-09-10T17:52:41.123664+0000","last_peered":"2024-09-10T17:52:41.123664+0000","last_clean":"2024-09-10T17:52:41.123664+0000","last_became_active":"2024-09-10T17:52:36.194698+0000","last_became_peered":"2024-09-10T17:52:36.194698+0000","last_unstale":"2024-09-10T17:52:41.123664+0000","last_undegraded":"2024-09-10T17:52:41.123664+0000","last_fullsized":"2024-09-10T17:52:41.123664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364876+0000","last_change":"2024-09-10T17:52:39.643179+0000","last_active":"2024-09-10T17:52:41.364876+0000","last_peered":"2024-09-10T17:52:41.364876+0000","last_clean":"2024-09-10T17:52:41.364876+0000","last_became_active":"2024-09-10T17:52:39.642643+0000","last_became_peered":"2024-09-10T17:52:39.642643+0000","last_unstale":"2024-09-10T17:52:41.364876+0000","last_undegraded":"2024-09-10T17:52:41.364876+0000","last_fullsized":"2024-09-10T17:52:41.364876+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.123767+0000","last_change":"2024-09-10T17:52:36.188755+0000","last_active":"2024-09-10T17:52:41.123767+0000","last_peered":"2024-09-10T17:52:41.123767+0000","last_clean":"2024-09-10T17:52:41.123767+0000","last_became_active":"2024-09-10T17:52:36.188465+0000","last_became_peered":"2024-09-10T17:52:36.188465+0000","last_unstale":"2024-09-10T17:52:41.123767+0000","last_undegraded":"2024-09-10T17:52:41.123767+0000","last_fullsized":"2024-09-10T17:52:41.123767+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365416+0000","last_change":"2024-09-10T17:52:39.635509+0000","last_active":"2024-09-10T17:52:41.365416+0000","last_peered":"2024-09-10T17:52:41.365416+0000","last_clean":"2024-09-10T17:52:41.365416+0000","last_became_active":"2024-09-10T17:52:39.635118+0000","last_became_peered":"2024-09-10T17:52:39.635118+0000","last_unstale":"2024-09-10T17:52:41.365416+0000","last_undegraded":"2024-09-10T17:52:41.365416+0000","last_fullsized":"2024-09-10T17:52:41.365416+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.375908+0000","last_change":"2024-09-10T17:52:36.200921+0000","last_active":"2024-09-10T17:52:41.375908+0000","last_peered":"2024-09-10T17:52:41.375908+0000","last_clean":"2024-09-10T17:52:41.375908+0000","last_became_active":"2024-09-10T17:52:36.200153+0000","last_became_peered":"2024-09-10T17:52:36.200153+0000","last_unstale":"2024-09-10T17:52:41.375908+0000","last_undegraded":"2024-09-10T17:52:41.375908+0000","last_fullsized":"2024-09-10T17:52:41.375908+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371318+0000","last_change":"2024-09-10T17:52:39.643628+0000","last_active":"2024-09-10T17:52:41.371318+0000","last_peered":"2024-09-10T17:52:41.371318+0000","last_clean":"2024-09-10T17:52:41.371318+0000","last_became_active":"2024-09-10T17:52:39.643355+0000","last_became_peered":"2024-09-10T17:52:39.643355+0000","last_unstale":"2024-09-10T17:52:41.371318+0000","last_undegraded":"2024-09-10T17:52:41.371318+0000","last_fullsized":"2024-09-10T17:52:41.371318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277976+0000","last_change":"2024-09-10T17:52:39.652448+0000","last_active":"2024-09-10T17:52:41.277976+0000","last_peered":"2024-09-10T17:52:41.277976+0000","last_clean":"2024-09-10T17:52:41.277976+0000","last_became_active":"2024-09-10T17:52:39.652164+0000","last_became_peered":"2024-09-10T17:52:39.652164+0000","last_unstale":"2024-09-10T17:52:41.277976+0000","last_undegraded":"2024-09-10T17:52:41.277976+0000","last_fullsized":"2024-09-10T17:52:41.277976+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377674+0000","last_change":"2024-09-10T17:52:36.200230+0000","last_active":"2024-09-10T17:52:41.377674+0000","last_peered":"2024-09-10T17:52:41.377674+0000","last_clean":"2024-09-10T17:52:41.377674+0000","last_became_active":"2024-09-10T17:52:36.199765+0000","last_became_peered":"2024-09-10T17:52:36.199765+0000","last_unstale":"2024-09-10T17:52:41.377674+0000","last_undegraded":"2024-09-10T17:52:41.377674+0000","last_fullsized":"2024-09-10T17:52:41.377674+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278300+0000","last_change":"2024-09-10T17:52:39.652608+0000","last_active":"2024-09-10T17:52:41.278300+0000","last_peered":"2024-09-10T17:52:41.278300+0000","last_clean":"2024-09-10T17:52:41.278300+0000","last_became_active":"2024-09-10T17:52:39.652354+0000","last_became_peered":"2024-09-10T17:52:39.652354+0000","last_unstale":"2024-09-10T17:52:41.278300+0000","last_undegraded":"2024-09-10T17:52:41.278300+0000","last_fullsized":"2024-09-10T17:52:41.278300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378350+0000","last_change":"2024-09-10T17:52:36.200731+0000","last_active":"2024-09-10T17:52:41.378350+0000","last_peered":"2024-09-10T17:52:41.378350+0000","last_clean":"2024-09-10T17:52:41.378350+0000","last_became_active":"2024-09-10T17:52:36.200429+0000","last_became_peered":"2024-09-10T17:52:36.200429+0000","last_unstale":"2024-09-10T17:52:41.378350+0000","last_undegraded":"2024-09-10T17:52:41.378350+0000","last_fullsized":"2024-09-10T17:52:41.378350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277454+0000","last_change":"2024-09-10T17:52:39.640232+0000","last_active":"2024-09-10T17:52:41.277454+0000","last_peered":"2024-09-10T17:52:41.277454+0000","last_clean":"2024-09-10T17:52:41.277454+0000","last_became_active":"2024-09-10T17:52:39.639462+0000","last_became_peered":"2024-09-10T17:52:39.639462+0000","last_unstale":"2024-09-10T17:52:41.277454+0000","last_undegraded":"2024-09-10T17:52:41.277454+0000","last_fullsized":"2024-09-10T17:52:41.277454+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"65'1","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365601+0000","last_change":"2024-09-10T17:52:36.190257+0000","last_active":"2024-09-10T17:52:41.365601+0000","last_peered":"2024-09-10T17:52:41.365601+0000","last_clean":"2024-09-10T17:52:41.365601+0000","last_became_active":"2024-09-10T17:52:36.189957+0000","last_became_peered":"2024-09-10T17:52:36.189957+0000","last_unstale":"2024-09-10T17:52:41.365601+0000","last_undegraded":"2024-09-10T17:52:41.365601+0000","last_fullsized":"2024-09-10T17:52:41.365601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365463+0000","last_change":"2024-09-10T17:52:39.636289+0000","last_active":"2024-09-10T17:52:41.365463+0000","last_peered":"2024-09-10T17:52:41.365463+0000","last_clean":"2024-09-10T17:52:41.365463+0000","last_became_active":"2024-09-10T17:52:39.635894+0000","last_became_peered":"2024-09-10T17:52:39.635894+0000","last_unstale":"2024-09-10T17:52:41.365463+0000","last_undegraded":"2024-09-10T17:52:41.365463+0000","last_fullsized":"2024-09-10T17:52:41.365463+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"65'4","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378444+0000","last_change":"2024-09-10T17:52:36.194542+0000","last_active":"2024-09-10T17:52:41.378444+0000","last_peered":"2024-09-10T17:52:41.378444+0000","last_clean":"2024-09-10T17:52:41.378444+0000","last_became_active":"2024-09-10T17:52:36.194232+0000","last_became_peered":"2024-09-10T17:52:36.194232+0000","last_unstale":"2024-09-10T17:52:41.378444+0000","last_undegraded":"2024-09-10T17:52:41.378444+0000","last_fullsized":"2024-09-10T17:52:41.378444+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":7086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233995,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716900,"statfs":{"total":95995035648,"available":95966105600,"internally_reserved":0,"allocated":1257472,"data_stored":868246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495633,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32352,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712800,"statfs":{"total":95995035648,"available":95961907200,"internally_reserved":0,"allocated":1257472,"data_stored":868933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65400000000000003}]},{"osd":2,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.498},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63300000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.69699999999999995}]},{"osd":4,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757269,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713380,"statfs":{"total":95995035648,"available":95962501120,"internally_reserved":0,"allocated":663552,"data_stored":278374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.626},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.56899999999999995}]},{"osd":2,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47899999999999998}]},{"osd":4,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.372}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018905,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27680,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717472,"statfs":{"total":95995035648,"available":95966691328,"internally_reserved":0,"allocated":675840,"data_stored":278313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.627}]},{"osd":1,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.377}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182431,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27688,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":679936,"data_stored":279273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.433,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Tue Sep 10 17:52:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.60599999999999998}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.624},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411364,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717484,"statfs":{"total":95995035648,"available":95966703616,"internally_reserved":0,"allocated":655360,"data_stored":277332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.29199999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.32400000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.27200000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:52:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56799999999999995}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46500000000000002}]},{"osd":6,"last update":"Tue Sep 10 17:52:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717480,"statfs":{"total":95995035648,"available":95966699520,"internally_reserved":0,"allocated":659456,"data_stored":277219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.37,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.216,"15min":0.216},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.28899999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.58999999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.28899999999999998}]},{"osd":2,"last update":"Tue Sep 10 17:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40200000000000002,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.40400000000000003}]},{"osd":3,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:52:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.496},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53000000000000003}]},{"osd":5,"last update":"Tue Sep 10 17:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54200000000000004}]},{"osd":6,"last update":"Tue Sep 10 17:52:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32360,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712792,"statfs":{"total":95995035648,"available":95961899008,"internally_reserved":0,"allocated":1269760,"data_stored":868701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 17:52:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54400000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.373,"15min":0.36199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.309}]},{"osd":2,"last update":"Tue Sep 10 17:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38500000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61499999999999999,"5min":0.62,"15min":0.62},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Tue Sep 10 17:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55700000000000005}]},{"osd":5,"last update":"Tue Sep 10 17:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.52400000000000002},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.907,"5min":7.907,"15min":7.907},"last":0.48699999999999999}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.497},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9450000000000003,"5min":7.9450000000000003,"15min":7.9450000000000003},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T17:53:02.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T17:53:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:02.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:02 smithi012 ceph-mon[27356]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:02.533 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:02 smithi012 ceph-mon[37454]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:02.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:02 smithi089 ceph-mon[31467]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:03.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-10T17:53:03.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [7, 2]}]: dispatch 2024-09-10T17:53:03.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [0, 2]}]: dispatch 2024-09-10T17:53:03.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 2]}]: dispatch 2024-09-10T17:53:03.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [4, 3]}]: dispatch 2024-09-10T17:53:03.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[27356]: pgmap v205: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:03.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-10T17:53:03.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [7, 2]}]: dispatch 2024-09-10T17:53:03.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [0, 2]}]: dispatch 2024-09-10T17:53:03.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 2]}]: dispatch 2024-09-10T17:53:03.515 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [4, 3]}]: dispatch 2024-09-10T17:53:03.516 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:03 smithi012 ceph-mon[37454]: pgmap v205: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-10T17:53:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [7, 2]}]: dispatch 2024-09-10T17:53:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [0, 2]}]: dispatch 2024-09-10T17:53:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 2]}]: dispatch 2024-09-10T17:53:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:03 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [4, 3]}]: dispatch 2024-09-10T17:53:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:03 smithi089 ceph-mon[31467]: pgmap v205: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:04.193 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-10T17:53:04.193 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [7, 2]}]': finished 2024-09-10T17:53:04.194 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [0, 2]}]': finished 2024-09-10T17:53:04.194 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 2]}]': finished 2024-09-10T17:53:04.194 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [4, 3]}]': finished 2024-09-10T17:53:04.194 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[27356]: osdmap e66: 8 total, 8 up, 8 in 2024-09-10T17:53:04.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:53:04.205 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T17:53:04.479 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-10T17:53:04.479 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [7, 2]}]': finished 2024-09-10T17:53:04.479 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [0, 2]}]': finished 2024-09-10T17:53:04.479 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 2]}]': finished 2024-09-10T17:53:04.479 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [4, 3]}]': finished 2024-09-10T17:53:04.479 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:04 smithi012 ceph-mon[37454]: osdmap e66: 8 total, 8 up, 8 in 2024-09-10T17:53:04.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:04 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-10T17:53:04.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:04 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [7, 2]}]': finished 2024-09-10T17:53:04.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:04 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [0, 2]}]': finished 2024-09-10T17:53:04.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:04 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 2]}]': finished 2024-09-10T17:53:04.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:04 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [4, 3]}]': finished 2024-09-10T17:53:04.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:04 smithi089 ceph-mon[31467]: osdmap e66: 8 total, 8 up, 8 in 2024-09-10T17:53:04.945 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-09-10T17:53:04.187846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":235460,"kb_used_data":6988,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749725756,"statfs":{"total":767960285184,"available":767719174144,"internally_reserved":0,"allocated":7155712,"data_stored":4016278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":233819706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.094127"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371926+0000","last_change":"2024-09-10T17:52:39.637199+0000","last_active":"2024-09-10T17:52:41.371926+0000","last_peered":"2024-09-10T17:52:41.371926+0000","last_clean":"2024-09-10T17:52:41.371926+0000","last_became_active":"2024-09-10T17:52:39.636912+0000","last_became_peered":"2024-09-10T17:52:39.636912+0000","last_unstale":"2024-09-10T17:52:41.371926+0000","last_undegraded":"2024-09-10T17:52:41.371926+0000","last_fullsized":"2024-09-10T17:52:41.371926+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474946+0000","last_change":"2024-09-10T17:52:39.640227+0000","last_active":"2024-09-10T17:52:43.474946+0000","last_peered":"2024-09-10T17:52:43.474946+0000","last_clean":"2024-09-10T17:52:43.474946+0000","last_became_active":"2024-09-10T17:52:39.639677+0000","last_became_peered":"2024-09-10T17:52:39.639677+0000","last_unstale":"2024-09-10T17:52:43.474946+0000","last_undegraded":"2024-09-10T17:52:43.474946+0000","last_fullsized":"2024-09-10T17:52:43.474946+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277368+0000","last_change":"2024-09-10T17:52:39.634939+0000","last_active":"2024-09-10T17:52:41.277368+0000","last_peered":"2024-09-10T17:52:41.277368+0000","last_clean":"2024-09-10T17:52:41.277368+0000","last_became_active":"2024-09-10T17:52:39.634668+0000","last_became_peered":"2024-09-10T17:52:39.634668+0000","last_unstale":"2024-09-10T17:52:41.277368+0000","last_undegraded":"2024-09-10T17:52:41.277368+0000","last_fullsized":"2024-09-10T17:52:41.277368+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278327+0000","last_change":"2024-09-10T17:52:39.652074+0000","last_active":"2024-09-10T17:52:41.278327+0000","last_peered":"2024-09-10T17:52:41.278327+0000","last_clean":"2024-09-10T17:52:41.278327+0000","last_became_active":"2024-09-10T17:52:39.651762+0000","last_became_peered":"2024-09-10T17:52:39.651762+0000","last_unstale":"2024-09-10T17:52:41.278327+0000","last_undegraded":"2024-09-10T17:52:41.278327+0000","last_fullsized":"2024-09-10T17:52:41.278327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371119+0000","last_change":"2024-09-10T17:52:39.637379+0000","last_active":"2024-09-10T17:52:41.371119+0000","last_peered":"2024-09-10T17:52:41.371119+0000","last_clean":"2024-09-10T17:52:41.371119+0000","last_became_active":"2024-09-10T17:52:39.636370+0000","last_became_peered":"2024-09-10T17:52:39.636370+0000","last_unstale":"2024-09-10T17:52:41.371119+0000","last_undegraded":"2024-09-10T17:52:41.371119+0000","last_fullsized":"2024-09-10T17:52:41.371119+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277862+0000","last_change":"2024-09-10T17:52:39.646980+0000","last_active":"2024-09-10T17:52:41.277862+0000","last_peered":"2024-09-10T17:52:41.277862+0000","last_clean":"2024-09-10T17:52:41.277862+0000","last_became_active":"2024-09-10T17:52:39.645786+0000","last_became_peered":"2024-09-10T17:52:39.645786+0000","last_unstale":"2024-09-10T17:52:41.277862+0000","last_undegraded":"2024-09-10T17:52:41.277862+0000","last_fullsized":"2024-09-10T17:52:41.277862+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:53:03.189906+0000","last_change":"2024-09-10T17:53:03.190102+0000","last_active":"2024-09-10T17:53:03.189906+0000","last_peered":"2024-09-10T17:52:41.370506+0000","last_clean":"2024-09-10T17:52:41.370506+0000","last_became_active":"2024-09-10T17:52:39.647752+0000","last_became_peered":"2024-09-10T17:52:39.647752+0000","last_unstale":"2024-09-10T17:53:03.189906+0000","last_undegraded":"2024-09-10T17:53:03.189906+0000","last_fullsized":"2024-09-10T17:53:03.189906+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:37:01.340312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3,4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549804+0000","last_change":"2024-09-10T17:52:39.645147+0000","last_active":"2024-09-10T17:52:43.549804+0000","last_peered":"2024-09-10T17:52:43.549804+0000","last_clean":"2024-09-10T17:52:43.549804+0000","last_became_active":"2024-09-10T17:52:39.644853+0000","last_became_peered":"2024-09-10T17:52:39.644853+0000","last_unstale":"2024-09-10T17:52:43.549804+0000","last_undegraded":"2024-09-10T17:52:43.549804+0000","last_fullsized":"2024-09-10T17:52:43.549804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372219+0000","last_change":"2024-09-10T17:52:39.643055+0000","last_active":"2024-09-10T17:52:41.372219+0000","last_peered":"2024-09-10T17:52:41.372219+0000","last_clean":"2024-09-10T17:52:41.372219+0000","last_became_active":"2024-09-10T17:52:39.642731+0000","last_became_peered":"2024-09-10T17:52:39.642731+0000","last_unstale":"2024-09-10T17:52:41.372219+0000","last_undegraded":"2024-09-10T17:52:41.372219+0000","last_fullsized":"2024-09-10T17:52:41.372219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371230+0000","last_change":"2024-09-10T17:52:39.642693+0000","last_active":"2024-09-10T17:52:41.371230+0000","last_peered":"2024-09-10T17:52:41.371230+0000","last_clean":"2024-09-10T17:52:41.371230+0000","last_became_active":"2024-09-10T17:52:39.642404+0000","last_became_peered":"2024-09-10T17:52:39.642404+0000","last_unstale":"2024-09-10T17:52:41.371230+0000","last_undegraded":"2024-09-10T17:52:41.371230+0000","last_fullsized":"2024-09-10T17:52:41.371230+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371449+0000","last_change":"2024-09-10T17:52:39.641932+0000","last_active":"2024-09-10T17:52:41.371449+0000","last_peered":"2024-09-10T17:52:41.371449+0000","last_clean":"2024-09-10T17:52:41.371449+0000","last_became_active":"2024-09-10T17:52:39.641622+0000","last_became_peered":"2024-09-10T17:52:39.641622+0000","last_unstale":"2024-09-10T17:52:41.371449+0000","last_undegraded":"2024-09-10T17:52:41.371449+0000","last_fullsized":"2024-09-10T17:52:41.371449+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":2,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:52:39.622507+0000","last_change":"2024-09-10T17:53:04.094591+0000","last_active":"2024-09-10T17:52:38.613602+0000","last_peered":"2024-09-10T17:52:38.613602+0000","last_clean":"2024-09-10T17:52:38.613602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T17:52:39.622507+0000","last_undegraded":"2024-09-10T17:52:39.622507+0000","last_fullsized":"2024-09-10T17:52:39.622507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549922+0000","last_change":"2024-09-10T17:52:39.642786+0000","last_active":"2024-09-10T17:52:43.549922+0000","last_peered":"2024-09-10T17:52:43.549922+0000","last_clean":"2024-09-10T17:52:43.549922+0000","last_became_active":"2024-09-10T17:52:39.641524+0000","last_became_peered":"2024-09-10T17:52:39.641524+0000","last_unstale":"2024-09-10T17:52:43.549922+0000","last_undegraded":"2024-09-10T17:52:43.549922+0000","last_fullsized":"2024-09-10T17:52:43.549922+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276944+0000","last_change":"2024-09-10T17:52:39.639101+0000","last_active":"2024-09-10T17:52:41.276944+0000","last_peered":"2024-09-10T17:52:41.276944+0000","last_clean":"2024-09-10T17:52:41.276944+0000","last_became_active":"2024-09-10T17:52:39.638816+0000","last_became_peered":"2024-09-10T17:52:39.638816+0000","last_unstale":"2024-09-10T17:52:41.276944+0000","last_undegraded":"2024-09-10T17:52:41.276944+0000","last_fullsized":"2024-09-10T17:52:41.276944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474886+0000","last_change":"2024-09-10T17:52:39.640880+0000","last_active":"2024-09-10T17:52:43.474886+0000","last_peered":"2024-09-10T17:52:43.474886+0000","last_clean":"2024-09-10T17:52:43.474886+0000","last_became_active":"2024-09-10T17:52:39.640599+0000","last_became_peered":"2024-09-10T17:52:39.640599+0000","last_unstale":"2024-09-10T17:52:43.474886+0000","last_undegraded":"2024-09-10T17:52:43.474886+0000","last_fullsized":"2024-09-10T17:52:43.474886+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277110+0000","last_change":"2024-09-10T17:52:39.646904+0000","last_active":"2024-09-10T17:52:41.277110+0000","last_peered":"2024-09-10T17:52:41.277110+0000","last_clean":"2024-09-10T17:52:41.277110+0000","last_became_active":"2024-09-10T17:52:39.646649+0000","last_became_peered":"2024-09-10T17:52:39.646649+0000","last_unstale":"2024-09-10T17:52:41.277110+0000","last_undegraded":"2024-09-10T17:52:41.277110+0000","last_fullsized":"2024-09-10T17:52:41.277110+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277670+0000","last_change":"2024-09-10T17:52:39.651784+0000","last_active":"2024-09-10T17:52:41.277670+0000","last_peered":"2024-09-10T17:52:41.277670+0000","last_clean":"2024-09-10T17:52:41.277670+0000","last_became_active":"2024-09-10T17:52:39.651519+0000","last_became_peered":"2024-09-10T17:52:39.651519+0000","last_unstale":"2024-09-10T17:52:41.277670+0000","last_undegraded":"2024-09-10T17:52:41.277670+0000","last_fullsized":"2024-09-10T17:52:41.277670+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365148+0000","last_change":"2024-09-10T17:52:39.636540+0000","last_active":"2024-09-10T17:52:41.365148+0000","last_peered":"2024-09-10T17:52:41.365148+0000","last_clean":"2024-09-10T17:52:41.365148+0000","last_became_active":"2024-09-10T17:52:39.636034+0000","last_became_peered":"2024-09-10T17:52:39.636034+0000","last_unstale":"2024-09-10T17:52:41.365148+0000","last_undegraded":"2024-09-10T17:52:41.365148+0000","last_fullsized":"2024-09-10T17:52:41.365148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372393+0000","last_change":"2024-09-10T17:52:39.642764+0000","last_active":"2024-09-10T17:52:41.372393+0000","last_peered":"2024-09-10T17:52:41.372393+0000","last_clean":"2024-09-10T17:52:41.372393+0000","last_became_active":"2024-09-10T17:52:39.642454+0000","last_became_peered":"2024-09-10T17:52:39.642454+0000","last_unstale":"2024-09-10T17:52:41.372393+0000","last_undegraded":"2024-09-10T17:52:41.372393+0000","last_fullsized":"2024-09-10T17:52:41.372393+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371826+0000","last_change":"2024-09-10T17:52:39.644420+0000","last_active":"2024-09-10T17:52:41.371826+0000","last_peered":"2024-09-10T17:52:41.371826+0000","last_clean":"2024-09-10T17:52:41.371826+0000","last_became_active":"2024-09-10T17:52:39.644155+0000","last_became_peered":"2024-09-10T17:52:39.644155+0000","last_unstale":"2024-09-10T17:52:41.371826+0000","last_undegraded":"2024-09-10T17:52:41.371826+0000","last_fullsized":"2024-09-10T17:52:41.371826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277103+0000","last_change":"2024-09-10T17:52:39.631587+0000","last_active":"2024-09-10T17:52:41.277103+0000","last_peered":"2024-09-10T17:52:41.277103+0000","last_clean":"2024-09-10T17:52:41.277103+0000","last_became_active":"2024-09-10T17:52:39.631291+0000","last_became_peered":"2024-09-10T17:52:39.631291+0000","last_unstale":"2024-09-10T17:52:41.277103+0000","last_undegraded":"2024-09-10T17:52:41.277103+0000","last_fullsized":"2024-09-10T17:52:41.277103+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277944+0000","last_change":"2024-09-10T17:52:39.635863+0000","last_active":"2024-09-10T17:52:41.277944+0000","last_peered":"2024-09-10T17:52:41.277944+0000","last_clean":"2024-09-10T17:52:41.277944+0000","last_became_active":"2024-09-10T17:52:39.635566+0000","last_became_peered":"2024-09-10T17:52:39.635566+0000","last_unstale":"2024-09-10T17:52:41.277944+0000","last_undegraded":"2024-09-10T17:52:41.277944+0000","last_fullsized":"2024-09-10T17:52:41.277944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549867+0000","last_change":"2024-09-10T17:52:39.641463+0000","last_active":"2024-09-10T17:52:43.549867+0000","last_peered":"2024-09-10T17:52:43.549867+0000","last_clean":"2024-09-10T17:52:43.549867+0000","last_became_active":"2024-09-10T17:52:39.640887+0000","last_became_peered":"2024-09-10T17:52:39.640887+0000","last_unstale":"2024-09-10T17:52:43.549867+0000","last_undegraded":"2024-09-10T17:52:43.549867+0000","last_fullsized":"2024-09-10T17:52:43.549867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277186+0000","last_change":"2024-09-10T17:52:39.648810+0000","last_active":"2024-09-10T17:52:41.277186+0000","last_peered":"2024-09-10T17:52:41.277186+0000","last_clean":"2024-09-10T17:52:41.277186+0000","last_became_active":"2024-09-10T17:52:39.648476+0000","last_became_peered":"2024-09-10T17:52:39.648476+0000","last_unstale":"2024-09-10T17:52:41.277186+0000","last_undegraded":"2024-09-10T17:52:41.277186+0000","last_fullsized":"2024-09-10T17:52:41.277186+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549974+0000","last_change":"2024-09-10T17:52:39.643794+0000","last_active":"2024-09-10T17:52:43.549974+0000","last_peered":"2024-09-10T17:52:43.549974+0000","last_clean":"2024-09-10T17:52:43.549974+0000","last_became_active":"2024-09-10T17:52:39.643540+0000","last_became_peered":"2024-09-10T17:52:39.643540+0000","last_unstale":"2024-09-10T17:52:43.549974+0000","last_undegraded":"2024-09-10T17:52:43.549974+0000","last_fullsized":"2024-09-10T17:52:43.549974+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371359+0000","last_change":"2024-09-10T17:52:39.650553+0000","last_active":"2024-09-10T17:52:41.371359+0000","last_peered":"2024-09-10T17:52:41.371359+0000","last_clean":"2024-09-10T17:52:41.371359+0000","last_became_active":"2024-09-10T17:52:39.650207+0000","last_became_peered":"2024-09-10T17:52:39.650207+0000","last_unstale":"2024-09-10T17:52:41.371359+0000","last_undegraded":"2024-09-10T17:52:41.371359+0000","last_fullsized":"2024-09-10T17:52:41.371359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474921+0000","last_change":"2024-09-10T17:52:39.641442+0000","last_active":"2024-09-10T17:52:43.474921+0000","last_peered":"2024-09-10T17:52:43.474921+0000","last_clean":"2024-09-10T17:52:43.474921+0000","last_became_active":"2024-09-10T17:52:39.641158+0000","last_became_peered":"2024-09-10T17:52:39.641158+0000","last_unstale":"2024-09-10T17:52:43.474921+0000","last_undegraded":"2024-09-10T17:52:43.474921+0000","last_fullsized":"2024-09-10T17:52:43.474921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549949+0000","last_change":"2024-09-10T17:52:39.644997+0000","last_active":"2024-09-10T17:52:43.549949+0000","last_peered":"2024-09-10T17:52:43.549949+0000","last_clean":"2024-09-10T17:52:43.549949+0000","last_became_active":"2024-09-10T17:52:39.643999+0000","last_became_peered":"2024-09-10T17:52:39.643999+0000","last_unstale":"2024-09-10T17:52:43.549949+0000","last_undegraded":"2024-09-10T17:52:43.549949+0000","last_fullsized":"2024-09-10T17:52:43.549949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277113+0000","last_change":"2024-09-10T17:52:39.632927+0000","last_active":"2024-09-10T17:52:41.277113+0000","last_peered":"2024-09-10T17:52:41.277113+0000","last_clean":"2024-09-10T17:52:41.277113+0000","last_became_active":"2024-09-10T17:52:39.632680+0000","last_became_peered":"2024-09-10T17:52:39.632680+0000","last_unstale":"2024-09-10T17:52:41.277113+0000","last_undegraded":"2024-09-10T17:52:41.277113+0000","last_fullsized":"2024-09-10T17:52:41.277113+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278032+0000","last_change":"2024-09-10T17:52:39.648726+0000","last_active":"2024-09-10T17:52:41.278032+0000","last_peered":"2024-09-10T17:52:41.278032+0000","last_clean":"2024-09-10T17:52:41.278032+0000","last_became_active":"2024-09-10T17:52:39.648448+0000","last_became_peered":"2024-09-10T17:52:39.648448+0000","last_unstale":"2024-09-10T17:52:41.278032+0000","last_undegraded":"2024-09-10T17:52:41.278032+0000","last_fullsized":"2024-09-10T17:52:41.278032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364473+0000","last_change":"2024-09-10T17:52:39.634918+0000","last_active":"2024-09-10T17:52:41.364473+0000","last_peered":"2024-09-10T17:52:41.364473+0000","last_clean":"2024-09-10T17:52:41.364473+0000","last_became_active":"2024-09-10T17:52:39.634622+0000","last_became_peered":"2024-09-10T17:52:39.634622+0000","last_unstale":"2024-09-10T17:52:41.364473+0000","last_undegraded":"2024-09-10T17:52:41.364473+0000","last_fullsized":"2024-09-10T17:52:41.364473+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372695+0000","last_change":"2024-09-10T17:52:39.642111+0000","last_active":"2024-09-10T17:52:41.372695+0000","last_peered":"2024-09-10T17:52:41.372695+0000","last_clean":"2024-09-10T17:52:41.372695+0000","last_became_active":"2024-09-10T17:52:39.641786+0000","last_became_peered":"2024-09-10T17:52:39.641786+0000","last_unstale":"2024-09-10T17:52:41.372695+0000","last_undegraded":"2024-09-10T17:52:41.372695+0000","last_fullsized":"2024-09-10T17:52:41.372695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.505826+0000","last_change":"2024-09-10T17:52:39.632064+0000","last_active":"2024-09-10T17:52:43.505826+0000","last_peered":"2024-09-10T17:52:43.505826+0000","last_clean":"2024-09-10T17:52:43.505826+0000","last_became_active":"2024-09-10T17:52:39.631529+0000","last_became_peered":"2024-09-10T17:52:39.631529+0000","last_unstale":"2024-09-10T17:52:43.505826+0000","last_undegraded":"2024-09-10T17:52:43.505826+0000","last_fullsized":"2024-09-10T17:52:43.505826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.374800+0000","last_change":"2024-09-10T17:52:36.192274+0000","last_active":"2024-09-10T17:52:41.374800+0000","last_peered":"2024-09-10T17:52:41.374800+0000","last_clean":"2024-09-10T17:52:41.374800+0000","last_became_active":"2024-09-10T17:52:36.191998+0000","last_became_peered":"2024-09-10T17:52:36.191998+0000","last_unstale":"2024-09-10T17:52:41.374800+0000","last_undegraded":"2024-09-10T17:52:41.374800+0000","last_fullsized":"2024-09-10T17:52:41.374800+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:52:41.371824+0000","last_change":"2024-09-10T17:53:04.094581+0000","last_active":"2024-09-10T17:53:04.094581+0000","last_peered":"2024-09-10T17:52:41.371824+0000","last_clean":"2024-09-10T17:52:41.371824+0000","last_became_active":"2024-09-10T17:52:39.632048+0000","last_became_peered":"2024-09-10T17:52:39.632048+0000","last_unstale":"2024-09-10T17:52:41.371824+0000","last_undegraded":"2024-09-10T17:52:41.371824+0000","last_fullsized":"2024-09-10T17:52:41.371824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"65'1","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371664+0000","last_change":"2024-09-10T17:52:36.190911+0000","last_active":"2024-09-10T17:52:41.371664+0000","last_peered":"2024-09-10T17:52:41.371664+0000","last_clean":"2024-09-10T17:52:41.371664+0000","last_became_active":"2024-09-10T17:52:36.190437+0000","last_became_peered":"2024-09-10T17:52:36.190437+0000","last_unstale":"2024-09-10T17:52:41.371664+0000","last_undegraded":"2024-09-10T17:52:41.371664+0000","last_fullsized":"2024-09-10T17:52:41.371664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364868+0000","last_change":"2024-09-10T17:52:36.192952+0000","last_active":"2024-09-10T17:52:41.364868+0000","last_peered":"2024-09-10T17:52:41.364868+0000","last_clean":"2024-09-10T17:52:41.364868+0000","last_became_active":"2024-09-10T17:52:36.192199+0000","last_became_peered":"2024-09-10T17:52:36.192199+0000","last_unstale":"2024-09-10T17:52:41.364868+0000","last_undegraded":"2024-09-10T17:52:41.364868+0000","last_fullsized":"2024-09-10T17:52:41.364868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549835+0000","last_change":"2024-09-10T17:52:39.646604+0000","last_active":"2024-09-10T17:52:43.549835+0000","last_peered":"2024-09-10T17:52:43.549835+0000","last_clean":"2024-09-10T17:52:43.549835+0000","last_became_active":"2024-09-10T17:52:39.646321+0000","last_became_peered":"2024-09-10T17:52:39.646321+0000","last_unstale":"2024-09-10T17:52:43.549835+0000","last_undegraded":"2024-09-10T17:52:43.549835+0000","last_fullsized":"2024-09-10T17:52:43.549835+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277187+0000","last_change":"2024-09-10T17:52:36.194360+0000","last_active":"2024-09-10T17:52:41.277187+0000","last_peered":"2024-09-10T17:52:41.277187+0000","last_clean":"2024-09-10T17:52:41.277187+0000","last_became_active":"2024-09-10T17:52:36.194106+0000","last_became_peered":"2024-09-10T17:52:36.194106+0000","last_unstale":"2024-09-10T17:52:41.277187+0000","last_undegraded":"2024-09-10T17:52:41.277187+0000","last_fullsized":"2024-09-10T17:52:41.277187+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474875+0000","last_change":"2024-09-10T17:52:39.637886+0000","last_active":"2024-09-10T17:52:43.474875+0000","last_peered":"2024-09-10T17:52:43.474875+0000","last_clean":"2024-09-10T17:52:43.474875+0000","last_became_active":"2024-09-10T17:52:39.637615+0000","last_became_peered":"2024-09-10T17:52:39.637615+0000","last_unstale":"2024-09-10T17:52:43.474875+0000","last_undegraded":"2024-09-10T17:52:43.474875+0000","last_fullsized":"2024-09-10T17:52:43.474875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277922+0000","last_change":"2024-09-10T17:52:36.193200+0000","last_active":"2024-09-10T17:52:41.277922+0000","last_peered":"2024-09-10T17:52:41.277922+0000","last_clean":"2024-09-10T17:52:41.277922+0000","last_became_active":"2024-09-10T17:52:36.192223+0000","last_became_peered":"2024-09-10T17:52:36.192223+0000","last_unstale":"2024-09-10T17:52:41.277922+0000","last_undegraded":"2024-09-10T17:52:41.277922+0000","last_fullsized":"2024-09-10T17:52:41.277922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277517+0000","last_change":"2024-09-10T17:52:39.646338+0000","last_active":"2024-09-10T17:52:41.277517+0000","last_peered":"2024-09-10T17:52:41.277517+0000","last_clean":"2024-09-10T17:52:41.277517+0000","last_became_active":"2024-09-10T17:52:39.645661+0000","last_became_peered":"2024-09-10T17:52:39.645661+0000","last_unstale":"2024-09-10T17:52:41.277517+0000","last_undegraded":"2024-09-10T17:52:41.277517+0000","last_fullsized":"2024-09-10T17:52:41.277517+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277757+0000","last_change":"2024-09-10T17:52:36.192408+0000","last_active":"2024-09-10T17:52:41.277757+0000","last_peered":"2024-09-10T17:52:41.277757+0000","last_clean":"2024-09-10T17:52:41.277757+0000","last_became_active":"2024-09-10T17:52:36.192132+0000","last_became_peered":"2024-09-10T17:52:36.192132+0000","last_unstale":"2024-09-10T17:52:41.277757+0000","last_undegraded":"2024-09-10T17:52:41.277757+0000","last_fullsized":"2024-09-10T17:52:41.277757+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277484+0000","last_change":"2024-09-10T17:52:39.641531+0000","last_active":"2024-09-10T17:52:41.277484+0000","last_peered":"2024-09-10T17:52:41.277484+0000","last_clean":"2024-09-10T17:52:41.277484+0000","last_became_active":"2024-09-10T17:52:39.639958+0000","last_became_peered":"2024-09-10T17:52:39.639958+0000","last_unstale":"2024-09-10T17:52:41.277484+0000","last_undegraded":"2024-09-10T17:52:41.277484+0000","last_fullsized":"2024-09-10T17:52:41.277484+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"65'3","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378343+0000","last_change":"2024-09-10T17:52:36.188432+0000","last_active":"2024-09-10T17:52:41.378343+0000","last_peered":"2024-09-10T17:52:41.378343+0000","last_clean":"2024-09-10T17:52:41.378343+0000","last_became_active":"2024-09-10T17:52:36.188019+0000","last_became_peered":"2024-09-10T17:52:36.188019+0000","last_unstale":"2024-09-10T17:52:41.378343+0000","last_undegraded":"2024-09-10T17:52:41.378343+0000","last_fullsized":"2024-09-10T17:52:41.378343+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.505864+0000","last_change":"2024-09-10T17:52:39.642140+0000","last_active":"2024-09-10T17:52:43.505864+0000","last_peered":"2024-09-10T17:52:43.505864+0000","last_clean":"2024-09-10T17:52:43.505864+0000","last_became_active":"2024-09-10T17:52:39.641201+0000","last_became_peered":"2024-09-10T17:52:39.641201+0000","last_unstale":"2024-09-10T17:52:43.505864+0000","last_undegraded":"2024-09-10T17:52:43.505864+0000","last_fullsized":"2024-09-10T17:52:43.505864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'6","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378744+0000","last_change":"2024-09-10T17:52:36.190637+0000","last_active":"2024-09-10T17:52:41.378744+0000","last_peered":"2024-09-10T17:52:41.378744+0000","last_clean":"2024-09-10T17:52:41.378744+0000","last_became_active":"2024-09-10T17:52:36.190315+0000","last_became_peered":"2024-09-10T17:52:36.190315+0000","last_unstale":"2024-09-10T17:52:41.378744+0000","last_undegraded":"2024-09-10T17:52:41.378744+0000","last_fullsized":"2024-09-10T17:52:41.378744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371472+0000","last_change":"2024-09-10T17:52:39.647058+0000","last_active":"2024-09-10T17:52:41.371472+0000","last_peered":"2024-09-10T17:52:41.371472+0000","last_clean":"2024-09-10T17:52:41.371472+0000","last_became_active":"2024-09-10T17:52:39.646127+0000","last_became_peered":"2024-09-10T17:52:39.646127+0000","last_unstale":"2024-09-10T17:52:41.371472+0000","last_undegraded":"2024-09-10T17:52:41.371472+0000","last_fullsized":"2024-09-10T17:52:41.371472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377709+0000","last_change":"2024-09-10T17:52:36.197133+0000","last_active":"2024-09-10T17:52:41.377709+0000","last_peered":"2024-09-10T17:52:41.377709+0000","last_clean":"2024-09-10T17:52:41.377709+0000","last_became_active":"2024-09-10T17:52:36.196798+0000","last_became_peered":"2024-09-10T17:52:36.196798+0000","last_unstale":"2024-09-10T17:52:41.377709+0000","last_undegraded":"2024-09-10T17:52:41.377709+0000","last_fullsized":"2024-09-10T17:52:41.377709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276995+0000","last_change":"2024-09-10T17:52:39.632963+0000","last_active":"2024-09-10T17:52:41.276995+0000","last_peered":"2024-09-10T17:52:41.276995+0000","last_clean":"2024-09-10T17:52:41.276995+0000","last_became_active":"2024-09-10T17:52:39.632648+0000","last_became_peered":"2024-09-10T17:52:39.632648+0000","last_unstale":"2024-09-10T17:52:41.276995+0000","last_undegraded":"2024-09-10T17:52:41.276995+0000","last_fullsized":"2024-09-10T17:52:41.276995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278098+0000","last_change":"2024-09-10T17:52:36.190919+0000","last_active":"2024-09-10T17:52:41.278098+0000","last_peered":"2024-09-10T17:52:41.278098+0000","last_clean":"2024-09-10T17:52:41.278098+0000","last_became_active":"2024-09-10T17:52:36.190637+0000","last_became_peered":"2024-09-10T17:52:36.190637+0000","last_unstale":"2024-09-10T17:52:41.278098+0000","last_undegraded":"2024-09-10T17:52:41.278098+0000","last_fullsized":"2024-09-10T17:52:41.278098+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372252+0000","last_change":"2024-09-10T17:52:39.637441+0000","last_active":"2024-09-10T17:52:41.372252+0000","last_peered":"2024-09-10T17:52:41.372252+0000","last_clean":"2024-09-10T17:52:41.372252+0000","last_became_active":"2024-09-10T17:52:39.636759+0000","last_became_peered":"2024-09-10T17:52:39.636759+0000","last_unstale":"2024-09-10T17:52:41.372252+0000","last_undegraded":"2024-09-10T17:52:41.372252+0000","last_fullsized":"2024-09-10T17:52:41.372252+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278198+0000","last_change":"2024-09-10T17:52:36.192102+0000","last_active":"2024-09-10T17:52:41.278198+0000","last_peered":"2024-09-10T17:52:41.278198+0000","last_clean":"2024-09-10T17:52:41.278198+0000","last_became_active":"2024-09-10T17:52:36.191743+0000","last_became_peered":"2024-09-10T17:52:36.191743+0000","last_unstale":"2024-09-10T17:52:41.278198+0000","last_undegraded":"2024-09-10T17:52:41.278198+0000","last_fullsized":"2024-09-10T17:52:41.278198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370594+0000","last_change":"2024-09-10T17:52:39.640124+0000","last_active":"2024-09-10T17:52:41.370594+0000","last_peered":"2024-09-10T17:52:41.370594+0000","last_clean":"2024-09-10T17:52:41.370594+0000","last_became_active":"2024-09-10T17:52:39.639840+0000","last_became_peered":"2024-09-10T17:52:39.639840+0000","last_unstale":"2024-09-10T17:52:41.370594+0000","last_undegraded":"2024-09-10T17:52:41.370594+0000","last_fullsized":"2024-09-10T17:52:41.370594+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"65'8","reported_seq":24,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377982+0000","last_change":"2024-09-10T17:52:36.191246+0000","last_active":"2024-09-10T17:52:41.377982+0000","last_peered":"2024-09-10T17:52:41.377982+0000","last_clean":"2024-09-10T17:52:41.377982+0000","last_became_active":"2024-09-10T17:52:36.190916+0000","last_became_peered":"2024-09-10T17:52:36.190916+0000","last_unstale":"2024-09-10T17:52:41.377982+0000","last_undegraded":"2024-09-10T17:52:41.377982+0000","last_fullsized":"2024-09-10T17:52:41.377982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370667+0000","last_change":"2024-09-10T17:52:39.647318+0000","last_active":"2024-09-10T17:52:41.370667+0000","last_peered":"2024-09-10T17:52:41.370667+0000","last_clean":"2024-09-10T17:52:41.370667+0000","last_became_active":"2024-09-10T17:52:39.647020+0000","last_became_peered":"2024-09-10T17:52:39.647020+0000","last_unstale":"2024-09-10T17:52:41.370667+0000","last_undegraded":"2024-09-10T17:52:41.370667+0000","last_fullsized":"2024-09-10T17:52:41.370667+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.375054+0000","last_change":"2024-09-10T17:52:36.194263+0000","last_active":"2024-09-10T17:52:41.375054+0000","last_peered":"2024-09-10T17:52:41.375054+0000","last_clean":"2024-09-10T17:52:41.375054+0000","last_became_active":"2024-09-10T17:52:36.193894+0000","last_became_peered":"2024-09-10T17:52:36.193894+0000","last_unstale":"2024-09-10T17:52:41.375054+0000","last_undegraded":"2024-09-10T17:52:41.375054+0000","last_fullsized":"2024-09-10T17:52:41.375054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":2,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:52:39.630290+0000","last_change":"2024-09-10T17:53:04.094609+0000","last_active":"2024-09-10T17:52:38.613602+0000","last_peered":"2024-09-10T17:52:38.613602+0000","last_clean":"2024-09-10T17:52:38.613602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T17:52:39.630290+0000","last_undegraded":"2024-09-10T17:52:39.630290+0000","last_fullsized":"2024-09-10T17:52:39.630290+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"65'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372888+0000","last_change":"2024-09-10T17:52:36.191958+0000","last_active":"2024-09-10T17:52:41.372888+0000","last_peered":"2024-09-10T17:52:41.372888+0000","last_clean":"2024-09-10T17:52:41.372888+0000","last_became_active":"2024-09-10T17:52:36.191684+0000","last_became_peered":"2024-09-10T17:52:36.191684+0000","last_unstale":"2024-09-10T17:52:41.372888+0000","last_undegraded":"2024-09-10T17:52:41.372888+0000","last_fullsized":"2024-09-10T17:52:41.372888+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371982+0000","last_change":"2024-09-10T17:52:39.648857+0000","last_active":"2024-09-10T17:52:41.371982+0000","last_peered":"2024-09-10T17:52:41.371982+0000","last_clean":"2024-09-10T17:52:41.371982+0000","last_became_active":"2024-09-10T17:52:39.648574+0000","last_became_peered":"2024-09-10T17:52:39.648574+0000","last_unstale":"2024-09-10T17:52:41.371982+0000","last_undegraded":"2024-09-10T17:52:41.371982+0000","last_fullsized":"2024-09-10T17:52:41.371982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377793+0000","last_change":"2024-09-10T17:52:36.185952+0000","last_active":"2024-09-10T17:52:41.377793+0000","last_peered":"2024-09-10T17:52:41.377793+0000","last_clean":"2024-09-10T17:52:41.377793+0000","last_became_active":"2024-09-10T17:52:36.184643+0000","last_became_peered":"2024-09-10T17:52:36.184643+0000","last_unstale":"2024-09-10T17:52:41.377793+0000","last_undegraded":"2024-09-10T17:52:41.377793+0000","last_fullsized":"2024-09-10T17:52:41.377793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278385+0000","last_change":"2024-09-10T17:52:39.651773+0000","last_active":"2024-09-10T17:52:41.278385+0000","last_peered":"2024-09-10T17:52:41.278385+0000","last_clean":"2024-09-10T17:52:41.278385+0000","last_became_active":"2024-09-10T17:52:39.650072+0000","last_became_peered":"2024-09-10T17:52:39.650072+0000","last_unstale":"2024-09-10T17:52:41.278385+0000","last_undegraded":"2024-09-10T17:52:41.278385+0000","last_fullsized":"2024-09-10T17:52:41.278385+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365074+0000","last_change":"2024-09-10T17:52:36.191363+0000","last_active":"2024-09-10T17:52:41.365074+0000","last_peered":"2024-09-10T17:52:41.365074+0000","last_clean":"2024-09-10T17:52:41.365074+0000","last_became_active":"2024-09-10T17:52:36.190976+0000","last_became_peered":"2024-09-10T17:52:36.190976+0000","last_unstale":"2024-09-10T17:52:41.365074+0000","last_undegraded":"2024-09-10T17:52:41.365074+0000","last_fullsized":"2024-09-10T17:52:41.365074+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371484+0000","last_change":"2024-09-10T17:52:39.643612+0000","last_active":"2024-09-10T17:52:41.371484+0000","last_peered":"2024-09-10T17:52:41.371484+0000","last_clean":"2024-09-10T17:52:41.371484+0000","last_became_active":"2024-09-10T17:52:39.643274+0000","last_became_peered":"2024-09-10T17:52:39.643274+0000","last_unstale":"2024-09-10T17:52:41.371484+0000","last_undegraded":"2024-09-10T17:52:41.371484+0000","last_fullsized":"2024-09-10T17:52:41.371484+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":224,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370785+0000","last_change":"2024-09-10T17:52:12.719807+0000","last_active":"2024-09-10T17:52:41.370785+0000","last_peered":"2024-09-10T17:52:41.370785+0000","last_clean":"2024-09-10T17:52:41.370785+0000","last_became_active":"2024-09-10T17:52:12.719452+0000","last_became_peered":"2024-09-10T17:52:12.719452+0000","last_unstale":"2024-09-10T17:52:41.370785+0000","last_undegraded":"2024-09-10T17:52:41.370785+0000","last_fullsized":"2024-09-10T17:52:41.370785+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_clean_scrub_stamp":"2024-09-10T17:50:14.084625+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277418+0000","last_change":"2024-09-10T17:52:36.195598+0000","last_active":"2024-09-10T17:52:41.277418+0000","last_peered":"2024-09-10T17:52:41.277418+0000","last_clean":"2024-09-10T17:52:41.277418+0000","last_became_active":"2024-09-10T17:52:36.195203+0000","last_became_peered":"2024-09-10T17:52:36.195203+0000","last_unstale":"2024-09-10T17:52:41.277418+0000","last_undegraded":"2024-09-10T17:52:41.277418+0000","last_fullsized":"2024-09-10T17:52:41.277418+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549894+0000","last_change":"2024-09-10T17:52:39.644934+0000","last_active":"2024-09-10T17:52:43.549894+0000","last_peered":"2024-09-10T17:52:43.549894+0000","last_clean":"2024-09-10T17:52:43.549894+0000","last_became_active":"2024-09-10T17:52:39.644205+0000","last_became_peered":"2024-09-10T17:52:39.644205+0000","last_unstale":"2024-09-10T17:52:43.549894+0000","last_undegraded":"2024-09-10T17:52:43.549894+0000","last_fullsized":"2024-09-10T17:52:43.549894+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:52:36.194691+0000","last_change":"2024-09-10T17:53:04.094544+0000","last_active":"2024-09-10T17:52:35.173921+0000","last_peered":"2024-09-10T17:52:35.173921+0000","last_clean":"2024-09-10T17:52:35.173921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T17:52:36.194691+0000","last_undegraded":"2024-09-10T17:52:36.194691+0000","last_fullsized":"2024-09-10T17:52:36.194691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276764+0000","last_change":"2024-09-10T17:52:39.632868+0000","last_active":"2024-09-10T17:52:41.276764+0000","last_peered":"2024-09-10T17:52:41.276764+0000","last_clean":"2024-09-10T17:52:41.276764+0000","last_became_active":"2024-09-10T17:52:39.632549+0000","last_became_peered":"2024-09-10T17:52:39.632549+0000","last_unstale":"2024-09-10T17:52:41.276764+0000","last_undegraded":"2024-09-10T17:52:41.276764+0000","last_fullsized":"2024-09-10T17:52:41.276764+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364641+0000","last_change":"2024-09-10T17:52:36.190567+0000","last_active":"2024-09-10T17:52:41.364641+0000","last_peered":"2024-09-10T17:52:41.364641+0000","last_clean":"2024-09-10T17:52:41.364641+0000","last_became_active":"2024-09-10T17:52:36.190261+0000","last_became_peered":"2024-09-10T17:52:36.190261+0000","last_unstale":"2024-09-10T17:52:41.364641+0000","last_undegraded":"2024-09-10T17:52:41.364641+0000","last_fullsized":"2024-09-10T17:52:41.364641+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474858+0000","last_change":"2024-09-10T17:52:39.638839+0000","last_active":"2024-09-10T17:52:43.474858+0000","last_peered":"2024-09-10T17:52:43.474858+0000","last_clean":"2024-09-10T17:52:43.474858+0000","last_became_active":"2024-09-10T17:52:39.638567+0000","last_became_peered":"2024-09-10T17:52:39.638567+0000","last_unstale":"2024-09-10T17:52:43.474858+0000","last_undegraded":"2024-09-10T17:52:43.474858+0000","last_fullsized":"2024-09-10T17:52:43.474858+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278166+0000","last_change":"2024-09-10T17:52:36.193278+0000","last_active":"2024-09-10T17:52:41.278166+0000","last_peered":"2024-09-10T17:52:41.278166+0000","last_clean":"2024-09-10T17:52:41.278166+0000","last_became_active":"2024-09-10T17:52:36.192979+0000","last_became_peered":"2024-09-10T17:52:36.192979+0000","last_unstale":"2024-09-10T17:52:41.278166+0000","last_undegraded":"2024-09-10T17:52:41.278166+0000","last_fullsized":"2024-09-10T17:52:41.278166+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.505841+0000","last_change":"2024-09-10T17:52:39.640516+0000","last_active":"2024-09-10T17:52:43.505841+0000","last_peered":"2024-09-10T17:52:43.505841+0000","last_clean":"2024-09-10T17:52:43.505841+0000","last_became_active":"2024-09-10T17:52:39.639996+0000","last_became_peered":"2024-09-10T17:52:39.639996+0000","last_unstale":"2024-09-10T17:52:43.505841+0000","last_undegraded":"2024-09-10T17:52:43.505841+0000","last_fullsized":"2024-09-10T17:52:43.505841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371978+0000","last_change":"2024-09-10T17:52:36.193781+0000","last_active":"2024-09-10T17:52:41.371978+0000","last_peered":"2024-09-10T17:52:41.371978+0000","last_clean":"2024-09-10T17:52:41.371978+0000","last_became_active":"2024-09-10T17:52:36.193487+0000","last_became_peered":"2024-09-10T17:52:36.193487+0000","last_unstale":"2024-09-10T17:52:41.371978+0000","last_undegraded":"2024-09-10T17:52:41.371978+0000","last_fullsized":"2024-09-10T17:52:41.371978+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278070+0000","last_change":"2024-09-10T17:52:39.647909+0000","last_active":"2024-09-10T17:52:41.278070+0000","last_peered":"2024-09-10T17:52:41.278070+0000","last_clean":"2024-09-10T17:52:41.278070+0000","last_became_active":"2024-09-10T17:52:39.647630+0000","last_became_peered":"2024-09-10T17:52:39.647630+0000","last_unstale":"2024-09-10T17:52:41.278070+0000","last_undegraded":"2024-09-10T17:52:41.278070+0000","last_fullsized":"2024-09-10T17:52:41.278070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372859+0000","last_change":"2024-09-10T17:52:36.200712+0000","last_active":"2024-09-10T17:52:41.372859+0000","last_peered":"2024-09-10T17:52:41.372859+0000","last_clean":"2024-09-10T17:52:41.372859+0000","last_became_active":"2024-09-10T17:52:36.200402+0000","last_became_peered":"2024-09-10T17:52:36.200402+0000","last_unstale":"2024-09-10T17:52:41.372859+0000","last_undegraded":"2024-09-10T17:52:41.372859+0000","last_fullsized":"2024-09-10T17:52:41.372859+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474907+0000","last_change":"2024-09-10T17:52:39.643072+0000","last_active":"2024-09-10T17:52:43.474907+0000","last_peered":"2024-09-10T17:52:43.474907+0000","last_clean":"2024-09-10T17:52:43.474907+0000","last_became_active":"2024-09-10T17:52:39.642792+0000","last_became_peered":"2024-09-10T17:52:39.642792+0000","last_unstale":"2024-09-10T17:52:43.474907+0000","last_undegraded":"2024-09-10T17:52:43.474907+0000","last_fullsized":"2024-09-10T17:52:43.474907+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:42.033729+0000","last_change":"2024-09-10T17:52:36.192033+0000","last_active":"2024-09-10T17:52:42.033729+0000","last_peered":"2024-09-10T17:52:42.033729+0000","last_clean":"2024-09-10T17:52:42.033729+0000","last_became_active":"2024-09-10T17:52:36.191662+0000","last_became_peered":"2024-09-10T17:52:36.191662+0000","last_unstale":"2024-09-10T17:52:42.033729+0000","last_undegraded":"2024-09-10T17:52:42.033729+0000","last_fullsized":"2024-09-10T17:52:42.033729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549987+0000","last_change":"2024-09-10T17:52:39.635594+0000","last_active":"2024-09-10T17:52:43.549987+0000","last_peered":"2024-09-10T17:52:43.549987+0000","last_clean":"2024-09-10T17:52:43.549987+0000","last_became_active":"2024-09-10T17:52:39.635320+0000","last_became_peered":"2024-09-10T17:52:39.635320+0000","last_unstale":"2024-09-10T17:52:43.549987+0000","last_undegraded":"2024-09-10T17:52:43.549987+0000","last_fullsized":"2024-09-10T17:52:43.549987+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378632+0000","last_change":"2024-09-10T17:52:36.194453+0000","last_active":"2024-09-10T17:52:41.378632+0000","last_peered":"2024-09-10T17:52:41.378632+0000","last_clean":"2024-09-10T17:52:41.378632+0000","last_became_active":"2024-09-10T17:52:36.194107+0000","last_became_peered":"2024-09-10T17:52:36.194107+0000","last_unstale":"2024-09-10T17:52:41.378632+0000","last_undegraded":"2024-09-10T17:52:41.378632+0000","last_fullsized":"2024-09-10T17:52:41.378632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277361+0000","last_change":"2024-09-10T17:52:39.631701+0000","last_active":"2024-09-10T17:52:41.277361+0000","last_peered":"2024-09-10T17:52:41.277361+0000","last_clean":"2024-09-10T17:52:41.277361+0000","last_became_active":"2024-09-10T17:52:39.631299+0000","last_became_peered":"2024-09-10T17:52:39.631299+0000","last_unstale":"2024-09-10T17:52:41.277361+0000","last_undegraded":"2024-09-10T17:52:41.277361+0000","last_fullsized":"2024-09-10T17:52:41.277361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370684+0000","last_change":"2024-09-10T17:52:36.200196+0000","last_active":"2024-09-10T17:52:41.370684+0000","last_peered":"2024-09-10T17:52:41.370684+0000","last_clean":"2024-09-10T17:52:41.370684+0000","last_became_active":"2024-09-10T17:52:36.199847+0000","last_became_peered":"2024-09-10T17:52:36.199847+0000","last_unstale":"2024-09-10T17:52:41.370684+0000","last_undegraded":"2024-09-10T17:52:41.370684+0000","last_fullsized":"2024-09-10T17:52:41.370684+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.505803+0000","last_change":"2024-09-10T17:52:39.643274+0000","last_active":"2024-09-10T17:52:43.505803+0000","last_peered":"2024-09-10T17:52:43.505803+0000","last_clean":"2024-09-10T17:52:43.505803+0000","last_became_active":"2024-09-10T17:52:39.643016+0000","last_became_peered":"2024-09-10T17:52:39.643016+0000","last_unstale":"2024-09-10T17:52:43.505803+0000","last_undegraded":"2024-09-10T17:52:43.505803+0000","last_fullsized":"2024-09-10T17:52:43.505803+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372345+0000","last_change":"2024-09-10T17:52:36.195088+0000","last_active":"2024-09-10T17:52:41.372345+0000","last_peered":"2024-09-10T17:52:41.372345+0000","last_clean":"2024-09-10T17:52:41.372345+0000","last_became_active":"2024-09-10T17:52:36.194698+0000","last_became_peered":"2024-09-10T17:52:36.194698+0000","last_unstale":"2024-09-10T17:52:41.372345+0000","last_undegraded":"2024-09-10T17:52:41.372345+0000","last_fullsized":"2024-09-10T17:52:41.372345+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549849+0000","last_change":"2024-09-10T17:52:39.643179+0000","last_active":"2024-09-10T17:52:43.549849+0000","last_peered":"2024-09-10T17:52:43.549849+0000","last_clean":"2024-09-10T17:52:43.549849+0000","last_became_active":"2024-09-10T17:52:39.642643+0000","last_became_peered":"2024-09-10T17:52:39.642643+0000","last_unstale":"2024-09-10T17:52:43.549849+0000","last_undegraded":"2024-09-10T17:52:43.549849+0000","last_fullsized":"2024-09-10T17:52:43.549849+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372285+0000","last_change":"2024-09-10T17:52:36.188755+0000","last_active":"2024-09-10T17:52:41.372285+0000","last_peered":"2024-09-10T17:52:41.372285+0000","last_clean":"2024-09-10T17:52:41.372285+0000","last_became_active":"2024-09-10T17:52:36.188465+0000","last_became_peered":"2024-09-10T17:52:36.188465+0000","last_unstale":"2024-09-10T17:52:41.372285+0000","last_undegraded":"2024-09-10T17:52:41.372285+0000","last_fullsized":"2024-09-10T17:52:41.372285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549932+0000","last_change":"2024-09-10T17:52:39.635509+0000","last_active":"2024-09-10T17:52:43.549932+0000","last_peered":"2024-09-10T17:52:43.549932+0000","last_clean":"2024-09-10T17:52:43.549932+0000","last_became_active":"2024-09-10T17:52:39.635118+0000","last_became_peered":"2024-09-10T17:52:39.635118+0000","last_unstale":"2024-09-10T17:52:43.549932+0000","last_undegraded":"2024-09-10T17:52:43.549932+0000","last_fullsized":"2024-09-10T17:52:43.549932+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"65'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.376017+0000","last_change":"2024-09-10T17:52:36.200921+0000","last_active":"2024-09-10T17:52:41.376017+0000","last_peered":"2024-09-10T17:52:41.376017+0000","last_clean":"2024-09-10T17:52:41.376017+0000","last_became_active":"2024-09-10T17:52:36.200153+0000","last_became_peered":"2024-09-10T17:52:36.200153+0000","last_unstale":"2024-09-10T17:52:41.376017+0000","last_undegraded":"2024-09-10T17:52:41.376017+0000","last_fullsized":"2024-09-10T17:52:41.376017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371318+0000","last_change":"2024-09-10T17:52:39.643628+0000","last_active":"2024-09-10T17:52:41.371318+0000","last_peered":"2024-09-10T17:52:41.371318+0000","last_clean":"2024-09-10T17:52:41.371318+0000","last_became_active":"2024-09-10T17:52:39.643355+0000","last_became_peered":"2024-09-10T17:52:39.643355+0000","last_unstale":"2024-09-10T17:52:41.371318+0000","last_undegraded":"2024-09-10T17:52:41.371318+0000","last_fullsized":"2024-09-10T17:52:41.371318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277976+0000","last_change":"2024-09-10T17:52:39.652448+0000","last_active":"2024-09-10T17:52:41.277976+0000","last_peered":"2024-09-10T17:52:41.277976+0000","last_clean":"2024-09-10T17:52:41.277976+0000","last_became_active":"2024-09-10T17:52:39.652164+0000","last_became_peered":"2024-09-10T17:52:39.652164+0000","last_unstale":"2024-09-10T17:52:41.277976+0000","last_undegraded":"2024-09-10T17:52:41.277976+0000","last_fullsized":"2024-09-10T17:52:41.277976+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"65'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377925+0000","last_change":"2024-09-10T17:52:36.200230+0000","last_active":"2024-09-10T17:52:41.377925+0000","last_peered":"2024-09-10T17:52:41.377925+0000","last_clean":"2024-09-10T17:52:41.377925+0000","last_became_active":"2024-09-10T17:52:36.199765+0000","last_became_peered":"2024-09-10T17:52:36.199765+0000","last_unstale":"2024-09-10T17:52:41.377925+0000","last_undegraded":"2024-09-10T17:52:41.377925+0000","last_fullsized":"2024-09-10T17:52:41.377925+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278300+0000","last_change":"2024-09-10T17:52:39.652608+0000","last_active":"2024-09-10T17:52:41.278300+0000","last_peered":"2024-09-10T17:52:41.278300+0000","last_clean":"2024-09-10T17:52:41.278300+0000","last_became_active":"2024-09-10T17:52:39.652354+0000","last_became_peered":"2024-09-10T17:52:39.652354+0000","last_unstale":"2024-09-10T17:52:41.278300+0000","last_undegraded":"2024-09-10T17:52:41.278300+0000","last_fullsized":"2024-09-10T17:52:41.278300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"65'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378498+0000","last_change":"2024-09-10T17:52:36.200731+0000","last_active":"2024-09-10T17:52:41.378498+0000","last_peered":"2024-09-10T17:52:41.378498+0000","last_clean":"2024-09-10T17:52:41.378498+0000","last_became_active":"2024-09-10T17:52:36.200429+0000","last_became_peered":"2024-09-10T17:52:36.200429+0000","last_unstale":"2024-09-10T17:52:41.378498+0000","last_undegraded":"2024-09-10T17:52:41.378498+0000","last_fullsized":"2024-09-10T17:52:41.378498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277454+0000","last_change":"2024-09-10T17:52:39.640232+0000","last_active":"2024-09-10T17:52:41.277454+0000","last_peered":"2024-09-10T17:52:41.277454+0000","last_clean":"2024-09-10T17:52:41.277454+0000","last_became_active":"2024-09-10T17:52:39.639462+0000","last_became_peered":"2024-09-10T17:52:39.639462+0000","last_unstale":"2024-09-10T17:52:41.277454+0000","last_undegraded":"2024-09-10T17:52:41.277454+0000","last_fullsized":"2024-09-10T17:52:41.277454+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.374580+0000","last_change":"2024-09-10T17:52:36.190257+0000","last_active":"2024-09-10T17:52:41.374580+0000","last_peered":"2024-09-10T17:52:41.374580+0000","last_clean":"2024-09-10T17:52:41.374580+0000","last_became_active":"2024-09-10T17:52:36.189957+0000","last_became_peered":"2024-09-10T17:52:36.189957+0000","last_unstale":"2024-09-10T17:52:41.374580+0000","last_undegraded":"2024-09-10T17:52:41.374580+0000","last_fullsized":"2024-09-10T17:52:41.374580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549959+0000","last_change":"2024-09-10T17:52:39.636289+0000","last_active":"2024-09-10T17:52:43.549959+0000","last_peered":"2024-09-10T17:52:43.549959+0000","last_clean":"2024-09-10T17:52:43.549959+0000","last_became_active":"2024-09-10T17:52:39.635894+0000","last_became_peered":"2024-09-10T17:52:39.635894+0000","last_unstale":"2024-09-10T17:52:43.549959+0000","last_undegraded":"2024-09-10T17:52:43.549959+0000","last_fullsized":"2024-09-10T17:52:43.549959+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"65'4","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378444+0000","last_change":"2024-09-10T17:52:36.194542+0000","last_active":"2024-09-10T17:52:41.378444+0000","last_peered":"2024-09-10T17:52:41.378444+0000","last_clean":"2024-09-10T17:52:41.378444+0000","last_became_active":"2024-09-10T17:52:36.194232+0000","last_became_peered":"2024-09-10T17:52:36.194232+0000","last_unstale":"2024-09-10T17:52:41.378444+0000","last_undegraded":"2024-09-10T17:52:41.378444+0000","last_fullsized":"2024-09-10T17:52:41.378444+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":7086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233996,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28260,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716892,"statfs":{"total":95995035648,"available":95966097408,"internally_reserved":0,"allocated":1269760,"data_stored":874875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495634,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32352,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712800,"statfs":{"total":95995035648,"available":95961907200,"internally_reserved":0,"allocated":1257472,"data_stored":868933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55900000000000005}]},{"osd":1,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.64000000000000001}]},{"osd":2,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.502},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54300000000000004}]},{"osd":4,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.379},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.39700000000000002}]},{"osd":5,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757270,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713380,"statfs":{"total":95995035648,"available":95962501120,"internally_reserved":0,"allocated":663552,"data_stored":278374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":1,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.438}]},{"osd":3,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51100000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.315},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.498}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":4,"up_from":30,"seq":128849018906,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27680,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717472,"statfs":{"total":95995035648,"available":95966691328,"internally_reserved":0,"allocated":675840,"data_stored":278313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.627}]},{"osd":1,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.377}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182432,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27688,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":679936,"data_stored":279273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.439,"5min":0.433,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:52:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411365,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717480,"statfs":{"total":95995035648,"available":95966699520,"internally_reserved":0,"allocated":667648,"data_stored":283961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.29199999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.5}]},{"osd":4,"last update":"Tue Sep 10 17:52:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.753},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.69499999999999995}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.78100000000000003}]},{"osd":6,"last update":"Tue Sep 10 17:52:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717476,"statfs":{"total":95995035648,"available":95966695424,"internally_reserved":0,"allocated":671744,"data_stored":283848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.37,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.216,"15min":0.216},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.28899999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.58999999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42099999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40200000000000002,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.435},{"interface":"front","average":{"1min":0.503,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:53:01 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.71699999999999997,"15min":0.60299999999999998},"min":{"1min":0.47899999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":15.68,"5min":15.68,"15min":15.68},"last":0.62},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.73999999999999999}]},{"osd":5,"last update":"Tue Sep 10 17:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.77900000000000003}]},{"osd":6,"last update":"Tue Sep 10 17:52:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.629},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32360,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712792,"statfs":{"total":95995035648,"available":95961899008,"internally_reserved":0,"allocated":1269760,"data_stored":868701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 17:52:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54400000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.373,"15min":0.36199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.309}]},{"osd":2,"last update":"Tue Sep 10 17:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38500000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61499999999999999,"5min":0.62,"15min":0.62},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Tue Sep 10 17:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55700000000000005}]},{"osd":5,"last update":"Tue Sep 10 17:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.52400000000000002},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.907,"5min":7.907,"15min":7.907},"last":0.48699999999999999}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.497},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9450000000000003,"5min":7.9450000000000003,"15min":7.9450000000000003},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T17:53:04.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T17:53:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:05.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:05 smithi012 ceph-mon[27356]: osdmap e67: 8 total, 8 up, 8 in 2024-09-10T17:53:05.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:05 smithi012 ceph-mon[27356]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:05.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:05 smithi012 ceph-mon[27356]: pgmap v208: 97 pgs: 5 peering, 92 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:05.524 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:05 smithi012 ceph-mon[37454]: osdmap e67: 8 total, 8 up, 8 in 2024-09-10T17:53:05.524 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:05 smithi012 ceph-mon[37454]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:05.524 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:05 smithi012 ceph-mon[37454]: pgmap v208: 97 pgs: 5 peering, 92 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:05.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:05 smithi089 ceph-mon[31467]: osdmap e67: 8 total, 8 up, 8 in 2024-09-10T17:53:05.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:05 smithi089 ceph-mon[31467]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:05.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:05 smithi089 ceph-mon[31467]: pgmap v208: 97 pgs: 5 peering, 92 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:07.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:53:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T17:53:07.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:07 smithi012 ceph-mon[27356]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:07.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:07 smithi012 ceph-mon[27356]: pgmap v209: 97 pgs: 5 peering, 92 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:07.532 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:07 smithi012 ceph-mon[37454]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:07.532 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:07 smithi012 ceph-mon[37454]: pgmap v209: 97 pgs: 5 peering, 92 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:07.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:07 smithi089 ceph-mon[31467]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:07.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:07 smithi089 ceph-mon[31467]: pgmap v209: 97 pgs: 5 peering, 92 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:07.783 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-10T17:53:05.096316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":235460,"kb_used_data":6988,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749725756,"statfs":{"total":767960285184,"available":767719174144,"internally_reserved":0,"allocated":7155712,"data_stored":4016278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":233819706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001809"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371926+0000","last_change":"2024-09-10T17:52:39.637199+0000","last_active":"2024-09-10T17:52:41.371926+0000","last_peered":"2024-09-10T17:52:41.371926+0000","last_clean":"2024-09-10T17:52:41.371926+0000","last_became_active":"2024-09-10T17:52:39.636912+0000","last_became_peered":"2024-09-10T17:52:39.636912+0000","last_unstale":"2024-09-10T17:52:41.371926+0000","last_undegraded":"2024-09-10T17:52:41.371926+0000","last_fullsized":"2024-09-10T17:52:41.371926+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474946+0000","last_change":"2024-09-10T17:52:39.640227+0000","last_active":"2024-09-10T17:52:43.474946+0000","last_peered":"2024-09-10T17:52:43.474946+0000","last_clean":"2024-09-10T17:52:43.474946+0000","last_became_active":"2024-09-10T17:52:39.639677+0000","last_became_peered":"2024-09-10T17:52:39.639677+0000","last_unstale":"2024-09-10T17:52:43.474946+0000","last_undegraded":"2024-09-10T17:52:43.474946+0000","last_fullsized":"2024-09-10T17:52:43.474946+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277368+0000","last_change":"2024-09-10T17:52:39.634939+0000","last_active":"2024-09-10T17:52:41.277368+0000","last_peered":"2024-09-10T17:52:41.277368+0000","last_clean":"2024-09-10T17:52:41.277368+0000","last_became_active":"2024-09-10T17:52:39.634668+0000","last_became_peered":"2024-09-10T17:52:39.634668+0000","last_unstale":"2024-09-10T17:52:41.277368+0000","last_undegraded":"2024-09-10T17:52:41.277368+0000","last_fullsized":"2024-09-10T17:52:41.277368+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278327+0000","last_change":"2024-09-10T17:52:39.652074+0000","last_active":"2024-09-10T17:52:41.278327+0000","last_peered":"2024-09-10T17:52:41.278327+0000","last_clean":"2024-09-10T17:52:41.278327+0000","last_became_active":"2024-09-10T17:52:39.651762+0000","last_became_peered":"2024-09-10T17:52:39.651762+0000","last_unstale":"2024-09-10T17:52:41.278327+0000","last_undegraded":"2024-09-10T17:52:41.278327+0000","last_fullsized":"2024-09-10T17:52:41.278327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371119+0000","last_change":"2024-09-10T17:52:39.637379+0000","last_active":"2024-09-10T17:52:41.371119+0000","last_peered":"2024-09-10T17:52:41.371119+0000","last_clean":"2024-09-10T17:52:41.371119+0000","last_became_active":"2024-09-10T17:52:39.636370+0000","last_became_peered":"2024-09-10T17:52:39.636370+0000","last_unstale":"2024-09-10T17:52:41.371119+0000","last_undegraded":"2024-09-10T17:52:41.371119+0000","last_fullsized":"2024-09-10T17:52:41.371119+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277862+0000","last_change":"2024-09-10T17:52:39.646980+0000","last_active":"2024-09-10T17:52:41.277862+0000","last_peered":"2024-09-10T17:52:41.277862+0000","last_clean":"2024-09-10T17:52:41.277862+0000","last_became_active":"2024-09-10T17:52:39.645786+0000","last_became_peered":"2024-09-10T17:52:39.645786+0000","last_unstale":"2024-09-10T17:52:41.277862+0000","last_undegraded":"2024-09-10T17:52:41.277862+0000","last_fullsized":"2024-09-10T17:52:41.277862+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:53:03.189906+0000","last_change":"2024-09-10T17:53:03.190102+0000","last_active":"2024-09-10T17:53:03.189906+0000","last_peered":"2024-09-10T17:52:41.370506+0000","last_clean":"2024-09-10T17:52:41.370506+0000","last_became_active":"2024-09-10T17:52:39.647752+0000","last_became_peered":"2024-09-10T17:52:39.647752+0000","last_unstale":"2024-09-10T17:53:03.189906+0000","last_undegraded":"2024-09-10T17:53:03.189906+0000","last_fullsized":"2024-09-10T17:53:03.189906+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:37:01.340312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3,4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549804+0000","last_change":"2024-09-10T17:52:39.645147+0000","last_active":"2024-09-10T17:52:43.549804+0000","last_peered":"2024-09-10T17:52:43.549804+0000","last_clean":"2024-09-10T17:52:43.549804+0000","last_became_active":"2024-09-10T17:52:39.644853+0000","last_became_peered":"2024-09-10T17:52:39.644853+0000","last_unstale":"2024-09-10T17:52:43.549804+0000","last_undegraded":"2024-09-10T17:52:43.549804+0000","last_fullsized":"2024-09-10T17:52:43.549804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372219+0000","last_change":"2024-09-10T17:52:39.643055+0000","last_active":"2024-09-10T17:52:41.372219+0000","last_peered":"2024-09-10T17:52:41.372219+0000","last_clean":"2024-09-10T17:52:41.372219+0000","last_became_active":"2024-09-10T17:52:39.642731+0000","last_became_peered":"2024-09-10T17:52:39.642731+0000","last_unstale":"2024-09-10T17:52:41.372219+0000","last_undegraded":"2024-09-10T17:52:41.372219+0000","last_fullsized":"2024-09-10T17:52:41.372219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371230+0000","last_change":"2024-09-10T17:52:39.642693+0000","last_active":"2024-09-10T17:52:41.371230+0000","last_peered":"2024-09-10T17:52:41.371230+0000","last_clean":"2024-09-10T17:52:41.371230+0000","last_became_active":"2024-09-10T17:52:39.642404+0000","last_became_peered":"2024-09-10T17:52:39.642404+0000","last_unstale":"2024-09-10T17:52:41.371230+0000","last_undegraded":"2024-09-10T17:52:41.371230+0000","last_fullsized":"2024-09-10T17:52:41.371230+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371449+0000","last_change":"2024-09-10T17:52:39.641932+0000","last_active":"2024-09-10T17:52:41.371449+0000","last_peered":"2024-09-10T17:52:41.371449+0000","last_clean":"2024-09-10T17:52:41.371449+0000","last_became_active":"2024-09-10T17:52:39.641622+0000","last_became_peered":"2024-09-10T17:52:39.641622+0000","last_unstale":"2024-09-10T17:52:41.371449+0000","last_undegraded":"2024-09-10T17:52:41.371449+0000","last_fullsized":"2024-09-10T17:52:41.371449+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":2,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:52:39.622507+0000","last_change":"2024-09-10T17:53:04.094591+0000","last_active":"2024-09-10T17:52:38.613602+0000","last_peered":"2024-09-10T17:52:38.613602+0000","last_clean":"2024-09-10T17:52:38.613602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T17:52:39.622507+0000","last_undegraded":"2024-09-10T17:52:39.622507+0000","last_fullsized":"2024-09-10T17:52:39.622507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549922+0000","last_change":"2024-09-10T17:52:39.642786+0000","last_active":"2024-09-10T17:52:43.549922+0000","last_peered":"2024-09-10T17:52:43.549922+0000","last_clean":"2024-09-10T17:52:43.549922+0000","last_became_active":"2024-09-10T17:52:39.641524+0000","last_became_peered":"2024-09-10T17:52:39.641524+0000","last_unstale":"2024-09-10T17:52:43.549922+0000","last_undegraded":"2024-09-10T17:52:43.549922+0000","last_fullsized":"2024-09-10T17:52:43.549922+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276944+0000","last_change":"2024-09-10T17:52:39.639101+0000","last_active":"2024-09-10T17:52:41.276944+0000","last_peered":"2024-09-10T17:52:41.276944+0000","last_clean":"2024-09-10T17:52:41.276944+0000","last_became_active":"2024-09-10T17:52:39.638816+0000","last_became_peered":"2024-09-10T17:52:39.638816+0000","last_unstale":"2024-09-10T17:52:41.276944+0000","last_undegraded":"2024-09-10T17:52:41.276944+0000","last_fullsized":"2024-09-10T17:52:41.276944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474886+0000","last_change":"2024-09-10T17:52:39.640880+0000","last_active":"2024-09-10T17:52:43.474886+0000","last_peered":"2024-09-10T17:52:43.474886+0000","last_clean":"2024-09-10T17:52:43.474886+0000","last_became_active":"2024-09-10T17:52:39.640599+0000","last_became_peered":"2024-09-10T17:52:39.640599+0000","last_unstale":"2024-09-10T17:52:43.474886+0000","last_undegraded":"2024-09-10T17:52:43.474886+0000","last_fullsized":"2024-09-10T17:52:43.474886+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277110+0000","last_change":"2024-09-10T17:52:39.646904+0000","last_active":"2024-09-10T17:52:41.277110+0000","last_peered":"2024-09-10T17:52:41.277110+0000","last_clean":"2024-09-10T17:52:41.277110+0000","last_became_active":"2024-09-10T17:52:39.646649+0000","last_became_peered":"2024-09-10T17:52:39.646649+0000","last_unstale":"2024-09-10T17:52:41.277110+0000","last_undegraded":"2024-09-10T17:52:41.277110+0000","last_fullsized":"2024-09-10T17:52:41.277110+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277670+0000","last_change":"2024-09-10T17:52:39.651784+0000","last_active":"2024-09-10T17:52:41.277670+0000","last_peered":"2024-09-10T17:52:41.277670+0000","last_clean":"2024-09-10T17:52:41.277670+0000","last_became_active":"2024-09-10T17:52:39.651519+0000","last_became_peered":"2024-09-10T17:52:39.651519+0000","last_unstale":"2024-09-10T17:52:41.277670+0000","last_undegraded":"2024-09-10T17:52:41.277670+0000","last_fullsized":"2024-09-10T17:52:41.277670+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365148+0000","last_change":"2024-09-10T17:52:39.636540+0000","last_active":"2024-09-10T17:52:41.365148+0000","last_peered":"2024-09-10T17:52:41.365148+0000","last_clean":"2024-09-10T17:52:41.365148+0000","last_became_active":"2024-09-10T17:52:39.636034+0000","last_became_peered":"2024-09-10T17:52:39.636034+0000","last_unstale":"2024-09-10T17:52:41.365148+0000","last_undegraded":"2024-09-10T17:52:41.365148+0000","last_fullsized":"2024-09-10T17:52:41.365148+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372393+0000","last_change":"2024-09-10T17:52:39.642764+0000","last_active":"2024-09-10T17:52:41.372393+0000","last_peered":"2024-09-10T17:52:41.372393+0000","last_clean":"2024-09-10T17:52:41.372393+0000","last_became_active":"2024-09-10T17:52:39.642454+0000","last_became_peered":"2024-09-10T17:52:39.642454+0000","last_unstale":"2024-09-10T17:52:41.372393+0000","last_undegraded":"2024-09-10T17:52:41.372393+0000","last_fullsized":"2024-09-10T17:52:41.372393+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371826+0000","last_change":"2024-09-10T17:52:39.644420+0000","last_active":"2024-09-10T17:52:41.371826+0000","last_peered":"2024-09-10T17:52:41.371826+0000","last_clean":"2024-09-10T17:52:41.371826+0000","last_became_active":"2024-09-10T17:52:39.644155+0000","last_became_peered":"2024-09-10T17:52:39.644155+0000","last_unstale":"2024-09-10T17:52:41.371826+0000","last_undegraded":"2024-09-10T17:52:41.371826+0000","last_fullsized":"2024-09-10T17:52:41.371826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277103+0000","last_change":"2024-09-10T17:52:39.631587+0000","last_active":"2024-09-10T17:52:41.277103+0000","last_peered":"2024-09-10T17:52:41.277103+0000","last_clean":"2024-09-10T17:52:41.277103+0000","last_became_active":"2024-09-10T17:52:39.631291+0000","last_became_peered":"2024-09-10T17:52:39.631291+0000","last_unstale":"2024-09-10T17:52:41.277103+0000","last_undegraded":"2024-09-10T17:52:41.277103+0000","last_fullsized":"2024-09-10T17:52:41.277103+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277944+0000","last_change":"2024-09-10T17:52:39.635863+0000","last_active":"2024-09-10T17:52:41.277944+0000","last_peered":"2024-09-10T17:52:41.277944+0000","last_clean":"2024-09-10T17:52:41.277944+0000","last_became_active":"2024-09-10T17:52:39.635566+0000","last_became_peered":"2024-09-10T17:52:39.635566+0000","last_unstale":"2024-09-10T17:52:41.277944+0000","last_undegraded":"2024-09-10T17:52:41.277944+0000","last_fullsized":"2024-09-10T17:52:41.277944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549867+0000","last_change":"2024-09-10T17:52:39.641463+0000","last_active":"2024-09-10T17:52:43.549867+0000","last_peered":"2024-09-10T17:52:43.549867+0000","last_clean":"2024-09-10T17:52:43.549867+0000","last_became_active":"2024-09-10T17:52:39.640887+0000","last_became_peered":"2024-09-10T17:52:39.640887+0000","last_unstale":"2024-09-10T17:52:43.549867+0000","last_undegraded":"2024-09-10T17:52:43.549867+0000","last_fullsized":"2024-09-10T17:52:43.549867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277186+0000","last_change":"2024-09-10T17:52:39.648810+0000","last_active":"2024-09-10T17:52:41.277186+0000","last_peered":"2024-09-10T17:52:41.277186+0000","last_clean":"2024-09-10T17:52:41.277186+0000","last_became_active":"2024-09-10T17:52:39.648476+0000","last_became_peered":"2024-09-10T17:52:39.648476+0000","last_unstale":"2024-09-10T17:52:41.277186+0000","last_undegraded":"2024-09-10T17:52:41.277186+0000","last_fullsized":"2024-09-10T17:52:41.277186+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549974+0000","last_change":"2024-09-10T17:52:39.643794+0000","last_active":"2024-09-10T17:52:43.549974+0000","last_peered":"2024-09-10T17:52:43.549974+0000","last_clean":"2024-09-10T17:52:43.549974+0000","last_became_active":"2024-09-10T17:52:39.643540+0000","last_became_peered":"2024-09-10T17:52:39.643540+0000","last_unstale":"2024-09-10T17:52:43.549974+0000","last_undegraded":"2024-09-10T17:52:43.549974+0000","last_fullsized":"2024-09-10T17:52:43.549974+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371359+0000","last_change":"2024-09-10T17:52:39.650553+0000","last_active":"2024-09-10T17:52:41.371359+0000","last_peered":"2024-09-10T17:52:41.371359+0000","last_clean":"2024-09-10T17:52:41.371359+0000","last_became_active":"2024-09-10T17:52:39.650207+0000","last_became_peered":"2024-09-10T17:52:39.650207+0000","last_unstale":"2024-09-10T17:52:41.371359+0000","last_undegraded":"2024-09-10T17:52:41.371359+0000","last_fullsized":"2024-09-10T17:52:41.371359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474921+0000","last_change":"2024-09-10T17:52:39.641442+0000","last_active":"2024-09-10T17:52:43.474921+0000","last_peered":"2024-09-10T17:52:43.474921+0000","last_clean":"2024-09-10T17:52:43.474921+0000","last_became_active":"2024-09-10T17:52:39.641158+0000","last_became_peered":"2024-09-10T17:52:39.641158+0000","last_unstale":"2024-09-10T17:52:43.474921+0000","last_undegraded":"2024-09-10T17:52:43.474921+0000","last_fullsized":"2024-09-10T17:52:43.474921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549949+0000","last_change":"2024-09-10T17:52:39.644997+0000","last_active":"2024-09-10T17:52:43.549949+0000","last_peered":"2024-09-10T17:52:43.549949+0000","last_clean":"2024-09-10T17:52:43.549949+0000","last_became_active":"2024-09-10T17:52:39.643999+0000","last_became_peered":"2024-09-10T17:52:39.643999+0000","last_unstale":"2024-09-10T17:52:43.549949+0000","last_undegraded":"2024-09-10T17:52:43.549949+0000","last_fullsized":"2024-09-10T17:52:43.549949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277113+0000","last_change":"2024-09-10T17:52:39.632927+0000","last_active":"2024-09-10T17:52:41.277113+0000","last_peered":"2024-09-10T17:52:41.277113+0000","last_clean":"2024-09-10T17:52:41.277113+0000","last_became_active":"2024-09-10T17:52:39.632680+0000","last_became_peered":"2024-09-10T17:52:39.632680+0000","last_unstale":"2024-09-10T17:52:41.277113+0000","last_undegraded":"2024-09-10T17:52:41.277113+0000","last_fullsized":"2024-09-10T17:52:41.277113+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278032+0000","last_change":"2024-09-10T17:52:39.648726+0000","last_active":"2024-09-10T17:52:41.278032+0000","last_peered":"2024-09-10T17:52:41.278032+0000","last_clean":"2024-09-10T17:52:41.278032+0000","last_became_active":"2024-09-10T17:52:39.648448+0000","last_became_peered":"2024-09-10T17:52:39.648448+0000","last_unstale":"2024-09-10T17:52:41.278032+0000","last_undegraded":"2024-09-10T17:52:41.278032+0000","last_fullsized":"2024-09-10T17:52:41.278032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364473+0000","last_change":"2024-09-10T17:52:39.634918+0000","last_active":"2024-09-10T17:52:41.364473+0000","last_peered":"2024-09-10T17:52:41.364473+0000","last_clean":"2024-09-10T17:52:41.364473+0000","last_became_active":"2024-09-10T17:52:39.634622+0000","last_became_peered":"2024-09-10T17:52:39.634622+0000","last_unstale":"2024-09-10T17:52:41.364473+0000","last_undegraded":"2024-09-10T17:52:41.364473+0000","last_fullsized":"2024-09-10T17:52:41.364473+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372695+0000","last_change":"2024-09-10T17:52:39.642111+0000","last_active":"2024-09-10T17:52:41.372695+0000","last_peered":"2024-09-10T17:52:41.372695+0000","last_clean":"2024-09-10T17:52:41.372695+0000","last_became_active":"2024-09-10T17:52:39.641786+0000","last_became_peered":"2024-09-10T17:52:39.641786+0000","last_unstale":"2024-09-10T17:52:41.372695+0000","last_undegraded":"2024-09-10T17:52:41.372695+0000","last_fullsized":"2024-09-10T17:52:41.372695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.505826+0000","last_change":"2024-09-10T17:52:39.632064+0000","last_active":"2024-09-10T17:52:43.505826+0000","last_peered":"2024-09-10T17:52:43.505826+0000","last_clean":"2024-09-10T17:52:43.505826+0000","last_became_active":"2024-09-10T17:52:39.631529+0000","last_became_peered":"2024-09-10T17:52:39.631529+0000","last_unstale":"2024-09-10T17:52:43.505826+0000","last_undegraded":"2024-09-10T17:52:43.505826+0000","last_fullsized":"2024-09-10T17:52:43.505826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.374800+0000","last_change":"2024-09-10T17:52:36.192274+0000","last_active":"2024-09-10T17:52:41.374800+0000","last_peered":"2024-09-10T17:52:41.374800+0000","last_clean":"2024-09-10T17:52:41.374800+0000","last_became_active":"2024-09-10T17:52:36.191998+0000","last_became_peered":"2024-09-10T17:52:36.191998+0000","last_unstale":"2024-09-10T17:52:41.374800+0000","last_undegraded":"2024-09-10T17:52:41.374800+0000","last_fullsized":"2024-09-10T17:52:41.374800+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:52:41.371824+0000","last_change":"2024-09-10T17:53:04.094581+0000","last_active":"2024-09-10T17:53:04.094581+0000","last_peered":"2024-09-10T17:52:41.371824+0000","last_clean":"2024-09-10T17:52:41.371824+0000","last_became_active":"2024-09-10T17:52:39.632048+0000","last_became_peered":"2024-09-10T17:52:39.632048+0000","last_unstale":"2024-09-10T17:52:41.371824+0000","last_undegraded":"2024-09-10T17:52:41.371824+0000","last_fullsized":"2024-09-10T17:52:41.371824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"65'1","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371664+0000","last_change":"2024-09-10T17:52:36.190911+0000","last_active":"2024-09-10T17:52:41.371664+0000","last_peered":"2024-09-10T17:52:41.371664+0000","last_clean":"2024-09-10T17:52:41.371664+0000","last_became_active":"2024-09-10T17:52:36.190437+0000","last_became_peered":"2024-09-10T17:52:36.190437+0000","last_unstale":"2024-09-10T17:52:41.371664+0000","last_undegraded":"2024-09-10T17:52:41.371664+0000","last_fullsized":"2024-09-10T17:52:41.371664+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364868+0000","last_change":"2024-09-10T17:52:36.192952+0000","last_active":"2024-09-10T17:52:41.364868+0000","last_peered":"2024-09-10T17:52:41.364868+0000","last_clean":"2024-09-10T17:52:41.364868+0000","last_became_active":"2024-09-10T17:52:36.192199+0000","last_became_peered":"2024-09-10T17:52:36.192199+0000","last_unstale":"2024-09-10T17:52:41.364868+0000","last_undegraded":"2024-09-10T17:52:41.364868+0000","last_fullsized":"2024-09-10T17:52:41.364868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549835+0000","last_change":"2024-09-10T17:52:39.646604+0000","last_active":"2024-09-10T17:52:43.549835+0000","last_peered":"2024-09-10T17:52:43.549835+0000","last_clean":"2024-09-10T17:52:43.549835+0000","last_became_active":"2024-09-10T17:52:39.646321+0000","last_became_peered":"2024-09-10T17:52:39.646321+0000","last_unstale":"2024-09-10T17:52:43.549835+0000","last_undegraded":"2024-09-10T17:52:43.549835+0000","last_fullsized":"2024-09-10T17:52:43.549835+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277187+0000","last_change":"2024-09-10T17:52:36.194360+0000","last_active":"2024-09-10T17:52:41.277187+0000","last_peered":"2024-09-10T17:52:41.277187+0000","last_clean":"2024-09-10T17:52:41.277187+0000","last_became_active":"2024-09-10T17:52:36.194106+0000","last_became_peered":"2024-09-10T17:52:36.194106+0000","last_unstale":"2024-09-10T17:52:41.277187+0000","last_undegraded":"2024-09-10T17:52:41.277187+0000","last_fullsized":"2024-09-10T17:52:41.277187+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474875+0000","last_change":"2024-09-10T17:52:39.637886+0000","last_active":"2024-09-10T17:52:43.474875+0000","last_peered":"2024-09-10T17:52:43.474875+0000","last_clean":"2024-09-10T17:52:43.474875+0000","last_became_active":"2024-09-10T17:52:39.637615+0000","last_became_peered":"2024-09-10T17:52:39.637615+0000","last_unstale":"2024-09-10T17:52:43.474875+0000","last_undegraded":"2024-09-10T17:52:43.474875+0000","last_fullsized":"2024-09-10T17:52:43.474875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277922+0000","last_change":"2024-09-10T17:52:36.193200+0000","last_active":"2024-09-10T17:52:41.277922+0000","last_peered":"2024-09-10T17:52:41.277922+0000","last_clean":"2024-09-10T17:52:41.277922+0000","last_became_active":"2024-09-10T17:52:36.192223+0000","last_became_peered":"2024-09-10T17:52:36.192223+0000","last_unstale":"2024-09-10T17:52:41.277922+0000","last_undegraded":"2024-09-10T17:52:41.277922+0000","last_fullsized":"2024-09-10T17:52:41.277922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277517+0000","last_change":"2024-09-10T17:52:39.646338+0000","last_active":"2024-09-10T17:52:41.277517+0000","last_peered":"2024-09-10T17:52:41.277517+0000","last_clean":"2024-09-10T17:52:41.277517+0000","last_became_active":"2024-09-10T17:52:39.645661+0000","last_became_peered":"2024-09-10T17:52:39.645661+0000","last_unstale":"2024-09-10T17:52:41.277517+0000","last_undegraded":"2024-09-10T17:52:41.277517+0000","last_fullsized":"2024-09-10T17:52:41.277517+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277757+0000","last_change":"2024-09-10T17:52:36.192408+0000","last_active":"2024-09-10T17:52:41.277757+0000","last_peered":"2024-09-10T17:52:41.277757+0000","last_clean":"2024-09-10T17:52:41.277757+0000","last_became_active":"2024-09-10T17:52:36.192132+0000","last_became_peered":"2024-09-10T17:52:36.192132+0000","last_unstale":"2024-09-10T17:52:41.277757+0000","last_undegraded":"2024-09-10T17:52:41.277757+0000","last_fullsized":"2024-09-10T17:52:41.277757+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277484+0000","last_change":"2024-09-10T17:52:39.641531+0000","last_active":"2024-09-10T17:52:41.277484+0000","last_peered":"2024-09-10T17:52:41.277484+0000","last_clean":"2024-09-10T17:52:41.277484+0000","last_became_active":"2024-09-10T17:52:39.639958+0000","last_became_peered":"2024-09-10T17:52:39.639958+0000","last_unstale":"2024-09-10T17:52:41.277484+0000","last_undegraded":"2024-09-10T17:52:41.277484+0000","last_fullsized":"2024-09-10T17:52:41.277484+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"65'3","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378343+0000","last_change":"2024-09-10T17:52:36.188432+0000","last_active":"2024-09-10T17:52:41.378343+0000","last_peered":"2024-09-10T17:52:41.378343+0000","last_clean":"2024-09-10T17:52:41.378343+0000","last_became_active":"2024-09-10T17:52:36.188019+0000","last_became_peered":"2024-09-10T17:52:36.188019+0000","last_unstale":"2024-09-10T17:52:41.378343+0000","last_undegraded":"2024-09-10T17:52:41.378343+0000","last_fullsized":"2024-09-10T17:52:41.378343+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.505864+0000","last_change":"2024-09-10T17:52:39.642140+0000","last_active":"2024-09-10T17:52:43.505864+0000","last_peered":"2024-09-10T17:52:43.505864+0000","last_clean":"2024-09-10T17:52:43.505864+0000","last_became_active":"2024-09-10T17:52:39.641201+0000","last_became_peered":"2024-09-10T17:52:39.641201+0000","last_unstale":"2024-09-10T17:52:43.505864+0000","last_undegraded":"2024-09-10T17:52:43.505864+0000","last_fullsized":"2024-09-10T17:52:43.505864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'6","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378744+0000","last_change":"2024-09-10T17:52:36.190637+0000","last_active":"2024-09-10T17:52:41.378744+0000","last_peered":"2024-09-10T17:52:41.378744+0000","last_clean":"2024-09-10T17:52:41.378744+0000","last_became_active":"2024-09-10T17:52:36.190315+0000","last_became_peered":"2024-09-10T17:52:36.190315+0000","last_unstale":"2024-09-10T17:52:41.378744+0000","last_undegraded":"2024-09-10T17:52:41.378744+0000","last_fullsized":"2024-09-10T17:52:41.378744+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371472+0000","last_change":"2024-09-10T17:52:39.647058+0000","last_active":"2024-09-10T17:52:41.371472+0000","last_peered":"2024-09-10T17:52:41.371472+0000","last_clean":"2024-09-10T17:52:41.371472+0000","last_became_active":"2024-09-10T17:52:39.646127+0000","last_became_peered":"2024-09-10T17:52:39.646127+0000","last_unstale":"2024-09-10T17:52:41.371472+0000","last_undegraded":"2024-09-10T17:52:41.371472+0000","last_fullsized":"2024-09-10T17:52:41.371472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377709+0000","last_change":"2024-09-10T17:52:36.197133+0000","last_active":"2024-09-10T17:52:41.377709+0000","last_peered":"2024-09-10T17:52:41.377709+0000","last_clean":"2024-09-10T17:52:41.377709+0000","last_became_active":"2024-09-10T17:52:36.196798+0000","last_became_peered":"2024-09-10T17:52:36.196798+0000","last_unstale":"2024-09-10T17:52:41.377709+0000","last_undegraded":"2024-09-10T17:52:41.377709+0000","last_fullsized":"2024-09-10T17:52:41.377709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276995+0000","last_change":"2024-09-10T17:52:39.632963+0000","last_active":"2024-09-10T17:52:41.276995+0000","last_peered":"2024-09-10T17:52:41.276995+0000","last_clean":"2024-09-10T17:52:41.276995+0000","last_became_active":"2024-09-10T17:52:39.632648+0000","last_became_peered":"2024-09-10T17:52:39.632648+0000","last_unstale":"2024-09-10T17:52:41.276995+0000","last_undegraded":"2024-09-10T17:52:41.276995+0000","last_fullsized":"2024-09-10T17:52:41.276995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278098+0000","last_change":"2024-09-10T17:52:36.190919+0000","last_active":"2024-09-10T17:52:41.278098+0000","last_peered":"2024-09-10T17:52:41.278098+0000","last_clean":"2024-09-10T17:52:41.278098+0000","last_became_active":"2024-09-10T17:52:36.190637+0000","last_became_peered":"2024-09-10T17:52:36.190637+0000","last_unstale":"2024-09-10T17:52:41.278098+0000","last_undegraded":"2024-09-10T17:52:41.278098+0000","last_fullsized":"2024-09-10T17:52:41.278098+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372252+0000","last_change":"2024-09-10T17:52:39.637441+0000","last_active":"2024-09-10T17:52:41.372252+0000","last_peered":"2024-09-10T17:52:41.372252+0000","last_clean":"2024-09-10T17:52:41.372252+0000","last_became_active":"2024-09-10T17:52:39.636759+0000","last_became_peered":"2024-09-10T17:52:39.636759+0000","last_unstale":"2024-09-10T17:52:41.372252+0000","last_undegraded":"2024-09-10T17:52:41.372252+0000","last_fullsized":"2024-09-10T17:52:41.372252+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278198+0000","last_change":"2024-09-10T17:52:36.192102+0000","last_active":"2024-09-10T17:52:41.278198+0000","last_peered":"2024-09-10T17:52:41.278198+0000","last_clean":"2024-09-10T17:52:41.278198+0000","last_became_active":"2024-09-10T17:52:36.191743+0000","last_became_peered":"2024-09-10T17:52:36.191743+0000","last_unstale":"2024-09-10T17:52:41.278198+0000","last_undegraded":"2024-09-10T17:52:41.278198+0000","last_fullsized":"2024-09-10T17:52:41.278198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370594+0000","last_change":"2024-09-10T17:52:39.640124+0000","last_active":"2024-09-10T17:52:41.370594+0000","last_peered":"2024-09-10T17:52:41.370594+0000","last_clean":"2024-09-10T17:52:41.370594+0000","last_became_active":"2024-09-10T17:52:39.639840+0000","last_became_peered":"2024-09-10T17:52:39.639840+0000","last_unstale":"2024-09-10T17:52:41.370594+0000","last_undegraded":"2024-09-10T17:52:41.370594+0000","last_fullsized":"2024-09-10T17:52:41.370594+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"65'8","reported_seq":24,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377982+0000","last_change":"2024-09-10T17:52:36.191246+0000","last_active":"2024-09-10T17:52:41.377982+0000","last_peered":"2024-09-10T17:52:41.377982+0000","last_clean":"2024-09-10T17:52:41.377982+0000","last_became_active":"2024-09-10T17:52:36.190916+0000","last_became_peered":"2024-09-10T17:52:36.190916+0000","last_unstale":"2024-09-10T17:52:41.377982+0000","last_undegraded":"2024-09-10T17:52:41.377982+0000","last_fullsized":"2024-09-10T17:52:41.377982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370667+0000","last_change":"2024-09-10T17:52:39.647318+0000","last_active":"2024-09-10T17:52:41.370667+0000","last_peered":"2024-09-10T17:52:41.370667+0000","last_clean":"2024-09-10T17:52:41.370667+0000","last_became_active":"2024-09-10T17:52:39.647020+0000","last_became_peered":"2024-09-10T17:52:39.647020+0000","last_unstale":"2024-09-10T17:52:41.370667+0000","last_undegraded":"2024-09-10T17:52:41.370667+0000","last_fullsized":"2024-09-10T17:52:41.370667+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.375054+0000","last_change":"2024-09-10T17:52:36.194263+0000","last_active":"2024-09-10T17:52:41.375054+0000","last_peered":"2024-09-10T17:52:41.375054+0000","last_clean":"2024-09-10T17:52:41.375054+0000","last_became_active":"2024-09-10T17:52:36.193894+0000","last_became_peered":"2024-09-10T17:52:36.193894+0000","last_unstale":"2024-09-10T17:52:41.375054+0000","last_undegraded":"2024-09-10T17:52:41.375054+0000","last_fullsized":"2024-09-10T17:52:41.375054+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":2,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:52:39.630290+0000","last_change":"2024-09-10T17:53:04.094609+0000","last_active":"2024-09-10T17:52:38.613602+0000","last_peered":"2024-09-10T17:52:38.613602+0000","last_clean":"2024-09-10T17:52:38.613602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T17:52:39.630290+0000","last_undegraded":"2024-09-10T17:52:39.630290+0000","last_fullsized":"2024-09-10T17:52:39.630290+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"65'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372888+0000","last_change":"2024-09-10T17:52:36.191958+0000","last_active":"2024-09-10T17:52:41.372888+0000","last_peered":"2024-09-10T17:52:41.372888+0000","last_clean":"2024-09-10T17:52:41.372888+0000","last_became_active":"2024-09-10T17:52:36.191684+0000","last_became_peered":"2024-09-10T17:52:36.191684+0000","last_unstale":"2024-09-10T17:52:41.372888+0000","last_undegraded":"2024-09-10T17:52:41.372888+0000","last_fullsized":"2024-09-10T17:52:41.372888+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371982+0000","last_change":"2024-09-10T17:52:39.648857+0000","last_active":"2024-09-10T17:52:41.371982+0000","last_peered":"2024-09-10T17:52:41.371982+0000","last_clean":"2024-09-10T17:52:41.371982+0000","last_became_active":"2024-09-10T17:52:39.648574+0000","last_became_peered":"2024-09-10T17:52:39.648574+0000","last_unstale":"2024-09-10T17:52:41.371982+0000","last_undegraded":"2024-09-10T17:52:41.371982+0000","last_fullsized":"2024-09-10T17:52:41.371982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377793+0000","last_change":"2024-09-10T17:52:36.185952+0000","last_active":"2024-09-10T17:52:41.377793+0000","last_peered":"2024-09-10T17:52:41.377793+0000","last_clean":"2024-09-10T17:52:41.377793+0000","last_became_active":"2024-09-10T17:52:36.184643+0000","last_became_peered":"2024-09-10T17:52:36.184643+0000","last_unstale":"2024-09-10T17:52:41.377793+0000","last_undegraded":"2024-09-10T17:52:41.377793+0000","last_fullsized":"2024-09-10T17:52:41.377793+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278385+0000","last_change":"2024-09-10T17:52:39.651773+0000","last_active":"2024-09-10T17:52:41.278385+0000","last_peered":"2024-09-10T17:52:41.278385+0000","last_clean":"2024-09-10T17:52:41.278385+0000","last_became_active":"2024-09-10T17:52:39.650072+0000","last_became_peered":"2024-09-10T17:52:39.650072+0000","last_unstale":"2024-09-10T17:52:41.278385+0000","last_undegraded":"2024-09-10T17:52:41.278385+0000","last_fullsized":"2024-09-10T17:52:41.278385+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.365074+0000","last_change":"2024-09-10T17:52:36.191363+0000","last_active":"2024-09-10T17:52:41.365074+0000","last_peered":"2024-09-10T17:52:41.365074+0000","last_clean":"2024-09-10T17:52:41.365074+0000","last_became_active":"2024-09-10T17:52:36.190976+0000","last_became_peered":"2024-09-10T17:52:36.190976+0000","last_unstale":"2024-09-10T17:52:41.365074+0000","last_undegraded":"2024-09-10T17:52:41.365074+0000","last_fullsized":"2024-09-10T17:52:41.365074+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371484+0000","last_change":"2024-09-10T17:52:39.643612+0000","last_active":"2024-09-10T17:52:41.371484+0000","last_peered":"2024-09-10T17:52:41.371484+0000","last_clean":"2024-09-10T17:52:41.371484+0000","last_became_active":"2024-09-10T17:52:39.643274+0000","last_became_peered":"2024-09-10T17:52:39.643274+0000","last_unstale":"2024-09-10T17:52:41.371484+0000","last_undegraded":"2024-09-10T17:52:41.371484+0000","last_fullsized":"2024-09-10T17:52:41.371484+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":224,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370785+0000","last_change":"2024-09-10T17:52:12.719807+0000","last_active":"2024-09-10T17:52:41.370785+0000","last_peered":"2024-09-10T17:52:41.370785+0000","last_clean":"2024-09-10T17:52:41.370785+0000","last_became_active":"2024-09-10T17:52:12.719452+0000","last_became_peered":"2024-09-10T17:52:12.719452+0000","last_unstale":"2024-09-10T17:52:41.370785+0000","last_undegraded":"2024-09-10T17:52:41.370785+0000","last_fullsized":"2024-09-10T17:52:41.370785+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_clean_scrub_stamp":"2024-09-10T17:50:14.084625+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277418+0000","last_change":"2024-09-10T17:52:36.195598+0000","last_active":"2024-09-10T17:52:41.277418+0000","last_peered":"2024-09-10T17:52:41.277418+0000","last_clean":"2024-09-10T17:52:41.277418+0000","last_became_active":"2024-09-10T17:52:36.195203+0000","last_became_peered":"2024-09-10T17:52:36.195203+0000","last_unstale":"2024-09-10T17:52:41.277418+0000","last_undegraded":"2024-09-10T17:52:41.277418+0000","last_fullsized":"2024-09-10T17:52:41.277418+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549894+0000","last_change":"2024-09-10T17:52:39.644934+0000","last_active":"2024-09-10T17:52:43.549894+0000","last_peered":"2024-09-10T17:52:43.549894+0000","last_clean":"2024-09-10T17:52:43.549894+0000","last_became_active":"2024-09-10T17:52:39.644205+0000","last_became_peered":"2024-09-10T17:52:39.644205+0000","last_unstale":"2024-09-10T17:52:43.549894+0000","last_undegraded":"2024-09-10T17:52:43.549894+0000","last_fullsized":"2024-09-10T17:52:43.549894+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-10T17:52:36.194691+0000","last_change":"2024-09-10T17:53:04.094544+0000","last_active":"2024-09-10T17:52:35.173921+0000","last_peered":"2024-09-10T17:52:35.173921+0000","last_clean":"2024-09-10T17:52:35.173921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T17:52:36.194691+0000","last_undegraded":"2024-09-10T17:52:36.194691+0000","last_fullsized":"2024-09-10T17:52:36.194691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.276764+0000","last_change":"2024-09-10T17:52:39.632868+0000","last_active":"2024-09-10T17:52:41.276764+0000","last_peered":"2024-09-10T17:52:41.276764+0000","last_clean":"2024-09-10T17:52:41.276764+0000","last_became_active":"2024-09-10T17:52:39.632549+0000","last_became_peered":"2024-09-10T17:52:39.632549+0000","last_unstale":"2024-09-10T17:52:41.276764+0000","last_undegraded":"2024-09-10T17:52:41.276764+0000","last_fullsized":"2024-09-10T17:52:41.276764+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.364641+0000","last_change":"2024-09-10T17:52:36.190567+0000","last_active":"2024-09-10T17:52:41.364641+0000","last_peered":"2024-09-10T17:52:41.364641+0000","last_clean":"2024-09-10T17:52:41.364641+0000","last_became_active":"2024-09-10T17:52:36.190261+0000","last_became_peered":"2024-09-10T17:52:36.190261+0000","last_unstale":"2024-09-10T17:52:41.364641+0000","last_undegraded":"2024-09-10T17:52:41.364641+0000","last_fullsized":"2024-09-10T17:52:41.364641+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474858+0000","last_change":"2024-09-10T17:52:39.638839+0000","last_active":"2024-09-10T17:52:43.474858+0000","last_peered":"2024-09-10T17:52:43.474858+0000","last_clean":"2024-09-10T17:52:43.474858+0000","last_became_active":"2024-09-10T17:52:39.638567+0000","last_became_peered":"2024-09-10T17:52:39.638567+0000","last_unstale":"2024-09-10T17:52:43.474858+0000","last_undegraded":"2024-09-10T17:52:43.474858+0000","last_fullsized":"2024-09-10T17:52:43.474858+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278166+0000","last_change":"2024-09-10T17:52:36.193278+0000","last_active":"2024-09-10T17:52:41.278166+0000","last_peered":"2024-09-10T17:52:41.278166+0000","last_clean":"2024-09-10T17:52:41.278166+0000","last_became_active":"2024-09-10T17:52:36.192979+0000","last_became_peered":"2024-09-10T17:52:36.192979+0000","last_unstale":"2024-09-10T17:52:41.278166+0000","last_undegraded":"2024-09-10T17:52:41.278166+0000","last_fullsized":"2024-09-10T17:52:41.278166+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.505841+0000","last_change":"2024-09-10T17:52:39.640516+0000","last_active":"2024-09-10T17:52:43.505841+0000","last_peered":"2024-09-10T17:52:43.505841+0000","last_clean":"2024-09-10T17:52:43.505841+0000","last_became_active":"2024-09-10T17:52:39.639996+0000","last_became_peered":"2024-09-10T17:52:39.639996+0000","last_unstale":"2024-09-10T17:52:43.505841+0000","last_undegraded":"2024-09-10T17:52:43.505841+0000","last_fullsized":"2024-09-10T17:52:43.505841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371978+0000","last_change":"2024-09-10T17:52:36.193781+0000","last_active":"2024-09-10T17:52:41.371978+0000","last_peered":"2024-09-10T17:52:41.371978+0000","last_clean":"2024-09-10T17:52:41.371978+0000","last_became_active":"2024-09-10T17:52:36.193487+0000","last_became_peered":"2024-09-10T17:52:36.193487+0000","last_unstale":"2024-09-10T17:52:41.371978+0000","last_undegraded":"2024-09-10T17:52:41.371978+0000","last_fullsized":"2024-09-10T17:52:41.371978+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278070+0000","last_change":"2024-09-10T17:52:39.647909+0000","last_active":"2024-09-10T17:52:41.278070+0000","last_peered":"2024-09-10T17:52:41.278070+0000","last_clean":"2024-09-10T17:52:41.278070+0000","last_became_active":"2024-09-10T17:52:39.647630+0000","last_became_peered":"2024-09-10T17:52:39.647630+0000","last_unstale":"2024-09-10T17:52:41.278070+0000","last_undegraded":"2024-09-10T17:52:41.278070+0000","last_fullsized":"2024-09-10T17:52:41.278070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372859+0000","last_change":"2024-09-10T17:52:36.200712+0000","last_active":"2024-09-10T17:52:41.372859+0000","last_peered":"2024-09-10T17:52:41.372859+0000","last_clean":"2024-09-10T17:52:41.372859+0000","last_became_active":"2024-09-10T17:52:36.200402+0000","last_became_peered":"2024-09-10T17:52:36.200402+0000","last_unstale":"2024-09-10T17:52:41.372859+0000","last_undegraded":"2024-09-10T17:52:41.372859+0000","last_fullsized":"2024-09-10T17:52:41.372859+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.474907+0000","last_change":"2024-09-10T17:52:39.643072+0000","last_active":"2024-09-10T17:52:43.474907+0000","last_peered":"2024-09-10T17:52:43.474907+0000","last_clean":"2024-09-10T17:52:43.474907+0000","last_became_active":"2024-09-10T17:52:39.642792+0000","last_became_peered":"2024-09-10T17:52:39.642792+0000","last_unstale":"2024-09-10T17:52:43.474907+0000","last_undegraded":"2024-09-10T17:52:43.474907+0000","last_fullsized":"2024-09-10T17:52:43.474907+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:42.033729+0000","last_change":"2024-09-10T17:52:36.192033+0000","last_active":"2024-09-10T17:52:42.033729+0000","last_peered":"2024-09-10T17:52:42.033729+0000","last_clean":"2024-09-10T17:52:42.033729+0000","last_became_active":"2024-09-10T17:52:36.191662+0000","last_became_peered":"2024-09-10T17:52:36.191662+0000","last_unstale":"2024-09-10T17:52:42.033729+0000","last_undegraded":"2024-09-10T17:52:42.033729+0000","last_fullsized":"2024-09-10T17:52:42.033729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549987+0000","last_change":"2024-09-10T17:52:39.635594+0000","last_active":"2024-09-10T17:52:43.549987+0000","last_peered":"2024-09-10T17:52:43.549987+0000","last_clean":"2024-09-10T17:52:43.549987+0000","last_became_active":"2024-09-10T17:52:39.635320+0000","last_became_peered":"2024-09-10T17:52:39.635320+0000","last_unstale":"2024-09-10T17:52:43.549987+0000","last_undegraded":"2024-09-10T17:52:43.549987+0000","last_fullsized":"2024-09-10T17:52:43.549987+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"65'2","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378632+0000","last_change":"2024-09-10T17:52:36.194453+0000","last_active":"2024-09-10T17:52:41.378632+0000","last_peered":"2024-09-10T17:52:41.378632+0000","last_clean":"2024-09-10T17:52:41.378632+0000","last_became_active":"2024-09-10T17:52:36.194107+0000","last_became_peered":"2024-09-10T17:52:36.194107+0000","last_unstale":"2024-09-10T17:52:41.378632+0000","last_undegraded":"2024-09-10T17:52:41.378632+0000","last_fullsized":"2024-09-10T17:52:41.378632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277361+0000","last_change":"2024-09-10T17:52:39.631701+0000","last_active":"2024-09-10T17:52:41.277361+0000","last_peered":"2024-09-10T17:52:41.277361+0000","last_clean":"2024-09-10T17:52:41.277361+0000","last_became_active":"2024-09-10T17:52:39.631299+0000","last_became_peered":"2024-09-10T17:52:39.631299+0000","last_unstale":"2024-09-10T17:52:41.277361+0000","last_undegraded":"2024-09-10T17:52:41.277361+0000","last_fullsized":"2024-09-10T17:52:41.277361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.370684+0000","last_change":"2024-09-10T17:52:36.200196+0000","last_active":"2024-09-10T17:52:41.370684+0000","last_peered":"2024-09-10T17:52:41.370684+0000","last_clean":"2024-09-10T17:52:41.370684+0000","last_became_active":"2024-09-10T17:52:36.199847+0000","last_became_peered":"2024-09-10T17:52:36.199847+0000","last_unstale":"2024-09-10T17:52:41.370684+0000","last_undegraded":"2024-09-10T17:52:41.370684+0000","last_fullsized":"2024-09-10T17:52:41.370684+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.505803+0000","last_change":"2024-09-10T17:52:39.643274+0000","last_active":"2024-09-10T17:52:43.505803+0000","last_peered":"2024-09-10T17:52:43.505803+0000","last_clean":"2024-09-10T17:52:43.505803+0000","last_became_active":"2024-09-10T17:52:39.643016+0000","last_became_peered":"2024-09-10T17:52:39.643016+0000","last_unstale":"2024-09-10T17:52:43.505803+0000","last_undegraded":"2024-09-10T17:52:43.505803+0000","last_fullsized":"2024-09-10T17:52:43.505803+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372345+0000","last_change":"2024-09-10T17:52:36.195088+0000","last_active":"2024-09-10T17:52:41.372345+0000","last_peered":"2024-09-10T17:52:41.372345+0000","last_clean":"2024-09-10T17:52:41.372345+0000","last_became_active":"2024-09-10T17:52:36.194698+0000","last_became_peered":"2024-09-10T17:52:36.194698+0000","last_unstale":"2024-09-10T17:52:41.372345+0000","last_undegraded":"2024-09-10T17:52:41.372345+0000","last_fullsized":"2024-09-10T17:52:41.372345+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549849+0000","last_change":"2024-09-10T17:52:39.643179+0000","last_active":"2024-09-10T17:52:43.549849+0000","last_peered":"2024-09-10T17:52:43.549849+0000","last_clean":"2024-09-10T17:52:43.549849+0000","last_became_active":"2024-09-10T17:52:39.642643+0000","last_became_peered":"2024-09-10T17:52:39.642643+0000","last_unstale":"2024-09-10T17:52:43.549849+0000","last_undegraded":"2024-09-10T17:52:43.549849+0000","last_fullsized":"2024-09-10T17:52:43.549849+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.372285+0000","last_change":"2024-09-10T17:52:36.188755+0000","last_active":"2024-09-10T17:52:41.372285+0000","last_peered":"2024-09-10T17:52:41.372285+0000","last_clean":"2024-09-10T17:52:41.372285+0000","last_became_active":"2024-09-10T17:52:36.188465+0000","last_became_peered":"2024-09-10T17:52:36.188465+0000","last_unstale":"2024-09-10T17:52:41.372285+0000","last_undegraded":"2024-09-10T17:52:41.372285+0000","last_fullsized":"2024-09-10T17:52:41.372285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549932+0000","last_change":"2024-09-10T17:52:39.635509+0000","last_active":"2024-09-10T17:52:43.549932+0000","last_peered":"2024-09-10T17:52:43.549932+0000","last_clean":"2024-09-10T17:52:43.549932+0000","last_became_active":"2024-09-10T17:52:39.635118+0000","last_became_peered":"2024-09-10T17:52:39.635118+0000","last_unstale":"2024-09-10T17:52:43.549932+0000","last_undegraded":"2024-09-10T17:52:43.549932+0000","last_fullsized":"2024-09-10T17:52:43.549932+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"65'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.376017+0000","last_change":"2024-09-10T17:52:36.200921+0000","last_active":"2024-09-10T17:52:41.376017+0000","last_peered":"2024-09-10T17:52:41.376017+0000","last_clean":"2024-09-10T17:52:41.376017+0000","last_became_active":"2024-09-10T17:52:36.200153+0000","last_became_peered":"2024-09-10T17:52:36.200153+0000","last_unstale":"2024-09-10T17:52:41.376017+0000","last_undegraded":"2024-09-10T17:52:41.376017+0000","last_fullsized":"2024-09-10T17:52:41.376017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.371318+0000","last_change":"2024-09-10T17:52:39.643628+0000","last_active":"2024-09-10T17:52:41.371318+0000","last_peered":"2024-09-10T17:52:41.371318+0000","last_clean":"2024-09-10T17:52:41.371318+0000","last_became_active":"2024-09-10T17:52:39.643355+0000","last_became_peered":"2024-09-10T17:52:39.643355+0000","last_unstale":"2024-09-10T17:52:41.371318+0000","last_undegraded":"2024-09-10T17:52:41.371318+0000","last_fullsized":"2024-09-10T17:52:41.371318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277976+0000","last_change":"2024-09-10T17:52:39.652448+0000","last_active":"2024-09-10T17:52:41.277976+0000","last_peered":"2024-09-10T17:52:41.277976+0000","last_clean":"2024-09-10T17:52:41.277976+0000","last_became_active":"2024-09-10T17:52:39.652164+0000","last_became_peered":"2024-09-10T17:52:39.652164+0000","last_unstale":"2024-09-10T17:52:41.277976+0000","last_undegraded":"2024-09-10T17:52:41.277976+0000","last_fullsized":"2024-09-10T17:52:41.277976+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"65'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.377925+0000","last_change":"2024-09-10T17:52:36.200230+0000","last_active":"2024-09-10T17:52:41.377925+0000","last_peered":"2024-09-10T17:52:41.377925+0000","last_clean":"2024-09-10T17:52:41.377925+0000","last_became_active":"2024-09-10T17:52:36.199765+0000","last_became_peered":"2024-09-10T17:52:36.199765+0000","last_unstale":"2024-09-10T17:52:41.377925+0000","last_undegraded":"2024-09-10T17:52:41.377925+0000","last_fullsized":"2024-09-10T17:52:41.377925+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.278300+0000","last_change":"2024-09-10T17:52:39.652608+0000","last_active":"2024-09-10T17:52:41.278300+0000","last_peered":"2024-09-10T17:52:41.278300+0000","last_clean":"2024-09-10T17:52:41.278300+0000","last_became_active":"2024-09-10T17:52:39.652354+0000","last_became_peered":"2024-09-10T17:52:39.652354+0000","last_unstale":"2024-09-10T17:52:41.278300+0000","last_undegraded":"2024-09-10T17:52:41.278300+0000","last_fullsized":"2024-09-10T17:52:41.278300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"65'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378498+0000","last_change":"2024-09-10T17:52:36.200731+0000","last_active":"2024-09-10T17:52:41.378498+0000","last_peered":"2024-09-10T17:52:41.378498+0000","last_clean":"2024-09-10T17:52:41.378498+0000","last_became_active":"2024-09-10T17:52:36.200429+0000","last_became_peered":"2024-09-10T17:52:36.200429+0000","last_unstale":"2024-09-10T17:52:41.378498+0000","last_undegraded":"2024-09-10T17:52:41.378498+0000","last_fullsized":"2024-09-10T17:52:41.378498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.277454+0000","last_change":"2024-09-10T17:52:39.640232+0000","last_active":"2024-09-10T17:52:41.277454+0000","last_peered":"2024-09-10T17:52:41.277454+0000","last_clean":"2024-09-10T17:52:41.277454+0000","last_became_active":"2024-09-10T17:52:39.639462+0000","last_became_peered":"2024-09-10T17:52:39.639462+0000","last_unstale":"2024-09-10T17:52:41.277454+0000","last_undegraded":"2024-09-10T17:52:41.277454+0000","last_fullsized":"2024-09-10T17:52:41.277454+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"65'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.374580+0000","last_change":"2024-09-10T17:52:36.190257+0000","last_active":"2024-09-10T17:52:41.374580+0000","last_peered":"2024-09-10T17:52:41.374580+0000","last_clean":"2024-09-10T17:52:41.374580+0000","last_became_active":"2024-09-10T17:52:36.189957+0000","last_became_peered":"2024-09-10T17:52:36.189957+0000","last_unstale":"2024-09-10T17:52:41.374580+0000","last_undegraded":"2024-09-10T17:52:41.374580+0000","last_fullsized":"2024-09-10T17:52:41.374580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:43.549959+0000","last_change":"2024-09-10T17:52:39.636289+0000","last_active":"2024-09-10T17:52:43.549959+0000","last_peered":"2024-09-10T17:52:43.549959+0000","last_clean":"2024-09-10T17:52:43.549959+0000","last_became_active":"2024-09-10T17:52:39.635894+0000","last_became_peered":"2024-09-10T17:52:39.635894+0000","last_unstale":"2024-09-10T17:52:43.549959+0000","last_undegraded":"2024-09-10T17:52:43.549959+0000","last_fullsized":"2024-09-10T17:52:43.549959+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"65'4","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T17:52:41.378444+0000","last_change":"2024-09-10T17:52:36.194542+0000","last_active":"2024-09-10T17:52:41.378444+0000","last_peered":"2024-09-10T17:52:41.378444+0000","last_clean":"2024-09-10T17:52:41.378444+0000","last_became_active":"2024-09-10T17:52:36.194232+0000","last_became_peered":"2024-09-10T17:52:36.194232+0000","last_unstale":"2024-09-10T17:52:41.378444+0000","last_undegraded":"2024-09-10T17:52:41.378444+0000","last_fullsized":"2024-09-10T17:52:41.378444+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":7086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233996,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28260,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716892,"statfs":{"total":95995035648,"available":95966097408,"internally_reserved":0,"allocated":1269760,"data_stored":874875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495634,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32352,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712800,"statfs":{"total":95995035648,"available":95961907200,"internally_reserved":0,"allocated":1257472,"data_stored":868933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55900000000000005}]},{"osd":1,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.64000000000000001}]},{"osd":2,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.502},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54300000000000004}]},{"osd":4,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.379},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.39700000000000002}]},{"osd":5,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757270,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713380,"statfs":{"total":95995035648,"available":95962501120,"internally_reserved":0,"allocated":663552,"data_stored":278374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47999999999999998}]},{"osd":1,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.35999999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.438}]},{"osd":3,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51100000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.315},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.498}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":4,"up_from":30,"seq":128849018906,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27680,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717472,"statfs":{"total":95995035648,"available":95966691328,"internally_reserved":0,"allocated":675840,"data_stored":278313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.627}]},{"osd":1,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Tue Sep 10 17:52:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.377}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182432,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27688,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":679936,"data_stored":279273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.439,"5min":0.433,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:52:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411365,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717480,"statfs":{"total":95995035648,"available":95966699520,"internally_reserved":0,"allocated":667648,"data_stored":283961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.29199999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.5}]},{"osd":4,"last update":"Tue Sep 10 17:52:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.753},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.69499999999999995}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.78100000000000003}]},{"osd":6,"last update":"Tue Sep 10 17:52:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717476,"statfs":{"total":95995035648,"available":95966695424,"internally_reserved":0,"allocated":671744,"data_stored":283848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.37,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.216,"15min":0.216},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.28899999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.58999999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42099999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40200000000000002,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.435},{"interface":"front","average":{"1min":0.503,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:53:01 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.71699999999999997,"15min":0.60299999999999998},"min":{"1min":0.47899999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":15.68,"5min":15.68,"15min":15.68},"last":0.62},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.73999999999999999}]},{"osd":5,"last update":"Tue Sep 10 17:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.77900000000000003}]},{"osd":6,"last update":"Tue Sep 10 17:52:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.629},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32360,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712792,"statfs":{"total":95995035648,"available":95961899008,"internally_reserved":0,"allocated":1269760,"data_stored":868701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 17:52:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54400000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.373,"15min":0.36199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.309}]},{"osd":2,"last update":"Tue Sep 10 17:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38500000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61499999999999999,"5min":0.62,"15min":0.62},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Tue Sep 10 17:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55700000000000005}]},{"osd":5,"last update":"Tue Sep 10 17:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.52400000000000002},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.907,"5min":7.907,"15min":7.907},"last":0.48699999999999999}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.497},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9450000000000003,"5min":7.9450000000000003,"15min":7.9450000000000003},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T17:53:07.788 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-10T17:53:07.788 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 66, 'state': 'peering', 'last_fresh': '2024-09-10T17:53:03.189906+0000', 'last_change': '2024-09-10T17:53:03.190102+0000', 'last_active': '2024-09-10T17:53:03.189906+0000', 'last_peered': '2024-09-10T17:52:41.370506+0000', 'last_clean': '2024-09-10T17:52:41.370506+0000', 'last_became_active': '2024-09-10T17:52:39.647752+0000', 'last_became_peered': '2024-09-10T17:52:39.647752+0000', 'last_unstale': '2024-09-10T17:53:03.189906+0000', 'last_undegraded': '2024-09-10T17:53:03.189906+0000', 'last_fullsized': '2024-09-10T17:53:03.189906+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 63, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'last_clean_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-11T22:37:01.340312+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0, 3], 'acting': [7, 0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 3, 4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T17:53:07.788 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-10T17:53:07.789 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 66, 'state': 'peering', 'last_fresh': '2024-09-10T17:52:39.622507+0000', 'last_change': '2024-09-10T17:53:04.094591+0000', 'last_active': '2024-09-10T17:52:38.613602+0000', 'last_peered': '2024-09-10T17:52:38.613602+0000', 'last_clean': '2024-09-10T17:52:38.613602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T17:52:39.622507+0000', 'last_undegraded': '2024-09-10T17:52:39.622507+0000', 'last_fullsized': '2024-09-10T17:52:39.622507+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 63, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'last_clean_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6, 0], 'acting': [2, 6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T17:53:07.789 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-10T17:53:07.789 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 66, 'state': 'peering', 'last_fresh': '2024-09-10T17:52:41.371824+0000', 'last_change': '2024-09-10T17:53:04.094581+0000', 'last_active': '2024-09-10T17:53:04.094581+0000', 'last_peered': '2024-09-10T17:52:41.371824+0000', 'last_clean': '2024-09-10T17:52:41.371824+0000', 'last_became_active': '2024-09-10T17:52:39.632048+0000', 'last_became_peered': '2024-09-10T17:52:39.632048+0000', 'last_unstale': '2024-09-10T17:52:41.371824+0000', 'last_undegraded': '2024-09-10T17:52:41.371824+0000', 'last_fullsized': '2024-09-10T17:52:41.371824+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 63, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'last_clean_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4, 7], 'acting': [2, 4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T17:53:07.789 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-10T17:53:07.789 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 66, 'state': 'peering', 'last_fresh': '2024-09-10T17:52:39.630290+0000', 'last_change': '2024-09-10T17:53:04.094609+0000', 'last_active': '2024-09-10T17:52:38.613602+0000', 'last_peered': '2024-09-10T17:52:38.613602+0000', 'last_clean': '2024-09-10T17:52:38.613602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T17:52:39.630290+0000', 'last_undegraded': '2024-09-10T17:52:39.630290+0000', 'last_fullsized': '2024-09-10T17:52:39.630290+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 63, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'last_clean_scrub_stamp': '2024-09-10T17:52:38.613602+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4, 1], 'acting': [2, 4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T17:53:07.789 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-10T17:53:07.789 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 66, 'state': 'peering', 'last_fresh': '2024-09-10T17:52:36.194691+0000', 'last_change': '2024-09-10T17:53:04.094544+0000', 'last_active': '2024-09-10T17:52:35.173921+0000', 'last_peered': '2024-09-10T17:52:35.173921+0000', 'last_clean': '2024-09-10T17:52:35.173921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T17:52:36.194691+0000', 'last_undegraded': '2024-09-10T17:52:36.194691+0000', 'last_fullsized': '2024-09-10T17:52:36.194691+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 60, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T17:52:35.173921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T17:52:35.173921+0000', 'last_clean_scrub_stamp': '2024-09-10T17:52:35.173921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1, 0], 'acting': [2, 1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T17:53:07.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph status --format=json 2024-09-10T17:53:07.995 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:09.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:09 smithi012 ceph-mon[27356]: pgmap v210: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:09.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:09 smithi012 ceph-mon[37454]: pgmap v210: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:09.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:09 smithi089 ceph-mon[31467]: pgmap v210: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:53:10.077 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":259,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1725990728,"num_in_osds":8,"osd_in_since":1725990712,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592730,"bytes_used":241258496,"bytes_avail":767719026688,"bytes_total":767960285184},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24340}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.12:8443/"}},"servicemap":{"epoch":13,"modified":"2024-09-10T17:53:09.097423+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T17:53:10.369 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:10 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3308691634' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-10T17:53:10.369 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:10 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3308691634' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-10T17:53:10.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:10 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3308691634' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-10T17:53:10.797 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T17:53:10.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T17:53:11.009 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:11.393 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:11 smithi012 ceph-mon[27356]: pgmap v211: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:11.393 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:11 smithi012 ceph-mon[37454]: pgmap v211: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:11.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:11 smithi089 ceph-mon[31467]: pgmap v211: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:53:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T17:53:13.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:13 smithi012 ceph-mon[27356]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:13.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:13 smithi012 ceph-mon[27356]: pgmap v212: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:13.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:13 smithi012 ceph-mon[37454]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:13.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:13 smithi012 ceph-mon[37454]: pgmap v212: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:13.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:13 smithi089 ceph-mon[31467]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:13.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:13 smithi089 ceph-mon[31467]: pgmap v212: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:13.646 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-10T17:53:11.097701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":235604,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749725612,"statfs":{"total":767960285184,"available":767719026688,"internally_reserved":0,"allocated":7315456,"data_stored":4101423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":233819706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001810"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190723+0000","last_change":"2024-09-10T17:52:39.637199+0000","last_active":"2024-09-10T17:53:03.190723+0000","last_peered":"2024-09-10T17:53:03.190723+0000","last_clean":"2024-09-10T17:53:03.190723+0000","last_became_active":"2024-09-10T17:52:39.636912+0000","last_became_peered":"2024-09-10T17:52:39.636912+0000","last_unstale":"2024-09-10T17:53:03.190723+0000","last_undegraded":"2024-09-10T17:53:03.190723+0000","last_fullsized":"2024-09-10T17:53:03.190723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188541+0000","last_change":"2024-09-10T17:52:39.640227+0000","last_active":"2024-09-10T17:53:03.188541+0000","last_peered":"2024-09-10T17:53:03.188541+0000","last_clean":"2024-09-10T17:53:03.188541+0000","last_became_active":"2024-09-10T17:52:39.639677+0000","last_became_peered":"2024-09-10T17:52:39.639677+0000","last_unstale":"2024-09-10T17:53:03.188541+0000","last_undegraded":"2024-09-10T17:53:03.188541+0000","last_fullsized":"2024-09-10T17:53:03.188541+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192865+0000","last_change":"2024-09-10T17:52:39.634939+0000","last_active":"2024-09-10T17:53:03.192865+0000","last_peered":"2024-09-10T17:53:03.192865+0000","last_clean":"2024-09-10T17:53:03.192865+0000","last_became_active":"2024-09-10T17:52:39.634668+0000","last_became_peered":"2024-09-10T17:52:39.634668+0000","last_unstale":"2024-09-10T17:53:03.192865+0000","last_undegraded":"2024-09-10T17:53:03.192865+0000","last_fullsized":"2024-09-10T17:53:03.192865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410123+0000","last_change":"2024-09-10T17:52:39.652074+0000","last_active":"2024-09-10T17:53:03.410123+0000","last_peered":"2024-09-10T17:53:03.410123+0000","last_clean":"2024-09-10T17:53:03.410123+0000","last_became_active":"2024-09-10T17:52:39.651762+0000","last_became_peered":"2024-09-10T17:52:39.651762+0000","last_unstale":"2024-09-10T17:53:03.410123+0000","last_undegraded":"2024-09-10T17:53:03.410123+0000","last_fullsized":"2024-09-10T17:53:03.410123+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189845+0000","last_change":"2024-09-10T17:52:39.637379+0000","last_active":"2024-09-10T17:53:03.189845+0000","last_peered":"2024-09-10T17:53:03.189845+0000","last_clean":"2024-09-10T17:53:03.189845+0000","last_became_active":"2024-09-10T17:52:39.636370+0000","last_became_peered":"2024-09-10T17:52:39.636370+0000","last_unstale":"2024-09-10T17:53:03.189845+0000","last_undegraded":"2024-09-10T17:53:03.189845+0000","last_fullsized":"2024-09-10T17:53:03.189845+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.409980+0000","last_change":"2024-09-10T17:52:39.646980+0000","last_active":"2024-09-10T17:53:03.409980+0000","last_peered":"2024-09-10T17:53:03.409980+0000","last_clean":"2024-09-10T17:53:03.409980+0000","last_became_active":"2024-09-10T17:52:39.645786+0000","last_became_peered":"2024-09-10T17:52:39.645786+0000","last_unstale":"2024-09-10T17:53:03.409980+0000","last_undegraded":"2024-09-10T17:53:03.409980+0000","last_fullsized":"2024-09-10T17:53:03.409980+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.527641+0000","last_change":"2024-09-10T17:53:04.527641+0000","last_active":"2024-09-10T17:53:04.527641+0000","last_peered":"2024-09-10T17:53:04.527641+0000","last_clean":"2024-09-10T17:53:04.527641+0000","last_became_active":"2024-09-10T17:53:04.527295+0000","last_became_peered":"2024-09-10T17:53:04.527295+0000","last_unstale":"2024-09-10T17:53:04.527641+0000","last_undegraded":"2024-09-10T17:53:04.527641+0000","last_fullsized":"2024-09-10T17:53:04.527641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:12.311291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187841+0000","last_change":"2024-09-10T17:52:39.645147+0000","last_active":"2024-09-10T17:53:03.187841+0000","last_peered":"2024-09-10T17:53:03.187841+0000","last_clean":"2024-09-10T17:53:03.187841+0000","last_became_active":"2024-09-10T17:52:39.644853+0000","last_became_peered":"2024-09-10T17:52:39.644853+0000","last_unstale":"2024-09-10T17:53:03.187841+0000","last_undegraded":"2024-09-10T17:53:03.187841+0000","last_fullsized":"2024-09-10T17:53:03.187841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191352+0000","last_change":"2024-09-10T17:52:39.643055+0000","last_active":"2024-09-10T17:53:03.191352+0000","last_peered":"2024-09-10T17:53:03.191352+0000","last_clean":"2024-09-10T17:53:03.191352+0000","last_became_active":"2024-09-10T17:52:39.642731+0000","last_became_peered":"2024-09-10T17:52:39.642731+0000","last_unstale":"2024-09-10T17:53:03.191352+0000","last_undegraded":"2024-09-10T17:53:03.191352+0000","last_fullsized":"2024-09-10T17:53:03.191352+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192715+0000","last_change":"2024-09-10T17:52:39.642693+0000","last_active":"2024-09-10T17:53:03.192715+0000","last_peered":"2024-09-10T17:53:03.192715+0000","last_clean":"2024-09-10T17:53:03.192715+0000","last_became_active":"2024-09-10T17:52:39.642404+0000","last_became_peered":"2024-09-10T17:52:39.642404+0000","last_unstale":"2024-09-10T17:53:03.192715+0000","last_undegraded":"2024-09-10T17:53:03.192715+0000","last_fullsized":"2024-09-10T17:53:03.192715+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192582+0000","last_change":"2024-09-10T17:52:39.641932+0000","last_active":"2024-09-10T17:53:03.192582+0000","last_peered":"2024-09-10T17:53:03.192582+0000","last_clean":"2024-09-10T17:53:03.192582+0000","last_became_active":"2024-09-10T17:52:39.641622+0000","last_became_peered":"2024-09-10T17:52:39.641622+0000","last_unstale":"2024-09-10T17:53:03.192582+0000","last_undegraded":"2024-09-10T17:53:03.192582+0000","last_fullsized":"2024-09-10T17:53:03.192582+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.527604+0000","last_change":"2024-09-10T17:53:04.527604+0000","last_active":"2024-09-10T17:53:04.527604+0000","last_peered":"2024-09-10T17:53:04.527604+0000","last_clean":"2024-09-10T17:53:04.527604+0000","last_became_active":"2024-09-10T17:53:04.527109+0000","last_became_peered":"2024-09-10T17:53:04.527109+0000","last_unstale":"2024-09-10T17:53:04.527604+0000","last_undegraded":"2024-09-10T17:53:04.527604+0000","last_fullsized":"2024-09-10T17:53:04.527604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188655+0000","last_change":"2024-09-10T17:52:39.642786+0000","last_active":"2024-09-10T17:53:03.188655+0000","last_peered":"2024-09-10T17:53:03.188655+0000","last_clean":"2024-09-10T17:53:03.188655+0000","last_became_active":"2024-09-10T17:52:39.641524+0000","last_became_peered":"2024-09-10T17:52:39.641524+0000","last_unstale":"2024-09-10T17:53:03.188655+0000","last_undegraded":"2024-09-10T17:53:03.188655+0000","last_fullsized":"2024-09-10T17:53:03.188655+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191696+0000","last_change":"2024-09-10T17:52:39.639101+0000","last_active":"2024-09-10T17:53:03.191696+0000","last_peered":"2024-09-10T17:53:03.191696+0000","last_clean":"2024-09-10T17:53:03.191696+0000","last_became_active":"2024-09-10T17:52:39.638816+0000","last_became_peered":"2024-09-10T17:52:39.638816+0000","last_unstale":"2024-09-10T17:53:03.191696+0000","last_undegraded":"2024-09-10T17:53:03.191696+0000","last_fullsized":"2024-09-10T17:53:03.191696+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187468+0000","last_change":"2024-09-10T17:52:39.640880+0000","last_active":"2024-09-10T17:53:03.187468+0000","last_peered":"2024-09-10T17:53:03.187468+0000","last_clean":"2024-09-10T17:53:03.187468+0000","last_became_active":"2024-09-10T17:52:39.640599+0000","last_became_peered":"2024-09-10T17:52:39.640599+0000","last_unstale":"2024-09-10T17:53:03.187468+0000","last_undegraded":"2024-09-10T17:53:03.187468+0000","last_fullsized":"2024-09-10T17:53:03.187468+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.409878+0000","last_change":"2024-09-10T17:52:39.646904+0000","last_active":"2024-09-10T17:53:03.409878+0000","last_peered":"2024-09-10T17:53:03.409878+0000","last_clean":"2024-09-10T17:53:03.409878+0000","last_became_active":"2024-09-10T17:52:39.646649+0000","last_became_peered":"2024-09-10T17:52:39.646649+0000","last_unstale":"2024-09-10T17:53:03.409878+0000","last_undegraded":"2024-09-10T17:53:03.409878+0000","last_fullsized":"2024-09-10T17:53:03.409878+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410566+0000","last_change":"2024-09-10T17:52:39.651784+0000","last_active":"2024-09-10T17:53:03.410566+0000","last_peered":"2024-09-10T17:53:03.410566+0000","last_clean":"2024-09-10T17:53:03.410566+0000","last_became_active":"2024-09-10T17:52:39.651519+0000","last_became_peered":"2024-09-10T17:52:39.651519+0000","last_unstale":"2024-09-10T17:53:03.410566+0000","last_undegraded":"2024-09-10T17:53:03.410566+0000","last_fullsized":"2024-09-10T17:53:03.410566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192086+0000","last_change":"2024-09-10T17:52:39.636540+0000","last_active":"2024-09-10T17:53:03.192086+0000","last_peered":"2024-09-10T17:53:03.192086+0000","last_clean":"2024-09-10T17:53:03.192086+0000","last_became_active":"2024-09-10T17:52:39.636034+0000","last_became_peered":"2024-09-10T17:52:39.636034+0000","last_unstale":"2024-09-10T17:53:03.192086+0000","last_undegraded":"2024-09-10T17:53:03.192086+0000","last_fullsized":"2024-09-10T17:53:03.192086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190407+0000","last_change":"2024-09-10T17:52:39.642764+0000","last_active":"2024-09-10T17:53:03.190407+0000","last_peered":"2024-09-10T17:53:03.190407+0000","last_clean":"2024-09-10T17:53:03.190407+0000","last_became_active":"2024-09-10T17:52:39.642454+0000","last_became_peered":"2024-09-10T17:52:39.642454+0000","last_unstale":"2024-09-10T17:53:03.190407+0000","last_undegraded":"2024-09-10T17:53:03.190407+0000","last_fullsized":"2024-09-10T17:53:03.190407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192775+0000","last_change":"2024-09-10T17:52:39.644420+0000","last_active":"2024-09-10T17:53:03.192775+0000","last_peered":"2024-09-10T17:53:03.192775+0000","last_clean":"2024-09-10T17:53:03.192775+0000","last_became_active":"2024-09-10T17:52:39.644155+0000","last_became_peered":"2024-09-10T17:52:39.644155+0000","last_unstale":"2024-09-10T17:53:03.192775+0000","last_undegraded":"2024-09-10T17:53:03.192775+0000","last_fullsized":"2024-09-10T17:53:03.192775+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192261+0000","last_change":"2024-09-10T17:52:39.631587+0000","last_active":"2024-09-10T17:53:03.192261+0000","last_peered":"2024-09-10T17:53:03.192261+0000","last_clean":"2024-09-10T17:53:03.192261+0000","last_became_active":"2024-09-10T17:52:39.631291+0000","last_became_peered":"2024-09-10T17:52:39.631291+0000","last_unstale":"2024-09-10T17:53:03.192261+0000","last_undegraded":"2024-09-10T17:53:03.192261+0000","last_fullsized":"2024-09-10T17:53:03.192261+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410007+0000","last_change":"2024-09-10T17:52:39.635863+0000","last_active":"2024-09-10T17:53:03.410007+0000","last_peered":"2024-09-10T17:53:03.410007+0000","last_clean":"2024-09-10T17:53:03.410007+0000","last_became_active":"2024-09-10T17:52:39.635566+0000","last_became_peered":"2024-09-10T17:52:39.635566+0000","last_unstale":"2024-09-10T17:53:03.410007+0000","last_undegraded":"2024-09-10T17:53:03.410007+0000","last_fullsized":"2024-09-10T17:53:03.410007+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188685+0000","last_change":"2024-09-10T17:52:39.641463+0000","last_active":"2024-09-10T17:53:03.188685+0000","last_peered":"2024-09-10T17:53:03.188685+0000","last_clean":"2024-09-10T17:53:03.188685+0000","last_became_active":"2024-09-10T17:52:39.640887+0000","last_became_peered":"2024-09-10T17:52:39.640887+0000","last_unstale":"2024-09-10T17:53:03.188685+0000","last_undegraded":"2024-09-10T17:53:03.188685+0000","last_fullsized":"2024-09-10T17:53:03.188685+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.409988+0000","last_change":"2024-09-10T17:52:39.648810+0000","last_active":"2024-09-10T17:53:03.409988+0000","last_peered":"2024-09-10T17:53:03.409988+0000","last_clean":"2024-09-10T17:53:03.409988+0000","last_became_active":"2024-09-10T17:52:39.648476+0000","last_became_peered":"2024-09-10T17:52:39.648476+0000","last_unstale":"2024-09-10T17:53:03.409988+0000","last_undegraded":"2024-09-10T17:53:03.409988+0000","last_fullsized":"2024-09-10T17:53:03.409988+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189099+0000","last_change":"2024-09-10T17:52:39.643794+0000","last_active":"2024-09-10T17:53:03.189099+0000","last_peered":"2024-09-10T17:53:03.189099+0000","last_clean":"2024-09-10T17:53:03.189099+0000","last_became_active":"2024-09-10T17:52:39.643540+0000","last_became_peered":"2024-09-10T17:52:39.643540+0000","last_unstale":"2024-09-10T17:53:03.189099+0000","last_undegraded":"2024-09-10T17:53:03.189099+0000","last_fullsized":"2024-09-10T17:53:03.189099+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192768+0000","last_change":"2024-09-10T17:52:39.650553+0000","last_active":"2024-09-10T17:53:03.192768+0000","last_peered":"2024-09-10T17:53:03.192768+0000","last_clean":"2024-09-10T17:53:03.192768+0000","last_became_active":"2024-09-10T17:52:39.650207+0000","last_became_peered":"2024-09-10T17:52:39.650207+0000","last_unstale":"2024-09-10T17:53:03.192768+0000","last_undegraded":"2024-09-10T17:53:03.192768+0000","last_fullsized":"2024-09-10T17:53:03.192768+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187672+0000","last_change":"2024-09-10T17:52:39.641442+0000","last_active":"2024-09-10T17:53:03.187672+0000","last_peered":"2024-09-10T17:53:03.187672+0000","last_clean":"2024-09-10T17:53:03.187672+0000","last_became_active":"2024-09-10T17:52:39.641158+0000","last_became_peered":"2024-09-10T17:52:39.641158+0000","last_unstale":"2024-09-10T17:53:03.187672+0000","last_undegraded":"2024-09-10T17:53:03.187672+0000","last_fullsized":"2024-09-10T17:53:03.187672+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188428+0000","last_change":"2024-09-10T17:52:39.644997+0000","last_active":"2024-09-10T17:53:03.188428+0000","last_peered":"2024-09-10T17:53:03.188428+0000","last_clean":"2024-09-10T17:53:03.188428+0000","last_became_active":"2024-09-10T17:52:39.643999+0000","last_became_peered":"2024-09-10T17:52:39.643999+0000","last_unstale":"2024-09-10T17:53:03.188428+0000","last_undegraded":"2024-09-10T17:53:03.188428+0000","last_fullsized":"2024-09-10T17:53:03.188428+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192340+0000","last_change":"2024-09-10T17:52:39.632927+0000","last_active":"2024-09-10T17:53:03.192340+0000","last_peered":"2024-09-10T17:53:03.192340+0000","last_clean":"2024-09-10T17:53:03.192340+0000","last_became_active":"2024-09-10T17:52:39.632680+0000","last_became_peered":"2024-09-10T17:52:39.632680+0000","last_unstale":"2024-09-10T17:53:03.192340+0000","last_undegraded":"2024-09-10T17:53:03.192340+0000","last_fullsized":"2024-09-10T17:53:03.192340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410081+0000","last_change":"2024-09-10T17:52:39.648726+0000","last_active":"2024-09-10T17:53:03.410081+0000","last_peered":"2024-09-10T17:53:03.410081+0000","last_clean":"2024-09-10T17:53:03.410081+0000","last_became_active":"2024-09-10T17:52:39.648448+0000","last_became_peered":"2024-09-10T17:52:39.648448+0000","last_unstale":"2024-09-10T17:53:03.410081+0000","last_undegraded":"2024-09-10T17:53:03.410081+0000","last_fullsized":"2024-09-10T17:53:03.410081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190676+0000","last_change":"2024-09-10T17:52:39.634918+0000","last_active":"2024-09-10T17:53:03.190676+0000","last_peered":"2024-09-10T17:53:03.190676+0000","last_clean":"2024-09-10T17:53:03.190676+0000","last_became_active":"2024-09-10T17:52:39.634622+0000","last_became_peered":"2024-09-10T17:52:39.634622+0000","last_unstale":"2024-09-10T17:53:03.190676+0000","last_undegraded":"2024-09-10T17:53:03.190676+0000","last_fullsized":"2024-09-10T17:53:03.190676+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192287+0000","last_change":"2024-09-10T17:52:39.642111+0000","last_active":"2024-09-10T17:53:03.192287+0000","last_peered":"2024-09-10T17:53:03.192287+0000","last_clean":"2024-09-10T17:53:03.192287+0000","last_became_active":"2024-09-10T17:52:39.641786+0000","last_became_peered":"2024-09-10T17:52:39.641786+0000","last_unstale":"2024-09-10T17:53:03.192287+0000","last_undegraded":"2024-09-10T17:53:03.192287+0000","last_fullsized":"2024-09-10T17:53:03.192287+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187474+0000","last_change":"2024-09-10T17:52:39.632064+0000","last_active":"2024-09-10T17:53:03.187474+0000","last_peered":"2024-09-10T17:53:03.187474+0000","last_clean":"2024-09-10T17:53:03.187474+0000","last_became_active":"2024-09-10T17:52:39.631529+0000","last_became_peered":"2024-09-10T17:52:39.631529+0000","last_unstale":"2024-09-10T17:53:03.187474+0000","last_undegraded":"2024-09-10T17:53:03.187474+0000","last_fullsized":"2024-09-10T17:53:03.187474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188910+0000","last_change":"2024-09-10T17:52:36.192274+0000","last_active":"2024-09-10T17:53:03.188910+0000","last_peered":"2024-09-10T17:53:03.188910+0000","last_clean":"2024-09-10T17:53:03.188910+0000","last_became_active":"2024-09-10T17:52:36.191998+0000","last_became_peered":"2024-09-10T17:52:36.191998+0000","last_unstale":"2024-09-10T17:53:03.188910+0000","last_undegraded":"2024-09-10T17:53:03.188910+0000","last_fullsized":"2024-09-10T17:53:03.188910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.205276+0000","last_change":"2024-09-10T17:53:04.205276+0000","last_active":"2024-09-10T17:53:04.205276+0000","last_peered":"2024-09-10T17:53:04.205276+0000","last_clean":"2024-09-10T17:53:04.205276+0000","last_became_active":"2024-09-10T17:53:04.204905+0000","last_became_peered":"2024-09-10T17:53:04.204905+0000","last_unstale":"2024-09-10T17:53:04.205276+0000","last_undegraded":"2024-09-10T17:53:04.205276+0000","last_fullsized":"2024-09-10T17:53:04.205276+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192685+0000","last_change":"2024-09-10T17:52:36.190911+0000","last_active":"2024-09-10T17:53:03.192685+0000","last_peered":"2024-09-10T17:53:03.192685+0000","last_clean":"2024-09-10T17:53:03.192685+0000","last_became_active":"2024-09-10T17:52:36.190437+0000","last_became_peered":"2024-09-10T17:52:36.190437+0000","last_unstale":"2024-09-10T17:53:03.192685+0000","last_undegraded":"2024-09-10T17:53:03.192685+0000","last_fullsized":"2024-09-10T17:53:03.192685+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188839+0000","last_change":"2024-09-10T17:52:36.192952+0000","last_active":"2024-09-10T17:53:03.188839+0000","last_peered":"2024-09-10T17:53:03.188839+0000","last_clean":"2024-09-10T17:53:03.188839+0000","last_became_active":"2024-09-10T17:52:36.192199+0000","last_became_peered":"2024-09-10T17:52:36.192199+0000","last_unstale":"2024-09-10T17:53:03.188839+0000","last_undegraded":"2024-09-10T17:53:03.188839+0000","last_fullsized":"2024-09-10T17:53:03.188839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187909+0000","last_change":"2024-09-10T17:52:39.646604+0000","last_active":"2024-09-10T17:53:03.187909+0000","last_peered":"2024-09-10T17:53:03.187909+0000","last_clean":"2024-09-10T17:53:03.187909+0000","last_became_active":"2024-09-10T17:52:39.646321+0000","last_became_peered":"2024-09-10T17:52:39.646321+0000","last_unstale":"2024-09-10T17:53:03.187909+0000","last_undegraded":"2024-09-10T17:53:03.187909+0000","last_fullsized":"2024-09-10T17:53:03.187909+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.409988+0000","last_change":"2024-09-10T17:52:36.194360+0000","last_active":"2024-09-10T17:53:03.409988+0000","last_peered":"2024-09-10T17:53:03.409988+0000","last_clean":"2024-09-10T17:53:03.409988+0000","last_became_active":"2024-09-10T17:52:36.194106+0000","last_became_peered":"2024-09-10T17:52:36.194106+0000","last_unstale":"2024-09-10T17:53:03.409988+0000","last_undegraded":"2024-09-10T17:53:03.409988+0000","last_fullsized":"2024-09-10T17:53:03.409988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187278+0000","last_change":"2024-09-10T17:52:39.637886+0000","last_active":"2024-09-10T17:53:03.187278+0000","last_peered":"2024-09-10T17:53:03.187278+0000","last_clean":"2024-09-10T17:53:03.187278+0000","last_became_active":"2024-09-10T17:52:39.637615+0000","last_became_peered":"2024-09-10T17:52:39.637615+0000","last_unstale":"2024-09-10T17:53:03.187278+0000","last_undegraded":"2024-09-10T17:53:03.187278+0000","last_fullsized":"2024-09-10T17:53:03.187278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192508+0000","last_change":"2024-09-10T17:52:36.193200+0000","last_active":"2024-09-10T17:53:03.192508+0000","last_peered":"2024-09-10T17:53:03.192508+0000","last_clean":"2024-09-10T17:53:03.192508+0000","last_became_active":"2024-09-10T17:52:36.192223+0000","last_became_peered":"2024-09-10T17:52:36.192223+0000","last_unstale":"2024-09-10T17:53:03.192508+0000","last_undegraded":"2024-09-10T17:53:03.192508+0000","last_fullsized":"2024-09-10T17:53:03.192508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410354+0000","last_change":"2024-09-10T17:52:39.646338+0000","last_active":"2024-09-10T17:53:03.410354+0000","last_peered":"2024-09-10T17:53:03.410354+0000","last_clean":"2024-09-10T17:53:03.410354+0000","last_became_active":"2024-09-10T17:52:39.645661+0000","last_became_peered":"2024-09-10T17:52:39.645661+0000","last_unstale":"2024-09-10T17:53:03.410354+0000","last_undegraded":"2024-09-10T17:53:03.410354+0000","last_fullsized":"2024-09-10T17:53:03.410354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410454+0000","last_change":"2024-09-10T17:52:36.192408+0000","last_active":"2024-09-10T17:53:03.410454+0000","last_peered":"2024-09-10T17:53:03.410454+0000","last_clean":"2024-09-10T17:53:03.410454+0000","last_became_active":"2024-09-10T17:52:36.192132+0000","last_became_peered":"2024-09-10T17:52:36.192132+0000","last_unstale":"2024-09-10T17:53:03.410454+0000","last_undegraded":"2024-09-10T17:53:03.410454+0000","last_fullsized":"2024-09-10T17:53:03.410454+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.193237+0000","last_change":"2024-09-10T17:52:39.641531+0000","last_active":"2024-09-10T17:53:03.193237+0000","last_peered":"2024-09-10T17:53:03.193237+0000","last_clean":"2024-09-10T17:53:03.193237+0000","last_became_active":"2024-09-10T17:52:39.639958+0000","last_became_peered":"2024-09-10T17:52:39.639958+0000","last_unstale":"2024-09-10T17:53:03.193237+0000","last_undegraded":"2024-09-10T17:53:03.193237+0000","last_fullsized":"2024-09-10T17:53:03.193237+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"65'3","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187822+0000","last_change":"2024-09-10T17:52:36.188432+0000","last_active":"2024-09-10T17:53:03.187822+0000","last_peered":"2024-09-10T17:53:03.187822+0000","last_clean":"2024-09-10T17:53:03.187822+0000","last_became_active":"2024-09-10T17:52:36.188019+0000","last_became_peered":"2024-09-10T17:52:36.188019+0000","last_unstale":"2024-09-10T17:53:03.187822+0000","last_undegraded":"2024-09-10T17:53:03.187822+0000","last_fullsized":"2024-09-10T17:53:03.187822+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187722+0000","last_change":"2024-09-10T17:52:39.642140+0000","last_active":"2024-09-10T17:53:03.187722+0000","last_peered":"2024-09-10T17:53:03.187722+0000","last_clean":"2024-09-10T17:53:03.187722+0000","last_became_active":"2024-09-10T17:52:39.641201+0000","last_became_peered":"2024-09-10T17:52:39.641201+0000","last_unstale":"2024-09-10T17:53:03.187722+0000","last_undegraded":"2024-09-10T17:53:03.187722+0000","last_fullsized":"2024-09-10T17:53:03.187722+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'6","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192850+0000","last_change":"2024-09-10T17:52:36.190637+0000","last_active":"2024-09-10T17:53:03.192850+0000","last_peered":"2024-09-10T17:53:03.192850+0000","last_clean":"2024-09-10T17:53:03.192850+0000","last_became_active":"2024-09-10T17:52:36.190315+0000","last_became_peered":"2024-09-10T17:52:36.190315+0000","last_unstale":"2024-09-10T17:53:03.192850+0000","last_undegraded":"2024-09-10T17:53:03.192850+0000","last_fullsized":"2024-09-10T17:53:03.192850+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190098+0000","last_change":"2024-09-10T17:52:39.647058+0000","last_active":"2024-09-10T17:53:03.190098+0000","last_peered":"2024-09-10T17:53:03.190098+0000","last_clean":"2024-09-10T17:53:03.190098+0000","last_became_active":"2024-09-10T17:52:39.646127+0000","last_became_peered":"2024-09-10T17:52:39.646127+0000","last_unstale":"2024-09-10T17:53:03.190098+0000","last_undegraded":"2024-09-10T17:53:03.190098+0000","last_fullsized":"2024-09-10T17:53:03.190098+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192445+0000","last_change":"2024-09-10T17:52:36.197133+0000","last_active":"2024-09-10T17:53:03.192445+0000","last_peered":"2024-09-10T17:53:03.192445+0000","last_clean":"2024-09-10T17:53:03.192445+0000","last_became_active":"2024-09-10T17:52:36.196798+0000","last_became_peered":"2024-09-10T17:52:36.196798+0000","last_unstale":"2024-09-10T17:53:03.192445+0000","last_undegraded":"2024-09-10T17:53:03.192445+0000","last_fullsized":"2024-09-10T17:53:03.192445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192052+0000","last_change":"2024-09-10T17:52:39.632963+0000","last_active":"2024-09-10T17:53:03.192052+0000","last_peered":"2024-09-10T17:53:03.192052+0000","last_clean":"2024-09-10T17:53:03.192052+0000","last_became_active":"2024-09-10T17:52:39.632648+0000","last_became_peered":"2024-09-10T17:52:39.632648+0000","last_unstale":"2024-09-10T17:53:03.192052+0000","last_undegraded":"2024-09-10T17:53:03.192052+0000","last_fullsized":"2024-09-10T17:53:03.192052+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410189+0000","last_change":"2024-09-10T17:52:36.190919+0000","last_active":"2024-09-10T17:53:03.410189+0000","last_peered":"2024-09-10T17:53:03.410189+0000","last_clean":"2024-09-10T17:53:03.410189+0000","last_became_active":"2024-09-10T17:52:36.190637+0000","last_became_peered":"2024-09-10T17:52:36.190637+0000","last_unstale":"2024-09-10T17:53:03.410189+0000","last_undegraded":"2024-09-10T17:53:03.410189+0000","last_fullsized":"2024-09-10T17:53:03.410189+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189957+0000","last_change":"2024-09-10T17:52:39.637441+0000","last_active":"2024-09-10T17:53:03.189957+0000","last_peered":"2024-09-10T17:53:03.189957+0000","last_clean":"2024-09-10T17:53:03.189957+0000","last_became_active":"2024-09-10T17:52:39.636759+0000","last_became_peered":"2024-09-10T17:52:39.636759+0000","last_unstale":"2024-09-10T17:53:03.189957+0000","last_undegraded":"2024-09-10T17:53:03.189957+0000","last_fullsized":"2024-09-10T17:53:03.189957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192893+0000","last_change":"2024-09-10T17:52:36.192102+0000","last_active":"2024-09-10T17:53:03.192893+0000","last_peered":"2024-09-10T17:53:03.192893+0000","last_clean":"2024-09-10T17:53:03.192893+0000","last_became_active":"2024-09-10T17:52:36.191743+0000","last_became_peered":"2024-09-10T17:52:36.191743+0000","last_unstale":"2024-09-10T17:53:03.192893+0000","last_undegraded":"2024-09-10T17:53:03.192893+0000","last_fullsized":"2024-09-10T17:53:03.192893+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192172+0000","last_change":"2024-09-10T17:52:39.640124+0000","last_active":"2024-09-10T17:53:03.192172+0000","last_peered":"2024-09-10T17:53:03.192172+0000","last_clean":"2024-09-10T17:53:03.192172+0000","last_became_active":"2024-09-10T17:52:39.639840+0000","last_became_peered":"2024-09-10T17:52:39.639840+0000","last_unstale":"2024-09-10T17:53:03.192172+0000","last_undegraded":"2024-09-10T17:53:03.192172+0000","last_fullsized":"2024-09-10T17:53:03.192172+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"65'8","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191624+0000","last_change":"2024-09-10T17:52:36.191246+0000","last_active":"2024-09-10T17:53:03.191624+0000","last_peered":"2024-09-10T17:53:03.191624+0000","last_clean":"2024-09-10T17:53:03.191624+0000","last_became_active":"2024-09-10T17:52:36.190916+0000","last_became_peered":"2024-09-10T17:52:36.190916+0000","last_unstale":"2024-09-10T17:53:03.191624+0000","last_undegraded":"2024-09-10T17:53:03.191624+0000","last_fullsized":"2024-09-10T17:53:03.191624+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191104+0000","last_change":"2024-09-10T17:52:39.647318+0000","last_active":"2024-09-10T17:53:03.191104+0000","last_peered":"2024-09-10T17:53:03.191104+0000","last_clean":"2024-09-10T17:53:03.191104+0000","last_became_active":"2024-09-10T17:52:39.647020+0000","last_became_peered":"2024-09-10T17:52:39.647020+0000","last_unstale":"2024-09-10T17:53:03.191104+0000","last_undegraded":"2024-09-10T17:53:03.191104+0000","last_fullsized":"2024-09-10T17:53:03.191104+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188360+0000","last_change":"2024-09-10T17:52:36.194263+0000","last_active":"2024-09-10T17:53:03.188360+0000","last_peered":"2024-09-10T17:53:03.188360+0000","last_clean":"2024-09-10T17:53:03.188360+0000","last_became_active":"2024-09-10T17:52:36.193894+0000","last_became_peered":"2024-09-10T17:52:36.193894+0000","last_unstale":"2024-09-10T17:53:03.188360+0000","last_undegraded":"2024-09-10T17:53:03.188360+0000","last_fullsized":"2024-09-10T17:53:03.188360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.205325+0000","last_change":"2024-09-10T17:53:04.205325+0000","last_active":"2024-09-10T17:53:04.205325+0000","last_peered":"2024-09-10T17:53:04.205325+0000","last_clean":"2024-09-10T17:53:04.205325+0000","last_became_active":"2024-09-10T17:53:04.204953+0000","last_became_peered":"2024-09-10T17:53:04.204953+0000","last_unstale":"2024-09-10T17:53:04.205325+0000","last_undegraded":"2024-09-10T17:53:04.205325+0000","last_fullsized":"2024-09-10T17:53:04.205325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192272+0000","last_change":"2024-09-10T17:52:36.191958+0000","last_active":"2024-09-10T17:53:03.192272+0000","last_peered":"2024-09-10T17:53:03.192272+0000","last_clean":"2024-09-10T17:53:03.192272+0000","last_became_active":"2024-09-10T17:52:36.191684+0000","last_became_peered":"2024-09-10T17:52:36.191684+0000","last_unstale":"2024-09-10T17:53:03.192272+0000","last_undegraded":"2024-09-10T17:53:03.192272+0000","last_fullsized":"2024-09-10T17:53:03.192272+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190808+0000","last_change":"2024-09-10T17:52:39.648857+0000","last_active":"2024-09-10T17:53:03.190808+0000","last_peered":"2024-09-10T17:53:03.190808+0000","last_clean":"2024-09-10T17:53:03.190808+0000","last_became_active":"2024-09-10T17:52:39.648574+0000","last_became_peered":"2024-09-10T17:52:39.648574+0000","last_unstale":"2024-09-10T17:53:03.190808+0000","last_undegraded":"2024-09-10T17:53:03.190808+0000","last_fullsized":"2024-09-10T17:53:03.190808+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187902+0000","last_change":"2024-09-10T17:52:36.185952+0000","last_active":"2024-09-10T17:53:03.187902+0000","last_peered":"2024-09-10T17:53:03.187902+0000","last_clean":"2024-09-10T17:53:03.187902+0000","last_became_active":"2024-09-10T17:52:36.184643+0000","last_became_peered":"2024-09-10T17:52:36.184643+0000","last_unstale":"2024-09-10T17:53:03.187902+0000","last_undegraded":"2024-09-10T17:53:03.187902+0000","last_fullsized":"2024-09-10T17:53:03.187902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410216+0000","last_change":"2024-09-10T17:52:39.651773+0000","last_active":"2024-09-10T17:53:03.410216+0000","last_peered":"2024-09-10T17:53:03.410216+0000","last_clean":"2024-09-10T17:53:03.410216+0000","last_became_active":"2024-09-10T17:52:39.650072+0000","last_became_peered":"2024-09-10T17:52:39.650072+0000","last_unstale":"2024-09-10T17:53:03.410216+0000","last_undegraded":"2024-09-10T17:53:03.410216+0000","last_fullsized":"2024-09-10T17:53:03.410216+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191305+0000","last_change":"2024-09-10T17:52:36.191363+0000","last_active":"2024-09-10T17:53:03.191305+0000","last_peered":"2024-09-10T17:53:03.191305+0000","last_clean":"2024-09-10T17:53:03.191305+0000","last_became_active":"2024-09-10T17:52:36.190976+0000","last_became_peered":"2024-09-10T17:52:36.190976+0000","last_unstale":"2024-09-10T17:53:03.191305+0000","last_undegraded":"2024-09-10T17:53:03.191305+0000","last_fullsized":"2024-09-10T17:53:03.191305+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190295+0000","last_change":"2024-09-10T17:52:39.643612+0000","last_active":"2024-09-10T17:53:03.190295+0000","last_peered":"2024-09-10T17:53:03.190295+0000","last_clean":"2024-09-10T17:53:03.190295+0000","last_became_active":"2024-09-10T17:52:39.643274+0000","last_became_peered":"2024-09-10T17:52:39.643274+0000","last_unstale":"2024-09-10T17:53:03.190295+0000","last_undegraded":"2024-09-10T17:53:03.190295+0000","last_fullsized":"2024-09-10T17:53:03.190295+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":225,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189942+0000","last_change":"2024-09-10T17:52:12.719807+0000","last_active":"2024-09-10T17:53:03.189942+0000","last_peered":"2024-09-10T17:53:03.189942+0000","last_clean":"2024-09-10T17:53:03.189942+0000","last_became_active":"2024-09-10T17:52:12.719452+0000","last_became_peered":"2024-09-10T17:52:12.719452+0000","last_unstale":"2024-09-10T17:53:03.189942+0000","last_undegraded":"2024-09-10T17:53:03.189942+0000","last_fullsized":"2024-09-10T17:53:03.189942+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_clean_scrub_stamp":"2024-09-10T17:50:14.084625+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410053+0000","last_change":"2024-09-10T17:52:36.195598+0000","last_active":"2024-09-10T17:53:03.410053+0000","last_peered":"2024-09-10T17:53:03.410053+0000","last_clean":"2024-09-10T17:53:03.410053+0000","last_became_active":"2024-09-10T17:52:36.195203+0000","last_became_peered":"2024-09-10T17:52:36.195203+0000","last_unstale":"2024-09-10T17:53:03.410053+0000","last_undegraded":"2024-09-10T17:53:03.410053+0000","last_fullsized":"2024-09-10T17:53:03.410053+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188720+0000","last_change":"2024-09-10T17:52:39.644934+0000","last_active":"2024-09-10T17:53:03.188720+0000","last_peered":"2024-09-10T17:53:03.188720+0000","last_clean":"2024-09-10T17:53:03.188720+0000","last_became_active":"2024-09-10T17:52:39.644205+0000","last_became_peered":"2024-09-10T17:52:39.644205+0000","last_unstale":"2024-09-10T17:53:03.188720+0000","last_undegraded":"2024-09-10T17:53:03.188720+0000","last_fullsized":"2024-09-10T17:53:03.188720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.527840+0000","last_change":"2024-09-10T17:53:04.527840+0000","last_active":"2024-09-10T17:53:04.527840+0000","last_peered":"2024-09-10T17:53:04.527840+0000","last_clean":"2024-09-10T17:53:04.527840+0000","last_became_active":"2024-09-10T17:53:04.527470+0000","last_became_peered":"2024-09-10T17:53:04.527470+0000","last_unstale":"2024-09-10T17:53:04.527840+0000","last_undegraded":"2024-09-10T17:53:04.527840+0000","last_fullsized":"2024-09-10T17:53:04.527840+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191804+0000","last_change":"2024-09-10T17:52:39.632868+0000","last_active":"2024-09-10T17:53:03.191804+0000","last_peered":"2024-09-10T17:53:03.191804+0000","last_clean":"2024-09-10T17:53:03.191804+0000","last_became_active":"2024-09-10T17:52:39.632549+0000","last_became_peered":"2024-09-10T17:52:39.632549+0000","last_unstale":"2024-09-10T17:53:03.191804+0000","last_undegraded":"2024-09-10T17:53:03.191804+0000","last_fullsized":"2024-09-10T17:53:03.191804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190906+0000","last_change":"2024-09-10T17:52:36.190567+0000","last_active":"2024-09-10T17:53:03.190906+0000","last_peered":"2024-09-10T17:53:03.190906+0000","last_clean":"2024-09-10T17:53:03.190906+0000","last_became_active":"2024-09-10T17:52:36.190261+0000","last_became_peered":"2024-09-10T17:52:36.190261+0000","last_unstale":"2024-09-10T17:53:03.190906+0000","last_undegraded":"2024-09-10T17:53:03.190906+0000","last_fullsized":"2024-09-10T17:53:03.190906+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187177+0000","last_change":"2024-09-10T17:52:39.638839+0000","last_active":"2024-09-10T17:53:03.187177+0000","last_peered":"2024-09-10T17:53:03.187177+0000","last_clean":"2024-09-10T17:53:03.187177+0000","last_became_active":"2024-09-10T17:52:39.638567+0000","last_became_peered":"2024-09-10T17:52:39.638567+0000","last_unstale":"2024-09-10T17:53:03.187177+0000","last_undegraded":"2024-09-10T17:53:03.187177+0000","last_fullsized":"2024-09-10T17:53:03.187177+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410184+0000","last_change":"2024-09-10T17:52:36.193278+0000","last_active":"2024-09-10T17:53:03.410184+0000","last_peered":"2024-09-10T17:53:03.410184+0000","last_clean":"2024-09-10T17:53:03.410184+0000","last_became_active":"2024-09-10T17:52:36.192979+0000","last_became_peered":"2024-09-10T17:52:36.192979+0000","last_unstale":"2024-09-10T17:53:03.410184+0000","last_undegraded":"2024-09-10T17:53:03.410184+0000","last_fullsized":"2024-09-10T17:53:03.410184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187762+0000","last_change":"2024-09-10T17:52:39.640516+0000","last_active":"2024-09-10T17:53:03.187762+0000","last_peered":"2024-09-10T17:53:03.187762+0000","last_clean":"2024-09-10T17:53:03.187762+0000","last_became_active":"2024-09-10T17:52:39.639996+0000","last_became_peered":"2024-09-10T17:52:39.639996+0000","last_unstale":"2024-09-10T17:53:03.187762+0000","last_undegraded":"2024-09-10T17:53:03.187762+0000","last_fullsized":"2024-09-10T17:53:03.187762+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187676+0000","last_change":"2024-09-10T17:52:36.193781+0000","last_active":"2024-09-10T17:53:03.187676+0000","last_peered":"2024-09-10T17:53:03.187676+0000","last_clean":"2024-09-10T17:53:03.187676+0000","last_became_active":"2024-09-10T17:52:36.193487+0000","last_became_peered":"2024-09-10T17:52:36.193487+0000","last_unstale":"2024-09-10T17:53:03.187676+0000","last_undegraded":"2024-09-10T17:53:03.187676+0000","last_fullsized":"2024-09-10T17:53:03.187676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410374+0000","last_change":"2024-09-10T17:52:39.647909+0000","last_active":"2024-09-10T17:53:03.410374+0000","last_peered":"2024-09-10T17:53:03.410374+0000","last_clean":"2024-09-10T17:53:03.410374+0000","last_became_active":"2024-09-10T17:52:39.647630+0000","last_became_peered":"2024-09-10T17:52:39.647630+0000","last_unstale":"2024-09-10T17:53:03.410374+0000","last_undegraded":"2024-09-10T17:53:03.410374+0000","last_fullsized":"2024-09-10T17:53:03.410374+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190511+0000","last_change":"2024-09-10T17:52:36.200712+0000","last_active":"2024-09-10T17:53:03.190511+0000","last_peered":"2024-09-10T17:53:03.190511+0000","last_clean":"2024-09-10T17:53:03.190511+0000","last_became_active":"2024-09-10T17:52:36.200402+0000","last_became_peered":"2024-09-10T17:52:36.200402+0000","last_unstale":"2024-09-10T17:53:03.190511+0000","last_undegraded":"2024-09-10T17:53:03.190511+0000","last_fullsized":"2024-09-10T17:53:03.190511+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187592+0000","last_change":"2024-09-10T17:52:39.643072+0000","last_active":"2024-09-10T17:53:03.187592+0000","last_peered":"2024-09-10T17:53:03.187592+0000","last_clean":"2024-09-10T17:53:03.187592+0000","last_became_active":"2024-09-10T17:52:39.642792+0000","last_became_peered":"2024-09-10T17:52:39.642792+0000","last_unstale":"2024-09-10T17:53:03.187592+0000","last_undegraded":"2024-09-10T17:53:03.187592+0000","last_fullsized":"2024-09-10T17:53:03.187592+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188619+0000","last_change":"2024-09-10T17:52:36.192033+0000","last_active":"2024-09-10T17:53:03.188619+0000","last_peered":"2024-09-10T17:53:03.188619+0000","last_clean":"2024-09-10T17:53:03.188619+0000","last_became_active":"2024-09-10T17:52:36.191662+0000","last_became_peered":"2024-09-10T17:52:36.191662+0000","last_unstale":"2024-09-10T17:53:03.188619+0000","last_undegraded":"2024-09-10T17:53:03.188619+0000","last_fullsized":"2024-09-10T17:53:03.188619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189158+0000","last_change":"2024-09-10T17:52:39.635594+0000","last_active":"2024-09-10T17:53:03.189158+0000","last_peered":"2024-09-10T17:53:03.189158+0000","last_clean":"2024-09-10T17:53:03.189158+0000","last_became_active":"2024-09-10T17:52:39.635320+0000","last_became_peered":"2024-09-10T17:52:39.635320+0000","last_unstale":"2024-09-10T17:53:03.189158+0000","last_undegraded":"2024-09-10T17:53:03.189158+0000","last_fullsized":"2024-09-10T17:53:03.189158+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192548+0000","last_change":"2024-09-10T17:52:36.194453+0000","last_active":"2024-09-10T17:53:03.192548+0000","last_peered":"2024-09-10T17:53:03.192548+0000","last_clean":"2024-09-10T17:53:03.192548+0000","last_became_active":"2024-09-10T17:52:36.194107+0000","last_became_peered":"2024-09-10T17:52:36.194107+0000","last_unstale":"2024-09-10T17:53:03.192548+0000","last_undegraded":"2024-09-10T17:53:03.192548+0000","last_fullsized":"2024-09-10T17:53:03.192548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.193074+0000","last_change":"2024-09-10T17:52:39.631701+0000","last_active":"2024-09-10T17:53:03.193074+0000","last_peered":"2024-09-10T17:53:03.193074+0000","last_clean":"2024-09-10T17:53:03.193074+0000","last_became_active":"2024-09-10T17:52:39.631299+0000","last_became_peered":"2024-09-10T17:52:39.631299+0000","last_unstale":"2024-09-10T17:53:03.193074+0000","last_undegraded":"2024-09-10T17:53:03.193074+0000","last_fullsized":"2024-09-10T17:53:03.193074+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189753+0000","last_change":"2024-09-10T17:52:36.200196+0000","last_active":"2024-09-10T17:53:03.189753+0000","last_peered":"2024-09-10T17:53:03.189753+0000","last_clean":"2024-09-10T17:53:03.189753+0000","last_became_active":"2024-09-10T17:52:36.199847+0000","last_became_peered":"2024-09-10T17:52:36.199847+0000","last_unstale":"2024-09-10T17:53:03.189753+0000","last_undegraded":"2024-09-10T17:53:03.189753+0000","last_fullsized":"2024-09-10T17:53:03.189753+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187592+0000","last_change":"2024-09-10T17:52:39.643274+0000","last_active":"2024-09-10T17:53:03.187592+0000","last_peered":"2024-09-10T17:53:03.187592+0000","last_clean":"2024-09-10T17:53:03.187592+0000","last_became_active":"2024-09-10T17:52:39.643016+0000","last_became_peered":"2024-09-10T17:52:39.643016+0000","last_unstale":"2024-09-10T17:53:03.187592+0000","last_undegraded":"2024-09-10T17:53:03.187592+0000","last_fullsized":"2024-09-10T17:53:03.187592+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187394+0000","last_change":"2024-09-10T17:52:36.195088+0000","last_active":"2024-09-10T17:53:03.187394+0000","last_peered":"2024-09-10T17:53:03.187394+0000","last_clean":"2024-09-10T17:53:03.187394+0000","last_became_active":"2024-09-10T17:52:36.194698+0000","last_became_peered":"2024-09-10T17:52:36.194698+0000","last_unstale":"2024-09-10T17:53:03.187394+0000","last_undegraded":"2024-09-10T17:53:03.187394+0000","last_fullsized":"2024-09-10T17:53:03.187394+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188613+0000","last_change":"2024-09-10T17:52:39.643179+0000","last_active":"2024-09-10T17:53:03.188613+0000","last_peered":"2024-09-10T17:53:03.188613+0000","last_clean":"2024-09-10T17:53:03.188613+0000","last_became_active":"2024-09-10T17:52:39.642643+0000","last_became_peered":"2024-09-10T17:52:39.642643+0000","last_unstale":"2024-09-10T17:53:03.188613+0000","last_undegraded":"2024-09-10T17:53:03.188613+0000","last_fullsized":"2024-09-10T17:53:03.188613+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187625+0000","last_change":"2024-09-10T17:52:36.188755+0000","last_active":"2024-09-10T17:53:03.187625+0000","last_peered":"2024-09-10T17:53:03.187625+0000","last_clean":"2024-09-10T17:53:03.187625+0000","last_became_active":"2024-09-10T17:52:36.188465+0000","last_became_peered":"2024-09-10T17:52:36.188465+0000","last_unstale":"2024-09-10T17:53:03.187625+0000","last_undegraded":"2024-09-10T17:53:03.187625+0000","last_fullsized":"2024-09-10T17:53:03.187625+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188736+0000","last_change":"2024-09-10T17:52:39.635509+0000","last_active":"2024-09-10T17:53:03.188736+0000","last_peered":"2024-09-10T17:53:03.188736+0000","last_clean":"2024-09-10T17:53:03.188736+0000","last_became_active":"2024-09-10T17:52:39.635118+0000","last_became_peered":"2024-09-10T17:52:39.635118+0000","last_unstale":"2024-09-10T17:53:03.188736+0000","last_undegraded":"2024-09-10T17:53:03.188736+0000","last_fullsized":"2024-09-10T17:53:03.188736+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190512+0000","last_change":"2024-09-10T17:52:36.200921+0000","last_active":"2024-09-10T17:53:03.190512+0000","last_peered":"2024-09-10T17:53:03.190512+0000","last_clean":"2024-09-10T17:53:03.190512+0000","last_became_active":"2024-09-10T17:52:36.200153+0000","last_became_peered":"2024-09-10T17:52:36.200153+0000","last_unstale":"2024-09-10T17:53:03.190512+0000","last_undegraded":"2024-09-10T17:53:03.190512+0000","last_fullsized":"2024-09-10T17:53:03.190512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192383+0000","last_change":"2024-09-10T17:52:39.643628+0000","last_active":"2024-09-10T17:53:03.192383+0000","last_peered":"2024-09-10T17:53:03.192383+0000","last_clean":"2024-09-10T17:53:03.192383+0000","last_became_active":"2024-09-10T17:52:39.643355+0000","last_became_peered":"2024-09-10T17:52:39.643355+0000","last_unstale":"2024-09-10T17:53:03.192383+0000","last_undegraded":"2024-09-10T17:53:03.192383+0000","last_fullsized":"2024-09-10T17:53:03.192383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410290+0000","last_change":"2024-09-10T17:52:39.652448+0000","last_active":"2024-09-10T17:53:03.410290+0000","last_peered":"2024-09-10T17:53:03.410290+0000","last_clean":"2024-09-10T17:53:03.410290+0000","last_became_active":"2024-09-10T17:52:39.652164+0000","last_became_peered":"2024-09-10T17:52:39.652164+0000","last_unstale":"2024-09-10T17:53:03.410290+0000","last_undegraded":"2024-09-10T17:53:03.410290+0000","last_fullsized":"2024-09-10T17:53:03.410290+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190184+0000","last_change":"2024-09-10T17:52:36.200230+0000","last_active":"2024-09-10T17:53:03.190184+0000","last_peered":"2024-09-10T17:53:03.190184+0000","last_clean":"2024-09-10T17:53:03.190184+0000","last_became_active":"2024-09-10T17:52:36.199765+0000","last_became_peered":"2024-09-10T17:52:36.199765+0000","last_unstale":"2024-09-10T17:53:03.190184+0000","last_undegraded":"2024-09-10T17:53:03.190184+0000","last_fullsized":"2024-09-10T17:53:03.190184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410193+0000","last_change":"2024-09-10T17:52:39.652608+0000","last_active":"2024-09-10T17:53:03.410193+0000","last_peered":"2024-09-10T17:53:03.410193+0000","last_clean":"2024-09-10T17:53:03.410193+0000","last_became_active":"2024-09-10T17:52:39.652354+0000","last_became_peered":"2024-09-10T17:52:39.652354+0000","last_unstale":"2024-09-10T17:53:03.410193+0000","last_undegraded":"2024-09-10T17:53:03.410193+0000","last_fullsized":"2024-09-10T17:53:03.410193+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190653+0000","last_change":"2024-09-10T17:52:36.200731+0000","last_active":"2024-09-10T17:53:03.190653+0000","last_peered":"2024-09-10T17:53:03.190653+0000","last_clean":"2024-09-10T17:53:03.190653+0000","last_became_active":"2024-09-10T17:52:36.200429+0000","last_became_peered":"2024-09-10T17:52:36.200429+0000","last_unstale":"2024-09-10T17:53:03.190653+0000","last_undegraded":"2024-09-10T17:53:03.190653+0000","last_fullsized":"2024-09-10T17:53:03.190653+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.193253+0000","last_change":"2024-09-10T17:52:39.640232+0000","last_active":"2024-09-10T17:53:03.193253+0000","last_peered":"2024-09-10T17:53:03.193253+0000","last_clean":"2024-09-10T17:53:03.193253+0000","last_became_active":"2024-09-10T17:52:39.639462+0000","last_became_peered":"2024-09-10T17:52:39.639462+0000","last_unstale":"2024-09-10T17:53:03.193253+0000","last_undegraded":"2024-09-10T17:53:03.193253+0000","last_fullsized":"2024-09-10T17:53:03.193253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189428+0000","last_change":"2024-09-10T17:52:36.190257+0000","last_active":"2024-09-10T17:53:03.189428+0000","last_peered":"2024-09-10T17:53:03.189428+0000","last_clean":"2024-09-10T17:53:03.189428+0000","last_became_active":"2024-09-10T17:52:36.189957+0000","last_became_peered":"2024-09-10T17:52:36.189957+0000","last_unstale":"2024-09-10T17:53:03.189428+0000","last_undegraded":"2024-09-10T17:53:03.189428+0000","last_fullsized":"2024-09-10T17:53:03.189428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189165+0000","last_change":"2024-09-10T17:52:39.636289+0000","last_active":"2024-09-10T17:53:03.189165+0000","last_peered":"2024-09-10T17:53:03.189165+0000","last_clean":"2024-09-10T17:53:03.189165+0000","last_became_active":"2024-09-10T17:52:39.635894+0000","last_became_peered":"2024-09-10T17:52:39.635894+0000","last_unstale":"2024-09-10T17:53:03.189165+0000","last_undegraded":"2024-09-10T17:53:03.189165+0000","last_fullsized":"2024-09-10T17:53:03.189165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"65'4","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.193332+0000","last_change":"2024-09-10T17:52:36.194542+0000","last_active":"2024-09-10T17:53:03.193332+0000","last_peered":"2024-09-10T17:53:03.193332+0000","last_clean":"2024-09-10T17:53:03.193332+0000","last_became_active":"2024-09-10T17:52:36.194232+0000","last_became_peered":"2024-09-10T17:52:36.194232+0000","last_unstale":"2024-09-10T17:53:03.193332+0000","last_undegraded":"2024-09-10T17:53:03.193332+0000","last_fullsized":"2024-09-10T17:53:03.193332+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":7086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233997,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28276,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716876,"statfs":{"total":95995035648,"available":95966081024,"internally_reserved":0,"allocated":1282048,"data_stored":881375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495635,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32368,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712784,"statfs":{"total":95995035648,"available":95961890816,"internally_reserved":0,"allocated":1282048,"data_stored":882062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61799999999999999}]},{"osd":1,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45500000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.38200000000000001}]},{"osd":5,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757271,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31792,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713360,"statfs":{"total":95995035648,"available":95962480640,"internally_reserved":0,"allocated":688128,"data_stored":291503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.622}]},{"osd":2,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.73899999999999999}]},{"osd":4,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":4,"up_from":30,"seq":128849018907,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":700416,"data_stored":291442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.34499999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.79900000000000004,"5min":0.873,"15min":0.873},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.78600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33900000000000002}]},{"osd":1,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.41299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69299999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57799999999999996}]},{"osd":2,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47899999999999998}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.53500000000000003}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182433,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":292402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.24099999999999999}]},{"osd":1,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.373},{"interface":"front","average":{"1min":0.439,"5min":0.433,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.29199999999999998}]},{"osd":4,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66300000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.73099999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47699999999999998}]},{"osd":5,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.498}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411366,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717468,"statfs":{"total":95995035648,"available":95966687232,"internally_reserved":0,"allocated":679936,"data_stored":290461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.29199999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.29899999999999999}]},{"osd":1,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Sep 10 17:53:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.753,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66900000000000004}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.75800000000000001}]},{"osd":6,"last update":"Tue Sep 10 17:52:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":290348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.37,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.216,"15min":0.216},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.28899999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.58999999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.316}]},{"osd":2,"last update":"Tue Sep 10 17:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40200000000000002,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38300000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.29599999999999999}]},{"osd":4,"last update":"Tue Sep 10 17:53:01 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.71699999999999997,"15min":0.60299999999999998},"min":{"1min":0.47899999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":15.68,"5min":15.68,"15min":15.68},"last":0.441},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60299999999999998}]},{"osd":5,"last update":"Tue Sep 10 17:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.433},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.501}]},{"osd":6,"last update":"Tue Sep 10 17:52:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738415,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32380,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712772,"statfs":{"total":95995035648,"available":95961878528,"internally_reserved":0,"allocated":1294336,"data_stored":881830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 17:52:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54400000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.373,"15min":0.36199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.29799999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.371},{"interface":"front","average":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.499}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61499999999999999,"5min":0.62,"15min":0.62},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.34599999999999997}]},{"osd":4,"last update":"Tue Sep 10 17:53:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.66900000000000004,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":7.8869999999999996,"5min":7.8869999999999996,"15min":7.8869999999999996},"last":0.56299999999999994}]},{"osd":5,"last update":"Tue Sep 10 17:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.57799999999999996},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.907,"5min":7.907,"15min":7.907},"last":0.48299999999999998}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9450000000000003,"5min":7.9450000000000003,"15min":7.9450000000000003},"last":0.46300000000000002}]},{"osd":7,"last update":"Tue Sep 10 17:53:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.441},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T17:53:15.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:15 smithi012 ceph-mon[27356]: pgmap v213: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:15.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:15 smithi012 ceph-mon[37454]: pgmap v213: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:15.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:15 smithi089 ceph-mon[31467]: pgmap v213: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:16.651 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T17:53:16.871 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:17.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:17 smithi012 ceph-mon[27356]: pgmap v214: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:17.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:17 smithi012 ceph-mon[37454]: pgmap v214: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:17.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:17 smithi089 ceph-mon[31467]: pgmap v214: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:53:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T17:53:19.283 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:19 smithi012 ceph-mon[37454]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:19.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:19 smithi012 ceph-mon[37454]: pgmap v215: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:19.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:19 smithi012 ceph-mon[27356]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:19.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:19 smithi012 ceph-mon[27356]: pgmap v215: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:19.416 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-10T17:53:17.099057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":235604,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749725612,"statfs":{"total":767960285184,"available":767719026688,"internally_reserved":0,"allocated":7315456,"data_stored":4101423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":233819706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002741"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190723+0000","last_change":"2024-09-10T17:52:39.637199+0000","last_active":"2024-09-10T17:53:03.190723+0000","last_peered":"2024-09-10T17:53:03.190723+0000","last_clean":"2024-09-10T17:53:03.190723+0000","last_became_active":"2024-09-10T17:52:39.636912+0000","last_became_peered":"2024-09-10T17:52:39.636912+0000","last_unstale":"2024-09-10T17:53:03.190723+0000","last_undegraded":"2024-09-10T17:53:03.190723+0000","last_fullsized":"2024-09-10T17:53:03.190723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188541+0000","last_change":"2024-09-10T17:52:39.640227+0000","last_active":"2024-09-10T17:53:03.188541+0000","last_peered":"2024-09-10T17:53:03.188541+0000","last_clean":"2024-09-10T17:53:03.188541+0000","last_became_active":"2024-09-10T17:52:39.639677+0000","last_became_peered":"2024-09-10T17:52:39.639677+0000","last_unstale":"2024-09-10T17:53:03.188541+0000","last_undegraded":"2024-09-10T17:53:03.188541+0000","last_fullsized":"2024-09-10T17:53:03.188541+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192865+0000","last_change":"2024-09-10T17:52:39.634939+0000","last_active":"2024-09-10T17:53:03.192865+0000","last_peered":"2024-09-10T17:53:03.192865+0000","last_clean":"2024-09-10T17:53:03.192865+0000","last_became_active":"2024-09-10T17:52:39.634668+0000","last_became_peered":"2024-09-10T17:52:39.634668+0000","last_unstale":"2024-09-10T17:53:03.192865+0000","last_undegraded":"2024-09-10T17:53:03.192865+0000","last_fullsized":"2024-09-10T17:53:03.192865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410123+0000","last_change":"2024-09-10T17:52:39.652074+0000","last_active":"2024-09-10T17:53:03.410123+0000","last_peered":"2024-09-10T17:53:03.410123+0000","last_clean":"2024-09-10T17:53:03.410123+0000","last_became_active":"2024-09-10T17:52:39.651762+0000","last_became_peered":"2024-09-10T17:52:39.651762+0000","last_unstale":"2024-09-10T17:53:03.410123+0000","last_undegraded":"2024-09-10T17:53:03.410123+0000","last_fullsized":"2024-09-10T17:53:03.410123+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189845+0000","last_change":"2024-09-10T17:52:39.637379+0000","last_active":"2024-09-10T17:53:03.189845+0000","last_peered":"2024-09-10T17:53:03.189845+0000","last_clean":"2024-09-10T17:53:03.189845+0000","last_became_active":"2024-09-10T17:52:39.636370+0000","last_became_peered":"2024-09-10T17:52:39.636370+0000","last_unstale":"2024-09-10T17:53:03.189845+0000","last_undegraded":"2024-09-10T17:53:03.189845+0000","last_fullsized":"2024-09-10T17:53:03.189845+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.409980+0000","last_change":"2024-09-10T17:52:39.646980+0000","last_active":"2024-09-10T17:53:03.409980+0000","last_peered":"2024-09-10T17:53:03.409980+0000","last_clean":"2024-09-10T17:53:03.409980+0000","last_became_active":"2024-09-10T17:52:39.645786+0000","last_became_peered":"2024-09-10T17:52:39.645786+0000","last_unstale":"2024-09-10T17:53:03.409980+0000","last_undegraded":"2024-09-10T17:53:03.409980+0000","last_fullsized":"2024-09-10T17:53:03.409980+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.527641+0000","last_change":"2024-09-10T17:53:04.527641+0000","last_active":"2024-09-10T17:53:04.527641+0000","last_peered":"2024-09-10T17:53:04.527641+0000","last_clean":"2024-09-10T17:53:04.527641+0000","last_became_active":"2024-09-10T17:53:04.527295+0000","last_became_peered":"2024-09-10T17:53:04.527295+0000","last_unstale":"2024-09-10T17:53:04.527641+0000","last_undegraded":"2024-09-10T17:53:04.527641+0000","last_fullsized":"2024-09-10T17:53:04.527641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:12.311291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187841+0000","last_change":"2024-09-10T17:52:39.645147+0000","last_active":"2024-09-10T17:53:03.187841+0000","last_peered":"2024-09-10T17:53:03.187841+0000","last_clean":"2024-09-10T17:53:03.187841+0000","last_became_active":"2024-09-10T17:52:39.644853+0000","last_became_peered":"2024-09-10T17:52:39.644853+0000","last_unstale":"2024-09-10T17:53:03.187841+0000","last_undegraded":"2024-09-10T17:53:03.187841+0000","last_fullsized":"2024-09-10T17:53:03.187841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191352+0000","last_change":"2024-09-10T17:52:39.643055+0000","last_active":"2024-09-10T17:53:03.191352+0000","last_peered":"2024-09-10T17:53:03.191352+0000","last_clean":"2024-09-10T17:53:03.191352+0000","last_became_active":"2024-09-10T17:52:39.642731+0000","last_became_peered":"2024-09-10T17:52:39.642731+0000","last_unstale":"2024-09-10T17:53:03.191352+0000","last_undegraded":"2024-09-10T17:53:03.191352+0000","last_fullsized":"2024-09-10T17:53:03.191352+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192715+0000","last_change":"2024-09-10T17:52:39.642693+0000","last_active":"2024-09-10T17:53:03.192715+0000","last_peered":"2024-09-10T17:53:03.192715+0000","last_clean":"2024-09-10T17:53:03.192715+0000","last_became_active":"2024-09-10T17:52:39.642404+0000","last_became_peered":"2024-09-10T17:52:39.642404+0000","last_unstale":"2024-09-10T17:53:03.192715+0000","last_undegraded":"2024-09-10T17:53:03.192715+0000","last_fullsized":"2024-09-10T17:53:03.192715+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192582+0000","last_change":"2024-09-10T17:52:39.641932+0000","last_active":"2024-09-10T17:53:03.192582+0000","last_peered":"2024-09-10T17:53:03.192582+0000","last_clean":"2024-09-10T17:53:03.192582+0000","last_became_active":"2024-09-10T17:52:39.641622+0000","last_became_peered":"2024-09-10T17:52:39.641622+0000","last_unstale":"2024-09-10T17:53:03.192582+0000","last_undegraded":"2024-09-10T17:53:03.192582+0000","last_fullsized":"2024-09-10T17:53:03.192582+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.527604+0000","last_change":"2024-09-10T17:53:04.527604+0000","last_active":"2024-09-10T17:53:04.527604+0000","last_peered":"2024-09-10T17:53:04.527604+0000","last_clean":"2024-09-10T17:53:04.527604+0000","last_became_active":"2024-09-10T17:53:04.527109+0000","last_became_peered":"2024-09-10T17:53:04.527109+0000","last_unstale":"2024-09-10T17:53:04.527604+0000","last_undegraded":"2024-09-10T17:53:04.527604+0000","last_fullsized":"2024-09-10T17:53:04.527604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188655+0000","last_change":"2024-09-10T17:52:39.642786+0000","last_active":"2024-09-10T17:53:03.188655+0000","last_peered":"2024-09-10T17:53:03.188655+0000","last_clean":"2024-09-10T17:53:03.188655+0000","last_became_active":"2024-09-10T17:52:39.641524+0000","last_became_peered":"2024-09-10T17:52:39.641524+0000","last_unstale":"2024-09-10T17:53:03.188655+0000","last_undegraded":"2024-09-10T17:53:03.188655+0000","last_fullsized":"2024-09-10T17:53:03.188655+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191696+0000","last_change":"2024-09-10T17:52:39.639101+0000","last_active":"2024-09-10T17:53:03.191696+0000","last_peered":"2024-09-10T17:53:03.191696+0000","last_clean":"2024-09-10T17:53:03.191696+0000","last_became_active":"2024-09-10T17:52:39.638816+0000","last_became_peered":"2024-09-10T17:52:39.638816+0000","last_unstale":"2024-09-10T17:53:03.191696+0000","last_undegraded":"2024-09-10T17:53:03.191696+0000","last_fullsized":"2024-09-10T17:53:03.191696+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187468+0000","last_change":"2024-09-10T17:52:39.640880+0000","last_active":"2024-09-10T17:53:03.187468+0000","last_peered":"2024-09-10T17:53:03.187468+0000","last_clean":"2024-09-10T17:53:03.187468+0000","last_became_active":"2024-09-10T17:52:39.640599+0000","last_became_peered":"2024-09-10T17:52:39.640599+0000","last_unstale":"2024-09-10T17:53:03.187468+0000","last_undegraded":"2024-09-10T17:53:03.187468+0000","last_fullsized":"2024-09-10T17:53:03.187468+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.409878+0000","last_change":"2024-09-10T17:52:39.646904+0000","last_active":"2024-09-10T17:53:03.409878+0000","last_peered":"2024-09-10T17:53:03.409878+0000","last_clean":"2024-09-10T17:53:03.409878+0000","last_became_active":"2024-09-10T17:52:39.646649+0000","last_became_peered":"2024-09-10T17:52:39.646649+0000","last_unstale":"2024-09-10T17:53:03.409878+0000","last_undegraded":"2024-09-10T17:53:03.409878+0000","last_fullsized":"2024-09-10T17:53:03.409878+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410566+0000","last_change":"2024-09-10T17:52:39.651784+0000","last_active":"2024-09-10T17:53:03.410566+0000","last_peered":"2024-09-10T17:53:03.410566+0000","last_clean":"2024-09-10T17:53:03.410566+0000","last_became_active":"2024-09-10T17:52:39.651519+0000","last_became_peered":"2024-09-10T17:52:39.651519+0000","last_unstale":"2024-09-10T17:53:03.410566+0000","last_undegraded":"2024-09-10T17:53:03.410566+0000","last_fullsized":"2024-09-10T17:53:03.410566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192086+0000","last_change":"2024-09-10T17:52:39.636540+0000","last_active":"2024-09-10T17:53:03.192086+0000","last_peered":"2024-09-10T17:53:03.192086+0000","last_clean":"2024-09-10T17:53:03.192086+0000","last_became_active":"2024-09-10T17:52:39.636034+0000","last_became_peered":"2024-09-10T17:52:39.636034+0000","last_unstale":"2024-09-10T17:53:03.192086+0000","last_undegraded":"2024-09-10T17:53:03.192086+0000","last_fullsized":"2024-09-10T17:53:03.192086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190407+0000","last_change":"2024-09-10T17:52:39.642764+0000","last_active":"2024-09-10T17:53:03.190407+0000","last_peered":"2024-09-10T17:53:03.190407+0000","last_clean":"2024-09-10T17:53:03.190407+0000","last_became_active":"2024-09-10T17:52:39.642454+0000","last_became_peered":"2024-09-10T17:52:39.642454+0000","last_unstale":"2024-09-10T17:53:03.190407+0000","last_undegraded":"2024-09-10T17:53:03.190407+0000","last_fullsized":"2024-09-10T17:53:03.190407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192775+0000","last_change":"2024-09-10T17:52:39.644420+0000","last_active":"2024-09-10T17:53:03.192775+0000","last_peered":"2024-09-10T17:53:03.192775+0000","last_clean":"2024-09-10T17:53:03.192775+0000","last_became_active":"2024-09-10T17:52:39.644155+0000","last_became_peered":"2024-09-10T17:52:39.644155+0000","last_unstale":"2024-09-10T17:53:03.192775+0000","last_undegraded":"2024-09-10T17:53:03.192775+0000","last_fullsized":"2024-09-10T17:53:03.192775+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192261+0000","last_change":"2024-09-10T17:52:39.631587+0000","last_active":"2024-09-10T17:53:03.192261+0000","last_peered":"2024-09-10T17:53:03.192261+0000","last_clean":"2024-09-10T17:53:03.192261+0000","last_became_active":"2024-09-10T17:52:39.631291+0000","last_became_peered":"2024-09-10T17:52:39.631291+0000","last_unstale":"2024-09-10T17:53:03.192261+0000","last_undegraded":"2024-09-10T17:53:03.192261+0000","last_fullsized":"2024-09-10T17:53:03.192261+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410007+0000","last_change":"2024-09-10T17:52:39.635863+0000","last_active":"2024-09-10T17:53:03.410007+0000","last_peered":"2024-09-10T17:53:03.410007+0000","last_clean":"2024-09-10T17:53:03.410007+0000","last_became_active":"2024-09-10T17:52:39.635566+0000","last_became_peered":"2024-09-10T17:52:39.635566+0000","last_unstale":"2024-09-10T17:53:03.410007+0000","last_undegraded":"2024-09-10T17:53:03.410007+0000","last_fullsized":"2024-09-10T17:53:03.410007+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188685+0000","last_change":"2024-09-10T17:52:39.641463+0000","last_active":"2024-09-10T17:53:03.188685+0000","last_peered":"2024-09-10T17:53:03.188685+0000","last_clean":"2024-09-10T17:53:03.188685+0000","last_became_active":"2024-09-10T17:52:39.640887+0000","last_became_peered":"2024-09-10T17:52:39.640887+0000","last_unstale":"2024-09-10T17:53:03.188685+0000","last_undegraded":"2024-09-10T17:53:03.188685+0000","last_fullsized":"2024-09-10T17:53:03.188685+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.409988+0000","last_change":"2024-09-10T17:52:39.648810+0000","last_active":"2024-09-10T17:53:03.409988+0000","last_peered":"2024-09-10T17:53:03.409988+0000","last_clean":"2024-09-10T17:53:03.409988+0000","last_became_active":"2024-09-10T17:52:39.648476+0000","last_became_peered":"2024-09-10T17:52:39.648476+0000","last_unstale":"2024-09-10T17:53:03.409988+0000","last_undegraded":"2024-09-10T17:53:03.409988+0000","last_fullsized":"2024-09-10T17:53:03.409988+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189099+0000","last_change":"2024-09-10T17:52:39.643794+0000","last_active":"2024-09-10T17:53:03.189099+0000","last_peered":"2024-09-10T17:53:03.189099+0000","last_clean":"2024-09-10T17:53:03.189099+0000","last_became_active":"2024-09-10T17:52:39.643540+0000","last_became_peered":"2024-09-10T17:52:39.643540+0000","last_unstale":"2024-09-10T17:53:03.189099+0000","last_undegraded":"2024-09-10T17:53:03.189099+0000","last_fullsized":"2024-09-10T17:53:03.189099+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192768+0000","last_change":"2024-09-10T17:52:39.650553+0000","last_active":"2024-09-10T17:53:03.192768+0000","last_peered":"2024-09-10T17:53:03.192768+0000","last_clean":"2024-09-10T17:53:03.192768+0000","last_became_active":"2024-09-10T17:52:39.650207+0000","last_became_peered":"2024-09-10T17:52:39.650207+0000","last_unstale":"2024-09-10T17:53:03.192768+0000","last_undegraded":"2024-09-10T17:53:03.192768+0000","last_fullsized":"2024-09-10T17:53:03.192768+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187672+0000","last_change":"2024-09-10T17:52:39.641442+0000","last_active":"2024-09-10T17:53:03.187672+0000","last_peered":"2024-09-10T17:53:03.187672+0000","last_clean":"2024-09-10T17:53:03.187672+0000","last_became_active":"2024-09-10T17:52:39.641158+0000","last_became_peered":"2024-09-10T17:52:39.641158+0000","last_unstale":"2024-09-10T17:53:03.187672+0000","last_undegraded":"2024-09-10T17:53:03.187672+0000","last_fullsized":"2024-09-10T17:53:03.187672+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188428+0000","last_change":"2024-09-10T17:52:39.644997+0000","last_active":"2024-09-10T17:53:03.188428+0000","last_peered":"2024-09-10T17:53:03.188428+0000","last_clean":"2024-09-10T17:53:03.188428+0000","last_became_active":"2024-09-10T17:52:39.643999+0000","last_became_peered":"2024-09-10T17:52:39.643999+0000","last_unstale":"2024-09-10T17:53:03.188428+0000","last_undegraded":"2024-09-10T17:53:03.188428+0000","last_fullsized":"2024-09-10T17:53:03.188428+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192340+0000","last_change":"2024-09-10T17:52:39.632927+0000","last_active":"2024-09-10T17:53:03.192340+0000","last_peered":"2024-09-10T17:53:03.192340+0000","last_clean":"2024-09-10T17:53:03.192340+0000","last_became_active":"2024-09-10T17:52:39.632680+0000","last_became_peered":"2024-09-10T17:52:39.632680+0000","last_unstale":"2024-09-10T17:53:03.192340+0000","last_undegraded":"2024-09-10T17:53:03.192340+0000","last_fullsized":"2024-09-10T17:53:03.192340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410081+0000","last_change":"2024-09-10T17:52:39.648726+0000","last_active":"2024-09-10T17:53:03.410081+0000","last_peered":"2024-09-10T17:53:03.410081+0000","last_clean":"2024-09-10T17:53:03.410081+0000","last_became_active":"2024-09-10T17:52:39.648448+0000","last_became_peered":"2024-09-10T17:52:39.648448+0000","last_unstale":"2024-09-10T17:53:03.410081+0000","last_undegraded":"2024-09-10T17:53:03.410081+0000","last_fullsized":"2024-09-10T17:53:03.410081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190676+0000","last_change":"2024-09-10T17:52:39.634918+0000","last_active":"2024-09-10T17:53:03.190676+0000","last_peered":"2024-09-10T17:53:03.190676+0000","last_clean":"2024-09-10T17:53:03.190676+0000","last_became_active":"2024-09-10T17:52:39.634622+0000","last_became_peered":"2024-09-10T17:52:39.634622+0000","last_unstale":"2024-09-10T17:53:03.190676+0000","last_undegraded":"2024-09-10T17:53:03.190676+0000","last_fullsized":"2024-09-10T17:53:03.190676+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192287+0000","last_change":"2024-09-10T17:52:39.642111+0000","last_active":"2024-09-10T17:53:03.192287+0000","last_peered":"2024-09-10T17:53:03.192287+0000","last_clean":"2024-09-10T17:53:03.192287+0000","last_became_active":"2024-09-10T17:52:39.641786+0000","last_became_peered":"2024-09-10T17:52:39.641786+0000","last_unstale":"2024-09-10T17:53:03.192287+0000","last_undegraded":"2024-09-10T17:53:03.192287+0000","last_fullsized":"2024-09-10T17:53:03.192287+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187474+0000","last_change":"2024-09-10T17:52:39.632064+0000","last_active":"2024-09-10T17:53:03.187474+0000","last_peered":"2024-09-10T17:53:03.187474+0000","last_clean":"2024-09-10T17:53:03.187474+0000","last_became_active":"2024-09-10T17:52:39.631529+0000","last_became_peered":"2024-09-10T17:52:39.631529+0000","last_unstale":"2024-09-10T17:53:03.187474+0000","last_undegraded":"2024-09-10T17:53:03.187474+0000","last_fullsized":"2024-09-10T17:53:03.187474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188910+0000","last_change":"2024-09-10T17:52:36.192274+0000","last_active":"2024-09-10T17:53:03.188910+0000","last_peered":"2024-09-10T17:53:03.188910+0000","last_clean":"2024-09-10T17:53:03.188910+0000","last_became_active":"2024-09-10T17:52:36.191998+0000","last_became_peered":"2024-09-10T17:52:36.191998+0000","last_unstale":"2024-09-10T17:53:03.188910+0000","last_undegraded":"2024-09-10T17:53:03.188910+0000","last_fullsized":"2024-09-10T17:53:03.188910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.205276+0000","last_change":"2024-09-10T17:53:04.205276+0000","last_active":"2024-09-10T17:53:04.205276+0000","last_peered":"2024-09-10T17:53:04.205276+0000","last_clean":"2024-09-10T17:53:04.205276+0000","last_became_active":"2024-09-10T17:53:04.204905+0000","last_became_peered":"2024-09-10T17:53:04.204905+0000","last_unstale":"2024-09-10T17:53:04.205276+0000","last_undegraded":"2024-09-10T17:53:04.205276+0000","last_fullsized":"2024-09-10T17:53:04.205276+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192685+0000","last_change":"2024-09-10T17:52:36.190911+0000","last_active":"2024-09-10T17:53:03.192685+0000","last_peered":"2024-09-10T17:53:03.192685+0000","last_clean":"2024-09-10T17:53:03.192685+0000","last_became_active":"2024-09-10T17:52:36.190437+0000","last_became_peered":"2024-09-10T17:52:36.190437+0000","last_unstale":"2024-09-10T17:53:03.192685+0000","last_undegraded":"2024-09-10T17:53:03.192685+0000","last_fullsized":"2024-09-10T17:53:03.192685+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188839+0000","last_change":"2024-09-10T17:52:36.192952+0000","last_active":"2024-09-10T17:53:03.188839+0000","last_peered":"2024-09-10T17:53:03.188839+0000","last_clean":"2024-09-10T17:53:03.188839+0000","last_became_active":"2024-09-10T17:52:36.192199+0000","last_became_peered":"2024-09-10T17:52:36.192199+0000","last_unstale":"2024-09-10T17:53:03.188839+0000","last_undegraded":"2024-09-10T17:53:03.188839+0000","last_fullsized":"2024-09-10T17:53:03.188839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187909+0000","last_change":"2024-09-10T17:52:39.646604+0000","last_active":"2024-09-10T17:53:03.187909+0000","last_peered":"2024-09-10T17:53:03.187909+0000","last_clean":"2024-09-10T17:53:03.187909+0000","last_became_active":"2024-09-10T17:52:39.646321+0000","last_became_peered":"2024-09-10T17:52:39.646321+0000","last_unstale":"2024-09-10T17:53:03.187909+0000","last_undegraded":"2024-09-10T17:53:03.187909+0000","last_fullsized":"2024-09-10T17:53:03.187909+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.409988+0000","last_change":"2024-09-10T17:52:36.194360+0000","last_active":"2024-09-10T17:53:03.409988+0000","last_peered":"2024-09-10T17:53:03.409988+0000","last_clean":"2024-09-10T17:53:03.409988+0000","last_became_active":"2024-09-10T17:52:36.194106+0000","last_became_peered":"2024-09-10T17:52:36.194106+0000","last_unstale":"2024-09-10T17:53:03.409988+0000","last_undegraded":"2024-09-10T17:53:03.409988+0000","last_fullsized":"2024-09-10T17:53:03.409988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187278+0000","last_change":"2024-09-10T17:52:39.637886+0000","last_active":"2024-09-10T17:53:03.187278+0000","last_peered":"2024-09-10T17:53:03.187278+0000","last_clean":"2024-09-10T17:53:03.187278+0000","last_became_active":"2024-09-10T17:52:39.637615+0000","last_became_peered":"2024-09-10T17:52:39.637615+0000","last_unstale":"2024-09-10T17:53:03.187278+0000","last_undegraded":"2024-09-10T17:53:03.187278+0000","last_fullsized":"2024-09-10T17:53:03.187278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192508+0000","last_change":"2024-09-10T17:52:36.193200+0000","last_active":"2024-09-10T17:53:03.192508+0000","last_peered":"2024-09-10T17:53:03.192508+0000","last_clean":"2024-09-10T17:53:03.192508+0000","last_became_active":"2024-09-10T17:52:36.192223+0000","last_became_peered":"2024-09-10T17:52:36.192223+0000","last_unstale":"2024-09-10T17:53:03.192508+0000","last_undegraded":"2024-09-10T17:53:03.192508+0000","last_fullsized":"2024-09-10T17:53:03.192508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410354+0000","last_change":"2024-09-10T17:52:39.646338+0000","last_active":"2024-09-10T17:53:03.410354+0000","last_peered":"2024-09-10T17:53:03.410354+0000","last_clean":"2024-09-10T17:53:03.410354+0000","last_became_active":"2024-09-10T17:52:39.645661+0000","last_became_peered":"2024-09-10T17:52:39.645661+0000","last_unstale":"2024-09-10T17:53:03.410354+0000","last_undegraded":"2024-09-10T17:53:03.410354+0000","last_fullsized":"2024-09-10T17:53:03.410354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410454+0000","last_change":"2024-09-10T17:52:36.192408+0000","last_active":"2024-09-10T17:53:03.410454+0000","last_peered":"2024-09-10T17:53:03.410454+0000","last_clean":"2024-09-10T17:53:03.410454+0000","last_became_active":"2024-09-10T17:52:36.192132+0000","last_became_peered":"2024-09-10T17:52:36.192132+0000","last_unstale":"2024-09-10T17:53:03.410454+0000","last_undegraded":"2024-09-10T17:53:03.410454+0000","last_fullsized":"2024-09-10T17:53:03.410454+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.193237+0000","last_change":"2024-09-10T17:52:39.641531+0000","last_active":"2024-09-10T17:53:03.193237+0000","last_peered":"2024-09-10T17:53:03.193237+0000","last_clean":"2024-09-10T17:53:03.193237+0000","last_became_active":"2024-09-10T17:52:39.639958+0000","last_became_peered":"2024-09-10T17:52:39.639958+0000","last_unstale":"2024-09-10T17:53:03.193237+0000","last_undegraded":"2024-09-10T17:53:03.193237+0000","last_fullsized":"2024-09-10T17:53:03.193237+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"65'3","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187822+0000","last_change":"2024-09-10T17:52:36.188432+0000","last_active":"2024-09-10T17:53:03.187822+0000","last_peered":"2024-09-10T17:53:03.187822+0000","last_clean":"2024-09-10T17:53:03.187822+0000","last_became_active":"2024-09-10T17:52:36.188019+0000","last_became_peered":"2024-09-10T17:52:36.188019+0000","last_unstale":"2024-09-10T17:53:03.187822+0000","last_undegraded":"2024-09-10T17:53:03.187822+0000","last_fullsized":"2024-09-10T17:53:03.187822+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187722+0000","last_change":"2024-09-10T17:52:39.642140+0000","last_active":"2024-09-10T17:53:03.187722+0000","last_peered":"2024-09-10T17:53:03.187722+0000","last_clean":"2024-09-10T17:53:03.187722+0000","last_became_active":"2024-09-10T17:52:39.641201+0000","last_became_peered":"2024-09-10T17:52:39.641201+0000","last_unstale":"2024-09-10T17:53:03.187722+0000","last_undegraded":"2024-09-10T17:53:03.187722+0000","last_fullsized":"2024-09-10T17:53:03.187722+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'6","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192850+0000","last_change":"2024-09-10T17:52:36.190637+0000","last_active":"2024-09-10T17:53:03.192850+0000","last_peered":"2024-09-10T17:53:03.192850+0000","last_clean":"2024-09-10T17:53:03.192850+0000","last_became_active":"2024-09-10T17:52:36.190315+0000","last_became_peered":"2024-09-10T17:52:36.190315+0000","last_unstale":"2024-09-10T17:53:03.192850+0000","last_undegraded":"2024-09-10T17:53:03.192850+0000","last_fullsized":"2024-09-10T17:53:03.192850+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190098+0000","last_change":"2024-09-10T17:52:39.647058+0000","last_active":"2024-09-10T17:53:03.190098+0000","last_peered":"2024-09-10T17:53:03.190098+0000","last_clean":"2024-09-10T17:53:03.190098+0000","last_became_active":"2024-09-10T17:52:39.646127+0000","last_became_peered":"2024-09-10T17:52:39.646127+0000","last_unstale":"2024-09-10T17:53:03.190098+0000","last_undegraded":"2024-09-10T17:53:03.190098+0000","last_fullsized":"2024-09-10T17:53:03.190098+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192445+0000","last_change":"2024-09-10T17:52:36.197133+0000","last_active":"2024-09-10T17:53:03.192445+0000","last_peered":"2024-09-10T17:53:03.192445+0000","last_clean":"2024-09-10T17:53:03.192445+0000","last_became_active":"2024-09-10T17:52:36.196798+0000","last_became_peered":"2024-09-10T17:52:36.196798+0000","last_unstale":"2024-09-10T17:53:03.192445+0000","last_undegraded":"2024-09-10T17:53:03.192445+0000","last_fullsized":"2024-09-10T17:53:03.192445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192052+0000","last_change":"2024-09-10T17:52:39.632963+0000","last_active":"2024-09-10T17:53:03.192052+0000","last_peered":"2024-09-10T17:53:03.192052+0000","last_clean":"2024-09-10T17:53:03.192052+0000","last_became_active":"2024-09-10T17:52:39.632648+0000","last_became_peered":"2024-09-10T17:52:39.632648+0000","last_unstale":"2024-09-10T17:53:03.192052+0000","last_undegraded":"2024-09-10T17:53:03.192052+0000","last_fullsized":"2024-09-10T17:53:03.192052+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410189+0000","last_change":"2024-09-10T17:52:36.190919+0000","last_active":"2024-09-10T17:53:03.410189+0000","last_peered":"2024-09-10T17:53:03.410189+0000","last_clean":"2024-09-10T17:53:03.410189+0000","last_became_active":"2024-09-10T17:52:36.190637+0000","last_became_peered":"2024-09-10T17:52:36.190637+0000","last_unstale":"2024-09-10T17:53:03.410189+0000","last_undegraded":"2024-09-10T17:53:03.410189+0000","last_fullsized":"2024-09-10T17:53:03.410189+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189957+0000","last_change":"2024-09-10T17:52:39.637441+0000","last_active":"2024-09-10T17:53:03.189957+0000","last_peered":"2024-09-10T17:53:03.189957+0000","last_clean":"2024-09-10T17:53:03.189957+0000","last_became_active":"2024-09-10T17:52:39.636759+0000","last_became_peered":"2024-09-10T17:52:39.636759+0000","last_unstale":"2024-09-10T17:53:03.189957+0000","last_undegraded":"2024-09-10T17:53:03.189957+0000","last_fullsized":"2024-09-10T17:53:03.189957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192893+0000","last_change":"2024-09-10T17:52:36.192102+0000","last_active":"2024-09-10T17:53:03.192893+0000","last_peered":"2024-09-10T17:53:03.192893+0000","last_clean":"2024-09-10T17:53:03.192893+0000","last_became_active":"2024-09-10T17:52:36.191743+0000","last_became_peered":"2024-09-10T17:52:36.191743+0000","last_unstale":"2024-09-10T17:53:03.192893+0000","last_undegraded":"2024-09-10T17:53:03.192893+0000","last_fullsized":"2024-09-10T17:53:03.192893+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192172+0000","last_change":"2024-09-10T17:52:39.640124+0000","last_active":"2024-09-10T17:53:03.192172+0000","last_peered":"2024-09-10T17:53:03.192172+0000","last_clean":"2024-09-10T17:53:03.192172+0000","last_became_active":"2024-09-10T17:52:39.639840+0000","last_became_peered":"2024-09-10T17:52:39.639840+0000","last_unstale":"2024-09-10T17:53:03.192172+0000","last_undegraded":"2024-09-10T17:53:03.192172+0000","last_fullsized":"2024-09-10T17:53:03.192172+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"65'8","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191624+0000","last_change":"2024-09-10T17:52:36.191246+0000","last_active":"2024-09-10T17:53:03.191624+0000","last_peered":"2024-09-10T17:53:03.191624+0000","last_clean":"2024-09-10T17:53:03.191624+0000","last_became_active":"2024-09-10T17:52:36.190916+0000","last_became_peered":"2024-09-10T17:52:36.190916+0000","last_unstale":"2024-09-10T17:53:03.191624+0000","last_undegraded":"2024-09-10T17:53:03.191624+0000","last_fullsized":"2024-09-10T17:53:03.191624+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191104+0000","last_change":"2024-09-10T17:52:39.647318+0000","last_active":"2024-09-10T17:53:03.191104+0000","last_peered":"2024-09-10T17:53:03.191104+0000","last_clean":"2024-09-10T17:53:03.191104+0000","last_became_active":"2024-09-10T17:52:39.647020+0000","last_became_peered":"2024-09-10T17:52:39.647020+0000","last_unstale":"2024-09-10T17:53:03.191104+0000","last_undegraded":"2024-09-10T17:53:03.191104+0000","last_fullsized":"2024-09-10T17:53:03.191104+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188360+0000","last_change":"2024-09-10T17:52:36.194263+0000","last_active":"2024-09-10T17:53:03.188360+0000","last_peered":"2024-09-10T17:53:03.188360+0000","last_clean":"2024-09-10T17:53:03.188360+0000","last_became_active":"2024-09-10T17:52:36.193894+0000","last_became_peered":"2024-09-10T17:52:36.193894+0000","last_unstale":"2024-09-10T17:53:03.188360+0000","last_undegraded":"2024-09-10T17:53:03.188360+0000","last_fullsized":"2024-09-10T17:53:03.188360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.205325+0000","last_change":"2024-09-10T17:53:04.205325+0000","last_active":"2024-09-10T17:53:04.205325+0000","last_peered":"2024-09-10T17:53:04.205325+0000","last_clean":"2024-09-10T17:53:04.205325+0000","last_became_active":"2024-09-10T17:53:04.204953+0000","last_became_peered":"2024-09-10T17:53:04.204953+0000","last_unstale":"2024-09-10T17:53:04.205325+0000","last_undegraded":"2024-09-10T17:53:04.205325+0000","last_fullsized":"2024-09-10T17:53:04.205325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192272+0000","last_change":"2024-09-10T17:52:36.191958+0000","last_active":"2024-09-10T17:53:03.192272+0000","last_peered":"2024-09-10T17:53:03.192272+0000","last_clean":"2024-09-10T17:53:03.192272+0000","last_became_active":"2024-09-10T17:52:36.191684+0000","last_became_peered":"2024-09-10T17:52:36.191684+0000","last_unstale":"2024-09-10T17:53:03.192272+0000","last_undegraded":"2024-09-10T17:53:03.192272+0000","last_fullsized":"2024-09-10T17:53:03.192272+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190808+0000","last_change":"2024-09-10T17:52:39.648857+0000","last_active":"2024-09-10T17:53:03.190808+0000","last_peered":"2024-09-10T17:53:03.190808+0000","last_clean":"2024-09-10T17:53:03.190808+0000","last_became_active":"2024-09-10T17:52:39.648574+0000","last_became_peered":"2024-09-10T17:52:39.648574+0000","last_unstale":"2024-09-10T17:53:03.190808+0000","last_undegraded":"2024-09-10T17:53:03.190808+0000","last_fullsized":"2024-09-10T17:53:03.190808+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187902+0000","last_change":"2024-09-10T17:52:36.185952+0000","last_active":"2024-09-10T17:53:03.187902+0000","last_peered":"2024-09-10T17:53:03.187902+0000","last_clean":"2024-09-10T17:53:03.187902+0000","last_became_active":"2024-09-10T17:52:36.184643+0000","last_became_peered":"2024-09-10T17:52:36.184643+0000","last_unstale":"2024-09-10T17:53:03.187902+0000","last_undegraded":"2024-09-10T17:53:03.187902+0000","last_fullsized":"2024-09-10T17:53:03.187902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410216+0000","last_change":"2024-09-10T17:52:39.651773+0000","last_active":"2024-09-10T17:53:03.410216+0000","last_peered":"2024-09-10T17:53:03.410216+0000","last_clean":"2024-09-10T17:53:03.410216+0000","last_became_active":"2024-09-10T17:52:39.650072+0000","last_became_peered":"2024-09-10T17:52:39.650072+0000","last_unstale":"2024-09-10T17:53:03.410216+0000","last_undegraded":"2024-09-10T17:53:03.410216+0000","last_fullsized":"2024-09-10T17:53:03.410216+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191305+0000","last_change":"2024-09-10T17:52:36.191363+0000","last_active":"2024-09-10T17:53:03.191305+0000","last_peered":"2024-09-10T17:53:03.191305+0000","last_clean":"2024-09-10T17:53:03.191305+0000","last_became_active":"2024-09-10T17:52:36.190976+0000","last_became_peered":"2024-09-10T17:52:36.190976+0000","last_unstale":"2024-09-10T17:53:03.191305+0000","last_undegraded":"2024-09-10T17:53:03.191305+0000","last_fullsized":"2024-09-10T17:53:03.191305+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190295+0000","last_change":"2024-09-10T17:52:39.643612+0000","last_active":"2024-09-10T17:53:03.190295+0000","last_peered":"2024-09-10T17:53:03.190295+0000","last_clean":"2024-09-10T17:53:03.190295+0000","last_became_active":"2024-09-10T17:52:39.643274+0000","last_became_peered":"2024-09-10T17:52:39.643274+0000","last_unstale":"2024-09-10T17:53:03.190295+0000","last_undegraded":"2024-09-10T17:53:03.190295+0000","last_fullsized":"2024-09-10T17:53:03.190295+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":225,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189942+0000","last_change":"2024-09-10T17:52:12.719807+0000","last_active":"2024-09-10T17:53:03.189942+0000","last_peered":"2024-09-10T17:53:03.189942+0000","last_clean":"2024-09-10T17:53:03.189942+0000","last_became_active":"2024-09-10T17:52:12.719452+0000","last_became_peered":"2024-09-10T17:52:12.719452+0000","last_unstale":"2024-09-10T17:53:03.189942+0000","last_undegraded":"2024-09-10T17:53:03.189942+0000","last_fullsized":"2024-09-10T17:53:03.189942+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_clean_scrub_stamp":"2024-09-10T17:50:14.084625+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410053+0000","last_change":"2024-09-10T17:52:36.195598+0000","last_active":"2024-09-10T17:53:03.410053+0000","last_peered":"2024-09-10T17:53:03.410053+0000","last_clean":"2024-09-10T17:53:03.410053+0000","last_became_active":"2024-09-10T17:52:36.195203+0000","last_became_peered":"2024-09-10T17:52:36.195203+0000","last_unstale":"2024-09-10T17:53:03.410053+0000","last_undegraded":"2024-09-10T17:53:03.410053+0000","last_fullsized":"2024-09-10T17:53:03.410053+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188720+0000","last_change":"2024-09-10T17:52:39.644934+0000","last_active":"2024-09-10T17:53:03.188720+0000","last_peered":"2024-09-10T17:53:03.188720+0000","last_clean":"2024-09-10T17:53:03.188720+0000","last_became_active":"2024-09-10T17:52:39.644205+0000","last_became_peered":"2024-09-10T17:52:39.644205+0000","last_unstale":"2024-09-10T17:53:03.188720+0000","last_undegraded":"2024-09-10T17:53:03.188720+0000","last_fullsized":"2024-09-10T17:53:03.188720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T17:53:04.527840+0000","last_change":"2024-09-10T17:53:04.527840+0000","last_active":"2024-09-10T17:53:04.527840+0000","last_peered":"2024-09-10T17:53:04.527840+0000","last_clean":"2024-09-10T17:53:04.527840+0000","last_became_active":"2024-09-10T17:53:04.527470+0000","last_became_peered":"2024-09-10T17:53:04.527470+0000","last_unstale":"2024-09-10T17:53:04.527840+0000","last_undegraded":"2024-09-10T17:53:04.527840+0000","last_fullsized":"2024-09-10T17:53:04.527840+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.191804+0000","last_change":"2024-09-10T17:52:39.632868+0000","last_active":"2024-09-10T17:53:03.191804+0000","last_peered":"2024-09-10T17:53:03.191804+0000","last_clean":"2024-09-10T17:53:03.191804+0000","last_became_active":"2024-09-10T17:52:39.632549+0000","last_became_peered":"2024-09-10T17:52:39.632549+0000","last_unstale":"2024-09-10T17:53:03.191804+0000","last_undegraded":"2024-09-10T17:53:03.191804+0000","last_fullsized":"2024-09-10T17:53:03.191804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190906+0000","last_change":"2024-09-10T17:52:36.190567+0000","last_active":"2024-09-10T17:53:03.190906+0000","last_peered":"2024-09-10T17:53:03.190906+0000","last_clean":"2024-09-10T17:53:03.190906+0000","last_became_active":"2024-09-10T17:52:36.190261+0000","last_became_peered":"2024-09-10T17:52:36.190261+0000","last_unstale":"2024-09-10T17:53:03.190906+0000","last_undegraded":"2024-09-10T17:53:03.190906+0000","last_fullsized":"2024-09-10T17:53:03.190906+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187177+0000","last_change":"2024-09-10T17:52:39.638839+0000","last_active":"2024-09-10T17:53:03.187177+0000","last_peered":"2024-09-10T17:53:03.187177+0000","last_clean":"2024-09-10T17:53:03.187177+0000","last_became_active":"2024-09-10T17:52:39.638567+0000","last_became_peered":"2024-09-10T17:52:39.638567+0000","last_unstale":"2024-09-10T17:53:03.187177+0000","last_undegraded":"2024-09-10T17:53:03.187177+0000","last_fullsized":"2024-09-10T17:53:03.187177+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410184+0000","last_change":"2024-09-10T17:52:36.193278+0000","last_active":"2024-09-10T17:53:03.410184+0000","last_peered":"2024-09-10T17:53:03.410184+0000","last_clean":"2024-09-10T17:53:03.410184+0000","last_became_active":"2024-09-10T17:52:36.192979+0000","last_became_peered":"2024-09-10T17:52:36.192979+0000","last_unstale":"2024-09-10T17:53:03.410184+0000","last_undegraded":"2024-09-10T17:53:03.410184+0000","last_fullsized":"2024-09-10T17:53:03.410184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187762+0000","last_change":"2024-09-10T17:52:39.640516+0000","last_active":"2024-09-10T17:53:03.187762+0000","last_peered":"2024-09-10T17:53:03.187762+0000","last_clean":"2024-09-10T17:53:03.187762+0000","last_became_active":"2024-09-10T17:52:39.639996+0000","last_became_peered":"2024-09-10T17:52:39.639996+0000","last_unstale":"2024-09-10T17:53:03.187762+0000","last_undegraded":"2024-09-10T17:53:03.187762+0000","last_fullsized":"2024-09-10T17:53:03.187762+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187676+0000","last_change":"2024-09-10T17:52:36.193781+0000","last_active":"2024-09-10T17:53:03.187676+0000","last_peered":"2024-09-10T17:53:03.187676+0000","last_clean":"2024-09-10T17:53:03.187676+0000","last_became_active":"2024-09-10T17:52:36.193487+0000","last_became_peered":"2024-09-10T17:52:36.193487+0000","last_unstale":"2024-09-10T17:53:03.187676+0000","last_undegraded":"2024-09-10T17:53:03.187676+0000","last_fullsized":"2024-09-10T17:53:03.187676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410374+0000","last_change":"2024-09-10T17:52:39.647909+0000","last_active":"2024-09-10T17:53:03.410374+0000","last_peered":"2024-09-10T17:53:03.410374+0000","last_clean":"2024-09-10T17:53:03.410374+0000","last_became_active":"2024-09-10T17:52:39.647630+0000","last_became_peered":"2024-09-10T17:52:39.647630+0000","last_unstale":"2024-09-10T17:53:03.410374+0000","last_undegraded":"2024-09-10T17:53:03.410374+0000","last_fullsized":"2024-09-10T17:53:03.410374+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190511+0000","last_change":"2024-09-10T17:52:36.200712+0000","last_active":"2024-09-10T17:53:03.190511+0000","last_peered":"2024-09-10T17:53:03.190511+0000","last_clean":"2024-09-10T17:53:03.190511+0000","last_became_active":"2024-09-10T17:52:36.200402+0000","last_became_peered":"2024-09-10T17:52:36.200402+0000","last_unstale":"2024-09-10T17:53:03.190511+0000","last_undegraded":"2024-09-10T17:53:03.190511+0000","last_fullsized":"2024-09-10T17:53:03.190511+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187592+0000","last_change":"2024-09-10T17:52:39.643072+0000","last_active":"2024-09-10T17:53:03.187592+0000","last_peered":"2024-09-10T17:53:03.187592+0000","last_clean":"2024-09-10T17:53:03.187592+0000","last_became_active":"2024-09-10T17:52:39.642792+0000","last_became_peered":"2024-09-10T17:52:39.642792+0000","last_unstale":"2024-09-10T17:53:03.187592+0000","last_undegraded":"2024-09-10T17:53:03.187592+0000","last_fullsized":"2024-09-10T17:53:03.187592+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188619+0000","last_change":"2024-09-10T17:52:36.192033+0000","last_active":"2024-09-10T17:53:03.188619+0000","last_peered":"2024-09-10T17:53:03.188619+0000","last_clean":"2024-09-10T17:53:03.188619+0000","last_became_active":"2024-09-10T17:52:36.191662+0000","last_became_peered":"2024-09-10T17:52:36.191662+0000","last_unstale":"2024-09-10T17:53:03.188619+0000","last_undegraded":"2024-09-10T17:53:03.188619+0000","last_fullsized":"2024-09-10T17:53:03.188619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189158+0000","last_change":"2024-09-10T17:52:39.635594+0000","last_active":"2024-09-10T17:53:03.189158+0000","last_peered":"2024-09-10T17:53:03.189158+0000","last_clean":"2024-09-10T17:53:03.189158+0000","last_became_active":"2024-09-10T17:52:39.635320+0000","last_became_peered":"2024-09-10T17:52:39.635320+0000","last_unstale":"2024-09-10T17:53:03.189158+0000","last_undegraded":"2024-09-10T17:53:03.189158+0000","last_fullsized":"2024-09-10T17:53:03.189158+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192548+0000","last_change":"2024-09-10T17:52:36.194453+0000","last_active":"2024-09-10T17:53:03.192548+0000","last_peered":"2024-09-10T17:53:03.192548+0000","last_clean":"2024-09-10T17:53:03.192548+0000","last_became_active":"2024-09-10T17:52:36.194107+0000","last_became_peered":"2024-09-10T17:52:36.194107+0000","last_unstale":"2024-09-10T17:53:03.192548+0000","last_undegraded":"2024-09-10T17:53:03.192548+0000","last_fullsized":"2024-09-10T17:53:03.192548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.193074+0000","last_change":"2024-09-10T17:52:39.631701+0000","last_active":"2024-09-10T17:53:03.193074+0000","last_peered":"2024-09-10T17:53:03.193074+0000","last_clean":"2024-09-10T17:53:03.193074+0000","last_became_active":"2024-09-10T17:52:39.631299+0000","last_became_peered":"2024-09-10T17:52:39.631299+0000","last_unstale":"2024-09-10T17:53:03.193074+0000","last_undegraded":"2024-09-10T17:53:03.193074+0000","last_fullsized":"2024-09-10T17:53:03.193074+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189753+0000","last_change":"2024-09-10T17:52:36.200196+0000","last_active":"2024-09-10T17:53:03.189753+0000","last_peered":"2024-09-10T17:53:03.189753+0000","last_clean":"2024-09-10T17:53:03.189753+0000","last_became_active":"2024-09-10T17:52:36.199847+0000","last_became_peered":"2024-09-10T17:52:36.199847+0000","last_unstale":"2024-09-10T17:53:03.189753+0000","last_undegraded":"2024-09-10T17:53:03.189753+0000","last_fullsized":"2024-09-10T17:53:03.189753+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187592+0000","last_change":"2024-09-10T17:52:39.643274+0000","last_active":"2024-09-10T17:53:03.187592+0000","last_peered":"2024-09-10T17:53:03.187592+0000","last_clean":"2024-09-10T17:53:03.187592+0000","last_became_active":"2024-09-10T17:52:39.643016+0000","last_became_peered":"2024-09-10T17:52:39.643016+0000","last_unstale":"2024-09-10T17:53:03.187592+0000","last_undegraded":"2024-09-10T17:53:03.187592+0000","last_fullsized":"2024-09-10T17:53:03.187592+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187394+0000","last_change":"2024-09-10T17:52:36.195088+0000","last_active":"2024-09-10T17:53:03.187394+0000","last_peered":"2024-09-10T17:53:03.187394+0000","last_clean":"2024-09-10T17:53:03.187394+0000","last_became_active":"2024-09-10T17:52:36.194698+0000","last_became_peered":"2024-09-10T17:52:36.194698+0000","last_unstale":"2024-09-10T17:53:03.187394+0000","last_undegraded":"2024-09-10T17:53:03.187394+0000","last_fullsized":"2024-09-10T17:53:03.187394+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188613+0000","last_change":"2024-09-10T17:52:39.643179+0000","last_active":"2024-09-10T17:53:03.188613+0000","last_peered":"2024-09-10T17:53:03.188613+0000","last_clean":"2024-09-10T17:53:03.188613+0000","last_became_active":"2024-09-10T17:52:39.642643+0000","last_became_peered":"2024-09-10T17:52:39.642643+0000","last_unstale":"2024-09-10T17:53:03.188613+0000","last_undegraded":"2024-09-10T17:53:03.188613+0000","last_fullsized":"2024-09-10T17:53:03.188613+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.187625+0000","last_change":"2024-09-10T17:52:36.188755+0000","last_active":"2024-09-10T17:53:03.187625+0000","last_peered":"2024-09-10T17:53:03.187625+0000","last_clean":"2024-09-10T17:53:03.187625+0000","last_became_active":"2024-09-10T17:52:36.188465+0000","last_became_peered":"2024-09-10T17:52:36.188465+0000","last_unstale":"2024-09-10T17:53:03.187625+0000","last_undegraded":"2024-09-10T17:53:03.187625+0000","last_fullsized":"2024-09-10T17:53:03.187625+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.188736+0000","last_change":"2024-09-10T17:52:39.635509+0000","last_active":"2024-09-10T17:53:03.188736+0000","last_peered":"2024-09-10T17:53:03.188736+0000","last_clean":"2024-09-10T17:53:03.188736+0000","last_became_active":"2024-09-10T17:52:39.635118+0000","last_became_peered":"2024-09-10T17:52:39.635118+0000","last_unstale":"2024-09-10T17:53:03.188736+0000","last_undegraded":"2024-09-10T17:53:03.188736+0000","last_fullsized":"2024-09-10T17:53:03.188736+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190512+0000","last_change":"2024-09-10T17:52:36.200921+0000","last_active":"2024-09-10T17:53:03.190512+0000","last_peered":"2024-09-10T17:53:03.190512+0000","last_clean":"2024-09-10T17:53:03.190512+0000","last_became_active":"2024-09-10T17:52:36.200153+0000","last_became_peered":"2024-09-10T17:52:36.200153+0000","last_unstale":"2024-09-10T17:53:03.190512+0000","last_undegraded":"2024-09-10T17:53:03.190512+0000","last_fullsized":"2024-09-10T17:53:03.190512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.192383+0000","last_change":"2024-09-10T17:52:39.643628+0000","last_active":"2024-09-10T17:53:03.192383+0000","last_peered":"2024-09-10T17:53:03.192383+0000","last_clean":"2024-09-10T17:53:03.192383+0000","last_became_active":"2024-09-10T17:52:39.643355+0000","last_became_peered":"2024-09-10T17:52:39.643355+0000","last_unstale":"2024-09-10T17:53:03.192383+0000","last_undegraded":"2024-09-10T17:53:03.192383+0000","last_fullsized":"2024-09-10T17:53:03.192383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410290+0000","last_change":"2024-09-10T17:52:39.652448+0000","last_active":"2024-09-10T17:53:03.410290+0000","last_peered":"2024-09-10T17:53:03.410290+0000","last_clean":"2024-09-10T17:53:03.410290+0000","last_became_active":"2024-09-10T17:52:39.652164+0000","last_became_peered":"2024-09-10T17:52:39.652164+0000","last_unstale":"2024-09-10T17:53:03.410290+0000","last_undegraded":"2024-09-10T17:53:03.410290+0000","last_fullsized":"2024-09-10T17:53:03.410290+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190184+0000","last_change":"2024-09-10T17:52:36.200230+0000","last_active":"2024-09-10T17:53:03.190184+0000","last_peered":"2024-09-10T17:53:03.190184+0000","last_clean":"2024-09-10T17:53:03.190184+0000","last_became_active":"2024-09-10T17:52:36.199765+0000","last_became_peered":"2024-09-10T17:52:36.199765+0000","last_unstale":"2024-09-10T17:53:03.190184+0000","last_undegraded":"2024-09-10T17:53:03.190184+0000","last_fullsized":"2024-09-10T17:53:03.190184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.410193+0000","last_change":"2024-09-10T17:52:39.652608+0000","last_active":"2024-09-10T17:53:03.410193+0000","last_peered":"2024-09-10T17:53:03.410193+0000","last_clean":"2024-09-10T17:53:03.410193+0000","last_became_active":"2024-09-10T17:52:39.652354+0000","last_became_peered":"2024-09-10T17:52:39.652354+0000","last_unstale":"2024-09-10T17:53:03.410193+0000","last_undegraded":"2024-09-10T17:53:03.410193+0000","last_fullsized":"2024-09-10T17:53:03.410193+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"65'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.190653+0000","last_change":"2024-09-10T17:52:36.200731+0000","last_active":"2024-09-10T17:53:03.190653+0000","last_peered":"2024-09-10T17:53:03.190653+0000","last_clean":"2024-09-10T17:53:03.190653+0000","last_became_active":"2024-09-10T17:52:36.200429+0000","last_became_peered":"2024-09-10T17:52:36.200429+0000","last_unstale":"2024-09-10T17:53:03.190653+0000","last_undegraded":"2024-09-10T17:53:03.190653+0000","last_fullsized":"2024-09-10T17:53:03.190653+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.193253+0000","last_change":"2024-09-10T17:52:39.640232+0000","last_active":"2024-09-10T17:53:03.193253+0000","last_peered":"2024-09-10T17:53:03.193253+0000","last_clean":"2024-09-10T17:53:03.193253+0000","last_became_active":"2024-09-10T17:52:39.639462+0000","last_became_peered":"2024-09-10T17:52:39.639462+0000","last_unstale":"2024-09-10T17:53:03.193253+0000","last_undegraded":"2024-09-10T17:53:03.193253+0000","last_fullsized":"2024-09-10T17:53:03.193253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"65'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189428+0000","last_change":"2024-09-10T17:52:36.190257+0000","last_active":"2024-09-10T17:53:03.189428+0000","last_peered":"2024-09-10T17:53:03.189428+0000","last_clean":"2024-09-10T17:53:03.189428+0000","last_became_active":"2024-09-10T17:52:36.189957+0000","last_became_peered":"2024-09-10T17:52:36.189957+0000","last_unstale":"2024-09-10T17:53:03.189428+0000","last_undegraded":"2024-09-10T17:53:03.189428+0000","last_fullsized":"2024-09-10T17:53:03.189428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.189165+0000","last_change":"2024-09-10T17:52:39.636289+0000","last_active":"2024-09-10T17:53:03.189165+0000","last_peered":"2024-09-10T17:53:03.189165+0000","last_clean":"2024-09-10T17:53:03.189165+0000","last_became_active":"2024-09-10T17:52:39.635894+0000","last_became_peered":"2024-09-10T17:52:39.635894+0000","last_unstale":"2024-09-10T17:53:03.189165+0000","last_undegraded":"2024-09-10T17:53:03.189165+0000","last_fullsized":"2024-09-10T17:53:03.189165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"65'4","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-10T17:53:03.193332+0000","last_change":"2024-09-10T17:52:36.194542+0000","last_active":"2024-09-10T17:53:03.193332+0000","last_peered":"2024-09-10T17:53:03.193332+0000","last_clean":"2024-09-10T17:53:03.193332+0000","last_became_active":"2024-09-10T17:52:36.194232+0000","last_became_peered":"2024-09-10T17:52:36.194232+0000","last_unstale":"2024-09-10T17:53:03.193332+0000","last_undegraded":"2024-09-10T17:53:03.193332+0000","last_fullsized":"2024-09-10T17:53:03.193332+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":7086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233998,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28276,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716876,"statfs":{"total":95995035648,"available":95966081024,"internally_reserved":0,"allocated":1282048,"data_stored":881375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495637,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32368,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712784,"statfs":{"total":95995035648,"available":95961890816,"internally_reserved":0,"allocated":1282048,"data_stored":882062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56899999999999995}]},{"osd":1,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58399999999999996}]},{"osd":2,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.432}]},{"osd":4,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.40799999999999997}]},{"osd":5,"last update":"Tue Sep 10 17:52:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55300000000000005}]},{"osd":7,"last update":"Tue Sep 10 17:53:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59599999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757273,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31792,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713360,"statfs":{"total":95995035648,"available":95962480640,"internally_reserved":0,"allocated":688128,"data_stored":291503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.39000000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47699999999999998}]},{"osd":2,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.5},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44800000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.28899999999999998}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33700000000000002}]},{"osd":7,"last update":"Tue Sep 10 17:53:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42699999999999999}]}]},{"osd":4,"up_from":30,"seq":128849018908,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":700416,"data_stored":291442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.34499999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.79900000000000004,"5min":0.873,"15min":0.873},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.78600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47499999999999998}]},{"osd":1,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.41299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69299999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.38700000000000001}]},{"osd":2,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.628},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.59599999999999997}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.495}]},{"osd":7,"last update":"Tue Sep 10 17:53:10 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57699999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182434,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":292402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.24099999999999999}]},{"osd":1,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44500000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.29799999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.373},{"interface":"front","average":{"1min":0.439,"5min":0.433,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.29199999999999998}]},{"osd":4,"last update":"Tue Sep 10 17:53:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66300000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.73099999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47699999999999998}]},{"osd":5,"last update":"Tue Sep 10 17:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.498}]},{"osd":6,"last update":"Tue Sep 10 17:52:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411367,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717468,"statfs":{"total":95995035648,"available":95966687232,"internally_reserved":0,"allocated":679936,"data_stored":290461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.29199999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.309}]},{"osd":1,"last update":"Tue Sep 10 17:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.39100000000000001},"min":{"1min":0.28699999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40200000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:53:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.753,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61899999999999999}]},{"osd":5,"last update":"Tue Sep 10 17:52:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.503}]},{"osd":6,"last update":"Tue Sep 10 17:52:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.441},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Tue Sep 10 17:53:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":290348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:52:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.37,"15min":0.35299999999999998},"min":{"1min":0.253,"5min":0.216,"15min":0.216},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.246},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.28899999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.58999999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.309}]},{"osd":2,"last update":"Tue Sep 10 17:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40200000000000002,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.373},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.437,"15min":0.42899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36499999999999999}]},{"osd":3,"last update":"Tue Sep 10 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.33700000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:53:01 2024","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.71699999999999997,"15min":0.60299999999999998},"min":{"1min":0.47899999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":15.68,"5min":15.68,"15min":15.68},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56999999999999995}]},{"osd":5,"last update":"Tue Sep 10 17:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Sep 10 17:52:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.67100000000000004}]},{"osd":7,"last update":"Tue Sep 10 17:53:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32380,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712772,"statfs":{"total":95995035648,"available":95961878528,"internally_reserved":0,"allocated":1294336,"data_stored":881830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 17:52:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54400000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.373,"15min":0.36199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.57599999999999996}]},{"osd":2,"last update":"Tue Sep 10 17:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42099999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.41199999999999998}]},{"osd":3,"last update":"Tue Sep 10 17:52:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61499999999999999,"5min":0.62,"15min":0.62},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.47999999999999998}]},{"osd":4,"last update":"Tue Sep 10 17:53:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.66900000000000004,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":7.8869999999999996,"5min":7.8869999999999996,"15min":7.8869999999999996},"last":0.70199999999999996}]},{"osd":5,"last update":"Tue Sep 10 17:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.65800000000000003},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.907,"5min":7.907,"15min":7.907},"last":0.55500000000000005}]},{"osd":6,"last update":"Tue Sep 10 17:52:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9450000000000003,"5min":7.9450000000000003,"15min":7.9450000000000003},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Sep 10 17:53:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T17:53:19.421 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T17:53:19.421 INFO:tasks.cephadm:Adding prometheus.a on smithi089 2024-09-10T17:53:19.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch apply prometheus '1;smithi089=a' 2024-09-10T17:53:19.451 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:19 smithi089 ceph-mon[31467]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:53:19.451 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:19 smithi089 ceph-mon[31467]: pgmap v215: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:19.632 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:53:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled prometheus update... 2024-09-10T17:53:21.388 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:21 smithi089 ceph-mon[31467]: pgmap v216: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:21.474 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:21 smithi012 ceph-mon[27356]: pgmap v216: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:21.474 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:21 smithi012 ceph-mon[37454]: pgmap v216: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:22.048 DEBUG:teuthology.orchestra.run.smithi089:prometheus.a> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service 2024-09-10T17:53:22.090 INFO:tasks.cephadm:Adding node-exporter.a on smithi012 2024-09-10T17:53:22.090 INFO:tasks.cephadm:Adding node-exporter.b on smithi089 2024-09-10T17:53:22.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch apply node-exporter '2;smithi012=a;smithi089=b' 2024-09-10T17:53:22.356 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:53:22.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:22 smithi089 ceph-mon[31467]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi089=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:22.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:22 smithi089 ceph-mon[31467]: Saving service prometheus spec with placement smithi089=a;count:1 2024-09-10T17:53:22.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:22.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:53:22.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:53:22.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:53:22.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:22 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:22.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:22 smithi089 ceph-mon[31467]: Deploying daemon prometheus.a on smithi089 2024-09-10T17:53:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[27356]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi089=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[27356]: Saving service prometheus spec with placement smithi089=a;count:1 2024-09-10T17:53:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:53:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:53:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:53:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[27356]: Deploying daemon prometheus.a on smithi089 2024-09-10T17:53:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[37454]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi089=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[37454]: Saving service prometheus spec with placement smithi089=a;count:1 2024-09-10T17:53:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:53:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:53:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:53:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:22 smithi012 ceph-mon[37454]: Deploying daemon prometheus.a on smithi089 2024-09-10T17:53:23.450 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:23 smithi089 ceph-mon[31467]: pgmap v217: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:23.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:23 smithi012 ceph-mon[27356]: pgmap v217: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:23.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:23 smithi012 ceph-mon[37454]: pgmap v217: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:24.277 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled node-exporter update... 2024-09-10T17:53:25.314 DEBUG:teuthology.orchestra.run.smithi012:node-exporter.a> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.a.service 2024-09-10T17:53:25.317 DEBUG:teuthology.orchestra.run.smithi089:node-exporter.b> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.b.service 2024-09-10T17:53:25.320 INFO:tasks.cephadm:Adding alertmanager.a on smithi012 2024-09-10T17:53:25.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch apply alertmanager '1;smithi012=a' 2024-09-10T17:53:25.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:25 smithi012 ceph-mon[27356]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi012=a;smithi089=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:25.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:25 smithi012 ceph-mon[27356]: Saving service node-exporter spec with placement smithi012=a;smithi089=b;count:2 2024-09-10T17:53:25.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:25 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:25.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:25 smithi012 ceph-mon[27356]: pgmap v218: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:25.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:25 smithi012 ceph-mon[37454]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi012=a;smithi089=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:25.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:25 smithi012 ceph-mon[37454]: Saving service node-exporter spec with placement smithi012=a;smithi089=b;count:2 2024-09-10T17:53:25.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:25 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:25.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:25 smithi012 ceph-mon[37454]: pgmap v218: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:25.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:25 smithi089 ceph-mon[31467]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi012=a;smithi089=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:25.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:25 smithi089 ceph-mon[31467]: Saving service node-exporter spec with placement smithi012=a;smithi089=b;count:2 2024-09-10T17:53:25.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:25 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:25.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:25 smithi089 ceph-mon[31467]: pgmap v218: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:25.562 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:53:27.457 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:27 smithi089 ceph-mon[31467]: pgmap v219: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:27.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:27 smithi012 ceph-mon[27356]: pgmap v219: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:27.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:27 smithi012 ceph-mon[37454]: pgmap v219: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:28.004 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled alertmanager update... 2024-09-10T17:53:29.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:29 smithi012 ceph-mon[27356]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi012=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:29.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:29 smithi012 ceph-mon[27356]: Saving service alertmanager spec with placement smithi012=a;count:1 2024-09-10T17:53:29.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:29 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:29 smithi012 ceph-mon[37454]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi012=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:29 smithi012 ceph-mon[37454]: Saving service alertmanager spec with placement smithi012=a;count:1 2024-09-10T17:53:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:29 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:29.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:29 smithi089 ceph-mon[31467]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi012=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:29.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:29 smithi089 ceph-mon[31467]: Saving service alertmanager spec with placement smithi012=a;count:1 2024-09-10T17:53:29.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:29 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:29.656 DEBUG:teuthology.orchestra.run.smithi012:alertmanager.a> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@alertmanager.a.service 2024-09-10T17:53:29.660 INFO:tasks.cephadm:Adding grafana.a on smithi089 2024-09-10T17:53:29.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph orch apply grafana '1;smithi089=a' 2024-09-10T17:53:30.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:30 smithi012 ceph-mon[27356]: pgmap v220: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:30 smithi012 ceph-mon[37454]: pgmap v220: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:30.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:30 smithi089 ceph-mon[31467]: pgmap v220: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:30.472 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:53:31.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:31 smithi089 ceph-mon[31467]: pgmap v221: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:31.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:31 smithi012 ceph-mon[27356]: pgmap v221: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:31.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:31 smithi012 ceph-mon[37454]: pgmap v221: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:33.436 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:33 smithi089 ceph-mon[31467]: pgmap v222: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:33.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:33 smithi012 ceph-mon[27356]: pgmap v222: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:33.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:33 smithi012 ceph-mon[37454]: pgmap v222: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:34.905 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled grafana update... 2024-09-10T17:53:35.909 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:35 smithi012 ceph-mon[27356]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi089=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:35.909 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:35 smithi012 ceph-mon[27356]: Saving service grafana spec with placement smithi089=a;count:1 2024-09-10T17:53:35.909 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:35 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:35.909 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:35 smithi012 ceph-mon[27356]: pgmap v223: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:35.909 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:35 smithi012 ceph-mon[37454]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi089=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:35.909 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:35 smithi012 ceph-mon[37454]: Saving service grafana spec with placement smithi089=a;count:1 2024-09-10T17:53:36.001 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:35 smithi089 ceph-mon[31467]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi089=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:53:36.001 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:35 smithi089 ceph-mon[31467]: Saving service grafana spec with placement smithi089=a;count:1 2024-09-10T17:53:36.001 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:35 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:36.001 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:35 smithi089 ceph-mon[31467]: pgmap v223: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:36.021 DEBUG:teuthology.orchestra.run.smithi089:grafana.a> sudo journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@grafana.a.service 2024-09-10T17:53:36.023 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T17:53:36.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T17:53:36.242 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:36.283 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:35 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:36.283 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:35 smithi012 ceph-mon[37454]: pgmap v223: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:36.288 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 podman[58897]: 2024-09-10 17:53:36.22666002 +0000 UTC m=+0.130770023 container create 7f717fea126ec459f90f34b7768a8701ef4fc9a2a571ecbe65ee5415bd02b052 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 podman[58897]: 2024-09-10 17:53:36.462718924 +0000 UTC m=+0.366828890 container init 7f717fea126ec459f90f34b7768a8701ef4fc9a2a571ecbe65ee5415bd02b052 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 podman[58897]: 2024-09-10 17:53:36.465753384 +0000 UTC m=+0.369863354 container start 7f717fea126ec459f90f34b7768a8701ef4fc9a2a571ecbe65ee5415bd02b052 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.489Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.489Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.489Z caller=main.go:570 level=info host_details="(Linux 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 x86_64 smithi089 (none))" 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.489Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.489Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.490Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.491Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-10T17:53:36.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.491Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.491Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.494Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.494Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.82µs 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.494Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.494Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.494Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=16.659µs wal_replay_duration=213.498µs wbl_replay_duration=86ns total_replay_duration=247.557µs 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.495Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.495Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.495Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.515Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=20.372018ms db_storage=846ns remote_storage=985ns web_handler=330ns query_engine=593ns scrape=394.383µs scrape_sd=74.04µs notify=992ns notify_sd=1.953µs rules=19.650473ms tracing=5.657µs 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.515Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:53:36.515Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 bash[58897]: 7f717fea126ec459f90f34b7768a8701ef4fc9a2a571ecbe65ee5415bd02b052 2024-09-10T17:53:36.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:53:36 smithi089 systemd[1]: Started Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:53:37.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-10T17:53:37.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[27356]: pgmap v224: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:37.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ignoring --setuser ceph since I am not root 2024-09-10T17:53:37.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ignoring --setgroup ceph since I am not root 2024-09-10T17:53:37.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-10T17:53:37.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-mon[37454]: pgmap v224: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:37.985 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' 2024-09-10T17:53:37.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-10T17:53:37.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-mon[31467]: pgmap v224: 97 pgs: 97 active+clean; 579 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:37.986 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: ignoring --setuser ceph since I am not root 2024-09-10T17:53:37.986 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: ignoring --setgroup ceph since I am not root 2024-09-10T17:53:37.986 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-mgr[33211]: -- 172.21.15.89:0/1471714109 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c834552d00 con 0x55c834527400 2024-09-10T17:53:37.986 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:37.779+0000 7efe61f4d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T17:53:37.987 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:37.836+0000 7efe61f4d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T17:53:37.987 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:37.984+0000 7efe61f4d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T17:53:38.043 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:37.783+0000 7f0ca43b6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T17:53:38.043 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:37 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:37.848+0000 7f0ca43b6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T17:53:38.044 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:38.004+0000 7f0ca43b6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T17:53:38.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:38.050+0000 7efe61f4d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T17:53:38.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:38.193+0000 7efe61f4d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:53:38.301 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-10T17:53:38.302 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCih+Bm4k7CERAATKfcHvrs1rCxxs8Lx/b47Q== 2024-09-10T17:53:38.302 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:38.076+0000 7f0ca43b6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T17:53:38.302 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:38.245+0000 7f0ca43b6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:53:38.631 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:38.394+0000 7f0ca43b6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T17:53:38.631 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:38.332+0000 7efe61f4d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T17:53:38.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-mon[27356]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-10T17:53:38.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-mon[27356]: mgrmap e16: y(active, since 5m), standbys: x 2024-09-10T17:53:38.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/444708018' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:38.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/444708018' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T17:53:38.977 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-mon[37454]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-10T17:53:38.977 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-mon[37454]: mgrmap e16: y(active, since 5m), standbys: x 2024-09-10T17:53:38.977 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/444708018' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:38.977 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/444708018' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T17:53:38.977 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:38.720+0000 7f0ca43b6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T17:53:38.977 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:38.783+0000 7f0ca43b6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T17:53:38.977 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:38 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:38.975+0000 7f0ca43b6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T17:53:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-mon[31467]: from='mgr.14150 172.21.15.12:0/3815019435' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-10T17:53:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-mon[31467]: mgrmap e16: y(active, since 5m), standbys: x 2024-09-10T17:53:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/444708018' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/444708018' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T17:53:39.035 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:38.635+0000 7efe61f4d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T17:53:39.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:38.695+0000 7efe61f4d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T17:53:39.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:38.873+0000 7efe61f4d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T17:53:39.070 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:53:39.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T17:53:39.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T17:53:39.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T17:53:39.316 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T17:53:40.035 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:39.779+0000 7efe61f4d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T17:53:40.035 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:39.844+0000 7efe61f4d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T17:53:40.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:39 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:39.885+0000 7f0ca43b6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T17:53:40.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:39 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:39.953+0000 7f0ca43b6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T17:53:40.785 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:40.571+0000 7efe61f4d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T17:53:40.785 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:40.686+0000 7efe61f4d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T17:53:40.967 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:40 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:40.700+0000 7f0ca43b6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T17:53:40.967 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:40 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:40.819+0000 7f0ca43b6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T17:53:41.117 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:40.833+0000 7efe61f4d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:53:41.117 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:40.895+0000 7efe61f4d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T17:53:41.117 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.045+0000 7efe61f4d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T17:53:41.117 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.116+0000 7efe61f4d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T17:53:41.253 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:40 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:40.966+0000 7f0ca43b6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:53:41.253 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.029+0000 7f0ca43b6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T17:53:41.253 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.182+0000 7f0ca43b6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T17:53:41.253 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.252+0000 7f0ca43b6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T17:53:41.291 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2024-09-10T17:53:41.292 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQClh+Bman0jERAAeKljMiMnW/7RUfSBrOxPpg== 2024-09-10T17:53:41.407 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-mon[31467]: from='client.? 172.21.15.89:0/1676084932' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:41.407 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:41.407 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T17:53:41.408 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.177+0000 7efe61f4d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T17:53:41.408 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.340+0000 7efe61f4d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T17:53:41.408 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.406+0000 7efe61f4d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T17:53:41.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-mon[27356]: from='client.? 172.21.15.89:0/1676084932' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:41.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:41.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T17:53:41.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.314+0000 7f0ca43b6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T17:53:41.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.477+0000 7f0ca43b6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T17:53:41.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-mon[37454]: from='client.? 172.21.15.89:0/1676084932' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:41.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T17:53:41.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T17:53:41.663 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.471+0000 7efe61f4d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T17:53:41.663 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.554+0000 7efe61f4d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T17:53:41.663 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.615+0000 7efe61f4d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T17:53:41.823 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.545+0000 7f0ca43b6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T17:53:41.823 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.614+0000 7f0ca43b6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T17:53:41.823 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.699+0000 7f0ca43b6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T17:53:41.823 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.760+0000 7f0ca43b6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T17:53:41.823 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:41 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:41.821+0000 7f0ca43b6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T17:53:42.035 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:41.675+0000 7efe61f4d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T17:53:42.059 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-10T17:53:42.059 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-10T17:53:42.059 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T17:53:42.097 INFO:tasks.cephadm:Creating RBD pool 2024-09-10T17:53:42.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool create rbd 8 2024-09-10T17:53:42.302 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:42.716 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[27356]: Standby manager daemon x restarted 2024-09-10T17:53:42.716 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[27356]: Standby manager daemon x started 2024-09-10T17:53:42.716 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:53:42.716 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:53:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:53:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:53:42.717 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.650+0000 7f0ca43b6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T17:53:42.717 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[37454]: Standby manager daemon x restarted 2024-09-10T17:53:42.717 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[37454]: Standby manager daemon x started 2024-09-10T17:53:42.717 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:53:42.717 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:53:42.718 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:53:42.718 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:53:42.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-mon[31467]: Standby manager daemon x restarted 2024-09-10T17:53:42.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-mon[31467]: Standby manager daemon x started 2024-09-10T17:53:42.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:53:42.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:53:42.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:53:42.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3767364771' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:53:42.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:42.452+0000 7efe61f4d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T17:53:42.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: [10/Sep/2024:17:53:42] ENGINE Bus STARTING 2024-09-10T17:53:42.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: CherryPy Checker: 2024-09-10T17:53:42.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: The Application mounted at '' has an empty config. 2024-09-10T17:53:42.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: 2024-09-10T17:53:42.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: [10/Sep/2024:17:53:42] ENGINE Serving on http://:::9283 2024-09-10T17:53:42.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:53:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[33207]: [10/Sep/2024:17:53:42] ENGINE Bus STARTED 2024-09-10T17:53:43.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:42] ENGINE Bus STARTING 2024-09-10T17:53:43.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: CherryPy Checker: 2024-09-10T17:53:43.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: The Application mounted at '' has an empty config. 2024-09-10T17:53:43.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:43.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.776+0000 7f0c0bf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.776+0000 7f0c0bf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.776+0000 7f0c0bf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.776+0000 7f0c0bf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.776+0000 7f0c0bf03640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.777+0000 7f0c0ef09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.777+0000 7f0c0ef09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.777+0000 7f0c0ef09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.777+0000 7f0c0ef09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:42.777+0000 7f0c0ef09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:42] ENGINE Serving on http://:::9283 2024-09-10T17:53:43.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:42] ENGINE Bus STARTED 2024-09-10T17:53:43.562 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: mgrmap e17: y(active, since 5m), standbys: x 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: Active manager daemon y restarted 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: Activating manager daemon y 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: osdmap e68: 8 total, 8 up, 8 in 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: mgrmap e18: y(active, starting, since 0.00871009s), standbys: x 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:53:43.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: Manager daemon y is now available 2024-09-10T17:53:43.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:53:43.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:43.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:53:43.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:53:43.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:53:43.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:53:43.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:43 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:53:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: mgrmap e17: y(active, since 5m), standbys: x 2024-09-10T17:53:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: Active manager daemon y restarted 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: Activating manager daemon y 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: osdmap e68: 8 total, 8 up, 8 in 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: mgrmap e18: y(active, starting, since 0.00871009s), standbys: x 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:53:43.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: Manager daemon y is now available 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:53:43.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: mgrmap e17: y(active, since 5m), standbys: x 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: Active manager daemon y restarted 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: Activating manager daemon y 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: osdmap e68: 8 total, 8 up, 8 in 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: mgrmap e18: y(active, starting, since 0.00871009s), standbys: x 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:53:43.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:53:43.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:53:43.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:53:43.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:53:43.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: Manager daemon y is now available 2024-09-10T17:53:43.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:53:43.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:43.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:53:43.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:53:43.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:53:43.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:53:43.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:53:44.152 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:53:43] "GET /metrics HTTP/1.1" 200 28739 "" "Prometheus/2.43.0" 2024-09-10T17:53:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:44.503+0000 7f0bf28d1640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:17:53:44] ENGINE Error in HTTPServer.serve 2024-09-10T17:53:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: Traceback (most recent call last): 2024-09-10T17:53:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._connections.run(self.expiration_interval) 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._run(expiration_interval) 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: s = self.context.wrap_socket( 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: return self.sslsocket_class._create( 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:53:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self.do_handshake() 2024-09-10T17:53:44.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:53:44.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: self._sslobj.do_handshake() 2024-09-10T17:53:44.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:53:44.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:53:44.954 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'rbd' created 2024-09-10T17:53:45.148 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-mon[27356]: mgrmap e19: y(active, since 1.01174s), standbys: x 2024-09-10T17:53:45.149 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-mon[27356]: pgmap v3: 97 pgs: 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:45.149 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-mon[37454]: mgrmap e19: y(active, since 1.01174s), standbys: x 2024-09-10T17:53:45.149 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:44 smithi012 ceph-mon[37454]: pgmap v3: 97 pgs: 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:45.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:44 smithi089 ceph-mon[31467]: mgrmap e19: y(active, since 1.01174s), standbys: x 2024-09-10T17:53:45.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:44 smithi089 ceph-mon[31467]: pgmap v3: 97 pgs: 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:45.721 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- rbd pool init rbd 2024-09-10T17:53:45.955 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: [10/Sep/2024:17:53:44] ENGINE Bus STARTING 2024-09-10T17:53:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: [10/Sep/2024:17:53:44] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:53:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2144452254' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-09-10T17:53:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: [10/Sep/2024:17:53:44] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: [10/Sep/2024:17:53:44] ENGINE Bus STARTED 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: [10/Sep/2024:17:53:44] ENGINE Error in HTTPServer.serve 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:53:46.035 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: pgmap v4: 97 pgs: 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: osdmap e69: 8 total, 8 up, 8 in 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: mgrmap e20: y(active, since 2s), standbys: x 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: [10/Sep/2024:17:53:44] ENGINE Bus STARTING 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: [10/Sep/2024:17:53:44] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2144452254' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-09-10T17:53:46.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: [10/Sep/2024:17:53:44] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: [10/Sep/2024:17:53:44] ENGINE Bus STARTED 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: [10/Sep/2024:17:53:44] ENGINE Error in HTTPServer.serve 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:53:46.038 INFO:journalctl@ceph.mon.c.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout: self.do_handshake() 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: pgmap v4: 97 pgs: 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: osdmap e69: 8 total, 8 up, 8 in 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: mgrmap e20: y(active, since 2s), standbys: x 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi089 to 2991M 2024-09-10T17:53:46.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi089 to 2991M 2024-09-10T17:53:46.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:45 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: [10/Sep/2024:17:53:44] ENGINE Bus STARTING 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: [10/Sep/2024:17:53:44] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2144452254' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: [10/Sep/2024:17:53:44] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: [10/Sep/2024:17:53:44] ENGINE Bus STARTED 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: [10/Sep/2024:17:53:44] ENGINE Error in HTTPServer.serve 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: Traceback (most recent call last): 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:53:46.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._run(expiration_interval) 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: s = self.context.wrap_socket( 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: return self.sslsocket_class._create( 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: self.do_handshake() 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._sslobj.do_handshake() 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:53:46.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: pgmap v4: 97 pgs: 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: osdmap e69: 8 total, 8 up, 8 in 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: mgrmap e20: y(active, since 2s), standbys: x 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:46.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi089 to 2991M 2024-09-10T17:53:46.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:45 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:47.269 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:46 smithi012 ceph-mon[27356]: osdmap e70: 8 total, 8 up, 8 in 2024-09-10T17:53:47.269 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:46 smithi012 ceph-mon[27356]: pgmap v7: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:47.269 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:46 smithi012 ceph-mon[37454]: osdmap e70: 8 total, 8 up, 8 in 2024-09-10T17:53:47.269 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:46 smithi012 ceph-mon[37454]: pgmap v7: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:47.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:46 smithi089 ceph-mon[31467]: osdmap e70: 8 total, 8 up, 8 in 2024-09-10T17:53:47.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:46 smithi089 ceph-mon[31467]: pgmap v7: 105 pgs: 8 unknown, 97 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: osdmap e71: 8 total, 8 up, 8 in 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: mgrmap e21: y(active, since 4s), standbys: x 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1667995544' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]: dispatch 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]: dispatch 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: osdmap e71: 8 total, 8 up, 8 in 2024-09-10T17:53:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: mgrmap e21: y(active, since 4s), standbys: x 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1667995544' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]: dispatch 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]: dispatch 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:47 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: osdmap e71: 8 total, 8 up, 8 in 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: mgrmap e21: y(active, since 4s), standbys: x 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1667995544' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:48.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:53:48.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:47 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:53:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi012 to 2993M 2024-09-10T17:53:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:53:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:53:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:53:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]': finished 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: osdmap e72: 8 total, 8 up, 8 in 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: pgmap v10: 105 pgs: 5 unknown, 100 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi012 to 2993M 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]': finished 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: osdmap e72: 8 total, 8 up, 8 in 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:53:49.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: pgmap v10: 105 pgs: 5 unknown, 100 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:49 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi012 to 2993M 2024-09-10T17:53:49.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]': finished 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: osdmap e72: 8 total, 8 up, 8 in 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: pgmap v10: 105 pgs: 5 unknown, 100 active+clean; 580 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:49.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:49 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:50.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:50 smithi012 ceph-mon[27356]: Deploying daemon alertmanager.a on smithi012 2024-09-10T17:53:50.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:50 smithi012 ceph-mon[27356]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:53:50.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:50 smithi012 ceph-mon[27356]: Cluster is now healthy 2024-09-10T17:53:50.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:50 smithi012 ceph-mon[27356]: osdmap e73: 8 total, 8 up, 8 in 2024-09-10T17:53:50.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:50 smithi012 ceph-mon[37454]: Deploying daemon alertmanager.a on smithi012 2024-09-10T17:53:50.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:50 smithi012 ceph-mon[37454]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:53:50.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:50 smithi012 ceph-mon[37454]: Cluster is now healthy 2024-09-10T17:53:50.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:50 smithi012 ceph-mon[37454]: osdmap e73: 8 total, 8 up, 8 in 2024-09-10T17:53:50.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:50 smithi089 ceph-mon[31467]: Deploying daemon alertmanager.a on smithi012 2024-09-10T17:53:50.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:50 smithi089 ceph-mon[31467]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:53:50.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:50 smithi089 ceph-mon[31467]: Cluster is now healthy 2024-09-10T17:53:50.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:50 smithi089 ceph-mon[31467]: osdmap e73: 8 total, 8 up, 8 in 2024-09-10T17:53:51.207 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T17:53:51.415 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:51.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:51 smithi012 ceph-mon[27356]: osdmap e74: 8 total, 8 up, 8 in 2024-09-10T17:53:51.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:51 smithi012 ceph-mon[27356]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 0 B/s wr, 28 op/s 2024-09-10T17:53:51.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:51 smithi012 ceph-mon[37454]: osdmap e74: 8 total, 8 up, 8 in 2024-09-10T17:53:51.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:51 smithi012 ceph-mon[37454]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 0 B/s wr, 28 op/s 2024-09-10T17:53:51.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:51 smithi089 ceph-mon[31467]: osdmap e74: 8 total, 8 up, 8 in 2024-09-10T17:53:51.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:51 smithi089 ceph-mon[31467]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 0 B/s wr, 28 op/s 2024-09-10T17:53:53.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:52 smithi012 ceph-mon[27356]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-10T17:53:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:52 smithi012 ceph-mon[37454]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-10T17:53:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:52 smithi089 ceph-mon[31467]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-10T17:53:54.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:53:53] "GET /metrics HTTP/1.1" 200 28739 "" "Prometheus/2.43.0" 2024-09-10T17:53:55.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:54 smithi012 ceph-mon[27356]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 316 B/s wr, 18 op/s 2024-09-10T17:53:55.031 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:54 smithi012 ceph-mon[37454]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 316 B/s wr, 18 op/s 2024-09-10T17:53:55.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:54 smithi089 ceph-mon[31467]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 316 B/s wr, 18 op/s 2024-09-10T17:53:56.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:53:57.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:56 smithi012 ceph-mon[27356]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 255 B/s wr, 14 op/s 2024-09-10T17:53:57.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:56 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1767776532' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-10T17:53:57.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:56 smithi012 ceph-mon[27356]: osdmap e75: 8 total, 8 up, 8 in 2024-09-10T17:53:57.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:56 smithi012 ceph-mon[37454]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 255 B/s wr, 14 op/s 2024-09-10T17:53:57.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:56 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1767776532' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-10T17:53:57.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:56 smithi012 ceph-mon[37454]: osdmap e75: 8 total, 8 up, 8 in 2024-09-10T17:53:57.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:56 smithi089 ceph-mon[31467]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 255 B/s wr, 14 op/s 2024-09-10T17:53:57.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:56 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1767776532' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-10T17:53:57.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:56 smithi089 ceph-mon[31467]: osdmap e75: 8 total, 8 up, 8 in 2024-09-10T17:53:57.955 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:57 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:53:57.956 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:57 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:53:57.975 INFO:teuthology.orchestra.run.smithi012.stdout:[{"version":25,"timestamp":"2024-09-10T17:53:47.753501+0000","name":"","changes":[{"name":"osd/host:smithi012/osd_memory_target","previous_value":"4212219596","new_value":"3138477772"}]}] 2024-09-10T17:53:57.976 INFO:tasks.ceph_manager:config epoch is 25 2024-09-10T17:53:57.976 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T17:53:57.976 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T17:53:57.976 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T17:53:58.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:57 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:53:58.517 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 podman[69783]: 2024-09-10 17:53:58.373457932 +0000 UTC m=+0.247280417 container create 665ab87989af0577ae6c50b4ffac3cd31590debf6ca6af0667d9627bf39d0240 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:53:58.776 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-mon[27356]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 241 B/s wr, 0 op/s 2024-09-10T17:53:58.777 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-mon[37454]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 241 B/s wr, 0 op/s 2024-09-10T17:53:58.777 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 podman[69783]: 2024-09-10 17:53:58.685179537 +0000 UTC m=+0.559002033 container init 665ab87989af0577ae6c50b4ffac3cd31590debf6ca6af0667d9627bf39d0240 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:53:58.777 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 podman[69783]: 2024-09-10 17:53:58.688464508 +0000 UTC m=+0.562287007 container start 665ab87989af0577ae6c50b4ffac3cd31590debf6ca6af0667d9627bf39d0240 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:53:58.777 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:53:58.705Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-10T17:53:58.777 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:53:58.705Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-10T17:53:58.777 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:53:58.706Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.12 port=9094 2024-09-10T17:53:58.777 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:53:58.707Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-10T17:53:58.777 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:53:58.731Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-10T17:53:58.777 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:53:58.731Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-10T17:53:58.778 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:53:58.734Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-10T17:53:58.778 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:53:58.734Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-10T17:53:58.778 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 bash[69783]: 665ab87989af0577ae6c50b4ffac3cd31590debf6ca6af0667d9627bf39d0240 2024-09-10T17:53:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:53:59.033 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:53:58 smithi012 systemd[1]: Started Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:53:59.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:58] ENGINE Bus STOPPING 2024-09-10T17:53:59.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:58] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:53:59.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:58] ENGINE Bus STOPPED 2024-09-10T17:53:59.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:58] ENGINE Bus STARTING 2024-09-10T17:53:59.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:58 smithi089 ceph-mon[31467]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 241 B/s wr, 0 op/s 2024-09-10T17:53:59.343 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:59] ENGINE Serving on http://:::9283 2024-09-10T17:53:59.344 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:53:59] ENGINE Bus STARTED 2024-09-10T17:53:59.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[27356]: Deploying daemon grafana.a on smithi089 2024-09-10T17:53:59.990 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:53:59.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:53:59 smithi012 ceph-mon[37454]: Deploying daemon grafana.a on smithi089 2024-09-10T17:54:00.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:00.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:00.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-10T17:54:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T17:54:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T17:54:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:53:59 smithi089 ceph-mon[31467]: Deploying daemon grafana.a on smithi089 2024-09-10T17:54:00.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:54:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:00 smithi012 ceph-mon[27356]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-09-10T17:54:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:00 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2249031568' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T17:54:01.034 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:00 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:54:00.707Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000169414s 2024-09-10T17:54:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:00 smithi012 ceph-mon[37454]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-09-10T17:54:01.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:00 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2249031568' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T17:54:01.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:00 smithi089 ceph-mon[31467]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-09-10T17:54:01.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:00 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2249031568' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T17:54:01.507 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"flags":0,"active_gid":14556,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2938079971},{"type":"v1","addr":"172.21.15.12:6801","nonce":2938079971}]},"active_addr":"172.21.15.12:6801/2938079971","active_change":"2024-09-10T17:53:42.652328+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24448,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.12:8443/","prometheus":"http://172.21.15.12:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":68,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2776327378}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1927024573}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2072251878}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":4039283761}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":429532513}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3294084033}]}]} 2024-09-10T17:54:01.511 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T17:54:01.511 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T17:54:01.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T17:54:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:02.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:02 smithi012 ceph-mon[27356]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-09-10T17:54:02.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:02 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:02.931 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:02 smithi012 ceph-mon[37454]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-09-10T17:54:02.931 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:02 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:02 smithi089 ceph-mon[31467]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-09-10T17:54:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:02 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:03.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:54:03.626 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":75,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T17:53:56.725090+0000","last_up_change":"2024-09-10T17:52:08.800071+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T17:52:35.123712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T17:52:38.563420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-09-10T17:53:44.896711+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":74,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6803","nonce":2400757557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6805","nonce":2400757557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6809","nonce":2400757557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6807","nonce":2400757557}]},"public_addr":"172.21.15.12:6803/2400757557","cluster_addr":"172.21.15.12:6805/2400757557","heartbeat_back_addr":"172.21.15.12:6809/2400757557","heartbeat_front_addr":"172.21.15.12:6807/2400757557","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6811","nonce":284928520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6813","nonce":284928520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6817","nonce":284928520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6815","nonce":284928520}]},"public_addr":"172.21.15.12:6811/284928520","cluster_addr":"172.21.15.12:6813/284928520","heartbeat_back_addr":"172.21.15.12:6817/284928520","heartbeat_front_addr":"172.21.15.12:6815/284928520","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6819","nonce":2631347892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6821","nonce":2631347892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6825","nonce":2631347892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6823","nonce":2631347892}]},"public_addr":"172.21.15.12:6819/2631347892","cluster_addr":"172.21.15.12:6821/2631347892","heartbeat_back_addr":"172.21.15.12:6825/2631347892","heartbeat_front_addr":"172.21.15.12:6823/2631347892","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6827","nonce":3917191557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6829","nonce":3917191557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6833","nonce":3917191557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6831","nonce":3917191557}]},"public_addr":"172.21.15.12:6827/3917191557","cluster_addr":"172.21.15.12:6829/3917191557","heartbeat_back_addr":"172.21.15.12:6833/3917191557","heartbeat_front_addr":"172.21.15.12:6831/3917191557","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6801","nonce":4063563708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6803","nonce":4063563708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6807","nonce":4063563708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6805","nonce":4063563708}]},"public_addr":"172.21.15.89:6801/4063563708","cluster_addr":"172.21.15.89:6803/4063563708","heartbeat_back_addr":"172.21.15.89:6807/4063563708","heartbeat_front_addr":"172.21.15.89:6805/4063563708","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6809","nonce":4007259364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6811","nonce":4007259364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6815","nonce":4007259364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6813","nonce":4007259364}]},"public_addr":"172.21.15.89:6809/4007259364","cluster_addr":"172.21.15.89:6811/4007259364","heartbeat_back_addr":"172.21.15.89:6815/4007259364","heartbeat_front_addr":"172.21.15.89:6813/4007259364","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6817","nonce":1083920992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6819","nonce":1083920992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6823","nonce":1083920992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6821","nonce":1083920992}]},"public_addr":"172.21.15.89:6817/1083920992","cluster_addr":"172.21.15.89:6819/1083920992","heartbeat_back_addr":"172.21.15.89:6823/1083920992","heartbeat_front_addr":"172.21.15.89:6821/1083920992","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6825","nonce":945164195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6827","nonce":945164195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6831","nonce":945164195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6829","nonce":945164195}]},"public_addr":"172.21.15.89:6825/945164195","cluster_addr":"172.21.15.89:6827/945164195","heartbeat_back_addr":"172.21.15.89:6831/945164195","heartbeat_front_addr":"172.21.15.89:6829/945164195","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3881499084":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6801/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6800/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/2177785153":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/4040448008":"2024-09-11T17:53:42.652060+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/135454569":"2024-09-11T17:53:42.652060+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T17:54:04.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:03 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2003771352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:54:04.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:54:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:54:03] "GET /metrics HTTP/1.1" 200 33652 "" "Prometheus/2.43.0" 2024-09-10T17:54:04.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:03 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2003771352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:54:04.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:03 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2003771352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:54:04.338 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T17:54:04.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T17:54:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:04.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:04 smithi012 ceph-mon[27356]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:04.976 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:04 smithi012 ceph-mon[37454]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:04 smithi089 ceph-mon[31467]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:06.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:54:06.299 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":75,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T17:53:56.725090+0000","last_up_change":"2024-09-10T17:52:08.800071+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T17:52:35.123712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T17:52:38.563420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-09-10T17:53:44.896711+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":74,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6803","nonce":2400757557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6805","nonce":2400757557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6809","nonce":2400757557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6807","nonce":2400757557}]},"public_addr":"172.21.15.12:6803/2400757557","cluster_addr":"172.21.15.12:6805/2400757557","heartbeat_back_addr":"172.21.15.12:6809/2400757557","heartbeat_front_addr":"172.21.15.12:6807/2400757557","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6811","nonce":284928520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6813","nonce":284928520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6817","nonce":284928520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6815","nonce":284928520}]},"public_addr":"172.21.15.12:6811/284928520","cluster_addr":"172.21.15.12:6813/284928520","heartbeat_back_addr":"172.21.15.12:6817/284928520","heartbeat_front_addr":"172.21.15.12:6815/284928520","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6819","nonce":2631347892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6821","nonce":2631347892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6825","nonce":2631347892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6823","nonce":2631347892}]},"public_addr":"172.21.15.12:6819/2631347892","cluster_addr":"172.21.15.12:6821/2631347892","heartbeat_back_addr":"172.21.15.12:6825/2631347892","heartbeat_front_addr":"172.21.15.12:6823/2631347892","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6827","nonce":3917191557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6829","nonce":3917191557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6833","nonce":3917191557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6831","nonce":3917191557}]},"public_addr":"172.21.15.12:6827/3917191557","cluster_addr":"172.21.15.12:6829/3917191557","heartbeat_back_addr":"172.21.15.12:6833/3917191557","heartbeat_front_addr":"172.21.15.12:6831/3917191557","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6801","nonce":4063563708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6803","nonce":4063563708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6807","nonce":4063563708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6805","nonce":4063563708}]},"public_addr":"172.21.15.89:6801/4063563708","cluster_addr":"172.21.15.89:6803/4063563708","heartbeat_back_addr":"172.21.15.89:6807/4063563708","heartbeat_front_addr":"172.21.15.89:6805/4063563708","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6809","nonce":4007259364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6811","nonce":4007259364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6815","nonce":4007259364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6813","nonce":4007259364}]},"public_addr":"172.21.15.89:6809/4007259364","cluster_addr":"172.21.15.89:6811/4007259364","heartbeat_back_addr":"172.21.15.89:6815/4007259364","heartbeat_front_addr":"172.21.15.89:6813/4007259364","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6817","nonce":1083920992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6819","nonce":1083920992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6823","nonce":1083920992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6821","nonce":1083920992}]},"public_addr":"172.21.15.89:6817/1083920992","cluster_addr":"172.21.15.89:6819/1083920992","heartbeat_back_addr":"172.21.15.89:6823/1083920992","heartbeat_front_addr":"172.21.15.89:6821/1083920992","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6825","nonce":945164195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6827","nonce":945164195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6831","nonce":945164195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6829","nonce":945164195}]},"public_addr":"172.21.15.89:6825/945164195","cluster_addr":"172.21.15.89:6827/945164195","heartbeat_back_addr":"172.21.15.89:6831/945164195","heartbeat_front_addr":"172.21.15.89:6829/945164195","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3881499084":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6801/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6800/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/2177785153":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/4040448008":"2024-09-11T17:53:42.652060+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/135454569":"2024-09-11T17:53:42.652060+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T17:54:06.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:06 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2496080088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:54:06.620 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:06 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2496080088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:54:06.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:06 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2496080088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:54:07.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T17:54:07.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T17:54:07.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T17:54:07.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T17:54:07.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T17:54:07.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T17:54:07.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T17:54:07.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T17:54:07.432 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:07.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:07 smithi012 ceph-mon[27356]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:07.714 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:07 smithi012 ceph-mon[37454]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:07.725 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:07.734 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:07.734 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:07.735 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:07.735 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:07.735 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:07.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:07 smithi089 ceph-mon[31467]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:08.156 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:08 smithi012 ceph-mon[27356]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:09.034 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:08 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:54:08.709Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.001985122s 2024-09-10T17:54:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:08 smithi012 ceph-mon[37454]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:08 smithi089 ceph-mon[31467]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:10.535 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:10 smithi089 systemd[1]: Starting Ceph grafana.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:54:10.892 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:10 smithi089 ceph-mon[31467]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:10.893 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:10 smithi089 podman[60867]: 2024-09-10 17:54:10.537977738 +0000 UTC m=+0.015212738 image pull 954c08fa618887fe9a6fe572ae541197c77e625b05f4193df7898f5ac649ada9 quay.io/ceph/ceph-grafana:9.4.7 2024-09-10T17:54:10.893 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:10 smithi089 podman[60867]: 2024-09-10 17:54:10.681243838 +0000 UTC m=+0.158478865 container create dfdd59da1bcad7bec4f96ed7ddfacb6e9591a98eafa08a743329dd83cf82164d (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, io.openshift.expose-services=, io.openshift.tags=base rhel8, release=239.1651231664, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ubi8, vendor=Red Hat, Inc., summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, io.buildah.version=1.32.0, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, vcs-type=git, maintainer=Paul Cuzner , version=8.5, architecture=x86_64, io.k8s.display-name=Red Hat Universal Base Image 8, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, build-date=2022-04-29T11:48:11.055897) 2024-09-10T17:54:10.893 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:10 smithi089 podman[60867]: 2024-09-10 17:54:10.891763901 +0000 UTC m=+0.368998890 container init dfdd59da1bcad7bec4f96ed7ddfacb6e9591a98eafa08a743329dd83cf82164d (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, io.buildah.version=1.32.0, version=8.5, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=ubi8, description=Ceph Grafana Container, release=239.1651231664, maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-04-29T11:48:11.055897, io.openshift.tags=base rhel8, vendor=Red Hat, Inc., summary=Grafana Container configured for Ceph mgr/dashboard integration, architecture=x86_64) 2024-09-10T17:54:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:10 smithi012 ceph-mon[27356]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:10 smithi012 ceph-mon[37454]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:11.143 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:10 smithi089 podman[60867]: 2024-09-10 17:54:10.894832634 +0000 UTC m=+0.372067620 container start dfdd59da1bcad7bec4f96ed7ddfacb6e9591a98eafa08a743329dd83cf82164d (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, name=ubi8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, build-date=2022-04-29T11:48:11.055897, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.expose-services=, description=Ceph Grafana Container, maintainer=Paul Cuzner , vendor=Red Hat, Inc., summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=239.1651231664, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, version=8.5, architecture=x86_64, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.tags=base rhel8, distribution-scope=public, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.32.0, com.redhat.component=ubi8-container) 2024-09-10T17:54:11.143 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 bash[60867]: dfdd59da1bcad7bec4f96ed7ddfacb6e9591a98eafa08a743329dd83cf82164d 2024-09-10T17:54:11.143 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 systemd[1]: Started Ceph grafana.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:54:11.143 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043633585Z level=info msg="Starting Grafana" version=9.4.7 commit=4add91f03d branch=HEAD compiled=2023-03-16T23:56:52Z 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043856681Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043882394Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043896153Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043908788Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043923471Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043934802Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043946626Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043957847Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043968585Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043978996Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.043995447Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-10T17:54:11.144 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.044011438Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=settings t=2024-09-10T17:54:11.044022496Z level=info msg="App mode production" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore t=2024-09-10T17:54:11.044077116Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore t=2024-09-10T17:54:11.044100126Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.045001776Z level=info msg="Starting DB migrations" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.045091626Z level=info msg="Executing migration" id="create migration_log table" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.045679334Z level=info msg="Executing migration" id="create user table" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.046120813Z level=info msg="Executing migration" id="add unique index user.login" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.048639394Z level=info msg="Executing migration" id="add unique index user.email" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.051366731Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.052007573Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.054671229Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-09-10T17:54:11.145 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.057427708Z level=info msg="Executing migration" id="create user table v2" 2024-09-10T17:54:11.146 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.060096379Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-09-10T17:54:11.146 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.062537947Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-09-10T17:54:11.146 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.065162873Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-09-10T17:54:11.146 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.067872698Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-09-10T17:54:11.146 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.068287132Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-09-10T17:54:11.146 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.071159053Z level=info msg="Executing migration" id="Update user table charset" 2024-09-10T17:54:11.147 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.072010156Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-09-10T17:54:11.147 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.072847072Z level=info msg="Executing migration" id="Add missing user data" 2024-09-10T17:54:11.147 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.07321883Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-09-10T17:54:11.147 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.074072305Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-09-10T17:54:11.147 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.074833839Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-09-10T17:54:11.147 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.07567615Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-09-10T17:54:11.147 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.076804807Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-09-10T17:54:11.148 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.077707411Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-09-10T17:54:11.148 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.078499634Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-09-10T17:54:11.148 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.0793576Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-09-10T17:54:11.148 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.080165052Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-09-10T17:54:11.148 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.080972179Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-09-10T17:54:11.148 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.081282797Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-09-10T17:54:11.148 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.082054687Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.082456061Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.082896707Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.083298509Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.083933508Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.084840919Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.085703777Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.086558664Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.087325384Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.088174554Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.089016567Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.089876347Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-10T17:54:11.149 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.090258409Z level=info msg="Executing migration" id="create star table" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.091198002Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.092113687Z level=info msg="Executing migration" id="create org table v1" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.092827602Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.093848646Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.094619395Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.095610507Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.096450589Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.097191016Z level=info msg="Executing migration" id="Update org table charset" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.098068998Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.100178392Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.102738409Z level=info msg="Executing migration" id="create dashboard table" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.10315808Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.108446705Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-10T17:54:11.150 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.109061144Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.111665222Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.114289987Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.116894598Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.119484382Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.12214014Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.127202674Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.127777524Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.130156952Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.132918958Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.135421648Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.135950972Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.138602935Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.141051252Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-10T17:54:11.151 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.14172427Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-10T17:54:11.152 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.142601534Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-10T17:54:11.152 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.143250129Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-10T17:54:11.152 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.144044516Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-10T17:54:11.152 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.144837534Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.145173283Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.145987959Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.146521553Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.147309641Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.147951624Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.148305363Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.149223425Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.14996504Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.150845088Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.151445145Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-10T17:54:11.395 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.152351279Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.153500912Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.154308494Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.154753942Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.155572245Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.156541214Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.15725904Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.15778371Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.158773386Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.159572402Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-10T17:54:11.396 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.160401405Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.160855797Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.161800623Z level=info msg="Executing migration" id="create data_source table" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.162463185Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.162890245Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.163352631Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.164126255Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.16494612Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.166002471Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.1664442Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.167234224Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-10T17:54:11.397 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.167718353Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-10T17:54:11.398 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.168195481Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-10T17:54:11.398 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.17110863Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-10T17:54:11.398 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.173709785Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-10T17:54:11.398 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.17633477Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-10T17:54:11.398 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.178984208Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-10T17:54:11.398 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.181611918Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-10T17:54:11.400 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.182007863Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-10T17:54:11.400 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.184949289Z level=info msg="Executing migration" id="Add uid column" 2024-09-10T17:54:11.400 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.187460731Z level=info msg="Executing migration" id="Update uid value" 2024-09-10T17:54:11.400 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.190112387Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-10T17:54:11.400 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.190547535Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.193233596Z level=info msg="Executing migration" id="create api_key table" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.195954652Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.198492604Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.199015739Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.201868716Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.204329367Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.20705917Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.20951806Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.212204085Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.214757801Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.215182781Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-10T17:54:11.401 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.215574681Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.215965023Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.216291434Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.21660152Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.216848706Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.217374511Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.21792522Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.218241193Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.218766342Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.219510116Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.21990645Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.222699909Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.225381565Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.225971408Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-10T17:54:11.402 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.226377524Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.226767939Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.227028453Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.227310223Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.227815206Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.228362176Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.228654839Z level=info msg="Executing migration" id="create quota table v1" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.229030028Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.22943598Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.229688038Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.230064257Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.230461249Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.231025004Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.231319266Z level=info msg="Executing migration" id="create session table" 2024-09-10T17:54:11.403 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.231727263Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.231984946Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.232302821Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.232663496Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.233027635Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.233302684Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.233551678Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.233806304Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.234063972Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.234438432Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.234694513Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.235266236Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.235559099Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-10T17:54:11.404 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.23613187Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.236723278Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.236986912Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.237413678Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.237862905Z level=info msg="Executing migration" id="create alert table v1" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.240461017Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.242927806Z level=info msg="Executing migration" id="add index alert state" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.245429866Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.245875421Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.246249403Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.246660861Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.247021785Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.248525324Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-10T17:54:11.405 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.248894574Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.249313643Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.2496194Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.250489412Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.250879779Z level=info msg="Executing migration" id="Add column is_default" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.251515095Z level=info msg="Executing migration" id="Add column frequency" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.252406673Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.253192192Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.254108482Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.25712992Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.259889494Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.262734235Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.265421914Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.268152407Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-10T17:54:11.406 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.271105396Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.274028467Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.276831097Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.279596431Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.282336418Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.285224791Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.287899738Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.290876776Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.293580971Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.296396513Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.29911492Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-10T17:54:11.407 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.301928932Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.304411507Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.306989214Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.309803153Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.312478861Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.31518972Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.317768129Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.320582118Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.323028813Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.325727823Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.3283326Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.330870247Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-10T17:54:11.408 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.333710592Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.336340815Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.339049374Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.34173607Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.344379037Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.347012843Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.349717734Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.350613797Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.351554194Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.352268253Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.353131367Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.353890782Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.35478722Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-10T17:54:11.409 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.355513497Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.356287047Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.357132486Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.358072262Z level=info msg="Executing migration" id="Move region to single row" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.358924147Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.359679647Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.360595567Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.361176449Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.361598722Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.362417926Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.362860167Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.363290381Z level=info msg="Executing migration" id="create test_data table" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.364175549Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-10T17:54:11.410 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.365051663Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.366020522Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.366752989Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.367616068Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.368111946Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.368422735Z level=info msg="Executing migration" id="create team table" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.369292832Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.370087796Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.371068996Z level=info msg="Executing migration" id="create team member table" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.371827586Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.372752602Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.373641353Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.374410531Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.375251513Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-10T17:54:11.411 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.376104795Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-10T17:54:11.412 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.376980568Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-10T17:54:11.412 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.379885082Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-10T17:54:11.412 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.382861829Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-10T17:54:11.412 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.38572202Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-10T17:54:11.412 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.38840768Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-10T17:54:11.412 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.391174114Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-10T17:54:11.412 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.394068868Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-10T17:54:11.412 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.396752814Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-10T17:54:11.645 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.399625624Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-10T17:54:11.645 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.402164947Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-10T17:54:11.645 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.404965288Z level=info msg="Executing migration" id="create tag table" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.408021721Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.408551997Z level=info msg="Executing migration" id="create login attempt table" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.411539892Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.414366035Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.417032452Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.418935801Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.421936277Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.424706931Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-10T17:54:11.646 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.427305194Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-10T17:54:11.647 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.427737485Z level=info msg="Executing migration" id="create user auth table" 2024-09-10T17:54:11.647 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.43039844Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-10T17:54:11.647 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.432978277Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-10T17:54:11.647 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.435593964Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-10T17:54:11.647 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.436517268Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-10T17:54:11.647 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.439227179Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-10T17:54:11.647 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.442085339Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-10T17:54:11.650 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.444591112Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-10T17:54:11.650 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.445088732Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-10T17:54:11.650 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.447808641Z level=info msg="Executing migration" id="create server_lock table" 2024-09-10T17:54:11.650 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.45043327Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-10T17:54:11.650 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.453160254Z level=info msg="Executing migration" id="create user auth token table" 2024-09-10T17:54:11.650 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.453624178Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-10T17:54:11.650 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.456422593Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-10T17:54:11.651 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.459021692Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-10T17:54:11.651 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.461613746Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-10T17:54:11.651 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.462421333Z level=info msg="Executing migration" id="create cache_data table" 2024-09-10T17:54:11.651 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.463379192Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-10T17:54:11.651 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.464071491Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-10T17:54:11.651 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.464904509Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-10T17:54:11.651 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.465389134Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.466309862Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.467086572Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.467970032Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.468592159Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.46943101Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.470273316Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.47108797Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.471550918Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-10T17:54:11.652 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.47229861Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.472775651Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.473583524Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.474563422Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.475053884Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.475935925Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.476909444Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.477656963Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.477944476Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.478404676Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.478787172Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.479242078Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-10T17:54:11.653 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.479716766Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.480562134Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.480981935Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.481461028Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.484780686Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.488107849Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.488580237Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.489000978Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.489843002Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.490246032Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.490677077Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.491077942Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.491488167Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.49175173Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-10T17:54:11.654 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.492604832Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.493487392Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.494333135Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.494759979Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.495528582Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.496342286Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.497168558Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.497598271Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.498453733Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.499282897Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.499583557Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.500007278Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.50042708Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.500841741Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-10T17:54:11.655 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.501154213Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.502038881Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.502896673Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.50375208Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.504636723Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.505681676Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.506442124Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.507285511Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.50816543Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.509038503Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.509926019Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.510709244Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.511632458Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-10T17:54:11.656 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.512480263Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.513327411Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.514175046Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.51461235Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.515419324Z level=info msg="Executing migration" id="create alert_image table" 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.51625509Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.517071795Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.517399428Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.520227516Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-10T17:54:11.657 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.520653931Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.520738244Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.52347045Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.524050563Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.524483196Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.524603075Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.524719208Z level=info msg="alerts found to migrate" alerts=0 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.527278694Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.527861588Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.529922003Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.532424977Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.532896012Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.535740771Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.538733083Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-10T17:54:11.658 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.5412732Z level=info msg="Executing migration" id="create data_keys table" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.5417177Z level=info msg="Executing migration" id="create secrets table" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.544338864Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.548644688Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.551477128Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.551831361Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.555918351Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.560069627Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.562770033Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.563256707Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.565961663Z level=info msg="Executing migration" id="create permission table" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.568658756Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.57119506Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.571666491Z level=info msg="Executing migration" id="create role table" 2024-09-10T17:54:11.659 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.574221852Z level=info msg="Executing migration" id="add column display_name" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.576823783Z level=info msg="Executing migration" id="add column group_name" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.57933769Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.579801961Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.58254979Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.585063289Z level=info msg="Executing migration" id="create team role table" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.587523865Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.587969653Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.590509745Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.592921717Z level=info msg="Executing migration" id="create user role table" 2024-09-10T17:54:11.660 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.593875941Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.594405464Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.595291793Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.595970656Z level=info msg="Executing migration" id="create builtin role table" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.596892731Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.597541865Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.598428762Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.599448741Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.599955332Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.600447303Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.600852992Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.601300084Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.601684953Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-10T17:54:11.661 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.602148075Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.60312761Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.603900287Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.604369463Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.604663899Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.605051141Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.605508708Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.605843785Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.606162336Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.60650899Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.606887602Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.607316949Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.608274988Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.608574077Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-10T17:54:11.662 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.608975268Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.609403044Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.60982461Z level=info msg="Executing migration" id="add correlation config column" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.610815472Z level=info msg="Executing migration" id="create entity_events table" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.611246108Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.611645446Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.611723417Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.612002315Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.612081554Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.61235103Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-10T17:54:11.663 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.613196245Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.614237692Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.614748526Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.61552107Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.616295144Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.617080855Z level=info msg="Executing migration" id="Drop public config table" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.617509379Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.618325414Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.618813907Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.619301088Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.62015391Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.623209982Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.624278271Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-10T17:54:11.664 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.625347391Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.626239826Z level=info msg="Executing migration" id="add share column" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.627500323Z level=info msg="Executing migration" id="create default alerting folders" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.62848293Z level=info msg="Executing migration" id="create file table" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.629182074Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.63016826Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.630844561Z level=info msg="Executing migration" id="create file_meta table" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.631801135Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.632473471Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.633466218Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.633963457Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.63477536Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.635777184Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-10T17:54:11.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.637012102Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-10T17:54:11.666 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.637356095Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-10T17:54:11.666 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.638345192Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-10T17:54:11.666 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.639042263Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-10T17:54:11.666 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.641639813Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-10T17:54:11.666 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.642045641Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-10T17:54:11.666 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.645006732Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-10T17:54:11.666 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.6476709Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-10T17:54:12.035 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.650332347Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.660138348Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.662946942Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.665817383Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.669231591Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.669577815Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.672458746Z level=info msg="Executing migration" id="create folder table" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.673053128Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.67526208Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.677800834Z level=info msg="Executing migration" id="Update folder title length" 2024-09-10T17:54:12.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.678148971Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-10T17:54:12.037 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=migrator t=2024-09-10T17:54:11.680969617Z level=info msg="migrations completed" performed=485 skipped=0 duration=635.902278ms 2024-09-10T17:54:12.037 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore t=2024-09-10T17:54:11.681413601Z level=info msg="Created default organization" 2024-09-10T17:54:12.037 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=plugin.loader t=2024-09-10T17:54:11.738236054Z level=info msg="Plugin registered" pluginID=input 2024-09-10T17:54:12.037 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=plugin.loader t=2024-09-10T17:54:11.764663026Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-09-10T17:54:12.037 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=plugin.loader t=2024-09-10T17:54:11.764679865Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-09-10T17:54:12.037 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=secrets t=2024-09-10T17:54:11.764711063Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-10T17:54:12.038 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=query_data t=2024-09-10T17:54:11.766349402Z level=info msg="Query Service initialization" 2024-09-10T17:54:12.038 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=live.push_http t=2024-09-10T17:54:11.768909574Z level=info msg="Live Push Gateway initialization" 2024-09-10T17:54:12.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[27356]: Deploying daemon node-exporter.a on smithi012 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:12 smithi012 ceph-mon[37454]: Deploying daemon node-exporter.a on smithi012 2024-09-10T17:54:12.387 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.387 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.387 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.387 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:12.387 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-mon[31467]: Deploying daemon node-exporter.a on smithi012 2024-09-10T17:54:12.643 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=infra.usagestats.collector t=2024-09-10T17:54:12.533276088Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-10T17:54:12.643 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=provisioning.datasources t=2024-09-10T17:54:12.588576526Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-10T17:54:12.643 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=provisioning.datasources t=2024-09-10T17:54:12.621018908Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-09-10T17:54:13.035 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=provisioning.alerting t=2024-09-10T17:54:12.642766682Z level=info msg="starting to provision alerting" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=provisioning.alerting t=2024-09-10T17:54:12.642812111Z level=info msg="finished to provision alerting" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=grafanaStorageLogger t=2024-09-10T17:54:12.643013788Z level=info msg="storage starting" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=ngalert.state.manager t=2024-09-10T17:54:12.643011474Z level=info msg="Warming state cache for startup" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=http.server t=2024-09-10T17:54:12.644836855Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=ngalert.state.manager t=2024-09-10T17:54:12.653198115Z level=info msg="State cache has been initialized" states=0 duration=10.186322ms 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=ticker t=2024-09-10T17:54:12.653274443Z level=info msg=starting first_tick=2024-09-10T17:54:20Z 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=ngalert.multiorg.alertmanager t=2024-09-10T17:54:12.653300712Z level=info msg="starting MultiOrg Alertmanager" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore.transactions t=2024-09-10T17:54:12.653310871Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore.transactions t=2024-09-10T17:54:12.696321298Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore.transactions t=2024-09-10T17:54:12.728969214Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore.transactions t=2024-09-10T17:54:12.740267969Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-10T17:54:13.036 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 17:54:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore.transactions t=2024-09-10T17:54:12.751539036Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-09-10T17:54:13.228 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:13 smithi012 ceph-mon[27356]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:13.228 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:13 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:13.228 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:13 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:13.229 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:13 smithi012 ceph-mon[37454]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:13.229 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:13 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:13.229 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:13 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:13.375 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:13 smithi089 ceph-mon[31467]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:13.376 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:13 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:13.376 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:13 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:14.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:54:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:54:13] "GET /metrics HTTP/1.1" 200 33646 "" "Prometheus/2.43.0" 2024-09-10T17:54:14.894 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:14 smithi012 ceph-mon[27356]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:14.895 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:14 smithi012 ceph-mon[37454]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:14 smithi089 ceph-mon[31467]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:16.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:16 smithi012 ceph-mon[27356]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:16.915 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:16 smithi012 ceph-mon[37454]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:17.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:16 smithi089 ceph-mon[31467]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:17.913 INFO:teuthology.orchestra.run.smithi012.stdout:197568495649 2024-09-10T17:54:17.914 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T17:54:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:163208757285 2024-09-10T17:54:18.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T17:54:18.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:18 smithi012 ceph-mon[27356]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:18.964 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:18 smithi012 ceph-mon[37454]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:18 smithi089 ceph-mon[31467]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:77309411380 2024-09-10T17:54:20.931 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T17:54:21.027 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:20 smithi012 ceph-mon[27356]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:21.028 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:20 smithi012 ceph-mon[37454]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:20 smithi089 ceph-mon[31467]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:22 smithi012 ceph-mon[27356]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:23.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:22 smithi012 ceph-mon[37454]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:23.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:22 smithi089 ceph-mon[31467]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:23.932 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:23 smithi012 bash[71545]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-10T17:54:23.932 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:23 smithi012 bash[71545]: Writing manifest to image destination 2024-09-10T17:54:24.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:54:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:54:23] "GET /metrics HTTP/1.1" 200 33646 "" "Prometheus/2.43.0" 2024-09-10T17:54:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:107374182447 2024-09-10T17:54:24.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T17:54:24.473 INFO:teuthology.orchestra.run.smithi012.stdout:231928234011 2024-09-10T17:54:24.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T17:54:24.689 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:24 smithi012 podman[71545]: 2024-09-10 17:54:24.344196358 +0000 UTC m=+5.356258763 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-10T17:54:24.689 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:24 smithi012 podman[71545]: 2024-09-10 17:54:24.567177334 +0000 UTC m=+5.579239725 container create 33d3201f4d4f402b0bcad46569ad30d24be9cdf3ce9a229a681e4f3acabb019e (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:24.996 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:24 smithi012 ceph-mon[27356]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:24.997 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:24 smithi012 ceph-mon[37454]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:25.017 INFO:teuthology.orchestra.run.smithi012.stdout:34359738429 2024-09-10T17:54:25.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T17:54:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:24 smithi089 ceph-mon[31467]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:25.363 INFO:teuthology.orchestra.run.smithi012.stdout:128849018921 2024-09-10T17:54:25.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T17:54:25.806 INFO:teuthology.orchestra.run.smithi012.stdout:55834574904 2024-09-10T17:54:25.806 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T17:54:26.065 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:26.067 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:26.068 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:26.228 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 podman[71545]: 2024-09-10 17:54:25.911451075 +0000 UTC m=+6.923513465 container init 33d3201f4d4f402b0bcad46569ad30d24be9cdf3ce9a229a681e4f3acabb019e (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 podman[71545]: 2024-09-10 17:54:25.916563803 +0000 UTC m=+6.928626205 container start 33d3201f4d4f402b0bcad46569ad30d24be9cdf3ce9a229a681e4f3acabb019e (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.922Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.922Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.923Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.923Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=arp 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-10T17:54:26.229 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=edac 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-10T17:54:26.230 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=os 2024-09-10T17:54:26.231 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-10T17:54:26.232 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-10T17:54:26.232 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-10T17:54:26.232 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-10T17:54:26.232 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-10T17:54:26.232 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-10T17:54:26.232 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-10T17:54:26.232 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=stat 2024-09-10T17:54:26.232 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=time 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=uname 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.924Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.925Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[71994]: ts=2024-09-10T17:54:25.925Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:26 smithi012 bash[71545]: 33d3201f4d4f402b0bcad46569ad30d24be9cdf3ce9a229a681e4f3acabb019e 2024-09-10T17:54:26.233 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 17:54:26 smithi012 systemd[1]: Started Ceph node-exporter.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:54:27.128 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:27 smithi089 bash[61144]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-10T17:54:27.313 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.313 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.313 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.313 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[37454]: Deploying daemon node-exporter.b on smithi089 2024-09-10T17:54:27.313 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[37454]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:27.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[27356]: Deploying daemon node-exporter.b on smithi089 2024-09-10T17:54:27.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:27 smithi012 ceph-mon[27356]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:27.420 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:27 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.421 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:27 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.421 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:27 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:27.421 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:27 smithi089 ceph-mon[31467]: Deploying daemon node-exporter.b on smithi089 2024-09-10T17:54:27.421 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:27 smithi089 ceph-mon[31467]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:27.682 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:27.682 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:27.689 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:27.689 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:27.689 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:27.785 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:27 smithi089 bash[61144]: Getting image source signatures 2024-09-10T17:54:27.785 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:27 smithi089 bash[61144]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-10T17:54:27.785 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:27 smithi089 bash[61144]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-10T17:54:27.785 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:27 smithi089 bash[61144]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-10T17:54:28.395 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:28 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:28.395 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:28 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:28.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:28 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:29.035 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:28 smithi089 bash[61144]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-10T17:54:29.035 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:28 smithi089 bash[61144]: Writing manifest to image destination 2024-09-10T17:54:29.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:29 smithi012 ceph-mon[27356]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:29 smithi012 ceph-mon[37454]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:29.396 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-mon[31467]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:29.396 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 podman[61144]: 2024-09-10 17:54:29.16979246 +0000 UTC m=+2.198193283 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-10T17:54:29.396 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 podman[61144]: 2024-09-10 17:54:29.268406046 +0000 UTC m=+2.296806944 container create ba0632e17e74521c6a0d2ed638b5f3b2693fe37d6c13c37a16e67c44f1648520 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T17:54:29.788 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 podman[61144]: 2024-09-10 17:54:29.504258897 +0000 UTC m=+2.532659721 container init ba0632e17e74521c6a0d2ed638b5f3b2693fe37d6c13c37a16e67c44f1648520 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 podman[61144]: 2024-09-10 17:54:29.50707685 +0000 UTC m=+2.535477673 container start ba0632e17e74521c6a0d2ed638b5f3b2693fe37d6c13c37a16e67c44f1648520 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.510Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.510Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.511Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.511Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.511Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.511Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=arp 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-10T17:54:29.789 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=edac 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-10T17:54:29.790 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=os 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-10T17:54:29.791 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=stat 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=time 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=uname 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-10T17:54:29.792 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-10T17:54:29.793 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.512Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-10T17:54:29.793 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.513Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-10T17:54:29.793 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[61216]: ts=2024-09-10T17:54:29.513Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-10T17:54:29.793 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 bash[61144]: ba0632e17e74521c6a0d2ed638b5f3b2693fe37d6c13c37a16e67c44f1648520 2024-09-10T17:54:29.793 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 17:54:29 smithi089 systemd[1]: Started Ceph node-exporter.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:54:30.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:30.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:30 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:54:31.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:30 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:31.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:30 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:31.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:30 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:31.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:30 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:31.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:30 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:31.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:30 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:54:31.496 INFO:teuthology.orchestra.run.smithi012.stdout:197568495652 2024-09-10T17:54:31.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:31 smithi012 ceph-mon[27356]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:31.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:31 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2163185128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T17:54:31.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:31 smithi012 ceph-mon[37454]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:31.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:31 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2163185128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T17:54:32.026 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:31 smithi089 ceph-mon[31467]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:32.026 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:31 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2163185128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T17:54:32.801 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495649 got 197568495652 for osd.6 2024-09-10T17:54:32.801 DEBUG:teuthology.parallel:result is None 2024-09-10T17:54:32.914 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:32 smithi089 ceph-mon[31467]: pgmap v35: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:32.914 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:32 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:33.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:32 smithi012 ceph-mon[27356]: pgmap v35: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:32 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:32 smithi012 ceph-mon[37454]: pgmap v35: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:32 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:33.507 INFO:teuthology.orchestra.run.smithi012.stdout:163208757288 2024-09-10T17:54:34.185 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:54:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:54:33] "GET /metrics HTTP/1.1" 200 33649 "" "Prometheus/2.43.0" 2024-09-10T17:54:34.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:34 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:34.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:34 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:34.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:34 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3695072493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T17:54:34.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:34 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:34.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:34 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:34.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:34 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3695072493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T17:54:34.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:34 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:34.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:34 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:34.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:34 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3695072493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T17:54:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:35 smithi012 ceph-mon[27356]: pgmap v36: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:35 smithi012 ceph-mon[37454]: pgmap v36: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:35 smithi089 ceph-mon[31467]: pgmap v36: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:36.378 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757285 got 163208757288 for osd.5 2024-09-10T17:54:36.378 DEBUG:teuthology.parallel:result is None 2024-09-10T17:54:37.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:36 smithi012 ceph-mon[27356]: pgmap v37: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:37.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:36 smithi012 ceph-mon[37454]: pgmap v37: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:37.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:36 smithi089 ceph-mon[31467]: pgmap v37: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:37.128 INFO:teuthology.orchestra.run.smithi012.stdout:77309411383 2024-09-10T17:54:38.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:37 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3401107333' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T17:54:38.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:37 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3401107333' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T17:54:38.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:37 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3401107333' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T17:54:38.221 INFO:teuthology.orchestra.run.smithi012.stdout:34359738432 2024-09-10T17:54:38.823 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411380 got 77309411383 for osd.2 2024-09-10T17:54:38.876 DEBUG:teuthology.parallel:result is None 2024-09-10T17:54:39.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:38 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/4109705247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T17:54:39.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:38 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1992606755' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T17:54:39.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:38 smithi012 ceph-mon[27356]: pgmap v38: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:39.022 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:38 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/4109705247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T17:54:39.022 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:38 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1992606755' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T17:54:39.022 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:38 smithi012 ceph-mon[37454]: pgmap v38: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:38 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/4109705247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T17:54:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:38 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1992606755' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T17:54:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:38 smithi089 ceph-mon[31467]: pgmap v38: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:107374182450 2024-09-10T17:54:39.310 INFO:teuthology.orchestra.run.smithi012.stdout:128849018924 2024-09-10T17:54:39.374 INFO:teuthology.orchestra.run.smithi012.stdout:231928234015 2024-09-10T17:54:39.997 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:39 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3097659609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T17:54:39.997 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:39 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/316345849' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T17:54:39.997 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:39 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3097659609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T17:54:39.997 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:39 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/316345849' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T17:54:40.019 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018921 got 128849018924 for osd.4 2024-09-10T17:54:40.019 DEBUG:teuthology.parallel:result is None 2024-09-10T17:54:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:39 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3097659609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T17:54:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:39 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/316345849' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T17:54:40.810 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:40 smithi012 ceph-mon[27356]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:40.811 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:40 smithi012 ceph-mon[37454]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:40.837 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234011 got 231928234015 for osd.7 2024-09-10T17:54:40.837 DEBUG:teuthology.parallel:result is None 2024-09-10T17:54:41.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:40 smithi089 ceph-mon[31467]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:41.325 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182447 got 107374182450 for osd.3 2024-09-10T17:54:41.325 DEBUG:teuthology.parallel:result is None 2024-09-10T17:54:42.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738429 got 34359738432 for osd.0 2024-09-10T17:54:42.541 DEBUG:teuthology.parallel:result is None 2024-09-10T17:54:42.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:42 smithi012 ceph-mon[27356]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:42.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:42 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:42.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:42 smithi012 ceph-mon[37454]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:42.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:42 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:42 smithi089 ceph-mon[31467]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:42 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:43.556 INFO:teuthology.orchestra.run.smithi012.stdout:55834574908 2024-09-10T17:54:43.860 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:43 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/4183360359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T17:54:43.860 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:43 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/4183360359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T17:54:44.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:43 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/4183360359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T17:54:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:54:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:54:43] "GET /metrics HTTP/1.1" 200 33651 "" "Prometheus/2.43.0" 2024-09-10T17:54:44.715 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574904 got 55834574908 for osd.1 2024-09-10T17:54:44.716 DEBUG:teuthology.parallel:result is None 2024-09-10T17:54:44.716 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T17:54:44.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T17:54:44.948 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:45.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:44 smithi012 ceph-mon[27356]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:45.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:44 smithi012 ceph-mon[37454]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:44 smithi089 ceph-mon[31467]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:47.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:46 smithi012 ceph-mon[27356]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:47.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:46 smithi012 ceph-mon[37454]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:47.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:46 smithi089 ceph-mon[31467]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:47.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:54:47.683 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T17:54:48.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:47 smithi012 ceph-mon[27356]: from='client.24644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:54:48.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:47 smithi012 ceph-mon[37454]: from='client.24644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:54:48.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:47 smithi089 ceph-mon[31467]: from='client.24644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:54:48.461 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-10T17:54:46.679304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593533,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":229,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":236368,"kb_used_data":7924,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749724848,"statfs":{"total":767960285184,"available":767718244352,"internally_reserved":0,"allocated":8114176,"data_stored":4571952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":233819706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002884"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.155953+0000","last_change":"2024-09-10T17:52:39.637199+0000","last_active":"2024-09-10T17:53:57.155953+0000","last_peered":"2024-09-10T17:53:57.155953+0000","last_clean":"2024-09-10T17:53:57.155953+0000","last_became_active":"2024-09-10T17:52:39.636912+0000","last_became_peered":"2024-09-10T17:52:39.636912+0000","last_unstale":"2024-09-10T17:53:57.155953+0000","last_undegraded":"2024-09-10T17:53:57.155953+0000","last_fullsized":"2024-09-10T17:53:57.155953+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199247+0000","last_change":"2024-09-10T17:52:39.640227+0000","last_active":"2024-09-10T17:53:50.199247+0000","last_peered":"2024-09-10T17:53:50.199247+0000","last_clean":"2024-09-10T17:53:50.199247+0000","last_became_active":"2024-09-10T17:52:39.639677+0000","last_became_peered":"2024-09-10T17:52:39.639677+0000","last_unstale":"2024-09-10T17:53:50.199247+0000","last_undegraded":"2024-09-10T17:53:50.199247+0000","last_fullsized":"2024-09-10T17:53:50.199247+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729996+0000","last_change":"2024-09-10T17:52:39.634939+0000","last_active":"2024-09-10T17:53:56.729996+0000","last_peered":"2024-09-10T17:53:56.729996+0000","last_clean":"2024-09-10T17:53:56.729996+0000","last_became_active":"2024-09-10T17:52:39.634668+0000","last_became_peered":"2024-09-10T17:52:39.634668+0000","last_unstale":"2024-09-10T17:53:56.729996+0000","last_undegraded":"2024-09-10T17:53:56.729996+0000","last_fullsized":"2024-09-10T17:53:56.729996+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.867745+0000","last_change":"2024-09-10T17:52:39.652074+0000","last_active":"2024-09-10T17:53:56.867745+0000","last_peered":"2024-09-10T17:53:56.867745+0000","last_clean":"2024-09-10T17:53:56.867745+0000","last_became_active":"2024-09-10T17:52:39.651762+0000","last_became_peered":"2024-09-10T17:52:39.651762+0000","last_unstale":"2024-09-10T17:53:56.867745+0000","last_undegraded":"2024-09-10T17:53:56.867745+0000","last_fullsized":"2024-09-10T17:53:56.867745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301649+0000","last_change":"2024-09-10T17:52:39.637379+0000","last_active":"2024-09-10T17:53:50.301649+0000","last_peered":"2024-09-10T17:53:50.301649+0000","last_clean":"2024-09-10T17:53:50.301649+0000","last_became_active":"2024-09-10T17:52:39.636370+0000","last_became_peered":"2024-09-10T17:52:39.636370+0000","last_unstale":"2024-09-10T17:53:50.301649+0000","last_undegraded":"2024-09-10T17:53:50.301649+0000","last_fullsized":"2024-09-10T17:53:50.301649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203361+0000","last_change":"2024-09-10T17:52:39.646980+0000","last_active":"2024-09-10T17:53:50.203361+0000","last_peered":"2024-09-10T17:53:50.203361+0000","last_clean":"2024-09-10T17:53:50.203361+0000","last_became_active":"2024-09-10T17:52:39.645786+0000","last_became_peered":"2024-09-10T17:52:39.645786+0000","last_unstale":"2024-09-10T17:53:50.203361+0000","last_undegraded":"2024-09-10T17:53:50.203361+0000","last_fullsized":"2024-09-10T17:53:50.203361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301835+0000","last_change":"2024-09-10T17:53:04.527641+0000","last_active":"2024-09-10T17:53:50.301835+0000","last_peered":"2024-09-10T17:53:50.301835+0000","last_clean":"2024-09-10T17:53:50.301835+0000","last_became_active":"2024-09-10T17:53:04.527295+0000","last_became_peered":"2024-09-10T17:53:04.527295+0000","last_unstale":"2024-09-10T17:53:50.301835+0000","last_undegraded":"2024-09-10T17:53:50.301835+0000","last_fullsized":"2024-09-10T17:53:50.301835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:12.311291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198750+0000","last_change":"2024-09-10T17:52:39.645147+0000","last_active":"2024-09-10T17:53:50.198750+0000","last_peered":"2024-09-10T17:53:50.198750+0000","last_clean":"2024-09-10T17:53:50.198750+0000","last_became_active":"2024-09-10T17:52:39.644853+0000","last_became_peered":"2024-09-10T17:52:39.644853+0000","last_unstale":"2024-09-10T17:53:50.198750+0000","last_undegraded":"2024-09-10T17:53:50.198750+0000","last_fullsized":"2024-09-10T17:53:50.198750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302468+0000","last_change":"2024-09-10T17:52:39.643055+0000","last_active":"2024-09-10T17:53:50.302468+0000","last_peered":"2024-09-10T17:53:50.302468+0000","last_clean":"2024-09-10T17:53:50.302468+0000","last_became_active":"2024-09-10T17:52:39.642731+0000","last_became_peered":"2024-09-10T17:52:39.642731+0000","last_unstale":"2024-09-10T17:53:50.302468+0000","last_undegraded":"2024-09-10T17:53:50.302468+0000","last_fullsized":"2024-09-10T17:53:50.302468+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301587+0000","last_change":"2024-09-10T17:52:39.642693+0000","last_active":"2024-09-10T17:53:50.301587+0000","last_peered":"2024-09-10T17:53:50.301587+0000","last_clean":"2024-09-10T17:53:50.301587+0000","last_became_active":"2024-09-10T17:52:39.642404+0000","last_became_peered":"2024-09-10T17:52:39.642404+0000","last_unstale":"2024-09-10T17:53:50.301587+0000","last_undegraded":"2024-09-10T17:53:50.301587+0000","last_fullsized":"2024-09-10T17:53:50.301587+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301874+0000","last_change":"2024-09-10T17:52:39.641932+0000","last_active":"2024-09-10T17:53:50.301874+0000","last_peered":"2024-09-10T17:53:50.301874+0000","last_clean":"2024-09-10T17:53:50.301874+0000","last_became_active":"2024-09-10T17:52:39.641622+0000","last_became_peered":"2024-09-10T17:52:39.641622+0000","last_unstale":"2024-09-10T17:53:50.301874+0000","last_undegraded":"2024-09-10T17:53:50.301874+0000","last_fullsized":"2024-09-10T17:53:50.301874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301348+0000","last_change":"2024-09-10T17:53:04.527604+0000","last_active":"2024-09-10T17:53:50.301348+0000","last_peered":"2024-09-10T17:53:50.301348+0000","last_clean":"2024-09-10T17:53:50.301348+0000","last_became_active":"2024-09-10T17:53:04.527109+0000","last_became_peered":"2024-09-10T17:53:04.527109+0000","last_unstale":"2024-09-10T17:53:50.301348+0000","last_undegraded":"2024-09-10T17:53:50.301348+0000","last_fullsized":"2024-09-10T17:53:50.301348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199181+0000","last_change":"2024-09-10T17:52:39.642786+0000","last_active":"2024-09-10T17:53:50.199181+0000","last_peered":"2024-09-10T17:53:50.199181+0000","last_clean":"2024-09-10T17:53:50.199181+0000","last_became_active":"2024-09-10T17:52:39.641524+0000","last_became_peered":"2024-09-10T17:52:39.641524+0000","last_unstale":"2024-09-10T17:53:50.199181+0000","last_undegraded":"2024-09-10T17:53:50.199181+0000","last_fullsized":"2024-09-10T17:53:50.199181+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301621+0000","last_change":"2024-09-10T17:52:39.639101+0000","last_active":"2024-09-10T17:53:50.301621+0000","last_peered":"2024-09-10T17:53:50.301621+0000","last_clean":"2024-09-10T17:53:50.301621+0000","last_became_active":"2024-09-10T17:52:39.638816+0000","last_became_peered":"2024-09-10T17:52:39.638816+0000","last_unstale":"2024-09-10T17:53:50.301621+0000","last_undegraded":"2024-09-10T17:53:50.301621+0000","last_fullsized":"2024-09-10T17:53:50.301621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198885+0000","last_change":"2024-09-10T17:52:39.640880+0000","last_active":"2024-09-10T17:53:50.198885+0000","last_peered":"2024-09-10T17:53:50.198885+0000","last_clean":"2024-09-10T17:53:50.198885+0000","last_became_active":"2024-09-10T17:52:39.640599+0000","last_became_peered":"2024-09-10T17:52:39.640599+0000","last_unstale":"2024-09-10T17:53:50.198885+0000","last_undegraded":"2024-09-10T17:53:50.198885+0000","last_fullsized":"2024-09-10T17:53:50.198885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203199+0000","last_change":"2024-09-10T17:52:39.646904+0000","last_active":"2024-09-10T17:53:50.203199+0000","last_peered":"2024-09-10T17:53:50.203199+0000","last_clean":"2024-09-10T17:53:50.203199+0000","last_became_active":"2024-09-10T17:52:39.646649+0000","last_became_peered":"2024-09-10T17:52:39.646649+0000","last_unstale":"2024-09-10T17:53:50.203199+0000","last_undegraded":"2024-09-10T17:53:50.203199+0000","last_fullsized":"2024-09-10T17:53:50.203199+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203972+0000","last_change":"2024-09-10T17:52:39.651784+0000","last_active":"2024-09-10T17:53:50.203972+0000","last_peered":"2024-09-10T17:53:50.203972+0000","last_clean":"2024-09-10T17:53:50.203972+0000","last_became_active":"2024-09-10T17:52:39.651519+0000","last_became_peered":"2024-09-10T17:52:39.651519+0000","last_unstale":"2024-09-10T17:53:50.203972+0000","last_undegraded":"2024-09-10T17:53:50.203972+0000","last_fullsized":"2024-09-10T17:53:50.203972+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302021+0000","last_change":"2024-09-10T17:52:39.636540+0000","last_active":"2024-09-10T17:53:50.302021+0000","last_peered":"2024-09-10T17:53:50.302021+0000","last_clean":"2024-09-10T17:53:50.302021+0000","last_became_active":"2024-09-10T17:52:39.636034+0000","last_became_peered":"2024-09-10T17:52:39.636034+0000","last_unstale":"2024-09-10T17:53:50.302021+0000","last_undegraded":"2024-09-10T17:53:50.302021+0000","last_fullsized":"2024-09-10T17:53:50.302021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302270+0000","last_change":"2024-09-10T17:52:39.642764+0000","last_active":"2024-09-10T17:53:50.302270+0000","last_peered":"2024-09-10T17:53:50.302270+0000","last_clean":"2024-09-10T17:53:50.302270+0000","last_became_active":"2024-09-10T17:52:39.642454+0000","last_became_peered":"2024-09-10T17:52:39.642454+0000","last_unstale":"2024-09-10T17:53:50.302270+0000","last_undegraded":"2024-09-10T17:53:50.302270+0000","last_fullsized":"2024-09-10T17:53:50.302270+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302336+0000","last_change":"2024-09-10T17:52:39.644420+0000","last_active":"2024-09-10T17:53:50.302336+0000","last_peered":"2024-09-10T17:53:50.302336+0000","last_clean":"2024-09-10T17:53:50.302336+0000","last_became_active":"2024-09-10T17:52:39.644155+0000","last_became_peered":"2024-09-10T17:52:39.644155+0000","last_unstale":"2024-09-10T17:53:50.302336+0000","last_undegraded":"2024-09-10T17:53:50.302336+0000","last_fullsized":"2024-09-10T17:53:50.302336+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302274+0000","last_change":"2024-09-10T17:52:39.631587+0000","last_active":"2024-09-10T17:53:50.302274+0000","last_peered":"2024-09-10T17:53:50.302274+0000","last_clean":"2024-09-10T17:53:50.302274+0000","last_became_active":"2024-09-10T17:52:39.631291+0000","last_became_peered":"2024-09-10T17:52:39.631291+0000","last_unstale":"2024-09-10T17:53:50.302274+0000","last_undegraded":"2024-09-10T17:53:50.302274+0000","last_fullsized":"2024-09-10T17:53:50.302274+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203349+0000","last_change":"2024-09-10T17:52:39.635863+0000","last_active":"2024-09-10T17:53:50.203349+0000","last_peered":"2024-09-10T17:53:50.203349+0000","last_clean":"2024-09-10T17:53:50.203349+0000","last_became_active":"2024-09-10T17:52:39.635566+0000","last_became_peered":"2024-09-10T17:52:39.635566+0000","last_unstale":"2024-09-10T17:53:50.203349+0000","last_undegraded":"2024-09-10T17:53:50.203349+0000","last_fullsized":"2024-09-10T17:53:50.203349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198959+0000","last_change":"2024-09-10T17:52:39.641463+0000","last_active":"2024-09-10T17:53:50.198959+0000","last_peered":"2024-09-10T17:53:50.198959+0000","last_clean":"2024-09-10T17:53:50.198959+0000","last_became_active":"2024-09-10T17:52:39.640887+0000","last_became_peered":"2024-09-10T17:52:39.640887+0000","last_unstale":"2024-09-10T17:53:50.198959+0000","last_undegraded":"2024-09-10T17:53:50.198959+0000","last_fullsized":"2024-09-10T17:53:50.198959+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203437+0000","last_change":"2024-09-10T17:52:39.648810+0000","last_active":"2024-09-10T17:53:50.203437+0000","last_peered":"2024-09-10T17:53:50.203437+0000","last_clean":"2024-09-10T17:53:50.203437+0000","last_became_active":"2024-09-10T17:52:39.648476+0000","last_became_peered":"2024-09-10T17:52:39.648476+0000","last_unstale":"2024-09-10T17:53:50.203437+0000","last_undegraded":"2024-09-10T17:53:50.203437+0000","last_fullsized":"2024-09-10T17:53:50.203437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199358+0000","last_change":"2024-09-10T17:52:39.643794+0000","last_active":"2024-09-10T17:53:50.199358+0000","last_peered":"2024-09-10T17:53:50.199358+0000","last_clean":"2024-09-10T17:53:50.199358+0000","last_became_active":"2024-09-10T17:52:39.643540+0000","last_became_peered":"2024-09-10T17:52:39.643540+0000","last_unstale":"2024-09-10T17:53:50.199358+0000","last_undegraded":"2024-09-10T17:53:50.199358+0000","last_fullsized":"2024-09-10T17:53:50.199358+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301593+0000","last_change":"2024-09-10T17:52:39.650553+0000","last_active":"2024-09-10T17:53:50.301593+0000","last_peered":"2024-09-10T17:53:50.301593+0000","last_clean":"2024-09-10T17:53:50.301593+0000","last_became_active":"2024-09-10T17:52:39.650207+0000","last_became_peered":"2024-09-10T17:52:39.650207+0000","last_unstale":"2024-09-10T17:53:50.301593+0000","last_undegraded":"2024-09-10T17:53:50.301593+0000","last_fullsized":"2024-09-10T17:53:50.301593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198166+0000","last_change":"2024-09-10T17:52:39.641442+0000","last_active":"2024-09-10T17:53:50.198166+0000","last_peered":"2024-09-10T17:53:50.198166+0000","last_clean":"2024-09-10T17:53:50.198166+0000","last_became_active":"2024-09-10T17:52:39.641158+0000","last_became_peered":"2024-09-10T17:52:39.641158+0000","last_unstale":"2024-09-10T17:53:50.198166+0000","last_undegraded":"2024-09-10T17:53:50.198166+0000","last_fullsized":"2024-09-10T17:53:50.198166+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199152+0000","last_change":"2024-09-10T17:52:39.644997+0000","last_active":"2024-09-10T17:53:50.199152+0000","last_peered":"2024-09-10T17:53:50.199152+0000","last_clean":"2024-09-10T17:53:50.199152+0000","last_became_active":"2024-09-10T17:52:39.643999+0000","last_became_peered":"2024-09-10T17:52:39.643999+0000","last_unstale":"2024-09-10T17:53:50.199152+0000","last_undegraded":"2024-09-10T17:53:50.199152+0000","last_fullsized":"2024-09-10T17:53:50.199152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302401+0000","last_change":"2024-09-10T17:52:39.632927+0000","last_active":"2024-09-10T17:53:50.302401+0000","last_peered":"2024-09-10T17:53:50.302401+0000","last_clean":"2024-09-10T17:53:50.302401+0000","last_became_active":"2024-09-10T17:52:39.632680+0000","last_became_peered":"2024-09-10T17:52:39.632680+0000","last_unstale":"2024-09-10T17:53:50.302401+0000","last_undegraded":"2024-09-10T17:53:50.302401+0000","last_fullsized":"2024-09-10T17:53:50.302401+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203693+0000","last_change":"2024-09-10T17:52:39.648726+0000","last_active":"2024-09-10T17:53:50.203693+0000","last_peered":"2024-09-10T17:53:50.203693+0000","last_clean":"2024-09-10T17:53:50.203693+0000","last_became_active":"2024-09-10T17:52:39.648448+0000","last_became_peered":"2024-09-10T17:52:39.648448+0000","last_unstale":"2024-09-10T17:53:50.203693+0000","last_undegraded":"2024-09-10T17:53:50.203693+0000","last_fullsized":"2024-09-10T17:53:50.203693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.732333+0000","last_change":"2024-09-10T17:52:39.634918+0000","last_active":"2024-09-10T17:53:56.732333+0000","last_peered":"2024-09-10T17:53:56.732333+0000","last_clean":"2024-09-10T17:53:56.732333+0000","last_became_active":"2024-09-10T17:52:39.634622+0000","last_became_peered":"2024-09-10T17:52:39.634622+0000","last_unstale":"2024-09-10T17:53:56.732333+0000","last_undegraded":"2024-09-10T17:53:56.732333+0000","last_fullsized":"2024-09-10T17:53:56.732333+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.301939+0000","last_change":"2024-09-10T17:52:39.642111+0000","last_active":"2024-09-10T17:53:57.301939+0000","last_peered":"2024-09-10T17:53:57.301939+0000","last_clean":"2024-09-10T17:53:57.301939+0000","last_became_active":"2024-09-10T17:52:39.641786+0000","last_became_peered":"2024-09-10T17:52:39.641786+0000","last_unstale":"2024-09-10T17:53:57.301939+0000","last_undegraded":"2024-09-10T17:53:57.301939+0000","last_fullsized":"2024-09-10T17:53:57.301939+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.196756+0000","last_change":"2024-09-10T17:52:39.632064+0000","last_active":"2024-09-10T17:53:50.196756+0000","last_peered":"2024-09-10T17:53:50.196756+0000","last_clean":"2024-09-10T17:53:50.196756+0000","last_became_active":"2024-09-10T17:52:39.631529+0000","last_became_peered":"2024-09-10T17:52:39.631529+0000","last_unstale":"2024-09-10T17:53:50.196756+0000","last_undegraded":"2024-09-10T17:53:50.196756+0000","last_fullsized":"2024-09-10T17:53:50.196756+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199321+0000","last_change":"2024-09-10T17:52:36.192274+0000","last_active":"2024-09-10T17:53:50.199321+0000","last_peered":"2024-09-10T17:53:50.199321+0000","last_clean":"2024-09-10T17:53:50.199321+0000","last_became_active":"2024-09-10T17:52:36.191998+0000","last_became_peered":"2024-09-10T17:52:36.191998+0000","last_unstale":"2024-09-10T17:53:50.199321+0000","last_undegraded":"2024-09-10T17:53:50.199321+0000","last_fullsized":"2024-09-10T17:53:50.199321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301613+0000","last_change":"2024-09-10T17:53:04.205276+0000","last_active":"2024-09-10T17:53:50.301613+0000","last_peered":"2024-09-10T17:53:50.301613+0000","last_clean":"2024-09-10T17:53:50.301613+0000","last_became_active":"2024-09-10T17:53:04.204905+0000","last_became_peered":"2024-09-10T17:53:04.204905+0000","last_unstale":"2024-09-10T17:53:50.301613+0000","last_undegraded":"2024-09-10T17:53:50.301613+0000","last_fullsized":"2024-09-10T17:53:50.301613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301502+0000","last_change":"2024-09-10T17:52:36.190911+0000","last_active":"2024-09-10T17:53:50.301502+0000","last_peered":"2024-09-10T17:53:50.301502+0000","last_clean":"2024-09-10T17:53:50.301502+0000","last_became_active":"2024-09-10T17:52:36.190437+0000","last_became_peered":"2024-09-10T17:52:36.190437+0000","last_unstale":"2024-09-10T17:53:50.301502+0000","last_undegraded":"2024-09-10T17:53:50.301502+0000","last_fullsized":"2024-09-10T17:53:50.301502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199182+0000","last_change":"2024-09-10T17:52:36.192952+0000","last_active":"2024-09-10T17:53:50.199182+0000","last_peered":"2024-09-10T17:53:50.199182+0000","last_clean":"2024-09-10T17:53:50.199182+0000","last_became_active":"2024-09-10T17:52:36.192199+0000","last_became_peered":"2024-09-10T17:52:36.192199+0000","last_unstale":"2024-09-10T17:53:50.199182+0000","last_undegraded":"2024-09-10T17:53:50.199182+0000","last_fullsized":"2024-09-10T17:53:50.199182+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198872+0000","last_change":"2024-09-10T17:52:39.646604+0000","last_active":"2024-09-10T17:53:50.198872+0000","last_peered":"2024-09-10T17:53:50.198872+0000","last_clean":"2024-09-10T17:53:50.198872+0000","last_became_active":"2024-09-10T17:52:39.646321+0000","last_became_peered":"2024-09-10T17:52:39.646321+0000","last_unstale":"2024-09-10T17:53:50.198872+0000","last_undegraded":"2024-09-10T17:53:50.198872+0000","last_fullsized":"2024-09-10T17:53:50.198872+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203521+0000","last_change":"2024-09-10T17:52:36.194360+0000","last_active":"2024-09-10T17:53:50.203521+0000","last_peered":"2024-09-10T17:53:50.203521+0000","last_clean":"2024-09-10T17:53:50.203521+0000","last_became_active":"2024-09-10T17:52:36.194106+0000","last_became_peered":"2024-09-10T17:52:36.194106+0000","last_unstale":"2024-09-10T17:53:50.203521+0000","last_undegraded":"2024-09-10T17:53:50.203521+0000","last_fullsized":"2024-09-10T17:53:50.203521+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.197554+0000","last_change":"2024-09-10T17:52:39.637886+0000","last_active":"2024-09-10T17:53:50.197554+0000","last_peered":"2024-09-10T17:53:50.197554+0000","last_clean":"2024-09-10T17:53:50.197554+0000","last_became_active":"2024-09-10T17:52:39.637615+0000","last_became_peered":"2024-09-10T17:52:39.637615+0000","last_unstale":"2024-09-10T17:53:50.197554+0000","last_undegraded":"2024-09-10T17:53:50.197554+0000","last_fullsized":"2024-09-10T17:53:50.197554+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301376+0000","last_change":"2024-09-10T17:52:36.193200+0000","last_active":"2024-09-10T17:53:50.301376+0000","last_peered":"2024-09-10T17:53:50.301376+0000","last_clean":"2024-09-10T17:53:50.301376+0000","last_became_active":"2024-09-10T17:52:36.192223+0000","last_became_peered":"2024-09-10T17:52:36.192223+0000","last_unstale":"2024-09-10T17:53:50.301376+0000","last_undegraded":"2024-09-10T17:53:50.301376+0000","last_fullsized":"2024-09-10T17:53:50.301376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203873+0000","last_change":"2024-09-10T17:52:39.646338+0000","last_active":"2024-09-10T17:53:50.203873+0000","last_peered":"2024-09-10T17:53:50.203873+0000","last_clean":"2024-09-10T17:53:50.203873+0000","last_became_active":"2024-09-10T17:52:39.645661+0000","last_became_peered":"2024-09-10T17:52:39.645661+0000","last_unstale":"2024-09-10T17:53:50.203873+0000","last_undegraded":"2024-09-10T17:53:50.203873+0000","last_fullsized":"2024-09-10T17:53:50.203873+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203941+0000","last_change":"2024-09-10T17:52:36.192408+0000","last_active":"2024-09-10T17:53:50.203941+0000","last_peered":"2024-09-10T17:53:50.203941+0000","last_clean":"2024-09-10T17:53:50.203941+0000","last_became_active":"2024-09-10T17:52:36.192132+0000","last_became_peered":"2024-09-10T17:52:36.192132+0000","last_unstale":"2024-09-10T17:53:50.203941+0000","last_undegraded":"2024-09-10T17:53:50.203941+0000","last_fullsized":"2024-09-10T17:53:50.203941+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.303056+0000","last_change":"2024-09-10T17:52:39.641531+0000","last_active":"2024-09-10T17:53:50.303056+0000","last_peered":"2024-09-10T17:53:50.303056+0000","last_clean":"2024-09-10T17:53:50.303056+0000","last_became_active":"2024-09-10T17:52:39.639958+0000","last_became_peered":"2024-09-10T17:52:39.639958+0000","last_unstale":"2024-09-10T17:53:50.303056+0000","last_undegraded":"2024-09-10T17:53:50.303056+0000","last_fullsized":"2024-09-10T17:53:50.303056+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"65'3","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198316+0000","last_change":"2024-09-10T17:52:36.188432+0000","last_active":"2024-09-10T17:53:50.198316+0000","last_peered":"2024-09-10T17:53:50.198316+0000","last_clean":"2024-09-10T17:53:50.198316+0000","last_became_active":"2024-09-10T17:52:36.188019+0000","last_became_peered":"2024-09-10T17:52:36.188019+0000","last_unstale":"2024-09-10T17:53:50.198316+0000","last_undegraded":"2024-09-10T17:53:50.198316+0000","last_fullsized":"2024-09-10T17:53:50.198316+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.197039+0000","last_change":"2024-09-10T17:52:39.642140+0000","last_active":"2024-09-10T17:53:50.197039+0000","last_peered":"2024-09-10T17:53:50.197039+0000","last_clean":"2024-09-10T17:53:50.197039+0000","last_became_active":"2024-09-10T17:52:39.641201+0000","last_became_peered":"2024-09-10T17:52:39.641201+0000","last_unstale":"2024-09-10T17:53:50.197039+0000","last_undegraded":"2024-09-10T17:53:50.197039+0000","last_fullsized":"2024-09-10T17:53:50.197039+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"68'9","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302433+0000","last_change":"2024-09-10T17:52:36.190637+0000","last_active":"2024-09-10T17:53:50.302433+0000","last_peered":"2024-09-10T17:53:50.302433+0000","last_clean":"2024-09-10T17:53:50.302433+0000","last_became_active":"2024-09-10T17:52:36.190315+0000","last_became_peered":"2024-09-10T17:52:36.190315+0000","last_unstale":"2024-09-10T17:53:50.302433+0000","last_undegraded":"2024-09-10T17:53:50.302433+0000","last_fullsized":"2024-09-10T17:53:50.302433+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2348,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301820+0000","last_change":"2024-09-10T17:52:39.647058+0000","last_active":"2024-09-10T17:53:50.301820+0000","last_peered":"2024-09-10T17:53:50.301820+0000","last_clean":"2024-09-10T17:53:50.301820+0000","last_became_active":"2024-09-10T17:52:39.646127+0000","last_became_peered":"2024-09-10T17:52:39.646127+0000","last_unstale":"2024-09-10T17:53:50.301820+0000","last_undegraded":"2024-09-10T17:53:50.301820+0000","last_fullsized":"2024-09-10T17:53:50.301820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302389+0000","last_change":"2024-09-10T17:52:36.197133+0000","last_active":"2024-09-10T17:53:50.302389+0000","last_peered":"2024-09-10T17:53:50.302389+0000","last_clean":"2024-09-10T17:53:50.302389+0000","last_became_active":"2024-09-10T17:52:36.196798+0000","last_became_peered":"2024-09-10T17:52:36.196798+0000","last_unstale":"2024-09-10T17:53:50.302389+0000","last_undegraded":"2024-09-10T17:53:50.302389+0000","last_fullsized":"2024-09-10T17:53:50.302389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301713+0000","last_change":"2024-09-10T17:52:39.632963+0000","last_active":"2024-09-10T17:53:50.301713+0000","last_peered":"2024-09-10T17:53:50.301713+0000","last_clean":"2024-09-10T17:53:50.301713+0000","last_became_active":"2024-09-10T17:52:39.632648+0000","last_became_peered":"2024-09-10T17:52:39.632648+0000","last_unstale":"2024-09-10T17:53:50.301713+0000","last_undegraded":"2024-09-10T17:53:50.301713+0000","last_fullsized":"2024-09-10T17:53:50.301713+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203725+0000","last_change":"2024-09-10T17:52:36.190919+0000","last_active":"2024-09-10T17:53:50.203725+0000","last_peered":"2024-09-10T17:53:50.203725+0000","last_clean":"2024-09-10T17:53:50.203725+0000","last_became_active":"2024-09-10T17:52:36.190637+0000","last_became_peered":"2024-09-10T17:52:36.190637+0000","last_unstale":"2024-09-10T17:53:50.203725+0000","last_undegraded":"2024-09-10T17:53:50.203725+0000","last_fullsized":"2024-09-10T17:53:50.203725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301901+0000","last_change":"2024-09-10T17:52:39.637441+0000","last_active":"2024-09-10T17:53:50.301901+0000","last_peered":"2024-09-10T17:53:50.301901+0000","last_clean":"2024-09-10T17:53:50.301901+0000","last_became_active":"2024-09-10T17:52:39.636759+0000","last_became_peered":"2024-09-10T17:52:39.636759+0000","last_unstale":"2024-09-10T17:53:50.301901+0000","last_undegraded":"2024-09-10T17:53:50.301901+0000","last_fullsized":"2024-09-10T17:53:50.301901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301408+0000","last_change":"2024-09-10T17:52:36.192102+0000","last_active":"2024-09-10T17:53:50.301408+0000","last_peered":"2024-09-10T17:53:50.301408+0000","last_clean":"2024-09-10T17:53:50.301408+0000","last_became_active":"2024-09-10T17:52:36.191743+0000","last_became_peered":"2024-09-10T17:52:36.191743+0000","last_unstale":"2024-09-10T17:53:50.301408+0000","last_undegraded":"2024-09-10T17:53:50.301408+0000","last_fullsized":"2024-09-10T17:53:50.301408+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301629+0000","last_change":"2024-09-10T17:52:39.640124+0000","last_active":"2024-09-10T17:53:50.301629+0000","last_peered":"2024-09-10T17:53:50.301629+0000","last_clean":"2024-09-10T17:53:50.301629+0000","last_became_active":"2024-09-10T17:52:39.639840+0000","last_became_peered":"2024-09-10T17:52:39.639840+0000","last_unstale":"2024-09-10T17:53:50.301629+0000","last_undegraded":"2024-09-10T17:53:50.301629+0000","last_fullsized":"2024-09-10T17:53:50.301629+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"65'8","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301854+0000","last_change":"2024-09-10T17:52:36.191246+0000","last_active":"2024-09-10T17:53:50.301854+0000","last_peered":"2024-09-10T17:53:50.301854+0000","last_clean":"2024-09-10T17:53:50.301854+0000","last_became_active":"2024-09-10T17:52:36.190916+0000","last_became_peered":"2024-09-10T17:52:36.190916+0000","last_unstale":"2024-09-10T17:53:50.301854+0000","last_undegraded":"2024-09-10T17:53:50.301854+0000","last_fullsized":"2024-09-10T17:53:50.301854+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301967+0000","last_change":"2024-09-10T17:52:39.647318+0000","last_active":"2024-09-10T17:53:50.301967+0000","last_peered":"2024-09-10T17:53:50.301967+0000","last_clean":"2024-09-10T17:53:50.301967+0000","last_became_active":"2024-09-10T17:52:39.647020+0000","last_became_peered":"2024-09-10T17:52:39.647020+0000","last_unstale":"2024-09-10T17:53:50.301967+0000","last_undegraded":"2024-09-10T17:53:50.301967+0000","last_fullsized":"2024-09-10T17:53:50.301967+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.197455+0000","last_change":"2024-09-10T17:52:36.194263+0000","last_active":"2024-09-10T17:53:50.197455+0000","last_peered":"2024-09-10T17:53:50.197455+0000","last_clean":"2024-09-10T17:53:50.197455+0000","last_became_active":"2024-09-10T17:52:36.193894+0000","last_became_peered":"2024-09-10T17:52:36.193894+0000","last_unstale":"2024-09-10T17:53:50.197455+0000","last_undegraded":"2024-09-10T17:53:50.197455+0000","last_fullsized":"2024-09-10T17:53:50.197455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301941+0000","last_change":"2024-09-10T17:53:04.205325+0000","last_active":"2024-09-10T17:53:50.301941+0000","last_peered":"2024-09-10T17:53:50.301941+0000","last_clean":"2024-09-10T17:53:50.301941+0000","last_became_active":"2024-09-10T17:53:04.204953+0000","last_became_peered":"2024-09-10T17:53:04.204953+0000","last_unstale":"2024-09-10T17:53:50.301941+0000","last_undegraded":"2024-09-10T17:53:50.301941+0000","last_fullsized":"2024-09-10T17:53:50.301941+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302171+0000","last_change":"2024-09-10T17:52:36.191958+0000","last_active":"2024-09-10T17:53:50.302171+0000","last_peered":"2024-09-10T17:53:50.302171+0000","last_clean":"2024-09-10T17:53:50.302171+0000","last_became_active":"2024-09-10T17:52:36.191684+0000","last_became_peered":"2024-09-10T17:52:36.191684+0000","last_unstale":"2024-09-10T17:53:50.302171+0000","last_undegraded":"2024-09-10T17:53:50.302171+0000","last_fullsized":"2024-09-10T17:53:50.302171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301799+0000","last_change":"2024-09-10T17:52:39.648857+0000","last_active":"2024-09-10T17:53:50.301799+0000","last_peered":"2024-09-10T17:53:50.301799+0000","last_clean":"2024-09-10T17:53:50.301799+0000","last_became_active":"2024-09-10T17:52:39.648574+0000","last_became_peered":"2024-09-10T17:52:39.648574+0000","last_unstale":"2024-09-10T17:53:50.301799+0000","last_undegraded":"2024-09-10T17:53:50.301799+0000","last_fullsized":"2024-09-10T17:53:50.301799+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198402+0000","last_change":"2024-09-10T17:52:36.185952+0000","last_active":"2024-09-10T17:53:50.198402+0000","last_peered":"2024-09-10T17:53:50.198402+0000","last_clean":"2024-09-10T17:53:50.198402+0000","last_became_active":"2024-09-10T17:52:36.184643+0000","last_became_peered":"2024-09-10T17:52:36.184643+0000","last_unstale":"2024-09-10T17:53:50.198402+0000","last_undegraded":"2024-09-10T17:53:50.198402+0000","last_fullsized":"2024-09-10T17:53:50.198402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203495+0000","last_change":"2024-09-10T17:52:39.651773+0000","last_active":"2024-09-10T17:53:50.203495+0000","last_peered":"2024-09-10T17:53:50.203495+0000","last_clean":"2024-09-10T17:53:50.203495+0000","last_became_active":"2024-09-10T17:52:39.650072+0000","last_became_peered":"2024-09-10T17:52:39.650072+0000","last_unstale":"2024-09-10T17:53:50.203495+0000","last_undegraded":"2024-09-10T17:53:50.203495+0000","last_fullsized":"2024-09-10T17:53:50.203495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301427+0000","last_change":"2024-09-10T17:52:36.191363+0000","last_active":"2024-09-10T17:53:50.301427+0000","last_peered":"2024-09-10T17:53:50.301427+0000","last_clean":"2024-09-10T17:53:50.301427+0000","last_became_active":"2024-09-10T17:52:36.190976+0000","last_became_peered":"2024-09-10T17:52:36.190976+0000","last_unstale":"2024-09-10T17:53:50.301427+0000","last_undegraded":"2024-09-10T17:53:50.301427+0000","last_fullsized":"2024-09-10T17:53:50.301427+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302158+0000","last_change":"2024-09-10T17:52:39.643612+0000","last_active":"2024-09-10T17:53:50.302158+0000","last_peered":"2024-09-10T17:53:50.302158+0000","last_clean":"2024-09-10T17:53:50.302158+0000","last_became_active":"2024-09-10T17:52:39.643274+0000","last_became_peered":"2024-09-10T17:52:39.643274+0000","last_unstale":"2024-09-10T17:53:50.302158+0000","last_undegraded":"2024-09-10T17:53:50.302158+0000","last_fullsized":"2024-09-10T17:53:50.302158+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.302347+0000","last_change":"2024-09-10T17:53:50.302350+0000","last_active":"2024-09-10T17:53:57.302347+0000","last_peered":"2024-09-10T17:53:57.302347+0000","last_clean":"2024-09-10T17:53:57.302347+0000","last_became_active":"2024-09-10T17:53:45.957358+0000","last_became_peered":"2024-09-10T17:53:45.957358+0000","last_unstale":"2024-09-10T17:53:57.302347+0000","last_undegraded":"2024-09-10T17:53:57.302347+0000","last_fullsized":"2024-09-10T17:53:57.302347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:01.978582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010232780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"68'128","reported_seq":273,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.155562+0000","last_change":"2024-09-10T17:52:12.719807+0000","last_active":"2024-09-10T17:53:57.155562+0000","last_peered":"2024-09-10T17:53:57.155562+0000","last_clean":"2024-09-10T17:53:57.155562+0000","last_became_active":"2024-09-10T17:52:12.719452+0000","last_became_peered":"2024-09-10T17:52:12.719452+0000","last_unstale":"2024-09-10T17:53:57.155562+0000","last_undegraded":"2024-09-10T17:53:57.155562+0000","last_fullsized":"2024-09-10T17:53:57.155562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_clean_scrub_stamp":"2024-09-10T17:50:14.084625+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.867705+0000","last_change":"2024-09-10T17:52:36.195598+0000","last_active":"2024-09-10T17:53:56.867705+0000","last_peered":"2024-09-10T17:53:56.867705+0000","last_clean":"2024-09-10T17:53:56.867705+0000","last_became_active":"2024-09-10T17:52:36.195203+0000","last_became_peered":"2024-09-10T17:52:36.195203+0000","last_unstale":"2024-09-10T17:53:56.867705+0000","last_undegraded":"2024-09-10T17:53:56.867705+0000","last_fullsized":"2024-09-10T17:53:56.867705+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199562+0000","last_change":"2024-09-10T17:52:39.644934+0000","last_active":"2024-09-10T17:53:50.199562+0000","last_peered":"2024-09-10T17:53:50.199562+0000","last_clean":"2024-09-10T17:53:50.199562+0000","last_became_active":"2024-09-10T17:52:39.644205+0000","last_became_peered":"2024-09-10T17:52:39.644205+0000","last_unstale":"2024-09-10T17:53:50.199562+0000","last_undegraded":"2024-09-10T17:53:50.199562+0000","last_fullsized":"2024-09-10T17:53:50.199562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.730292+0000","last_change":"2024-09-10T17:53:50.303137+0000","last_active":"2024-09-10T17:53:56.730292+0000","last_peered":"2024-09-10T17:53:56.730292+0000","last_clean":"2024-09-10T17:53:56.730292+0000","last_became_active":"2024-09-10T17:53:45.961914+0000","last_became_peered":"2024-09-10T17:53:45.961914+0000","last_unstale":"2024-09-10T17:53:56.730292+0000","last_undegraded":"2024-09-10T17:53:56.730292+0000","last_fullsized":"2024-09-10T17:53:56.730292+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:53.216058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027560099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301621+0000","last_change":"2024-09-10T17:53:04.527840+0000","last_active":"2024-09-10T17:53:50.301621+0000","last_peered":"2024-09-10T17:53:50.301621+0000","last_clean":"2024-09-10T17:53:50.301621+0000","last_became_active":"2024-09-10T17:53:04.527470+0000","last_became_peered":"2024-09-10T17:53:04.527470+0000","last_unstale":"2024-09-10T17:53:50.301621+0000","last_undegraded":"2024-09-10T17:53:50.301621+0000","last_fullsized":"2024-09-10T17:53:50.301621+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.728362+0000","last_change":"2024-09-10T17:52:39.632868+0000","last_active":"2024-09-10T17:53:56.728362+0000","last_peered":"2024-09-10T17:53:56.728362+0000","last_clean":"2024-09-10T17:53:56.728362+0000","last_became_active":"2024-09-10T17:52:39.632549+0000","last_became_peered":"2024-09-10T17:52:39.632549+0000","last_unstale":"2024-09-10T17:53:56.728362+0000","last_undegraded":"2024-09-10T17:53:56.728362+0000","last_fullsized":"2024-09-10T17:53:56.728362+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.233006+0000","last_change":"2024-09-10T17:53:50.198782+0000","last_active":"2024-09-10T17:53:57.233006+0000","last_peered":"2024-09-10T17:53:57.233006+0000","last_clean":"2024-09-10T17:53:57.233006+0000","last_became_active":"2024-09-10T17:53:46.005227+0000","last_became_peered":"2024-09-10T17:53:46.005227+0000","last_unstale":"2024-09-10T17:53:57.233006+0000","last_undegraded":"2024-09-10T17:53:57.233006+0000","last_fullsized":"2024-09-10T17:53:57.233006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:51.873480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073360500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.732389+0000","last_change":"2024-09-10T17:52:36.190567+0000","last_active":"2024-09-10T17:53:56.732389+0000","last_peered":"2024-09-10T17:53:56.732389+0000","last_clean":"2024-09-10T17:53:56.732389+0000","last_became_active":"2024-09-10T17:52:36.190261+0000","last_became_peered":"2024-09-10T17:52:36.190261+0000","last_unstale":"2024-09-10T17:53:56.732389+0000","last_undegraded":"2024-09-10T17:53:56.732389+0000","last_fullsized":"2024-09-10T17:53:56.732389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.231691+0000","last_change":"2024-09-10T17:52:39.638839+0000","last_active":"2024-09-10T17:53:57.231691+0000","last_peered":"2024-09-10T17:53:57.231691+0000","last_clean":"2024-09-10T17:53:57.231691+0000","last_became_active":"2024-09-10T17:52:39.638567+0000","last_became_peered":"2024-09-10T17:52:39.638567+0000","last_unstale":"2024-09-10T17:53:57.231691+0000","last_undegraded":"2024-09-10T17:53:57.231691+0000","last_fullsized":"2024-09-10T17:53:57.231691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.233366+0000","last_change":"2024-09-10T17:53:50.198381+0000","last_active":"2024-09-10T17:53:57.233366+0000","last_peered":"2024-09-10T17:53:57.233366+0000","last_clean":"2024-09-10T17:53:57.233366+0000","last_became_active":"2024-09-10T17:53:45.961040+0000","last_became_peered":"2024-09-10T17:53:45.961040+0000","last_unstale":"2024-09-10T17:53:57.233366+0000","last_undegraded":"2024-09-10T17:53:57.233366+0000","last_fullsized":"2024-09-10T17:53:57.233366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:34.194479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046083499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.867739+0000","last_change":"2024-09-10T17:52:36.193278+0000","last_active":"2024-09-10T17:53:56.867739+0000","last_peered":"2024-09-10T17:53:56.867739+0000","last_clean":"2024-09-10T17:53:56.867739+0000","last_became_active":"2024-09-10T17:52:36.192979+0000","last_became_peered":"2024-09-10T17:52:36.192979+0000","last_unstale":"2024-09-10T17:53:56.867739+0000","last_undegraded":"2024-09-10T17:53:56.867739+0000","last_fullsized":"2024-09-10T17:53:56.867739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.197069+0000","last_change":"2024-09-10T17:52:39.640516+0000","last_active":"2024-09-10T17:53:50.197069+0000","last_peered":"2024-09-10T17:53:50.197069+0000","last_clean":"2024-09-10T17:53:50.197069+0000","last_became_active":"2024-09-10T17:52:39.639996+0000","last_became_peered":"2024-09-10T17:52:39.639996+0000","last_unstale":"2024-09-10T17:53:50.197069+0000","last_undegraded":"2024-09-10T17:53:50.197069+0000","last_fullsized":"2024-09-10T17:53:50.197069+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"74'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.232091+0000","last_change":"2024-09-10T17:53:50.198385+0000","last_active":"2024-09-10T17:53:57.232091+0000","last_peered":"2024-09-10T17:53:57.232091+0000","last_clean":"2024-09-10T17:53:57.232091+0000","last_became_active":"2024-09-10T17:53:46.005011+0000","last_became_peered":"2024-09-10T17:53:46.005011+0000","last_unstale":"2024-09-10T17:53:57.232091+0000","last_undegraded":"2024-09-10T17:53:57.232091+0000","last_fullsized":"2024-09-10T17:53:57.232091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:31.979953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062133499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.233709+0000","last_change":"2024-09-10T17:52:36.193781+0000","last_active":"2024-09-10T17:53:57.233709+0000","last_peered":"2024-09-10T17:53:57.233709+0000","last_clean":"2024-09-10T17:53:57.233709+0000","last_became_active":"2024-09-10T17:52:36.193487+0000","last_became_peered":"2024-09-10T17:52:36.193487+0000","last_unstale":"2024-09-10T17:53:57.233709+0000","last_undegraded":"2024-09-10T17:53:57.233709+0000","last_fullsized":"2024-09-10T17:53:57.233709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203783+0000","last_change":"2024-09-10T17:52:39.647909+0000","last_active":"2024-09-10T17:53:50.203783+0000","last_peered":"2024-09-10T17:53:50.203783+0000","last_clean":"2024-09-10T17:53:50.203783+0000","last_became_active":"2024-09-10T17:52:39.647630+0000","last_became_peered":"2024-09-10T17:52:39.647630+0000","last_unstale":"2024-09-10T17:53:50.203783+0000","last_undegraded":"2024-09-10T17:53:50.203783+0000","last_fullsized":"2024-09-10T17:53:50.203783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"72'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.728772+0000","last_change":"2024-09-10T17:53:50.302596+0000","last_active":"2024-09-10T17:53:56.728772+0000","last_peered":"2024-09-10T17:53:56.728772+0000","last_clean":"2024-09-10T17:53:56.728772+0000","last_became_active":"2024-09-10T17:53:46.005071+0000","last_became_peered":"2024-09-10T17:53:46.005071+0000","last_unstale":"2024-09-10T17:53:56.728772+0000","last_undegraded":"2024-09-10T17:53:56.728772+0000","last_fullsized":"2024-09-10T17:53:56.728772+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:21.200358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000456615,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302374+0000","last_change":"2024-09-10T17:52:36.200712+0000","last_active":"2024-09-10T17:53:50.302374+0000","last_peered":"2024-09-10T17:53:50.302374+0000","last_clean":"2024-09-10T17:53:50.302374+0000","last_became_active":"2024-09-10T17:52:36.200402+0000","last_became_peered":"2024-09-10T17:52:36.200402+0000","last_unstale":"2024-09-10T17:53:50.302374+0000","last_undegraded":"2024-09-10T17:53:50.302374+0000","last_fullsized":"2024-09-10T17:53:50.302374+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198085+0000","last_change":"2024-09-10T17:52:39.643072+0000","last_active":"2024-09-10T17:53:50.198085+0000","last_peered":"2024-09-10T17:53:50.198085+0000","last_clean":"2024-09-10T17:53:50.198085+0000","last_became_active":"2024-09-10T17:52:39.642792+0000","last_became_peered":"2024-09-10T17:52:39.642792+0000","last_unstale":"2024-09-10T17:53:50.198085+0000","last_undegraded":"2024-09-10T17:53:50.198085+0000","last_fullsized":"2024-09-10T17:53:50.198085+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.728960+0000","last_change":"2024-09-10T17:53:50.199886+0000","last_active":"2024-09-10T17:53:56.728960+0000","last_peered":"2024-09-10T17:53:56.728960+0000","last_clean":"2024-09-10T17:53:56.728960+0000","last_became_active":"2024-09-10T17:53:45.959700+0000","last_became_peered":"2024-09-10T17:53:45.959700+0000","last_unstale":"2024-09-10T17:53:56.728960+0000","last_undegraded":"2024-09-10T17:53:56.728960+0000","last_fullsized":"2024-09-10T17:53:56.728960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.618711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001168997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199322+0000","last_change":"2024-09-10T17:52:36.192033+0000","last_active":"2024-09-10T17:53:50.199322+0000","last_peered":"2024-09-10T17:53:50.199322+0000","last_clean":"2024-09-10T17:53:50.199322+0000","last_became_active":"2024-09-10T17:52:36.191662+0000","last_became_peered":"2024-09-10T17:52:36.191662+0000","last_unstale":"2024-09-10T17:53:50.199322+0000","last_undegraded":"2024-09-10T17:53:50.199322+0000","last_fullsized":"2024-09-10T17:53:50.199322+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199438+0000","last_change":"2024-09-10T17:52:39.635594+0000","last_active":"2024-09-10T17:53:50.199438+0000","last_peered":"2024-09-10T17:53:50.199438+0000","last_clean":"2024-09-10T17:53:50.199438+0000","last_became_active":"2024-09-10T17:52:39.635320+0000","last_became_peered":"2024-09-10T17:52:39.635320+0000","last_unstale":"2024-09-10T17:53:50.199438+0000","last_undegraded":"2024-09-10T17:53:50.199438+0000","last_fullsized":"2024-09-10T17:53:50.199438+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.728595+0000","last_change":"2024-09-10T17:53:50.197168+0000","last_active":"2024-09-10T17:53:56.728595+0000","last_peered":"2024-09-10T17:53:56.728595+0000","last_clean":"2024-09-10T17:53:56.728595+0000","last_became_active":"2024-09-10T17:53:46.005109+0000","last_became_peered":"2024-09-10T17:53:46.005109+0000","last_unstale":"2024-09-10T17:53:56.728595+0000","last_undegraded":"2024-09-10T17:53:56.728595+0000","last_fullsized":"2024-09-10T17:53:56.728595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:08.888245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061699300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"65'2","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.302613+0000","last_change":"2024-09-10T17:52:36.194453+0000","last_active":"2024-09-10T17:53:57.302613+0000","last_peered":"2024-09-10T17:53:57.302613+0000","last_clean":"2024-09-10T17:53:57.302613+0000","last_became_active":"2024-09-10T17:52:36.194107+0000","last_became_peered":"2024-09-10T17:52:36.194107+0000","last_unstale":"2024-09-10T17:53:57.302613+0000","last_undegraded":"2024-09-10T17:53:57.302613+0000","last_fullsized":"2024-09-10T17:53:57.302613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302797+0000","last_change":"2024-09-10T17:52:39.631701+0000","last_active":"2024-09-10T17:53:50.302797+0000","last_peered":"2024-09-10T17:53:50.302797+0000","last_clean":"2024-09-10T17:53:50.302797+0000","last_became_active":"2024-09-10T17:52:39.631299+0000","last_became_peered":"2024-09-10T17:52:39.631299+0000","last_unstale":"2024-09-10T17:53:50.302797+0000","last_undegraded":"2024-09-10T17:53:50.302797+0000","last_fullsized":"2024-09-10T17:53:50.302797+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302790+0000","last_change":"2024-09-10T17:52:36.200196+0000","last_active":"2024-09-10T17:53:50.302790+0000","last_peered":"2024-09-10T17:53:50.302790+0000","last_clean":"2024-09-10T17:53:50.302790+0000","last_became_active":"2024-09-10T17:52:36.199847+0000","last_became_peered":"2024-09-10T17:52:36.199847+0000","last_unstale":"2024-09-10T17:53:50.302790+0000","last_undegraded":"2024-09-10T17:53:50.302790+0000","last_fullsized":"2024-09-10T17:53:50.302790+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.196862+0000","last_change":"2024-09-10T17:52:39.643274+0000","last_active":"2024-09-10T17:53:50.196862+0000","last_peered":"2024-09-10T17:53:50.196862+0000","last_clean":"2024-09-10T17:53:50.196862+0000","last_became_active":"2024-09-10T17:52:39.643016+0000","last_became_peered":"2024-09-10T17:52:39.643016+0000","last_unstale":"2024-09-10T17:53:50.196862+0000","last_undegraded":"2024-09-10T17:53:50.196862+0000","last_fullsized":"2024-09-10T17:53:50.196862+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198562+0000","last_change":"2024-09-10T17:52:36.195088+0000","last_active":"2024-09-10T17:53:50.198562+0000","last_peered":"2024-09-10T17:53:50.198562+0000","last_clean":"2024-09-10T17:53:50.198562+0000","last_became_active":"2024-09-10T17:52:36.194698+0000","last_became_peered":"2024-09-10T17:52:36.194698+0000","last_unstale":"2024-09-10T17:53:50.198562+0000","last_undegraded":"2024-09-10T17:53:50.198562+0000","last_fullsized":"2024-09-10T17:53:50.198562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198865+0000","last_change":"2024-09-10T17:52:39.643179+0000","last_active":"2024-09-10T17:53:50.198865+0000","last_peered":"2024-09-10T17:53:50.198865+0000","last_clean":"2024-09-10T17:53:50.198865+0000","last_became_active":"2024-09-10T17:52:39.642643+0000","last_became_peered":"2024-09-10T17:52:39.642643+0000","last_unstale":"2024-09-10T17:53:50.198865+0000","last_undegraded":"2024-09-10T17:53:50.198865+0000","last_fullsized":"2024-09-10T17:53:50.198865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198181+0000","last_change":"2024-09-10T17:52:36.188755+0000","last_active":"2024-09-10T17:53:50.198181+0000","last_peered":"2024-09-10T17:53:50.198181+0000","last_clean":"2024-09-10T17:53:50.198181+0000","last_became_active":"2024-09-10T17:52:36.188465+0000","last_became_peered":"2024-09-10T17:52:36.188465+0000","last_unstale":"2024-09-10T17:53:50.198181+0000","last_undegraded":"2024-09-10T17:53:50.198181+0000","last_fullsized":"2024-09-10T17:53:50.198181+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199262+0000","last_change":"2024-09-10T17:52:39.635509+0000","last_active":"2024-09-10T17:53:50.199262+0000","last_peered":"2024-09-10T17:53:50.199262+0000","last_clean":"2024-09-10T17:53:50.199262+0000","last_became_active":"2024-09-10T17:52:39.635118+0000","last_became_peered":"2024-09-10T17:52:39.635118+0000","last_unstale":"2024-09-10T17:53:50.199262+0000","last_undegraded":"2024-09-10T17:53:50.199262+0000","last_fullsized":"2024-09-10T17:53:50.199262+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302248+0000","last_change":"2024-09-10T17:52:36.200921+0000","last_active":"2024-09-10T17:53:50.302248+0000","last_peered":"2024-09-10T17:53:50.302248+0000","last_clean":"2024-09-10T17:53:50.302248+0000","last_became_active":"2024-09-10T17:52:36.200153+0000","last_became_peered":"2024-09-10T17:52:36.200153+0000","last_unstale":"2024-09-10T17:53:50.302248+0000","last_undegraded":"2024-09-10T17:53:50.302248+0000","last_fullsized":"2024-09-10T17:53:50.302248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301251+0000","last_change":"2024-09-10T17:52:39.643628+0000","last_active":"2024-09-10T17:53:50.301251+0000","last_peered":"2024-09-10T17:53:50.301251+0000","last_clean":"2024-09-10T17:53:50.301251+0000","last_became_active":"2024-09-10T17:52:39.643355+0000","last_became_peered":"2024-09-10T17:52:39.643355+0000","last_unstale":"2024-09-10T17:53:50.301251+0000","last_undegraded":"2024-09-10T17:53:50.301251+0000","last_fullsized":"2024-09-10T17:53:50.301251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203760+0000","last_change":"2024-09-10T17:52:39.652448+0000","last_active":"2024-09-10T17:53:50.203760+0000","last_peered":"2024-09-10T17:53:50.203760+0000","last_clean":"2024-09-10T17:53:50.203760+0000","last_became_active":"2024-09-10T17:52:39.652164+0000","last_became_peered":"2024-09-10T17:52:39.652164+0000","last_unstale":"2024-09-10T17:53:50.203760+0000","last_undegraded":"2024-09-10T17:53:50.203760+0000","last_fullsized":"2024-09-10T17:53:50.203760+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302454+0000","last_change":"2024-09-10T17:52:36.200230+0000","last_active":"2024-09-10T17:53:50.302454+0000","last_peered":"2024-09-10T17:53:50.302454+0000","last_clean":"2024-09-10T17:53:50.302454+0000","last_became_active":"2024-09-10T17:52:36.199765+0000","last_became_peered":"2024-09-10T17:52:36.199765+0000","last_unstale":"2024-09-10T17:53:50.302454+0000","last_undegraded":"2024-09-10T17:53:50.302454+0000","last_fullsized":"2024-09-10T17:53:50.302454+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203580+0000","last_change":"2024-09-10T17:52:39.652608+0000","last_active":"2024-09-10T17:53:50.203580+0000","last_peered":"2024-09-10T17:53:50.203580+0000","last_clean":"2024-09-10T17:53:50.203580+0000","last_became_active":"2024-09-10T17:52:39.652354+0000","last_became_peered":"2024-09-10T17:52:39.652354+0000","last_unstale":"2024-09-10T17:53:50.203580+0000","last_undegraded":"2024-09-10T17:53:50.203580+0000","last_fullsized":"2024-09-10T17:53:50.203580+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302171+0000","last_change":"2024-09-10T17:52:36.200731+0000","last_active":"2024-09-10T17:53:50.302171+0000","last_peered":"2024-09-10T17:53:50.302171+0000","last_clean":"2024-09-10T17:53:50.302171+0000","last_became_active":"2024-09-10T17:52:36.200429+0000","last_became_peered":"2024-09-10T17:52:36.200429+0000","last_unstale":"2024-09-10T17:53:50.302171+0000","last_undegraded":"2024-09-10T17:53:50.302171+0000","last_fullsized":"2024-09-10T17:53:50.302171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.730167+0000","last_change":"2024-09-10T17:52:39.640232+0000","last_active":"2024-09-10T17:53:56.730167+0000","last_peered":"2024-09-10T17:53:56.730167+0000","last_clean":"2024-09-10T17:53:56.730167+0000","last_became_active":"2024-09-10T17:52:39.639462+0000","last_became_peered":"2024-09-10T17:52:39.639462+0000","last_unstale":"2024-09-10T17:53:56.730167+0000","last_undegraded":"2024-09-10T17:53:56.730167+0000","last_fullsized":"2024-09-10T17:53:56.730167+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"65'1","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729836+0000","last_change":"2024-09-10T17:52:36.190257+0000","last_active":"2024-09-10T17:53:56.729836+0000","last_peered":"2024-09-10T17:53:56.729836+0000","last_clean":"2024-09-10T17:53:56.729836+0000","last_became_active":"2024-09-10T17:52:36.189957+0000","last_became_peered":"2024-09-10T17:52:36.189957+0000","last_unstale":"2024-09-10T17:53:56.729836+0000","last_undegraded":"2024-09-10T17:53:56.729836+0000","last_fullsized":"2024-09-10T17:53:56.729836+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729692+0000","last_change":"2024-09-10T17:52:39.636289+0000","last_active":"2024-09-10T17:53:56.729692+0000","last_peered":"2024-09-10T17:53:56.729692+0000","last_clean":"2024-09-10T17:53:56.729692+0000","last_became_active":"2024-09-10T17:52:39.635894+0000","last_became_peered":"2024-09-10T17:52:39.635894+0000","last_unstale":"2024-09-10T17:53:56.729692+0000","last_undegraded":"2024-09-10T17:53:56.729692+0000","last_fullsized":"2024-09-10T17:53:56.729692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"65'4","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.730385+0000","last_change":"2024-09-10T17:52:36.194542+0000","last_active":"2024-09-10T17:53:56.730385+0000","last_peered":"2024-09-10T17:53:56.730385+0000","last_clean":"2024-09-10T17:53:56.730385+0000","last_became_active":"2024-09-10T17:52:36.194232+0000","last_became_peered":"2024-09-10T17:52:36.194232+0000","last_unstale":"2024-09-10T17:53:56.730385+0000","last_undegraded":"2024-09-10T17:53:56.730385+0000","last_fullsized":"2024-09-10T17:53:56.730385+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3146,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234016,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28368,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716784,"statfs":{"total":95995035648,"available":95965986816,"internally_reserved":0,"allocated":1380352,"data_stored":939890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.627}]},{"osd":2,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.505},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74199999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.68400000000000005}]},{"osd":3,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57799999999999996}]},{"osd":4,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.436,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.433,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38200000000000001}]},{"osd":5,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.746},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65800000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.43099999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712688,"statfs":{"total":95995035648,"available":95961792512,"internally_reserved":0,"allocated":1380352,"data_stored":941361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.503,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61799999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.627},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.67400000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54200000000000004}]},{"osd":1,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65400000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66000000000000003}]},{"osd":2,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51500000000000001,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63600000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65600000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.39000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68799999999999994,"5min":0.877,"15min":0.877},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.42299999999999999},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.39100000000000001}]},{"osd":5,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60499999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.443}]},{"osd":7,"last update":"Tue Sep 10 17:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.54600000000000004,"15min":0.56200000000000006},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68799999999999994,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.52700000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757291,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31884,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713268,"statfs":{"total":95995035648,"available":95962386432,"internally_reserved":0,"allocated":790528,"data_stored":350821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53200000000000003}]},{"osd":2,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67200000000000004,"5min":0.747,"15min":0.747},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.39700000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59199999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.34999999999999998},"min":{"1min":0.25800000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.68999999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45700000000000002}]},{"osd":6,"last update":"Tue Sep 10 17:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.628,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.29299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.441}]},{"osd":7,"last update":"Tue Sep 10 17:54:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.54400000000000004,"15min":0.56299999999999994},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67000000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63600000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.50600000000000001}]}]},{"osd":4,"up_from":30,"seq":128849018926,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":802816,"data_stored":349976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.379,"5min":0.255,"15min":0.255},"max":{"1min":0.64000000000000001,"5min":0.873,"15min":0.873},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72099999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78300000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66200000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55000000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68899999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53200000000000003}]},{"osd":5,"last update":"Tue Sep 10 17:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.38600000000000001},"min":{"1min":0.24399999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.61199999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38800000000000001,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57199999999999995,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Tue Sep 10 17:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.45600000000000002,"15min":0.45000000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Tue Sep 10 17:54:10 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.50900000000000001,"15min":0.52000000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68500000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58699999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":802816,"data_stored":351701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.436,"15min":0.44600000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55800000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.26400000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.44900000000000001,"15min":0.44500000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73799999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Sep 10 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.313},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68500000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.371}]},{"osd":4,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.746,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Tue Sep 10 17:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68600000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64300000000000002}]},{"osd":6,"last update":"Tue Sep 10 17:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Tue Sep 10 17:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.55800000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411385,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717372,"statfs":{"total":95995035648,"available":95966588928,"internally_reserved":0,"allocated":778240,"data_stored":348976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.36199999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60899999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.372}]},{"osd":1,"last update":"Tue Sep 10 17:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue Sep 10 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.31900000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.68600000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45100000000000001,"15min":0.44600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66500000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.496}]},{"osd":4,"last update":"Tue Sep 10 17:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Sep 10 17:54:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.46800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Sep 10 17:53:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Sep 10 17:54:12 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44,"5min":0.379,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.62},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85299999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":786432,"data_stored":348882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:53:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.377,"15min":0.35499999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.42499999999999999,"15min":0.373},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:54:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.439,"15min":0.40899999999999997},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":4.633,"5min":4.633,"15min":4.633},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.46899999999999997,"15min":0.44},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.9950000000000001,"5min":3.9950000000000001,"15min":3.9950000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.45000000000000001,"15min":0.46000000000000002},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.77600000000000002,"15min":0.623},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":5.4050000000000002,"5min":15.68,"15min":15.68},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Sep 10 17:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.63900000000000001,"15min":0.60699999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.3330000000000002,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Sep 10 17:53:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.66400000000000003,"15min":0.67800000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Tue Sep 10 17:54:10 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.438,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":5.3760000000000003,"5min":5.3760000000000003,"15min":5.3760000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.78200000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32476,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712676,"statfs":{"total":95995035648,"available":95961780224,"internally_reserved":0,"allocated":1392640,"data_stored":940345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 17:53:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53200000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.27700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57599999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Tue Sep 10 17:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.375,"15min":0.379},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.40799999999999997}]},{"osd":3,"last update":"Tue Sep 10 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46899999999999997,"15min":0.48299999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.42899999999999999,"15min":0.44500000000000001},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.30199999999999999}]},{"osd":4,"last update":"Tue Sep 10 17:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69499999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66800000000000004,"15min":0.61899999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84899999999999998,"5min":7.8869999999999996,"15min":7.8869999999999996},"last":0.72999999999999998}]},{"osd":5,"last update":"Tue Sep 10 17:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.86799999999999999,"5min":1.034,"15min":1.034},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.82699999999999996,"15min":0.94199999999999995},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71799999999999997,"5min":7.907,"15min":7.907},"last":0.61899999999999999}]},{"osd":6,"last update":"Tue Sep 10 17:53:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91400000000000003,"5min":1.093,"15min":1.093},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.86799999999999999,"15min":0.91800000000000004},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79300000000000004,"5min":7.9450000000000003,"15min":7.9450000000000003},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Sep 10 17:54:10 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T17:54:48.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T17:54:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:48 smithi012 ceph-mon[27356]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:48 smithi012 ceph-mon[37454]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:48 smithi089 ceph-mon[31467]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:50.005 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.005 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[27356]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[27356]: Reconfiguring daemon alertmanager.a on smithi012 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.006 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[37454]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-10T17:54:50.007 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:49 smithi012 ceph-mon[37454]: Reconfiguring daemon alertmanager.a on smithi012 2024-09-10T17:54:50.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:49 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:49 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:49 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:54:50.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:49 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:54:50.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:49 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:49 smithi089 ceph-mon[31467]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-10T17:54:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:49 smithi089 ceph-mon[31467]: Reconfiguring daemon alertmanager.a on smithi012 2024-09-10T17:54:50.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:54:50.714 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T17:54:51.001 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:50 smithi012 ceph-mon[27356]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:51.002 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:50 smithi012 ceph-mon[37454]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:51.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:50 smithi089 ceph-mon[31467]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:51.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:51 smithi012 ceph-mon[27356]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:54:51.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:51 smithi012 ceph-mon[37454]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:54:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:51 smithi089 ceph-mon[31467]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T17:54:53.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:52 smithi012 ceph-mon[27356]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:52 smithi012 ceph-mon[37454]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:52 smithi089 ceph-mon[31467]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:53.784 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:53 smithi012 systemd[1]: Stopping Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:54:53.949 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-10T17:54:50.680125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593533,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":229,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":236368,"kb_used_data":7924,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749724848,"statfs":{"total":767960285184,"available":767718244352,"internally_reserved":0,"allocated":8114176,"data_stored":4571952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":233819706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002853"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.155953+0000","last_change":"2024-09-10T17:52:39.637199+0000","last_active":"2024-09-10T17:53:57.155953+0000","last_peered":"2024-09-10T17:53:57.155953+0000","last_clean":"2024-09-10T17:53:57.155953+0000","last_became_active":"2024-09-10T17:52:39.636912+0000","last_became_peered":"2024-09-10T17:52:39.636912+0000","last_unstale":"2024-09-10T17:53:57.155953+0000","last_undegraded":"2024-09-10T17:53:57.155953+0000","last_fullsized":"2024-09-10T17:53:57.155953+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.233983+0000","last_change":"2024-09-10T17:52:39.640227+0000","last_active":"2024-09-10T17:53:57.233983+0000","last_peered":"2024-09-10T17:53:57.233983+0000","last_clean":"2024-09-10T17:53:57.233983+0000","last_became_active":"2024-09-10T17:52:39.639677+0000","last_became_peered":"2024-09-10T17:52:39.639677+0000","last_unstale":"2024-09-10T17:53:57.233983+0000","last_undegraded":"2024-09-10T17:53:57.233983+0000","last_fullsized":"2024-09-10T17:53:57.233983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729996+0000","last_change":"2024-09-10T17:52:39.634939+0000","last_active":"2024-09-10T17:53:56.729996+0000","last_peered":"2024-09-10T17:53:56.729996+0000","last_clean":"2024-09-10T17:53:56.729996+0000","last_became_active":"2024-09-10T17:52:39.634668+0000","last_became_peered":"2024-09-10T17:52:39.634668+0000","last_unstale":"2024-09-10T17:53:56.729996+0000","last_undegraded":"2024-09-10T17:53:56.729996+0000","last_fullsized":"2024-09-10T17:53:56.729996+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.867745+0000","last_change":"2024-09-10T17:52:39.652074+0000","last_active":"2024-09-10T17:53:56.867745+0000","last_peered":"2024-09-10T17:53:56.867745+0000","last_clean":"2024-09-10T17:53:56.867745+0000","last_became_active":"2024-09-10T17:52:39.651762+0000","last_became_peered":"2024-09-10T17:52:39.651762+0000","last_unstale":"2024-09-10T17:53:56.867745+0000","last_undegraded":"2024-09-10T17:53:56.867745+0000","last_fullsized":"2024-09-10T17:53:56.867745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301649+0000","last_change":"2024-09-10T17:52:39.637379+0000","last_active":"2024-09-10T17:53:50.301649+0000","last_peered":"2024-09-10T17:53:50.301649+0000","last_clean":"2024-09-10T17:53:50.301649+0000","last_became_active":"2024-09-10T17:52:39.636370+0000","last_became_peered":"2024-09-10T17:52:39.636370+0000","last_unstale":"2024-09-10T17:53:50.301649+0000","last_undegraded":"2024-09-10T17:53:50.301649+0000","last_fullsized":"2024-09-10T17:53:50.301649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203361+0000","last_change":"2024-09-10T17:52:39.646980+0000","last_active":"2024-09-10T17:53:50.203361+0000","last_peered":"2024-09-10T17:53:50.203361+0000","last_clean":"2024-09-10T17:53:50.203361+0000","last_became_active":"2024-09-10T17:52:39.645786+0000","last_became_peered":"2024-09-10T17:52:39.645786+0000","last_unstale":"2024-09-10T17:53:50.203361+0000","last_undegraded":"2024-09-10T17:53:50.203361+0000","last_fullsized":"2024-09-10T17:53:50.203361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301835+0000","last_change":"2024-09-10T17:53:04.527641+0000","last_active":"2024-09-10T17:53:50.301835+0000","last_peered":"2024-09-10T17:53:50.301835+0000","last_clean":"2024-09-10T17:53:50.301835+0000","last_became_active":"2024-09-10T17:53:04.527295+0000","last_became_peered":"2024-09-10T17:53:04.527295+0000","last_unstale":"2024-09-10T17:53:50.301835+0000","last_undegraded":"2024-09-10T17:53:50.301835+0000","last_fullsized":"2024-09-10T17:53:50.301835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:12.311291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198750+0000","last_change":"2024-09-10T17:52:39.645147+0000","last_active":"2024-09-10T17:53:50.198750+0000","last_peered":"2024-09-10T17:53:50.198750+0000","last_clean":"2024-09-10T17:53:50.198750+0000","last_became_active":"2024-09-10T17:52:39.644853+0000","last_became_peered":"2024-09-10T17:52:39.644853+0000","last_unstale":"2024-09-10T17:53:50.198750+0000","last_undegraded":"2024-09-10T17:53:50.198750+0000","last_fullsized":"2024-09-10T17:53:50.198750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302468+0000","last_change":"2024-09-10T17:52:39.643055+0000","last_active":"2024-09-10T17:53:50.302468+0000","last_peered":"2024-09-10T17:53:50.302468+0000","last_clean":"2024-09-10T17:53:50.302468+0000","last_became_active":"2024-09-10T17:52:39.642731+0000","last_became_peered":"2024-09-10T17:52:39.642731+0000","last_unstale":"2024-09-10T17:53:50.302468+0000","last_undegraded":"2024-09-10T17:53:50.302468+0000","last_fullsized":"2024-09-10T17:53:50.302468+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301587+0000","last_change":"2024-09-10T17:52:39.642693+0000","last_active":"2024-09-10T17:53:50.301587+0000","last_peered":"2024-09-10T17:53:50.301587+0000","last_clean":"2024-09-10T17:53:50.301587+0000","last_became_active":"2024-09-10T17:52:39.642404+0000","last_became_peered":"2024-09-10T17:52:39.642404+0000","last_unstale":"2024-09-10T17:53:50.301587+0000","last_undegraded":"2024-09-10T17:53:50.301587+0000","last_fullsized":"2024-09-10T17:53:50.301587+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301874+0000","last_change":"2024-09-10T17:52:39.641932+0000","last_active":"2024-09-10T17:53:50.301874+0000","last_peered":"2024-09-10T17:53:50.301874+0000","last_clean":"2024-09-10T17:53:50.301874+0000","last_became_active":"2024-09-10T17:52:39.641622+0000","last_became_peered":"2024-09-10T17:52:39.641622+0000","last_unstale":"2024-09-10T17:53:50.301874+0000","last_undegraded":"2024-09-10T17:53:50.301874+0000","last_fullsized":"2024-09-10T17:53:50.301874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301348+0000","last_change":"2024-09-10T17:53:04.527604+0000","last_active":"2024-09-10T17:53:50.301348+0000","last_peered":"2024-09-10T17:53:50.301348+0000","last_clean":"2024-09-10T17:53:50.301348+0000","last_became_active":"2024-09-10T17:53:04.527109+0000","last_became_peered":"2024-09-10T17:53:04.527109+0000","last_unstale":"2024-09-10T17:53:50.301348+0000","last_undegraded":"2024-09-10T17:53:50.301348+0000","last_fullsized":"2024-09-10T17:53:50.301348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199181+0000","last_change":"2024-09-10T17:52:39.642786+0000","last_active":"2024-09-10T17:53:50.199181+0000","last_peered":"2024-09-10T17:53:50.199181+0000","last_clean":"2024-09-10T17:53:50.199181+0000","last_became_active":"2024-09-10T17:52:39.641524+0000","last_became_peered":"2024-09-10T17:52:39.641524+0000","last_unstale":"2024-09-10T17:53:50.199181+0000","last_undegraded":"2024-09-10T17:53:50.199181+0000","last_fullsized":"2024-09-10T17:53:50.199181+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301621+0000","last_change":"2024-09-10T17:52:39.639101+0000","last_active":"2024-09-10T17:53:50.301621+0000","last_peered":"2024-09-10T17:53:50.301621+0000","last_clean":"2024-09-10T17:53:50.301621+0000","last_became_active":"2024-09-10T17:52:39.638816+0000","last_became_peered":"2024-09-10T17:52:39.638816+0000","last_unstale":"2024-09-10T17:53:50.301621+0000","last_undegraded":"2024-09-10T17:53:50.301621+0000","last_fullsized":"2024-09-10T17:53:50.301621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198885+0000","last_change":"2024-09-10T17:52:39.640880+0000","last_active":"2024-09-10T17:53:50.198885+0000","last_peered":"2024-09-10T17:53:50.198885+0000","last_clean":"2024-09-10T17:53:50.198885+0000","last_became_active":"2024-09-10T17:52:39.640599+0000","last_became_peered":"2024-09-10T17:52:39.640599+0000","last_unstale":"2024-09-10T17:53:50.198885+0000","last_undegraded":"2024-09-10T17:53:50.198885+0000","last_fullsized":"2024-09-10T17:53:50.198885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203199+0000","last_change":"2024-09-10T17:52:39.646904+0000","last_active":"2024-09-10T17:53:50.203199+0000","last_peered":"2024-09-10T17:53:50.203199+0000","last_clean":"2024-09-10T17:53:50.203199+0000","last_became_active":"2024-09-10T17:52:39.646649+0000","last_became_peered":"2024-09-10T17:52:39.646649+0000","last_unstale":"2024-09-10T17:53:50.203199+0000","last_undegraded":"2024-09-10T17:53:50.203199+0000","last_fullsized":"2024-09-10T17:53:50.203199+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203972+0000","last_change":"2024-09-10T17:52:39.651784+0000","last_active":"2024-09-10T17:53:50.203972+0000","last_peered":"2024-09-10T17:53:50.203972+0000","last_clean":"2024-09-10T17:53:50.203972+0000","last_became_active":"2024-09-10T17:52:39.651519+0000","last_became_peered":"2024-09-10T17:52:39.651519+0000","last_unstale":"2024-09-10T17:53:50.203972+0000","last_undegraded":"2024-09-10T17:53:50.203972+0000","last_fullsized":"2024-09-10T17:53:50.203972+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302021+0000","last_change":"2024-09-10T17:52:39.636540+0000","last_active":"2024-09-10T17:53:50.302021+0000","last_peered":"2024-09-10T17:53:50.302021+0000","last_clean":"2024-09-10T17:53:50.302021+0000","last_became_active":"2024-09-10T17:52:39.636034+0000","last_became_peered":"2024-09-10T17:52:39.636034+0000","last_unstale":"2024-09-10T17:53:50.302021+0000","last_undegraded":"2024-09-10T17:53:50.302021+0000","last_fullsized":"2024-09-10T17:53:50.302021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302270+0000","last_change":"2024-09-10T17:52:39.642764+0000","last_active":"2024-09-10T17:53:50.302270+0000","last_peered":"2024-09-10T17:53:50.302270+0000","last_clean":"2024-09-10T17:53:50.302270+0000","last_became_active":"2024-09-10T17:52:39.642454+0000","last_became_peered":"2024-09-10T17:52:39.642454+0000","last_unstale":"2024-09-10T17:53:50.302270+0000","last_undegraded":"2024-09-10T17:53:50.302270+0000","last_fullsized":"2024-09-10T17:53:50.302270+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302336+0000","last_change":"2024-09-10T17:52:39.644420+0000","last_active":"2024-09-10T17:53:50.302336+0000","last_peered":"2024-09-10T17:53:50.302336+0000","last_clean":"2024-09-10T17:53:50.302336+0000","last_became_active":"2024-09-10T17:52:39.644155+0000","last_became_peered":"2024-09-10T17:52:39.644155+0000","last_unstale":"2024-09-10T17:53:50.302336+0000","last_undegraded":"2024-09-10T17:53:50.302336+0000","last_fullsized":"2024-09-10T17:53:50.302336+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302274+0000","last_change":"2024-09-10T17:52:39.631587+0000","last_active":"2024-09-10T17:53:50.302274+0000","last_peered":"2024-09-10T17:53:50.302274+0000","last_clean":"2024-09-10T17:53:50.302274+0000","last_became_active":"2024-09-10T17:52:39.631291+0000","last_became_peered":"2024-09-10T17:52:39.631291+0000","last_unstale":"2024-09-10T17:53:50.302274+0000","last_undegraded":"2024-09-10T17:53:50.302274+0000","last_fullsized":"2024-09-10T17:53:50.302274+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203349+0000","last_change":"2024-09-10T17:52:39.635863+0000","last_active":"2024-09-10T17:53:50.203349+0000","last_peered":"2024-09-10T17:53:50.203349+0000","last_clean":"2024-09-10T17:53:50.203349+0000","last_became_active":"2024-09-10T17:52:39.635566+0000","last_became_peered":"2024-09-10T17:52:39.635566+0000","last_unstale":"2024-09-10T17:53:50.203349+0000","last_undegraded":"2024-09-10T17:53:50.203349+0000","last_fullsized":"2024-09-10T17:53:50.203349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198959+0000","last_change":"2024-09-10T17:52:39.641463+0000","last_active":"2024-09-10T17:53:50.198959+0000","last_peered":"2024-09-10T17:53:50.198959+0000","last_clean":"2024-09-10T17:53:50.198959+0000","last_became_active":"2024-09-10T17:52:39.640887+0000","last_became_peered":"2024-09-10T17:52:39.640887+0000","last_unstale":"2024-09-10T17:53:50.198959+0000","last_undegraded":"2024-09-10T17:53:50.198959+0000","last_fullsized":"2024-09-10T17:53:50.198959+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203437+0000","last_change":"2024-09-10T17:52:39.648810+0000","last_active":"2024-09-10T17:53:50.203437+0000","last_peered":"2024-09-10T17:53:50.203437+0000","last_clean":"2024-09-10T17:53:50.203437+0000","last_became_active":"2024-09-10T17:52:39.648476+0000","last_became_peered":"2024-09-10T17:52:39.648476+0000","last_unstale":"2024-09-10T17:53:50.203437+0000","last_undegraded":"2024-09-10T17:53:50.203437+0000","last_fullsized":"2024-09-10T17:53:50.203437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199358+0000","last_change":"2024-09-10T17:52:39.643794+0000","last_active":"2024-09-10T17:53:50.199358+0000","last_peered":"2024-09-10T17:53:50.199358+0000","last_clean":"2024-09-10T17:53:50.199358+0000","last_became_active":"2024-09-10T17:52:39.643540+0000","last_became_peered":"2024-09-10T17:52:39.643540+0000","last_unstale":"2024-09-10T17:53:50.199358+0000","last_undegraded":"2024-09-10T17:53:50.199358+0000","last_fullsized":"2024-09-10T17:53:50.199358+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301593+0000","last_change":"2024-09-10T17:52:39.650553+0000","last_active":"2024-09-10T17:53:50.301593+0000","last_peered":"2024-09-10T17:53:50.301593+0000","last_clean":"2024-09-10T17:53:50.301593+0000","last_became_active":"2024-09-10T17:52:39.650207+0000","last_became_peered":"2024-09-10T17:52:39.650207+0000","last_unstale":"2024-09-10T17:53:50.301593+0000","last_undegraded":"2024-09-10T17:53:50.301593+0000","last_fullsized":"2024-09-10T17:53:50.301593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198166+0000","last_change":"2024-09-10T17:52:39.641442+0000","last_active":"2024-09-10T17:53:50.198166+0000","last_peered":"2024-09-10T17:53:50.198166+0000","last_clean":"2024-09-10T17:53:50.198166+0000","last_became_active":"2024-09-10T17:52:39.641158+0000","last_became_peered":"2024-09-10T17:52:39.641158+0000","last_unstale":"2024-09-10T17:53:50.198166+0000","last_undegraded":"2024-09-10T17:53:50.198166+0000","last_fullsized":"2024-09-10T17:53:50.198166+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199152+0000","last_change":"2024-09-10T17:52:39.644997+0000","last_active":"2024-09-10T17:53:50.199152+0000","last_peered":"2024-09-10T17:53:50.199152+0000","last_clean":"2024-09-10T17:53:50.199152+0000","last_became_active":"2024-09-10T17:52:39.643999+0000","last_became_peered":"2024-09-10T17:52:39.643999+0000","last_unstale":"2024-09-10T17:53:50.199152+0000","last_undegraded":"2024-09-10T17:53:50.199152+0000","last_fullsized":"2024-09-10T17:53:50.199152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729128+0000","last_change":"2024-09-10T17:52:39.632927+0000","last_active":"2024-09-10T17:53:56.729128+0000","last_peered":"2024-09-10T17:53:56.729128+0000","last_clean":"2024-09-10T17:53:56.729128+0000","last_became_active":"2024-09-10T17:52:39.632680+0000","last_became_peered":"2024-09-10T17:52:39.632680+0000","last_unstale":"2024-09-10T17:53:56.729128+0000","last_undegraded":"2024-09-10T17:53:56.729128+0000","last_fullsized":"2024-09-10T17:53:56.729128+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.867623+0000","last_change":"2024-09-10T17:52:39.648726+0000","last_active":"2024-09-10T17:53:56.867623+0000","last_peered":"2024-09-10T17:53:56.867623+0000","last_clean":"2024-09-10T17:53:56.867623+0000","last_became_active":"2024-09-10T17:52:39.648448+0000","last_became_peered":"2024-09-10T17:52:39.648448+0000","last_unstale":"2024-09-10T17:53:56.867623+0000","last_undegraded":"2024-09-10T17:53:56.867623+0000","last_fullsized":"2024-09-10T17:53:56.867623+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.732333+0000","last_change":"2024-09-10T17:52:39.634918+0000","last_active":"2024-09-10T17:53:56.732333+0000","last_peered":"2024-09-10T17:53:56.732333+0000","last_clean":"2024-09-10T17:53:56.732333+0000","last_became_active":"2024-09-10T17:52:39.634622+0000","last_became_peered":"2024-09-10T17:52:39.634622+0000","last_unstale":"2024-09-10T17:53:56.732333+0000","last_undegraded":"2024-09-10T17:53:56.732333+0000","last_fullsized":"2024-09-10T17:53:56.732333+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.301939+0000","last_change":"2024-09-10T17:52:39.642111+0000","last_active":"2024-09-10T17:53:57.301939+0000","last_peered":"2024-09-10T17:53:57.301939+0000","last_clean":"2024-09-10T17:53:57.301939+0000","last_became_active":"2024-09-10T17:52:39.641786+0000","last_became_peered":"2024-09-10T17:52:39.641786+0000","last_unstale":"2024-09-10T17:53:57.301939+0000","last_undegraded":"2024-09-10T17:53:57.301939+0000","last_fullsized":"2024-09-10T17:53:57.301939+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.196756+0000","last_change":"2024-09-10T17:52:39.632064+0000","last_active":"2024-09-10T17:53:50.196756+0000","last_peered":"2024-09-10T17:53:50.196756+0000","last_clean":"2024-09-10T17:53:50.196756+0000","last_became_active":"2024-09-10T17:52:39.631529+0000","last_became_peered":"2024-09-10T17:52:39.631529+0000","last_unstale":"2024-09-10T17:53:50.196756+0000","last_undegraded":"2024-09-10T17:53:50.196756+0000","last_fullsized":"2024-09-10T17:53:50.196756+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199321+0000","last_change":"2024-09-10T17:52:36.192274+0000","last_active":"2024-09-10T17:53:50.199321+0000","last_peered":"2024-09-10T17:53:50.199321+0000","last_clean":"2024-09-10T17:53:50.199321+0000","last_became_active":"2024-09-10T17:52:36.191998+0000","last_became_peered":"2024-09-10T17:52:36.191998+0000","last_unstale":"2024-09-10T17:53:50.199321+0000","last_undegraded":"2024-09-10T17:53:50.199321+0000","last_fullsized":"2024-09-10T17:53:50.199321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301613+0000","last_change":"2024-09-10T17:53:04.205276+0000","last_active":"2024-09-10T17:53:50.301613+0000","last_peered":"2024-09-10T17:53:50.301613+0000","last_clean":"2024-09-10T17:53:50.301613+0000","last_became_active":"2024-09-10T17:53:04.204905+0000","last_became_peered":"2024-09-10T17:53:04.204905+0000","last_unstale":"2024-09-10T17:53:50.301613+0000","last_undegraded":"2024-09-10T17:53:50.301613+0000","last_fullsized":"2024-09-10T17:53:50.301613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301502+0000","last_change":"2024-09-10T17:52:36.190911+0000","last_active":"2024-09-10T17:53:50.301502+0000","last_peered":"2024-09-10T17:53:50.301502+0000","last_clean":"2024-09-10T17:53:50.301502+0000","last_became_active":"2024-09-10T17:52:36.190437+0000","last_became_peered":"2024-09-10T17:52:36.190437+0000","last_unstale":"2024-09-10T17:53:50.301502+0000","last_undegraded":"2024-09-10T17:53:50.301502+0000","last_fullsized":"2024-09-10T17:53:50.301502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199182+0000","last_change":"2024-09-10T17:52:36.192952+0000","last_active":"2024-09-10T17:53:50.199182+0000","last_peered":"2024-09-10T17:53:50.199182+0000","last_clean":"2024-09-10T17:53:50.199182+0000","last_became_active":"2024-09-10T17:52:36.192199+0000","last_became_peered":"2024-09-10T17:52:36.192199+0000","last_unstale":"2024-09-10T17:53:50.199182+0000","last_undegraded":"2024-09-10T17:53:50.199182+0000","last_fullsized":"2024-09-10T17:53:50.199182+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198872+0000","last_change":"2024-09-10T17:52:39.646604+0000","last_active":"2024-09-10T17:53:50.198872+0000","last_peered":"2024-09-10T17:53:50.198872+0000","last_clean":"2024-09-10T17:53:50.198872+0000","last_became_active":"2024-09-10T17:52:39.646321+0000","last_became_peered":"2024-09-10T17:52:39.646321+0000","last_unstale":"2024-09-10T17:53:50.198872+0000","last_undegraded":"2024-09-10T17:53:50.198872+0000","last_fullsized":"2024-09-10T17:53:50.198872+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203521+0000","last_change":"2024-09-10T17:52:36.194360+0000","last_active":"2024-09-10T17:53:50.203521+0000","last_peered":"2024-09-10T17:53:50.203521+0000","last_clean":"2024-09-10T17:53:50.203521+0000","last_became_active":"2024-09-10T17:52:36.194106+0000","last_became_peered":"2024-09-10T17:52:36.194106+0000","last_unstale":"2024-09-10T17:53:50.203521+0000","last_undegraded":"2024-09-10T17:53:50.203521+0000","last_fullsized":"2024-09-10T17:53:50.203521+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.197554+0000","last_change":"2024-09-10T17:52:39.637886+0000","last_active":"2024-09-10T17:53:50.197554+0000","last_peered":"2024-09-10T17:53:50.197554+0000","last_clean":"2024-09-10T17:53:50.197554+0000","last_became_active":"2024-09-10T17:52:39.637615+0000","last_became_peered":"2024-09-10T17:52:39.637615+0000","last_unstale":"2024-09-10T17:53:50.197554+0000","last_undegraded":"2024-09-10T17:53:50.197554+0000","last_fullsized":"2024-09-10T17:53:50.197554+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301376+0000","last_change":"2024-09-10T17:52:36.193200+0000","last_active":"2024-09-10T17:53:50.301376+0000","last_peered":"2024-09-10T17:53:50.301376+0000","last_clean":"2024-09-10T17:53:50.301376+0000","last_became_active":"2024-09-10T17:52:36.192223+0000","last_became_peered":"2024-09-10T17:52:36.192223+0000","last_unstale":"2024-09-10T17:53:50.301376+0000","last_undegraded":"2024-09-10T17:53:50.301376+0000","last_fullsized":"2024-09-10T17:53:50.301376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203873+0000","last_change":"2024-09-10T17:52:39.646338+0000","last_active":"2024-09-10T17:53:50.203873+0000","last_peered":"2024-09-10T17:53:50.203873+0000","last_clean":"2024-09-10T17:53:50.203873+0000","last_became_active":"2024-09-10T17:52:39.645661+0000","last_became_peered":"2024-09-10T17:52:39.645661+0000","last_unstale":"2024-09-10T17:53:50.203873+0000","last_undegraded":"2024-09-10T17:53:50.203873+0000","last_fullsized":"2024-09-10T17:53:50.203873+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203941+0000","last_change":"2024-09-10T17:52:36.192408+0000","last_active":"2024-09-10T17:53:50.203941+0000","last_peered":"2024-09-10T17:53:50.203941+0000","last_clean":"2024-09-10T17:53:50.203941+0000","last_became_active":"2024-09-10T17:52:36.192132+0000","last_became_peered":"2024-09-10T17:52:36.192132+0000","last_unstale":"2024-09-10T17:53:50.203941+0000","last_undegraded":"2024-09-10T17:53:50.203941+0000","last_fullsized":"2024-09-10T17:53:50.203941+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.303056+0000","last_change":"2024-09-10T17:52:39.641531+0000","last_active":"2024-09-10T17:53:50.303056+0000","last_peered":"2024-09-10T17:53:50.303056+0000","last_clean":"2024-09-10T17:53:50.303056+0000","last_became_active":"2024-09-10T17:52:39.639958+0000","last_became_peered":"2024-09-10T17:52:39.639958+0000","last_unstale":"2024-09-10T17:53:50.303056+0000","last_undegraded":"2024-09-10T17:53:50.303056+0000","last_fullsized":"2024-09-10T17:53:50.303056+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"65'3","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198316+0000","last_change":"2024-09-10T17:52:36.188432+0000","last_active":"2024-09-10T17:53:50.198316+0000","last_peered":"2024-09-10T17:53:50.198316+0000","last_clean":"2024-09-10T17:53:50.198316+0000","last_became_active":"2024-09-10T17:52:36.188019+0000","last_became_peered":"2024-09-10T17:52:36.188019+0000","last_unstale":"2024-09-10T17:53:50.198316+0000","last_undegraded":"2024-09-10T17:53:50.198316+0000","last_fullsized":"2024-09-10T17:53:50.198316+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.197039+0000","last_change":"2024-09-10T17:52:39.642140+0000","last_active":"2024-09-10T17:53:50.197039+0000","last_peered":"2024-09-10T17:53:50.197039+0000","last_clean":"2024-09-10T17:53:50.197039+0000","last_became_active":"2024-09-10T17:52:39.641201+0000","last_became_peered":"2024-09-10T17:52:39.641201+0000","last_unstale":"2024-09-10T17:53:50.197039+0000","last_undegraded":"2024-09-10T17:53:50.197039+0000","last_fullsized":"2024-09-10T17:53:50.197039+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"68'9","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302433+0000","last_change":"2024-09-10T17:52:36.190637+0000","last_active":"2024-09-10T17:53:50.302433+0000","last_peered":"2024-09-10T17:53:50.302433+0000","last_clean":"2024-09-10T17:53:50.302433+0000","last_became_active":"2024-09-10T17:52:36.190315+0000","last_became_peered":"2024-09-10T17:52:36.190315+0000","last_unstale":"2024-09-10T17:53:50.302433+0000","last_undegraded":"2024-09-10T17:53:50.302433+0000","last_fullsized":"2024-09-10T17:53:50.302433+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2348,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301820+0000","last_change":"2024-09-10T17:52:39.647058+0000","last_active":"2024-09-10T17:53:50.301820+0000","last_peered":"2024-09-10T17:53:50.301820+0000","last_clean":"2024-09-10T17:53:50.301820+0000","last_became_active":"2024-09-10T17:52:39.646127+0000","last_became_peered":"2024-09-10T17:52:39.646127+0000","last_unstale":"2024-09-10T17:53:50.301820+0000","last_undegraded":"2024-09-10T17:53:50.301820+0000","last_fullsized":"2024-09-10T17:53:50.301820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302389+0000","last_change":"2024-09-10T17:52:36.197133+0000","last_active":"2024-09-10T17:53:50.302389+0000","last_peered":"2024-09-10T17:53:50.302389+0000","last_clean":"2024-09-10T17:53:50.302389+0000","last_became_active":"2024-09-10T17:52:36.196798+0000","last_became_peered":"2024-09-10T17:52:36.196798+0000","last_unstale":"2024-09-10T17:53:50.302389+0000","last_undegraded":"2024-09-10T17:53:50.302389+0000","last_fullsized":"2024-09-10T17:53:50.302389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301713+0000","last_change":"2024-09-10T17:52:39.632963+0000","last_active":"2024-09-10T17:53:50.301713+0000","last_peered":"2024-09-10T17:53:50.301713+0000","last_clean":"2024-09-10T17:53:50.301713+0000","last_became_active":"2024-09-10T17:52:39.632648+0000","last_became_peered":"2024-09-10T17:52:39.632648+0000","last_unstale":"2024-09-10T17:53:50.301713+0000","last_undegraded":"2024-09-10T17:53:50.301713+0000","last_fullsized":"2024-09-10T17:53:50.301713+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203725+0000","last_change":"2024-09-10T17:52:36.190919+0000","last_active":"2024-09-10T17:53:50.203725+0000","last_peered":"2024-09-10T17:53:50.203725+0000","last_clean":"2024-09-10T17:53:50.203725+0000","last_became_active":"2024-09-10T17:52:36.190637+0000","last_became_peered":"2024-09-10T17:52:36.190637+0000","last_unstale":"2024-09-10T17:53:50.203725+0000","last_undegraded":"2024-09-10T17:53:50.203725+0000","last_fullsized":"2024-09-10T17:53:50.203725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301901+0000","last_change":"2024-09-10T17:52:39.637441+0000","last_active":"2024-09-10T17:53:50.301901+0000","last_peered":"2024-09-10T17:53:50.301901+0000","last_clean":"2024-09-10T17:53:50.301901+0000","last_became_active":"2024-09-10T17:52:39.636759+0000","last_became_peered":"2024-09-10T17:52:39.636759+0000","last_unstale":"2024-09-10T17:53:50.301901+0000","last_undegraded":"2024-09-10T17:53:50.301901+0000","last_fullsized":"2024-09-10T17:53:50.301901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301408+0000","last_change":"2024-09-10T17:52:36.192102+0000","last_active":"2024-09-10T17:53:50.301408+0000","last_peered":"2024-09-10T17:53:50.301408+0000","last_clean":"2024-09-10T17:53:50.301408+0000","last_became_active":"2024-09-10T17:52:36.191743+0000","last_became_peered":"2024-09-10T17:52:36.191743+0000","last_unstale":"2024-09-10T17:53:50.301408+0000","last_undegraded":"2024-09-10T17:53:50.301408+0000","last_fullsized":"2024-09-10T17:53:50.301408+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301629+0000","last_change":"2024-09-10T17:52:39.640124+0000","last_active":"2024-09-10T17:53:50.301629+0000","last_peered":"2024-09-10T17:53:50.301629+0000","last_clean":"2024-09-10T17:53:50.301629+0000","last_became_active":"2024-09-10T17:52:39.639840+0000","last_became_peered":"2024-09-10T17:52:39.639840+0000","last_unstale":"2024-09-10T17:53:50.301629+0000","last_undegraded":"2024-09-10T17:53:50.301629+0000","last_fullsized":"2024-09-10T17:53:50.301629+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"65'8","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301854+0000","last_change":"2024-09-10T17:52:36.191246+0000","last_active":"2024-09-10T17:53:50.301854+0000","last_peered":"2024-09-10T17:53:50.301854+0000","last_clean":"2024-09-10T17:53:50.301854+0000","last_became_active":"2024-09-10T17:52:36.190916+0000","last_became_peered":"2024-09-10T17:52:36.190916+0000","last_unstale":"2024-09-10T17:53:50.301854+0000","last_undegraded":"2024-09-10T17:53:50.301854+0000","last_fullsized":"2024-09-10T17:53:50.301854+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301967+0000","last_change":"2024-09-10T17:52:39.647318+0000","last_active":"2024-09-10T17:53:50.301967+0000","last_peered":"2024-09-10T17:53:50.301967+0000","last_clean":"2024-09-10T17:53:50.301967+0000","last_became_active":"2024-09-10T17:52:39.647020+0000","last_became_peered":"2024-09-10T17:52:39.647020+0000","last_unstale":"2024-09-10T17:53:50.301967+0000","last_undegraded":"2024-09-10T17:53:50.301967+0000","last_fullsized":"2024-09-10T17:53:50.301967+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.197455+0000","last_change":"2024-09-10T17:52:36.194263+0000","last_active":"2024-09-10T17:53:50.197455+0000","last_peered":"2024-09-10T17:53:50.197455+0000","last_clean":"2024-09-10T17:53:50.197455+0000","last_became_active":"2024-09-10T17:52:36.193894+0000","last_became_peered":"2024-09-10T17:52:36.193894+0000","last_unstale":"2024-09-10T17:53:50.197455+0000","last_undegraded":"2024-09-10T17:53:50.197455+0000","last_fullsized":"2024-09-10T17:53:50.197455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301941+0000","last_change":"2024-09-10T17:53:04.205325+0000","last_active":"2024-09-10T17:53:50.301941+0000","last_peered":"2024-09-10T17:53:50.301941+0000","last_clean":"2024-09-10T17:53:50.301941+0000","last_became_active":"2024-09-10T17:53:04.204953+0000","last_became_peered":"2024-09-10T17:53:04.204953+0000","last_unstale":"2024-09-10T17:53:50.301941+0000","last_undegraded":"2024-09-10T17:53:50.301941+0000","last_fullsized":"2024-09-10T17:53:50.301941+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302171+0000","last_change":"2024-09-10T17:52:36.191958+0000","last_active":"2024-09-10T17:53:50.302171+0000","last_peered":"2024-09-10T17:53:50.302171+0000","last_clean":"2024-09-10T17:53:50.302171+0000","last_became_active":"2024-09-10T17:52:36.191684+0000","last_became_peered":"2024-09-10T17:52:36.191684+0000","last_unstale":"2024-09-10T17:53:50.302171+0000","last_undegraded":"2024-09-10T17:53:50.302171+0000","last_fullsized":"2024-09-10T17:53:50.302171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301799+0000","last_change":"2024-09-10T17:52:39.648857+0000","last_active":"2024-09-10T17:53:50.301799+0000","last_peered":"2024-09-10T17:53:50.301799+0000","last_clean":"2024-09-10T17:53:50.301799+0000","last_became_active":"2024-09-10T17:52:39.648574+0000","last_became_peered":"2024-09-10T17:52:39.648574+0000","last_unstale":"2024-09-10T17:53:50.301799+0000","last_undegraded":"2024-09-10T17:53:50.301799+0000","last_fullsized":"2024-09-10T17:53:50.301799+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"65'1","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198402+0000","last_change":"2024-09-10T17:52:36.185952+0000","last_active":"2024-09-10T17:53:50.198402+0000","last_peered":"2024-09-10T17:53:50.198402+0000","last_clean":"2024-09-10T17:53:50.198402+0000","last_became_active":"2024-09-10T17:52:36.184643+0000","last_became_peered":"2024-09-10T17:52:36.184643+0000","last_unstale":"2024-09-10T17:53:50.198402+0000","last_undegraded":"2024-09-10T17:53:50.198402+0000","last_fullsized":"2024-09-10T17:53:50.198402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203495+0000","last_change":"2024-09-10T17:52:39.651773+0000","last_active":"2024-09-10T17:53:50.203495+0000","last_peered":"2024-09-10T17:53:50.203495+0000","last_clean":"2024-09-10T17:53:50.203495+0000","last_became_active":"2024-09-10T17:52:39.650072+0000","last_became_peered":"2024-09-10T17:52:39.650072+0000","last_unstale":"2024-09-10T17:53:50.203495+0000","last_undegraded":"2024-09-10T17:53:50.203495+0000","last_fullsized":"2024-09-10T17:53:50.203495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301427+0000","last_change":"2024-09-10T17:52:36.191363+0000","last_active":"2024-09-10T17:53:50.301427+0000","last_peered":"2024-09-10T17:53:50.301427+0000","last_clean":"2024-09-10T17:53:50.301427+0000","last_became_active":"2024-09-10T17:52:36.190976+0000","last_became_peered":"2024-09-10T17:52:36.190976+0000","last_unstale":"2024-09-10T17:53:50.301427+0000","last_undegraded":"2024-09-10T17:53:50.301427+0000","last_fullsized":"2024-09-10T17:53:50.301427+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302158+0000","last_change":"2024-09-10T17:52:39.643612+0000","last_active":"2024-09-10T17:53:50.302158+0000","last_peered":"2024-09-10T17:53:50.302158+0000","last_clean":"2024-09-10T17:53:50.302158+0000","last_became_active":"2024-09-10T17:52:39.643274+0000","last_became_peered":"2024-09-10T17:52:39.643274+0000","last_unstale":"2024-09-10T17:53:50.302158+0000","last_undegraded":"2024-09-10T17:53:50.302158+0000","last_fullsized":"2024-09-10T17:53:50.302158+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.302347+0000","last_change":"2024-09-10T17:53:50.302350+0000","last_active":"2024-09-10T17:53:57.302347+0000","last_peered":"2024-09-10T17:53:57.302347+0000","last_clean":"2024-09-10T17:53:57.302347+0000","last_became_active":"2024-09-10T17:53:45.957358+0000","last_became_peered":"2024-09-10T17:53:45.957358+0000","last_unstale":"2024-09-10T17:53:57.302347+0000","last_undegraded":"2024-09-10T17:53:57.302347+0000","last_fullsized":"2024-09-10T17:53:57.302347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:01.978582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010232780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"68'128","reported_seq":273,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.155562+0000","last_change":"2024-09-10T17:52:12.719807+0000","last_active":"2024-09-10T17:53:57.155562+0000","last_peered":"2024-09-10T17:53:57.155562+0000","last_clean":"2024-09-10T17:53:57.155562+0000","last_became_active":"2024-09-10T17:52:12.719452+0000","last_became_peered":"2024-09-10T17:52:12.719452+0000","last_unstale":"2024-09-10T17:53:57.155562+0000","last_undegraded":"2024-09-10T17:53:57.155562+0000","last_fullsized":"2024-09-10T17:53:57.155562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_clean_scrub_stamp":"2024-09-10T17:50:14.084625+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.867705+0000","last_change":"2024-09-10T17:52:36.195598+0000","last_active":"2024-09-10T17:53:56.867705+0000","last_peered":"2024-09-10T17:53:56.867705+0000","last_clean":"2024-09-10T17:53:56.867705+0000","last_became_active":"2024-09-10T17:52:36.195203+0000","last_became_peered":"2024-09-10T17:52:36.195203+0000","last_unstale":"2024-09-10T17:53:56.867705+0000","last_undegraded":"2024-09-10T17:53:56.867705+0000","last_fullsized":"2024-09-10T17:53:56.867705+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729612+0000","last_change":"2024-09-10T17:52:39.644934+0000","last_active":"2024-09-10T17:53:56.729612+0000","last_peered":"2024-09-10T17:53:56.729612+0000","last_clean":"2024-09-10T17:53:56.729612+0000","last_became_active":"2024-09-10T17:52:39.644205+0000","last_became_peered":"2024-09-10T17:52:39.644205+0000","last_unstale":"2024-09-10T17:53:56.729612+0000","last_undegraded":"2024-09-10T17:53:56.729612+0000","last_fullsized":"2024-09-10T17:53:56.729612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.730292+0000","last_change":"2024-09-10T17:53:50.303137+0000","last_active":"2024-09-10T17:53:56.730292+0000","last_peered":"2024-09-10T17:53:56.730292+0000","last_clean":"2024-09-10T17:53:56.730292+0000","last_became_active":"2024-09-10T17:53:45.961914+0000","last_became_peered":"2024-09-10T17:53:45.961914+0000","last_unstale":"2024-09-10T17:53:56.730292+0000","last_undegraded":"2024-09-10T17:53:56.730292+0000","last_fullsized":"2024-09-10T17:53:56.730292+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:53.216058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027560099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301621+0000","last_change":"2024-09-10T17:53:04.527840+0000","last_active":"2024-09-10T17:53:50.301621+0000","last_peered":"2024-09-10T17:53:50.301621+0000","last_clean":"2024-09-10T17:53:50.301621+0000","last_became_active":"2024-09-10T17:53:04.527470+0000","last_became_peered":"2024-09-10T17:53:04.527470+0000","last_unstale":"2024-09-10T17:53:50.301621+0000","last_undegraded":"2024-09-10T17:53:50.301621+0000","last_fullsized":"2024-09-10T17:53:50.301621+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.728362+0000","last_change":"2024-09-10T17:52:39.632868+0000","last_active":"2024-09-10T17:53:56.728362+0000","last_peered":"2024-09-10T17:53:56.728362+0000","last_clean":"2024-09-10T17:53:56.728362+0000","last_became_active":"2024-09-10T17:52:39.632549+0000","last_became_peered":"2024-09-10T17:52:39.632549+0000","last_unstale":"2024-09-10T17:53:56.728362+0000","last_undegraded":"2024-09-10T17:53:56.728362+0000","last_fullsized":"2024-09-10T17:53:56.728362+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.233006+0000","last_change":"2024-09-10T17:53:50.198782+0000","last_active":"2024-09-10T17:53:57.233006+0000","last_peered":"2024-09-10T17:53:57.233006+0000","last_clean":"2024-09-10T17:53:57.233006+0000","last_became_active":"2024-09-10T17:53:46.005227+0000","last_became_peered":"2024-09-10T17:53:46.005227+0000","last_unstale":"2024-09-10T17:53:57.233006+0000","last_undegraded":"2024-09-10T17:53:57.233006+0000","last_fullsized":"2024-09-10T17:53:57.233006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:51.873480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073360500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.732389+0000","last_change":"2024-09-10T17:52:36.190567+0000","last_active":"2024-09-10T17:53:56.732389+0000","last_peered":"2024-09-10T17:53:56.732389+0000","last_clean":"2024-09-10T17:53:56.732389+0000","last_became_active":"2024-09-10T17:52:36.190261+0000","last_became_peered":"2024-09-10T17:52:36.190261+0000","last_unstale":"2024-09-10T17:53:56.732389+0000","last_undegraded":"2024-09-10T17:53:56.732389+0000","last_fullsized":"2024-09-10T17:53:56.732389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.231691+0000","last_change":"2024-09-10T17:52:39.638839+0000","last_active":"2024-09-10T17:53:57.231691+0000","last_peered":"2024-09-10T17:53:57.231691+0000","last_clean":"2024-09-10T17:53:57.231691+0000","last_became_active":"2024-09-10T17:52:39.638567+0000","last_became_peered":"2024-09-10T17:52:39.638567+0000","last_unstale":"2024-09-10T17:53:57.231691+0000","last_undegraded":"2024-09-10T17:53:57.231691+0000","last_fullsized":"2024-09-10T17:53:57.231691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.233366+0000","last_change":"2024-09-10T17:53:50.198381+0000","last_active":"2024-09-10T17:53:57.233366+0000","last_peered":"2024-09-10T17:53:57.233366+0000","last_clean":"2024-09-10T17:53:57.233366+0000","last_became_active":"2024-09-10T17:53:45.961040+0000","last_became_peered":"2024-09-10T17:53:45.961040+0000","last_unstale":"2024-09-10T17:53:57.233366+0000","last_undegraded":"2024-09-10T17:53:57.233366+0000","last_fullsized":"2024-09-10T17:53:57.233366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:34.194479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046083499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.867739+0000","last_change":"2024-09-10T17:52:36.193278+0000","last_active":"2024-09-10T17:53:56.867739+0000","last_peered":"2024-09-10T17:53:56.867739+0000","last_clean":"2024-09-10T17:53:56.867739+0000","last_became_active":"2024-09-10T17:52:36.192979+0000","last_became_peered":"2024-09-10T17:52:36.192979+0000","last_unstale":"2024-09-10T17:53:56.867739+0000","last_undegraded":"2024-09-10T17:53:56.867739+0000","last_fullsized":"2024-09-10T17:53:56.867739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729352+0000","last_change":"2024-09-10T17:52:39.640516+0000","last_active":"2024-09-10T17:53:56.729352+0000","last_peered":"2024-09-10T17:53:56.729352+0000","last_clean":"2024-09-10T17:53:56.729352+0000","last_became_active":"2024-09-10T17:52:39.639996+0000","last_became_peered":"2024-09-10T17:52:39.639996+0000","last_unstale":"2024-09-10T17:53:56.729352+0000","last_undegraded":"2024-09-10T17:53:56.729352+0000","last_fullsized":"2024-09-10T17:53:56.729352+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"74'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.232091+0000","last_change":"2024-09-10T17:53:50.198385+0000","last_active":"2024-09-10T17:53:57.232091+0000","last_peered":"2024-09-10T17:53:57.232091+0000","last_clean":"2024-09-10T17:53:57.232091+0000","last_became_active":"2024-09-10T17:53:46.005011+0000","last_became_peered":"2024-09-10T17:53:46.005011+0000","last_unstale":"2024-09-10T17:53:57.232091+0000","last_undegraded":"2024-09-10T17:53:57.232091+0000","last_fullsized":"2024-09-10T17:53:57.232091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:31.979953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062133499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.233709+0000","last_change":"2024-09-10T17:52:36.193781+0000","last_active":"2024-09-10T17:53:57.233709+0000","last_peered":"2024-09-10T17:53:57.233709+0000","last_clean":"2024-09-10T17:53:57.233709+0000","last_became_active":"2024-09-10T17:52:36.193487+0000","last_became_peered":"2024-09-10T17:52:36.193487+0000","last_unstale":"2024-09-10T17:53:57.233709+0000","last_undegraded":"2024-09-10T17:53:57.233709+0000","last_fullsized":"2024-09-10T17:53:57.233709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.868059+0000","last_change":"2024-09-10T17:52:39.647909+0000","last_active":"2024-09-10T17:53:56.868059+0000","last_peered":"2024-09-10T17:53:56.868059+0000","last_clean":"2024-09-10T17:53:56.868059+0000","last_became_active":"2024-09-10T17:52:39.647630+0000","last_became_peered":"2024-09-10T17:52:39.647630+0000","last_unstale":"2024-09-10T17:53:56.868059+0000","last_undegraded":"2024-09-10T17:53:56.868059+0000","last_fullsized":"2024-09-10T17:53:56.868059+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"72'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.728772+0000","last_change":"2024-09-10T17:53:50.302596+0000","last_active":"2024-09-10T17:53:56.728772+0000","last_peered":"2024-09-10T17:53:56.728772+0000","last_clean":"2024-09-10T17:53:56.728772+0000","last_became_active":"2024-09-10T17:53:46.005071+0000","last_became_peered":"2024-09-10T17:53:46.005071+0000","last_unstale":"2024-09-10T17:53:56.728772+0000","last_undegraded":"2024-09-10T17:53:56.728772+0000","last_fullsized":"2024-09-10T17:53:56.728772+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:21.200358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000456615,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.156008+0000","last_change":"2024-09-10T17:52:36.200712+0000","last_active":"2024-09-10T17:53:57.156008+0000","last_peered":"2024-09-10T17:53:57.156008+0000","last_clean":"2024-09-10T17:53:57.156008+0000","last_became_active":"2024-09-10T17:52:36.200402+0000","last_became_peered":"2024-09-10T17:52:36.200402+0000","last_unstale":"2024-09-10T17:53:57.156008+0000","last_undegraded":"2024-09-10T17:53:57.156008+0000","last_fullsized":"2024-09-10T17:53:57.156008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.233618+0000","last_change":"2024-09-10T17:52:39.643072+0000","last_active":"2024-09-10T17:53:57.233618+0000","last_peered":"2024-09-10T17:53:57.233618+0000","last_clean":"2024-09-10T17:53:57.233618+0000","last_became_active":"2024-09-10T17:52:39.642792+0000","last_became_peered":"2024-09-10T17:52:39.642792+0000","last_unstale":"2024-09-10T17:53:57.233618+0000","last_undegraded":"2024-09-10T17:53:57.233618+0000","last_fullsized":"2024-09-10T17:53:57.233618+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.728960+0000","last_change":"2024-09-10T17:53:50.199886+0000","last_active":"2024-09-10T17:53:56.728960+0000","last_peered":"2024-09-10T17:53:56.728960+0000","last_clean":"2024-09-10T17:53:56.728960+0000","last_became_active":"2024-09-10T17:53:45.959700+0000","last_became_peered":"2024-09-10T17:53:45.959700+0000","last_unstale":"2024-09-10T17:53:56.728960+0000","last_undegraded":"2024-09-10T17:53:56.728960+0000","last_fullsized":"2024-09-10T17:53:56.728960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.618711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001168997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"65'1","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.234071+0000","last_change":"2024-09-10T17:52:36.192033+0000","last_active":"2024-09-10T17:53:57.234071+0000","last_peered":"2024-09-10T17:53:57.234071+0000","last_clean":"2024-09-10T17:53:57.234071+0000","last_became_active":"2024-09-10T17:52:36.191662+0000","last_became_peered":"2024-09-10T17:52:36.191662+0000","last_unstale":"2024-09-10T17:53:57.234071+0000","last_undegraded":"2024-09-10T17:53:57.234071+0000","last_fullsized":"2024-09-10T17:53:57.234071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199438+0000","last_change":"2024-09-10T17:52:39.635594+0000","last_active":"2024-09-10T17:53:50.199438+0000","last_peered":"2024-09-10T17:53:50.199438+0000","last_clean":"2024-09-10T17:53:50.199438+0000","last_became_active":"2024-09-10T17:52:39.635320+0000","last_became_peered":"2024-09-10T17:52:39.635320+0000","last_unstale":"2024-09-10T17:53:50.199438+0000","last_undegraded":"2024-09-10T17:53:50.199438+0000","last_fullsized":"2024-09-10T17:53:50.199438+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.728595+0000","last_change":"2024-09-10T17:53:50.197168+0000","last_active":"2024-09-10T17:53:56.728595+0000","last_peered":"2024-09-10T17:53:56.728595+0000","last_clean":"2024-09-10T17:53:56.728595+0000","last_became_active":"2024-09-10T17:53:46.005109+0000","last_became_peered":"2024-09-10T17:53:46.005109+0000","last_unstale":"2024-09-10T17:53:56.728595+0000","last_undegraded":"2024-09-10T17:53:56.728595+0000","last_fullsized":"2024-09-10T17:53:56.728595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:08.888245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061699300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"65'2","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.302613+0000","last_change":"2024-09-10T17:52:36.194453+0000","last_active":"2024-09-10T17:53:57.302613+0000","last_peered":"2024-09-10T17:53:57.302613+0000","last_clean":"2024-09-10T17:53:57.302613+0000","last_became_active":"2024-09-10T17:52:36.194107+0000","last_became_peered":"2024-09-10T17:52:36.194107+0000","last_unstale":"2024-09-10T17:53:57.302613+0000","last_undegraded":"2024-09-10T17:53:57.302613+0000","last_fullsized":"2024-09-10T17:53:57.302613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.730068+0000","last_change":"2024-09-10T17:52:39.631701+0000","last_active":"2024-09-10T17:53:56.730068+0000","last_peered":"2024-09-10T17:53:56.730068+0000","last_clean":"2024-09-10T17:53:56.730068+0000","last_became_active":"2024-09-10T17:52:39.631299+0000","last_became_peered":"2024-09-10T17:52:39.631299+0000","last_unstale":"2024-09-10T17:53:56.730068+0000","last_undegraded":"2024-09-10T17:53:56.730068+0000","last_fullsized":"2024-09-10T17:53:56.730068+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.155537+0000","last_change":"2024-09-10T17:52:36.200196+0000","last_active":"2024-09-10T17:53:57.155537+0000","last_peered":"2024-09-10T17:53:57.155537+0000","last_clean":"2024-09-10T17:53:57.155537+0000","last_became_active":"2024-09-10T17:52:36.199847+0000","last_became_peered":"2024-09-10T17:52:36.199847+0000","last_unstale":"2024-09-10T17:53:57.155537+0000","last_undegraded":"2024-09-10T17:53:57.155537+0000","last_fullsized":"2024-09-10T17:53:57.155537+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.196862+0000","last_change":"2024-09-10T17:52:39.643274+0000","last_active":"2024-09-10T17:53:50.196862+0000","last_peered":"2024-09-10T17:53:50.196862+0000","last_clean":"2024-09-10T17:53:50.196862+0000","last_became_active":"2024-09-10T17:52:39.643016+0000","last_became_peered":"2024-09-10T17:52:39.643016+0000","last_unstale":"2024-09-10T17:53:50.196862+0000","last_undegraded":"2024-09-10T17:53:50.196862+0000","last_fullsized":"2024-09-10T17:53:50.196862+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.232222+0000","last_change":"2024-09-10T17:52:36.195088+0000","last_active":"2024-09-10T17:53:57.232222+0000","last_peered":"2024-09-10T17:53:57.232222+0000","last_clean":"2024-09-10T17:53:57.232222+0000","last_became_active":"2024-09-10T17:52:36.194698+0000","last_became_peered":"2024-09-10T17:52:36.194698+0000","last_unstale":"2024-09-10T17:53:57.232222+0000","last_undegraded":"2024-09-10T17:53:57.232222+0000","last_fullsized":"2024-09-10T17:53:57.232222+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.198865+0000","last_change":"2024-09-10T17:52:39.643179+0000","last_active":"2024-09-10T17:53:50.198865+0000","last_peered":"2024-09-10T17:53:50.198865+0000","last_clean":"2024-09-10T17:53:50.198865+0000","last_became_active":"2024-09-10T17:52:39.642643+0000","last_became_peered":"2024-09-10T17:52:39.642643+0000","last_unstale":"2024-09-10T17:53:50.198865+0000","last_undegraded":"2024-09-10T17:53:50.198865+0000","last_fullsized":"2024-09-10T17:53:50.198865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:57.234541+0000","last_change":"2024-09-10T17:52:36.188755+0000","last_active":"2024-09-10T17:53:57.234541+0000","last_peered":"2024-09-10T17:53:57.234541+0000","last_clean":"2024-09-10T17:53:57.234541+0000","last_became_active":"2024-09-10T17:52:36.188465+0000","last_became_peered":"2024-09-10T17:52:36.188465+0000","last_unstale":"2024-09-10T17:53:57.234541+0000","last_undegraded":"2024-09-10T17:53:57.234541+0000","last_fullsized":"2024-09-10T17:53:57.234541+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.199262+0000","last_change":"2024-09-10T17:52:39.635509+0000","last_active":"2024-09-10T17:53:50.199262+0000","last_peered":"2024-09-10T17:53:50.199262+0000","last_clean":"2024-09-10T17:53:50.199262+0000","last_became_active":"2024-09-10T17:52:39.635118+0000","last_became_peered":"2024-09-10T17:52:39.635118+0000","last_unstale":"2024-09-10T17:53:50.199262+0000","last_undegraded":"2024-09-10T17:53:50.199262+0000","last_fullsized":"2024-09-10T17:53:50.199262+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302248+0000","last_change":"2024-09-10T17:52:36.200921+0000","last_active":"2024-09-10T17:53:50.302248+0000","last_peered":"2024-09-10T17:53:50.302248+0000","last_clean":"2024-09-10T17:53:50.302248+0000","last_became_active":"2024-09-10T17:52:36.200153+0000","last_became_peered":"2024-09-10T17:52:36.200153+0000","last_unstale":"2024-09-10T17:53:50.302248+0000","last_undegraded":"2024-09-10T17:53:50.302248+0000","last_fullsized":"2024-09-10T17:53:50.302248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.301251+0000","last_change":"2024-09-10T17:52:39.643628+0000","last_active":"2024-09-10T17:53:50.301251+0000","last_peered":"2024-09-10T17:53:50.301251+0000","last_clean":"2024-09-10T17:53:50.301251+0000","last_became_active":"2024-09-10T17:52:39.643355+0000","last_became_peered":"2024-09-10T17:52:39.643355+0000","last_unstale":"2024-09-10T17:53:50.301251+0000","last_undegraded":"2024-09-10T17:53:50.301251+0000","last_fullsized":"2024-09-10T17:53:50.301251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203760+0000","last_change":"2024-09-10T17:52:39.652448+0000","last_active":"2024-09-10T17:53:50.203760+0000","last_peered":"2024-09-10T17:53:50.203760+0000","last_clean":"2024-09-10T17:53:50.203760+0000","last_became_active":"2024-09-10T17:52:39.652164+0000","last_became_peered":"2024-09-10T17:52:39.652164+0000","last_unstale":"2024-09-10T17:53:50.203760+0000","last_undegraded":"2024-09-10T17:53:50.203760+0000","last_fullsized":"2024-09-10T17:53:50.203760+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302454+0000","last_change":"2024-09-10T17:52:36.200230+0000","last_active":"2024-09-10T17:53:50.302454+0000","last_peered":"2024-09-10T17:53:50.302454+0000","last_clean":"2024-09-10T17:53:50.302454+0000","last_became_active":"2024-09-10T17:52:36.199765+0000","last_became_peered":"2024-09-10T17:52:36.199765+0000","last_unstale":"2024-09-10T17:53:50.302454+0000","last_undegraded":"2024-09-10T17:53:50.302454+0000","last_fullsized":"2024-09-10T17:53:50.302454+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.203580+0000","last_change":"2024-09-10T17:52:39.652608+0000","last_active":"2024-09-10T17:53:50.203580+0000","last_peered":"2024-09-10T17:53:50.203580+0000","last_clean":"2024-09-10T17:53:50.203580+0000","last_became_active":"2024-09-10T17:52:39.652354+0000","last_became_peered":"2024-09-10T17:52:39.652354+0000","last_unstale":"2024-09-10T17:53:50.203580+0000","last_undegraded":"2024-09-10T17:53:50.203580+0000","last_fullsized":"2024-09-10T17:53:50.203580+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"65'2","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-10T17:53:50.302171+0000","last_change":"2024-09-10T17:52:36.200731+0000","last_active":"2024-09-10T17:53:50.302171+0000","last_peered":"2024-09-10T17:53:50.302171+0000","last_clean":"2024-09-10T17:53:50.302171+0000","last_became_active":"2024-09-10T17:52:36.200429+0000","last_became_peered":"2024-09-10T17:52:36.200429+0000","last_unstale":"2024-09-10T17:53:50.302171+0000","last_undegraded":"2024-09-10T17:53:50.302171+0000","last_fullsized":"2024-09-10T17:53:50.302171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.730167+0000","last_change":"2024-09-10T17:52:39.640232+0000","last_active":"2024-09-10T17:53:56.730167+0000","last_peered":"2024-09-10T17:53:56.730167+0000","last_clean":"2024-09-10T17:53:56.730167+0000","last_became_active":"2024-09-10T17:52:39.639462+0000","last_became_peered":"2024-09-10T17:52:39.639462+0000","last_unstale":"2024-09-10T17:53:56.730167+0000","last_undegraded":"2024-09-10T17:53:56.730167+0000","last_fullsized":"2024-09-10T17:53:56.730167+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"65'1","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729836+0000","last_change":"2024-09-10T17:52:36.190257+0000","last_active":"2024-09-10T17:53:56.729836+0000","last_peered":"2024-09-10T17:53:56.729836+0000","last_clean":"2024-09-10T17:53:56.729836+0000","last_became_active":"2024-09-10T17:52:36.189957+0000","last_became_peered":"2024-09-10T17:52:36.189957+0000","last_unstale":"2024-09-10T17:53:56.729836+0000","last_undegraded":"2024-09-10T17:53:56.729836+0000","last_fullsized":"2024-09-10T17:53:56.729836+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.729692+0000","last_change":"2024-09-10T17:52:39.636289+0000","last_active":"2024-09-10T17:53:56.729692+0000","last_peered":"2024-09-10T17:53:56.729692+0000","last_clean":"2024-09-10T17:53:56.729692+0000","last_became_active":"2024-09-10T17:52:39.635894+0000","last_became_peered":"2024-09-10T17:52:39.635894+0000","last_unstale":"2024-09-10T17:53:56.729692+0000","last_undegraded":"2024-09-10T17:53:56.729692+0000","last_fullsized":"2024-09-10T17:53:56.729692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"65'4","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T17:53:56.730385+0000","last_change":"2024-09-10T17:52:36.194542+0000","last_active":"2024-09-10T17:53:56.730385+0000","last_peered":"2024-09-10T17:53:56.730385+0000","last_clean":"2024-09-10T17:53:56.730385+0000","last_became_active":"2024-09-10T17:52:36.194232+0000","last_became_peered":"2024-09-10T17:52:36.194232+0000","last_unstale":"2024-09-10T17:53:56.730385+0000","last_undegraded":"2024-09-10T17:53:56.730385+0000","last_fullsized":"2024-09-10T17:53:56.730385+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3146,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234017,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28368,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716784,"statfs":{"total":95995035648,"available":95965986816,"internally_reserved":0,"allocated":1380352,"data_stored":939890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.41899999999999998}]},{"osd":2,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.378},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74199999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.36699999999999999}]},{"osd":3,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.43099999999999999}]},{"osd":4,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.436,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.433,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.32900000000000001}]},{"osd":5,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.746},"last":0.31},{"interface":"front","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.29999999999999999}]},{"osd":6,"last update":"Tue Sep 10 17:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65800000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.28199999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712688,"statfs":{"total":95995035648,"available":95961792512,"internally_reserved":0,"allocated":1380352,"data_stored":941361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.503,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61799999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.67400000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35499999999999998}]},{"osd":1,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.497,"15min":0.497},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.372},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65400000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.34799999999999998}]},{"osd":2,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51500000000000001,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63600000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.317},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65600000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.39000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68799999999999994,"5min":0.877,"15min":0.877},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.42299999999999999},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.27300000000000002}]},{"osd":5,"last update":"Tue Sep 10 17:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.314,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60499999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33200000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.307}]},{"osd":7,"last update":"Tue Sep 10 17:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.441},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.54600000000000004,"15min":0.56200000000000006},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68799999999999994,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41499999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31884,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713268,"statfs":{"total":95995035648,"available":95962386432,"internally_reserved":0,"allocated":790528,"data_stored":350821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44900000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.499},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67200000000000004,"5min":0.747,"15min":0.747},"last":0.38800000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.372},{"interface":"front","average":{"1min":0.495,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68500000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53000000000000003}]},{"osd":4,"last update":"Tue Sep 10 17:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59199999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.34999999999999998},"min":{"1min":0.25800000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.68999999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46899999999999997}]},{"osd":6,"last update":"Tue Sep 10 17:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.628,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.29299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Sep 10 17:54:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.54400000000000004,"15min":0.56299999999999994},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67000000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63600000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57799999999999996}]}]},{"osd":4,"up_from":30,"seq":128849018927,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":802816,"data_stored":349976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.379,"5min":0.255,"15min":0.255},"max":{"1min":0.64000000000000001,"5min":0.873,"15min":0.873},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72099999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54000000000000004}]},{"osd":1,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78300000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61299999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66200000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55000000000000004,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68899999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57399999999999995}]},{"osd":3,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60699999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56399999999999995}]},{"osd":5,"last update":"Tue Sep 10 17:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.38600000000000001},"min":{"1min":0.24399999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.61199999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38800000000000001,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57199999999999995,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Tue Sep 10 17:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.443},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.45600000000000002,"15min":0.45000000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Tue Sep 10 17:54:10 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.50900000000000001,"15min":0.52000000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68500000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47699999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":802816,"data_stored":351701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.45900000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.439},{"interface":"front","average":{"1min":0.373,"5min":0.41999999999999998,"15min":0.441},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.26200000000000001}]},{"osd":1,"last update":"Tue Sep 10 17:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58399999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.374},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.44,"15min":0.442},"min":{"1min":0.28899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.56100000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Tue Sep 10 17:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.313,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59999999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.30299999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59399999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Sep 10 17:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.746,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Tue Sep 10 17:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68600000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.625}]},{"osd":6,"last update":"Tue Sep 10 17:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Sep 10 17:54:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.54900000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717372,"statfs":{"total":95995035648,"available":95966588928,"internally_reserved":0,"allocated":778240,"data_stored":348976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.36199999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.249},{"interface":"front","average":{"1min":0.379,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60899999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Tue Sep 10 17:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.372},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.40100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Sep 10 17:54:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.307,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70299999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.44600000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.38300000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Tue Sep 10 17:54:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.46800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66300000000000003}]},{"osd":6,"last update":"Tue Sep 10 17:53:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53500000000000003}]},{"osd":7,"last update":"Tue Sep 10 17:54:12 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44,"5min":0.379,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85299999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.629}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":786432,"data_stored":348882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 17:53:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.377,"15min":0.35499999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.42499999999999999,"15min":0.373},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Sep 10 17:54:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.439,"15min":0.40899999999999997},"min":{"1min":0.25,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":4.633,"5min":4.633,"15min":4.633},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.46899999999999997,"15min":0.44},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.9950000000000001,"5min":3.9950000000000001,"15min":3.9950000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Sep 10 17:53:45 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.45000000000000001,"15min":0.46000000000000002},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.77600000000000002,"15min":0.623},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":5.4050000000000002,"5min":15.68,"15min":15.68},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Sep 10 17:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.63900000000000001,"15min":0.60699999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.3330000000000002,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.61199999999999999}]},{"osd":6,"last update":"Tue Sep 10 17:53:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.66400000000000003,"15min":0.67800000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Tue Sep 10 17:54:10 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.438,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":5.3760000000000003,"5min":5.3760000000000003,"15min":5.3760000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.78200000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32476,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712676,"statfs":{"total":95995035648,"available":95961780224,"internally_reserved":0,"allocated":1392640,"data_stored":940345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 17:53:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53200000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.27700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57599999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.28499999999999998}]},{"osd":2,"last update":"Tue Sep 10 17:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.375,"15min":0.379},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.312},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.30299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.41999999999999998}]},{"osd":3,"last update":"Tue Sep 10 17:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45800000000000002,"15min":0.47999999999999998},"min":{"1min":0.33900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58299999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40999999999999998,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Sep 10 17:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69499999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66800000000000004,"15min":0.61899999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84899999999999998,"5min":7.8869999999999996,"15min":7.8869999999999996},"last":0.54600000000000004}]},{"osd":5,"last update":"Tue Sep 10 17:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.86799999999999999,"5min":1.034,"15min":1.034},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.82699999999999996,"15min":0.94199999999999995},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71799999999999997,"5min":7.907,"15min":7.907},"last":0.40200000000000002}]},{"osd":6,"last update":"Tue Sep 10 17:53:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91400000000000003,"5min":1.093,"15min":1.093},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.86799999999999999,"15min":0.91800000000000004},"min":{"1min":0.38900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79300000000000004,"5min":7.9450000000000003,"15min":7.9450000000000003},"last":0.49299999999999999}]},{"osd":7,"last update":"Tue Sep 10 17:54:10 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T17:54:53.954 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T17:54:53.954 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T17:54:53.955 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T17:54:53.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T17:54:54.226 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:54:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:54:53] "GET /metrics HTTP/1.1" 200 33651 "" "Prometheus/2.43.0" 2024-09-10T17:54:54.235 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:54.534 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[69825]: ts=2024-09-10T17:54:54.226Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-10T17:54:54.534 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:54 smithi012 podman[74192]: 2024-09-10 17:54:54.246713762 +0000 UTC m=+0.118771931 container died 665ab87989af0577ae6c50b4ffac3cd31590debf6ca6af0667d9627bf39d0240 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:54.869 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:54 smithi012 ceph-mon[27356]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:54.869 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:54 smithi012 podman[74192]: 2024-09-10 17:54:54.725921941 +0000 UTC m=+0.597980112 container cleanup 665ab87989af0577ae6c50b4ffac3cd31590debf6ca6af0667d9627bf39d0240 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:54.869 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:54 smithi012 bash[74192]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a 2024-09-10T17:54:54.870 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:54 smithi012 ceph-mon[37454]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:55.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:54 smithi089 ceph-mon[31467]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:56.166 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:56 smithi012 podman[74237]: 2024-09-10 17:54:56.000579838 +0000 UTC m=+1.748175283 container remove 665ab87989af0577ae6c50b4ffac3cd31590debf6ca6af0667d9627bf39d0240 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:56.167 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:56 smithi012 podman[74237]: 2024-09-10 17:54:56.059610036 +0000 UTC m=+1.807205402 volume remove 6525519ad7d55713f1178fd814d3b8e954ab09c08d6dcf97e38af7cc33a2a17a 2024-09-10T17:54:56.749 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:56 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-10T17:54:56.750 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:56 smithi012 systemd[1]: Stopped Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:54:56.750 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:56 smithi012 systemd[1]: Starting Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:54:56.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:54:56.776 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T17:54:57.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:56 smithi012 ceph-mon[27356]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:57.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:56 smithi012 ceph-mon[37454]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:57.034 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:56 smithi012 podman[74401]: 2024-09-10 17:54:56.739928171 +0000 UTC m=+0.017185161 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-09-10T17:54:57.034 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:56 smithi012 podman[74401]: 2024-09-10 17:54:56.855832221 +0000 UTC m=+0.133089193 volume create a3d7d561d605e3f20d11e7b1fc75c7338c0394473450c54ece407eda5890b0f9 2024-09-10T17:54:57.034 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:56 smithi012 podman[74401]: 2024-09-10 17:54:56.947774549 +0000 UTC m=+0.225031521 container create 24404959babd19984f0525fb8bbe3b5faedc4900f8116f1b49e719bd8b5bed68 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:57.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:56 smithi089 ceph-mon[31467]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:57.284 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 podman[74401]: 2024-09-10 17:54:57.267615706 +0000 UTC m=+0.544872678 container init 24404959babd19984f0525fb8bbe3b5faedc4900f8116f1b49e719bd8b5bed68 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:57.284 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 podman[74401]: 2024-09-10 17:54:57.270510196 +0000 UTC m=+0.547767169 container start 24404959babd19984f0525fb8bbe3b5faedc4900f8116f1b49e719bd8b5bed68 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T17:54:57.284 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:57.283Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-10T17:54:57.739 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:57.283Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-10T17:54:57.739 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:57.284Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.12 port=9094 2024-09-10T17:54:57.739 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:57.285Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-10T17:54:57.739 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:57.309Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-10T17:54:57.739 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:57.309Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-10T17:54:57.739 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:57.313Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-10T17:54:57.739 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:57.313Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-10T17:54:57.739 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 bash[74401]: 24404959babd19984f0525fb8bbe3b5faedc4900f8116f1b49e719bd8b5bed68 2024-09-10T17:54:57.740 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:57 smithi012 systemd[1]: Started Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:54:58.004 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:57 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1876627756' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T17:54:58.004 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:57 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:58.004 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:57 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:58.005 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:57 smithi089 ceph-mon[31467]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:54:58.005 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:57 smithi089 ceph-mon[31467]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:54:58.005 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:57 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1876627756' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T17:54:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[27356]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:54:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[27356]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:54:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1876627756' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T17:54:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:54:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[37454]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:54:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[37454]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:54:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:57 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:54:58.085 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T17:54:58.086 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T17:54:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:54:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:54:58 smithi012 ceph-mon[27356]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:59.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:54:58 smithi012 ceph-mon[37454]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:59.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:54:58 smithi089 ceph-mon[31467]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:54:59.672 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:54:59 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:54:59.285Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000301308s 2024-09-10T17:55:00.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:55:00.189 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/705014602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":705014602},{"type":"v1","addr":"172.21.15.12:6835","nonce":705014602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T17:52:41.361507+0000","modified":"2024-09-10T17:52:53.075075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24340":{"gid":24340,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.89:6833/3197689939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3197689939},{"type":"v1","addr":"172.21.15.89:6833","nonce":3197689939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-10T17:55:00.190 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T17:55:00.493 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3842878038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:00.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:00 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3842878038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:00.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:00 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3842878038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:00.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 systemd[1]: Stopping Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:55:00.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T17:55:01.140 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:55:01.190 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.880Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.881Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.881Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-10T17:55:01.191 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[58912]: ts=2024-09-10T17:55:00.881Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-10T17:55:01.192 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:00 smithi089 podman[61989]: 2024-09-10 17:55:00.890612125 +0000 UTC m=+0.099275067 container died 7f717fea126ec459f90f34b7768a8701ef4fc9a2a571ecbe65ee5415bd02b052 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:55:01.523 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:01 smithi089 ceph-mon[31467]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:01.524 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:01 smithi089 podman[61989]: 2024-09-10 17:55:01.305251789 +0000 UTC m=+0.513914733 container cleanup 7f717fea126ec459f90f34b7768a8701ef4fc9a2a571ecbe65ee5415bd02b052 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:55:01.524 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:01 smithi089 bash[61989]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a 2024-09-10T17:55:01.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:01 smithi012 ceph-mon[27356]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:01.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:01 smithi012 ceph-mon[37454]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:01.780 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:01 smithi089 podman[62002]: 2024-09-10 17:55:01.523152381 +0000 UTC m=+0.634860374 container remove 7f717fea126ec459f90f34b7768a8701ef4fc9a2a571ecbe65ee5415bd02b052 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:55:02.033 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:01 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-10T17:55:02.033 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:01 smithi089 systemd[1]: Stopped Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:55:02.033 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:01 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service: Consumed 1.084s CPU time. 2024-09-10T17:55:02.033 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:01 smithi089 systemd[1]: Starting Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:55:02.033 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:01 smithi089 podman[62095]: 2024-09-10 17:55:01.893944664 +0000 UTC m=+0.016723831 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-10T17:55:02.033 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 podman[62095]: 2024-09-10 17:55:02.032660835 +0000 UTC m=+0.155440002 container create 9c8fe13e4a8edaffbab8b908175662560d767049564ca487198d4854c4840bfc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:55:02.286 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 podman[62095]: 2024-09-10 17:55:02.234641799 +0000 UTC m=+0.357420966 container init 9c8fe13e4a8edaffbab8b908175662560d767049564ca487198d4854c4840bfc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:55:02.286 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 podman[62095]: 2024-09-10 17:55:02.237213172 +0000 UTC m=+0.359992340 container start 9c8fe13e4a8edaffbab8b908175662560d767049564ca487198d4854c4840bfc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:55:02.286 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.260Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.260Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.260Z caller=main.go:570 level=info host_details="(Linux 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 x86_64 smithi089 (none))" 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.260Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.260Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.261Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.262Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.263Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.263Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.264Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.264Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.626µs 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.264Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.267Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-10T17:55:02.287 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.267Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-10T17:55:02.288 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.267Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=26.858µs wal_replay_duration=2.326984ms wbl_replay_duration=110ns total_replay_duration=2.37149ms 2024-09-10T17:55:02.288 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.268Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-10T17:55:02.288 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.268Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-10T17:55:02.288 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.268Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-10T17:55:02.656 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:02] ENGINE Bus STOPPING 2024-09-10T17:55:02.656 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:02] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:55:02.656 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:02] ENGINE Bus STOPPED 2024-09-10T17:55:02.656 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:02] ENGINE Bus STARTING 2024-09-10T17:55:02.656 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:02] ENGINE Serving on http://:::9283 2024-09-10T17:55:02.656 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:02] ENGINE Bus STARTED 2024-09-10T17:55:02.656 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:02] ENGINE Bus STOPPING 2024-09-10T17:55:02.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.289Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.007803ms db_storage=798ns remote_storage=1.445µs web_handler=401ns query_engine=593ns scrape=398.334µs scrape_sd=78.761µs notify=17.061µs notify_sd=9.027µs rules=20.204014ms tracing=7.438µs 2024-09-10T17:55:02.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.289Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-10T17:55:02.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:55:02.289Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-10T17:55:02.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 bash[62095]: 9c8fe13e4a8edaffbab8b908175662560d767049564ca487198d4854c4840bfc 2024-09-10T17:55:02.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:55:02 smithi089 systemd[1]: Started Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:55:02.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:55:02.883 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/705014602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":705014602},{"type":"v1","addr":"172.21.15.12:6835","nonce":705014602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T17:52:41.361507+0000","modified":"2024-09-10T17:52:53.075075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24340":{"gid":24340,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.89:6833/3197689939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3197689939},{"type":"v1","addr":"172.21.15.89:6833","nonce":3197689939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-10T17:55:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T17:55:03.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:55:03.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Bus STOPPED 2024-09-10T17:55:03.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Bus STARTING 2024-09-10T17:55:03.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Serving on http://:::9283 2024-09-10T17:55:03.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Bus STARTED 2024-09-10T17:55:03.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Bus STOPPING 2024-09-10T17:55:03.621 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.621 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.621 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T17:55:03.621 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T17:55:03.621 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi012.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi012.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T17:55:03.622 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2745043481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi012.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi012.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T17:55:03.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:03.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2745043481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi012.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi012.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:55:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:03.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:03 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2745043481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:03.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T17:55:03.955 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:55:03.955 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Bus STOPPED 2024-09-10T17:55:03.955 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Bus STARTING 2024-09-10T17:55:03.955 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Serving on http://:::9283 2024-09-10T17:55:03.955 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:03] ENGINE Bus STARTED 2024-09-10T17:55:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:55:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:04 smithi012 ceph-mon[27356]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:04 smithi012 ceph-mon[37454]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:04 smithi089 ceph-mon[31467]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:06.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:55:06.153 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":75,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T17:53:56.725090+0000","last_up_change":"2024-09-10T17:52:08.800071+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T17:52:35.123712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T17:52:38.563420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-09-10T17:53:44.896711+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":74,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6803","nonce":2400757557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6805","nonce":2400757557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6809","nonce":2400757557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2400757557},{"type":"v1","addr":"172.21.15.12:6807","nonce":2400757557}]},"public_addr":"172.21.15.12:6803/2400757557","cluster_addr":"172.21.15.12:6805/2400757557","heartbeat_back_addr":"172.21.15.12:6809/2400757557","heartbeat_front_addr":"172.21.15.12:6807/2400757557","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6811","nonce":284928520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6813","nonce":284928520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6817","nonce":284928520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":284928520},{"type":"v1","addr":"172.21.15.12:6815","nonce":284928520}]},"public_addr":"172.21.15.12:6811/284928520","cluster_addr":"172.21.15.12:6813/284928520","heartbeat_back_addr":"172.21.15.12:6817/284928520","heartbeat_front_addr":"172.21.15.12:6815/284928520","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6819","nonce":2631347892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6821","nonce":2631347892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6825","nonce":2631347892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2631347892},{"type":"v1","addr":"172.21.15.12:6823","nonce":2631347892}]},"public_addr":"172.21.15.12:6819/2631347892","cluster_addr":"172.21.15.12:6821/2631347892","heartbeat_back_addr":"172.21.15.12:6825/2631347892","heartbeat_front_addr":"172.21.15.12:6823/2631347892","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6827","nonce":3917191557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6829","nonce":3917191557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6833","nonce":3917191557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3917191557},{"type":"v1","addr":"172.21.15.12:6831","nonce":3917191557}]},"public_addr":"172.21.15.12:6827/3917191557","cluster_addr":"172.21.15.12:6829/3917191557","heartbeat_back_addr":"172.21.15.12:6833/3917191557","heartbeat_front_addr":"172.21.15.12:6831/3917191557","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6801","nonce":4063563708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6803","nonce":4063563708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6807","nonce":4063563708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4063563708},{"type":"v1","addr":"172.21.15.89:6805","nonce":4063563708}]},"public_addr":"172.21.15.89:6801/4063563708","cluster_addr":"172.21.15.89:6803/4063563708","heartbeat_back_addr":"172.21.15.89:6807/4063563708","heartbeat_front_addr":"172.21.15.89:6805/4063563708","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6809","nonce":4007259364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6811","nonce":4007259364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6815","nonce":4007259364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4007259364},{"type":"v1","addr":"172.21.15.89:6813","nonce":4007259364}]},"public_addr":"172.21.15.89:6809/4007259364","cluster_addr":"172.21.15.89:6811/4007259364","heartbeat_back_addr":"172.21.15.89:6815/4007259364","heartbeat_front_addr":"172.21.15.89:6813/4007259364","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6817","nonce":1083920992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6819","nonce":1083920992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6823","nonce":1083920992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1083920992},{"type":"v1","addr":"172.21.15.89:6821","nonce":1083920992}]},"public_addr":"172.21.15.89:6817/1083920992","cluster_addr":"172.21.15.89:6819/1083920992","heartbeat_back_addr":"172.21.15.89:6823/1083920992","heartbeat_front_addr":"172.21.15.89:6821/1083920992","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6825","nonce":945164195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6827","nonce":945164195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6831","nonce":945164195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":945164195},{"type":"v1","addr":"172.21.15.89:6829","nonce":945164195}]},"public_addr":"172.21.15.89:6825/945164195","cluster_addr":"172.21.15.89:6827/945164195","heartbeat_back_addr":"172.21.15.89:6831/945164195","heartbeat_front_addr":"172.21.15.89:6829/945164195","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3881499084":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6801/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6800/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/2177785153":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/4040448008":"2024-09-11T17:53:42.652060+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/135454569":"2024-09-11T17:53:42.652060+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T17:55:07.124 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:06 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:07.124 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:06 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:07.124 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:06 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1154161535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:55:07.124 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:06 smithi012 ceph-mon[27356]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:07.125 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:06 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:07.125 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:06 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:07.125 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:06 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1154161535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:55:07.125 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:06 smithi012 ceph-mon[37454]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:06 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:06 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:06 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1154161535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T17:55:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:06 smithi089 ceph-mon[31467]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:07.500 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 17:55:07 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T17:55:07.288Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003118486s 2024-09-10T17:55:07.528 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T17:55:08.387 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:55:09.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:55:09.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:55:09.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[27356]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:09.628 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.629 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.629 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:55:09.629 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:55:09.629 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.629 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:09 smithi012 ceph-mon[37454]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:09.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:09 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:09 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:09 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:55:09.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:09 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:55:09.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:09 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:09.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:09 smithi089 ceph-mon[31467]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T17:55:10.348 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/705014602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":705014602},{"type":"v1","addr":"172.21.15.12:6835","nonce":705014602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T17:52:41.361507+0000","modified":"2024-09-10T17:52:53.075075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24340":{"gid":24340,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.89:6833/3197689939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3197689939},{"type":"v1","addr":"172.21.15.89:6833","nonce":3197689939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-10T17:55:10.348 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T17:55:10.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:10 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3842955192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:10.644 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:10 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3842955192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:10.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:10 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3842955192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T17:55:11.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T17:52:41.361507+0000', 'modified': '2024-09-10T17:52:53.075075+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24340}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24340': {'gid': 24340, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.89:6833/3197689939', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6832', 'nonce': 3197689939}, {'type': 'v1', 'addr': '172.21.15.89:6833', 'nonce': 3197689939}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-10T17:55:11.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T17:55:11.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T17:55:11.251 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:55:11.688 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:11 smithi012 ceph-mon[27356]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:11.689 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:11 smithi012 ceph-mon[37454]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:11.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:11 smithi089 ceph-mon[31467]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T17:55:12.889+0000 7fe0d77fe640 0 client.24692 ms_handle_reset on v2:172.21.15.89:6832/3197689939 2024-09-10T17:55:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T17:55:12.908+0000 7fe0d77fe640 0 client.14796 ms_handle_reset on v2:172.21.15.89:6832/3197689939 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "9996668a-6f9c-11ef-bcea-c7b262605968", 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24340, 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 151.545035004, 2024-09-10T17:55:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 7, 2024-09-10T17:55:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 75, 2024-09-10T17:55:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 65, 2024-09-10T17:55:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 165.878918223 2024-09-10T17:55:12.911 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:55:12.919 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:12 smithi012 ceph-mon[27356]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:12.919 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:12 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:12.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:12 smithi012 ceph-mon[37454]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:12.920 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:12 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:12 smithi089 ceph-mon[31467]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:12 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:13.439 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T17:55:13.439 INFO:teuthology.run_tasks:Running task print... 2024-09-10T17:55:13.448 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-09-10T17:55:13.448 INFO:teuthology.run_tasks:Running task print... 2024-09-10T17:55:13.479 INFO:teuthology.task.print:**** done start cephadm.shell ceph config set mgr... 2024-09-10T17:55:13.480 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T17:55:13.523 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T17:55:13.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-10T17:55:13.732 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:55:14.178 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:55:13] "GET /metrics HTTP/1.1" 200 33652 "" "Prometheus/2.43.0" 2024-09-10T17:55:15.027 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:14 smithi012 ceph-mon[27356]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:15.027 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:14 smithi012 ceph-mon[27356]: mgrmap e22: y(active, since 92s), standbys: x 2024-09-10T17:55:15.028 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:14 smithi012 ceph-mon[37454]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:15.028 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:14 smithi012 ceph-mon[37454]: mgrmap e22: y(active, since 92s), standbys: x 2024-09-10T17:55:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:14 smithi089 ceph-mon[31467]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:14 smithi089 ceph-mon[31467]: mgrmap e22: y(active, since 92s), standbys: x 2024-09-10T17:55:15.783 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:15] ENGINE Bus STOPPING 2024-09-10T17:55:16.117 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:15] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:55:16.117 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:15] ENGINE Bus STOPPED 2024-09-10T17:55:16.117 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:15] ENGINE Bus STARTING 2024-09-10T17:55:16.117 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:16 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:16] ENGINE Serving on http://:::9283 2024-09-10T17:55:16.117 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:16 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:55:16] ENGINE Bus STARTED 2024-09-10T17:55:16.118 INFO:teuthology.run_tasks:Running task print... 2024-09-10T17:55:16.127 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-10T17:55:16.127 INFO:teuthology.run_tasks:Running task print... 2024-09-10T17:55:16.172 INFO:teuthology.task.print:**** done start telemetry reef... 2024-09-10T17:55:16.172 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T17:55:16.220 INFO:tasks.workunit:Pulling workunits from ref bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:55:16.221 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T17:55:16.221 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T17:55:16.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T17:55:16.239 INFO:teuthology.orchestra.run.smithi012.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-10T17:55:16.239 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T17:55:16.295 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-10T17:55:16.296 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-10T17:55:16.352 INFO:tasks.workunit:timeout=3h 2024-09-10T17:55:16.352 INFO:tasks.workunit:cleanup=True 2024-09-10T17:55:16.352 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:55:16.408 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T17:55:16.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:16 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1904475232' entity='client.admin' 2024-09-10T17:55:16.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:55:16.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:16 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1904475232' entity='client.admin' 2024-09-10T17:55:16.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:55:16.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:16 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1904475232' entity='client.admin' 2024-09-10T17:55:16.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:55:17.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:17 smithi012 ceph-mon[27356]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:17.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:17 smithi012 ceph-mon[37454]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:17.885 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:17 smithi089 ceph-mon[31467]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[27356]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:20.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:55:20.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:55:20.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[37454]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:20.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:55:20.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:55:20.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:19 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:19 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:19 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:19 smithi089 ceph-mon[31467]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:20.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:19 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:19 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:20.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:19 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:55:20.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:19 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:55:20.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:19 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:55:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:20 smithi012 ceph-mon[27356]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:21.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:20 smithi012 ceph-mon[37454]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:20 smithi089 ceph-mon[31467]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:22 smithi012 ceph-mon[27356]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:23.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:22 smithi012 ceph-mon[37454]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:23.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:22 smithi089 ceph-mon[31467]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:24.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:55:23] "GET /metrics HTTP/1.1" 200 33652 "" "Prometheus/2.43.0" 2024-09-10T17:55:25.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:24 smithi012 ceph-mon[27356]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:24 smithi012 ceph-mon[37454]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:24 smithi089 ceph-mon[31467]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T17:55:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:26 smithi012 ceph-mon[27356]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:26 smithi012 ceph-mon[37454]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:27.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:26 smithi089 ceph-mon[31467]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:28.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:27 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:28.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:27 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:27 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:28 smithi012 ceph-mon[27356]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:28 smithi012 ceph-mon[37454]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:28 smithi089 ceph-mon[31467]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:31.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:30 smithi012 ceph-mon[27356]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:31.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:30 smithi012 ceph-mon[37454]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:31.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:30 smithi089 ceph-mon[31467]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:33.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:32 smithi012 ceph-mon[27356]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:32 smithi012 ceph-mon[37454]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:33.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:32 smithi089 ceph-mon[31467]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:34.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:55:33] "GET /metrics HTTP/1.1" 200 33651 "" "Prometheus/2.43.0" 2024-09-10T17:55:35.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:34 smithi012 ceph-mon[27356]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:35.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:34 smithi012 ceph-mon[37454]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:35.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:34 smithi089 ceph-mon[31467]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:37.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:36 smithi012 ceph-mon[27356]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:37.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:36 smithi012 ceph-mon[37454]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:37.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:36 smithi089 ceph-mon[31467]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:39.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:38 smithi012 ceph-mon[27356]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:39.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:38 smithi012 ceph-mon[37454]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:38 smithi089 ceph-mon[31467]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:41.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:40 smithi012 ceph-mon[27356]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:40 smithi012 ceph-mon[37454]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:41.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:40 smithi089 ceph-mon[31467]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:43.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:42 smithi012 ceph-mon[27356]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:42 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:43.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:42 smithi012 ceph-mon[37454]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:43.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:42 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:42 smithi089 ceph-mon[31467]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:42 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:55:43] "GET /metrics HTTP/1.1" 200 33648 "" "Prometheus/2.43.0" 2024-09-10T17:55:45.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:44 smithi012 ceph-mon[27356]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:45.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:44 smithi012 ceph-mon[37454]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:44 smithi089 ceph-mon[31467]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:47.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:46 smithi012 ceph-mon[27356]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:47.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:46 smithi012 ceph-mon[37454]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:47.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:46 smithi089 ceph-mon[31467]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:48 smithi012 ceph-mon[27356]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:48 smithi012 ceph-mon[37454]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:48 smithi089 ceph-mon[31467]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:50 smithi012 ceph-mon[27356]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:51.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:50 smithi012 ceph-mon[37454]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:51.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:50 smithi089 ceph-mon[31467]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:53.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:52 smithi012 ceph-mon[27356]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:52 smithi012 ceph-mon[37454]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:52 smithi089 ceph-mon[31467]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:54.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:55:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:55:53] "GET /metrics HTTP/1.1" 200 33648 "" "Prometheus/2.43.0" 2024-09-10T17:55:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:54 smithi012 ceph-mon[27356]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:54 smithi012 ceph-mon[37454]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:54 smithi089 ceph-mon[31467]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:56 smithi012 ceph-mon[27356]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:56 smithi012 ceph-mon[37454]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:57.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:56 smithi089 ceph-mon[31467]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:58.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:57 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:57 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:58.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:57 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:55:59.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:55:58 smithi012 ceph-mon[27356]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:59.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:55:58 smithi012 ceph-mon[37454]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:55:59.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:55:58 smithi089 ceph-mon[31467]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:00 smithi012 ceph-mon[27356]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:00 smithi012 ceph-mon[37454]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:00 smithi089 ceph-mon[31467]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:02 smithi012 ceph-mon[27356]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:02 smithi012 ceph-mon[37454]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:02 smithi089 ceph-mon[31467]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:04.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:56:03] "GET /metrics HTTP/1.1" 200 33660 "" "Prometheus/2.43.0" 2024-09-10T17:56:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:04 smithi012 ceph-mon[27356]: pgmap v81: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:04 smithi012 ceph-mon[37454]: pgmap v81: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:04 smithi089 ceph-mon[31467]: pgmap v81: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:06 smithi012 ceph-mon[27356]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:07.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:06 smithi012 ceph-mon[37454]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:07.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:06 smithi089 ceph-mon[31467]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:07.934 INFO:tasks.workunit.client.0.smithi012.stderr:Updating files: 95% (11576/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T17:56:09.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:08 smithi012 ceph-mon[27356]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:08 smithi012 ceph-mon[37454]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:08 smithi089 ceph-mon[31467]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'. 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2024-09-10T17:56:09.047 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:09.048 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2024-09-10T17:56:09.048 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:09.048 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2024-09-10T17:56:09.048 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:09.048 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T17:56:09.048 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:09.048 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at bad1f558c32 Merge branch 'wip-ifed-bluestore-tool-really-really' of https://github.com/ifed01/ceph into wip-bharath7-testing-2024-09-10-1409 2024-09-10T17:56:09.052 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T17:56:09.117 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T17:56:09.120 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T17:56:09.120 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T17:56:09.775 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T17:56:09.851 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T17:56:09.894 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T17:56:09.896 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T17:56:09.896 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T17:56:09.936 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T17:56:09.940 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T17:56:09.940 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T17:56:09.997 INFO:tasks.workunit:Running workunits matching test_telemetry_reef.sh on client.0... 2024-09-10T17:56:09.998 INFO:tasks.workunit:Running workunit test_telemetry_reef.sh... 2024-09-10T17:56:09.998 DEBUG:teuthology.orchestra.run.smithi012:workunit test test_telemetry_reef.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_reef.sh 2024-09-10T17:56:10.058 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph config set mgr mgr/telemetry/channel_ident true 2024-09-10T17:56:10.441 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph config set mgr mgr/telemetry/organization ceph-qa 2024-09-10T17:56:10.595 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:10 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:10] ENGINE Bus STOPPING 2024-09-10T17:56:10.595 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:10 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:10] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:56:10.595 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:10 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:10] ENGINE Bus STOPPED 2024-09-10T17:56:10.595 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:10 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:10] ENGINE Bus STARTING 2024-09-10T17:56:10.595 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:10 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:10] ENGINE Serving on http://:::9283 2024-09-10T17:56:10.595 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:10 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:10] ENGINE Bus STARTED 2024-09-10T17:56:10.849 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph config set mgr mgr/telemetry/description 'upgrade test cluster' 2024-09-10T17:56:11.033 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:10 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:10] ENGINE Bus STOPPING 2024-09-10T17:56:11.234 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph telemetry preview 2024-09-10T17:56:11.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:56:11.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Bus STOPPED 2024-09-10T17:56:11.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Bus STARTING 2024-09-10T17:56:11.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Serving on http://:::9283 2024-09-10T17:56:11.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Bus STARTED 2024-09-10T17:56:11.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Bus STOPPING 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/152621260' entity='client.admin' 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/4234170961' entity='client.admin' 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/152621260' entity='client.admin' 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:11.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/4234170961' entity='client.admin' 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:11.722 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2024-09-10T17:56:11.722 INFO:tasks.workunit.client.0.smithi012.stdout: "balancer": { 2024-09-10T17:56:11.722 INFO:tasks.workunit.client.0.smithi012.stdout: "active": true, 2024-09-10T17:56:11.722 INFO:tasks.workunit.client.0.smithi012.stdout: "mode": "" 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "channels": [ 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "basic", 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "crash", 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "device", 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "ident" 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "channels_available": [ 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "basic", 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "ident", 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "crash", 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "device", 2024-09-10T17:56:11.723 INFO:tasks.workunit.client.0.smithi012.stdout: "perf" 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "collections_available": [ 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_base", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "device_base", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "crash_base", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "ident_base", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_perf", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_mds_metadata", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_usage", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_usage_by_class", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_rook_v01", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_memory_metrics", 2024-09-10T17:56:11.724 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_options_bluestore" 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "collections_opted_in": [ 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_base", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "device_base", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "crash_base", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "ident_base", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_perf", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_mds_metadata", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_usage", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_usage_by_class", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_rook_v01", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_memory_metrics", 2024-09-10T17:56:11.725 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_options_bluestore" 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "config": { 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "active_changed": [ 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_allow_insecure_global_id_reclaim", 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_debug", 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_mon_ticket_ttl", 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_service_ticket_ttl", 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "bdev_debug_aio", 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "client_check_pool_perm", 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "client_mount_gid", 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "client_mount_uid", 2024-09-10T17:56:11.726 INFO:tasks.workunit.client.0.smithi012.stdout: "client_quota", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "container_image", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "daemonize", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_asserts_on_shutdown", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mgr", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mon", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_ms", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_osd", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_paxos", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "keyring", 2024-09-10T17:56:11.727 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_block_size", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_cache_size", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_compression", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_log", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_write_buffer_size", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_file", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_journald", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_stderr", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_allow_pool_delete", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_clock_drift_allowed", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_file_level", 2024-09-10T17:56:11.728 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_file", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_journald", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_stderr", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_data_avail_warn", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_election_default_strategy", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_host", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_max_pg_per_osd", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_mgr_mkfs_grace", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_prime_pg_temp", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_reporter_subtree_level", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_pg_warn_max_object_skew", 2024-09-10T17:56:11.729 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_bytes_per_osd", 2024-09-10T17:56:11.730 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_pgs_per_osd", 2024-09-10T17:56:11.730 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-09-10T17:56:11.730 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-09-10T17:56:11.730 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-09-10T17:56:11.730 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_legacy_crush_tunables", 2024-09-10T17:56:11.730 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-09-10T17:56:11.730 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_too_few_osds", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_bug", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_old_message", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "no_config_file", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_default_list", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_load_list", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_crush_chooseleaf_type", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_misdirected_ops", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_op_order", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_pg_log_writeout", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_shutdown", 2024-09-10T17:56:11.731 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_cached_snaps", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_missing_on_start", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_stray_on_activate", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_deep_scrub_update_digest_min_age", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_hdd", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_hybrid", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_ssd", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_max_backfills", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_profile", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-09-10T17:56:11.732 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_lim", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_res", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_wgt", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target_autotune", 2024-09-10T17:56:11.733 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue_cut_off", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pg_delete_cost", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_erasure_code_profile", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_pg_autoscale_mode", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recover_clone_overlap", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active_hdd", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active_ssd", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_chunk", 2024-09-10T17:56:11.734 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_hdd", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_hybrid", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_ssd", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_load_threshold", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_max_interval", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_sleep", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_shutdown_pgref_assert", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_hdd", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_hybrid", 2024-09-10T17:56:11.735 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_ssd", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "public_addr", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "public_addrv", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "public_network", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd_default_features", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd_qos_exclude_ops", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "setgroup", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "setuser" 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster_changed": [ 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_allow_insecure_global_id_reclaim", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_debug", 2024-09-10T17:56:11.736 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_mon_ticket_ttl", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_service_ticket_ttl", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "bdev_debug_aio", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "container_image", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_asserts_on_shutdown", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mgr", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mon", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_ms", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_osd", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_paxos", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_file", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_journald", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_stderr", 2024-09-10T17:56:11.737 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_join_fs", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/allow_ptrace", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/container_init", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/migration_current", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/use_repo_digest", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/ssl_server_port", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/orchestrator/orchestrator", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/channel_ident", 2024-09-10T17:56:11.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/description", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/organization", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_allow_pool_delete", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_clock_drift_allowed", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_file_level", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_file", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_data_avail_warn", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_election_default_strategy", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_max_pg_per_osd", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_mgr_mkfs_grace", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_prime_pg_temp", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_reporter_subtree_level", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_pg_warn_max_object_skew", 2024-09-10T17:56:11.739 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_bytes_per_osd", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_pgs_per_osd", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_legacy_crush_tunables", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_too_few_osds", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_bug", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_old_message", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_default_list", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_load_list", 2024-09-10T17:56:11.740 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_misdirected_ops", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_op_order", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_pg_log_writeout", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_shutdown", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_cached_snaps", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_missing_on_start", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_stray_on_activate", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_deep_scrub_update_digest_min_age", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_profile", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target_autotune", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue", 2024-09-10T17:56:11.741 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue_cut_off", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_erasure_code_profile", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_pg_autoscale_mode", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recover_clone_overlap", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_chunk", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_load_threshold", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_max_interval", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_shutdown_pgref_assert", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "public_network", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_cache_enabled", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_enable_ops_log", 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_enable_usage_log" 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:11.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "contact": null, 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "crashes": [], 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "created": "2024-09-10T17:47:02.984611Z", 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "crush": { 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_algs": { 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "straw2": 3 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_sizes": { 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "2": 1, 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "4": 2 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_types": { 2024-09-10T17:56:11.743 INFO:tasks.workunit.client.0.smithi012.stdout: "1": 2, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "11": 1 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "compat_weight_set": false, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "device_classes": [ 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: 8 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_buckets": 6, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_devices": 8, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_rules": 1, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_types": 12, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_weight_sets": 0, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "tunables": { 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "allowed_bucket_algs": 54, 2024-09-10T17:56:11.744 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_local_fallback_tries": 0, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_local_tries": 0, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_total_tries": 50, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_descend_once": 1, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_stable": 1, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_vary_r": 1, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v2_rules": 0, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v3_rules": 0, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v4_buckets": 1, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v5_rules": 0, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "legacy_tunables": 0, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "minimum_required_version": "jewel", 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "optimal_tunables": 1, 2024-09-10T17:56:11.745 INFO:tasks.workunit.client.0.smithi012.stdout: "profile": "jewel", 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables": 1, 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables2": 1, 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables3": 1, 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables5": 1, 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "straw_calc_version": 1 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "description": "upgrade test cluster", 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "fs": { 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "feature_flags": { 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "enable_multiple": true, 2024-09-10T17:56:11.746 INFO:tasks.workunit.client.0.smithi012.stdout: "ever_enabled_multiple": true 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "filesystems": [ 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "approx_ctime": "2024-09", 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "balancer_enabled": false, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_caps": 0, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_dns": 10, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_inos": 13, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_subtrees": 2, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "ever_allowed_features": 0, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "explicitly_allowed_features": 0, 2024-09-10T17:56:11.747 INFO:tasks.workunit.client.0.smithi012.stdout: "files": 0, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "max_mds": 1, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_data_pools": 1, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_in": 1, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_mds": 1, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": 0, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_standby_replay": 0, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_up": 1, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "snaps": 0, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "standby_count_wanted": 0 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_standby_mds": 1, 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: "total_num_mds": 2 2024-09-10T17:56:11.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "hosts": { 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num": 2, 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mds": 2, 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mgr": 2, 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mon": 2, 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_osd": 2 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "leaderboard": false, 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "leaderboard_description": null, 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "license": "sharing-1-0", 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "metadata": { 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:11.749 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 2 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 1, 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 1 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 2 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.750 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 2 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 2 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 2 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 2 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.751 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 3 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 2, 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 1 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 3 2024-09-10T17:56:11.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 3 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 3 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 3 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 3 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 8 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 4, 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 4 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.754 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 8 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 8 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 8 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 8 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 8 2024-09-10T17:56:11.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_objectstore": { 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": 8 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: "rotational": { 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: "0": 8 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:11.756 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:11.757 INFO:tasks.workunit.client.0.smithi012.stdout: "features": { 2024-09-10T17:56:11.757 INFO:tasks.workunit.client.0.smithi012.stdout: "optional": [], 2024-09-10T17:56:11.757 INFO:tasks.workunit.client.0.smithi012.stdout: "persistent": [ 2024-09-10T17:56:11.757 INFO:tasks.workunit.client.0.smithi012.stdout: "kraken", 2024-09-10T17:56:11.757 INFO:tasks.workunit.client.0.smithi012.stdout: "luminous", 2024-09-10T17:56:11.757 INFO:tasks.workunit.client.0.smithi012.stdout: "mimic", 2024-09-10T17:56:11.757 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap-prune", 2024-09-10T17:56:11.757 INFO:tasks.workunit.client.0.smithi012.stdout: "nautilus", 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "octopus", 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "pacific", 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "elector-pinging", 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "quincy", 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "reef" 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "ipv4_addr_mons": 6, 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "ipv6_addr_mons": 0, 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "min_mon_release": 18, 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "v1_addr_mons": 3, 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: "v2_addr_mons": 3 2024-09-10T17:56:11.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "organization": "ceph-qa", 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster_network": false, 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 8, 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "require_min_compat_client": "luminous", 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "require_osd_release": "reef" 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "pools": [ 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr" 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:11.759 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 1, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 1, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 1, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296218378, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 1781760, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 1781760, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:11.760 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098730496, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 2, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 2.443116500217002e-06, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 212, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 313344, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 590368, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 590368, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 1771104, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 179, 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 2473984 2024-09-10T17:56:11.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:11.762 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 32, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 32, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 2, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296218378, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 98304, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 98304, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098730496, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 22, 2024-09-10T17:56:11.763 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 1.347929554640359e-07, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 3428, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 3428, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 10284, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 51, 2024-09-10T17:56:11.764 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 20480 2024-09-10T17:56:11.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.765 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:11.765 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:11.765 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:11.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.765 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:11.765 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:11.765 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 64, 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 64, 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 3, 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:11.766 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296218378, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098730496, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 0.0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:11.767 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 0 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:11.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd" 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 8, 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 8, 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 4, 2024-09-10T17:56:11.769 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296218378, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 12288, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 12288, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098730496, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 2, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 1.684912120936133e-08, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:11.770 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 19, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 19, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 57, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 2, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 2048 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.771 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd": { 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: "mirroring_by_pool": [ 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: false 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_images_by_pool": [ 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pools": 1 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: "report_id": "c90c0484-59f6-4fbf-bb6e-84e822e60bed", 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: "report_timestamp": "2024-09-10T17:56:11.715027", 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: "report_version": 1, 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: "rook": { 2024-09-10T17:56:11.772 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster": { 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "external-mode": null, 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "allow-multiple-per-node": null, 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "count": null, 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "max-id": null, 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pvc": { 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": null 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "stretch": { 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": null 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "network": { 2024-09-10T17:56:11.773 INFO:tasks.workunit.client.0.smithi012.stdout: "provider": null 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "storage": { 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "device-set": { 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "non-portable": null, 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "portable": null, 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "total": null 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "csi": { 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "kubernetes": { 2024-09-10T17:56:11.774 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "node": { 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "kubernetes-total": null, 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "with-ceph-daemons": null, 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-cephfs-plugin": null, 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-nfs-plugin": null, 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-rbd-plugin": null 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "usage": { 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "storage-class": { 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": null, 2024-09-10T17:56:11.775 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs": null, 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "nfs": null, 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd": null, 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "total": null 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "services": {}, 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "usage": { 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 105, 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "pools": 4, 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_by_class": { 2024-09-10T17:56:11.776 INFO:tasks.workunit.client.0.smithi012.stdout: "ssd": { 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: "total_avail_bytes": 767718252544, 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: "total_bytes": 767960285184, 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_bytes": 242032640, 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_raw_bytes": 242032640, 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_raw_ratio": 0.00031516296439804137 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: "total_avail_bytes": 767718252544, 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: "total_bytes": 767960285184, 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_bytes": 242032640 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout:} 2024-09-10T17:56:11.777 INFO:tasks.workunit.client.0.smithi012.stdout:Device report is generated separately. To see it run 'ceph telemetry preview-device'. 2024-09-10T17:56:11.778 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph telemetry preview-device 2024-09-10T17:56:11.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/152621260' entity='client.admin' 2024-09-10T17:56:11.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/4234170961' entity='client.admin' 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:11.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:11 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.033 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:56:12.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Bus STOPPED 2024-09-10T17:56:12.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Bus STARTING 2024-09-10T17:56:12.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Serving on http://:::9283 2024-09-10T17:56:12.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:11] ENGINE Bus STARTED 2024-09-10T17:56:12.257 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "f7408896-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "INTEL_SSDPEDMD400G4_f7421396-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "20240910-175016": { 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "device": { 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "info_name": "/dev/nvme0n1", 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "/dev/nvme0n1", 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "protocol": "NVMe", 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "nvme" 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "firmware_version": "8DV101H0", 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "host_id": "f7408896-6f9d-11ef-b721-ac1f6bf825ea", 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: "json_format_version": [ 2024-09-10T17:56:12.258 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "local_time": { 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "asctime": "Tue Sep 10 17:50:15 2024 UTC", 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "time_t": 1725990615 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "logical_block_size": 512, 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_controller_id": 0, 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_namespaces": [ 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "capacity": { 2024-09-10T17:56:12.259 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "formatted_lba_size": 512, 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 1, 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "size": { 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "utilization": { 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.260 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_number_of_namespaces": 1, 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_pci_vendor": { 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 32902, 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "subsystem_id": 32902 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_add_log": { 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "Device stats": { 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_fw_downgrades": { 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "crc_error_count": { 2024-09-10T17:56:12.261 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "end_to_end_error_detection_count": { 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "erase_fail_count": { 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "host_bytes_written": { 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 38262821 2024-09-10T17:56:12.262 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "host_ctx_wear_used": { 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 1 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "media_bytes_read": { 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "nand_bytes_written": { 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 58635234 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_stat_indicator": { 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.263 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "pll_lock_loss_count": { 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "program_fail_count": { 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "re_alloc_sectr_cnt": { 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "retry_buffer_overflow_count": { 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "soft_ecc_err_rate": { 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "thermal_throttle_status": { 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "cnt": 0, 2024-09-10T17:56:12.265 INFO:tasks.workunit.client.0.smithi012.stdout: "pct": 0 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_host_reads": { 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_media_wear": { 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": "63.999023" 2024-09-10T17:56:12.266 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_timer": { 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "unexp_power_loss": { 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "wear_leveling": { 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 88, 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "avg": 3842, 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "max": 3861, 2024-09-10T17:56:12.267 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 3823 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel Smart log": "nvme0n1" 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_log": { 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare": 100, 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare_threshold": 10, 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: "controller_busy_time": 11, 2024-09-10T17:56:12.268 INFO:tasks.workunit.client.0.smithi012.stdout: "critical_warning": 0, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_read": 441908119, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_written": 2507592278, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "host_reads": 6653040893, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "host_writes": 40196130890, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "media_errors": 0, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_err_log_entries": 0, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "percentage_used": 12, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycles": 45671, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_hours": 64317, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": 22, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "unsafe_shutdowns": 410 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_vendor": "intel", 2024-09-10T17:56:12.269 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_version": { 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "string": "<1.2", 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycle_count": 45671, 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_time": { 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "hours": 64317 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "serial_number": "deleted", 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "smart_status": { 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme": { 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: "passed": true 2024-09-10T17:56:12.270 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl": { 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "argv": [ 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl", 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "-x", 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "--json=o", 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "/dev/nvme0n1" 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "build_info": "(local build)", 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "exit_status": 0, 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "output": [ 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.0-505.el9.x86_64] (local build)", 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF INFORMATION SECTION ===", 2024-09-10T17:56:12.271 INFO:tasks.workunit.client.0.smithi012.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Serial Number: deleted", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Version: 8DV101H0", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller ID: 0", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "NVMe Version: <1.2", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Number of Namespaces: 1", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Local Time is: Tue Sep 10 17:50:15 2024 UTC", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Updates (0x02): 1 Slot", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-09-10T17:56:12.272 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: "Log Page Attributes (0x02): Cmd_Eff_Lg", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported Power States", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 512 0 2", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: " 1 - 512 8 2", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: " 2 - 512 16 2", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: " 3 - 4096 0 0", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: " 4 - 4096 8 0", 2024-09-10T17:56:12.273 INFO:tasks.workunit.client.0.smithi012.stdout: " 5 - 4096 64 0", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: " 6 - 4096 128 0", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF SMART DATA SECTION ===", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "Critical Warning: 0x00", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "Temperature: 22 Celsius", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare: 100%", 2024-09-10T17:56:12.274 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare Threshold: 10%", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Percentage Used: 12%", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Read: 441,908,119 [226 TB]", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Written: 2,507,592,278 [1.28 PB]", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Read Commands: 6,653,040,893", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Write Commands: 40,196,130,890", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller Busy Time: 11", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Power Cycles: 45,671", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Power On Hours: 64,317", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Unsafe Shutdowns: 410", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Media and Data Integrity Errors: 0", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information Log Entries: 0", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information (NVMe Log 0x01, 16 of 64 entries)", 2024-09-10T17:56:12.275 INFO:tasks.workunit.client.0.smithi012.stdout: "No Errors Logged", 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: "" 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: "platform_info": "x86_64-linux-5.14.0-505.el9.x86_64", 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: "svn_revision": "5155", 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: "version": [ 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": { 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: "current": 22 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.276 INFO:tasks.workunit.client.0.smithi012.stdout: "user_capacity": { 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "f7442352-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "INTEL_SSDPEDMD400G4_f745781a-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "20240910-175019": { 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "device": { 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "info_name": "/dev/nvme0n1", 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "/dev/nvme0n1", 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "protocol": "NVMe", 2024-09-10T17:56:12.277 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "nvme" 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "firmware_version": "8DV101H0", 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "host_id": "f7442352-6f9d-11ef-b721-ac1f6bf825ea", 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "json_format_version": [ 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "local_time": { 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "asctime": "Tue Sep 10 17:50:19 2024 UTC", 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "time_t": 1725990619 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "logical_block_size": 512, 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-09-10T17:56:12.278 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_controller_id": 0, 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_namespaces": [ 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "capacity": { 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "formatted_lba_size": 512, 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 1, 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "size": { 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.279 INFO:tasks.workunit.client.0.smithi012.stdout: "utilization": { 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_number_of_namespaces": 1, 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_pci_vendor": { 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 32902, 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "subsystem_id": 32902 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_add_log": { 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "Device stats": { 2024-09-10T17:56:12.280 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_fw_downgrades": { 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "crc_error_count": { 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "end_to_end_error_detection_count": { 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "erase_fail_count": { 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.281 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "host_bytes_written": { 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 33826795 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "host_ctx_wear_used": { 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 1 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "media_bytes_read": { 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "nand_bytes_written": { 2024-09-10T17:56:12.282 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 56709061 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_stat_indicator": { 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "pll_lock_loss_count": { 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "program_fail_count": { 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "re_alloc_sectr_cnt": { 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "retry_buffer_overflow_count": { 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "soft_ecc_err_rate": { 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "thermal_throttle_status": { 2024-09-10T17:56:12.284 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "cnt": 0, 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "pct": 0 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_host_reads": { 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_media_wear": { 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": "63.999023" 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.285 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_timer": { 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "unexp_power_loss": { 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "wear_leveling": { 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 88, 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "avg": 3832, 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "max": 3846, 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 3816 2024-09-10T17:56:12.286 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel Smart log": "nvme0n1" 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_log": { 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare": 100, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare_threshold": 10, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "controller_busy_time": 10, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "critical_warning": 0, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_read": 461984543, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_written": 2216872845, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "host_reads": 7306234026, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "host_writes": 38652005814, 2024-09-10T17:56:12.287 INFO:tasks.workunit.client.0.smithi012.stdout: "media_errors": 0, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_err_log_entries": 0, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "percentage_used": 12, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycles": 57579, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_hours": 57768, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": 26, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "unsafe_shutdowns": 593 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_vendor": "intel", 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_version": { 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "string": "<1.2", 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycle_count": 57579, 2024-09-10T17:56:12.288 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_time": { 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "hours": 57768 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "serial_number": "deleted", 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "smart_status": { 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme": { 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "passed": true 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl": { 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "argv": [ 2024-09-10T17:56:12.289 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "-x", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "--json=o", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "/dev/nvme0n1" 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "build_info": "(local build)", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "exit_status": 0, 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "output": [ 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.0-505.el9.x86_64] (local build)", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF INFORMATION SECTION ===", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "Serial Number: deleted", 2024-09-10T17:56:12.290 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Version: 8DV101H0", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller ID: 0", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "NVMe Version: <1.2", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Number of Namespaces: 1", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Local Time is: Tue Sep 10 17:50:19 2024 UTC", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Updates (0x02): 1 Slot", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Log Page Attributes (0x02): Cmd_Eff_Lg", 2024-09-10T17:56:12.291 INFO:tasks.workunit.client.0.smithi012.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported Power States", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 512 0 2", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: " 1 - 512 8 2", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: " 2 - 512 16 2", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: " 3 - 4096 0 0", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: " 4 - 4096 8 0", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: " 5 - 4096 64 0", 2024-09-10T17:56:12.292 INFO:tasks.workunit.client.0.smithi012.stdout: " 6 - 4096 128 0", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF SMART DATA SECTION ===", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Critical Warning: 0x00", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Temperature: 26 Celsius", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare: 100%", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare Threshold: 10%", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Percentage Used: 12%", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Read: 461,984,543 [236 TB]", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Written: 2,216,872,845 [1.13 PB]", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Read Commands: 7,306,234,026", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Write Commands: 38,652,005,814", 2024-09-10T17:56:12.293 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller Busy Time: 10", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "Power Cycles: 57,579", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "Power On Hours: 57,768", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "Unsafe Shutdowns: 593", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "Media and Data Integrity Errors: 0", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information Log Entries: 0", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information (NVMe Log 0x01, 16 of 64 entries)", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "No Errors Logged", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "" 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "platform_info": "x86_64-linux-5.14.0-505.el9.x86_64", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "svn_revision": "5155", 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: "version": [ 2024-09-10T17:56:12.294 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": { 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: "current": 26 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: "user_capacity": { 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.295 INFO:tasks.workunit.client.0.smithi012.stdout:} 2024-09-10T17:56:12.296 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph telemetry preview-all 2024-09-10T17:56:12.773 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "device_report": { 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "f7408896-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "INTEL_SSDPEDMD400G4_f7421396-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "20240910-175016": { 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "device": { 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "info_name": "/dev/nvme0n1", 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "/dev/nvme0n1", 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "protocol": "NVMe", 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "nvme" 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "firmware_version": "8DV101H0", 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "host_id": "f7408896-6f9d-11ef-b721-ac1f6bf825ea", 2024-09-10T17:56:12.774 INFO:tasks.workunit.client.0.smithi012.stdout: "json_format_version": [ 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: "local_time": { 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: "asctime": "Tue Sep 10 17:50:15 2024 UTC", 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: "time_t": 1725990615 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: "logical_block_size": 512, 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_controller_id": 0, 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_namespaces": [ 2024-09-10T17:56:12.775 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "capacity": { 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "formatted_lba_size": 512, 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 1, 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "size": { 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "utilization": { 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.776 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_number_of_namespaces": 1, 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_pci_vendor": { 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 32902, 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "subsystem_id": 32902 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_add_log": { 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "Device stats": { 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_fw_downgrades": { 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "crc_error_count": { 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "end_to_end_error_detection_count": { 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "erase_fail_count": { 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "host_bytes_written": { 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 38262821 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "host_ctx_wear_used": { 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 1 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "media_bytes_read": { 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.779 INFO:tasks.workunit.client.0.smithi012.stdout: "nand_bytes_written": { 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 58635234 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_stat_indicator": { 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: "pll_lock_loss_count": { 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.780 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "program_fail_count": { 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "re_alloc_sectr_cnt": { 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "retry_buffer_overflow_count": { 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "soft_ecc_err_rate": { 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "thermal_throttle_status": { 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "cnt": 0, 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "pct": 0 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_host_reads": { 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:12.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.783 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_media_wear": { 2024-09-10T17:56:12.783 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.783 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": "63.999023" 2024-09-10T17:56:12.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.783 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_timer": { 2024-09-10T17:56:12.783 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.783 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:12.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "unexp_power_loss": { 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "wear_leveling": { 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 88, 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "avg": 3842, 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "max": 3861, 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 3823 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.784 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel Smart log": "nvme0n1" 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_log": { 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare": 100, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare_threshold": 10, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "controller_busy_time": 11, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "critical_warning": 0, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_read": 441908119, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_written": 2507592278, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "host_reads": 6653040893, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "host_writes": 40196130890, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "media_errors": 0, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "num_err_log_entries": 0, 2024-09-10T17:56:12.785 INFO:tasks.workunit.client.0.smithi012.stdout: "percentage_used": 12, 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycles": 45671, 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_hours": 64317, 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": 22, 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "unsafe_shutdowns": 410 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_vendor": "intel", 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_version": { 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "string": "<1.2", 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycle_count": 45671, 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_time": { 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: "hours": 64317 2024-09-10T17:56:12.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "serial_number": "deleted", 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "smart_status": { 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme": { 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "passed": true 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl": { 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "argv": [ 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl", 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "-x", 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "--json=o", 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "/dev/nvme0n1" 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.787 INFO:tasks.workunit.client.0.smithi012.stdout: "build_info": "(local build)", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "exit_status": 0, 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "output": [ 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.0-505.el9.x86_64] (local build)", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF INFORMATION SECTION ===", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "Serial Number: deleted", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Version: 8DV101H0", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller ID: 0", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "NVMe Version: <1.2", 2024-09-10T17:56:12.788 INFO:tasks.workunit.client.0.smithi012.stdout: "Number of Namespaces: 1", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Local Time is: Tue Sep 10 17:50:15 2024 UTC", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Updates (0x02): 1 Slot", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Log Page Attributes (0x02): Cmd_Eff_Lg", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported Power States", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.789 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 512 0 2", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: " 1 - 512 8 2", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: " 2 - 512 16 2", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: " 3 - 4096 0 0", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: " 4 - 4096 8 0", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: " 5 - 4096 64 0", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: " 6 - 4096 128 0", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF SMART DATA SECTION ===", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-09-10T17:56:12.790 INFO:tasks.workunit.client.0.smithi012.stdout: "Critical Warning: 0x00", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Temperature: 22 Celsius", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare: 100%", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare Threshold: 10%", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Percentage Used: 12%", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Read: 441,908,119 [226 TB]", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Written: 2,507,592,278 [1.28 PB]", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Read Commands: 6,653,040,893", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Write Commands: 40,196,130,890", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller Busy Time: 11", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Power Cycles: 45,671", 2024-09-10T17:56:12.791 INFO:tasks.workunit.client.0.smithi012.stdout: "Power On Hours: 64,317", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "Unsafe Shutdowns: 410", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "Media and Data Integrity Errors: 0", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information Log Entries: 0", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information (NVMe Log 0x01, 16 of 64 entries)", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "No Errors Logged", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "" 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "platform_info": "x86_64-linux-5.14.0-505.el9.x86_64", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "svn_revision": "5155", 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: "version": [ 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:12.792 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": { 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: "current": 22 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: "user_capacity": { 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: "f7442352-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: "INTEL_SSDPEDMD400G4_f745781a-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:12.793 INFO:tasks.workunit.client.0.smithi012.stdout: "20240910-175019": { 2024-09-10T17:56:12.794 INFO:tasks.workunit.client.0.smithi012.stdout: "device": { 2024-09-10T17:56:12.794 INFO:tasks.workunit.client.0.smithi012.stdout: "info_name": "/dev/nvme0n1", 2024-09-10T17:56:12.794 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "/dev/nvme0n1", 2024-09-10T17:56:12.794 INFO:tasks.workunit.client.0.smithi012.stdout: "protocol": "NVMe", 2024-09-10T17:56:12.794 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "nvme" 2024-09-10T17:56:12.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.794 INFO:tasks.workunit.client.0.smithi012.stdout: "firmware_version": "8DV101H0", 2024-09-10T17:56:12.794 INFO:tasks.workunit.client.0.smithi012.stdout: "host_id": "f7442352-6f9d-11ef-b721-ac1f6bf825ea", 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "json_format_version": [ 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "local_time": { 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "asctime": "Tue Sep 10 17:50:19 2024 UTC", 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "time_t": 1725990619 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "logical_block_size": 512, 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_controller_id": 0, 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-09-10T17:56:12.795 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_namespaces": [ 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "capacity": { 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "formatted_lba_size": 512, 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 1, 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "size": { 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.796 INFO:tasks.workunit.client.0.smithi012.stdout: "utilization": { 2024-09-10T17:56:12.797 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.797 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.797 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.797 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.797 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.797 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_number_of_namespaces": 1, 2024-09-10T17:56:12.797 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_pci_vendor": { 2024-09-10T17:56:12.797 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 32902, 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "subsystem_id": 32902 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_add_log": { 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "Device stats": { 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_fw_downgrades": { 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "crc_error_count": { 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.798 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: "end_to_end_error_detection_count": { 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: "erase_fail_count": { 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: "host_bytes_written": { 2024-09-10T17:56:12.799 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 33826795 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "host_ctx_wear_used": { 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 1 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "media_bytes_read": { 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "nand_bytes_written": { 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 56709061 2024-09-10T17:56:12.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_stat_indicator": { 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "pll_lock_loss_count": { 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "program_fail_count": { 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.801 INFO:tasks.workunit.client.0.smithi012.stdout: "re_alloc_sectr_cnt": { 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "retry_buffer_overflow_count": { 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "soft_ecc_err_rate": { 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "thermal_throttle_status": { 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.802 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "cnt": 0, 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "pct": 0 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_host_reads": { 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_media_wear": { 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": "63.999023" 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_timer": { 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:12.803 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "unexp_power_loss": { 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "wear_leveling": { 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 88, 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "avg": 3832, 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "max": 3846, 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 3816 2024-09-10T17:56:12.804 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel Smart log": "nvme0n1" 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_log": { 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare": 100, 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare_threshold": 10, 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: "controller_busy_time": 10, 2024-09-10T17:56:12.805 INFO:tasks.workunit.client.0.smithi012.stdout: "critical_warning": 0, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_read": 461984543, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_written": 2216872845, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "host_reads": 7306234026, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "host_writes": 38652005814, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "media_errors": 0, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "num_err_log_entries": 0, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "percentage_used": 12, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycles": 57579, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_hours": 57768, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": 26, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "unsafe_shutdowns": 593 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_vendor": "intel", 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_version": { 2024-09-10T17:56:12.806 INFO:tasks.workunit.client.0.smithi012.stdout: "string": "<1.2", 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycle_count": 57579, 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_time": { 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "hours": 57768 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "serial_number": "deleted", 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "smart_status": { 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme": { 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.807 INFO:tasks.workunit.client.0.smithi012.stdout: "passed": true 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl": { 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "argv": [ 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl", 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "-x", 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "--json=o", 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "/dev/nvme0n1" 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "build_info": "(local build)", 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "exit_status": 0, 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "output": [ 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.0-505.el9.x86_64] (local build)", 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-09-10T17:56:12.808 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF INFORMATION SECTION ===", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Serial Number: deleted", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Version: 8DV101H0", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller ID: 0", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "NVMe Version: <1.2", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Number of Namespaces: 1", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Local Time is: Tue Sep 10 17:50:19 2024 UTC", 2024-09-10T17:56:12.809 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Updates (0x02): 1 Slot", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "Log Page Attributes (0x02): Cmd_Eff_Lg", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported Power States", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 512 0 2", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: " 1 - 512 8 2", 2024-09-10T17:56:12.810 INFO:tasks.workunit.client.0.smithi012.stdout: " 2 - 512 16 2", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: " 3 - 4096 0 0", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: " 4 - 4096 8 0", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: " 5 - 4096 64 0", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: " 6 - 4096 128 0", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF SMART DATA SECTION ===", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "Critical Warning: 0x00", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "Temperature: 26 Celsius", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare: 100%", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare Threshold: 10%", 2024-09-10T17:56:12.811 INFO:tasks.workunit.client.0.smithi012.stdout: "Percentage Used: 12%", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Read: 461,984,543 [236 TB]", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Written: 2,216,872,845 [1.13 PB]", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Read Commands: 7,306,234,026", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Write Commands: 38,652,005,814", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller Busy Time: 10", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Power Cycles: 57,579", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Power On Hours: 57,768", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Unsafe Shutdowns: 593", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Media and Data Integrity Errors: 0", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information Log Entries: 0", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information (NVMe Log 0x01, 16 of 64 entries)", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "No Errors Logged", 2024-09-10T17:56:12.812 INFO:tasks.workunit.client.0.smithi012.stdout: "" 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: "platform_info": "x86_64-linux-5.14.0-505.el9.x86_64", 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: "svn_revision": "5155", 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: "version": [ 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": { 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: "current": 26 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: "user_capacity": { 2024-09-10T17:56:12.813 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: "report": { 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: "balancer": { 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: "active": true, 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: "mode": "" 2024-09-10T17:56:12.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "channels": [ 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "basic", 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "crash", 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "device", 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "ident" 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "channels_available": [ 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "basic", 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "ident", 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "crash", 2024-09-10T17:56:12.815 INFO:tasks.workunit.client.0.smithi012.stdout: "device", 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: "perf" 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: "collections_available": [ 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_base", 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: "device_base", 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: "crash_base", 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: "ident_base", 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_perf", 2024-09-10T17:56:12.816 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_mds_metadata", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_usage", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_usage_by_class", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_rook_v01", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_memory_metrics", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_options_bluestore" 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "collections_opted_in": [ 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_base", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "device_base", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "crash_base", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "ident_base", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_perf", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_mds_metadata", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_usage", 2024-09-10T17:56:12.817 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_usage_by_class", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_rook_v01", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_memory_metrics", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_options_bluestore" 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "config": { 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "active_changed": [ 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_allow_insecure_global_id_reclaim", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_debug", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_mon_ticket_ttl", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_service_ticket_ttl", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "bdev_debug_aio", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "client_check_pool_perm", 2024-09-10T17:56:12.818 INFO:tasks.workunit.client.0.smithi012.stdout: "client_mount_gid", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "client_mount_uid", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "client_quota", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "container_image", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "daemonize", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_asserts_on_shutdown", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mgr", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mon", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_ms", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_osd", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_paxos", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "keyring", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_block_size", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_cache_size", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_compression", 2024-09-10T17:56:12.819 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_log", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_write_buffer_size", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_file", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_journald", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_stderr", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_allow_pool_delete", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_clock_drift_allowed", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_file_level", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_file", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_journald", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_stderr", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_data_avail_warn", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_election_default_strategy", 2024-09-10T17:56:12.820 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_host", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_max_pg_per_osd", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_mgr_mkfs_grace", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_prime_pg_temp", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_reporter_subtree_level", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_pg_warn_max_object_skew", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_bytes_per_osd", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_pgs_per_osd", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_legacy_crush_tunables", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-09-10T17:56:12.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_too_few_osds", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_bug", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_old_message", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "no_config_file", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_default_list", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_load_list", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_crush_chooseleaf_type", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_misdirected_ops", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_op_order", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_pg_log_writeout", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_shutdown", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_cached_snaps", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_missing_on_start", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_stray_on_activate", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_deep_scrub_update_digest_min_age", 2024-09-10T17:56:12.822 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_hdd", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_hybrid", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_ssd", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_max_backfills", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_profile", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-09-10T17:56:12.823 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_lim", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_res", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_wgt", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target_autotune", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue_cut_off", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pg_delete_cost", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_erasure_code_profile", 2024-09-10T17:56:12.824 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_pg_autoscale_mode", 2024-09-10T17:56:12.825 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recover_clone_overlap", 2024-09-10T17:56:12.825 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active", 2024-09-10T17:56:12.825 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active_hdd", 2024-09-10T17:56:12.825 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active_ssd", 2024-09-10T17:56:12.825 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_chunk", 2024-09-10T17:56:12.825 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep", 2024-09-10T17:56:12.825 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_hdd", 2024-09-10T17:56:12.825 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_hybrid", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_ssd", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_load_threshold", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_max_interval", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_sleep", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_shutdown_pgref_assert", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_hdd", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_hybrid", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_ssd", 2024-09-10T17:56:12.826 INFO:tasks.workunit.client.0.smithi012.stdout: "public_addr", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "public_addrv", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "public_network", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd_default_features", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd_qos_exclude_ops", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "setgroup", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "setuser" 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster_changed": [ 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_allow_insecure_global_id_reclaim", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_debug", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_mon_ticket_ttl", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_service_ticket_ttl", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "bdev_debug_aio", 2024-09-10T17:56:12.827 INFO:tasks.workunit.client.0.smithi012.stdout: "container_image", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_asserts_on_shutdown", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mgr", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mon", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_ms", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_osd", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_paxos", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_file", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_journald", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_stderr", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_join_fs", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/allow_ptrace", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/container_init", 2024-09-10T17:56:12.828 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/migration_current", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/use_repo_digest", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/ssl_server_port", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/orchestrator/orchestrator", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/channel_ident", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/description", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/organization", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_allow_pool_delete", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_clock_drift_allowed", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_file_level", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_file", 2024-09-10T17:56:12.829 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_data_avail_warn", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_election_default_strategy", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_max_pg_per_osd", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_mgr_mkfs_grace", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_prime_pg_temp", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_reporter_subtree_level", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_pg_warn_max_object_skew", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_bytes_per_osd", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_pgs_per_osd", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_legacy_crush_tunables", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-09-10T17:56:12.830 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_too_few_osds", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_bug", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_old_message", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_default_list", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_load_list", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_misdirected_ops", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_op_order", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_pg_log_writeout", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_shutdown", 2024-09-10T17:56:12.831 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_cached_snaps", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_missing_on_start", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_stray_on_activate", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_deep_scrub_update_digest_min_age", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_profile", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target_autotune", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue_cut_off", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_erasure_code_profile", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_pg_autoscale_mode", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recover_clone_overlap", 2024-09-10T17:56:12.832 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_chunk", 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_load_threshold", 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_max_interval", 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_shutdown_pgref_assert", 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "public_network", 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_cache_enabled", 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_enable_ops_log", 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_enable_usage_log" 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "contact": null, 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "crashes": [], 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "created": "2024-09-10T17:47:02.984611Z", 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "crush": { 2024-09-10T17:56:12.833 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_algs": { 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: "straw2": 3 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_sizes": { 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: "2": 1, 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: "4": 2 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_types": { 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: "1": 2, 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: "11": 1 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.834 INFO:tasks.workunit.client.0.smithi012.stdout: "compat_weight_set": false, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "device_classes": [ 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: 8 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_buckets": 6, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_devices": 8, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_rules": 1, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_types": 12, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_weight_sets": 0, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "tunables": { 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "allowed_bucket_algs": 54, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_local_fallback_tries": 0, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_local_tries": 0, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_total_tries": 50, 2024-09-10T17:56:12.835 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_descend_once": 1, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_stable": 1, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_vary_r": 1, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v2_rules": 0, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v3_rules": 0, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v4_buckets": 1, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v5_rules": 0, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "legacy_tunables": 0, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "minimum_required_version": "jewel", 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "optimal_tunables": 1, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "profile": "jewel", 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables": 1, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables2": 1, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables3": 1, 2024-09-10T17:56:12.836 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables5": 1, 2024-09-10T17:56:12.837 INFO:tasks.workunit.client.0.smithi012.stdout: "straw_calc_version": 1 2024-09-10T17:56:12.837 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.837 INFO:tasks.workunit.client.0.smithi012.stdout: "description": "upgrade test cluster", 2024-09-10T17:56:12.837 INFO:tasks.workunit.client.0.smithi012.stdout: "fs": { 2024-09-10T17:56:12.837 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:12.837 INFO:tasks.workunit.client.0.smithi012.stdout: "feature_flags": { 2024-09-10T17:56:12.837 INFO:tasks.workunit.client.0.smithi012.stdout: "enable_multiple": true, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "ever_enabled_multiple": true 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "filesystems": [ 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "approx_ctime": "2024-09", 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "balancer_enabled": false, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_caps": 0, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_dns": 10, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_inos": 13, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_subtrees": 2, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "ever_allowed_features": 0, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "explicitly_allowed_features": 0, 2024-09-10T17:56:12.838 INFO:tasks.workunit.client.0.smithi012.stdout: "files": 0, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "max_mds": 1, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "num_data_pools": 1, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "num_in": 1, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "num_mds": 1, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": 0, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "num_standby_replay": 0, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "num_up": 1, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "snaps": 0, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "standby_count_wanted": 0 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "num_standby_mds": 1, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "total_num_mds": 2 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.839 INFO:tasks.workunit.client.0.smithi012.stdout: "hosts": { 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "num": 2, 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mds": 2, 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mgr": 2, 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mon": 2, 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_osd": 2 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "leaderboard": false, 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "leaderboard_description": null, 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "license": "sharing-1-0", 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "metadata": { 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:12.840 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:12.841 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 2 2024-09-10T17:56:12.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.841 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:12.841 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:56:12.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.841 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:12.842 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 1, 2024-09-10T17:56:12.842 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 1 2024-09-10T17:56:12.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.842 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:12.842 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 2 2024-09-10T17:56:12.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.843 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:12.843 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 2 2024-09-10T17:56:12.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.843 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:12.843 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 2 2024-09-10T17:56:12.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.843 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:12.844 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 2 2024-09-10T17:56:12.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.844 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:12.844 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 2 2024-09-10T17:56:12.844 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.844 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:12.845 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:12.845 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 3 2024-09-10T17:56:12.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.845 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:12.845 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:56:12.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.845 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:12.845 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 2, 2024-09-10T17:56:12.846 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 1 2024-09-10T17:56:12.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.846 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:12.846 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 3 2024-09-10T17:56:12.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.846 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:12.846 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 3 2024-09-10T17:56:12.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.847 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:12.847 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 3 2024-09-10T17:56:12.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.847 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:12.847 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 3 2024-09-10T17:56:12.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.848 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:12.848 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 3 2024-09-10T17:56:12.848 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.848 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:12.849 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:12.849 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 8 2024-09-10T17:56:12.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.849 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:12.849 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:56:12.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.849 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:12.849 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 4, 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 4 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 8 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 8 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 8 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.850 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 8 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 8 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_objectstore": { 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": 8 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: "rotational": { 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: "0": 8 2024-09-10T17:56:12.851 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "features": { 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "optional": [], 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "persistent": [ 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "kraken", 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "luminous", 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "mimic", 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap-prune", 2024-09-10T17:56:12.852 INFO:tasks.workunit.client.0.smithi012.stdout: "nautilus", 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "octopus", 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "pacific", 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "elector-pinging", 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "quincy", 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "reef" 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "ipv4_addr_mons": 6, 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "ipv6_addr_mons": 0, 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "min_mon_release": 18, 2024-09-10T17:56:12.853 INFO:tasks.workunit.client.0.smithi012.stdout: "v1_addr_mons": 3, 2024-09-10T17:56:12.854 INFO:tasks.workunit.client.0.smithi012.stdout: "v2_addr_mons": 3 2024-09-10T17:56:12.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.854 INFO:tasks.workunit.client.0.smithi012.stdout: "organization": "ceph-qa", 2024-09-10T17:56:12.854 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:12.854 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster_network": false, 2024-09-10T17:56:12.854 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 8, 2024-09-10T17:56:12.854 INFO:tasks.workunit.client.0.smithi012.stdout: "require_min_compat_client": "luminous", 2024-09-10T17:56:12.854 INFO:tasks.workunit.client.0.smithi012.stdout: "require_osd_release": "reef" 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "pools": [ 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr" 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 1, 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 1, 2024-09-10T17:56:12.855 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 1, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296218378, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 1781760, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 1781760, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098730496, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 2, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 2.443116500217002e-06, 2024-09-10T17:56:12.856 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 212, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 313344, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 590368, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 590368, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 1771104, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 179, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 2473984 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:12.857 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 32, 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 32, 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 2, 2024-09-10T17:56:12.858 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296218378, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 98304, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 98304, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098730496, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 22, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 1.347929554640359e-07, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:12.859 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 3428, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 3428, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 10284, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 51, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 20480 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:12.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 64, 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 64, 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 3, 2024-09-10T17:56:12.861 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:12.862 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:12.862 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296218378, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098730496, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 0.0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:12.863 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 0, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 0, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 0, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 0, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 0 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:12.864 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd" 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 8, 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 8, 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 4, 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:12.865 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296218378, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 12288, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 12288, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098730496, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 2, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 1.684912120936133e-08, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 19, 2024-09-10T17:56:12.866 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 19, 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 57, 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 2, 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 2048 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd": { 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: "mirroring_by_pool": [ 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: false 2024-09-10T17:56:12.867 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_images_by_pool": [ 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pools": 1 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "report_id": "c90c0484-59f6-4fbf-bb6e-84e822e60bed", 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "report_timestamp": "2024-09-10T17:56:12.756048", 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "report_version": 1, 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "rook": { 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster": { 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "external-mode": null, 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "allow-multiple-per-node": null, 2024-09-10T17:56:12.868 INFO:tasks.workunit.client.0.smithi012.stdout: "count": null, 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "max-id": null, 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pvc": { 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": null 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "stretch": { 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": null 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "network": { 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "provider": null 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "storage": { 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "device-set": { 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:12.869 INFO:tasks.workunit.client.0.smithi012.stdout: "non-portable": null, 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: "portable": null, 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: "total": null 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: "csi": { 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: "kubernetes": { 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: "node": { 2024-09-10T17:56:12.870 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "kubernetes-total": null, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "with-ceph-daemons": null, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-cephfs-plugin": null, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-nfs-plugin": null, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-rbd-plugin": null 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "usage": { 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "storage-class": { 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": null, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs": null, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "nfs": null, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd": null, 2024-09-10T17:56:12.871 INFO:tasks.workunit.client.0.smithi012.stdout: "total": null 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "services": {}, 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "usage": { 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 105, 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "pools": 4, 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_by_class": { 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "ssd": { 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "total_avail_bytes": 767718252544, 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "total_bytes": 767960285184, 2024-09-10T17:56:12.872 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_bytes": 242032640, 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_raw_bytes": 242032640, 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_raw_ratio": 0.00031516296439804137 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: "total_avail_bytes": 767718252544, 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: "total_bytes": 767960285184, 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_bytes": 242032640 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:12.873 INFO:tasks.workunit.client.0.smithi012.stdout:} 2024-09-10T17:56:12.874 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:12.874 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.874 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.874 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:12.874 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.874 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.874 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.874 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:12 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.876 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:12 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:12.876 INFO:tasks.workunit.client.0.smithi012.stderr:++ ceph telemetry collection ls 2024-09-10T17:56:13.270 INFO:tasks.workunit.client.0.smithi012.stderr:+ COLLECTIONS='New collections are available: 2024-09-10T17:56:13.270 INFO:tasks.workunit.client.0.smithi012.stderr:['\''basic_base'\'', '\''basic_mds_metadata'\'', '\''basic_pool_options_bluestore'\'', '\''basic_pool_usage'\'', '\''basic_rook_v01'\'', '\''basic_usage_by_class'\'', '\''crash_base'\'', '\''device_base'\'', '\''ident_base'\'', '\''perf_memory_metrics'\'', '\''perf_perf'\''] 2024-09-10T17:56:13.270 INFO:tasks.workunit.client.0.smithi012.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-09-10T17:56:13.270 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:13.270 INFO:tasks.workunit.client.0.smithi012.stderr:NAME STATUS DESC 2024-09-10T17:56:13.270 INFO:tasks.workunit.client.0.smithi012.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-09-10T17:56:13.270 INFO:tasks.workunit.client.0.smithi012.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster ' 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:+ NEW_COLLECTIONS=("perf_perf" "basic_mds_metadata" "basic_pool_usage" "basic_rook_v01" "perf_memory_metrics") 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:+ [[ New collections are available: 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-09-10T17:56:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:NAME STATUS DESC 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-09-10T17:56:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *perf_perf* ]] 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:+ [[ New collections are available: 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:NAME STATUS DESC 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-09-10T17:56:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_mds_metadata* ]] 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:+ [[ New collections are available: 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:NAME STATUS DESC 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-09-10T17:56:13.274 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_pool_usage* ]] 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:+ [[ New collections are available: 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:NAME STATUS DESC 2024-09-10T17:56:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_rook_v01* ]] 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ [[ New collections are available: 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-09-10T17:56:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:NAME STATUS DESC 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *perf_memory_metrics* ]] 2024-09-10T17:56:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph telemetry on --license sharing-1-0 2024-09-10T17:56:13.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: pgmap v85: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:13.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:13.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: pgmap v85: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.608 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:13.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: pgmap v85: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:13.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:13.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:13 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:13.800 INFO:tasks.workunit.client.0.smithi012.stdout:Telemetry is on. 2024-09-10T17:56:13.800 INFO:tasks.workunit.client.0.smithi012.stdout:Some channels are disabled, please enable with: 2024-09-10T17:56:13.800 INFO:tasks.workunit.client.0.smithi012.stdout:`ceph telemetry enable channel perf` 2024-09-10T17:56:13.818 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph telemetry enable channel perf 2024-09-10T17:56:13.914 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:13] ENGINE Bus STOPPING 2024-09-10T17:56:13.914 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:13] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:56:13.914 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:13] ENGINE Bus STOPPED 2024-09-10T17:56:13.914 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:13] ENGINE Bus STARTING 2024-09-10T17:56:13.915 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:13] ENGINE Serving on http://:::9283 2024-09-10T17:56:13.915 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:13] ENGINE Bus STARTED 2024-09-10T17:56:14.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:56:13] "GET /metrics HTTP/1.1" 200 33658 "" "Prometheus/2.43.0" 2024-09-10T17:56:14.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:14] ENGINE Bus STOPPING 2024-09-10T17:56:14.315 INFO:tasks.workunit.client.0.smithi012.stdout:channel_perf is enabled 2024-09-10T17:56:14.326 INFO:tasks.workunit.client.0.smithi012.stderr:++ ceph config get mgr mgr/telemetry/last_opt_revision 2024-09-10T17:56:14.586 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:14] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:56:14.586 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:14] ENGINE Bus STOPPED 2024-09-10T17:56:14.586 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:14] ENGINE Bus STARTING 2024-09-10T17:56:14.587 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.587 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.587 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.587 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: mgrmap e23: y(active, since 2m), standbys: x 2024-09-10T17:56:14.587 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.587 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.587 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.587 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.588 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:14.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:14.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.589 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: mgrmap e23: y(active, since 2m), standbys: x 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.592 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.593 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.593 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.593 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.593 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.593 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.593 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.687 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: mgrmap e23: y(active, since 2m), standbys: x 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.688 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:14.689 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:14.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:14.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:14.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.690 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.691 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:14.692 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:14.692 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:14.692 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:14.692 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:14 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:14.707 INFO:tasks.workunit.client.0.smithi012.stderr:+ LAST_OPT_REVISION=1 2024-09-10T17:56:14.707 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 1 -ne 1 ']' 2024-09-10T17:56:14.707 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph telemetry show 2024-09-10T17:56:15.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:14] ENGINE Serving on http://:::9283 2024-09-10T17:56:15.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:56:14] ENGINE Bus STARTED 2024-09-10T17:56:15.399 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2024-09-10T17:56:15.399 INFO:tasks.workunit.client.0.smithi012.stdout: "balancer": { 2024-09-10T17:56:15.399 INFO:tasks.workunit.client.0.smithi012.stdout: "active": true, 2024-09-10T17:56:15.399 INFO:tasks.workunit.client.0.smithi012.stdout: "mode": "" 2024-09-10T17:56:15.399 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "channels": [ 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "basic", 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "crash", 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "device", 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "ident", 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "perf" 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "channels_available": [ 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "basic", 2024-09-10T17:56:15.400 INFO:tasks.workunit.client.0.smithi012.stdout: "ident", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "crash", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "device", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "perf" 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "collections_available": [ 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_base", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "device_base", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "crash_base", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "ident_base", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_perf", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_mds_metadata", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_usage", 2024-09-10T17:56:15.401 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_usage_by_class", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_rook_v01", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_memory_metrics", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_options_bluestore" 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "collections_opted_in": [ 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_base", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "device_base", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "crash_base", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "ident_base", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_perf", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_mds_metadata", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_usage", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_usage_by_class", 2024-09-10T17:56:15.402 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_rook_v01", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_memory_metrics", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_options_bluestore" 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "config": { 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "active_changed": [ 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_allow_insecure_global_id_reclaim", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_debug", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_mon_ticket_ttl", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_service_ticket_ttl", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "bdev_debug_aio", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "client_check_pool_perm", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "client_mount_gid", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "client_mount_uid", 2024-09-10T17:56:15.403 INFO:tasks.workunit.client.0.smithi012.stdout: "client_quota", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "container_image", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "daemonize", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_asserts_on_shutdown", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mgr", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mon", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_ms", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_osd", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_paxos", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "keyring", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_block_size", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_cache_size", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_compression", 2024-09-10T17:56:15.404 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_log", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_write_buffer_size", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_file", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_journald", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_stderr", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_allow_pool_delete", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_clock_drift_allowed", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_file_level", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_file", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_journald", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_stderr", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_data_avail_warn", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_election_default_strategy", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_host", 2024-09-10T17:56:15.405 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_max_pg_per_osd", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_mgr_mkfs_grace", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_prime_pg_temp", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_reporter_subtree_level", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_pg_warn_max_object_skew", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_bytes_per_osd", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_pgs_per_osd", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_legacy_crush_tunables", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_too_few_osds", 2024-09-10T17:56:15.406 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_bug", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_old_message", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "no_config_file", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_default_list", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_load_list", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_crush_chooseleaf_type", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_misdirected_ops", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_op_order", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_pg_log_writeout", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_shutdown", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_cached_snaps", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_missing_on_start", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_stray_on_activate", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_deep_scrub_update_digest_min_age", 2024-09-10T17:56:15.407 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_hdd", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_hybrid", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_ssd", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_max_backfills", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_profile", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_lim", 2024-09-10T17:56:15.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_res", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_wgt", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target_autotune", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue_cut_off", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pg_delete_cost", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_erasure_code_profile", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_pg_autoscale_mode", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recover_clone_overlap", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active_hdd", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active_ssd", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_chunk", 2024-09-10T17:56:15.409 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_hdd", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_hybrid", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_ssd", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_load_threshold", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_max_interval", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_sleep", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_shutdown_pgref_assert", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_hdd", 2024-09-10T17:56:15.410 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_hybrid", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_ssd", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "public_addr", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "public_addrv", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "public_network", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd_default_features", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd_qos_exclude_ops", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "setgroup", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "setuser" 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster_changed": [ 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_allow_insecure_global_id_reclaim", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_debug", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_mon_ticket_ttl", 2024-09-10T17:56:15.411 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_service_ticket_ttl", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "bdev_debug_aio", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "container_image", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_asserts_on_shutdown", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mgr", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mon", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_ms", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_osd", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_paxos", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_file", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_journald", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_stderr", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_join_fs", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/allow_ptrace", 2024-09-10T17:56:15.412 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/container_init", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/migration_current", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/use_repo_digest", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/ssl_server_port", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/orchestrator/orchestrator", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/channel_ident", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/channel_perf", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/description", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/enabled", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/organization", 2024-09-10T17:56:15.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_allow_pool_delete", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_clock_drift_allowed", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_file_level", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_file", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_data_avail_warn", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_election_default_strategy", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_max_pg_per_osd", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_mgr_mkfs_grace", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_prime_pg_temp", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_reporter_subtree_level", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_pg_warn_max_object_skew", 2024-09-10T17:56:15.414 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_bytes_per_osd", 2024-09-10T17:56:15.418 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_pgs_per_osd", 2024-09-10T17:56:15.418 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-09-10T17:56:15.418 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-09-10T17:56:15.418 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-09-10T17:56:15.418 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_legacy_crush_tunables", 2024-09-10T17:56:15.418 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-09-10T17:56:15.418 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_too_few_osds", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_bug", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_old_message", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_default_list", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_load_list", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_misdirected_ops", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_op_order", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_pg_log_writeout", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_shutdown", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_cached_snaps", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_missing_on_start", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_stray_on_activate", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_deep_scrub_update_digest_min_age", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-09-10T17:56:15.419 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_profile", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target_autotune", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue_cut_off", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_erasure_code_profile", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_pg_autoscale_mode", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recover_clone_overlap", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_chunk", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_load_threshold", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_max_interval", 2024-09-10T17:56:15.420 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_shutdown_pgref_assert", 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: "public_network", 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_cache_enabled", 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_enable_ops_log", 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_enable_usage_log" 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: "contact": null, 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: "crashes": [], 2024-09-10T17:56:15.421 INFO:tasks.workunit.client.0.smithi012.stdout: "created": "2024-09-10T17:47:02.984611Z", 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "crush": { 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_algs": { 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "straw2": 3 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_sizes": { 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "2": 1, 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "4": 2 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_types": { 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "1": 2, 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "11": 1 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.422 INFO:tasks.workunit.client.0.smithi012.stdout: "compat_weight_set": false, 2024-09-10T17:56:15.423 INFO:tasks.workunit.client.0.smithi012.stdout: "device_classes": [ 2024-09-10T17:56:15.423 INFO:tasks.workunit.client.0.smithi012.stdout: 8 2024-09-10T17:56:15.423 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.423 INFO:tasks.workunit.client.0.smithi012.stdout: "num_buckets": 6, 2024-09-10T17:56:15.423 INFO:tasks.workunit.client.0.smithi012.stdout: "num_devices": 8, 2024-09-10T17:56:15.423 INFO:tasks.workunit.client.0.smithi012.stdout: "num_rules": 1, 2024-09-10T17:56:15.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_types": 12, 2024-09-10T17:56:15.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_weight_sets": 0, 2024-09-10T17:56:15.424 INFO:tasks.workunit.client.0.smithi012.stdout: "tunables": { 2024-09-10T17:56:15.424 INFO:tasks.workunit.client.0.smithi012.stdout: "allowed_bucket_algs": 54, 2024-09-10T17:56:15.424 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_local_fallback_tries": 0, 2024-09-10T17:56:15.424 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_local_tries": 0, 2024-09-10T17:56:15.425 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_total_tries": 50, 2024-09-10T17:56:15.425 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_descend_once": 1, 2024-09-10T17:56:15.425 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_stable": 1, 2024-09-10T17:56:15.425 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_vary_r": 1, 2024-09-10T17:56:15.425 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v2_rules": 0, 2024-09-10T17:56:15.425 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v3_rules": 0, 2024-09-10T17:56:15.425 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v4_buckets": 1, 2024-09-10T17:56:15.425 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v5_rules": 0, 2024-09-10T17:56:15.426 INFO:tasks.workunit.client.0.smithi012.stdout: "legacy_tunables": 0, 2024-09-10T17:56:15.426 INFO:tasks.workunit.client.0.smithi012.stdout: "minimum_required_version": "jewel", 2024-09-10T17:56:15.426 INFO:tasks.workunit.client.0.smithi012.stdout: "optimal_tunables": 1, 2024-09-10T17:56:15.426 INFO:tasks.workunit.client.0.smithi012.stdout: "profile": "jewel", 2024-09-10T17:56:15.426 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables": 1, 2024-09-10T17:56:15.426 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables2": 1, 2024-09-10T17:56:15.426 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables3": 1, 2024-09-10T17:56:15.427 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables5": 1, 2024-09-10T17:56:15.427 INFO:tasks.workunit.client.0.smithi012.stdout: "straw_calc_version": 1 2024-09-10T17:56:15.427 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.427 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.427 INFO:tasks.workunit.client.0.smithi012.stdout: "description": "upgrade test cluster", 2024-09-10T17:56:15.427 INFO:tasks.workunit.client.0.smithi012.stdout: "fs": { 2024-09-10T17:56:15.427 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:15.427 INFO:tasks.workunit.client.0.smithi012.stdout: "feature_flags": { 2024-09-10T17:56:15.428 INFO:tasks.workunit.client.0.smithi012.stdout: "enable_multiple": true, 2024-09-10T17:56:15.428 INFO:tasks.workunit.client.0.smithi012.stdout: "ever_enabled_multiple": true 2024-09-10T17:56:15.428 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.428 INFO:tasks.workunit.client.0.smithi012.stdout: "filesystems": [ 2024-09-10T17:56:15.428 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.428 INFO:tasks.workunit.client.0.smithi012.stdout: "approx_ctime": "2024-09", 2024-09-10T17:56:15.429 INFO:tasks.workunit.client.0.smithi012.stdout: "balancer_enabled": false, 2024-09-10T17:56:15.429 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.429 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_caps": 0, 2024-09-10T17:56:15.429 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_dns": 10, 2024-09-10T17:56:15.429 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_inos": 13, 2024-09-10T17:56:15.429 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_subtrees": 2, 2024-09-10T17:56:15.429 INFO:tasks.workunit.client.0.smithi012.stdout: "ever_allowed_features": 0, 2024-09-10T17:56:15.430 INFO:tasks.workunit.client.0.smithi012.stdout: "explicitly_allowed_features": 0, 2024-09-10T17:56:15.430 INFO:tasks.workunit.client.0.smithi012.stdout: "files": 0, 2024-09-10T17:56:15.430 INFO:tasks.workunit.client.0.smithi012.stdout: "max_mds": 1, 2024-09-10T17:56:15.430 INFO:tasks.workunit.client.0.smithi012.stdout: "num_data_pools": 1, 2024-09-10T17:56:15.431 INFO:tasks.workunit.client.0.smithi012.stdout: "num_in": 1, 2024-09-10T17:56:15.431 INFO:tasks.workunit.client.0.smithi012.stdout: "num_mds": 1, 2024-09-10T17:56:15.431 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": 0, 2024-09-10T17:56:15.431 INFO:tasks.workunit.client.0.smithi012.stdout: "num_standby_replay": 0, 2024-09-10T17:56:15.431 INFO:tasks.workunit.client.0.smithi012.stdout: "num_up": 1, 2024-09-10T17:56:15.431 INFO:tasks.workunit.client.0.smithi012.stdout: "snaps": 0, 2024-09-10T17:56:15.431 INFO:tasks.workunit.client.0.smithi012.stdout: "standby_count_wanted": 0 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: "num_standby_mds": 1, 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: "total_num_mds": 2 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_stats": { 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 20135936, 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 330160, 2024-09-10T17:56:15.432 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 868352, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 0, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 341, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 1061072, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 12, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 545792, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 14709120, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 20135936 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 20406272, 2024-09-10T17:56:15.433 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 355064, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 8192, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 778240, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 421, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 1287304, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 20, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 979968, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 15154304, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 21184512 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:15.434 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 49512448, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1418880, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 5496832, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 0, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 2016, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 12516776, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 22, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 2701056, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 24757464, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 49512448 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.435 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 39133184, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 880016, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 5210112, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 6299648, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1200, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 8930432, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 21, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 859136, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 20632048, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 45432832 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.436 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.ddb55796e0023ab827f1fac99ce57bb7a1696db8": { 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 39583744, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 885456, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 5480448, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 4792320, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1063, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 8065512, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 22, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 1143808, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 21387080, 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 44376064 2024-09-10T17:56:15.437 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.0": { 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 51421184, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1936136, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 221184, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1772, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5707416, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3788032, 2024-09-10T17:56:15.438 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 37237088, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 51642368 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.1": { 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 46505984, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1013752, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 942080, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1393, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5509696, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 2290688, 2024-09-10T17:56:15.439 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 34939336, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 47448064 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.2": { 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 45015040, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 718864, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 1105920, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1297, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5359296, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 2300160, 2024-09-10T17:56:15.440 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 33884208, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 46120960 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.3": { 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 47407104, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1676304, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 40960, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1626, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5132752, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:15.441 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3051264, 2024-09-10T17:56:15.442 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 34794272, 2024-09-10T17:56:15.442 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 47448064 2024-09-10T17:56:15.442 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.442 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.4": { 2024-09-10T17:56:15.442 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 45514752, 2024-09-10T17:56:15.442 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 614696, 2024-09-10T17:56:15.442 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 57344, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 671744, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1276, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5082976, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 1845504, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 35161720, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 46186496 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.5": { 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 48873472, 2024-09-10T17:56:15.443 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 2167536, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 606208, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1696, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5278744, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3927808, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 34746872, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 49479680 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.6": { 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 49020928, 2024-09-10T17:56:15.444 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1979152, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 1572864, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1676, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5236440, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3821312, 2024-09-10T17:56:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 35231512, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 50593792 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.7": { 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 48119808, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1991360, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 311296, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1686, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5640584, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3284736, 2024-09-10T17:56:15.446 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 34450616, 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 48431104 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "hosts": { 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "num": 2, 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mds": 2, 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mgr": 2, 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mon": 2, 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_osd": 2 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "io_rate": { 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_stats_delta": { 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 0, 2024-09-10T17:56:15.447 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "stamp_delta": "12.002419", 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:15.448 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:15.449 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 182, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 278, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:15.450 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 40, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:15.451 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 0 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: "leaderboard": false, 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: "leaderboard_description": null, 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: "license": "sharing-1-0", 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: "mempool": { 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:15.452 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.453 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.454 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.455 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.456 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.457 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 150168, 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 33 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 928, 2024-09-10T17:56:15.458 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 2 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.459 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.460 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.461 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.462 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.463 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.463 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.463 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.463 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.463 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.463 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.463 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.464 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.465 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.466 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.467 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 222727, 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 72 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 51704, 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 208 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.468 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8016, 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 135 2024-09-10T17:56:15.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.470 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.471 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.472 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.473 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.474 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.475 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.476 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1181441, 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 386 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 264, 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.477 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.478 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6592, 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 134 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12744, 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1546 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 10624, 2024-09-10T17:56:15.479 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 206 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.480 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.481 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.481 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.481 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.481 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.481 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.481 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.482 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.482 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.482 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.482 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.482 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.482 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.482 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.483 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.483 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.483 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.483 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.483 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.483 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.484 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.484 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.484 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.484 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.484 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.484 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.484 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.485 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.485 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.485 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.485 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.485 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.485 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.485 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.485 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.486 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.486 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.486 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.486 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.486 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.486 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.486 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.487 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.487 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.487 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.487 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.487 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.487 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.487 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.488 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.488 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.488 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.488 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.488 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.489 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.489 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.489 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.489 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.489 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.489 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.489 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1221775, 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 374 2024-09-10T17:56:15.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 176, 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 2 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.491 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6592, 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 134 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12744, 2024-09-10T17:56:15.492 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1546 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5312, 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 103 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.ddb55796e0023ab827f1fac99ce57bb7a1696db8": { 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.494 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.495 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.496 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.497 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.498 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1385209, 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 450 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 176, 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 2 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.499 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.500 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6592, 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 134 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12744, 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1546 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5312, 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 103 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.501 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.0": { 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.502 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.503 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5920, 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 74 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22960, 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 205 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2160, 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 49 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 635085, 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 23 2024-09-10T17:56:15.504 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 97988, 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 16727 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 214456, 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 347 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 11852, 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 777 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.505 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9840, 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 205 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 33906, 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 215 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22960, 2024-09-10T17:56:15.506 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 205 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 434691, 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 95 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.507 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2466950, 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 201 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 7392, 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 84 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 533232, 2024-09-10T17:56:15.508 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 46 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 95264, 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 188 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.509 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.510 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.1": { 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.511 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5040, 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 63 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21504, 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 192 2024-09-10T17:56:15.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1264, 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 41 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16384, 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 4 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 50970, 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9422 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.513 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 134216, 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 229 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9564, 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 598 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9216, 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 192 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.514 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 28862, 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 197 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.515 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21504, 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 192 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 736, 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 465987, 2024-09-10T17:56:15.516 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 102 2024-09-10T17:56:15.517 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.517 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.517 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12112, 2024-09-10T17:56:15.517 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.517 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.517 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.517 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2444186, 2024-09-10T17:56:15.517 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 198 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4840, 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 55 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.518 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 417312, 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 36 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.519 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.520 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8528, 2024-09-10T17:56:15.520 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 22 2024-09-10T17:56:15.520 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.520 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.520 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:15.520 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:15.520 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.520 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.521 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.2": { 2024-09-10T17:56:15.522 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.523 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:15.524 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:15.524 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.524 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.524 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:15.524 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.524 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.524 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.524 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4560, 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 57 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21280, 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 190 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1152, 2024-09-10T17:56:15.525 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 40 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12288, 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 48757, 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9134 2024-09-10T17:56:15.526 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 130136, 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 223 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8964, 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 589 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.527 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9120, 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 190 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.528 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 27662, 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 191 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21280, 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 190 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 736, 2024-09-10T17:56:15.529 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 355701, 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 75 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12112, 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.530 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2421628, 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 178 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4400, 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 50 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.531 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 359352, 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 31 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.532 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.533 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.533 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.533 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.533 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8320, 2024-09-10T17:56:15.533 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 24 2024-09-10T17:56:15.533 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.533 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.534 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.535 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.3": { 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.536 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:15.537 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:15.537 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.537 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.537 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:15.537 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:15.537 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.537 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.537 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4480, 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 56 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21952, 2024-09-10T17:56:15.538 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 480, 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 34 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.539 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 89878, 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 15599 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 203576, 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 331 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9788, 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 609 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9408, 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.540 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 28702, 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 199 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21952, 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.541 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2208, 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 341107, 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 71 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 26565, 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2461438, 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 186 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.542 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4752, 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 54 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 428904, 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 37 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.543 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 10400, 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 20 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.544 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.4": { 2024-09-10T17:56:15.545 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:15.546 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4000, 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 50 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21952, 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1040, 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 39 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.547 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8192, 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 2 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 51838, 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9660 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 137616, 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 234 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9980, 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 609 2024-09-10T17:56:15.548 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9408, 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 29470, 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21952, 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 736, 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 946342, 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 76 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12112, 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.550 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2414045, 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 175 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4928, 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 56 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 452088, 2024-09-10T17:56:15.551 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 39 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8944, 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 18 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239496, 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3507 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.552 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.553 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.554 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.554 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.5": { 2024-09-10T17:56:15.554 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.554 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.556 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.556 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.556 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.556 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:15.556 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 3200, 2024-09-10T17:56:15.557 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 40 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21616, 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 193 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 480, 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 34 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.558 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 91875, 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 15789 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 206296, 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 335 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 10288, 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 608 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9264, 2024-09-10T17:56:15.559 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 193 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 30230, 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 203 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21616, 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 193 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.560 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2208, 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 879783, 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 60 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 26565, 2024-09-10T17:56:15.561 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2411403, 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 170 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5544, 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 63 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.562 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 486864, 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 42 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 13520, 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 26 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:15.563 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.564 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.6": { 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.565 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2800, 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 35 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22624, 2024-09-10T17:56:15.566 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 256, 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 32 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 91180, 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 15982 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.567 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 204256, 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 332 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 11200, 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 764 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9696, 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.568 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 30490, 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 200 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22624, 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.569 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 849908, 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 53 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2440710, 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 177 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4664, 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 53 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.570 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 452088, 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 39 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 94952, 2024-09-10T17:56:15.571 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 193 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.572 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.7": { 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.573 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2160, 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 27 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.574 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22624, 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1600, 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 44 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 297314, 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 13 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 94983, 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 16428 2024-09-10T17:56:15.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 210376, 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 341 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 11872, 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 770 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9696, 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:15.576 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 32794, 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 209 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22624, 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:15.577 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 196961, 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 38 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2425816, 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 217 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.578 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6336, 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 72 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 521640, 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 45 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.579 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 97968, 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 226 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.580 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.581 INFO:tasks.workunit.client.0.smithi012.stdout: "metadata": { 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 2 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 1, 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 1 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 2 2024-09-10T17:56:15.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 2 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 2 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 2 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 2 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.583 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 3 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 2, 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 1 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 3 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.584 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 3 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 3 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 3 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 3 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:15.585 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 8 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 4, 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 4 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 8 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 8 2024-09-10T17:56:15.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 8 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 8 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 8 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_objectstore": { 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": 8 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "rotational": { 2024-09-10T17:56:15.587 INFO:tasks.workunit.client.0.smithi012.stdout: "0": 8 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "features": { 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "optional": [], 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "persistent": [ 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "kraken", 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "luminous", 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "mimic", 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap-prune", 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "nautilus", 2024-09-10T17:56:15.588 INFO:tasks.workunit.client.0.smithi012.stdout: "octopus", 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "pacific", 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "elector-pinging", 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "quincy", 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "reef" 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "ipv4_addr_mons": 6, 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "ipv6_addr_mons": 0, 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "min_mon_release": 18, 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "v1_addr_mons": 3, 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "v2_addr_mons": 3 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "organization": "ceph-qa", 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.589 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster_network": false, 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 8, 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "require_min_compat_client": "luminous", 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "require_osd_release": "reef" 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_perf_histograms": [ 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "axes": [ 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Latency (usec)", 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 100000, 2024-09-10T17:56:15.590 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[100000, 199999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[200000, 399999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[400000, 799999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[800000, 1599999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[1600000, 3199999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[3200000, 6399999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[6400000, 12799999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[12800000, 25599999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[25600000, 51199999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[51200000, 102399999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[102400000, 204799999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[204800000, 409599999]", 2024-09-10T17:56:15.591 INFO:tasks.workunit.client.0.smithi012.stdout: "[409600000, 819199999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[819200000, 1638399999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[1638400000, 3276799999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[3276800000, 6553599999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[6553600000, 13107199999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[13107200000, 26214399999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[26214400000, 52428799999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[52428800000, 104857599999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[104857600000, 209715199999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[209715200000, 419430399999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[419430400000, 838860799999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[838860800000, 1677721599999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[1677721600000, 3355443199999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[3355443200000, 6710886399999]", 2024-09-10T17:56:15.592 INFO:tasks.workunit.client.0.smithi012.stdout: "[6710886400000, 13421772799999]", 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "[13421772800000, 26843545599999]", 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "[26843545600000, 53687091199999]", 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "[53687091200000, None]" 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Request size (bytes)", 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 512, 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 511]", 2024-09-10T17:56:15.593 INFO:tasks.workunit.client.0.smithi012.stdout: "[512, 1023]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[1024, 2047]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[2048, 4095]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[4096, 8191]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[8192, 16383]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[16384, 32767]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[32768, 65535]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[65536, 131071]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[131072, 262143]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[262144, 524287]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[524288, 1048575]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[1048576, 2097151]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[2097152, 4194303]", 2024-09-10T17:56:15.594 INFO:tasks.workunit.client.0.smithi012.stdout: "[4194304, 8388607]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[8388608, 16777215]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[16777216, 33554431]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[33554432, 67108863]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[67108864, 134217727]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[134217728, 268435455]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[268435456, 536870911]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[536870912, 1073741823]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[1073741824, 2147483647]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[2147483648, 4294967295]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[4294967296, 8589934591]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[8589934592, 17179869183]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[17179869184, 34359738367]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[34359738368, 68719476735]", 2024-09-10T17:56:15.595 INFO:tasks.workunit.client.0.smithi012.stdout: "[68719476736, 137438953471]", 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "[137438953472, 274877906943]", 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "[274877906944, None]" 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "osds": [ 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 0, 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.596 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.597 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.598 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 1, 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.599 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.600 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 2, 2024-09-10T17:56:15.601 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.602 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.603 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 3, 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.604 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.605 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.606 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 4, 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.607 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.608 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 5, 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.609 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.610 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.611 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 6, 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.612 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.613 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.614 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 7, 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.615 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.617 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "axes": [ 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Latency (usec)", 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 100000, 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99999]", 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "[100000, 199999]", 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "[200000, 399999]", 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "[400000, 799999]", 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "[800000, 1599999]", 2024-09-10T17:56:15.618 INFO:tasks.workunit.client.0.smithi012.stdout: "[1600000, 3199999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[3200000, 6399999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[6400000, 12799999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[12800000, 25599999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[25600000, 51199999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[51200000, 102399999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[102400000, 204799999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[204800000, 409599999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[409600000, 819199999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[819200000, 1638399999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[1638400000, 3276799999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[3276800000, 6553599999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[6553600000, 13107199999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[13107200000, 26214399999]", 2024-09-10T17:56:15.619 INFO:tasks.workunit.client.0.smithi012.stdout: "[26214400000, 52428799999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[52428800000, 104857599999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[104857600000, 209715199999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[209715200000, 419430399999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[419430400000, 838860799999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[838860800000, 1677721599999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[1677721600000, 3355443199999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[3355443200000, 6710886399999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[6710886400000, 13421772799999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[13421772800000, 26843545599999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[26843545600000, 53687091199999]", 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "[53687091200000, None]" 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:15.620 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Request size (bytes)", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 512, 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 511]", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[512, 1023]", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[1024, 2047]", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[2048, 4095]", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[4096, 8191]", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[8192, 16383]", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[16384, 32767]", 2024-09-10T17:56:15.621 INFO:tasks.workunit.client.0.smithi012.stdout: "[32768, 65535]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[65536, 131071]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[131072, 262143]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[262144, 524287]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[524288, 1048575]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[1048576, 2097151]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[2097152, 4194303]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[4194304, 8388607]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[8388608, 16777215]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[16777216, 33554431]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[33554432, 67108863]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[67108864, 134217727]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[134217728, 268435455]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[268435456, 536870911]", 2024-09-10T17:56:15.622 INFO:tasks.workunit.client.0.smithi012.stdout: "[536870912, 1073741823]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[1073741824, 2147483647]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[2147483648, 4294967295]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[4294967296, 8589934591]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[8589934592, 17179869183]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[17179869184, 34359738367]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[34359738368, 68719476735]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[68719476736, 137438953471]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[137438953472, 274877906943]", 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "[274877906944, None]" 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: "osds": [ 2024-09-10T17:56:15.623 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 0, 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.624 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.625 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 1, 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.626 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.627 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.628 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 2, 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.629 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.630 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.631 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 3, 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.632 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.633 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 4, 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.634 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.635 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.636 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 5, 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.637 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.638 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 6, 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.639 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.640 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.641 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 7, 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.642 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.643 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.644 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "axes": [ 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Latency (usec)", 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 100000, 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99999]", 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "[100000, 199999]", 2024-09-10T17:56:15.645 INFO:tasks.workunit.client.0.smithi012.stdout: "[200000, 399999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[400000, 799999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[800000, 1599999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[1600000, 3199999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[3200000, 6399999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[6400000, 12799999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[12800000, 25599999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[25600000, 51199999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[51200000, 102399999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[102400000, 204799999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[204800000, 409599999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[409600000, 819199999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[819200000, 1638399999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[1638400000, 3276799999]", 2024-09-10T17:56:15.646 INFO:tasks.workunit.client.0.smithi012.stdout: "[3276800000, 6553599999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[6553600000, 13107199999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[13107200000, 26214399999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[26214400000, 52428799999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[52428800000, 104857599999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[104857600000, 209715199999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[209715200000, 419430399999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[419430400000, 838860799999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[838860800000, 1677721599999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[1677721600000, 3355443199999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[3355443200000, 6710886399999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[6710886400000, 13421772799999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[13421772800000, 26843545599999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[26843545600000, 53687091199999]", 2024-09-10T17:56:15.647 INFO:tasks.workunit.client.0.smithi012.stdout: "[53687091200000, None]" 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Request size (bytes)", 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 512, 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 511]", 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "[512, 1023]", 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "[1024, 2047]", 2024-09-10T17:56:15.648 INFO:tasks.workunit.client.0.smithi012.stdout: "[2048, 4095]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[4096, 8191]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[8192, 16383]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[16384, 32767]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[32768, 65535]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[65536, 131071]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[131072, 262143]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[262144, 524287]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[524288, 1048575]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[1048576, 2097151]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[2097152, 4194303]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[4194304, 8388607]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[8388608, 16777215]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[16777216, 33554431]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[33554432, 67108863]", 2024-09-10T17:56:15.649 INFO:tasks.workunit.client.0.smithi012.stdout: "[67108864, 134217727]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[134217728, 268435455]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[268435456, 536870911]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[536870912, 1073741823]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[1073741824, 2147483647]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[2147483648, 4294967295]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[4294967296, 8589934591]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[8589934592, 17179869183]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[17179869184, 34359738367]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[34359738368, 68719476735]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[68719476736, 137438953471]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[137438953472, 274877906943]", 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "[274877906944, None]" 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.650 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "osds": [ 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 0, 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.651 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.652 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.653 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 1, 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.654 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.655 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 2, 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.656 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.657 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.658 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 3, 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.659 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.660 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 4, 2024-09-10T17:56:15.661 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.662 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.663 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 5, 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.664 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.665 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.666 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 6, 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.667 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.668 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 7, 2024-09-10T17:56:15.669 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.670 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.671 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "axes": [ 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Latency (usec)", 2024-09-10T17:56:15.672 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 100000, 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[100000, 199999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[200000, 399999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[400000, 799999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[800000, 1599999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[1600000, 3199999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[3200000, 6399999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[6400000, 12799999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[12800000, 25599999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[25600000, 51199999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[51200000, 102399999]", 2024-09-10T17:56:15.673 INFO:tasks.workunit.client.0.smithi012.stdout: "[102400000, 204799999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[204800000, 409599999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[409600000, 819199999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[819200000, 1638399999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[1638400000, 3276799999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[3276800000, 6553599999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[6553600000, 13107199999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[13107200000, 26214399999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[26214400000, 52428799999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[52428800000, 104857599999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[104857600000, 209715199999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[209715200000, 419430399999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[419430400000, 838860799999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[838860800000, 1677721599999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[1677721600000, 3355443199999]", 2024-09-10T17:56:15.674 INFO:tasks.workunit.client.0.smithi012.stdout: "[3355443200000, 6710886399999]", 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "[6710886400000, 13421772799999]", 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "[13421772800000, 26843545599999]", 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "[26843545600000, 53687091199999]", 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "[53687091200000, None]" 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Request size (bytes)", 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 512, 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:15.675 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 511]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[512, 1023]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[1024, 2047]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[2048, 4095]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[4096, 8191]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[8192, 16383]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[16384, 32767]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[32768, 65535]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[65536, 131071]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[131072, 262143]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[262144, 524287]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[524288, 1048575]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[1048576, 2097151]", 2024-09-10T17:56:15.676 INFO:tasks.workunit.client.0.smithi012.stdout: "[2097152, 4194303]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[4194304, 8388607]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[8388608, 16777215]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[16777216, 33554431]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[33554432, 67108863]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[67108864, 134217727]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[134217728, 268435455]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[268435456, 536870911]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[536870912, 1073741823]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[1073741824, 2147483647]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[2147483648, 4294967295]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[4294967296, 8589934591]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[8589934592, 17179869183]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[17179869184, 34359738367]", 2024-09-10T17:56:15.677 INFO:tasks.workunit.client.0.smithi012.stdout: "[34359738368, 68719476735]", 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "[68719476736, 137438953471]", 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "[137438953472, 274877906943]", 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "[274877906944, None]" 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "osds": [ 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 0, 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.678 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 4, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.679 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.680 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 1, 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 11, 1, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 14, 7, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 15, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.681 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 13, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.682 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 2, 2024-09-10T17:56:15.683 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.684 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.685 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 3, 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.686 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.687 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.688 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 4, 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.689 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.690 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 5, 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.691 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.692 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.693 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 6, 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.694 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.695 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:15.696 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 7, 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.697 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.698 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.699 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_counters": { 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "caps": { 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_flush_ack": { 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_flushsnap_ack": { 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.700 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_grant": { 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_revoke": { 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_trunc": { 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_commit": { 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_fetch_complete": { 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_fetch_keys": { 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_merge": { 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_split": { 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "exported_inodes": { 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "forward": { 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_cap_release": { 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_caps": { 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_caps_dirty": { 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_inode_file_caps": { 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "imported_inodes": { 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "inodes": { 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "inodes_expired": { 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "inodes_pinned": { 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "inodes_with_caps": { 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "load_cent": { 2024-09-10T17:56:15.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "openino_dir_fetch": { 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "process_request_cap_release": { 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "reply_latency": { 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 77664 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "request": { 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "root_rbytes": { 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "root_rfiles": { 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "root_rsnaps": { 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_reply": { 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "subtrees": { 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.706 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_cache": { 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_enqueue_scrub": { 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_exportdir": { 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_flush": { 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_fragmentdir": { 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.707 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_fragstats": { 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_inodestats": { 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "num_recovering_enqueued": { 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "num_recovering_prioritized": { 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "num_recovering_processing": { 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "num_strays": { 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "num_strays_delayed": { 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "num_strays_enqueuing": { 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_completed": { 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_started": { 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "strays_created": { 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "strays_enqueued": { 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "strays_migrated": { 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "strays_reintegrated": { 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.710 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_log": { 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "ev": { 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "evadd": { 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "evex": { 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "evexd": { 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "evexg": { 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "evtrm": { 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "jlat": { 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10096424 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "replayed": { 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "seg": { 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "segadd": { 2024-09-10T17:56:15.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "segex": { 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "segexd": { 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "segexg": { 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "segtrm": { 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.713 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_mem": { 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "cap": { 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "cap+": { 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "cap-": { 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "dir": { 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.714 INFO:tasks.workunit.client.0.smithi012.stdout: "dir+": { 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "dir-": { 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "dn": { 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "dn+": { 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "dn-": { 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "heap": { 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 207124 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "ino": { 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "ino+": { 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "ino-": { 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "rss": { 2024-09-10T17:56:15.716 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39556 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_server": { 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "cap_acquisition_throttle": { 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "cap_revoke_eviction": { 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_request": { 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_session": { 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 16 2024-09-10T17:56:15.717 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_peer_request": { 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "req_create_latency": { 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "req_getattr_latency": { 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 77664 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "req_getfilelock_latency": { 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.718 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "req_getvxattr_latency": { 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "req_link_latency": { 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookup_latency": { 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookuphash_latency": { 2024-09-10T17:56:15.719 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookupino_latency": { 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookupname_latency": { 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookupparent_latency": { 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.720 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lssnap_latency": { 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "req_mkdir_latency": { 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "req_mknod_latency": { 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.721 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "req_mksnap_latency": { 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "req_open_latency": { 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "req_readdir_latency": { 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "req_rename_latency": { 2024-09-10T17:56:15.722 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "req_renamesnap_latency": { 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "req_rmdir_latency": { 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "req_rmsnap_latency": { 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "req_rmxattr_latency": { 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setattr_latency": { 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setfilelock_latency": { 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.724 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setlayout_latency": { 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setxattr_latency": { 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "req_snapdiff_latency": { 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.725 INFO:tasks.workunit.client.0.smithi012.stdout: "req_symlink_latency": { 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "req_unlink_latency": { 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_sessions": { 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "average_load": { 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "avg_session_uptime": { 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 89 2024-09-10T17:56:15.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "mdthresh_evicted": { 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "session_add": { 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "session_count": { 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "session_remove": { 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "sessions_open": { 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "sessions_stale": { 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "total_load": { 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "purge_queue": { 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executed": { 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executed_ops": { 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.729 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executing": { 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executing_high_water": { 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executing_ops": { 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executing_ops_high_water": { 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_item_in_journal": { 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.730 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "election_call": { 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "election_lose": { 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "election_win": { 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_elections": { 2024-09-10T17:56:15.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": { 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "session_add": { 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "session_rm": { 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 188 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "session_trim": { 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.732 INFO:tasks.workunit.client.0.smithi012.stdout: "paxos": { 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "accept_timeout": { 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "begin": { 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 992 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_bytes": { 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5221367 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_keys": { 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:15.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2976 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_latency": { 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 209998477 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "collect": { 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_bytes": { 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_keys": { 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_latency": { 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_timeout": { 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_uncommitted": { 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "commit": { 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 992 2024-09-10T17:56:15.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_bytes": { 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5149997 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_keys": { 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5620 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_latency": { 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 383065440 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.736 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_ack_timeout": { 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_timeout": { 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn": { 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn_latency": { 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 999993 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh": { 2024-09-10T17:56:15.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 994 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh_latency": { 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 994, 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2719980139 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "restart": { 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state": { 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_bytes": { 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1050 2024-09-10T17:56:15.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_keys": { 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "start_leader": { 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "start_peon": { 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state": { 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.739 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_bytes": { 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_keys": { 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_latency": { 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache": { 2024-09-10T17:56:15.740 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1020054731 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46891008 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42524672 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2147483648 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4366336 2024-09-10T17:56:15.741 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:full": { 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277007671 2024-09-10T17:56:15.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 307806 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 70811755 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:inc": { 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.745 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277007671 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 41432 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71078129 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:kv": { 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 322961408 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.748 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 184671781 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71180763 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb": { 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "compact": { 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_len": { 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_merge": { 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_range": { 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "get_latency": { 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 44173, 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 187411249 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_delay_time": { 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_memtable_time": { 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_pre_and_post_time": { 2024-09-10T17:56:15.752 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_wal_time": { 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_latency": { 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_sync_latency": { 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2159, 2024-09-10T17:56:15.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 674369994 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "election_call": { 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "election_lose": { 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "election_win": { 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_elections": { 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": { 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "session_add": { 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "session_rm": { 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 53 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "session_trim": { 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.755 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "paxos": { 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "accept_timeout": { 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "begin": { 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 871 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_bytes": { 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 871, 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4172922 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_keys": { 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.756 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_latency": { 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 871, 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 189995671 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "collect": { 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_bytes": { 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 146 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_keys": { 2024-09-10T17:56:15.757 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_latency": { 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 999978 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_timeout": { 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_uncommitted": { 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "commit": { 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 872 2024-09-10T17:56:15.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_bytes": { 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_keys": { 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_latency": { 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_ack_timeout": { 2024-09-10T17:56:15.759 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_timeout": { 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn": { 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn_latency": { 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh": { 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 872 2024-09-10T17:56:15.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh_latency": { 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 872, 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1888956925 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "restart": { 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state": { 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_bytes": { 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_keys": { 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "start_leader": { 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "start_peon": { 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state": { 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 872 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.762 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_bytes": { 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 872, 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8182211 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_keys": { 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 872, 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5827 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_latency": { 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 872, 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 427990236 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache": { 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:15.763 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1020054731 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42811392 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33808384 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2147483648 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9003008 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:full": { 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277006596 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.765 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 308236 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.766 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 70812400 2024-09-10T17:56:15.767 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:inc": { 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277006596 2024-09-10T17:56:15.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43871 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71076765 2024-09-10T17:56:15.770 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:kv": { 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 322961408 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 184671064 2024-09-10T17:56:15.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.773 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71181480 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb": { 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "compact": { 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_len": { 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_merge": { 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.774 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_range": { 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "get_latency": { 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 37272, 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85995624 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_delay_time": { 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_memtable_time": { 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.775 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_pre_and_post_time": { 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_wal_time": { 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_latency": { 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_sync_latency": { 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1898, 2024-09-10T17:56:15.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 718191754 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.ddb55796e0023ab827f1fac99ce57bb7a1696db8": { 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: "election_call": { 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: "election_lose": { 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: "election_win": { 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "num_elections": { 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": { 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "session_add": { 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "session_rm": { 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 80 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "session_trim": { 2024-09-10T17:56:15.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "paxos": { 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "accept_timeout": { 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "begin": { 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 860 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_bytes": { 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 860, 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4145481 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_keys": { 2024-09-10T17:56:15.779 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_latency": { 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 860, 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 296997830 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "collect": { 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_bytes": { 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.780 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_keys": { 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_latency": { 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 999993 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_timeout": { 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_uncommitted": { 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.781 INFO:tasks.workunit.client.0.smithi012.stdout: "commit": { 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 861 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_bytes": { 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_keys": { 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_latency": { 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.782 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_ack_timeout": { 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_timeout": { 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn": { 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn_latency": { 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh": { 2024-09-10T17:56:15.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 861 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh_latency": { 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 861, 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2141984364 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "restart": { 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state": { 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_bytes": { 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.784 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_keys": { 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "start_leader": { 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "start_peon": { 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state": { 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 861 2024-09-10T17:56:15.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_bytes": { 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 861, 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8129616 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_keys": { 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 861, 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5747 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_latency": { 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 861, 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 539996053 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache": { 2024-09-10T17:56:15.786 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1020054731 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 41754624 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33890304 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2147483648 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7864320 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:full": { 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277006596 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.788 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 308236 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.789 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 70812400 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:inc": { 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277006596 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43871 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.792 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71076765 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:kv": { 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 322961408 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.794 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 184671064 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.796 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71181480 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb": { 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "compact": { 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_len": { 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_merge": { 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.797 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_range": { 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "get_latency": { 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 37025, 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 102025856 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_delay_time": { 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_memtable_time": { 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.798 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_pre_and_post_time": { 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_wal_time": { 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_latency": { 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_sync_latency": { 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1849, 2024-09-10T17:56:15.799 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 907817940 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.0": { 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:15.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:15.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7827456 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:15.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4071424 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3932160 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:15.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:15.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:15.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:15.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:15.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.808 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 11837440 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1392640 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 78103 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.809 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:15.810 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 26, 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 72192 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 947, 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 533738301 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:15.811 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 939, 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22814678 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 947, 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1017369 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 947, 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 534755670 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.812 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42208 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 8, 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23110 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 4, 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10111 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3982 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 343 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.814 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 130, 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3133510 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 343, 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 377712 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 213, 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3725427 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 101, 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5518611 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3813075521 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 129, 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15556239 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:15.816 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 129, 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 393405029838 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 129, 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 161598781700 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 84021101362 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 179232 2024-09-10T17:56:15.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 239082660 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2717244946 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 504554 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1395118607 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 384382042 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 940345 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 63, 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 315714 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:15.819 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8549158846 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 421615606 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 280557715 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:15.820 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1862399738 2024-09-10T17:56:15.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.821 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:15.821 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 48889856 2024-09-10T17:56:15.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.821 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:15.821 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 48513024 2024-09-10T17:56:15.824 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.824 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:15.824 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3138477772 2024-09-10T17:56:15.824 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 376832 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85509049 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 622592 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73251911 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.828 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641317867 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.829 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.830 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71711685 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 57006032 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.832 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.833 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68822624 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.834 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641317867 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2398 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5995 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 369353 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.836 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71336067 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:15.838 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 616 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:15.839 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 6, 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 48550994 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 7, 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5229908 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 6, 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 17140844 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.840 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:15.841 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 616 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 6, 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 48550994 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.844 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 7, 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5229908 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 6, 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 17140844 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.845 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1771104 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33251328 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.846 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.1": { 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:15.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2514944 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1593344 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:15.849 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1454080 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.850 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.851 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:15.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.854 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4046848 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:15.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 786432 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 266146 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:15.856 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 30, 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85055 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.857 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 88355756 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 338, 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10587146 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:15.858 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 400564 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 88756320 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 38119 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.859 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 4, 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8610 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:15.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12108 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 850 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 249 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 145, 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5933249 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 369, 2024-09-10T17:56:15.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 373823 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 224, 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6329059 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 108726 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.862 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13830934 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 127, 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8482060 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 126, 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 283464821499 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 127, 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 165507606897 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.863 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 417, 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 79773327154 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 417, 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42744 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 462324 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.864 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 163669393 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 147092 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73931911 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 21967096 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:15.865 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348882 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 60, 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 323439 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 273921876 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26812230 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.866 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2683852 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1862399738 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 44695552 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43827200 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.867 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3138477772 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 868352 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.868 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85553762 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 16384 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73813406 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.871 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641653220 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.873 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71376332 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 57035841 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.875 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.876 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68792815 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.877 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641653220 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.878 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 235958 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.879 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71142502 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.880 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 36 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.881 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 157 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2429467 2024-09-10T17:56:15.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 157, 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 649765471 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1041 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 157, 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 60852268 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 157, 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 193676400 2024-09-10T17:56:15.883 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 33, 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6571973 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1041 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.884 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 33, 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5924928 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 33, 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5047911 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.885 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 22, 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 20366706 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:15.886 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 22, 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8492844 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 22, 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 19221666 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 102 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2429467 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:15.887 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 622826792 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46434496 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 169406823 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.888 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 590368 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28454912 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.889 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.2": { 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.890 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2146304 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.891 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1331200 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:15.892 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1191936 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:15.893 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.894 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:15.895 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:15.896 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.897 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3416064 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:15.898 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 778240 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 4, 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 201130 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:15.899 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 12, 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 16233 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.900 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 278, 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 64213376 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 268, 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9072375 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 278, 2024-09-10T17:56:15.901 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 371629 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 278, 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 64585005 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 35534 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:15.902 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1196 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6779 2024-09-10T17:56:15.903 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 618 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 224 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 99, 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1471813 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 272, 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 304373 2024-09-10T17:56:15.904 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 173, 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1552101 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 118632 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 18461734 2024-09-10T17:56:15.905 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 120, 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7651558 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 119, 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 234127575313 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 120, 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 156729414104 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 341, 2024-09-10T17:56:15.906 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 86235845563 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 341, 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 105795 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2208120 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 146915205 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:15.907 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 122354 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73751102 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 20205924 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348976 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.908 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 54, 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 279240 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 261591423 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23807833 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2456149 2024-09-10T17:56:15.909 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1862399738 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43368448 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42041344 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3138477772 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.910 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1327104 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.911 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85554533 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.912 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.913 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73816731 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.914 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641659000 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.915 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.916 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71370552 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.917 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 57036355 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.918 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.919 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68792301 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:15.920 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641659000 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.921 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 227436 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.922 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71145244 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:15.923 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:15.924 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:15.925 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 74797327 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5212205 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:15.926 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 62332133 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.927 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.928 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.929 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 74797327 2024-09-10T17:56:15.930 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5212205 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 62332133 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:15.931 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28446720 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.932 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.3": { 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.933 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6180864 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:15.934 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3153920 2024-09-10T17:56:15.935 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3014656 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:15.936 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:15.937 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.938 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5555 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5555 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.939 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:15.940 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9273344 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.941 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 802816 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.942 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6312 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:15.943 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 723, 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 498785257 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 716, 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22400891 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.944 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 723, 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 821542 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 723, 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 499606799 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 35576 2024-09-10T17:56:15.945 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1812 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:15.946 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9653 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3476 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 329 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 97, 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1001408 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 174, 2024-09-10T17:56:15.947 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 319663 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 77, 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 402201 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 100, 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5501651 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.948 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3947447091 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 60, 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 60456527 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 57, 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 323726508724 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 60, 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 78938894214 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.949 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3340, 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1483103914 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3340, 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 211473 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 111848693 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.950 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2809982352 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 544418 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1529832326 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 388442739 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.951 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 351983 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 51, 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 271537 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8787817895 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 427256618 2024-09-10T17:56:15.952 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 285504957 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1862399738 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 44695552 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 44490752 2024-09-10T17:56:15.953 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3138477772 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 204800 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.954 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85548227 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.955 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.956 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73835325 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.957 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641611707 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.958 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.959 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71417845 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.960 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 57032151 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.961 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.962 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68796505 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.963 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641611707 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.964 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5826 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 342617 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.965 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71071530 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.966 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 37 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:15.967 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.968 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 826300 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.969 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.970 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:15.971 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.972 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.973 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 826300 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.974 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28467200 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.975 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.4": { 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.976 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1376256 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.977 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 995328 2024-09-10T17:56:15.978 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 856064 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:15.979 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:15.980 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.981 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.982 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.983 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2310144 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:15.984 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 802816 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 8, 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 332958 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:15.985 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 11366 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.986 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 196, 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 54882494 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 191, 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4791728 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 196, 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 196690 2024-09-10T17:56:15.987 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 196, 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 55079184 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31494 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:15.988 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1090 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:15.989 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13431 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 404 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 247 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1415211 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 175, 2024-09-10T17:56:15.990 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 248632 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 73, 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 667742 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 133352 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.991 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6046233 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 50, 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14752903 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 49, 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 241484030870 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 50, 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 74202779421 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.992 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 276, 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 594086 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 276, 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27314 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 280002 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.993 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 165499229 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 86542 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73863595 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15275698 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.994 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 349976 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 48, 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 216080 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 261002080 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 18222452 2024-09-10T17:56:15.995 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2161928 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1861407221 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43433984 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:15.996 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42582016 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3137310105 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 851968 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:15.997 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85494333 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:15.998 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8192 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:15.999 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73881027 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.000 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641207504 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.001 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.002 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71822048 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.003 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 56996222 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.004 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.005 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68832434 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:16.006 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641207504 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.007 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 239678 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.008 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71584498 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:16.009 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:16.010 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.011 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6555061 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 736346 2024-09-10T17:56:16.012 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6453709 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.013 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.014 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:16.015 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:16.016 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6555061 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 736346 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:16.017 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6453709 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.018 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28471296 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.5": { 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:16.019 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.020 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6508544 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.021 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3457024 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3317760 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.022 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:16.023 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:16.024 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:16.025 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.026 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.027 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9904128 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 790528 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:16.028 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 4, 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 93814 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.029 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4733 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 797, 2024-09-10T17:56:16.030 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 471839084 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 794, 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 20453702 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 797, 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 694658 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 797, 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 472533742 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:16.031 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 34284 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 976 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.032 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4737 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3465 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 353 2024-09-10T17:56:16.033 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 96, 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 894255 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 157, 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 339638 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 61, 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 397019 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.034 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 103, 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7559405 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3846291198 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 47, 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26220643 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:16.035 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 44, 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 249775699754 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 47, 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 75434735753 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3376, 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7854137763 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3376, 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 179920 2024-09-10T17:56:16.036 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 100079328 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2463999079 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 459390 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:16.037 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1305788977 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 373004020 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 351103 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 39, 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 169676 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.038 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8089361610 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 408993572 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 273388461 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:16.039 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1861407221 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46727168 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46014464 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3137310105 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 712704 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.040 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85488320 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.042 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73895232 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.043 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641162406 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.044 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.045 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71867146 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.046 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 56992213 2024-09-10T17:56:16.047 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.048 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.049 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68836443 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.050 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641162406 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.051 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 354252 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.052 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71515022 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.053 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:16.054 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.056 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.057 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.058 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.059 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:16.060 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.061 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 32649216 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.6": { 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:16.062 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.063 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7282688 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:16.064 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4235264 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096000 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:16.065 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:16.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:16.067 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.068 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.069 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 11456512 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1380352 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.071 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.072 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6194 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.073 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 987, 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 504687439 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 972, 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27152255 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 987, 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 782993 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 987, 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 505470432 2024-09-10T17:56:16.074 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 47645 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1070 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:16.075 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9524 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3481 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.076 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 361 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 98, 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 792572 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 153, 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 370929 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 55, 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 384067 2024-09-10T17:56:16.077 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 100, 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10218615 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3969482641 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 40, 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 37112336 2024-09-10T17:56:16.078 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 40, 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 410112102456 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 40, 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65814702281 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1728442316 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.079 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 197016 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6353223 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2806169708 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 504859 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.080 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1424784357 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 387532678 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 941643 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 33, 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 134840 2024-09-10T17:56:16.081 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8594568318 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 427260213 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 270812940 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:16.082 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1861407221 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46792704 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46186496 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3137310105 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 606208 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.083 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85488281 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.084 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.085 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.086 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73895271 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.087 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641162109 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.088 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.089 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71867443 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.090 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 56992187 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.091 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.092 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68836469 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.093 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641162109 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2363 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3545 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.094 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5908 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 342694 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.095 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71515061 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:16.096 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:16.097 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2810 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71725643 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.098 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 15, 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9222204 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39568168 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.099 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:16.100 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.102 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2810 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71725643 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 15, 2024-09-10T17:56:16.103 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9222204 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39568168 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.104 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33239040 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.7": { 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.105 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.106 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5898240 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.107 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2879488 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2740224 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:16.108 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:16.109 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:16.110 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5552 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.111 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5552 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.112 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.113 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8716288 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1380352 2024-09-10T17:56:16.114 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 257300 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.115 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 41099 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.116 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 656, 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 487462521 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 652, 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23217298 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 656, 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 514050 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 656, 2024-09-10T17:56:16.117 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 487976571 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33419 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1072 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:16.118 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3703 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3757 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:16.119 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 392 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 131, 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2875047 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 208, 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 359679 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 77, 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2027557 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.120 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5502000 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3878292756 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 26, 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 17514384 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.121 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 26, 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 320417833127 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 26, 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45485626717 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1179793757 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 168248 2024-09-10T17:56:16.122 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 162288334 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2579531901 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 447999 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.123 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1478897893 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 368754088 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 939890 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 25, 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 111452 2024-09-10T17:56:16.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8467994731 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 401951869 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 283365023 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:16.125 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1861407221 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45678592 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45105152 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3137310105 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 573440 2024-09-10T17:56:16.126 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85478833 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.127 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.128 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 143360 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.129 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73761359 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641091252 2024-09-10T17:56:16.130 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.131 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.132 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71938300 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.133 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 56985889 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.134 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.135 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68842767 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.136 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641091252 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.137 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 365901 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.138 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71574527 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.139 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 115 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:16.140 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 115, 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 84642076 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 265066 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.141 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 117, 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26845345 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 115, 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 61712151 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 80 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 80, 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12164042 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.142 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 265066 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 80, 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10732404 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 80, 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8748472 2024-09-10T17:56:16.143 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 30 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 30, 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28423373 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.144 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 30, 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12801593 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 30, 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26579505 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:16.145 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 44054661 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 7, 2024-09-10T17:56:16.146 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3311348 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26384174 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:16.147 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 29044736 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: "pools": [ 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr" 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.148 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 1, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 1, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 1, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296251146, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 1781760, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:16.149 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 1781760, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098763264, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 2, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 2.443116500217002e-06, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 394, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 598016, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 590368, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 590368, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 1771104, 2024-09-10T17:56:16.150 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 219, 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 2473984 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:16.151 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 32, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 32, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 2, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296251146, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 98304, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 98304, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098763264, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 22, 2024-09-10T17:56:16.152 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 1.3479292704232648e-07, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 3428, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 3428, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 10284, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 51, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 20480 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:16.153 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 64, 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 64, 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 3, 2024-09-10T17:56:16.154 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296251146, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098763264, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 0.0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:16.155 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 0 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:16.156 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd" 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 8, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 8, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 4, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296251146, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 12288, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:16.157 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 12288, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098763264, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 2, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 1.684911943300449e-08, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 19, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 19, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:16.158 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 57, 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 2, 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 2048 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd": { 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: "mirroring_by_pool": [ 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: false 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_images_by_pool": [ 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.159 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pools": 1 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "report_id": "c90c0484-59f6-4fbf-bb6e-84e822e60bed", 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "report_timestamp": "2024-09-10T17:56:15.283177", 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "report_version": 1, 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_stats": { 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "7.9.2" 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "rook": { 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster": { 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "external-mode": null, 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "allow-multiple-per-node": null, 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "count": null, 2024-09-10T17:56:16.160 INFO:tasks.workunit.client.0.smithi012.stdout: "max-id": null, 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "pvc": { 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": null 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "stretch": { 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": null 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "network": { 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "provider": null 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "storage": { 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "device-set": { 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:16.161 INFO:tasks.workunit.client.0.smithi012.stdout: "non-portable": null, 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: "portable": null, 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: "total": null 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: "csi": { 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: "kubernetes": { 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: "node": { 2024-09-10T17:56:16.162 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "kubernetes-total": null, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "with-ceph-daemons": null, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-cephfs-plugin": null, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-nfs-plugin": null, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-rbd-plugin": null 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "usage": { 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "storage-class": { 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": null, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs": null, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "nfs": null, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd": null, 2024-09-10T17:56:16.163 INFO:tasks.workunit.client.0.smithi012.stdout: "total": null 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: "services": {}, 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_per_pg": [ 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.164 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.636912+0000", 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.636912+0000", 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.637199+0000", 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.165 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.166 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3f", 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000", 2024-09-10T17:56:16.167 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.169 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.170 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.171 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639677+0000", 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639677+0000", 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640227+0000", 2024-09-10T17:56:16.172 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.173 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3e", 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.174 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000", 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.178 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:16.179 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.634668+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.634668+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.634939+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:16.180 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.181 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3d", 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000", 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.184 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.185 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.186 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.651762+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.651762+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.652074+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:16.187 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.188 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3c", 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000", 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.191 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.192 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.193 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.636370+0000", 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.636370+0000", 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.637379+0000", 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.194 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.195 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3b", 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.196 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000", 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.199 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.200 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.645786+0000", 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.645786+0000", 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.646980+0000", 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:16.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.202 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3a", 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.203 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000", 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.206 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.207 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.527295+0000", 2024-09-10T17:56:16.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.527295+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.527641+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:16.209 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.39", 2024-09-10T17:56:16.210 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 32, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:05:12.311291+0000", 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.214 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.215 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.644853+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.644853+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.645147+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:16.216 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.217 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.38", 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000", 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.221 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.222 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642731+0000", 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642731+0000", 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643055+0000", 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.224 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.37", 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000", 2024-09-10T17:56:16.225 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.228 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.229 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.232 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.232 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.232 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.232 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.232 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.232 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642404+0000", 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642404+0000", 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642693+0000", 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.233 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.234 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.36", 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000", 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.235 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.236 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.237 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.238 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.239 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641622+0000", 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641622+0000", 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.641932+0000", 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:16.240 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.241 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.35", 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.242 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000", 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.243 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.244 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.245 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.246 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.527109+0000", 2024-09-10T17:56:16.247 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.527109+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.527604+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:16.248 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.249 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.34", 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 20, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000", 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.250 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.251 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.252 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.253 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.254 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641524+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641524+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642786+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.255 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.256 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.33", 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000", 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.257 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.258 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.259 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.260 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.261 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.638816+0000", 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.638816+0000", 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.639101+0000", 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.262 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.263 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.32", 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000", 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.264 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.265 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.266 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.267 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.268 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.640599+0000", 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.640599+0000", 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640880+0000", 2024-09-10T17:56:16.269 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.270 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.31", 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.271 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000", 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.272 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.273 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.274 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.275 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.276 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.646649+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.646649+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.646904+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.277 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.278 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.30", 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000", 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.279 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.280 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.281 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.282 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.283 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.651519+0000", 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.651519+0000", 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.651784+0000", 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.284 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.285 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2f", 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000", 2024-09-10T17:56:16.286 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.287 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.290 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.636034+0000", 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.636034+0000", 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.636540+0000", 2024-09-10T17:56:16.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.292 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2e", 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.293 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000", 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.297 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.298 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642454+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642454+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642764+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.300 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2d", 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000", 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.301 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.304 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.305 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.305 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.305 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.305 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.305 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.306 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.644155+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.644155+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.644420+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.308 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2c", 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000", 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.312 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.313 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.631291+0000", 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.631291+0000", 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.631587+0000", 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.315 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2b", 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000", 2024-09-10T17:56:16.316 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.320 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.635566+0000", 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.635566+0000", 2024-09-10T17:56:16.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.635863+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:16.322 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2a", 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.323 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000", 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.327 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.328 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.640887+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.640887+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.641463+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.330 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.29", 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000", 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.334 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.335 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.648476+0000", 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.648476+0000", 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.648810+0000", 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.337 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.28", 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000", 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.338 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.341 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.342 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643540+0000", 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643540+0000", 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643794+0000", 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.344 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.27", 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.345 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000", 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.349 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.650207+0000", 2024-09-10T17:56:16.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.650207+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.650553+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:16.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.352 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.26", 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000", 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.356 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.357 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641158+0000", 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641158+0000", 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.641442+0000", 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.359 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.25", 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000", 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.360 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.363 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.364 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643999+0000", 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643999+0000", 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.644997+0000", 2024-09-10T17:56:16.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.366 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.24", 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.367 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000", 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.371 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.632680+0000", 2024-09-10T17:56:16.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.632680+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.632927+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.374 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.23", 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000", 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.378 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.379 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.648448+0000", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.648448+0000", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.648726+0000", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:16.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.381 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.22", 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000", 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.382 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.385 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.386 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.634622+0000", 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.634622+0000", 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.634918+0000", 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:16.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.388 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.21", 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.389 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000", 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.393 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:16.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641786+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641786+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642111+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.396 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.20", 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000", 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.400 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.401 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.631529+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.631529+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.632064+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:16.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.403 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1a", 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000", 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.404 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.407 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.408 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.191998+0000", 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.191998+0000", 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192274+0000", 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.409 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.410 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1b", 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.411 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000", 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.412 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.413 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.415 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.204905+0000", 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.204905+0000", 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.205276+0000", 2024-09-10T17:56:16.416 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:16.417 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1b", 2024-09-10T17:56:16.418 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 20, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000", 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.419 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.420 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.421 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.422 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.423 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190437+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190437+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190911+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.424 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:16.425 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1a", 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000", 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.429 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.430 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.192199+0000", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.192199+0000", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192952+0000", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:16.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.432 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.19", 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000", 2024-09-10T17:56:16.433 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.436 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.436 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.437 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.438 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.439 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.440 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.646321+0000", 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.646321+0000", 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.646604+0000", 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:16.441 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.442 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.18", 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.443 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000", 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.447 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.194106+0000", 2024-09-10T17:56:16.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.194106+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.194360+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.449 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.450 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.18", 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000", 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.454 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.455 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.637615+0000", 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.637615+0000", 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.637886+0000", 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:16.457 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.458 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.19", 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000", 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.459 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.463 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.464 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.192223+0000", 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.192223+0000", 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.193200+0000", 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:16.466 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.467 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.17", 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000", 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.468 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.472 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.473 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.645661+0000", 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.645661+0000", 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.646338+0000", 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.475 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.16", 2024-09-10T17:56:16.476 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000", 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.477 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.481 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.482 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.192132+0000", 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.192132+0000", 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192408+0000", 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:16.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.485 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.16", 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000", 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.486 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.490 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.491 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639958+0000", 2024-09-10T17:56:16.492 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639958+0000", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.641531+0000", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.493 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.494 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.17", 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000", 2024-09-10T17:56:16.495 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.496 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.497 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.499 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.500 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.188019+0000", 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.188019+0000", 2024-09-10T17:56:16.501 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.188432+0000", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.502 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 3, 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.503 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 3, 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.15", 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 29, 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000", 2024-09-10T17:56:16.504 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 90, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.505 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.506 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.507 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 4, 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 1 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.508 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'3" 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.509 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641201+0000", 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641201+0000", 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642140+0000", 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.510 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.511 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.512 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.14", 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000", 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.513 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.514 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.515 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.516 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.517 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.518 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190315+0000", 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190315+0000", 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190637+0000", 2024-09-10T17:56:16.519 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.520 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 12, 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.521 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 12, 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.14", 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 38, 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000", 2024-09-10T17:56:16.522 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 2630, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.523 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 12, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 4, 2024-09-10T17:56:16.524 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 4, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.525 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 12, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 9 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.526 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "75'12" 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.527 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.528 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.646127+0000", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.646127+0000", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.647058+0000", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:16.529 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.530 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.15", 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.531 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000", 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.532 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.533 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.534 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.537 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.196798+0000", 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.196798+0000", 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.197133+0000", 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.538 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.539 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.13", 2024-09-10T17:56:16.540 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000", 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 34, 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.541 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.542 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.543 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 7 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.545 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.546 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.632648+0000", 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.632648+0000", 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.632963+0000", 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.547 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.548 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.549 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.12", 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000", 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.550 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.551 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.552 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.554 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.555 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190637+0000", 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190637+0000", 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190919+0000", 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:16.556 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:16.557 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.558 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.12", 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000", 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.559 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.560 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.561 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.563 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.564 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.565 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.636759+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.636759+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.637441+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:16.566 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.567 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.13", 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.568 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000", 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.569 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.570 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.573 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.574 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.191743+0000", 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.191743+0000", 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192102+0000", 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.575 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.576 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.577 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.11", 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000", 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.578 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.579 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.582 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.583 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639840+0000", 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639840+0000", 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640124+0000", 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.584 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.585 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.10", 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.586 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000", 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.587 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.588 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.589 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.591 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.592 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190916+0000", 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190916+0000", 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.191246+0000", 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:16.593 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:16.594 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 8, 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 8, 2024-09-10T17:56:16.595 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.10", 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 34, 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000", 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.596 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.597 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 12, 2024-09-10T17:56:16.598 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 4, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 4, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 4, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 12, 2024-09-10T17:56:16.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'8" 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.601 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.602 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.647020+0000", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.647020+0000", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.647318+0000", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:16.603 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.604 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.11", 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.605 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000", 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.606 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.610 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:16.611 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.193894+0000", 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.193894+0000", 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.194263+0000", 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:16.612 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:16.613 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.614 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.f", 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000", 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.615 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 22, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 1, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 1 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.619 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.620 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.204953+0000", 2024-09-10T17:56:16.621 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.204953+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.205325+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.623 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.624 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.624 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.e", 2024-09-10T17:56:16.624 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.624 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.624 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.624 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 20, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000", 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.625 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.629 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.629 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.629 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.630 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.191684+0000", 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.191684+0000", 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.191958+0000", 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:16.631 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:16.632 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.e", 2024-09-10T17:56:16.633 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000", 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.634 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.640 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.641 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.642 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.643 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.648574+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.648574+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.648857+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:16.644 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.645 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.f", 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.646 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.647 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.647 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.647 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000", 2024-09-10T17:56:16.647 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.647 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.647 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.648 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.648 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.648 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.648 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.648 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.648 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.649 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.649 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.649 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.649 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.649 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.649 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.650 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.650 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.650 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.650 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.650 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.650 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.650 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.651 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.651 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.651 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.651 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.651 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.651 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.652 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.652 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.652 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.652 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.652 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.652 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.654 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.654 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.655 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.655 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.656 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.656 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.656 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.657 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.657 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.657 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.658 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.658 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.658 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.658 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.658 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.659 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.659 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.659 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.659 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.659 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.659 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.660 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.660 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.660 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.660 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.184643+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.184643+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.185952+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.661 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.662 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.d", 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000", 2024-09-10T17:56:16.663 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 70, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.666 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 1, 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 1 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.667 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.668 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.669 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.669 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.669 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.669 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:16.669 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.650072+0000", 2024-09-10T17:56:16.669 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.650072+0000", 2024-09-10T17:56:16.669 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.651773+0000", 2024-09-10T17:56:16.669 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:16.670 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:16.671 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.671 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.671 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.671 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.671 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.672 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.672 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.672 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.672 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.672 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.672 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.672 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.c", 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000", 2024-09-10T17:56:16.673 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.675 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.676 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.677 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:16.678 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190976+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190976+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.191363+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:16.679 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.680 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.c", 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000", 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.684 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.685 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643274+0000", 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643274+0000", 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643612+0000", 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.687 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.d", 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.688 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000", 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.692 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.693 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:45.957358+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:45.957358+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.302350+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.694 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.695 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.5", 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:08:01.978582+0000", 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.001023278, 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.696 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.697 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.698 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.699 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.700 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 19, 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:12.719452+0000", 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:12.719452+0000", 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:12.719807+0000", 2024-09-10T17:56:16.701 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:50:14.084625+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:50:14.084625+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 58, 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:50:14.084625+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.702 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 148, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 57, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 148, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "1.0", 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.703 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 345, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000", 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 590368, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 1771104, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 6, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 394, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 584, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 219, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 2416 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.707 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "75'148" 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.708 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.195203+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.195203+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.195598+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:16.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.710 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.3", 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000", 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.711 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.715 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.644205+0000", 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.644205+0000", 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.644934+0000", 2024-09-10T17:56:16.716 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:16.717 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2", 2024-09-10T17:56:16.718 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000", 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.719 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.722 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:16.723 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:45.961914+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:45.961914+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.303137+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:16.724 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.725 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.6", 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:24:53.216058+0000", 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000275601, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.726 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.727 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.728 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.729 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.730 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.527470+0000", 2024-09-10T17:56:16.731 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.527470+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.527840+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.732 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.733 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.0", 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 20, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000", 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.734 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.735 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.736 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.737 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.738 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.632549+0000", 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.632549+0000", 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.632868+0000", 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.739 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.740 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1", 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.741 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000", 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.744 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.745 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:46.005227+0000", 2024-09-10T17:56:16.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:46.005227+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.198782+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:16.747 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.748 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.7", 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:18:51.873480+0000", 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000733605, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.752 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.753 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190261+0000", 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190261+0000", 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190567+0000", 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.754 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.755 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1", 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.756 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000", 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.760 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.761 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.638567+0000", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.638567+0000", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.638839+0000", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:16.762 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.763 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.0", 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.764 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000", 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.768 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.769 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:45.961040+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:45.961040+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.198381+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.770 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.771 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.4", 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:57:34.194479+0000", 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000460835, 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.774 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.775 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.776 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.192979+0000", 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.192979+0000", 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.193278+0000", 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.777 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.778 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.2", 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.779 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000", 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.780 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.781 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.782 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.783 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.784 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639996+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639996+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640516+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:16.785 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.786 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3", 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000", 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.787 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.788 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.789 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.791 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:46.005011+0000", 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:46.005011+0000", 2024-09-10T17:56:16.792 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.198385+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:16.793 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.2", 2024-09-10T17:56:16.794 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:18:31.979953+0000", 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000621335, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 19, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.795 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.797 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 2, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 2 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.798 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "74'2" 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.799 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.193487+0000", 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.193487+0000", 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.193781+0000", 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.800 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.801 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.4", 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000", 2024-09-10T17:56:16.802 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.803 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.804 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.805 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.806 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.807 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.647630+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.647630+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.647909+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:16.808 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.809 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.5", 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000", 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.810 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.811 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.812 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.814 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:46.005071+0000", 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:46.005071+0000", 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.302596+0000", 2024-09-10T17:56:16.815 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:16.816 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.3", 2024-09-10T17:56:16.817 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 22, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:24:21.200358+0000", 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000456615, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.818 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.819 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.820 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.821 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "72'1" 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.822 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.200402+0000", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.200402+0000", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200712+0000", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:16.823 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.824 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.5", 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000", 2024-09-10T17:56:16.825 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.826 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.827 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.828 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.829 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:16.830 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642792+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642792+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643072+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.831 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.832 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.4", 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000", 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.833 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.834 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.835 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.836 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.837 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:45.959700+0000", 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:45.959700+0000", 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.199886+0000", 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.838 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.839 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.0", 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.840 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:16.841 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.841 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:56:08.618711+0000", 2024-09-10T17:56:16.841 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.001168997, 2024-09-10T17:56:16.841 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.841 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.841 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.841 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.841 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.844 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.845 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.846 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.848 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.191662+0000", 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.191662+0000", 2024-09-10T17:56:16.849 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192033+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:16.850 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.6", 2024-09-10T17:56:16.851 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000", 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.852 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.853 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.854 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 1, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.855 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.856 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.635320+0000", 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.635320+0000", 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.635594+0000", 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.857 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.858 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.7", 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.859 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000", 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.860 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.861 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.862 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.863 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:16.864 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:46.005109+0000", 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:46.005109+0000", 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.197168+0000", 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.865 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.866 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.1", 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:16.867 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:27:08.888245+0000", 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000616993, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.868 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.869 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.870 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:16.871 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.872 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.194107+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.194107+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.194453+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:16.873 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.874 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.7", 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000", 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.875 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.876 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.877 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:16.878 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.879 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.631299+0000", 2024-09-10T17:56:16.880 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.631299+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.631701+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.881 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.882 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.6", 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000", 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.883 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.884 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.885 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.886 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.887 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.199847+0000", 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.199847+0000", 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200196+0000", 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.888 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.889 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.8", 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.890 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000", 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.891 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.892 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.893 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.894 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.895 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643016+0000", 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643016+0000", 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643274+0000", 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.897 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.9", 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.898 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000", 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.899 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.900 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.901 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.902 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.903 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.194698+0000", 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.194698+0000", 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.195088+0000", 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.904 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.905 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.9", 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.906 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000", 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.907 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.908 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.909 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:16.910 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.911 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642643+0000", 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642643+0000", 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643179+0000", 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:16.912 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.913 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.914 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.8", 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000", 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.915 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.916 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.917 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.918 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.919 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:16.920 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.188465+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.188465+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.188755+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.921 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.922 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.a", 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000", 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.923 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.924 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.925 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.926 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.927 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.635118+0000", 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.635118+0000", 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.635509+0000", 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:16.928 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:16.929 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.b", 2024-09-10T17:56:16.930 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000", 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.931 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.932 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.933 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.934 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.935 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.200153+0000", 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.200153+0000", 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200921+0000", 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.936 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.937 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.b", 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.938 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000", 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.939 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.940 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 1, 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:16.942 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.943 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643355+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643355+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643628+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.944 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.945 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.a", 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000", 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.946 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.947 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.949 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.950 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.652164+0000", 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.652164+0000", 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.652448+0000", 2024-09-10T17:56:16.951 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:16.952 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1d", 2024-09-10T17:56:16.953 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000", 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.954 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.955 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.957 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.958 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.199765+0000", 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.199765+0000", 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200230+0000", 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.959 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.960 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1c", 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.961 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000", 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.962 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:16.965 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.966 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.652354+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.652354+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.652608+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.967 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.968 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1c", 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000", 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.969 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.970 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.972 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.973 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.200429+0000", 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.200429+0000", 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200731+0000", 2024-09-10T17:56:16.974 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.975 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1d", 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.976 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000", 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.977 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:16.980 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.981 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639462+0000", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639462+0000", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640232+0000", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:16.982 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.983 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1f", 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000", 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.984 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.985 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.987 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.988 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.189957+0000", 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.189957+0000", 2024-09-10T17:56:16.989 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190257+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:16.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.991 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1e", 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000", 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:16.992 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:16.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:16.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:16.995 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:16.996 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.635894+0000", 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.635894+0000", 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.636289+0000", 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:16.997 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:16.998 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1e", 2024-09-10T17:56:16.999 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000", 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.003 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.004 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.194232+0000", 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.194232+0000", 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.194542+0000", 2024-09-10T17:56:17.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:17.006 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 4, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 4, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1f", 2024-09-10T17:56:17.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 30, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000", 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 582, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 4, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 1 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.011 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'4" 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_per_pool": [ 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 24, 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:17.012 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd" 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 3, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pg": 8, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 8, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 3, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "poolid": 4, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 19, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.013 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:17.014 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 2, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 2 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.016 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 12288, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 57, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 24 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.017 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 192, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pg": 64, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 8, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "poolid": 3, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.019 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.020 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:17.021 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 0, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 192 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 96, 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:17.022 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 45, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pg": 32, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 8, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 45, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "poolid": 2, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 3428, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 66, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 22, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 22, 2024-09-10T17:56:17.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 14, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 51, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 20 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 98304, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:17.026 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 10284, 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 96 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 3, 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr" 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 148, 2024-09-10T17:56:17.027 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pg": 1, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 3, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 148, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "poolid": 1, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 590368, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 1771104, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.028 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.029 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 6, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 394, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 584, 2024-09-10T17:56:17.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 219, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 2416 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 1781760, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 1771104, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:17.031 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 3 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "usage": { 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 105, 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "pools": 4, 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_by_class": { 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "ssd": { 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "total_avail_bytes": 767718260736, 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "total_bytes": 767960285184, 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_bytes": 242024448, 2024-09-10T17:56:17.032 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_raw_bytes": 242024448, 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_raw_ratio": 0.00031515228329226375 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout: "total_avail_bytes": 767718260736, 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout: "total_bytes": 767960285184, 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_bytes": 242024448 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout:} 2024-09-10T17:56:17.033 INFO:tasks.workunit.client.0.smithi012.stdout:Device report is generated separately. To see it run 'ceph telemetry show-device'. 2024-09-10T17:56:17.034 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph telemetry show-device 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='client.24764 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='client.24764 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/800011229' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/800011229' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='client.24764 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='client.24764 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/800011229' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/800011229' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:15 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:16 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.044 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='client.24764 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='client.24764 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/800011229' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/800011229' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:17.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:17.047 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:17.047 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:17.047 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:17.047 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.047 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:15 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:17.047 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2024-09-10T17:56:17.047 INFO:tasks.workunit.client.0.smithi012.stdout: "f7408896-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:17.047 INFO:tasks.workunit.client.0.smithi012.stdout: "INTEL_SSDPEDMD400G4_f7421396-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "20240910-175016": { 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "device": { 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "info_name": "/dev/nvme0n1", 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "/dev/nvme0n1", 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "protocol": "NVMe", 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "nvme" 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "firmware_version": "8DV101H0", 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "host_id": "f7408896-6f9d-11ef-b721-ac1f6bf825ea", 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: "json_format_version": [ 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.048 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "local_time": { 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "asctime": "Tue Sep 10 17:50:15 2024 UTC", 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "time_t": 1725990615 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "logical_block_size": 512, 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_controller_id": 0, 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_namespaces": [ 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "capacity": { 2024-09-10T17:56:17.049 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "formatted_lba_size": 512, 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 1, 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "size": { 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "utilization": { 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.050 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_number_of_namespaces": 1, 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_pci_vendor": { 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 32902, 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "subsystem_id": 32902 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_add_log": { 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "Device stats": { 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_fw_downgrades": { 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "crc_error_count": { 2024-09-10T17:56:17.051 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "end_to_end_error_detection_count": { 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "erase_fail_count": { 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "host_bytes_written": { 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.052 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 38262821 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "host_ctx_wear_used": { 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 1 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "media_bytes_read": { 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "nand_bytes_written": { 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 58635234 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.053 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_stat_indicator": { 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "pll_lock_loss_count": { 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "program_fail_count": { 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "re_alloc_sectr_cnt": { 2024-09-10T17:56:17.054 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "retry_buffer_overflow_count": { 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "soft_ecc_err_rate": { 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "thermal_throttle_status": { 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:17.055 INFO:tasks.workunit.client.0.smithi012.stdout: "cnt": 0, 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "pct": 0 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_host_reads": { 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_media_wear": { 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": "63.999023" 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_timer": { 2024-09-10T17:56:17.056 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "unexp_power_loss": { 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "wear_leveling": { 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 88, 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "avg": 3842, 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "max": 3861, 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 3823 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.057 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel Smart log": "nvme0n1" 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_log": { 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare": 100, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare_threshold": 10, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "controller_busy_time": 11, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "critical_warning": 0, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_read": 441908119, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_written": 2507592278, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "host_reads": 6653040893, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "host_writes": 40196130890, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "media_errors": 0, 2024-09-10T17:56:17.058 INFO:tasks.workunit.client.0.smithi012.stdout: "num_err_log_entries": 0, 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "percentage_used": 12, 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycles": 45671, 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_hours": 64317, 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": 22, 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "unsafe_shutdowns": 410 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_vendor": "intel", 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_version": { 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "string": "<1.2", 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycle_count": 45671, 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_time": { 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: "hours": 64317 2024-09-10T17:56:17.059 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "serial_number": "deleted", 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "smart_status": { 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme": { 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "passed": true 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl": { 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "argv": [ 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl", 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "-x", 2024-09-10T17:56:17.060 INFO:tasks.workunit.client.0.smithi012.stdout: "--json=o", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "/dev/nvme0n1" 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "build_info": "(local build)", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "exit_status": 0, 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "output": [ 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.0-505.el9.x86_64] (local build)", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF INFORMATION SECTION ===", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "Serial Number: deleted", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Version: 8DV101H0", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-09-10T17:56:17.061 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller ID: 0", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "NVMe Version: <1.2", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Number of Namespaces: 1", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Local Time is: Tue Sep 10 17:50:15 2024 UTC", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Updates (0x02): 1 Slot", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Log Page Attributes (0x02): Cmd_Eff_Lg", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.062 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported Power States", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 512 0 2", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: " 1 - 512 8 2", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: " 2 - 512 16 2", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: " 3 - 4096 0 0", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: " 4 - 4096 8 0", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: " 5 - 4096 64 0", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: " 6 - 4096 128 0", 2024-09-10T17:56:17.063 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF SMART DATA SECTION ===", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Critical Warning: 0x00", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Temperature: 22 Celsius", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare: 100%", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare Threshold: 10%", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Percentage Used: 12%", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Read: 441,908,119 [226 TB]", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Written: 2,507,592,278 [1.28 PB]", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Read Commands: 6,653,040,893", 2024-09-10T17:56:17.064 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Write Commands: 40,196,130,890", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller Busy Time: 11", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "Power Cycles: 45,671", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "Power On Hours: 64,317", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "Unsafe Shutdowns: 410", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "Media and Data Integrity Errors: 0", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information Log Entries: 0", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information (NVMe Log 0x01, 16 of 64 entries)", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "No Errors Logged", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "" 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "platform_info": "x86_64-linux-5.14.0-505.el9.x86_64", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "svn_revision": "5155", 2024-09-10T17:56:17.065 INFO:tasks.workunit.client.0.smithi012.stdout: "version": [ 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": { 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: "current": 22 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: "user_capacity": { 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "f7442352-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "INTEL_SSDPEDMD400G4_f745781a-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "20240910-175019": { 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "device": { 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "info_name": "/dev/nvme0n1", 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "/dev/nvme0n1", 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "protocol": "NVMe", 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "nvme" 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "firmware_version": "8DV101H0", 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "host_id": "f7442352-6f9d-11ef-b721-ac1f6bf825ea", 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: "json_format_version": [ 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:17.067 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "local_time": { 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "asctime": "Tue Sep 10 17:50:19 2024 UTC", 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "time_t": 1725990619 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "logical_block_size": 512, 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_controller_id": 0, 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_namespaces": [ 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "capacity": { 2024-09-10T17:56:17.068 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "formatted_lba_size": 512, 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 1, 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "size": { 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "utilization": { 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.069 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_number_of_namespaces": 1, 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_pci_vendor": { 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 32902, 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "subsystem_id": 32902 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_add_log": { 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "Device stats": { 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_fw_downgrades": { 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.070 INFO:tasks.workunit.client.0.smithi012.stdout: "crc_error_count": { 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "end_to_end_error_detection_count": { 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "erase_fail_count": { 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "host_bytes_written": { 2024-09-10T17:56:17.071 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 33826795 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "host_ctx_wear_used": { 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 1 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "media_bytes_read": { 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "nand_bytes_written": { 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 56709061 2024-09-10T17:56:17.072 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_stat_indicator": { 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "pll_lock_loss_count": { 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "program_fail_count": { 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "re_alloc_sectr_cnt": { 2024-09-10T17:56:17.073 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "retry_buffer_overflow_count": { 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "soft_ecc_err_rate": { 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "thermal_throttle_status": { 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.074 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "cnt": 0, 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "pct": 0 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_host_reads": { 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_media_wear": { 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": "63.999023" 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_timer": { 2024-09-10T17:56:17.075 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "unexp_power_loss": { 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "wear_leveling": { 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 88, 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "avg": 3832, 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "max": 3846, 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 3816 2024-09-10T17:56:17.076 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel Smart log": "nvme0n1" 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_log": { 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare": 100, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare_threshold": 10, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "controller_busy_time": 10, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "critical_warning": 0, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_read": 461984543, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_written": 2216872845, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "host_reads": 7306234026, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "host_writes": 38652005814, 2024-09-10T17:56:17.077 INFO:tasks.workunit.client.0.smithi012.stdout: "media_errors": 0, 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "num_err_log_entries": 0, 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "percentage_used": 12, 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycles": 57579, 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_hours": 57768, 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": 26, 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "unsafe_shutdowns": 593 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_vendor": "intel", 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_version": { 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "string": "<1.2", 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.078 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycle_count": 57579, 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_time": { 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "hours": 57768 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "serial_number": "deleted", 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "smart_status": { 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme": { 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "passed": true 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl": { 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "argv": [ 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl", 2024-09-10T17:56:17.079 INFO:tasks.workunit.client.0.smithi012.stdout: "-x", 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "--json=o", 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "/dev/nvme0n1" 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "build_info": "(local build)", 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "exit_status": 0, 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "output": [ 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.0-505.el9.x86_64] (local build)", 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF INFORMATION SECTION ===", 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-09-10T17:56:17.080 INFO:tasks.workunit.client.0.smithi012.stdout: "Serial Number: deleted", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Version: 8DV101H0", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller ID: 0", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "NVMe Version: <1.2", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Number of Namespaces: 1", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Local Time is: Tue Sep 10 17:50:19 2024 UTC", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Updates (0x02): 1 Slot", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-09-10T17:56:17.081 INFO:tasks.workunit.client.0.smithi012.stdout: "Log Page Attributes (0x02): Cmd_Eff_Lg", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported Power States", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 512 0 2", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: " 1 - 512 8 2", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: " 2 - 512 16 2", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: " 3 - 4096 0 0", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: " 4 - 4096 8 0", 2024-09-10T17:56:17.082 INFO:tasks.workunit.client.0.smithi012.stdout: " 5 - 4096 64 0", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: " 6 - 4096 128 0", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF SMART DATA SECTION ===", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "Critical Warning: 0x00", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "Temperature: 26 Celsius", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare: 100%", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare Threshold: 10%", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "Percentage Used: 12%", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Read: 461,984,543 [236 TB]", 2024-09-10T17:56:17.083 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Written: 2,216,872,845 [1.13 PB]", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Read Commands: 7,306,234,026", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Write Commands: 38,652,005,814", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller Busy Time: 10", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Power Cycles: 57,579", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Power On Hours: 57,768", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Unsafe Shutdowns: 593", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Media and Data Integrity Errors: 0", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information Log Entries: 0", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information (NVMe Log 0x01, 16 of 64 entries)", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "No Errors Logged", 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "" 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.084 INFO:tasks.workunit.client.0.smithi012.stdout: "platform_info": "x86_64-linux-5.14.0-505.el9.x86_64", 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: "svn_revision": "5155", 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: "version": [ 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": { 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: "current": 26 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: "user_capacity": { 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.085 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.086 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.086 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.086 INFO:tasks.workunit.client.0.smithi012.stdout:} 2024-09-10T17:56:17.086 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph telemetry show-all 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "device_report": { 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "f7408896-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "INTEL_SSDPEDMD400G4_f7421396-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "20240910-175016": { 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "device": { 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "info_name": "/dev/nvme0n1", 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "/dev/nvme0n1", 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "protocol": "NVMe", 2024-09-10T17:56:17.096 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "nvme" 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: "firmware_version": "8DV101H0", 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: "host_id": "f7408896-6f9d-11ef-b721-ac1f6bf825ea", 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: "json_format_version": [ 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: "local_time": { 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: "asctime": "Tue Sep 10 17:50:15 2024 UTC", 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: "time_t": 1725990615 2024-09-10T17:56:17.097 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "logical_block_size": 512, 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_controller_id": 0, 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_namespaces": [ 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "capacity": { 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "formatted_lba_size": 512, 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 1, 2024-09-10T17:56:17.098 INFO:tasks.workunit.client.0.smithi012.stdout: "size": { 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "utilization": { 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_number_of_namespaces": 1, 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_pci_vendor": { 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 32902, 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: "subsystem_id": 32902 2024-09-10T17:56:17.099 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_add_log": { 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "Device stats": { 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_fw_downgrades": { 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "crc_error_count": { 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "end_to_end_error_detection_count": { 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.100 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "erase_fail_count": { 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "host_bytes_written": { 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 38262821 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "host_ctx_wear_used": { 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 1 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.101 INFO:tasks.workunit.client.0.smithi012.stdout: "media_bytes_read": { 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "nand_bytes_written": { 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 58635234 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_stat_indicator": { 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "pll_lock_loss_count": { 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.102 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "program_fail_count": { 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "re_alloc_sectr_cnt": { 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "retry_buffer_overflow_count": { 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.103 INFO:tasks.workunit.client.0.smithi012.stdout: "soft_ecc_err_rate": { 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "thermal_throttle_status": { 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "cnt": 0, 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "pct": 0 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_host_reads": { 2024-09-10T17:56:17.104 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_media_wear": { 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": "63.999023" 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_timer": { 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "unexp_power_loss": { 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.105 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "wear_leveling": { 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 88, 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "avg": 3842, 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "max": 3861, 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 3823 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel Smart log": "nvme0n1" 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_log": { 2024-09-10T17:56:17.106 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare": 100, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare_threshold": 10, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "controller_busy_time": 11, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "critical_warning": 0, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_read": 441908119, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_written": 2507592278, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "host_reads": 6653040893, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "host_writes": 40196130890, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "media_errors": 0, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_err_log_entries": 0, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "percentage_used": 12, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycles": 45671, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_hours": 64317, 2024-09-10T17:56:17.107 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": 22, 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "unsafe_shutdowns": 410 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_vendor": "intel", 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_version": { 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "string": "<1.2", 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycle_count": 45671, 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_time": { 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "hours": 64317 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "serial_number": "deleted", 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "smart_status": { 2024-09-10T17:56:17.108 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme": { 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "passed": true 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl": { 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "argv": [ 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl", 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "-x", 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "--json=o", 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "/dev/nvme0n1" 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "build_info": "(local build)", 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "exit_status": 0, 2024-09-10T17:56:17.109 INFO:tasks.workunit.client.0.smithi012.stdout: "output": [ 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.0-505.el9.x86_64] (local build)", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF INFORMATION SECTION ===", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "Serial Number: deleted", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Version: 8DV101H0", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller ID: 0", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "NVMe Version: <1.2", 2024-09-10T17:56:17.110 INFO:tasks.workunit.client.0.smithi012.stdout: "Number of Namespaces: 1", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Local Time is: Tue Sep 10 17:50:15 2024 UTC", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Updates (0x02): 1 Slot", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Log Page Attributes (0x02): Cmd_Eff_Lg", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported Power States", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.111 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 512 0 2", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: " 1 - 512 8 2", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: " 2 - 512 16 2", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: " 3 - 4096 0 0", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: " 4 - 4096 8 0", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: " 5 - 4096 64 0", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: " 6 - 4096 128 0", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF SMART DATA SECTION ===", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.112 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Critical Warning: 0x00", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Temperature: 22 Celsius", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare: 100%", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare Threshold: 10%", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Percentage Used: 12%", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Read: 441,908,119 [226 TB]", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Written: 2,507,592,278 [1.28 PB]", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Read Commands: 6,653,040,893", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Write Commands: 40,196,130,890", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller Busy Time: 11", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Power Cycles: 45,671", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Power On Hours: 64,317", 2024-09-10T17:56:17.113 INFO:tasks.workunit.client.0.smithi012.stdout: "Unsafe Shutdowns: 410", 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "Media and Data Integrity Errors: 0", 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information Log Entries: 0", 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information (NVMe Log 0x01, 16 of 64 entries)", 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "No Errors Logged", 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "" 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "platform_info": "x86_64-linux-5.14.0-505.el9.x86_64", 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "svn_revision": "5155", 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: "version": [ 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.114 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": { 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: "current": 22 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: "user_capacity": { 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: "f7442352-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: "INTEL_SSDPEDMD400G4_f745781a-6f9d-11ef-b721-ac1f6bf825ea": { 2024-09-10T17:56:17.115 INFO:tasks.workunit.client.0.smithi012.stdout: "20240910-175019": { 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "device": { 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "info_name": "/dev/nvme0n1", 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "/dev/nvme0n1", 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "protocol": "NVMe", 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "nvme" 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "firmware_version": "8DV101H0", 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "host_id": "f7442352-6f9d-11ef-b721-ac1f6bf825ea", 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "json_format_version": [ 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "local_time": { 2024-09-10T17:56:17.116 INFO:tasks.workunit.client.0.smithi012.stdout: "asctime": "Tue Sep 10 17:50:19 2024 UTC", 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "time_t": 1725990619 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "logical_block_size": 512, 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_controller_id": 0, 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_namespaces": [ 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "capacity": { 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.117 INFO:tasks.workunit.client.0.smithi012.stdout: "formatted_lba_size": 512, 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 1, 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "size": { 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "utilization": { 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_number_of_namespaces": 1, 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_pci_vendor": { 2024-09-10T17:56:17.118 INFO:tasks.workunit.client.0.smithi012.stdout: "id": 32902, 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "subsystem_id": 32902 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_add_log": { 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "Device stats": { 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_fw_downgrades": { 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "crc_error_count": { 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "end_to_end_error_detection_count": { 2024-09-10T17:56:17.119 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "erase_fail_count": { 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "host_bytes_written": { 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 33826795 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "host_ctx_wear_used": { 2024-09-10T17:56:17.120 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 1 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "media_bytes_read": { 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "nand_bytes_written": { 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 56709061 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_stat_indicator": { 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.121 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "pll_lock_loss_count": { 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "program_fail_count": { 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "re_alloc_sectr_cnt": { 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.122 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "retry_buffer_overflow_count": { 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "soft_ecc_err_rate": { 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "thermal_throttle_status": { 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "cnt": 0, 2024-09-10T17:56:17.123 INFO:tasks.workunit.client.0.smithi012.stdout: "pct": 0 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_host_reads": { 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_media_wear": { 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": "63.999023" 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "timed_workload_timer": { 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 100, 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 65535 2024-09-10T17:56:17.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "unexp_power_loss": { 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 0, 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": 0 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "wear_leveling": { 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "normalized": 88, 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "raw": { 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "avg": 3832, 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "max": 3846, 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 3816 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.125 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel Smart log": "nvme0n1" 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_smart_health_information_log": { 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare": 100, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "available_spare_threshold": 10, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "controller_busy_time": 10, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "critical_warning": 0, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_read": 461984543, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "data_units_written": 2216872845, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "host_reads": 7306234026, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "host_writes": 38652005814, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "media_errors": 0, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "num_err_log_entries": 0, 2024-09-10T17:56:17.126 INFO:tasks.workunit.client.0.smithi012.stdout: "percentage_used": 12, 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycles": 57579, 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_hours": 57768, 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": 26, 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "unsafe_shutdowns": 593 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_vendor": "intel", 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme_version": { 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "string": "<1.2", 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "power_cycle_count": 57579, 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "power_on_time": { 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: "hours": 57768 2024-09-10T17:56:17.127 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "serial_number": "deleted", 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "smart_status": { 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "nvme": { 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "passed": true 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl": { 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "argv": [ 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl", 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "-x", 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "--json=o", 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: "/dev/nvme0n1" 2024-09-10T17:56:17.128 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "build_info": "(local build)", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "exit_status": 0, 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "output": [ 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.0-505.el9.x86_64] (local build)", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF INFORMATION SECTION ===", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "Serial Number: deleted", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Version: 8DV101H0", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-09-10T17:56:17.129 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller ID: 0", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "NVMe Version: <1.2", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Number of Namespaces: 1", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Local Time is: Tue Sep 10 17:50:19 2024 UTC", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Firmware Updates (0x02): 1 Slot", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Log Page Attributes (0x02): Cmd_Eff_Lg", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported Power States", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-09-10T17:56:17.130 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: " 0 + 512 0 2", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: " 1 - 512 8 2", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: " 2 - 512 16 2", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: " 3 - 4096 0 0", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: " 4 - 4096 8 0", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: " 5 - 4096 64 0", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: " 6 - 4096 128 0", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: "=== START OF SMART DATA SECTION ===", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.131 INFO:tasks.workunit.client.0.smithi012.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Critical Warning: 0x00", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Temperature: 26 Celsius", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare: 100%", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Available Spare Threshold: 10%", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Percentage Used: 12%", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Read: 461,984,543 [236 TB]", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Data Units Written: 2,216,872,845 [1.13 PB]", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Read Commands: 7,306,234,026", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Host Write Commands: 38,652,005,814", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Controller Busy Time: 10", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Power Cycles: 57,579", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Power On Hours: 57,768", 2024-09-10T17:56:17.132 INFO:tasks.workunit.client.0.smithi012.stdout: "Unsafe Shutdowns: 593", 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "Media and Data Integrity Errors: 0", 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information Log Entries: 0", 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "", 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "Error Information (NVMe Log 0x01, 16 of 64 entries)", 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "No Errors Logged", 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "" 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "platform_info": "x86_64-linux-5.14.0-505.el9.x86_64", 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "svn_revision": "5155", 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: "version": [ 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:17.133 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: "temperature": { 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: "current": 26 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: "user_capacity": { 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: "blocks": 781422768, 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 400088457216 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: "report": { 2024-09-10T17:56:17.134 INFO:tasks.workunit.client.0.smithi012.stdout: "balancer": { 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "active": true, 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "mode": "" 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "channels": [ 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "basic", 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "crash", 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "device", 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "ident", 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "perf" 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "channels_available": [ 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "basic", 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "ident", 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "crash", 2024-09-10T17:56:17.135 INFO:tasks.workunit.client.0.smithi012.stdout: "device", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "perf" 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "collections_available": [ 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_base", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "device_base", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "crash_base", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "ident_base", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_perf", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_mds_metadata", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_usage", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_usage_by_class", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_rook_v01", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_memory_metrics", 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_options_bluestore" 2024-09-10T17:56:17.136 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "collections_opted_in": [ 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_base", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "device_base", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "crash_base", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "ident_base", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_perf", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_mds_metadata", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_usage", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_usage_by_class", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_rook_v01", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_memory_metrics", 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: "basic_pool_options_bluestore" 2024-09-10T17:56:17.137 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "config": { 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "active_changed": [ 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_allow_insecure_global_id_reclaim", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_debug", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_mon_ticket_ttl", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_service_ticket_ttl", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "bdev_debug_aio", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "client_check_pool_perm", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "client_mount_gid", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "client_mount_uid", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "client_quota", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "container_image", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "daemonize", 2024-09-10T17:56:17.138 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_asserts_on_shutdown", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mgr", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mon", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_ms", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_osd", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_paxos", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "keyring", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_block_size", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_cache_size", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_compression", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_log", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "leveldb_write_buffer_size", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_file", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_journald", 2024-09-10T17:56:17.139 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_stderr", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_allow_pool_delete", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_clock_drift_allowed", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_file_level", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_file", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_journald", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_stderr", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_data_avail_warn", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_election_default_strategy", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_host", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_max_pg_per_osd", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_mgr_mkfs_grace", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_prime_pg_temp", 2024-09-10T17:56:17.140 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_reporter_subtree_level", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_pg_warn_max_object_skew", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_bytes_per_osd", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_pgs_per_osd", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_legacy_crush_tunables", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_too_few_osds", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_bug", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_old_message", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "no_config_file", 2024-09-10T17:56:17.141 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_default_list", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_load_list", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_crush_chooseleaf_type", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_misdirected_ops", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_op_order", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_pg_log_writeout", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_shutdown", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_cached_snaps", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_missing_on_start", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_stray_on_activate", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_deep_scrub_update_digest_min_age", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_hdd", 2024-09-10T17:56:17.142 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_hybrid", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_delete_sleep_ssd", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_max_backfills", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_profile", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_lim", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_res", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_scheduler_client_wgt", 2024-09-10T17:56:17.143 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target_autotune", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue_cut_off", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pg_delete_cost", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_erasure_code_profile", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_pg_autoscale_mode", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recover_clone_overlap", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active_hdd", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_active_ssd", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_chunk", 2024-09-10T17:56:17.144 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_hdd", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_hybrid", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_sleep_ssd", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_load_threshold", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_max_interval", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_sleep", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_shutdown_pgref_assert", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_hdd", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_hybrid", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_snap_trim_sleep_ssd", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "public_addr", 2024-09-10T17:56:17.145 INFO:tasks.workunit.client.0.smithi012.stdout: "public_addrv", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "public_network", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd_default_features", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd_qos_exclude_ops", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "setgroup", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "setuser" 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster_changed": [ 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_allow_insecure_global_id_reclaim", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_debug", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_mon_ticket_ttl", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "auth_service_ticket_ttl", 2024-09-10T17:56:17.146 INFO:tasks.workunit.client.0.smithi012.stdout: "bdev_debug_aio", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "container_image", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_asserts_on_shutdown", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mgr", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_mon", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_ms", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_osd", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "debug_paxos", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_file", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_journald", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "log_to_stderr", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_join_fs", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/allow_ptrace", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/container_init", 2024-09-10T17:56:17.147 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/migration_current", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/cephadm/use_repo_digest", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/dashboard/ssl_server_port", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/orchestrator/orchestrator", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/channel_ident", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/channel_perf", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/description", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/enabled", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr/telemetry/organization", 2024-09-10T17:56:17.148 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_allow_pool_delete", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_clock_drift_allowed", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_file_level", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_cluster_log_to_file", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_data_avail_warn", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_election_default_strategy", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_max_pg_per_osd", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_mgr_mkfs_grace", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_prime_pg_temp", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_osd_reporter_subtree_level", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_pg_warn_max_object_skew", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_bytes_per_osd", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_reweight_min_pgs_per_osd", 2024-09-10T17:56:17.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_legacy_crush_tunables", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "mon_warn_on_too_few_osds", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_bug", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "ms_die_on_old_message", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_default_list", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_class_load_list", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_misdirected_ops", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_op_order", 2024-09-10T17:56:17.150 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_pg_log_writeout", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_shutdown", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_cached_snaps", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_missing_on_start", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_debug_verify_stray_on_activate", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_deep_scrub_update_digest_min_age", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mclock_profile", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_memory_target_autotune", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_op_queue_cut_off", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_erasure_code_profile", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pool_default_pg_autoscale_mode", 2024-09-10T17:56:17.151 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recover_clone_overlap", 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_recovery_max_chunk", 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_load_threshold", 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_scrub_max_interval", 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_shutdown_pgref_assert", 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "public_network", 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_cache_enabled", 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_enable_ops_log", 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "rgw_enable_usage_log" 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "contact": null, 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "crashes": [], 2024-09-10T17:56:17.152 INFO:tasks.workunit.client.0.smithi012.stdout: "created": "2024-09-10T17:47:02.984611Z", 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "crush": { 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_algs": { 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "straw2": 3 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_sizes": { 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "2": 1, 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "4": 2 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_types": { 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "1": 2, 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "11": 1 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.153 INFO:tasks.workunit.client.0.smithi012.stdout: "compat_weight_set": false, 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "device_classes": [ 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: 8 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "num_buckets": 6, 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "num_devices": 8, 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "num_rules": 1, 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "num_types": 12, 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "num_weight_sets": 0, 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "tunables": { 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "allowed_bucket_algs": 54, 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_local_fallback_tries": 0, 2024-09-10T17:56:17.154 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_local_tries": 0, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "choose_total_tries": 50, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_descend_once": 1, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_stable": 1, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "chooseleaf_vary_r": 1, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v2_rules": 0, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v3_rules": 0, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v4_buckets": 1, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "has_v5_rules": 0, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "legacy_tunables": 0, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "minimum_required_version": "jewel", 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "optimal_tunables": 1, 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "profile": "jewel", 2024-09-10T17:56:17.155 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables": 1, 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables2": 1, 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables3": 1, 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "require_feature_tunables5": 1, 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "straw_calc_version": 1 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "description": "upgrade test cluster", 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "fs": { 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "feature_flags": { 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "enable_multiple": true, 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: "ever_enabled_multiple": true 2024-09-10T17:56:17.156 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "filesystems": [ 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "approx_ctime": "2024-09", 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "balancer_enabled": false, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_caps": 0, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_dns": 10, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_inos": 13, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "cached_subtrees": 2, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "ever_allowed_features": 0, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "explicitly_allowed_features": 0, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "files": 0, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "max_mds": 1, 2024-09-10T17:56:17.157 INFO:tasks.workunit.client.0.smithi012.stdout: "num_data_pools": 1, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_in": 1, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_mds": 1, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": 0, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_standby_replay": 0, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_up": 1, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "snaps": 0, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "standby_count_wanted": 0 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_standby_mds": 1, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "total_num_mds": 2 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.158 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_stats": { 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 20135936, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 327888, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 851968, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 0, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 342, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 1079728, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 12, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 545792, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 14709120, 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 20135936 2024-09-10T17:56:17.159 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 20422656, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 359640, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 761856, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 422, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 1307304, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 20, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 979968, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 15154304, 2024-09-10T17:56:17.160 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 21184512 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 49512448, 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1467624, 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 4898816, 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 0, 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 2029, 2024-09-10T17:56:17.161 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 13144880, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 22, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 2472192, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 24907496, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 49512448 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 39133184, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 823776, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 5144576, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 6299648, 2024-09-10T17:56:17.162 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1201, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 8807056, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 21, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 952832, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 20783504, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 45432832 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.ddb55796e0023ab827f1fac99ce57bb7a1696db8": { 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 34603008, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 907096, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2621440, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 294912, 2024-09-10T17:56:17.163 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 9773056, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1074, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 7985472, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 22, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 1598464, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 21195624, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 44376064 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.0": { 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 51453952, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1916904, 2024-09-10T17:56:17.164 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 188416, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1776, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5865080, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3670272, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 37249184, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 51642368 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.1": { 2024-09-10T17:56:17.165 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 46489600, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 997488, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 958464, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1393, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5475784, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 2321408, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 34942408, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 47448064 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.2": { 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 45088768, 2024-09-10T17:56:17.166 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 709824, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 1032192, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1300, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5369360, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 2369792, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 33887280, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 46120960 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.3": { 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 48472064, 2024-09-10T17:56:17.167 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1728720, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 1007616, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 24576, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1630, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 4838160, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3344640, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 34800416, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 48496640 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.4": { 2024-09-10T17:56:17.168 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 45498368, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 660856, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 688128, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1277, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5085456, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 1831680, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 35167864, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 46186496 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.169 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.5": { 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 48881664, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 2216896, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 598016, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1697, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5277000, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3882240, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 34753016, 2024-09-10T17:56:17.170 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 49479680 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.6": { 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 49061888, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1971056, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 16384, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 1531904, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1680, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5144120, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3933440, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 35244376, 2024-09-10T17:56:17.171 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 50593792 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.7": { 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "actual_memory_used": 48234496, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "central_cache_freelist": 1998064, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "malloc_metadata": 2752512, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "page_heap_freelist": 0, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "released_to_os": 196608, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "spans_in_use": 1689, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "tcmalloc_page_size": 8192, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_cache_freelists": 5566168, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "thread_heaps_in_use": 47, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "transfer_cache_freelist": 3452160, 2024-09-10T17:56:17.172 INFO:tasks.workunit.client.0.smithi012.stdout: "use_by_application": 34465592, 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "virtual_address_space_used": 48431104 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "hosts": { 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num": 2, 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mds": 2, 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mgr": 2, 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_mon": 2, 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_with_osd": 2 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "io_rate": { 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_stats_delta": { 2024-09-10T17:56:17.173 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "stamp_delta": "12.002419", 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 182, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 278, 2024-09-10T17:56:17.176 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 40, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:17.177 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 0 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "leaderboard": false, 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "leaderboard_description": null, 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "license": "sharing-1-0", 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "mempool": { 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.178 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.179 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.180 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.181 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.182 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.183 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 150168, 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 33 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.184 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 928, 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 2 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.185 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.186 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.187 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.188 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.189 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.190 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.191 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.192 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 222727, 2024-09-10T17:56:17.193 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 72 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 51704, 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 208 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.194 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8016, 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 135 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.195 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.196 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.197 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.198 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.199 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.200 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.201 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1212913, 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 358 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.202 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 352, 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 4 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.203 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6592, 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 134 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12744, 2024-09-10T17:56:17.204 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1546 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 10624, 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 206 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.205 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.206 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.207 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.208 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.209 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.210 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1211855, 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 364 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.211 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 88, 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.212 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6592, 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 134 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12744, 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1546 2024-09-10T17:56:17.213 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5312, 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 103 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.214 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.ddb55796e0023ab827f1fac99ce57bb7a1696db8": { 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.215 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.216 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.217 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.218 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.219 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1259865, 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 394 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.220 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.221 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6592, 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 134 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12744, 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1546 2024-09-10T17:56:17.222 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5312, 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 103 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.223 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.0": { 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:17.224 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5920, 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 74 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22960, 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 205 2024-09-10T17:56:17.225 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2160, 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 49 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 635085, 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 23 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 97988, 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 16727 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.226 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 214456, 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 347 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 11852, 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 777 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9840, 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 205 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.227 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 33906, 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 215 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22960, 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 205 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.228 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 434691, 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 95 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2466950, 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 201 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.229 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 7392, 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 84 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 533232, 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 46 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.230 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 101504, 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 200 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.231 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.232 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.1": { 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.233 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5040, 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 63 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21504, 2024-09-10T17:56:17.234 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 192 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1264, 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 41 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16384, 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 4 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.235 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 50970, 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9422 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 134216, 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 229 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9564, 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 598 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.236 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9216, 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 192 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 28862, 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 197 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21504, 2024-09-10T17:56:17.237 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 192 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 736, 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 465987, 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 102 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12112, 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.238 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2444186, 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 198 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4840, 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 55 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.239 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 417312, 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 36 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8528, 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 22 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.240 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.241 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.2": { 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.242 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4560, 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 57 2024-09-10T17:56:17.243 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21280, 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 190 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1152, 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 40 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12288, 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.244 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 48757, 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9134 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 130136, 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 223 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8964, 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 589 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.245 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9120, 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 190 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 27662, 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 191 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21280, 2024-09-10T17:56:17.246 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 190 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 736, 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 355701, 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 75 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12112, 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.247 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2421628, 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 178 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4400, 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 50 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.248 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 359352, 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 31 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8320, 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 24 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.249 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.250 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.3": { 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:17.251 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4480, 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 56 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.252 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.253 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21952, 2024-09-10T17:56:17.253 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:17.253 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.253 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.253 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 480, 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 34 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 89878, 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 15599 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.258 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 203576, 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 331 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9788, 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 609 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9408, 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.259 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 28702, 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 199 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21952, 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2208, 2024-09-10T17:56:17.260 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 341107, 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 71 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 26565, 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2461438, 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 186 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.261 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4752, 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 54 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 428904, 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 37 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.262 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 10400, 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 20 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.263 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.4": { 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:17.265 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4000, 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 50 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21952, 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.266 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1040, 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 39 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8192, 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 2 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 51838, 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9660 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 137616, 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 234 2024-09-10T17:56:17.267 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9980, 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 609 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9408, 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.268 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 29470, 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21952, 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 196 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 736, 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 1 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 946342, 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 76 2024-09-10T17:56:17.269 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 12112, 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2414045, 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 175 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4928, 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 56 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.270 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 452088, 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 39 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 8944, 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 18 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.271 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239496, 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3507 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.272 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.5": { 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:17.273 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 3200, 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 40 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.274 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21616, 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 193 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 480, 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 34 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.275 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 91875, 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 15789 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 206296, 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 335 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 10288, 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 608 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9264, 2024-09-10T17:56:17.276 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 193 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 30230, 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 203 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 21616, 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 193 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.277 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2208, 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 879783, 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 60 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 26565, 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 9 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2411403, 2024-09-10T17:56:17.278 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 170 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 5544, 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 63 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 486864, 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 42 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.279 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 13520, 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 26 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.280 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.281 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.6": { 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.282 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2800, 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 35 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22624, 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 256, 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 32 2024-09-10T17:56:17.283 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 91180, 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 15982 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 204256, 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 332 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.284 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 11200, 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 764 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9696, 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 30490, 2024-09-10T17:56:17.285 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 200 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22624, 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 849908, 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 53 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.286 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2440710, 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 177 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 4664, 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 53 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.287 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 452088, 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 39 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 101192, 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 205 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.288 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.289 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.7": { 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "bloom_filter": { 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6304, 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 115 2024-09-10T17:56:17.290 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_reader": { 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 16896, 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 8 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs_file_writer": { 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 576, 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_alloc": { 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2160, 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 27 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_blob": { 2024-09-10T17:56:17.291 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22624, 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_buffer": { 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 1600, 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 44 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_data": { 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 297314, 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 13 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_meta": { 2024-09-10T17:56:17.292 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 94983, 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 16428 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_onode": { 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 210376, 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 341 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_cache_other": { 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 11872, 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 770 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_extent": { 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 9696, 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:17.293 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_fsck": { 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_inline_bl": { 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 32794, 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 209 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_shared_blob": { 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 22624, 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 202 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_txc": { 2024-09-10T17:56:17.294 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing": { 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 196961, 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 38 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore_writing_deferred": { 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_anon": { 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 2425816, 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 217 2024-09-10T17:56:17.295 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "buffer_meta": { 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 6336, 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 72 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_co": { 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 521640, 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 45 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_mapbl": { 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.296 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_pglog": { 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 105456, 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 250 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap": { 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 239240, 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 3495 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap_mapping": { 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.297 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "pgmap": { 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_1": { 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "unittest_2": { 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes": 0, 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: "items": 0 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.298 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "metadata": { 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 2 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 1, 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 1 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:17.299 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 2 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 2 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 2 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 2 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 2 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.300 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 3 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 2, 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 1 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 3 2024-09-10T17:56:17.301 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 3 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 3 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 3 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 3 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.302 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "arch": { 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "x86_64": 8 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_version": { 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "cpu": { 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz": 4, 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 4 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "distro": { 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "centos": 8 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.303 INFO:tasks.workunit.client.0.smithi012.stdout: "distro_description": { 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "CentOS Stream 9": 8 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_description": { 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024": 8 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "kernel_version": { 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "5.14.0-505.el9.x86_64": 8 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "os": { 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "Linux": 8 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_objectstore": { 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": 8 2024-09-10T17:56:17.304 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "rotational": { 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "0": 8 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "features": { 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "optional": [], 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "persistent": [ 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "kraken", 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "luminous", 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "mimic", 2024-09-10T17:56:17.305 INFO:tasks.workunit.client.0.smithi012.stdout: "osdmap-prune", 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "nautilus", 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "octopus", 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "pacific", 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "elector-pinging", 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "quincy", 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "reef" 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "ipv4_addr_mons": 6, 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "ipv6_addr_mons": 0, 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "min_mon_release": 18, 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "v1_addr_mons": 3, 2024-09-10T17:56:17.306 INFO:tasks.workunit.client.0.smithi012.stdout: "v2_addr_mons": 3 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "organization": "ceph-qa", 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster_network": false, 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 8, 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "require_min_compat_client": "luminous", 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "require_osd_release": "reef" 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_perf_histograms": [ 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: "axes": [ 2024-09-10T17:56:17.307 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Latency (usec)", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 100000, 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99999]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[100000, 199999]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[200000, 399999]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[400000, 799999]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[800000, 1599999]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[1600000, 3199999]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[3200000, 6399999]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[6400000, 12799999]", 2024-09-10T17:56:17.308 INFO:tasks.workunit.client.0.smithi012.stdout: "[12800000, 25599999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[25600000, 51199999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[51200000, 102399999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[102400000, 204799999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[204800000, 409599999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[409600000, 819199999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[819200000, 1638399999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[1638400000, 3276799999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[3276800000, 6553599999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[6553600000, 13107199999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[13107200000, 26214399999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[26214400000, 52428799999]", 2024-09-10T17:56:17.309 INFO:tasks.workunit.client.0.smithi012.stdout: "[52428800000, 104857599999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[104857600000, 209715199999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[209715200000, 419430399999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[419430400000, 838860799999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[838860800000, 1677721599999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[1677721600000, 3355443199999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[3355443200000, 6710886399999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[6710886400000, 13421772799999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[13421772800000, 26843545599999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[26843545600000, 53687091199999]", 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "[53687091200000, None]" 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.310 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Request size (bytes)", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 512, 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 511]", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[512, 1023]", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[1024, 2047]", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[2048, 4095]", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[4096, 8191]", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[8192, 16383]", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[16384, 32767]", 2024-09-10T17:56:17.311 INFO:tasks.workunit.client.0.smithi012.stdout: "[32768, 65535]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[65536, 131071]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[131072, 262143]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[262144, 524287]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[524288, 1048575]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[1048576, 2097151]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[2097152, 4194303]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[4194304, 8388607]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[8388608, 16777215]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[16777216, 33554431]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[33554432, 67108863]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[67108864, 134217727]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[134217728, 268435455]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[268435456, 536870911]", 2024-09-10T17:56:17.312 INFO:tasks.workunit.client.0.smithi012.stdout: "[536870912, 1073741823]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[1073741824, 2147483647]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[2147483648, 4294967295]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[4294967296, 8589934591]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[8589934592, 17179869183]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[17179869184, 34359738367]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[34359738368, 68719476735]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[68719476736, 137438953471]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[137438953472, 274877906943]", 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "[274877906944, None]" 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.313 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "osds": [ 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 0, 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.314 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.315 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 1, 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.316 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.317 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.318 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 2, 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.319 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.320 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.321 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 3, 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.322 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.323 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 4, 2024-09-10T17:56:17.324 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.325 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.326 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 5, 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.327 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.328 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.329 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 6, 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.330 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.331 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.332 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 7, 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 122, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 7, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.333 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.334 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "axes": [ 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.335 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Latency (usec)", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 100000, 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99999]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[100000, 199999]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[200000, 399999]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[400000, 799999]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[800000, 1599999]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[1600000, 3199999]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[3200000, 6399999]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[6400000, 12799999]", 2024-09-10T17:56:17.336 INFO:tasks.workunit.client.0.smithi012.stdout: "[12800000, 25599999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[25600000, 51199999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[51200000, 102399999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[102400000, 204799999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[204800000, 409599999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[409600000, 819199999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[819200000, 1638399999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[1638400000, 3276799999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[3276800000, 6553599999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[6553600000, 13107199999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[13107200000, 26214399999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[26214400000, 52428799999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[52428800000, 104857599999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[104857600000, 209715199999]", 2024-09-10T17:56:17.337 INFO:tasks.workunit.client.0.smithi012.stdout: "[209715200000, 419430399999]", 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "[419430400000, 838860799999]", 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "[838860800000, 1677721599999]", 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "[1677721600000, 3355443199999]", 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "[3355443200000, 6710886399999]", 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "[6710886400000, 13421772799999]", 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "[13421772800000, 26843545599999]", 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "[26843545600000, 53687091199999]", 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "[53687091200000, None]" 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:17.338 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Request size (bytes)", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 512, 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 511]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[512, 1023]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[1024, 2047]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[2048, 4095]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[4096, 8191]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[8192, 16383]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[16384, 32767]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[32768, 65535]", 2024-09-10T17:56:17.339 INFO:tasks.workunit.client.0.smithi012.stdout: "[65536, 131071]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[131072, 262143]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[262144, 524287]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[524288, 1048575]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[1048576, 2097151]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[2097152, 4194303]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[4194304, 8388607]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[8388608, 16777215]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[16777216, 33554431]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[33554432, 67108863]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[67108864, 134217727]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[134217728, 268435455]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[268435456, 536870911]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[536870912, 1073741823]", 2024-09-10T17:56:17.340 INFO:tasks.workunit.client.0.smithi012.stdout: "[1073741824, 2147483647]", 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "[2147483648, 4294967295]", 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "[4294967296, 8589934591]", 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "[8589934592, 17179869183]", 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "[17179869184, 34359738367]", 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "[34359738368, 68719476735]", 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "[68719476736, 137438953471]", 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "[137438953472, 274877906943]", 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "[274877906944, None]" 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.341 INFO:tasks.workunit.client.0.smithi012.stdout: "osds": [ 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 0, 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.342 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.343 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 1, 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.344 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.345 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 2, 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.348 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.349 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 3, 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.350 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.351 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.352 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 4, 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.353 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.354 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 5, 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.355 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.356 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.357 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 6, 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.358 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.359 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.360 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 7, 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.361 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.362 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.363 INFO:tasks.workunit.client.0.smithi012.stdout: "axes": [ 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Latency (usec)", 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 100000, 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99999]", 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "[100000, 199999]", 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "[200000, 399999]", 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "[400000, 799999]", 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "[800000, 1599999]", 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "[1600000, 3199999]", 2024-09-10T17:56:17.364 INFO:tasks.workunit.client.0.smithi012.stdout: "[3200000, 6399999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[6400000, 12799999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[12800000, 25599999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[25600000, 51199999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[51200000, 102399999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[102400000, 204799999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[204800000, 409599999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[409600000, 819199999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[819200000, 1638399999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[1638400000, 3276799999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[3276800000, 6553599999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[6553600000, 13107199999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[13107200000, 26214399999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[26214400000, 52428799999]", 2024-09-10T17:56:17.365 INFO:tasks.workunit.client.0.smithi012.stdout: "[52428800000, 104857599999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[104857600000, 209715199999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[209715200000, 419430399999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[419430400000, 838860799999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[838860800000, 1677721599999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[1677721600000, 3355443199999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[3355443200000, 6710886399999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[6710886400000, 13421772799999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[13421772800000, 26843545599999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[26843545600000, 53687091199999]", 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "[53687091200000, None]" 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.366 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Request size (bytes)", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 512, 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 511]", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[512, 1023]", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[1024, 2047]", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[2048, 4095]", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[4096, 8191]", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[8192, 16383]", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[16384, 32767]", 2024-09-10T17:56:17.367 INFO:tasks.workunit.client.0.smithi012.stdout: "[32768, 65535]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[65536, 131071]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[131072, 262143]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[262144, 524287]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[524288, 1048575]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[1048576, 2097151]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[2097152, 4194303]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[4194304, 8388607]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[8388608, 16777215]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[16777216, 33554431]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[33554432, 67108863]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[67108864, 134217727]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[134217728, 268435455]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[268435456, 536870911]", 2024-09-10T17:56:17.368 INFO:tasks.workunit.client.0.smithi012.stdout: "[536870912, 1073741823]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[1073741824, 2147483647]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[2147483648, 4294967295]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[4294967296, 8589934591]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[8589934592, 17179869183]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[17179869184, 34359738367]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[34359738368, 68719476735]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[68719476736, 137438953471]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[137438953472, 274877906943]", 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "[274877906944, None]" 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.369 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "osds": [ 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 0, 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.370 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.371 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 1, 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.372 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.373 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.374 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 2, 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.375 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.376 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.377 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 3, 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.378 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.379 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.380 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 4, 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.381 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.382 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 5, 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.383 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.384 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.385 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 6, 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.386 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.387 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 7, 2024-09-10T17:56:17.388 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.389 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.390 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "axes": [ 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.391 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Latency (usec)", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 100000, 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 99999]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[100000, 199999]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[200000, 399999]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[400000, 799999]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[800000, 1599999]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[1600000, 3199999]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[3200000, 6399999]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[6400000, 12799999]", 2024-09-10T17:56:17.392 INFO:tasks.workunit.client.0.smithi012.stdout: "[12800000, 25599999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[25600000, 51199999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[51200000, 102399999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[102400000, 204799999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[204800000, 409599999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[409600000, 819199999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[819200000, 1638399999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[1638400000, 3276799999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[3276800000, 6553599999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[6553600000, 13107199999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[13107200000, 26214399999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[26214400000, 52428799999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[52428800000, 104857599999]", 2024-09-10T17:56:17.393 INFO:tasks.workunit.client.0.smithi012.stdout: "[104857600000, 209715199999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[209715200000, 419430399999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[419430400000, 838860799999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[838860800000, 1677721599999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[1677721600000, 3355443199999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[3355443200000, 6710886399999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[6710886400000, 13421772799999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[13421772800000, 26843545599999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[26843545600000, 53687091199999]", 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "[53687091200000, None]" 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.394 INFO:tasks.workunit.client.0.smithi012.stdout: "buckets": 32, 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "min": 0, 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "Request size (bytes)", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "quant_size": 512, 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "ranges": [ 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[None, -1]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 511]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[512, 1023]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[1024, 2047]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[2048, 4095]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[4096, 8191]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[8192, 16383]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[16384, 32767]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[32768, 65535]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[65536, 131071]", 2024-09-10T17:56:17.395 INFO:tasks.workunit.client.0.smithi012.stdout: "[131072, 262143]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[262144, 524287]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[524288, 1048575]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[1048576, 2097151]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[2097152, 4194303]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[4194304, 8388607]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[8388608, 16777215]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[16777216, 33554431]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[33554432, 67108863]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[67108864, 134217727]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[134217728, 268435455]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[268435456, 536870911]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[536870912, 1073741823]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[1073741824, 2147483647]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[2147483648, 4294967295]", 2024-09-10T17:56:17.396 INFO:tasks.workunit.client.0.smithi012.stdout: "[4294967296, 8589934591]", 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "[8589934592, 17179869183]", 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "[17179869184, 34359738367]", 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "[34359738368, 68719476735]", 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "[68719476736, 137438953471]", 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "[137438953472, 274877906943]", 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "[274877906944, None]" 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "scale_type": "log2" 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "osds": [ 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 0, 2024-09-10T17:56:17.397 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 4, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.398 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.399 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 1, 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.400 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 11, 1, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 14, 7, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 15, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 13, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.401 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.402 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 2, 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.403 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.404 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.405 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 3, 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.406 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.407 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 4, 2024-09-10T17:56:17.408 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.409 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.410 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 5, 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.411 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.412 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.413 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 6, 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.414 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.415 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "osd_id": 7, 2024-09-10T17:56:17.416 INFO:tasks.workunit.client.0.smithi012.stdout: "values": [ 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.417 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.418 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: ] 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "perf_counters": { 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "mds.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:17.419 INFO:tasks.workunit.client.0.smithi012.stdout: "mds": { 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "caps": { 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_flush_ack": { 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_flushsnap_ack": { 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_grant": { 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.420 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_revoke": { 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "ceph_cap_op_trunc": { 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_commit": { 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_fetch_complete": { 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_fetch_keys": { 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.421 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_merge": { 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "dir_split": { 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "exported_inodes": { 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "forward": { 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_cap_release": { 2024-09-10T17:56:17.422 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_caps": { 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_caps_dirty": { 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_inode_file_caps": { 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "imported_inodes": { 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "inodes": { 2024-09-10T17:56:17.423 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "inodes_expired": { 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "inodes_pinned": { 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "inodes_with_caps": { 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "load_cent": { 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.424 INFO:tasks.workunit.client.0.smithi012.stdout: "openino_dir_fetch": { 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "process_request_cap_release": { 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "reply_latency": { 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 77664 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "request": { 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "root_rbytes": { 2024-09-10T17:56:17.425 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: "root_rfiles": { 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: "root_rsnaps": { 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_reply": { 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: "subtrees": { 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.426 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_cache": { 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_enqueue_scrub": { 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_exportdir": { 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_flush": { 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_fragmentdir": { 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.427 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_fragstats": { 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "ireq_inodestats": { 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_recovering_enqueued": { 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_recovering_prioritized": { 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "num_recovering_processing": { 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.428 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_strays": { 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_strays_delayed": { 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "num_strays_enqueuing": { 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_completed": { 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_started": { 2024-09-10T17:56:17.429 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: "strays_created": { 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: "strays_enqueued": { 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: "strays_migrated": { 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: "strays_reintegrated": { 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.430 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_log": { 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "ev": { 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "evadd": { 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "evex": { 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "evexd": { 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.431 INFO:tasks.workunit.client.0.smithi012.stdout: "evexg": { 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "evtrm": { 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "jlat": { 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10096424 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "replayed": { 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.432 INFO:tasks.workunit.client.0.smithi012.stdout: "seg": { 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "segadd": { 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "segex": { 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "segexd": { 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "segexg": { 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.433 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "segtrm": { 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_mem": { 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "cap": { 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "cap+": { 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "cap-": { 2024-09-10T17:56:17.434 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: "dir": { 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: "dir+": { 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: "dir-": { 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: "dn": { 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:17.435 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "dn+": { 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "dn-": { 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "heap": { 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 207124 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "ino": { 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "ino+": { 2024-09-10T17:56:17.436 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "ino-": { 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "rss": { 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39556 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_server": { 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "cap_acquisition_throttle": { 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "cap_revoke_eviction": { 2024-09-10T17:56:17.437 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_request": { 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_client_session": { 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 16 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "handle_peer_request": { 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "req_create_latency": { 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.438 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "req_getattr_latency": { 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 77664 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "req_getfilelock_latency": { 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "req_getvxattr_latency": { 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "req_link_latency": { 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.439 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookup_latency": { 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookuphash_latency": { 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookupino_latency": { 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.440 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookupname_latency": { 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookupparent_latency": { 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "req_lssnap_latency": { 2024-09-10T17:56:17.441 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "req_mkdir_latency": { 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "req_mknod_latency": { 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "req_mksnap_latency": { 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.442 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "req_open_latency": { 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "req_readdir_latency": { 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "req_rename_latency": { 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "req_renamesnap_latency": { 2024-09-10T17:56:17.443 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "req_rmdir_latency": { 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "req_rmsnap_latency": { 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "req_rmxattr_latency": { 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.444 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setattr_latency": { 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setfilelock_latency": { 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setlayout_latency": { 2024-09-10T17:56:17.445 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "req_setxattr_latency": { 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "req_snapdiff_latency": { 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "req_symlink_latency": { 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.446 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "req_unlink_latency": { 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "mds_sessions": { 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "average_load": { 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "avg_session_uptime": { 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 89 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "mdthresh_evicted": { 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.447 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "session_add": { 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "session_count": { 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "session_remove": { 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "sessions_open": { 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "sessions_stale": { 2024-09-10T17:56:17.448 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "total_load": { 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.449 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "purge_queue": { 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executed": { 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executed_ops": { 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executing": { 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.450 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executing_high_water": { 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executing_ops": { 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_executing_ops_high_water": { 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "pq_item_in_journal": { 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.451 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.06fa698ab98e3cfe9eeae061bae82a2280c73314": { 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "election_call": { 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "election_lose": { 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "election_win": { 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_elections": { 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9 2024-09-10T17:56:17.452 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": { 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "session_add": { 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "session_rm": { 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 188 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "session_trim": { 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.453 INFO:tasks.workunit.client.0.smithi012.stdout: "paxos": { 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "accept_timeout": { 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "begin": { 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 992 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_bytes": { 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5221367 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_keys": { 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2976 2024-09-10T17:56:17.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_latency": { 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 209998477 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "collect": { 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_bytes": { 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_keys": { 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.455 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.456 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.456 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_latency": { 2024-09-10T17:56:17.456 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.456 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.456 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.456 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_timeout": { 2024-09-10T17:56:17.456 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.456 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_uncommitted": { 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "commit": { 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 992 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_bytes": { 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5149997 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_keys": { 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5620 2024-09-10T17:56:17.461 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_latency": { 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 992, 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 383065440 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_ack_timeout": { 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_timeout": { 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn": { 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.462 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn_latency": { 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 999993 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh": { 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 994 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh_latency": { 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 994, 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2719980139 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "restart": { 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state": { 2024-09-10T17:56:17.463 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_bytes": { 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1050 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_keys": { 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "start_leader": { 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "start_peon": { 2024-09-10T17:56:17.464 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state": { 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_bytes": { 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_keys": { 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_latency": { 2024-09-10T17:56:17.465 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache": { 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1020054731 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46891008 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42524672 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.466 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2147483648 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4366336 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:full": { 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.467 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277007671 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 307806 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.469 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 70811755 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:inc": { 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.470 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277007671 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 41432 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.471 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.472 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71078129 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:kv": { 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 322961408 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 184671781 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.474 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.475 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71180763 2024-09-10T17:56:17.476 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb": { 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "compact": { 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_len": { 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_merge": { 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_range": { 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.477 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "get_latency": { 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 44173, 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 187411249 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_delay_time": { 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_memtable_time": { 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_pre_and_post_time": { 2024-09-10T17:56:17.478 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_wal_time": { 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_latency": { 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_sync_latency": { 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2159, 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 674369994 2024-09-10T17:56:17.479 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.7700de863b2c3c489c31453e328bd072c5eff11a": { 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "election_call": { 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "election_lose": { 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "election_win": { 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_elections": { 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": { 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "session_add": { 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "session_rm": { 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 53 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "session_trim": { 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.481 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "paxos": { 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "accept_timeout": { 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "begin": { 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 871 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_bytes": { 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 871, 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4172922 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_keys": { 2024-09-10T17:56:17.482 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_latency": { 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 871, 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 189995671 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "collect": { 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_bytes": { 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 146 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.483 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_keys": { 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_latency": { 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 999978 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_timeout": { 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_uncommitted": { 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.484 INFO:tasks.workunit.client.0.smithi012.stdout: "commit": { 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 872 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_bytes": { 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_keys": { 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_latency": { 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.485 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_ack_timeout": { 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_timeout": { 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn": { 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn_latency": { 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.486 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh": { 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 872 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh_latency": { 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 872, 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1888956925 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "restart": { 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state": { 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_bytes": { 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.487 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_keys": { 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "start_leader": { 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "start_peon": { 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state": { 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 872 2024-09-10T17:56:17.488 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_bytes": { 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 872, 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8182211 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_keys": { 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 872, 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5827 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_latency": { 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 872, 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 427990236 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.489 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache": { 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1020054731 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42811392 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33808384 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2147483648 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9003008 2024-09-10T17:56:17.490 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:full": { 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277006596 2024-09-10T17:56:17.491 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 308236 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.492 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 70812400 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:inc": { 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.494 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277006596 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43871 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.495 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.496 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71076765 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:kv": { 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 322961408 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.497 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 184671064 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.498 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.499 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71181480 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb": { 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: "compact": { 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.500 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_len": { 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_merge": { 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_range": { 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: "get_latency": { 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 37272, 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85995624 2024-09-10T17:56:17.501 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_delay_time": { 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_memtable_time": { 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_pre_and_post_time": { 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_wal_time": { 2024-09-10T17:56:17.502 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_latency": { 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_sync_latency": { 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1898, 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 718191754 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "mon.ddb55796e0023ab827f1fac99ce57bb7a1696db8": { 2024-09-10T17:56:17.503 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "election_call": { 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "election_lose": { 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "election_win": { 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "num_elections": { 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "num_sessions": { 2024-09-10T17:56:17.504 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: "session_add": { 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: "session_rm": { 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 80 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: "session_trim": { 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: "paxos": { 2024-09-10T17:56:17.505 INFO:tasks.workunit.client.0.smithi012.stdout: "accept_timeout": { 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "begin": { 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 860 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_bytes": { 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 860, 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4145481 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_keys": { 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "begin_latency": { 2024-09-10T17:56:17.506 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 860, 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 296997830 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "collect": { 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_bytes": { 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_keys": { 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.507 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_latency": { 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 999993 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_timeout": { 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "collect_uncommitted": { 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "commit": { 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 861 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_bytes": { 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.508 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_keys": { 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "commit_latency": { 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_ack_timeout": { 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "lease_timeout": { 2024-09-10T17:56:17.509 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn": { 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: "new_pn_latency": { 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh": { 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 861 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.510 INFO:tasks.workunit.client.0.smithi012.stdout: "refresh_latency": { 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 861, 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2141984364 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "restart": { 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state": { 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_bytes": { 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.511 INFO:tasks.workunit.client.0.smithi012.stdout: "share_state_keys": { 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "start_leader": { 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "start_peon": { 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state": { 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 861 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_bytes": { 2024-09-10T17:56:17.512 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 861, 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8129616 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_keys": { 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 861, 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5747 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "store_state_latency": { 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 861, 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 539996053 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache": { 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.513 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1020054731 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 41754624 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33890304 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2147483648 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7864320 2024-09-10T17:56:17.514 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:full": { 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.515 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277006596 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 308236 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.516 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.517 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 70812400 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:inc": { 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348127232 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.518 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 277006596 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43871 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.519 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.520 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71076765 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: "prioritycache:kv": { 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 322961408 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.521 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 184671064 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.522 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.523 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71181480 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb": { 2024-09-10T17:56:17.524 INFO:tasks.workunit.client.0.smithi012.stdout: "compact": { 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_len": { 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_queue_merge": { 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_range": { 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "get_latency": { 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 37025, 2024-09-10T17:56:17.525 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 102025856 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_delay_time": { 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_memtable_time": { 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_pre_and_post_time": { 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.526 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_write_wal_time": { 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_latency": { 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "submit_sync_latency": { 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1849, 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 907817940 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.527 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.0": { 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.528 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7827456 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.529 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4071424 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3932160 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:17.531 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.532 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:17.533 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.534 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:17.535 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 11837440 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1392640 2024-09-10T17:56:17.537 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 78103 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.538 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 26, 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 72192 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.539 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 947, 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 533738301 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 939, 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22814678 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 947, 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1017369 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:17.540 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 947, 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 534755670 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42208 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 8, 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23110 2024-09-10T17:56:17.541 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 4, 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10111 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3982 2024-09-10T17:56:17.542 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 343 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 130, 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3133510 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 343, 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 377712 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 213, 2024-09-10T17:56:17.543 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3725427 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 101, 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5518611 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3813075521 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 129, 2024-09-10T17:56:17.544 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15556239 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 129, 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 393405029838 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 129, 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 161598781700 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 84021101362 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.545 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 179232 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 239082660 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2717244946 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:17.546 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 504554 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1395118607 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 384382042 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 940345 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.547 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 63, 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 315714 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8549158846 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 421615606 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:17.548 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3609, 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 280557715 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1862399738 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 48889856 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 48513024 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.549 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3138477772 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 376832 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.550 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85509049 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.551 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 622592 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.552 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73251911 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.553 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641317867 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.554 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.555 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71711685 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.556 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 57006032 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.558 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68822624 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.559 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641317867 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.560 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2398 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5995 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 369353 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.561 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71336067 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.562 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.563 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:17.564 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 616 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 6, 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 48550994 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.565 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 7, 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5229908 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 6, 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 17140844 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.567 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.568 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.569 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 616 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 6, 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 48550994 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 7, 2024-09-10T17:56:17.570 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5229908 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 6, 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 17140844 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1771104 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6 2024-09-10T17:56:17.571 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33251328 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.1": { 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.572 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.573 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2514944 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.574 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1593344 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1454080 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:17.576 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.577 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.578 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.579 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:17.580 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4046848 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:17.581 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 786432 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 266146 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.582 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 30, 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85055 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.583 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 88355756 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 338, 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10587146 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 400564 2024-09-10T17:56:17.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 88756320 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 38119 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:17.585 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 4, 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8610 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12108 2024-09-10T17:56:17.586 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 850 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 249 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 145, 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5933249 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 369, 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 373823 2024-09-10T17:56:17.587 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 224, 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6329059 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 108726 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.588 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13830934 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 127, 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8482060 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 126, 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 283464821499 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 127, 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 165507606897 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.589 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 417, 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 79773327154 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 417, 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42744 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 462324 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.590 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 163669393 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 147092 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73931911 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 21967096 2024-09-10T17:56:17.591 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348882 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 60, 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 323439 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 273921876 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26812230 2024-09-10T17:56:17.592 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 418, 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2683852 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1862399738 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 44695552 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43827200 2024-09-10T17:56:17.593 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3138477772 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 868352 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.594 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85553762 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.595 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 16384 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.596 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73813406 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.597 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641653220 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.598 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.599 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71376332 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.600 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 57035841 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.601 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.602 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68792815 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:17.603 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641653220 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.604 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 235958 2024-09-10T17:56:17.605 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71142502 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.606 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.607 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 36 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 157 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.608 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2429467 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 157, 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 649765471 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1041 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:17.609 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 157, 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 60852268 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 157, 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 193676400 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 33, 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6571973 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.610 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1041 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 33, 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5924928 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 33, 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5047911 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:17.611 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 22, 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 20366706 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 22, 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8492844 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 22, 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 19221666 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 102 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2429467 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 622826792 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:17.614 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46434496 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 169406823 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 590368 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2 2024-09-10T17:56:17.615 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28454912 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.2": { 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:17.616 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.617 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2146304 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:17.618 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1331200 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1191936 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:17.619 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.620 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.621 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:17.622 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:17.623 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.624 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3416064 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 778240 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:17.625 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 4, 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 201130 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.626 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 12, 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 16233 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 278, 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 64213376 2024-09-10T17:56:17.627 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 268, 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9072375 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 278, 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 371629 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 278, 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 64585005 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.628 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 35534 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1196 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.629 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6779 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 618 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 224 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.630 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 99, 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1471813 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 272, 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 304373 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 173, 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1552101 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.631 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 118632 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 18461734 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 120, 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7651558 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:17.632 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 119, 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 234127575313 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 120, 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 156729414104 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 341, 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 86235845563 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 341, 2024-09-10T17:56:17.633 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 105795 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2208120 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 146915205 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 122354 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:17.634 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73751102 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 20205924 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 348976 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 54, 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 279240 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:17.635 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 261591423 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23807833 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 342, 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2456149 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.636 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1862399738 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43368448 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42041344 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3138477772 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1327104 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.637 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85554533 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.638 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73816731 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.640 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641659000 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.641 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.642 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.643 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71370552 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.644 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 57036355 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.645 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.646 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68792301 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.647 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641659000 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.648 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 227436 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.649 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71145244 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.650 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.651 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.652 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 74797327 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5212205 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 62332133 2024-09-10T17:56:17.653 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.654 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.655 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.656 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:17.657 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 74797327 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5212205 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 10, 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 62332133 2024-09-10T17:56:17.658 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28446720 2024-09-10T17:56:17.659 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.3": { 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:17.660 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6180864 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.661 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:17.662 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3153920 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3014656 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:17.663 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.664 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.665 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5555 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5555 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.666 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.667 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9273344 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.668 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 802816 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:17.669 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:17.670 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6312 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 723, 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 498785257 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:17.671 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 716, 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22400891 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 723, 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 821542 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 723, 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 499606799 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.672 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 35576 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1812 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.673 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9653 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3476 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 329 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.674 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 97, 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1001408 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 174, 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 319663 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 77, 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 402201 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:17.675 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 100, 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5501651 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3947447091 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 60, 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 60456527 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:17.676 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 57, 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 323726508724 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 60, 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 78938894214 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3340, 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1483103914 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3340, 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 211473 2024-09-10T17:56:17.677 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 111848693 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2809982352 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 544418 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.678 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1529832326 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 388442739 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 351983 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 51, 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 271537 2024-09-10T17:56:17.679 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8787817895 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 427256618 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3343, 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 285504957 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.680 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1862399738 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 44695552 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 44490752 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3138477772 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 204800 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.681 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85548227 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.682 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.683 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.684 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73835325 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.685 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641611707 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.686 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.687 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71417845 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.688 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 57032151 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.689 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.690 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68796505 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.691 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641611707 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.692 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5826 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 342617 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.693 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71071530 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.694 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 37 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.695 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.696 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 826300 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.697 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.698 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.699 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:17.700 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.701 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 826300 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:17.702 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28467200 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.703 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.4": { 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.704 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1376256 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.705 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 995328 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 856064 2024-09-10T17:56:17.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:17.707 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.708 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:17.709 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:17.710 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:17.711 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2310144 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:17.712 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 802816 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 8, 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 332958 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:17.713 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 11366 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 196, 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 54882494 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 191, 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4791728 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 196, 2024-09-10T17:56:17.715 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 196690 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 196, 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 55079184 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31494 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.716 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1090 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.717 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13431 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 404 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 247 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1415211 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:17.718 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 175, 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 248632 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 73, 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 667742 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 133352 2024-09-10T17:56:17.719 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6046233 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 50, 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14752903 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 49, 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 241484030870 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.720 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 50, 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 74202779421 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 276, 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 594086 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 276, 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27314 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 280002 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 165499229 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 86542 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73863595 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15275698 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 349976 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 48, 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 216080 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 261002080 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:17.723 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 18222452 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 277, 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2161928 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1861407221 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.724 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 43433984 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42582016 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3137310105 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 851968 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:17.725 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85494333 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.726 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.727 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8192 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73881027 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.728 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641207504 2024-09-10T17:56:17.729 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.730 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.731 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71822048 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.732 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 56996222 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.733 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68832434 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641207504 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.736 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 239678 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.737 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71584498 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.738 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:17.739 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.740 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6555061 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 736346 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6453709 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.741 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.742 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.744 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 22 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6555061 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.745 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 736346 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6453709 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.746 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28471296 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.5": { 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:17.747 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.748 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6508544 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.749 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3457024 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3317760 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:17.750 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.751 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.752 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:17.753 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5557 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:17.754 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:17.755 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9904128 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:17.756 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 790528 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 4, 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 93814 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.757 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4733 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.758 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 797, 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 471839084 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 794, 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 20453702 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 797, 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 694658 2024-09-10T17:56:17.759 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 797, 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 472533742 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 34284 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:17.760 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 976 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4737 2024-09-10T17:56:17.761 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3465 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 353 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 96, 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 894255 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 157, 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 339638 2024-09-10T17:56:17.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 61, 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 397019 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 103, 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7559405 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.763 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3846291198 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 47, 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26220643 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 44, 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 249775699754 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 47, 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 75434735753 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.764 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3376, 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7854137763 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3376, 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 179920 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 100079328 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2463999079 2024-09-10T17:56:17.765 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 459390 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1305788977 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 373004020 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:17.766 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 351103 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 39, 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 169676 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8089361610 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 408993572 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.767 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 273388461 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1861407221 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46727168 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46014464 2024-09-10T17:56:17.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3137310105 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 712704 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85488320 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.770 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.771 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73895232 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.772 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641162406 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.773 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.774 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71867146 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 56992213 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.776 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.777 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.778 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68836443 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.779 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641162406 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.780 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 354252 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.781 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71515022 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.782 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 42 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.783 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:17.784 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.785 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:17.786 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.787 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.788 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:17.789 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.790 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 32649216 2024-09-10T17:56:17.791 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.6": { 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:17.792 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:17.793 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 7282688 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.794 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4235264 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096000 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.795 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:17.796 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.797 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5556 2024-09-10T17:56:17.798 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.799 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.800 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 11456512 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1380352 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.801 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:17.802 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6194 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 987, 2024-09-10T17:56:17.803 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 504687439 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 972, 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27152255 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 987, 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 782993 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 987, 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 505470432 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.804 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 47645 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1070 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:17.805 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3, 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9524 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:17.806 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3481 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 361 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 98, 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 792572 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 153, 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 370929 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.807 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 55, 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 384067 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 100, 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10218615 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3969482641 2024-09-10T17:56:17.808 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 40, 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 37112336 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 40, 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 410112102456 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 40, 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65814702281 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:17.809 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1728442316 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 197016 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 6353223 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.810 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2806169708 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 504859 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1424784357 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 387532678 2024-09-10T17:56:17.811 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 941643 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 33, 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 134840 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8594568318 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:17.812 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 427260213 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3379, 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 270812940 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1861407221 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.813 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46792704 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 46186496 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3137310105 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 606208 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:17.814 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85488281 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.816 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73895271 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:17.817 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641162109 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.818 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:17.819 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71867443 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:17.820 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 56992187 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.821 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.822 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68836469 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:17.823 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641162109 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.824 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2363 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3545 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5908 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 342694 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.825 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71515061 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.826 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.827 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2810 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71725643 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.829 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 15, 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9222204 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39568168 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.830 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.832 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.833 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 13 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2810 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71725643 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.834 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 15, 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 9222204 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 39568168 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.835 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33239040 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: "osd.7": { 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: "bluefs": { 2024-09-10T17:56:17.836 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_fallback": { 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_slow_size_fallback": { 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_db": { 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 65536 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_main": { 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit_wal": { 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.837 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_slow": { 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_sst": { 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12288 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_written_wal": { 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5898240 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lat": { 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "compact_lock_lat": { 2024-09-10T17:56:17.838 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "db_total_bytes": { 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "db_used_bytes": { 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 27656192 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "log_bytes": { 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2879488 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "logged_bytes": { 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2740224 2024-09-10T17:56:17.839 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_db": { 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 31850496 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_slow": { 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "max_bytes_wal": { 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "num_files": { 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 14 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "read_bytes": { 2024-09-10T17:56:17.840 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 206480 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: "read_count": { 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes": { 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1282048 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_db": { 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1286144 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_slow": { 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_bytes_wal": { 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "read_disk_count": { 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 15 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_bytes": { 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4991 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "read_prefetch_count": { 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_bytes": { 2024-09-10T17:56:17.842 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5552 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_buffer_count": { 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_bytes": { 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5552 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_count": { 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 24 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes": { 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.843 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_db": { 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_slow": { 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_bytes_wal": { 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "read_random_disk_count": { 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_total_bytes": { 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "slow_used_bytes": { 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_total_bytes": { 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "wal_used_bytes": { 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "write_bytes": { 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8716288 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.845 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore": { 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "alloc_unit": { 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 4096 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": { 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1380352 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "clist_lat": { 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 257300 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_lat": { 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.846 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed": { 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_allocated": { 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "compressed_original": { 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "csum_lat": { 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 13, 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 41099 2024-09-10T17:56:17.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "decompress_lat": { 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "fragmentation_micros": { 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_commit_lat": { 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 656, 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 487462521 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_final_lat": { 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 652, 2024-09-10T17:56:17.848 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 23217298 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_flush_lat": { 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 656, 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 514050 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "kv_sync_lat": { 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 656, 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 487976571 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_keys_lat": { 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.849 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_get_values_lat": { 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 1, 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 33419 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_lower_bound_lat": { 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1072 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_next_lat": { 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_seek_to_first_lat": { 2024-09-10T17:56:17.850 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 0, 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_upper_bound_lat": { 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 2, 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3703 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_hits": { 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3757 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "onode_misses": { 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 392 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "read_lat": { 2024-09-10T17:56:17.851 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 131, 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2875047 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "read_onode_meta_lat": { 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 208, 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 359679 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "read_wait_aio_lat": { 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 77, 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2027557 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "reads_with_retries": { 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.852 INFO:tasks.workunit.client.0.smithi012.stdout: "remove_lat": { 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 102, 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5502000 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "state_aio_wait_lat": { 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3878292756 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_aio_wait_lat": { 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 26, 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 17514384 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_cleanup_lat": { 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 26, 2024-09-10T17:56:17.853 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 320417833127 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "state_deferred_queued_lat": { 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 26, 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45485626717 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "state_done_lat": { 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1179793757 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "state_finishing_lat": { 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 168248 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "state_io_done_lat": { 2024-09-10T17:56:17.854 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 162288334 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_commiting_lat": { 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2579531901 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_done_lat": { 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 447999 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "state_kv_queued_lat": { 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1478897893 2024-09-10T17:56:17.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "state_prepare_lat": { 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 368754088 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": { 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 939890 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "truncate_lat": { 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 25, 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 111452 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_commit_lat": { 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.856 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8467994731 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_submit_lat": { 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 401951869 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "txc_throttle_lat": { 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 3413, 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 283365023 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache": { 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_bytes": { 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 1861407221 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.857 INFO:tasks.workunit.client.0.smithi012.stdout: "heap_bytes": { 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45678592 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: "mapped_bytes": { 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45105152 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: "target_bytes": { 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3137310105 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: "unmapped_bytes": { 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 573440 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.858 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:data": { 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 159383552 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 85478833 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.859 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.860 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 143360 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 73761359 2024-09-10T17:56:17.861 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv": { 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 780140544 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641091252 2024-09-10T17:56:17.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.863 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 2128 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.864 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71938300 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:kv_onode": { 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 192937984 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 67108864 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 464 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.865 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 56985889 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.866 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.867 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 68842767 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "bluestore-pricache:meta": { 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "committed_bytes": { 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 713031680 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "pri0_bytes": { 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "pri10_bytes": { 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri11_bytes": { 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 641091252 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri1_bytes": { 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri2_bytes": { 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri3_bytes": { 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "pri4_bytes": { 2024-09-10T17:56:17.869 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri5_bytes": { 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri6_bytes": { 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 365901 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri7_bytes": { 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri8_bytes": { 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.870 INFO:tasks.workunit.client.0.smithi012.stdout: "pri9_bytes": { 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "reserved_bytes": { 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 71574527 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "objecter": { 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "op_active": { 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.871 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rmw": { 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: "osd": { 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg": { 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 45 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: "numpg_removing": { 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "op": { 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 115 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_degraded": { 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "op_delayed_unreadable": { 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "op_in_bytes": { 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "op_latency": { 2024-09-10T17:56:17.873 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 115, 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 84642076 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "op_out_bytes": { 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 265066 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "op_prepare_latency": { 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 117, 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26845345 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "op_process_latency": { 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 115, 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 61712151 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r": { 2024-09-10T17:56:17.874 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 80 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency": { 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 80, 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12164042 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_latency_out_bytes_histogram": { 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_out_bytes": { 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 265066 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_prepare_latency": { 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 80, 2024-09-10T17:56:17.875 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 10732404 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "op_r_process_latency": { 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 80, 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 8748472 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw": { 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 30 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_in_bytes": { 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency": { 2024-09-10T17:56:17.876 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 30, 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 28423373 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_in_bytes_histogram": { 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_latency_out_bytes_histogram": { 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_out_bytes": { 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_prepare_latency": { 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 30, 2024-09-10T17:56:17.877 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 12801593 2024-09-10T17:56:17.878 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.880 INFO:tasks.workunit.client.0.smithi012.stdout: "op_rw_process_latency": { 2024-09-10T17:56:17.880 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 30, 2024-09-10T17:56:17.880 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26579505 2024-09-10T17:56:17.880 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.880 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w": { 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 5 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_in_bytes": { 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency": { 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 44054661 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_latency_in_bytes_histogram": { 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_prepare_latency": { 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 7, 2024-09-10T17:56:17.881 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 3311348 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "op_w_process_latency": { 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "count": 5, 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 26384174 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "op_wip": { 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_bytes": { 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "recovery_ops": { 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 0 2024-09-10T17:56:17.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes": { 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 95995035648 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_bytes_used": { 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: "value": 29044736 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: "pools": [ 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr" 2024-09-10T17:56:17.883 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 1, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 1, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 1, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296251146, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 1781760, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:17.884 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 1781760, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098763264, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 2, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 2.443116500217002e-06, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 394, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 598016, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 590368, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 590368, 2024-09-10T17:56:17.885 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 1771104, 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 219, 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 2473984 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:17.886 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 32, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 32, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 2, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296251146, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 98304, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 98304, 2024-09-10T17:56:17.887 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098763264, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 22, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 1.3479292704232648e-07, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 3428, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 3428, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 10284, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 51, 2024-09-10T17:56:17.888 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 20480 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:17.889 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 64, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 64, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 3, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296251146, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 0, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 0, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098763264, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 0, 2024-09-10T17:56:17.890 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 0.0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 0 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:17.891 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd" 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "cache_mode": "none", 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "erasure_code_profile": {}, 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "min_size": 2, 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "options": {}, 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 8, 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "pgp_num": 8, 2024-09-10T17:56:17.892 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": 4, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "size": 3, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "stats": { 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_raw": 729296251146, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "bytes_used": 12288, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_bytes_used": 0, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "compress_under_bytes": 0, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "data_bytes_used": 12288, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty": 0, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "max_avail": 243098763264, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "objects": 2, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_bytes_used": 0, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "percent_used": 1.684911943300449e-08, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_bytes": 0, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "quota_objects": 0, 2024-09-10T17:56:17.893 INFO:tasks.workunit.client.0.smithi012.stdout: "rd": 0, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "rd_bytes": 0, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "stored": 19, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_data": 19, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_omap": 0, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "stored_raw": 57, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "wr": 2, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "wr_bytes": 2048 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_bytes": 0, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "target_max_objects": 0, 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "replicated" 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.894 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd": { 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: "mirroring_by_pool": [ 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: false 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: "num_images_by_pool": [ 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pools": 1 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: "report_id": "c90c0484-59f6-4fbf-bb6e-84e822e60bed", 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: "report_timestamp": "2024-09-10T17:56:16.483027", 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: "report_version": 1, 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: "rocksdb_stats": { 2024-09-10T17:56:17.895 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "7.9.2" 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "rook": { 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "cluster": { 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "external-mode": null, 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "mon": { 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "allow-multiple-per-node": null, 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "count": null, 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "max-id": null, 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "pvc": { 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": null 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "stretch": { 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": null 2024-09-10T17:56:17.896 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: "network": { 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: "provider": null 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: "storage": { 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: "device-set": { 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: "non-portable": null, 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: "portable": null, 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: "total": null 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.897 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "csi": { 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "kubernetes": { 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "node": { 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "kubernetes-total": null, 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "with-ceph-daemons": null, 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-cephfs-plugin": null, 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-nfs-plugin": null, 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: "with-csi-rbd-plugin": null 2024-09-10T17:56:17.898 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "usage": { 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "storage-class": { 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "count": { 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": null, 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs": null, 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "nfs": null, 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd": null, 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "total": null 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: "version": null 2024-09-10T17:56:17.899 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "services": {}, 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_per_pg": [ 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.900 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.636912+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.636912+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.637199+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:17.901 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155953+0000", 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.902 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3f", 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:27:59.177654+0000", 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.903 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.904 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.905 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.906 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.907 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639677+0000", 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639677+0000", 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640227+0000", 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.908 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233983+0000", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.909 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3e", 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.910 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:26:37.127590+0000", 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.911 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.912 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.913 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:17.914 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.915 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.634668+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.634668+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.634939+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:17.916 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729996+0000", 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.917 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3d", 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:44:57.070010+0000", 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.918 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.919 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.920 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.921 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:17.922 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.651762+0000", 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.651762+0000", 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.652074+0000", 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.923 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867745+0000", 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.924 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3c", 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.925 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:52:04.290714+0000", 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.926 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.927 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.928 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:17.929 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.930 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.636370+0000", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.636370+0000", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.637379+0000", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:17.931 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155588+0000", 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.932 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3b", 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:02:14.018129+0000", 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.933 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.934 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.935 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.936 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.937 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.645786+0000", 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.645786+0000", 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.646980+0000", 2024-09-10T17:56:17.938 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867537+0000", 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.939 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3a", 2024-09-10T17:56:17.940 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:11:21.906343+0000", 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.941 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.942 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.943 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:17.944 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.945 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.527295+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.527295+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.527641+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155321+0000", 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.947 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.39", 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 32, 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:05:12.311291+0000", 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.948 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.949 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.950 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.951 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.952 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.644853+0000", 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.644853+0000", 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.645147+0000", 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:17.953 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729038+0000", 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.954 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.38", 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.955 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:48:14.652149+0000", 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.956 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.957 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.958 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:17.959 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.960 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642731+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642731+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643055+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:17.961 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.156123+0000", 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.962 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.37", 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:19:36.214703+0000", 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.963 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.964 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.965 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.966 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.967 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642404+0000", 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642404+0000", 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642693+0000", 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.968 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302498+0000", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.969 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.36", 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.970 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:31:30.773367+0000", 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.971 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.972 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.973 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.974 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:17.975 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641622+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641622+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.641932+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.976 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302504+0000", 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.977 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.35", 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:36:23.825157+0000", 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.978 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.979 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.980 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.981 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.982 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.527109+0000", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.527109+0000", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.527604+0000", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:17.983 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732532+0000", 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.984 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.34", 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 20, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:24:41.838811+0000", 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.985 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.986 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.987 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.988 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.989 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641524+0000", 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641524+0000", 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642786+0000", 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.990 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730081+0000", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.991 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.33", 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:17.992 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:19:47.780772+0000", 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:17.993 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:17.994 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:17.995 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:17.996 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:17.997 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.638816+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.638816+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.639101+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:17.998 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728744+0000", 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:17.999 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.32", 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:25:06.360636+0000", 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.000 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.001 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.002 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.003 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.004 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.640599+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.640599+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640880+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:18.005 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232131+0000", 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.006 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.31", 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:42:34.186636+0000", 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.007 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.008 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.009 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.010 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.011 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.646649+0000", 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.646649+0000", 2024-09-10T17:56:18.012 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.646904+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867425+0000", 2024-09-10T17:56:18.013 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.30", 2024-09-10T17:56:18.014 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:41:23.895378+0000", 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.015 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.016 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.017 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.018 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.019 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.651519+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.651519+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.651784+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:18.020 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.868175+0000", 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.021 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2f", 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:06:08.069895+0000", 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.022 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.023 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.024 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.025 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.026 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.636034+0000", 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.636034+0000", 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.636540+0000", 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.027 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732902+0000", 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.028 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2e", 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:39:13.754751+0000", 2024-09-10T17:56:18.029 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.030 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.031 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.032 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.033 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642454+0000", 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642454+0000", 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642764+0000", 2024-09-10T17:56:18.034 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.156007+0000", 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.035 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2d", 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.036 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:15:14.254801+0000", 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.037 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.038 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.039 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.040 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.041 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.644155+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.644155+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.644420+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.042 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302296+0000", 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.043 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2c", 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:39:33.531784+0000", 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.044 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.045 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.046 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.047 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.048 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.631291+0000", 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.631291+0000", 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.631587+0000", 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.049 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729057+0000", 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.050 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2b", 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:44:00.479506+0000", 2024-09-10T17:56:18.051 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.052 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.053 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.054 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.055 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.635566+0000", 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.635566+0000", 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.635863+0000", 2024-09-10T17:56:18.056 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867598+0000", 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.057 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2a", 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.058 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:42:13.369399+0000", 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.059 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.060 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.061 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.062 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.063 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.640887+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.640887+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.641463+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:18.064 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730066+0000", 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.065 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.29", 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:00:04.323739+0000", 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.066 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.067 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.068 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.069 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.070 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.648476+0000", 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.648476+0000", 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.648810+0000", 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:18.071 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867506+0000", 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.072 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.28", 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.073 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:41:59.638618+0000", 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.074 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.075 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.076 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.077 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.078 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643540+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643540+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643794+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.079 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729880+0000", 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.080 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.27", 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:05:12.570733+0000", 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.081 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.082 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.082 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.082 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.082 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.082 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.082 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.082 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.084 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.084 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.084 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.085 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.086 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.087 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.650207+0000", 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.650207+0000", 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.650553+0000", 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.088 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302560+0000", 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.089 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.26", 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.090 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:08:42.530501+0000", 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.091 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.092 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.093 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.094 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.095 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641158+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641158+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.641442+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.096 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232613+0000", 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.097 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.25", 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:36:53.454703+0000", 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.098 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.099 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.100 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.101 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.102 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643999+0000", 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643999+0000", 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.644997+0000", 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.103 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729415+0000", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.104 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.24", 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.105 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:36:53.456366+0000", 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.106 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.107 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.108 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.109 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.110 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.632680+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.632680+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.632927+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.111 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729128+0000", 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.112 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.23", 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:18:41.103267+0000", 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.113 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.114 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.115 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.116 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.117 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.648448+0000", 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.648448+0000", 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.648726+0000", 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.118 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867623+0000", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.119 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.22", 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.120 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:06:28.167728+0000", 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.121 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.122 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.123 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.124 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.634622+0000", 2024-09-10T17:56:18.125 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.634622+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.634918+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732333+0000", 2024-09-10T17:56:18.126 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.21", 2024-09-10T17:56:18.127 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:12:36.763110+0000", 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.128 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.129 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.130 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.131 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.132 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641786+0000", 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641786+0000", 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642111+0000", 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.133 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.301939+0000", 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.134 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.20", 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:12:23.582671+0000", 2024-09-10T17:56:18.135 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.136 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.137 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.138 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.139 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.631529+0000", 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.631529+0000", 2024-09-10T17:56:18.140 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.632064+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728712+0000", 2024-09-10T17:56:18.141 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1a", 2024-09-10T17:56:18.142 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:23:08.242940+0000", 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.143 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.144 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.145 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.146 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.147 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.191998+0000", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.191998+0000", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192274+0000", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:18.148 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730236+0000", 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.149 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1b", 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:14:36.695686+0000", 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.150 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.151 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.152 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.153 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.154 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.204905+0000", 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.204905+0000", 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.205276+0000", 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:18.155 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732545+0000", 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.156 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1b", 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.157 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 20, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:39:34.407480+0000", 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.158 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.159 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.160 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.161 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.162 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190437+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190437+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190911+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.163 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302164+0000", 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.164 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1a", 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:32:07.664597+0000", 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.165 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.166 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.167 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.168 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.169 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.192199+0000", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.192199+0000", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192952+0000", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:18.170 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730028+0000", 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.171 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.19", 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:18:52.313043+0000", 2024-09-10T17:56:18.172 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.173 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.174 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.175 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.176 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.646321+0000", 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.646321+0000", 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.646604+0000", 2024-09-10T17:56:18.177 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729285+0000", 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.178 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.18", 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.179 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:52:51.768967+0000", 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.180 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.181 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.182 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.183 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.184 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.194106+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.194106+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.194360+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:18.185 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867535+0000", 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.186 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.18", 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:20:23.447069+0000", 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.187 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.188 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.189 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.190 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.191 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.637615+0000", 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.637615+0000", 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.637886+0000", 2024-09-10T17:56:18.192 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.231630+0000", 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.193 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.19", 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.194 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:37:07.616690+0000", 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.195 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.196 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.197 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.198 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.199 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.192223+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.192223+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.193200+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:18.200 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302510+0000", 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.201 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.17", 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:44:50.147156+0000", 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.202 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.203 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.204 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.205 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.206 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.645661+0000", 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.645661+0000", 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.646338+0000", 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.207 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867900+0000", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.208 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.16", 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.209 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:03:42.267516+0000", 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.210 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.211 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.212 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.213 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.192132+0000", 2024-09-10T17:56:18.214 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.192132+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192408+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:18.215 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.868014+0000", 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.216 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.16", 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:40:20.330671+0000", 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.217 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.218 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.219 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.220 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.221 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639958+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639958+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.641531+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:18.222 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730218+0000", 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.223 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.17", 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:35:31.562343+0000", 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.224 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.225 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.226 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.227 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.228 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.188019+0000", 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.188019+0000", 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.188432+0000", 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.229 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232762+0000", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 3, 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.230 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 3, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.15", 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 29, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.231 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:35:56.317055+0000", 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 90, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.232 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.233 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 4, 2024-09-10T17:56:18.234 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 1 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'3" 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.235 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.641201+0000", 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.641201+0000", 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.642140+0000", 2024-09-10T17:56:18.236 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729021+0000", 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.237 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.14", 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.238 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:39:59.879928+0000", 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.239 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.240 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.241 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:18.242 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.243 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190315+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190315+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190637+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.244 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:55:12.768258+0000", 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 12, 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 12, 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.245 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.14", 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 38, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:29:46.931055+0000", 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 2630, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.246 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 12, 2024-09-10T17:56:18.247 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 4, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 4, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.248 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 12, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 9 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.249 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "75'12" 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.250 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.646127+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.646127+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.647058+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:18.251 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155787+0000", 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.252 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.15", 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:37:47.402493+0000", 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.253 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.254 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.255 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.256 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.257 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.196798+0000", 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.196798+0000", 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.197133+0000", 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.258 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729356+0000", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.259 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.13", 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.260 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:58:43.999658+0000", 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 34, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.261 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.262 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.263 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 7 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.264 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:18.265 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.632648+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.632648+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.632963+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:18.266 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728675+0000", 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.267 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.12", 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:37:47.286139+0000", 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.268 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.269 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.270 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.271 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.272 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190637+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190637+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190919+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:18.273 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867697+0000", 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.274 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.12", 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:39:22.425546+0000", 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.275 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.276 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.277 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.278 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.279 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.636759+0000", 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.636759+0000", 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.637441+0000", 2024-09-10T17:56:18.280 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155613+0000", 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.13", 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.282 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T17:55:24.979608+0000", 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.283 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.284 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.285 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.285 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.285 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.285 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.285 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.288 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.289 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.290 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.191743+0000", 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.191743+0000", 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192102+0000", 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.291 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302126+0000", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.292 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.11", 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.293 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:33:45.633351+0000", 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.294 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.295 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.296 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.297 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.298 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639840+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639840+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640124+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.299 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.301938+0000", 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.300 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.10", 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T05:10:36.857233+0000", 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.301 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.302 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.303 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.304 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.305 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190916+0000", 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190916+0000", 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.191246+0000", 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.306 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732486+0000", 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 8, 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.307 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 8, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.10", 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 34, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:17:39.604984+0000", 2024-09-10T17:56:18.308 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.309 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 12, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 4, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 4, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.310 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 4, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 12, 2024-09-10T17:56:18.311 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'8" 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.312 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.647020+0000", 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.647020+0000", 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.647318+0000", 2024-09-10T17:56:18.313 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155375+0000", 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.314 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.11", 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.315 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:44:56.897139+0000", 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.316 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.317 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.318 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.319 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:18.320 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.193894+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.193894+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.194263+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:18.321 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729481+0000", 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.322 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.f", 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:52:03.317131+0000", 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 22, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.323 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.324 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.325 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 1, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 1 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.326 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.327 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.204953+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.204953+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.205325+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:18.328 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732823+0000", 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.329 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.e", 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 20, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:12:44.691943+0000", 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.330 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.331 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.332 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.333 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.334 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.191684+0000", 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.191684+0000", 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.191958+0000", 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.335 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732951+0000", 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.336 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.e", 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.337 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:00:28.509776+0000", 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.338 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.339 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.340 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.341 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.648574+0000", 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.648574+0000", 2024-09-10T17:56:18.342 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.648857+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.156018+0000", 2024-09-10T17:56:18.343 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.f", 2024-09-10T17:56:18.344 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T04:14:28.905835+0000", 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.345 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.346 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.347 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.348 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.349 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.184643+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.184643+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.185952+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.350 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232892+0000", 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:18.351 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.d", 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:12:33.637417+0000", 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 70, 2024-09-10T17:56:18.352 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.353 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.354 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 1, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 1 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.355 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.356 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.650072+0000", 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.650072+0000", 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.651773+0000", 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.357 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867861+0000", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.358 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.c", 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.359 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:36:47.179846+0000", 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.360 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.361 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.362 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.363 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190976+0000", 2024-09-10T17:56:18.364 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190976+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.191363+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:18.365 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732647+0000", 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.366 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.c", 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:27:26.580641+0000", 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.367 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.368 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.369 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.370 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.371 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643274+0000", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643274+0000", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643612+0000", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:18.372 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155880+0000", 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.373 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.d", 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:43:25.162760+0000", 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.374 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.375 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.376 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.377 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.378 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:45.957358+0000", 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:45.957358+0000", 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.302350+0000", 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:18.379 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302404+0000", 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.5", 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:08:01.978582+0000", 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.001023278, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.382 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.383 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.384 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.385 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 19, 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.386 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:12.719452+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:12.719452+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:12.719807+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:50:14.084625+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:50:14.084625+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 58, 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:50:14.084625+0000", 2024-09-10T17:56:18.387 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:56:13.661807+0000", 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 148, 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 57, 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 148, 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.388 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "1.0", 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 345, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:22:42.699945+0000", 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 590368, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 1771104, 2024-09-10T17:56:18.389 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:18.390 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 6, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.391 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 394, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 584, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 219, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 2416 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.392 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "75'148" 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.393 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.195203+0000", 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.195203+0000", 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.195598+0000", 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.394 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867705+0000", 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.395 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.3", 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:19:16.684822+0000", 2024-09-10T17:56:18.396 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.397 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.398 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.399 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.400 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.401 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.644205+0000", 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.644205+0000", 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.644934+0000", 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.402 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729612+0000", 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.403 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.2", 2024-09-10T17:56:18.404 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:28:22.741147+0000", 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.405 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.406 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.407 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.408 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.409 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.410 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:45.961914+0000", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:45.961914+0000", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.303137+0000", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:18.411 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730336+0000", 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.412 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.6", 2024-09-10T17:56:18.413 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:24:53.216058+0000", 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000275601, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.414 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.415 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.416 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.417 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.418 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.419 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:04.527470+0000", 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:04.527470+0000", 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:04.527840+0000", 2024-09-10T17:56:18.420 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 67, 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.421 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732301+0000", 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 66, 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.422 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.0", 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 20, 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:24:38.815318+0000", 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.423 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.424 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.425 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.426 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.427 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.428 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.632549+0000", 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.632549+0000", 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.632868+0000", 2024-09-10T17:56:18.429 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.430 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728362+0000", 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.431 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1", 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.432 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:12:30.265358+0000", 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.433 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.434 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.435 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.436 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.437 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:46.005227+0000", 2024-09-10T17:56:18.438 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:46.005227+0000", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.198782+0000", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.439 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233041+0000", 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.440 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.7", 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:18:51.873480+0000", 2024-09-10T17:56:18.441 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000733605, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.442 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.443 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.444 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.445 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.446 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 2, 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.190261+0000", 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.190261+0000", 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190567+0000", 2024-09-10T17:56:18.447 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.732389+0000", 2024-09-10T17:56:18.448 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.449 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1", 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:43:04.146953+0000", 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.450 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.451 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.452 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.453 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.454 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 2, 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.455 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.638567+0000", 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.638567+0000", 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.638839+0000", 2024-09-10T17:56:18.456 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:18.457 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.231691+0000", 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.458 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.0", 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:25:30.090957+0000", 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.459 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.460 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.461 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.462 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.463 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.464 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:45.961040+0000", 2024-09-10T17:56:18.465 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:45.961040+0000", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.198381+0000", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.466 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233406+0000", 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.467 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.4", 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:57:34.194479+0000", 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000460835, 2024-09-10T17:56:18.468 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.469 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.470 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.473 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.192979+0000", 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.192979+0000", 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.193278+0000", 2024-09-10T17:56:18.474 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:18.475 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867739+0000", 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.476 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.2", 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:37:14.282484+0000", 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.477 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.478 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.479 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.480 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.481 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.482 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639996+0000", 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639996+0000", 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640516+0000", 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:18.483 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729352+0000", 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.484 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.485 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.3", 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:43:45.900696+0000", 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.486 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.487 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.488 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.489 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.492 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.493 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.494 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:46.005011+0000", 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:46.005011+0000", 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.198385+0000", 2024-09-10T17:56:18.495 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:18.496 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232141+0000", 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.497 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.2", 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:18:31.979953+0000", 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000621335, 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.498 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 19, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.499 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.500 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.501 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 2, 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 2 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.502 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "74'2" 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.503 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.193487+0000", 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.193487+0000", 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.193781+0000", 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:18.504 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233709+0000", 2024-09-10T17:56:18.505 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.506 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.4", 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:22:21.136096+0000", 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.507 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.508 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.509 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.510 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.511 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.512 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.647630+0000", 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.647630+0000", 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.647909+0000", 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:18.513 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.868059+0000", 2024-09-10T17:56:18.514 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.515 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.5", 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:24:12.358545+0000", 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.516 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.517 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.518 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.519 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.520 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.521 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:18.522 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:46.005071+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:46.005071+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.302596+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.523 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728828+0000", 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.524 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.3", 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 22, 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.525 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:24:21.200358+0000", 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000456615, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.526 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.527 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.528 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.529 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "72'1" 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.530 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:18.531 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.200402+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.200402+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200712+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.532 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.156008+0000", 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.533 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.5", 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.534 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:35:02.931886+0000", 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.535 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.536 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.537 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.538 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.539 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642792+0000", 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642792+0000", 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643072+0000", 2024-09-10T17:56:18.540 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.541 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.233618+0000", 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.542 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.4", 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:48:08.246910+0000", 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.543 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.544 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.545 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.546 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.547 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.548 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:45.959700+0000", 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:45.959700+0000", 2024-09-10T17:56:18.549 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.199886+0000", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.550 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728999+0000", 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.551 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.0", 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:56:08.618711+0000", 2024-09-10T17:56:18.552 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.001168997, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.553 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.554 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.555 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.556 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.557 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:18.558 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.191662+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.191662+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.192033+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:18.559 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.234071+0000", 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.560 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.6", 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.561 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T19:46:45.739240+0000", 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.562 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.563 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.564 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 1, 2024-09-10T17:56:18.565 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:18.566 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.567 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.635320+0000", 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.635320+0000", 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.635594+0000", 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.568 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729933+0000", 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.569 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.7", 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.570 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:57:18.996778+0000", 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.571 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.572 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.573 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.574 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.575 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 69, 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.576 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:53:46.005109+0000", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:53:46.005109+0000", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:53:50.197168+0000", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 70, 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:18.577 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:53:44.946861+0000", 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.728647+0000", 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 69, 2024-09-10T17:56:18.578 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "4.1", 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.579 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 21, 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:27:08.888245+0000", 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.000616993, 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.580 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.581 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.582 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.583 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.584 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.585 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.194107+0000", 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.194107+0000", 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.194453+0000", 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.586 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302613+0000", 2024-09-10T17:56:18.587 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:18.588 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.7", 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:45:28.617341+0000", 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.589 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.592 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.593 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.594 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:18.595 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.631299+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.631299+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.631701+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:18.596 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730068+0000", 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.597 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.6", 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.598 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:13:37.640848+0000", 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.599 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.600 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.601 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.602 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.603 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.199847+0000", 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.199847+0000", 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200196+0000", 2024-09-10T17:56:18.604 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:18.605 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155537+0000", 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.606 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.8", 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:22:29.262824+0000", 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.607 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.608 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.609 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.610 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.611 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 4, 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.612 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643016+0000", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643016+0000", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643274+0000", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:18.613 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729200+0000", 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.614 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.9", 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.615 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:38:34.587624+0000", 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.616 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.617 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.618 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.619 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: 2, 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.620 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 4, 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.621 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.194698+0000", 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.194698+0000", 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.195088+0000", 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.622 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.232222+0000", 2024-09-10T17:56:18.623 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.624 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.9", 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T03:44:51.898404+0000", 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.625 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.626 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.627 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.628 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.629 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: 3 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.630 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.631 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.642643+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.642643+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643179+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:18.632 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729134+0000", 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.633 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.8", 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.634 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:36:04.694940+0000", 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.635 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.636 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.637 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.638 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.639 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 1, 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.640 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.188465+0000", 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.188465+0000", 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.188755+0000", 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.641 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.234541+0000", 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.642 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.a", 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.643 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 26, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:56:54.675740+0000", 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.644 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.645 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.646 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.647 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: 1, 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: 7 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 1, 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.648 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.635118+0000", 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.635118+0000", 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.635509+0000", 2024-09-10T17:56:18.649 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.650 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730153+0000", 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.651 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.b", 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.652 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T22:22:53.398301+0000", 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.653 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.654 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.655 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.656 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.657 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.200153+0000", 2024-09-10T17:56:18.658 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.200153+0000", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200921+0000", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.659 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155798+0000", 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:18.660 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.b", 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T20:29:28.252983+0000", 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.661 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.662 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.663 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.664 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 1, 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.665 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.666 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 6, 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.643355+0000", 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.643355+0000", 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.643628+0000", 2024-09-10T17:56:18.667 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.302070+0000", 2024-09-10T17:56:18.668 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.669 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.a", 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:03:41.902602+0000", 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.670 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.671 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.672 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.673 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.674 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 6, 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.675 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.652164+0000", 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.652164+0000", 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.652448+0000", 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.676 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867884+0000", 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.677 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.678 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1d", 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:04:35.453015+0000", 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.679 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.680 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.681 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.682 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.683 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: 6 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.684 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:18.685 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.199765+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.199765+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200230+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:18.686 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:18.687 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155788+0000", 2024-09-10T17:56:18.687 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.687 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:18.687 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.687 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.688 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1c", 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T23:43:32.087337+0000", 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.689 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.690 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.691 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.692 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:18.693 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:18.694 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 5, 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.695 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.652354+0000", 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.652354+0000", 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.652608+0000", 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.696 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.867850+0000", 2024-09-10T17:56:18.697 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.700 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.700 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.701 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1c", 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:53:29.271096+0000", 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.702 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.703 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.704 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 4, 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 5, 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 7, 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.200429+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.200429+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.200731+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:57.155888+0000", 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 2, 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 2, 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1d", 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 28, 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T01:38:03.434358+0000", 2024-09-10T17:56:18.710 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.711 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 3, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 1, 2024-09-10T17:56:18.712 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 1, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.713 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 3, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.714 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: 0 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 7, 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'2" 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.715 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.716 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.639462+0000", 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.639462+0000", 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.640232+0000", 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.717 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730167+0000", 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.718 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.719 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1f", 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T21:31:25.220522+0000", 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.720 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.721 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.722 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.723 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.724 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: 5, 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.725 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:18.726 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.189957+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.189957+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.190257+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.727 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729836+0000", 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 1, 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.728 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 1, 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1e", 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 27, 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.729 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T00:58:03.837878+0000", 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.730 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.731 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.732 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.733 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: 5 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.734 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'1" 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 3, 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 62, 2024-09-10T17:56:18.735 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:39.635894+0000", 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:39.635894+0000", 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:39.636289+0000", 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.736 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 63, 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:38.613602+0000", 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.729692+0000", 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.737 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 62, 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.738 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "3.1e", 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 23, 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-11T18:30:36.030983+0000", 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.739 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.740 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.741 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.742 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: 3, 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: 6, 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: 2 2024-09-10T17:56:18.743 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 3, 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "0'0" 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": [ 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: "acting_primary": 0, 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: "avail_no_missing": [], 2024-09-10T17:56:18.744 INFO:tasks.workunit.client.0.smithi012.stdout: "blocked_by": [], 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "created": 59, 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "dirty_stats_invalid": false, 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_bytes_stats_invalid": false, 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "hitset_stats_invalid": false, 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "last_active": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_active": "2024-09-10T17:52:36.194232+0000", 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "last_became_peered": "2024-09-10T17:52:36.194232+0000", 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "last_change": "2024-09-10T17:52:36.194542+0000", 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "last_clean_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.745 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub": "0'0", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_deep_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_epoch_clean": 60, 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fresh": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_fullsized": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_peered": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub": "0'0", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_duration": 0, 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_scrub_stamp": "2024-09-10T17:52:35.173921+0000", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_undegraded": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "last_unstale": "2024-09-10T17:53:56.730385+0000", 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "log_dups_size": 0, 2024-09-10T17:56:18.746 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 4, 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "log_start": "0'0", 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "manifest_stats_invalid": false, 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "mapping_epoch": 59, 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "object_location_counts": [], 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_scrubbed": 0, 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "objects_trimmed": 0, 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_stats_invalid": false, 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 4, 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_start": "0'0", 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "parent": "0.0", 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "parent_split_bits": 0, 2024-09-10T17:56:18.747 INFO:tasks.workunit.client.0.smithi012.stdout: "pgid": "2.1f", 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "pin_stats_invalid": false, 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "purged_snaps": [], 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_epoch": 75, 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "reported_seq": 30, 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_duration": 0.0, 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-12T02:23:54.603082+0000", 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrim_duration": 0.0, 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "snaptrimq_len": 0, 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 582, 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.748 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.749 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 1, 2024-09-10T17:56:18.750 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.751 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 4, 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 1 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: "state": "active+clean", 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_invalid": false, 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: "up": [ 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: 0, 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: 7, 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: 4 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: "up_primary": 0, 2024-09-10T17:56:18.752 INFO:tasks.workunit.client.0.smithi012.stdout: "version": "65'4" 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_per_pool": [ 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 24, 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: "rbd" 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 3, 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pg": 8, 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 8, 2024-09-10T17:56:18.753 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 3, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "poolid": 4, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 19, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.754 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.755 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.756 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 2, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 2 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 12288, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:18.757 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 57, 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 24 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 192, 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 0, 2024-09-10T17:56:18.758 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pg": 64, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 8, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "poolid": 3, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.759 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.760 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.761 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 0 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:18.762 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 0, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 192 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 96, 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:18.763 INFO:tasks.workunit.client.0.smithi012.stdout: "cephfs" 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 45, 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pg": 32, 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 8, 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 45, 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "poolid": 2, 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 3428, 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 0, 2024-09-10T17:56:18.764 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.765 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 66, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 22, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 22, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.766 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 14, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.767 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 51, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 20 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 98304, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 10284, 2024-09-10T17:56:18.768 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 96 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: { 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: "acting": 3, 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: "application": [ 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: "mgr" 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.769 INFO:tasks.workunit.client.0.smithi012.stdout: "log_size": 148, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "num_pg": 1, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "num_store_stats": 3, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "ondisk_log_size": 148, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "poolid": 1, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "stat_sum": { 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes": 590368, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_hit_set_archive": 0, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "num_bytes_recovered": 1771104, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "num_deep_scrub_errors": 0, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict": 0, 2024-09-10T17:56:18.770 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_kb": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_full": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_evict_mode_some": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_kb": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_high": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_flush_mode_low": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_keys_recovered": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_large_omap_objects": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_legacy_snapsets": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_clones": 0, 2024-09-10T17:56:18.771 INFO:tasks.workunit.client.0.smithi012.stdout: "num_object_copies": 6, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects": 2, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_degraded": 0, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_dirty": 2, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_hit_set_archive": 0, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_manifest": 0, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_misplaced": 0, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing": 0, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_missing_on_primary": 0, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_omap": 0, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_pinned": 0, 2024-09-10T17:56:18.772 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_recovered": 6, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_repaired": 0, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_objects_unfound": 0, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_bytes": 0, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_omap_keys": 0, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_promote": 0, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read": 394, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_read_kb": 584, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_scrub_errors": 0, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_shallow_scrub_errors": 0, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_whiteouts": 0, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write": 219, 2024-09-10T17:56:18.773 INFO:tasks.workunit.client.0.smithi012.stdout: "num_write_kb": 2416 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "store_stats": { 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "allocated": 1781760, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "available": 0, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed": 0, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_allocated": 0, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "data_compressed_original": 0, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "data_stored": 1771104, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "internal_metadata": 0, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "internally_reserved": 0, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "omap_allocated": 0, 2024-09-10T17:56:18.774 INFO:tasks.workunit.client.0.smithi012.stdout: "total": 0 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "up": 3 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "usage": { 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "pg_num": 105, 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "pools": 4, 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "stats_by_class": { 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "ssd": { 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "total_avail_bytes": 767718260736, 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "total_bytes": 767960285184, 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_bytes": 242024448, 2024-09-10T17:56:18.775 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_raw_bytes": 242024448, 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_raw_ratio": 0.00031515228329226375 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout: "total_avail_bytes": 767718260736, 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout: "total_bytes": 767960285184, 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout: "total_used_bytes": 242024448 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout: } 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout:} 2024-09-10T17:56:18.776 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-09-10T17:56:18.778 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK 2024-09-10T17:56:18.778 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T17:56:18.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T17:56:18.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.782 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.782 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.782 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.782 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.782 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.782 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.782 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.782 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.783 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.788 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:16 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[27356]: pgmap v87: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-10T17:56:18.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.793 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.794 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.795 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.796 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:17 smithi012 ceph-mon[37454]: pgmap v87: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-10T17:56:18.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:18.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:56:18.798 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:56:18.799 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:56:18.799 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:56:18.799 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:56:18.799 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:17 smithi089 ceph-mon[31467]: pgmap v87: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-10T17:56:18.830 INFO:tasks.workunit:Stopping ['test_telemetry_reef.sh'] on client.0... 2024-09-10T17:56:18.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T17:56:19.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:18 smithi012 ceph-mon[27356]: pgmap v88: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:19.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:18 smithi012 ceph-mon[37454]: pgmap v88: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:18 smithi089 ceph-mon[31467]: pgmap v88: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:19.148 DEBUG:teuthology.parallel:result is None 2024-09-10T17:56:19.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T17:56:19.175 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T17:56:19.175 DEBUG:teuthology.orchestra.run.smithi012:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T17:56:19.237 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T17:56:19.237 INFO:teuthology.run_tasks:Running task print... 2024-09-10T17:56:19.249 INFO:teuthology.task.print:**** done end telemetry reef... 2024-09-10T17:56:19.249 INFO:teuthology.run_tasks:Running task print... 2024-09-10T17:56:19.280 INFO:teuthology.task.print:**** done start parallel 2024-09-10T17:56:19.281 INFO:teuthology.run_tasks:Running task parallel... 2024-09-10T17:56:19.320 INFO:teuthology.task.parallel:starting parallel... 2024-09-10T17:56:19.321 INFO:teuthology.task.parallel:In parallel, running task full_sequential... 2024-09-10T17:56:19.321 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-09-10T17:56:19.321 INFO:teuthology.task.print:**** done start ec-rados-default.yaml 2024-09-10T17:56:19.322 INFO:teuthology.task.full_sequential:In full_sequential, running task rados... 2024-09-10T17:56:19.325 INFO:tasks.rados:Beginning rados... 2024-09-10T17:56:19.325 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 4000, 'write_append_excl': False} 2024-09-10T17:56:19.325 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-bharath7-testing-2024-09-10-1409'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'create_rbd_pool': True, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'mons down', 'mon down', 'MON_DOWN', 'out of quorum', 'PG_AVAILABILITY'], 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-bharath7-testing-2024-09-10-1409', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}} 2024-09-10T17:56:19.325 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 4000, 'write_append_excl': False} 2024-09-10T17:56:19.325 INFO:tasks.rados:joining rados 2024-09-10T17:56:19.325 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-10T17:56:19.326 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T17:56:19.326 INFO:teuthology.task.print:**** done start upgrade, wait 2024-09-10T17:56:19.326 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-10T17:56:19.327 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T17:56:19.327 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -e sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-10T17:56:19.327 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2024-09-10T17:56:19.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set teuthologyprofile k=2 m=1 crush-failure-domain=osd 2024-09-10T17:56:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:56:19.549 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:56:21.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:20 smithi012 ceph-mon[27356]: pgmap v89: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:21.029 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:20 smithi012 ceph-mon[37454]: pgmap v89: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:20 smithi089 ceph-mon[31467]: pgmap v89: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:22.889 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:22 smithi012 ceph-mon[27356]: pgmap v90: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:22.890 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:22 smithi012 ceph-mon[37454]: pgmap v90: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:23.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:22 smithi089 ceph-mon[31467]: pgmap v90: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 44 op/s 2024-09-10T17:56:23.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -e sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-10T17:56:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:56:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:23 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2803660853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T17:56:24.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:56:23] "GET /metrics HTTP/1.1" 200 33658 "" "Prometheus/2.43.0" 2024-09-10T17:56:24.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:23 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2803660853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T17:56:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:23 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2803660853' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T17:56:25.051 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:24 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2803660853' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-10T17:56:25.051 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:24 smithi012 ceph-mon[27356]: osdmap e76: 8 total, 8 up, 8 in 2024-09-10T17:56:25.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:24 smithi012 ceph-mon[27356]: pgmap v92: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-10T17:56:25.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:24 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2803660853' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-10T17:56:25.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:24 smithi012 ceph-mon[37454]: osdmap e76: 8 total, 8 up, 8 in 2024-09-10T17:56:25.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:24 smithi012 ceph-mon[37454]: pgmap v92: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-10T17:56:25.077 INFO:tasks.rados:starting run 0 out of 1 2024-09-10T17:56:25.077 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-10T17:56:25.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool create unique_pool_0 16 16 erasure teuthologyprofile 2024-09-10T17:56:25.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:24 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2803660853' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-09-10T17:56:25.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:24 smithi089 ceph-mon[31467]: osdmap e76: 8 total, 8 up, 8 in 2024-09-10T17:56:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:24 smithi089 ceph-mon[31467]: pgmap v92: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-10T17:56:25.996 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:56:26.170 INFO:teuthology.orchestra.run.smithi012.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:56:26.951 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -e sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-10T17:56:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:56:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[37454]: pgmap v93: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:27 smithi012 ceph-mon[27356]: pgmap v93: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:56:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:27.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T17:56:27.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:27 smithi089 ceph-mon[31467]: pgmap v93: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-10T17:56:27.803 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:56:28.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:28 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:28.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:28 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:28.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:28 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:29.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:29 smithi012 ceph-mon[27356]: pgmap v94: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:29.451 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:29 smithi012 ceph-mon[37454]: pgmap v94: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:29.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:29 smithi089 ceph-mon[31467]: pgmap v94: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:30.296 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T17:56:30.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:30 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1386225458' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-09-10T17:56:30.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:30 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1386225458' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-09-10T17:56:30.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:30 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1386225458' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-09-10T17:56:30.920 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T17:56:30.920 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (94s) 72s ago 2m 15.7M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (2m) 72s ago 2m 81.9M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (4m) 72s ago 4m 16.5M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (4m) 72s ago 4m 16.0M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,8765 running (7m) 72s ago 7m 438M - 18.2.4-837-g7a853b17 f21ba1eea74e d3a723eea923 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:9283,8765 running (9m) 72s ago 9m 487M - 18.2.4-837-g7a853b17 f21ba1eea74e 46d8d80f1292 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (9m) 72s ago 9m 48.1M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2f6698e39d41 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (7m) 72s ago 7m 42.7M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e bddaa233c388 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (7m) 72s ago 7m 40.7M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2ba771d7bc46 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (2m) 72s ago 2m 14.0M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (2m) 72s ago 2m 3598k - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (7m) 72s ago 7m 52.8M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e a54550a62cfe 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (6m) 72s ago 6m 44.6M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T17:56:30.921 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (6m) 72s ago 6m 42.5M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T17:56:30.922 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (5m) 72s ago 5m 49.9M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T17:56:30.922 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (5m) 72s ago 5m 45.3M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T17:56:30.922 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (5m) 72s ago 5m 51.1M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T17:56:30.922 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (4m) 72s ago 4m 51.1M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T17:56:30.922 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (4m) 72s ago 4m 49.6M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T17:56:30.922 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (89s) 72s ago 2m 29.3M - 2.43.0 a07b618ecd1d 9c8fe13e4a8e 2024-09-10T17:56:31.199 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:31 smithi012 ceph-mon[27356]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:31 smithi012 ceph-mon[27356]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:31 smithi012 ceph-mon[27356]: osdmap e77: 8 total, 8 up, 8 in 2024-09-10T17:56:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:31 smithi012 ceph-mon[27356]: pgmap v96: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:31.200 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:31 smithi012 ceph-mon[37454]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:31.200 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:31 smithi012 ceph-mon[37454]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:31.200 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:31 smithi012 ceph-mon[37454]: osdmap e77: 8 total, 8 up, 8 in 2024-09-10T17:56:31.205 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'unique_pool_0' created 2024-09-10T17:56:31.308 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:56:31.309 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T17:56:31.309 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:56:31.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:56:31.309 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T17:56:31.310 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:56:31.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:56:31.310 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T17:56:31.310 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:56:31.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:56:31.310 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T17:56:31.310 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:56:31.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:56:31.311 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T17:56:31.311 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 15 2024-09-10T17:56:31.311 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T17:56:31.311 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:56:31.533 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:31 smithi012 ceph-mon[37454]: pgmap v96: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:31.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:31 smithi089 ceph-mon[31467]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:31.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:31 smithi089 ceph-mon[31467]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:31.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:31 smithi089 ceph-mon[31467]: osdmap e77: 8 total, 8 up, 8 in 2024-09-10T17:56:31.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:31 smithi089 ceph-mon[31467]: pgmap v96: 105 pgs: 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:31.631 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:56:31.631 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46", 2024-09-10T17:56:31.631 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T17:56:31.632 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T17:56:31.632 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [], 2024-09-10T17:56:31.632 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "", 2024-09-10T17:56:31.632 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:bad1f558c327094897e4a32e99dd5cb4ae6ccd46 image", 2024-09-10T17:56:31.632 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T17:56:31.632 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:56:31.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-10T17:56:32.150 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T17:56:32.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[27356]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:32.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1386225458' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-09-10T17:56:32.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[27356]: osdmap e78: 8 total, 8 up, 8 in 2024-09-10T17:56:32.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/4159163105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:56:32.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[27356]: from='client.24872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[37454]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1386225458' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-09-10T17:56:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[37454]: osdmap e78: 8 total, 8 up, 8 in 2024-09-10T17:56:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/4159163105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:56:32.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:32 smithi012 ceph-mon[37454]: from='client.24872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:32 smithi089 ceph-mon[31467]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:32 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1386225458' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-09-10T17:56:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:32 smithi089 ceph-mon[31467]: osdmap e78: 8 total, 8 up, 8 in 2024-09-10T17:56:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:32 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/4159163105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:56:32.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:32 smithi089 ceph-mon[31467]: from='client.24872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:56:33.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:33 smithi012 ceph-mon[27356]: osdmap e79: 8 total, 8 up, 8 in 2024-09-10T17:56:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:33 smithi012 ceph-mon[27356]: pgmap v99: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:33.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:33 smithi012 ceph-mon[37454]: osdmap e79: 8 total, 8 up, 8 in 2024-09-10T17:56:33.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:33 smithi012 ceph-mon[37454]: pgmap v99: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:33.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:33 smithi089 ceph-mon[31467]: osdmap e79: 8 total, 8 up, 8 in 2024-09-10T17:56:33.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:33 smithi089 ceph-mon[31467]: pgmap v99: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-10T17:56:34.234 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:34 smithi012 ceph-mon[27356]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:56:34.234 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:34 smithi012 ceph-mon[27356]: osdmap e80: 8 total, 8 up, 8 in 2024-09-10T17:56:34.235 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:34 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/120664228' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:56:34.235 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:34 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:56:34.235 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:34 smithi012 ceph-mon[37454]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:56:34.235 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:34 smithi012 ceph-mon[37454]: osdmap e80: 8 total, 8 up, 8 in 2024-09-10T17:56:34.235 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:34 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/120664228' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:56:34.235 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:34 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:56:34.235 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:56:33] "GET /metrics HTTP/1.1" 200 33658 "" "Prometheus/2.43.0" 2024-09-10T17:56:34.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:34 smithi089 ceph-mon[31467]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T17:56:34.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:34 smithi089 ceph-mon[31467]: osdmap e80: 8 total, 8 up, 8 in 2024-09-10T17:56:34.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:34 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/120664228' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:56:34.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:34 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T17:56:35.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:35 smithi012 ceph-mon[27356]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-09-10T17:56:35.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:35 smithi012 ceph-mon[27356]: osdmap e81: 8 total, 8 up, 8 in 2024-09-10T17:56:35.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:35 smithi012 ceph-mon[27356]: pgmap v102: 121 pgs: 121 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:35.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:35 smithi012 ceph-mon[37454]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-09-10T17:56:35.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:35 smithi012 ceph-mon[37454]: osdmap e81: 8 total, 8 up, 8 in 2024-09-10T17:56:35.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:35 smithi012 ceph-mon[37454]: pgmap v102: 121 pgs: 121 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:35 smithi089 ceph-mon[31467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-09-10T17:56:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:35 smithi089 ceph-mon[31467]: osdmap e81: 8 total, 8 up, 8 in 2024-09-10T17:56:35.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:35 smithi089 ceph-mon[31467]: pgmap v102: 121 pgs: 121 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:35.915 DEBUG:teuthology.orchestra.run.smithi012:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-09-10T17:56:35.947 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight read -> 100 2024-09-10T17:56:35.947 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight delete -> 50 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight snap_create -> 50 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight snap_remove -> 50 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight rollback -> 50 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight setattr -> 25 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight rmattr -> 25 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight copy_from -> 50 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:adding op weight append -> 100 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable) 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout:Configuration: 2024-09-10T17:56:35.948 INFO:tasks.rados.rados.0.smithi012.stdout: Number of operations: 4000 2024-09-10T17:56:35.949 INFO:tasks.rados.rados.0.smithi012.stdout: Number of objects: 50 2024-09-10T17:56:35.949 INFO:tasks.rados.rados.0.smithi012.stdout: Max in flight operations: 16 2024-09-10T17:56:35.949 INFO:tasks.rados.rados.0.smithi012.stdout: Object size (in bytes): 4000000 2024-09-10T17:56:35.949 INFO:tasks.rados.rados.0.smithi012.stdout: Write stride min: 400000 2024-09-10T17:56:35.949 INFO:tasks.rados.rados.0.smithi012.stdout: Write stride max: 800000 2024-09-10T17:56:36.240 INFO:tasks.rados.rados.0.smithi012.stdout:1: write initial oid 1 2024-09-10T17:56:36.240 INFO:tasks.rados.rados.0.smithi012.stdout:1: seq_num 0 ranges {0=24576} 2024-09-10T17:56:36.241 INFO:tasks.rados.rados.0.smithi012.stdout:1: writing smithi01278544-1 from 0 to 24576 tid 1 2024-09-10T17:56:36.241 INFO:tasks.rados.rados.0.smithi012.stdout:2: write initial oid 2 2024-09-10T17:56:36.241 INFO:tasks.rados.rados.0.smithi012.stdout:2: seq_num 1 ranges {0=24576} 2024-09-10T17:56:36.241 INFO:tasks.rados.rados.0.smithi012.stdout:2: writing smithi01278544-2 from 0 to 24576 tid 1 2024-09-10T17:56:36.241 INFO:tasks.rados.rados.0.smithi012.stdout:3: write initial oid 3 2024-09-10T17:56:36.241 INFO:tasks.rados.rados.0.smithi012.stdout:3: seq_num 2 ranges {0=40960} 2024-09-10T17:56:36.242 INFO:tasks.rados.rados.0.smithi012.stdout:3: writing smithi01278544-3 from 0 to 40960 tid 1 2024-09-10T17:56:36.242 INFO:tasks.rados.rados.0.smithi012.stdout:4: write initial oid 4 2024-09-10T17:56:36.242 INFO:tasks.rados.rados.0.smithi012.stdout:4: seq_num 3 ranges {0=57344} 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:4: writing smithi01278544-4 from 0 to 57344 tid 1 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:5: write initial oid 5 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:5: seq_num 4 ranges {0=73728} 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:5: writing smithi01278544-5 from 0 to 73728 tid 1 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:6: write initial oid 6 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:6: seq_num 5 ranges {0=90112} 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:6: writing smithi01278544-6 from 0 to 90112 tid 1 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:7: write initial oid 7 2024-09-10T17:56:36.243 INFO:tasks.rados.rados.0.smithi012.stdout:7: seq_num 6 ranges {0=106496} 2024-09-10T17:56:36.244 INFO:tasks.rados.rados.0.smithi012.stdout:7: writing smithi01278544-7 from 0 to 106496 tid 1 2024-09-10T17:56:36.244 INFO:tasks.rados.rados.0.smithi012.stdout:8: write initial oid 8 2024-09-10T17:56:36.244 INFO:tasks.rados.rados.0.smithi012.stdout:8: seq_num 7 ranges {0=122880} 2024-09-10T17:56:36.245 INFO:tasks.rados.rados.0.smithi012.stdout:8: writing smithi01278544-8 from 0 to 122880 tid 1 2024-09-10T17:56:36.245 INFO:tasks.rados.rados.0.smithi012.stdout:9: write initial oid 9 2024-09-10T17:56:36.245 INFO:tasks.rados.rados.0.smithi012.stdout:9: seq_num 8 ranges {0=139264} 2024-09-10T17:56:36.246 INFO:tasks.rados.rados.0.smithi012.stdout:9: writing smithi01278544-9 from 0 to 139264 tid 1 2024-09-10T17:56:36.246 INFO:tasks.rados.rados.0.smithi012.stdout:10: write initial oid 10 2024-09-10T17:56:36.246 INFO:tasks.rados.rados.0.smithi012.stdout:10: seq_num 9 ranges {0=155648} 2024-09-10T17:56:36.247 INFO:tasks.rados.rados.0.smithi012.stdout:10: writing smithi01278544-10 from 0 to 155648 tid 1 2024-09-10T17:56:36.247 INFO:tasks.rados.rados.0.smithi012.stdout:11: write initial oid 11 2024-09-10T17:56:36.247 INFO:tasks.rados.rados.0.smithi012.stdout:11: seq_num 10 ranges {0=172032} 2024-09-10T17:56:36.249 INFO:tasks.rados.rados.0.smithi012.stdout:11: writing smithi01278544-11 from 0 to 172032 tid 1 2024-09-10T17:56:36.249 INFO:tasks.rados.rados.0.smithi012.stdout:1: finishing write tid 1 to smithi01278544-1 2024-09-10T17:56:36.249 INFO:tasks.rados.rados.0.smithi012.stdout:1: finishing write tid 2 to smithi01278544-1 2024-09-10T17:56:36.249 INFO:tasks.rados.rados.0.smithi012.stdout:2: finishing write tid 1 to smithi01278544-2 2024-09-10T17:56:36.249 INFO:tasks.rados.rados.0.smithi012.stdout:3: finishing write tid 1 to smithi01278544-3 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:3: finishing write tid 2 to smithi01278544-3 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:2: finishing write tid 2 to smithi01278544-2 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:4: finishing write tid 1 to smithi01278544-4 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:5: finishing write tid 1 to smithi01278544-5 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:5: finishing write tid 2 to smithi01278544-5 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:1: finishing write tid 3 to smithi01278544-1 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:1: oid 1 updating version 0 to 1 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:1: oid 1 updating version 1 to 2 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:2: finishing write tid 3 to smithi01278544-2 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:2: oid 2 updating version 0 to 1 2024-09-10T17:56:36.250 INFO:tasks.rados.rados.0.smithi012.stdout:2: oid 2 updating version 1 to 2 2024-09-10T17:56:36.251 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-10T17:56:36.251 INFO:tasks.rados.rados.0.smithi012.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-09-10T17:56:36.251 INFO:tasks.rados.rados.0.smithi012.stdout:1: done (10 left) 2024-09-10T17:56:36.251 INFO:tasks.rados.rados.0.smithi012.stdout:2: done (9 left) 2024-09-10T17:56:36.251 INFO:tasks.rados.rados.0.smithi012.stdout:12: write initial oid 12 2024-09-10T17:56:36.251 INFO:tasks.rados.rados.0.smithi012.stdout:12: seq_num 11 ranges {0=188416} 2024-09-10T17:56:36.252 INFO:tasks.rados.rados.0.smithi012.stdout:12: writing smithi01278544-12 from 0 to 188416 tid 1 2024-09-10T17:56:36.252 INFO:tasks.rados.rados.0.smithi012.stdout:13: write initial oid 13 2024-09-10T17:56:36.252 INFO:tasks.rados.rados.0.smithi012.stdout:13: seq_num 12 ranges {0=204800} 2024-09-10T17:56:36.253 INFO:tasks.rados.rados.0.smithi012.stdout:13: writing smithi01278544-13 from 0 to 204800 tid 1 2024-09-10T17:56:36.253 INFO:tasks.rados.rados.0.smithi012.stdout:14: write initial oid 14 2024-09-10T17:56:36.254 INFO:tasks.rados.rados.0.smithi012.stdout:14: seq_num 13 ranges {0=221184} 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:14: writing smithi01278544-14 from 0 to 221184 tid 1 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:3: finishing write tid 3 to smithi01278544-3 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:3: oid 3 updating version 0 to 1 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:3: oid 3 updating version 1 to 2 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:7: finishing write tid 1 to smithi01278544-7 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:4: finishing write tid 2 to smithi01278544-4 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:4: finishing write tid 3 to smithi01278544-4 2024-09-10T17:56:36.255 INFO:tasks.rados.rados.0.smithi012.stdout:4: oid 4 updating version 0 to 1 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:4: oid 4 updating version 1 to 2 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:7: finishing write tid 2 to smithi01278544-7 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:6: finishing write tid 1 to smithi01278544-6 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:9: finishing write tid 1 to smithi01278544-9 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:6: finishing write tid 2 to smithi01278544-6 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:7: finishing write tid 3 to smithi01278544-7 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:7: oid 7 updating version 0 to 2 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:7: oid 7 version 2 is already newer than 1 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-09-10T17:56:36.256 INFO:tasks.rados.rados.0.smithi012.stdout:9: finishing write tid 2 to smithi01278544-9 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:10: finishing write tid 1 to smithi01278544-10 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:8: finishing write tid 1 to smithi01278544-8 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:8: finishing write tid 2 to smithi01278544-8 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:5: finishing write tid 3 to smithi01278544-5 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:5: oid 5 updating version 0 to 1 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:5: oid 5 updating version 1 to 2 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:10: finishing write tid 2 to smithi01278544-10 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:9: finishing write tid 3 to smithi01278544-9 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:9: oid 9 updating version 0 to 4 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:9: oid 9 version 4 is already newer than 3 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 4 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-09-10T17:56:36.257 INFO:tasks.rados.rados.0.smithi012.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-09-10T17:56:36.258 INFO:tasks.rados.rados.0.smithi012.stdout:3: done (11 left) 2024-09-10T17:56:36.258 INFO:tasks.rados.rados.0.smithi012.stdout:4: done (10 left) 2024-09-10T17:56:36.258 INFO:tasks.rados.rados.0.smithi012.stdout:5: done (9 left) 2024-09-10T17:56:36.258 INFO:tasks.rados.rados.0.smithi012.stdout:7: done (8 left) 2024-09-10T17:56:36.258 INFO:tasks.rados.rados.0.smithi012.stdout:9: done (7 left) 2024-09-10T17:56:36.258 INFO:tasks.rados.rados.0.smithi012.stdout:15: write initial oid 15 2024-09-10T17:56:36.258 INFO:tasks.rados.rados.0.smithi012.stdout:15: seq_num 14 ranges {0=237568} 2024-09-10T17:56:36.259 INFO:tasks.rados.rados.0.smithi012.stdout:15: writing smithi01278544-15 from 0 to 237568 tid 1 2024-09-10T17:56:36.259 INFO:tasks.rados.rados.0.smithi012.stdout:11: finishing write tid 1 to smithi01278544-11 2024-09-10T17:56:36.259 INFO:tasks.rados.rados.0.smithi012.stdout:11: finishing write tid 2 to smithi01278544-11 2024-09-10T17:56:36.259 INFO:tasks.rados.rados.0.smithi012.stdout:6: finishing write tid 3 to smithi01278544-6 2024-09-10T17:56:36.259 INFO:tasks.rados.rados.0.smithi012.stdout:6: oid 6 updating version 0 to 1 2024-09-10T17:56:36.259 INFO:tasks.rados.rados.0.smithi012.stdout:6: oid 6 updating version 1 to 2 2024-09-10T17:56:36.259 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 2 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:8: finishing write tid 3 to smithi01278544-8 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:8: oid 8 updating version 0 to 3 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:8: oid 8 updating version 3 to 4 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:10: finishing write tid 3 to smithi01278544-10 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:10: oid 10 updating version 0 to 1 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:10: oid 10 updating version 1 to 2 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:13: finishing write tid 1 to smithi01278544-13 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:13: finishing write tid 2 to smithi01278544-13 2024-09-10T17:56:36.260 INFO:tasks.rados.rados.0.smithi012.stdout:6: done (7 left) 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:8: done (6 left) 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:10: done (5 left) 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:16: write initial oid 16 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:16: seq_num 15 ranges {0=253952} 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:16: writing smithi01278544-16 from 0 to 253952 tid 1 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:11: finishing write tid 3 to smithi01278544-11 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:11: oid 11 updating version 0 to 4 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:11: oid 11 version 4 is already newer than 3 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:12: finishing write tid 1 to smithi01278544-12 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:14: finishing write tid 1 to smithi01278544-14 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:14: finishing write tid 2 to smithi01278544-14 2024-09-10T17:56:36.261 INFO:tasks.rados.rados.0.smithi012.stdout:12: finishing write tid 2 to smithi01278544-12 2024-09-10T17:56:36.262 INFO:tasks.rados.rados.0.smithi012.stdout:11: done (5 left) 2024-09-10T17:56:36.262 INFO:tasks.rados.rados.0.smithi012.stdout:17: write initial oid 17 2024-09-10T17:56:36.262 INFO:tasks.rados.rados.0.smithi012.stdout:17: seq_num 16 ranges {0=270336} 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:17: writing smithi01278544-17 from 0 to 270336 tid 1 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:18: write initial oid 18 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:13: finishing write tid 3 to smithi01278544-13 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:13: oid 13 updating version 0 to 3 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:13: oid 13 updating version 3 to 4 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 4 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:15: finishing write tid 1 to smithi01278544-15 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:15: finishing write tid 2 to smithi01278544-15 2024-09-10T17:56:36.263 INFO:tasks.rados.rados.0.smithi012.stdout:12: finishing write tid 3 to smithi01278544-12 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:12: oid 12 updating version 0 to 6 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:12: oid 12 version 6 is already newer than 5 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 6 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:14: finishing write tid 3 to smithi01278544-14 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:14: oid 14 updating version 0 to 2 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:14: oid 14 version 2 is already newer than 1 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 2 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:18: seq_num 17 ranges {0=286720} 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:18: writing smithi01278544-18 from 0 to 286720 tid 1 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:12: done (6 left) 2024-09-10T17:56:36.264 INFO:tasks.rados.rados.0.smithi012.stdout:13: done (5 left) 2024-09-10T17:56:36.265 INFO:tasks.rados.rados.0.smithi012.stdout:14: done (4 left) 2024-09-10T17:56:36.265 INFO:tasks.rados.rados.0.smithi012.stdout:19: write initial oid 19 2024-09-10T17:56:36.265 INFO:tasks.rados.rados.0.smithi012.stdout:19: seq_num 18 ranges {0=303104} 2024-09-10T17:56:36.265 INFO:tasks.rados.rados.0.smithi012.stdout:19: writing smithi01278544-19 from 0 to 303104 tid 1 2024-09-10T17:56:36.265 INFO:tasks.rados.rados.0.smithi012.stdout:20: write initial oid 20 2024-09-10T17:56:36.266 INFO:tasks.rados.rados.0.smithi012.stdout:20: seq_num 19 ranges {0=319488} 2024-09-10T17:56:36.267 INFO:tasks.rados.rados.0.smithi012.stdout:20: writing smithi01278544-20 from 0 to 319488 tid 1 2024-09-10T17:56:36.267 INFO:tasks.rados.rados.0.smithi012.stdout:21: write initial oid 21 2024-09-10T17:56:36.267 INFO:tasks.rados.rados.0.smithi012.stdout:21: seq_num 20 ranges {0=344064} 2024-09-10T17:56:36.269 INFO:tasks.rados.rados.0.smithi012.stdout:21: writing smithi01278544-21 from 0 to 344064 tid 1 2024-09-10T17:56:36.269 INFO:tasks.rados.rados.0.smithi012.stdout:22: write initial oid 22 2024-09-10T17:56:36.269 INFO:tasks.rados.rados.0.smithi012.stdout:22: seq_num 21 ranges {0=360448} 2024-09-10T17:56:36.272 INFO:tasks.rados.rados.0.smithi012.stdout:22: writing smithi01278544-22 from 0 to 360448 tid 1 2024-09-10T17:56:36.272 INFO:tasks.rados.rados.0.smithi012.stdout:23: write initial oid 23 2024-09-10T17:56:36.272 INFO:tasks.rados.rados.0.smithi012.stdout:23: seq_num 22 ranges {0=376832} 2024-09-10T17:56:36.274 INFO:tasks.rados.rados.0.smithi012.stdout:23: writing smithi01278544-23 from 0 to 376832 tid 1 2024-09-10T17:56:36.274 INFO:tasks.rados.rados.0.smithi012.stdout:24: write initial oid 24 2024-09-10T17:56:36.274 INFO:tasks.rados.rados.0.smithi012.stdout:24: seq_num 23 ranges {0=393216} 2024-09-10T17:56:36.277 INFO:tasks.rados.rados.0.smithi012.stdout:24: writing smithi01278544-24 from 0 to 393216 tid 1 2024-09-10T17:56:36.277 INFO:tasks.rados.rados.0.smithi012.stdout:25: write initial oid 25 2024-09-10T17:56:36.277 INFO:tasks.rados.rados.0.smithi012.stdout:25: seq_num 24 ranges {0=409600} 2024-09-10T17:56:36.279 INFO:tasks.rados.rados.0.smithi012.stdout:25: writing smithi01278544-25 from 0 to 409600 tid 1 2024-09-10T17:56:36.279 INFO:tasks.rados.rados.0.smithi012.stdout:26: write initial oid 26 2024-09-10T17:56:36.279 INFO:tasks.rados.rados.0.smithi012.stdout:26: seq_num 25 ranges {0=425984} 2024-09-10T17:56:36.282 INFO:tasks.rados.rados.0.smithi012.stdout:26: writing smithi01278544-26 from 0 to 425984 tid 1 2024-09-10T17:56:36.282 INFO:tasks.rados.rados.0.smithi012.stdout:27: write initial oid 27 2024-09-10T17:56:36.282 INFO:tasks.rados.rados.0.smithi012.stdout:27: seq_num 26 ranges {0=442368} 2024-09-10T17:56:36.285 INFO:tasks.rados.rados.0.smithi012.stdout:27: writing smithi01278544-27 from 0 to 442368 tid 1 2024-09-10T17:56:36.285 INFO:tasks.rados.rados.0.smithi012.stdout:28: write initial oid 28 2024-09-10T17:56:36.285 INFO:tasks.rados.rados.0.smithi012.stdout:28: seq_num 27 ranges {0=458752} 2024-09-10T17:56:36.287 INFO:tasks.rados.rados.0.smithi012.stdout:28: writing smithi01278544-28 from 0 to 458752 tid 1 2024-09-10T17:56:36.288 INFO:tasks.rados.rados.0.smithi012.stdout:29: write initial oid 29 2024-09-10T17:56:36.288 INFO:tasks.rados.rados.0.smithi012.stdout:29: seq_num 28 ranges {0=475136} 2024-09-10T17:56:36.290 INFO:tasks.rados.rados.0.smithi012.stdout:29: writing smithi01278544-29 from 0 to 475136 tid 1 2024-09-10T17:56:36.291 INFO:tasks.rados.rados.0.smithi012.stdout:30: write initial oid 30 2024-09-10T17:56:36.291 INFO:tasks.rados.rados.0.smithi012.stdout:30: seq_num 29 ranges {0=491520} 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:30: writing smithi01278544-30 from 0 to 491520 tid 1 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout: waiting on 16 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:16: finishing write tid 1 to smithi01278544-16 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:15: finishing write tid 3 to smithi01278544-15 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:15: oid 15 updating version 0 to 4 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:15: oid 15 version 4 is already newer than 3 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 4 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:16: finishing write tid 2 to smithi01278544-16 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:17: finishing write tid 1 to smithi01278544-17 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:16: finishing write tid 3 to smithi01278544-16 2024-09-10T17:56:36.295 INFO:tasks.rados.rados.0.smithi012.stdout:16: oid 16 updating version 0 to 5 2024-09-10T17:56:36.296 INFO:tasks.rados.rados.0.smithi012.stdout:16: oid 16 updating version 5 to 6 2024-09-10T17:56:36.296 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 6 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-10T17:56:36.296 INFO:tasks.rados.rados.0.smithi012.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-09-10T17:56:36.296 INFO:tasks.rados.rados.0.smithi012.stdout:17: finishing write tid 2 to smithi01278544-17 2024-09-10T17:56:36.296 INFO:tasks.rados.rados.0.smithi012.stdout:15: done (15 left) 2024-09-10T17:56:36.296 INFO:tasks.rados.rados.0.smithi012.stdout:16: done (14 left) 2024-09-10T17:56:36.296 INFO:tasks.rados.rados.0.smithi012.stdout:31: write initial oid 31 2024-09-10T17:56:36.296 INFO:tasks.rados.rados.0.smithi012.stdout:31: seq_num 30 ranges {0=507904} 2024-09-10T17:56:36.297 INFO:tasks.rados.rados.0.smithi012.stdout:31: writing smithi01278544-31 from 0 to 507904 tid 1 2024-09-10T17:56:36.297 INFO:tasks.rados.rados.0.smithi012.stdout:32: write initial oid 32 2024-09-10T17:56:36.297 INFO:tasks.rados.rados.0.smithi012.stdout:32: seq_num 31 ranges {0=524288} 2024-09-10T17:56:36.302 INFO:tasks.rados.rados.0.smithi012.stdout:32: writing smithi01278544-32 from 0 to 524288 tid 1 2024-09-10T17:56:36.302 INFO:tasks.rados.rados.0.smithi012.stdout: waiting on 16 2024-09-10T17:56:36.302 INFO:tasks.rados.rados.0.smithi012.stdout:18: finishing write tid 1 to smithi01278544-18 2024-09-10T17:56:36.302 INFO:tasks.rados.rados.0.smithi012.stdout:18: finishing write tid 2 to smithi01278544-18 2024-09-10T17:56:36.302 INFO:tasks.rados.rados.0.smithi012.stdout:17: finishing write tid 3 to smithi01278544-17 2024-09-10T17:56:36.302 INFO:tasks.rados.rados.0.smithi012.stdout:17: oid 17 updating version 0 to 4 2024-09-10T17:56:36.302 INFO:tasks.rados.rados.0.smithi012.stdout:17: oid 17 version 4 is already newer than 3 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 4 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:19: finishing write tid 1 to smithi01278544-19 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:18: finishing write tid 3 to smithi01278544-18 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:18: oid 18 updating version 0 to 6 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:18: oid 18 version 6 is already newer than 5 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 6 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:19: finishing write tid 2 to smithi01278544-19 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:19: finishing write tid 3 to smithi01278544-19 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:19: oid 19 updating version 0 to 1 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:19: oid 19 updating version 1 to 2 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 2 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:20: finishing write tid 1 to smithi01278544-20 2024-09-10T17:56:36.303 INFO:tasks.rados.rados.0.smithi012.stdout:20: finishing write tid 2 to smithi01278544-20 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:20: finishing write tid 3 to smithi01278544-20 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:20: oid 20 updating version 0 to 8 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:20: oid 20 version 8 is already newer than 7 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 8 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:17: done (15 left) 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:18: done (14 left) 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:19: done (13 left) 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:20: done (12 left) 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:33: write initial oid 33 2024-09-10T17:56:36.304 INFO:tasks.rados.rados.0.smithi012.stdout:33: seq_num 32 ranges {0=540672} 2024-09-10T17:56:36.305 INFO:tasks.rados.rados.0.smithi012.stdout:33: writing smithi01278544-33 from 0 to 540672 tid 1 2024-09-10T17:56:36.305 INFO:tasks.rados.rados.0.smithi012.stdout:34: write initial oid 34 2024-09-10T17:56:36.305 INFO:tasks.rados.rados.0.smithi012.stdout:34: seq_num 33 ranges {0=557056} 2024-09-10T17:56:36.308 INFO:tasks.rados.rados.0.smithi012.stdout:34: writing smithi01278544-34 from 0 to 557056 tid 1 2024-09-10T17:56:36.308 INFO:tasks.rados.rados.0.smithi012.stdout:35: write initial oid 35 2024-09-10T17:56:36.308 INFO:tasks.rados.rados.0.smithi012.stdout:35: seq_num 34 ranges {0=573440} 2024-09-10T17:56:36.312 INFO:tasks.rados.rados.0.smithi012.stdout:35: writing smithi01278544-35 from 0 to 573440 tid 1 2024-09-10T17:56:36.312 INFO:tasks.rados.rados.0.smithi012.stdout:36: write initial oid 36 2024-09-10T17:56:36.312 INFO:tasks.rados.rados.0.smithi012.stdout:36: seq_num 35 ranges {0=589824} 2024-09-10T17:56:36.316 INFO:tasks.rados.rados.0.smithi012.stdout:36: writing smithi01278544-36 from 0 to 589824 tid 1 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout: waiting on 16 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:21: finishing write tid 1 to smithi01278544-21 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:21: finishing write tid 2 to smithi01278544-21 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:21: finishing write tid 3 to smithi01278544-21 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:21: oid 21 updating version 0 to 4 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:21: oid 21 version 4 is already newer than 3 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 4 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:22: finishing write tid 1 to smithi01278544-22 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:22: finishing write tid 2 to smithi01278544-22 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:23: finishing write tid 1 to smithi01278544-23 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:23: finishing write tid 2 to smithi01278544-23 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:22: finishing write tid 3 to smithi01278544-22 2024-09-10T17:56:36.317 INFO:tasks.rados.rados.0.smithi012.stdout:22: oid 22 updating version 0 to 10 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:22: oid 22 version 10 is already newer than 9 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 10 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:23: finishing write tid 3 to smithi01278544-23 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:23: oid 23 updating version 0 to 6 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:23: oid 23 version 6 is already newer than 5 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:24: finishing write tid 1 to smithi01278544-24 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:24: finishing write tid 2 to smithi01278544-24 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:25: finishing write tid 1 to smithi01278544-25 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:25: finishing write tid 2 to smithi01278544-25 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:24: finishing write tid 3 to smithi01278544-24 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:24: oid 24 updating version 0 to 1 2024-09-10T17:56:36.318 INFO:tasks.rados.rados.0.smithi012.stdout:24: oid 24 updating version 1 to 2 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 2 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:26: finishing write tid 1 to smithi01278544-26 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:25: finishing write tid 3 to smithi01278544-25 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:25: oid 25 updating version 0 to 11 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:25: oid 25 updating version 11 to 12 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 12 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:26: finishing write tid 2 to smithi01278544-26 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:26: finishing write tid 3 to smithi01278544-26 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:26: oid 26 updating version 0 to 4 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:26: oid 26 version 4 is already newer than 3 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 4 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-09-10T17:56:36.319 INFO:tasks.rados.rados.0.smithi012.stdout:27: finishing write tid 1 to smithi01278544-27 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:27: finishing write tid 2 to smithi01278544-27 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:27: finishing write tid 3 to smithi01278544-27 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:27: oid 27 updating version 0 to 4 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:27: oid 27 version 4 is already newer than 3 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:28: finishing write tid 1 to smithi01278544-28 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:28: finishing write tid 2 to smithi01278544-28 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:29: finishing write tid 1 to smithi01278544-29 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:29: finishing write tid 2 to smithi01278544-29 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:21: done (15 left) 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:22: done (14 left) 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:23: done (13 left) 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:24: done (12 left) 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:25: done (11 left) 2024-09-10T17:56:36.320 INFO:tasks.rados.rados.0.smithi012.stdout:26: done (10 left) 2024-09-10T17:56:36.321 INFO:tasks.rados.rados.0.smithi012.stdout:27: done (9 left) 2024-09-10T17:56:36.321 INFO:tasks.rados.rados.0.smithi012.stdout:37: write initial oid 37 2024-09-10T17:56:36.321 INFO:tasks.rados.rados.0.smithi012.stdout:37: seq_num 36 ranges {0=606208} 2024-09-10T17:56:36.321 INFO:tasks.rados.rados.0.smithi012.stdout:37: writing smithi01278544-37 from 0 to 606208 tid 1 2024-09-10T17:56:36.321 INFO:tasks.rados.rados.0.smithi012.stdout:38: write initial oid 38 2024-09-10T17:56:36.321 INFO:tasks.rados.rados.0.smithi012.stdout:38: seq_num 37 ranges {0=622592} 2024-09-10T17:56:36.323 INFO:tasks.rados.rados.0.smithi012.stdout:38: writing smithi01278544-38 from 0 to 622592 tid 1 2024-09-10T17:56:36.323 INFO:tasks.rados.rados.0.smithi012.stdout:39: write initial oid 39 2024-09-10T17:56:36.324 INFO:tasks.rados.rados.0.smithi012.stdout:39: seq_num 38 ranges {0=638976} 2024-09-10T17:56:36.328 INFO:tasks.rados.rados.0.smithi012.stdout:39: writing smithi01278544-39 from 0 to 638976 tid 1 2024-09-10T17:56:36.328 INFO:tasks.rados.rados.0.smithi012.stdout:40: write initial oid 40 2024-09-10T17:56:36.328 INFO:tasks.rados.rados.0.smithi012.stdout:40: seq_num 39 ranges {0=663552} 2024-09-10T17:56:36.332 INFO:tasks.rados.rados.0.smithi012.stdout:40: writing smithi01278544-40 from 0 to 663552 tid 1 2024-09-10T17:56:36.332 INFO:tasks.rados.rados.0.smithi012.stdout:41: write initial oid 41 2024-09-10T17:56:36.332 INFO:tasks.rados.rados.0.smithi012.stdout:41: seq_num 40 ranges {0=679936} 2024-09-10T17:56:36.336 INFO:tasks.rados.rados.0.smithi012.stdout:41: writing smithi01278544-41 from 0 to 679936 tid 1 2024-09-10T17:56:36.336 INFO:tasks.rados.rados.0.smithi012.stdout:42: write initial oid 42 2024-09-10T17:56:36.336 INFO:tasks.rados.rados.0.smithi012.stdout:42: seq_num 41 ranges {0=696320} 2024-09-10T17:56:36.341 INFO:tasks.rados.rados.0.smithi012.stdout:42: writing smithi01278544-42 from 0 to 696320 tid 1 2024-09-10T17:56:36.341 INFO:tasks.rados.rados.0.smithi012.stdout:43: write initial oid 43 2024-09-10T17:56:36.341 INFO:tasks.rados.rados.0.smithi012.stdout:43: seq_num 42 ranges {0=712704} 2024-09-10T17:56:36.346 INFO:tasks.rados.rados.0.smithi012.stdout:43: writing smithi01278544-43 from 0 to 712704 tid 1 2024-09-10T17:56:36.346 INFO:tasks.rados.rados.0.smithi012.stdout: waiting on 16 2024-09-10T17:56:36.346 INFO:tasks.rados.rados.0.smithi012.stdout:28: finishing write tid 3 to smithi01278544-28 2024-09-10T17:56:36.346 INFO:tasks.rados.rados.0.smithi012.stdout:28: oid 28 updating version 0 to 1 2024-09-10T17:56:36.346 INFO:tasks.rados.rados.0.smithi012.stdout:28: oid 28 updating version 1 to 2 2024-09-10T17:56:36.346 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 2 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-10T17:56:36.346 INFO:tasks.rados.rados.0.smithi012.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-09-10T17:56:36.346 INFO:tasks.rados.rados.0.smithi012.stdout:29: finishing write tid 3 to smithi01278544-29 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:29: oid 29 updating version 0 to 2 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:29: oid 29 version 2 is already newer than 1 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 2 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:30: finishing write tid 1 to smithi01278544-30 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:28: done (15 left) 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:29: done (14 left) 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:44: write initial oid 44 2024-09-10T17:56:36.347 INFO:tasks.rados.rados.0.smithi012.stdout:44: seq_num 43 ranges {0=729088} 2024-09-10T17:56:36.351 INFO:tasks.rados.rados.0.smithi012.stdout:44: writing smithi01278544-44 from 0 to 729088 tid 1 2024-09-10T17:56:36.351 INFO:tasks.rados.rados.0.smithi012.stdout:45: write initial oid 45 2024-09-10T17:56:36.351 INFO:tasks.rados.rados.0.smithi012.stdout:45: seq_num 44 ranges {0=745472} 2024-09-10T17:56:36.356 INFO:tasks.rados.rados.0.smithi012.stdout:45: writing smithi01278544-45 from 0 to 745472 tid 1 2024-09-10T17:56:36.356 INFO:tasks.rados.rados.0.smithi012.stdout: waiting on 16 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:30: finishing write tid 2 to smithi01278544-30 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:30: finishing write tid 3 to smithi01278544-30 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:30: oid 30 updating version 0 to 1 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:30: oid 30 updating version 1 to 2 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:31: finishing write tid 1 to smithi01278544-31 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:31: finishing write tid 2 to smithi01278544-31 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:31: finishing write tid 3 to smithi01278544-31 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:31: oid 31 updating version 0 to 5 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:31: oid 31 updating version 5 to 6 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 6 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-09-10T17:56:36.357 INFO:tasks.rados.rados.0.smithi012.stdout:32: finishing write tid 1 to smithi01278544-32 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:32: finishing write tid 2 to smithi01278544-32 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:32: finishing write tid 3 to smithi01278544-32 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:32: oid 32 updating version 0 to 4 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:32: oid 32 version 4 is already newer than 3 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 4 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:33: finishing write tid 1 to smithi01278544-33 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:33: finishing write tid 2 to smithi01278544-33 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:33: finishing write tid 3 to smithi01278544-33 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:33: oid 33 updating version 0 to 3 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:33: oid 33 updating version 3 to 4 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 4 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-09-10T17:56:36.358 INFO:tasks.rados.rados.0.smithi012.stdout:34: finishing write tid 1 to smithi01278544-34 2024-09-10T17:56:36.359 INFO:tasks.rados.rados.0.smithi012.stdout:34: finishing write tid 2 to smithi01278544-34 2024-09-10T17:56:36.359 INFO:tasks.rados.rados.0.smithi012.stdout:30: done (15 left) 2024-09-10T17:56:36.359 INFO:tasks.rados.rados.0.smithi012.stdout:31: done (14 left) 2024-09-10T17:56:36.359 INFO:tasks.rados.rados.0.smithi012.stdout:32: done (13 left) 2024-09-10T17:56:36.359 INFO:tasks.rados.rados.0.smithi012.stdout:33: done (12 left) 2024-09-10T17:56:36.359 INFO:tasks.rados.rados.0.smithi012.stdout:46: write initial oid 46 2024-09-10T17:56:36.359 INFO:tasks.rados.rados.0.smithi012.stdout:46: seq_num 45 ranges {0=761856} 2024-09-10T17:56:36.360 INFO:tasks.rados.rados.0.smithi012.stdout:46: writing smithi01278544-46 from 0 to 761856 tid 1 2024-09-10T17:56:36.360 INFO:tasks.rados.rados.0.smithi012.stdout:47: write initial oid 47 2024-09-10T17:56:36.360 INFO:tasks.rados.rados.0.smithi012.stdout:47: seq_num 46 ranges {0=778240} 2024-09-10T17:56:36.365 INFO:tasks.rados.rados.0.smithi012.stdout:47: writing smithi01278544-47 from 0 to 778240 tid 1 2024-09-10T17:56:36.365 INFO:tasks.rados.rados.0.smithi012.stdout:48: write initial oid 48 2024-09-10T17:56:36.365 INFO:tasks.rados.rados.0.smithi012.stdout:48: seq_num 47 ranges {0=794624} 2024-09-10T17:56:36.370 INFO:tasks.rados.rados.0.smithi012.stdout:48: writing smithi01278544-48 from 0 to 794624 tid 1 2024-09-10T17:56:36.370 INFO:tasks.rados.rados.0.smithi012.stdout:49: write initial oid 49 2024-09-10T17:56:36.370 INFO:tasks.rados.rados.0.smithi012.stdout:49: seq_num 48 ranges {0=409600,409600=401408} 2024-09-10T17:56:36.373 INFO:tasks.rados.rados.0.smithi012.stdout:49: writing smithi01278544-49 from 0 to 409600 tid 1 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout:49: writing smithi01278544-49 from 409600 to 811008 tid 2 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout: waiting on 16 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout:34: finishing write tid 3 to smithi01278544-34 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout:34: oid 34 updating version 0 to 8 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout:34: oid 34 version 8 is already newer than 7 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 8 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout:35: finishing write tid 1 to smithi01278544-35 2024-09-10T17:56:36.376 INFO:tasks.rados.rados.0.smithi012.stdout:35: finishing write tid 2 to smithi01278544-35 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:35: finishing write tid 3 to smithi01278544-35 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:35: oid 35 updating version 0 to 5 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:35: oid 35 updating version 5 to 6 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:36: finishing write tid 1 to smithi01278544-36 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:34: done (15 left) 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:35: done (14 left) 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:50: write initial oid 50 2024-09-10T17:56:36.377 INFO:tasks.rados.rados.0.smithi012.stdout:50: seq_num 49 ranges {0=425984,425984=401408} 2024-09-10T17:56:36.378 INFO:tasks.rados.rados.0.smithi012.stdout:50: writing smithi01278544-50 from 0 to 425984 tid 1 2024-09-10T17:56:36.383 INFO:tasks.rados.rados.0.smithi012.stdout:50: writing smithi01278544-50 from 425984 to 827392 tid 2 2024-09-10T17:56:36.383 INFO:tasks.rados.rados.0.smithi012.stdout:51: copy_from oid 2 from oid 11 current snap is 0 2024-09-10T17:56:36.383 INFO:tasks.rados.rados.0.smithi012.stdout:36: finishing write tid 2 to smithi01278544-36 2024-09-10T17:56:36.383 INFO:tasks.rados.rados.0.smithi012.stdout:36: finishing write tid 3 to smithi01278544-36 2024-09-10T17:56:36.383 INFO:tasks.rados.rados.0.smithi012.stdout:36: oid 36 updating version 0 to 6 2024-09-10T17:56:36.383 INFO:tasks.rados.rados.0.smithi012.stdout:36: oid 36 version 6 is already newer than 5 2024-09-10T17:56:36.383 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 6 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-10T17:56:36.383 INFO:tasks.rados.rados.0.smithi012.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:37: finishing write tid 1 to smithi01278544-37 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:37: finishing write tid 2 to smithi01278544-37 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:37: finishing write tid 3 to smithi01278544-37 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:37: oid 37 updating version 0 to 8 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:37: oid 37 version 8 is already newer than 7 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 8 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:38: finishing write tid 1 to smithi01278544-38 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:38: finishing write tid 2 to smithi01278544-38 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:38: finishing write tid 3 to smithi01278544-38 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:38: oid 38 updating version 0 to 5 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:38: oid 38 updating version 5 to 6 2024-09-10T17:56:36.384 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:39: finishing write tid 1 to smithi01278544-39 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:39: finishing write tid 2 to smithi01278544-39 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:39: finishing write tid 3 to smithi01278544-39 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:39: oid 39 updating version 0 to 13 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:39: oid 39 updating version 13 to 14 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 14 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:40: finishing write tid 1 to smithi01278544-40 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:40: finishing write tid 2 to smithi01278544-40 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:40: finishing write tid 3 to smithi01278544-40 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:40: oid 40 updating version 0 to 5 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:40: oid 40 updating version 5 to 6 2024-09-10T17:56:36.385 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:41: finishing write tid 1 to smithi01278544-41 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:41: finishing write tid 2 to smithi01278544-41 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:41: finishing write tid 3 to smithi01278544-41 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:41: oid 41 updating version 0 to 10 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:41: oid 41 version 10 is already newer than 9 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 10 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:42: finishing write tid 1 to smithi01278544-42 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:42: finishing write tid 2 to smithi01278544-42 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:42: finishing write tid 3 to smithi01278544-42 2024-09-10T17:56:36.386 INFO:tasks.rados.rados.0.smithi012.stdout:42: oid 42 updating version 0 to 7 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:42: oid 42 updating version 7 to 8 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 8 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:43: finishing write tid 1 to smithi01278544-43 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:43: finishing write tid 2 to smithi01278544-43 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:43: finishing write tid 3 to smithi01278544-43 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:43: oid 43 updating version 0 to 10 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:43: oid 43 version 10 is already newer than 9 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 10 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:44: finishing write tid 1 to smithi01278544-44 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:44: finishing write tid 2 to smithi01278544-44 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:44: finishing write tid 3 to smithi01278544-44 2024-09-10T17:56:36.387 INFO:tasks.rados.rados.0.smithi012.stdout:44: oid 44 updating version 0 to 5 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:44: oid 44 updating version 5 to 6 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 6 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:45: finishing write tid 1 to smithi01278544-45 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:45: finishing write tid 2 to smithi01278544-45 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:45: finishing write tid 3 to smithi01278544-45 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:45: oid 45 updating version 0 to 12 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:45: oid 45 version 12 is already newer than 11 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 12 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:46: finishing write tid 1 to smithi01278544-46 2024-09-10T17:56:36.388 INFO:tasks.rados.rados.0.smithi012.stdout:46: finishing write tid 2 to smithi01278544-46 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:46: finishing write tid 3 to smithi01278544-46 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:46: oid 46 updating version 0 to 7 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:46: oid 46 updating version 7 to 8 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 8 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:47: finishing write tid 1 to smithi01278544-47 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:47: finishing write tid 2 to smithi01278544-47 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:47: finishing write tid 3 to smithi01278544-47 2024-09-10T17:56:36.389 INFO:tasks.rados.rados.0.smithi012.stdout:47: oid 47 updating version 0 to 14 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:47: oid 47 version 14 is already newer than 13 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 14 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:48: finishing write tid 1 to smithi01278544-48 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:48: finishing write tid 2 to smithi01278544-48 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:49: finishing write tid 1 to smithi01278544-49 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:48: finishing write tid 3 to smithi01278544-48 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:48: oid 48 updating version 0 to 7 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:48: oid 48 updating version 7 to 8 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 8 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:49: finishing write tid 2 to smithi01278544-49 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:49: finishing write tid 3 to smithi01278544-49 2024-09-10T17:56:36.390 INFO:tasks.rados.rados.0.smithi012.stdout:49: finishing write tid 4 to smithi01278544-49 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:49: oid 49 updating version 0 to 7 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:49: oid 49 updating version 7 to 9 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:49: oid 49 version 9 is already newer than 8 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:50: finishing write tid 1 to smithi01278544-50 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:36: done (15 left) 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:37: done (14 left) 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:38: done (13 left) 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:39: done (12 left) 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:40: done (11 left) 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:41: done (10 left) 2024-09-10T17:56:36.391 INFO:tasks.rados.rados.0.smithi012.stdout:42: done (9 left) 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:43: done (8 left) 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:44: done (7 left) 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:45: done (6 left) 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:46: done (5 left) 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:47: done (4 left) 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:48: done (3 left) 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:49: done (2 left) 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 0 2024-09-10T17:56:36.392 INFO:tasks.rados.rados.0.smithi012.stdout:52: seq_num 50 ranges {442368=442368,884736=401408} 2024-09-10T17:56:36.394 INFO:tasks.rados.rados.0.smithi012.stdout:52: writing smithi01278544-27 from 442368 to 884736 tid 1 2024-09-10T17:56:36.394 INFO:tasks.rados.rados.0.smithi012.stdout:52: writing smithi01278544-27 from 884736 to 1286144 tid 2 2024-09-10T17:56:36.394 INFO:tasks.rados.rados.0.smithi012.stdout:53: rmattr oid 24 current snap is 0 2024-09-10T17:56:36.394 INFO:tasks.rados.rados.0.smithi012.stdout:53: done (3 left) 2024-09-10T17:56:36.394 INFO:tasks.rados.rados.0.smithi012.stdout:54: delete oid 10 current snap is 0 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:50: finishing write tid 2 to smithi01278544-50 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:50: finishing write tid 3 to smithi01278544-50 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:50: finishing write tid 4 to smithi01278544-50 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:50: oid 50 updating version 0 to 1 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:50: oid 50 updating version 1 to 2 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:50: oid 50 updating version 2 to 3 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 3 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:51: finishing copy_from racing read to smithi01278544-2 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:51: finishing copy_from to smithi01278544-2 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:52: finishing write tid 1 to smithi01278544-27 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:50: done (3 left) 2024-09-10T17:56:36.395 INFO:tasks.rados.rados.0.smithi012.stdout:51: done (2 left) 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:54: done (1 left) 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:55: read oid 15 snap -1 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:56: rollback oid 31 current snap is 0 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:56: done (2 left) 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:57: read oid 28 snap -1 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:57: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:58: copy_from oid 29 from oid 47 current snap is 0 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:59: rollback oid 45 current snap is 0 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:59: done (4 left) 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:60: copy_from oid 22 from oid 48 current snap is 0 2024-09-10T17:56:36.396 INFO:tasks.rados.rados.0.smithi012.stdout:61: delete oid 1 current snap is 0 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:52: finishing write tid 2 to smithi01278544-27 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:52: finishing write tid 3 to smithi01278544-27 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:52: finishing write tid 4 to smithi01278544-27 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:52: oid 27 updating version 0 to 10 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:52: oid 27 updating version 10 to 11 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:52: oid 27 version 11 is already newer than 9 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 11 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:52: left oid 27 (ObjNum 50 snap 0 seq_num 50) 2024-09-10T17:56:36.397 INFO:tasks.rados.rados.0.smithi012.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2024-09-10T17:56:36.401 INFO:tasks.rados.rados.0.smithi012.stdout:57: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-10T17:56:36.414 INFO:tasks.rados.rados.0.smithi012.stdout:60: finishing copy_from racing read to smithi01278544-22 2024-09-10T17:56:36.414 INFO:tasks.rados.rados.0.smithi012.stdout:60: finishing copy_from to smithi01278544-22 2024-09-10T17:56:36.414 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 8 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-10T17:56:36.414 INFO:tasks.rados.rados.0.smithi012.stdout:58: finishing copy_from racing read to smithi01278544-29 2024-09-10T17:56:36.414 INFO:tasks.rados.rados.0.smithi012.stdout:58: finishing copy_from to smithi01278544-29 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 14 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:52: done (5 left) 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:55: done (4 left) 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:57: done (3 left) 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:58: done (2 left) 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:60: done (1 left) 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:61: done (0 left) 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:62: read oid 17 snap -1 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:62: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-10T17:56:36.415 INFO:tasks.rados.rados.0.smithi012.stdout:63: snap_create 2024-09-10T17:56:36.417 INFO:tasks.rados.rados.0.smithi012.stdout:62: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-10T17:56:36.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:36 smithi012 ceph-mon[27356]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:56:36.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:36 smithi012 ceph-mon[27356]: Cluster is now healthy 2024-09-10T17:56:36.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:36 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1437718249' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-09-10T17:56:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:36 smithi012 ceph-mon[37454]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:56:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:36 smithi012 ceph-mon[37454]: Cluster is now healthy 2024-09-10T17:56:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:36 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1437718249' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-09-10T17:56:36.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:36 smithi089 ceph-mon[31467]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T17:56:36.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:36 smithi089 ceph-mon[31467]: Cluster is now healthy 2024-09-10T17:56:36.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:36 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1437718249' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-09-10T17:56:37.245 INFO:tasks.rados.rados.0.smithi012.stdout:62: done (1 left) 2024-09-10T17:56:37.245 INFO:tasks.rados.rados.0.smithi012.stdout:63: done (0 left) 2024-09-10T17:56:37.246 INFO:tasks.rados.rados.0.smithi012.stdout:64: copy_from oid 15 from oid 2 current snap is 1 2024-09-10T17:56:37.246 INFO:tasks.rados.rados.0.smithi012.stdout:65: read oid 30 snap -1 2024-09-10T17:56:37.246 INFO:tasks.rados.rados.0.smithi012.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-10T17:56:37.246 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 1 2024-09-10T17:56:37.246 INFO:tasks.rados.rados.0.smithi012.stdout:66: seq_num 53 ranges {376832=491520,868352=401408} 2024-09-10T17:56:37.250 INFO:tasks.rados.rados.0.smithi012.stdout:66: writing smithi01278544-23 from 376832 to 868352 tid 1 2024-09-10T17:56:37.253 INFO:tasks.rados.rados.0.smithi012.stdout:66: writing smithi01278544-23 from 868352 to 1269760 tid 2 2024-09-10T17:56:37.253 INFO:tasks.rados.rados.0.smithi012.stdout:67: rollback oid 10 current snap is 1 2024-09-10T17:56:37.253 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 0 2024-09-10T17:56:37.253 INFO:tasks.rados.rados.0.smithi012.stdout:68: setattr oid 32 current snap is 1 2024-09-10T17:56:37.253 INFO:tasks.rados.rados.0.smithi012.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-10T17:56:37.271 INFO:tasks.rados.rados.0.smithi012.stdout:67: finishing rollback tid 1 to smithi01278544-10 2024-09-10T17:56:37.271 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 0 (ObjNum 33 snap 0 seq_num 3491042552) dirty dne 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:64: finishing copy_from racing read to smithi01278544-15 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:64: finishing copy_from to smithi01278544-15 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:66: finishing write tid 1 to smithi01278544-23 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:66: finishing write tid 2 to smithi01278544-23 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:66: finishing write tid 3 to smithi01278544-23 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:66: finishing write tid 4 to smithi01278544-23 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:66: oid 23 updating version 0 to 11 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:66: oid 23 updating version 11 to 12 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:66: oid 23 version 12 is already newer than 10 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 12 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:66: left oid 23 (ObjNum 53 snap 1 seq_num 53) 2024-09-10T17:56:37.272 INFO:tasks.rados.rados.0.smithi012.stdout:64: done (4 left) 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:65: done (3 left) 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:66: done (2 left) 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:67: done (1 left) 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:69: copy_from oid 45 from oid 34 current snap is 1 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:70: read oid 23 snap 0 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:70: expect (ObjNum 22 snap 0 seq_num 22) 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:71: copy_from oid 36 from oid 27 current snap is 1 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:72: rollback oid 49 current snap is 1 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 49 to 0 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:73: read oid 4 snap 0 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:73: expect (ObjNum 3 snap 0 seq_num 3) 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:74: rmattr oid 7 current snap is 1 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:74: done (6 left) 2024-09-10T17:56:37.273 INFO:tasks.rados.rados.0.smithi012.stdout:75: copy_from oid 20 from oid 12 current snap is 1 2024-09-10T17:56:37.274 INFO:tasks.rados.rados.0.smithi012.stdout:76: read oid 39 snap -1 2024-09-10T17:56:37.274 INFO:tasks.rados.rados.0.smithi012.stdout:76: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:56:37.274 INFO:tasks.rados.rados.0.smithi012.stdout:77: copy_from oid 6 from oid 37 current snap is 1 2024-09-10T17:56:37.274 INFO:tasks.rados.rados.0.smithi012.stdout:78: read oid 2 snap -1 2024-09-10T17:56:37.274 INFO:tasks.rados.rados.0.smithi012.stdout:78: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:56:37.274 INFO:tasks.rados.rados.0.smithi012.stdout:79: setattr oid 41 current snap is 1 2024-09-10T17:56:37.274 INFO:tasks.rados.rados.0.smithi012.stdout:80: snap_create 2024-09-10T17:56:37.275 INFO:tasks.rados.rados.0.smithi012.stdout:72: finishing rollback tid 0 to smithi01278544-49 2024-09-10T17:56:37.275 INFO:tasks.rados.rados.0.smithi012.stdout:72: finishing rollback tid 1 to smithi01278544-49 2024-09-10T17:56:37.275 INFO:tasks.rados.rados.0.smithi012.stdout:72: finishing rollback tid 2 to smithi01278544-49 2024-09-10T17:56:37.275 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 16 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-10T17:56:37.275 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 8 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-09-10T17:56:37.275 INFO:tasks.rados.rados.0.smithi012.stdout:73: expect (ObjNum 3 snap 0 seq_num 3) 2024-09-10T17:56:37.278 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 12 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-10T17:56:37.278 INFO:tasks.rados.rados.0.smithi012.stdout:70: expect (ObjNum 22 snap 0 seq_num 22) 2024-09-10T17:56:37.290 INFO:tasks.rados.rados.0.smithi012.stdout:76: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:56:37.309 INFO:tasks.rados.rados.0.smithi012.stdout:78: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:56:37.314 INFO:tasks.rados.rados.0.smithi012.stdout:69: finishing copy_from racing read to smithi01278544-45 2024-09-10T17:56:37.314 INFO:tasks.rados.rados.0.smithi012.stdout:75: finishing copy_from racing read to smithi01278544-20 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:75: finishing copy_from to smithi01278544-20 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 6 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:69: finishing copy_from to smithi01278544-45 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 8 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:77: finishing copy_from racing read to smithi01278544-6 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:77: finishing copy_from to smithi01278544-6 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 8 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:71: finishing copy_from racing read to smithi01278544-36 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:71: finishing copy_from to smithi01278544-36 2024-09-10T17:56:37.315 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 11 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-09-10T17:56:37.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:37 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1437718249' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-09-10T17:56:37.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:37 smithi012 ceph-mon[27356]: osdmap e82: 8 total, 8 up, 8 in 2024-09-10T17:56:37.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:37 smithi012 ceph-mon[27356]: pgmap v104: 121 pgs: 121 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:37.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:37 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1437718249' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-09-10T17:56:37.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:37 smithi012 ceph-mon[37454]: osdmap e82: 8 total, 8 up, 8 in 2024-09-10T17:56:37.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:37 smithi012 ceph-mon[37454]: pgmap v104: 121 pgs: 121 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:37.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:37 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1437718249' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-09-10T17:56:37.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:37 smithi089 ceph-mon[31467]: osdmap e82: 8 total, 8 up, 8 in 2024-09-10T17:56:37.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:37 smithi089 ceph-mon[31467]: pgmap v104: 121 pgs: 121 active+clean; 580 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:38.255 INFO:tasks.rados.rados.0.smithi012.stdout:68: done (11 left) 2024-09-10T17:56:38.255 INFO:tasks.rados.rados.0.smithi012.stdout:69: done (10 left) 2024-09-10T17:56:38.255 INFO:tasks.rados.rados.0.smithi012.stdout:70: done (9 left) 2024-09-10T17:56:38.255 INFO:tasks.rados.rados.0.smithi012.stdout:71: done (8 left) 2024-09-10T17:56:38.255 INFO:tasks.rados.rados.0.smithi012.stdout:72: done (7 left) 2024-09-10T17:56:38.255 INFO:tasks.rados.rados.0.smithi012.stdout:73: done (6 left) 2024-09-10T17:56:38.255 INFO:tasks.rados.rados.0.smithi012.stdout:75: done (5 left) 2024-09-10T17:56:38.255 INFO:tasks.rados.rados.0.smithi012.stdout:76: done (4 left) 2024-09-10T17:56:38.256 INFO:tasks.rados.rados.0.smithi012.stdout:77: done (3 left) 2024-09-10T17:56:38.256 INFO:tasks.rados.rados.0.smithi012.stdout:78: done (2 left) 2024-09-10T17:56:38.256 INFO:tasks.rados.rados.0.smithi012.stdout:79: done (1 left) 2024-09-10T17:56:38.256 INFO:tasks.rados.rados.0.smithi012.stdout:80: done (0 left) 2024-09-10T17:56:38.256 INFO:tasks.rados.rados.0.smithi012.stdout:81: rollback oid 40 current snap is 2 2024-09-10T17:56:38.256 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 40 to 1 2024-09-10T17:56:38.256 INFO:tasks.rados.rados.0.smithi012.stdout:82: snap_create 2024-09-10T17:56:38.257 INFO:tasks.rados.rados.0.smithi012.stdout:81: finishing rollback tid 0 to smithi01278544-40 2024-09-10T17:56:38.257 INFO:tasks.rados.rados.0.smithi012.stdout:81: finishing rollback tid 1 to smithi01278544-40 2024-09-10T17:56:38.257 INFO:tasks.rados.rados.0.smithi012.stdout:81: finishing rollback tid 2 to smithi01278544-40 2024-09-10T17:56:38.257 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 20 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-10T17:56:38.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:38 smithi012 ceph-mon[27356]: osdmap e83: 8 total, 8 up, 8 in 2024-09-10T17:56:38.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:38 smithi012 ceph-mon[37454]: osdmap e83: 8 total, 8 up, 8 in 2024-09-10T17:56:38.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:38 smithi089 ceph-mon[31467]: osdmap e83: 8 total, 8 up, 8 in 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:81: done (1 left) 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:82: done (0 left) 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:83: rollback oid 9 current snap is 3 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 0 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:84: read oid 20 snap 1 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:84: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:85: read oid 41 snap -1 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:85: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-10T17:56:39.256 INFO:tasks.rados.rados.0.smithi012.stdout:86: snap_create 2024-09-10T17:56:39.260 INFO:tasks.rados.rados.0.smithi012.stdout:83: finishing rollback tid 0 to smithi01278544-9 2024-09-10T17:56:39.261 INFO:tasks.rados.rados.0.smithi012.stdout:83: finishing rollback tid 1 to smithi01278544-9 2024-09-10T17:56:39.261 INFO:tasks.rados.rados.0.smithi012.stdout:83: finishing rollback tid 2 to smithi01278544-9 2024-09-10T17:56:39.262 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 13 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-09-10T17:56:39.262 INFO:tasks.rados.rados.0.smithi012.stdout:85: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-10T17:56:39.283 INFO:tasks.rados.rados.0.smithi012.stdout:84: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-10T17:56:39.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:39 smithi012 ceph-mon[27356]: osdmap e84: 8 total, 8 up, 8 in 2024-09-10T17:56:39.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:39 smithi012 ceph-mon[27356]: pgmap v107: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 67 op/s 2024-09-10T17:56:39.524 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:39 smithi012 ceph-mon[37454]: osdmap e84: 8 total, 8 up, 8 in 2024-09-10T17:56:39.524 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:39 smithi012 ceph-mon[37454]: pgmap v107: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 67 op/s 2024-09-10T17:56:39.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:39 smithi089 ceph-mon[31467]: osdmap e84: 8 total, 8 up, 8 in 2024-09-10T17:56:39.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:39 smithi089 ceph-mon[31467]: pgmap v107: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 67 op/s 2024-09-10T17:56:40.260 INFO:tasks.rados.rados.0.smithi012.stdout:83: done (3 left) 2024-09-10T17:56:40.260 INFO:tasks.rados.rados.0.smithi012.stdout:84: done (2 left) 2024-09-10T17:56:40.260 INFO:tasks.rados.rados.0.smithi012.stdout:85: done (1 left) 2024-09-10T17:56:40.260 INFO:tasks.rados.rados.0.smithi012.stdout:86: done (0 left) 2024-09-10T17:56:40.260 INFO:tasks.rados.rados.0.smithi012.stdout:87: snap_remove snap 0 2024-09-10T17:56:40.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:40 smithi012 ceph-mon[27356]: osdmap e85: 8 total, 8 up, 8 in 2024-09-10T17:56:40.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:40 smithi012 ceph-mon[37454]: osdmap e85: 8 total, 8 up, 8 in 2024-09-10T17:56:40.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:40 smithi089 ceph-mon[31467]: osdmap e85: 8 total, 8 up, 8 in 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:87: done (0 left) 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:88: read oid 29 snap 3 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:88: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:89: read oid 46 snap -1 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:89: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:90: copy_from oid 36 from oid 2 current snap is 4 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:91: rmattr oid 49 current snap is 4 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:91: done (3 left) 2024-09-10T17:56:41.268 INFO:tasks.rados.rados.0.smithi012.stdout:92: snap_remove snap 2 2024-09-10T17:56:41.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:41 smithi012 ceph-mon[27356]: osdmap e86: 8 total, 8 up, 8 in 2024-09-10T17:56:41.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:41 smithi012 ceph-mon[27356]: pgmap v110: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 75 op/s 2024-09-10T17:56:41.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:41 smithi012 ceph-mon[37454]: osdmap e86: 8 total, 8 up, 8 in 2024-09-10T17:56:41.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:41 smithi012 ceph-mon[37454]: pgmap v110: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 75 op/s 2024-09-10T17:56:41.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:41 smithi089 ceph-mon[31467]: osdmap e86: 8 total, 8 up, 8 in 2024-09-10T17:56:41.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:41 smithi089 ceph-mon[31467]: pgmap v110: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 6.5 MiB/s wr, 75 op/s 2024-09-10T17:56:42.275 INFO:tasks.rados.rados.0.smithi012.stdout:92: done (3 left) 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:93: rmattr oid 30 current snap is 4 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:93: done (3 left) 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:94: read oid 42 snap 1 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:94: expect (ObjNum 41 snap 0 seq_num 41) 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:95: rmattr oid 14 current snap is 4 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:95: done (4 left) 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:96: read oid 9 snap 1 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:96: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 4 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:90: finishing copy_from racing read to smithi01278544-36 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:90: finishing copy_from to smithi01278544-36 2024-09-10T17:56:42.276 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-10T17:56:42.277 INFO:tasks.rados.rados.0.smithi012.stdout:88: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:56:42.302 INFO:tasks.rados.rados.0.smithi012.stdout:89: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:56:42.325 INFO:tasks.rados.rados.0.smithi012.stdout:97: seq_num 54 ranges {393216=507904,901120=401408} 2024-09-10T17:56:42.330 INFO:tasks.rados.rados.0.smithi012.stdout:97: writing smithi01278544-24 from 393216 to 901120 tid 1 2024-09-10T17:56:42.333 INFO:tasks.rados.rados.0.smithi012.stdout:97: writing smithi01278544-24 from 901120 to 1302528 tid 2 2024-09-10T17:56:42.333 INFO:tasks.rados.rados.0.smithi012.stdout:88: done (5 left) 2024-09-10T17:56:42.333 INFO:tasks.rados.rados.0.smithi012.stdout:89: done (4 left) 2024-09-10T17:56:42.333 INFO:tasks.rados.rados.0.smithi012.stdout:90: done (3 left) 2024-09-10T17:56:42.333 INFO:tasks.rados.rados.0.smithi012.stdout:98: copy_from oid 34 from oid 40 current snap is 4 2024-09-10T17:56:42.333 INFO:tasks.rados.rados.0.smithi012.stdout:96: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-10T17:56:42.338 INFO:tasks.rados.rados.0.smithi012.stdout:94: expect (ObjNum 41 snap 0 seq_num 41) 2024-09-10T17:56:42.358 INFO:tasks.rados.rados.0.smithi012.stdout:97: finishing write tid 1 to smithi01278544-24 2024-09-10T17:56:42.358 INFO:tasks.rados.rados.0.smithi012.stdout:97: finishing write tid 2 to smithi01278544-24 2024-09-10T17:56:42.358 INFO:tasks.rados.rados.0.smithi012.stdout:97: finishing write tid 3 to smithi01278544-24 2024-09-10T17:56:42.359 INFO:tasks.rados.rados.0.smithi012.stdout:97: finishing write tid 4 to smithi01278544-24 2024-09-10T17:56:42.359 INFO:tasks.rados.rados.0.smithi012.stdout:97: oid 24 updating version 0 to 18 2024-09-10T17:56:42.359 INFO:tasks.rados.rados.0.smithi012.stdout:97: oid 24 version 18 is already newer than 17 2024-09-10T17:56:42.359 INFO:tasks.rados.rados.0.smithi012.stdout:97: oid 24 version 18 is already newer than 16 2024-09-10T17:56:42.359 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 18 (ObjNum 54 snap 4 seq_num 54) dirty exists 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:97: left oid 24 (ObjNum 54 snap 4 seq_num 54) 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:98: finishing copy_from racing read to smithi01278544-34 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:98: finishing copy_from to smithi01278544-34 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 20 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:94: done (3 left) 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:96: done (2 left) 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:97: done (1 left) 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:98: done (0 left) 2024-09-10T17:56:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:99: snap_remove snap 3 2024-09-10T17:56:42.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:42 smithi012 ceph-mon[27356]: osdmap e87: 8 total, 8 up, 8 in 2024-09-10T17:56:42.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:42 smithi012 ceph-mon[37454]: osdmap e87: 8 total, 8 up, 8 in 2024-09-10T17:56:42.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:42 smithi089 ceph-mon[31467]: osdmap e87: 8 total, 8 up, 8 in 2024-09-10T17:56:43.283 INFO:tasks.rados.rados.0.smithi012.stdout:99: done (0 left) 2024-09-10T17:56:43.283 INFO:tasks.rados.rados.0.smithi012.stdout:100: copy_from oid 42 from oid 39 current snap is 4 2024-09-10T17:56:43.283 INFO:tasks.rados.rados.0.smithi012.stdout:101: read oid 14 snap 1 2024-09-10T17:56:43.283 INFO:tasks.rados.rados.0.smithi012.stdout:101: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-10T17:56:43.283 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 4 2024-09-10T17:56:43.283 INFO:tasks.rados.rados.0.smithi012.stdout:102: seq_num 55 ranges {811008=524288,1335296=401408} 2024-09-10T17:56:43.290 INFO:tasks.rados.rados.0.smithi012.stdout:102: writing smithi01278544-49 from 811008 to 1335296 tid 1 2024-09-10T17:56:43.294 INFO:tasks.rados.rados.0.smithi012.stdout:102: writing smithi01278544-49 from 1335296 to 1736704 tid 2 2024-09-10T17:56:43.294 INFO:tasks.rados.rados.0.smithi012.stdout:103: delete oid 43 current snap is 4 2024-09-10T17:56:43.294 INFO:tasks.rados.rados.0.smithi012.stdout:101: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:100: finishing copy_from racing read to smithi01278544-42 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:100: finishing copy_from to smithi01278544-42 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 14 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:100: done (3 left) 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:101: done (2 left) 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:103: done (1 left) 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:104: read oid 2 snap -1 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:104: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:105: rollback oid 34 current snap is 4 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 34 to 1 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:102: finishing write tid 1 to smithi01278544-49 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:102: finishing write tid 2 to smithi01278544-49 2024-09-10T17:56:43.302 INFO:tasks.rados.rados.0.smithi012.stdout:102: finishing write tid 3 to smithi01278544-49 2024-09-10T17:56:43.303 INFO:tasks.rados.rados.0.smithi012.stdout:102: finishing write tid 4 to smithi01278544-49 2024-09-10T17:56:43.303 INFO:tasks.rados.rados.0.smithi012.stdout:102: oid 49 updating version 0 to 23 2024-09-10T17:56:43.303 INFO:tasks.rados.rados.0.smithi012.stdout:102: oid 49 updating version 23 to 24 2024-09-10T17:56:43.303 INFO:tasks.rados.rados.0.smithi012.stdout:102: oid 49 version 24 is already newer than 22 2024-09-10T17:56:43.303 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 24 (ObjNum 55 snap 4 seq_num 55) dirty exists 2024-09-10T17:56:43.303 INFO:tasks.rados.rados.0.smithi012.stdout:102: left oid 49 (ObjNum 55 snap 4 seq_num 55) 2024-09-10T17:56:43.303 INFO:tasks.rados.rados.0.smithi012.stdout:102: done (2 left) 2024-09-10T17:56:43.303 INFO:tasks.rados.rados.0.smithi012.stdout:106: delete oid 12 current snap is 4 2024-09-10T17:56:43.304 INFO:tasks.rados.rados.0.smithi012.stdout:105: finishing rollback tid 0 to smithi01278544-34 2024-09-10T17:56:43.304 INFO:tasks.rados.rados.0.smithi012.stdout:106: done (2 left) 2024-09-10T17:56:43.304 INFO:tasks.rados.rados.0.smithi012.stdout:107: read oid 17 snap 1 2024-09-10T17:56:43.304 INFO:tasks.rados.rados.0.smithi012.stdout:107: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-10T17:56:43.304 INFO:tasks.rados.rados.0.smithi012.stdout:108: rollback oid 41 current snap is 4 2024-09-10T17:56:43.304 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 1 2024-09-10T17:56:43.304 INFO:tasks.rados.rados.0.smithi012.stdout:105: finishing rollback tid 1 to smithi01278544-34 2024-09-10T17:56:43.305 INFO:tasks.rados.rados.0.smithi012.stdout:109: delete oid 8 current snap is 4 2024-09-10T17:56:43.305 INFO:tasks.rados.rados.0.smithi012.stdout:105: finishing rollback tid 2 to smithi01278544-34 2024-09-10T17:56:43.305 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 23 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-10T17:56:43.305 INFO:tasks.rados.rados.0.smithi012.stdout:104: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:56:43.311 INFO:tasks.rados.rados.0.smithi012.stdout:107: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:108: finishing rollback tid 0 to smithi01278544-41 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:108: finishing rollback tid 1 to smithi01278544-41 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:108: finishing rollback tid 2 to smithi01278544-41 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 18 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:104: done (4 left) 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:105: done (3 left) 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:107: done (2 left) 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:108: done (1 left) 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:109: done (0 left) 2024-09-10T17:56:43.319 INFO:tasks.rados.rados.0.smithi012.stdout:110: setattr oid 35 current snap is 4 2024-09-10T17:56:43.320 INFO:tasks.rados.rados.0.smithi012.stdout:111: snap_create 2024-09-10T17:56:43.322 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 12 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-10T17:56:43.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-mon[27356]: osdmap e88: 8 total, 8 up, 8 in 2024-09-10T17:56:43.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-mon[27356]: pgmap v113: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:43.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:43.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:43.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-mon[37454]: osdmap e88: 8 total, 8 up, 8 in 2024-09-10T17:56:43.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-mon[37454]: pgmap v113: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:43.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:43.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:43.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:43 smithi089 ceph-mon[31467]: osdmap e88: 8 total, 8 up, 8 in 2024-09-10T17:56:43.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:43 smithi089 ceph-mon[31467]: pgmap v113: 121 pgs: 121 active+clean; 25 MiB data, 273 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:43.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:43.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:43 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:44.277 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:56:43] "GET /metrics HTTP/1.1" 200 36003 "" "Prometheus/2.43.0" 2024-09-10T17:56:44.287 INFO:tasks.rados.rados.0.smithi012.stdout:110: done (1 left) 2024-09-10T17:56:44.287 INFO:tasks.rados.rados.0.smithi012.stdout:111: done (0 left) 2024-09-10T17:56:44.287 INFO:tasks.rados.rados.0.smithi012.stdout:112: copy_from oid 25 from oid 6 current snap is 5 2024-09-10T17:56:44.287 INFO:tasks.rados.rados.0.smithi012.stdout:113: setattr oid 23 current snap is 5 2024-09-10T17:56:44.288 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 5 2024-09-10T17:56:44.288 INFO:tasks.rados.rados.0.smithi012.stdout:114: seq_num 59 ranges {172032=598016,770048=401408} 2024-09-10T17:56:44.293 INFO:tasks.rados.rados.0.smithi012.stdout:114: writing smithi01278544-15 from 172032 to 770048 tid 1 2024-09-10T17:56:44.296 INFO:tasks.rados.rados.0.smithi012.stdout:114: writing smithi01278544-15 from 770048 to 1171456 tid 2 2024-09-10T17:56:44.296 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 5 2024-09-10T17:56:44.296 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 24 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-09-10T17:56:44.296 INFO:tasks.rados.rados.0.smithi012.stdout:115: seq_num 60 ranges {188416=614400,802816=401408} 2024-09-10T17:56:44.300 INFO:tasks.rados.rados.0.smithi012.stdout:115: writing smithi01278544-20 from 188416 to 802816 tid 1 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:115: writing smithi01278544-20 from 802816 to 1204224 tid 2 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:113: done (3 left) 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:116: rollback oid 14 current snap is 5 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 14 to 1 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:112: finishing copy_from racing read to smithi01278544-25 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:114: finishing write tid 1 to smithi01278544-15 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:112: finishing copy_from to smithi01278544-25 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 8 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:114: finishing write tid 2 to smithi01278544-15 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:114: finishing write tid 3 to smithi01278544-15 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:114: finishing write tid 4 to smithi01278544-15 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:114: oid 15 updating version 0 to 28 2024-09-10T17:56:44.304 INFO:tasks.rados.rados.0.smithi012.stdout:114: oid 15 version 28 is already newer than 27 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:114: oid 15 version 28 is already newer than 26 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 28 (ObjNum 59 snap 5 seq_num 59) dirty exists 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:114: left oid 15 (ObjNum 59 snap 5 seq_num 59) 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:112: done (3 left) 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:114: done (2 left) 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:117: read oid 27 snap -1 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:117: expect (ObjNum 50 snap 0 seq_num 50) 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 5 2024-09-10T17:56:44.305 INFO:tasks.rados.rados.0.smithi012.stdout:118: seq_num 61 ranges {344064=630784,974848=401408} 2024-09-10T17:56:44.309 INFO:tasks.rados.rados.0.smithi012.stdout:118: writing smithi01278544-21 from 344064 to 974848 tid 1 2024-09-10T17:56:44.311 INFO:tasks.rados.rados.0.smithi012.stdout:118: writing smithi01278544-21 from 974848 to 1376256 tid 2 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:119: snap_create 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:116: finishing rollback tid 0 to smithi01278544-14 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:115: finishing write tid 1 to smithi01278544-20 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:116: finishing rollback tid 1 to smithi01278544-14 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:115: finishing write tid 2 to smithi01278544-20 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:116: finishing rollback tid 2 to smithi01278544-14 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 32 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:115: finishing write tid 3 to smithi01278544-20 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:115: finishing write tid 4 to smithi01278544-20 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:115: oid 20 updating version 0 to 27 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:115: oid 20 updating version 27 to 29 2024-09-10T17:56:44.312 INFO:tasks.rados.rados.0.smithi012.stdout:115: oid 20 version 29 is already newer than 28 2024-09-10T17:56:44.313 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 29 (ObjNum 60 snap 5 seq_num 60) dirty exists 2024-09-10T17:56:44.313 INFO:tasks.rados.rados.0.smithi012.stdout:115: left oid 20 (ObjNum 60 snap 5 seq_num 60) 2024-09-10T17:56:44.313 INFO:tasks.rados.rados.0.smithi012.stdout:117: expect (ObjNum 50 snap 0 seq_num 50) 2024-09-10T17:56:44.356 INFO:tasks.rados.rados.0.smithi012.stdout:118: finishing write tid 1 to smithi01278544-21 2024-09-10T17:56:44.356 INFO:tasks.rados.rados.0.smithi012.stdout:118: finishing write tid 2 to smithi01278544-21 2024-09-10T17:56:44.356 INFO:tasks.rados.rados.0.smithi012.stdout:118: finishing write tid 3 to smithi01278544-21 2024-09-10T17:56:44.356 INFO:tasks.rados.rados.0.smithi012.stdout:118: finishing write tid 4 to smithi01278544-21 2024-09-10T17:56:44.356 INFO:tasks.rados.rados.0.smithi012.stdout:118: oid 21 updating version 0 to 25 2024-09-10T17:56:44.356 INFO:tasks.rados.rados.0.smithi012.stdout:118: oid 21 updating version 25 to 26 2024-09-10T17:56:44.356 INFO:tasks.rados.rados.0.smithi012.stdout:118: oid 21 updating version 26 to 27 2024-09-10T17:56:44.356 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 27 (ObjNum 61 snap 5 seq_num 61) dirty exists 2024-09-10T17:56:44.357 INFO:tasks.rados.rados.0.smithi012.stdout:118: left oid 21 (ObjNum 61 snap 5 seq_num 61) 2024-09-10T17:56:44.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:44 smithi012 ceph-mon[27356]: osdmap e89: 8 total, 8 up, 8 in 2024-09-10T17:56:44.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:44 smithi012 ceph-mon[37454]: osdmap e89: 8 total, 8 up, 8 in 2024-09-10T17:56:44.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:44 smithi089 ceph-mon[31467]: osdmap e89: 8 total, 8 up, 8 in 2024-09-10T17:56:45.296 INFO:tasks.rados.rados.0.smithi012.stdout:115: done (4 left) 2024-09-10T17:56:45.296 INFO:tasks.rados.rados.0.smithi012.stdout:116: done (3 left) 2024-09-10T17:56:45.297 INFO:tasks.rados.rados.0.smithi012.stdout:117: done (2 left) 2024-09-10T17:56:45.297 INFO:tasks.rados.rados.0.smithi012.stdout:118: done (1 left) 2024-09-10T17:56:45.297 INFO:tasks.rados.rados.0.smithi012.stdout:119: done (0 left) 2024-09-10T17:56:45.297 INFO:tasks.rados.rados.0.smithi012.stdout:120: read oid 48 snap 4 2024-09-10T17:56:45.297 INFO:tasks.rados.rados.0.smithi012.stdout:120: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-10T17:56:45.297 INFO:tasks.rados.rados.0.smithi012.stdout:121: read oid 49 snap 5 2024-09-10T17:56:45.297 INFO:tasks.rados.rados.0.smithi012.stdout:121: expect (ObjNum 55 snap 4 seq_num 55) 2024-09-10T17:56:45.297 INFO:tasks.rados.rados.0.smithi012.stdout:122: delete oid 44 current snap is 6 2024-09-10T17:56:45.301 INFO:tasks.rados.rados.0.smithi012.stdout:120: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-10T17:56:45.325 INFO:tasks.rados.rados.0.smithi012.stdout:120: done (2 left) 2024-09-10T17:56:45.325 INFO:tasks.rados.rados.0.smithi012.stdout:122: done (1 left) 2024-09-10T17:56:45.325 INFO:tasks.rados.rados.0.smithi012.stdout:123: rollback oid 46 current snap is 6 2024-09-10T17:56:45.325 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 4 2024-09-10T17:56:45.325 INFO:tasks.rados.rados.0.smithi012.stdout:121: expect (ObjNum 55 snap 4 seq_num 55) 2024-09-10T17:56:45.388 INFO:tasks.rados.rados.0.smithi012.stdout:123: finishing rollback tid 0 to smithi01278544-46 2024-09-10T17:56:45.388 INFO:tasks.rados.rados.0.smithi012.stdout:123: finishing rollback tid 1 to smithi01278544-46 2024-09-10T17:56:45.388 INFO:tasks.rados.rados.0.smithi012.stdout:123: finishing rollback tid 2 to smithi01278544-46 2024-09-10T17:56:45.388 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 17 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:56:45.388 INFO:tasks.rados.rados.0.smithi012.stdout:121: done (1 left) 2024-09-10T17:56:45.388 INFO:tasks.rados.rados.0.smithi012.stdout:123: done (0 left) 2024-09-10T17:56:45.388 INFO:tasks.rados.rados.0.smithi012.stdout:124: read oid 46 snap -1 2024-09-10T17:56:45.389 INFO:tasks.rados.rados.0.smithi012.stdout:124: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:56:45.389 INFO:tasks.rados.rados.0.smithi012.stdout:125: setattr oid 39 current snap is 6 2024-09-10T17:56:45.389 INFO:tasks.rados.rados.0.smithi012.stdout:126: delete oid 32 current snap is 6 2024-09-10T17:56:45.391 INFO:tasks.rados.rados.0.smithi012.stdout:126: done (2 left) 2024-09-10T17:56:45.391 INFO:tasks.rados.rados.0.smithi012.stdout:127: snap_remove snap 4 2024-09-10T17:56:45.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:45 smithi012 ceph-mon[27356]: osdmap e90: 8 total, 8 up, 8 in 2024-09-10T17:56:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:45 smithi012 ceph-mon[27356]: pgmap v116: 121 pgs: 121 active+clean; 27 MiB data, 277 MiB used, 715 GiB / 715 GiB avail; 2.8 MiB/s rd, 808 KiB/s wr, 19 op/s 2024-09-10T17:56:45.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:45 smithi012 ceph-mon[37454]: osdmap e90: 8 total, 8 up, 8 in 2024-09-10T17:56:45.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:45 smithi012 ceph-mon[37454]: pgmap v116: 121 pgs: 121 active+clean; 27 MiB data, 277 MiB used, 715 GiB / 715 GiB avail; 2.8 MiB/s rd, 808 KiB/s wr, 19 op/s 2024-09-10T17:56:45.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:45 smithi089 ceph-mon[31467]: osdmap e90: 8 total, 8 up, 8 in 2024-09-10T17:56:45.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:45 smithi089 ceph-mon[31467]: pgmap v116: 121 pgs: 121 active+clean; 27 MiB data, 277 MiB used, 715 GiB / 715 GiB avail; 2.8 MiB/s rd, 808 KiB/s wr, 19 op/s 2024-09-10T17:56:46.294 INFO:tasks.rados.rados.0.smithi012.stdout:127: done (2 left) 2024-09-10T17:56:46.294 INFO:tasks.rados.rados.0.smithi012.stdout:128: setattr oid 31 current snap is 6 2024-09-10T17:56:46.295 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 31 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-10T17:56:46.295 INFO:tasks.rados.rados.0.smithi012.stdout:124: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:56:46.318 INFO:tasks.rados.rados.0.smithi012.stdout:124: done (2 left) 2024-09-10T17:56:46.318 INFO:tasks.rados.rados.0.smithi012.stdout:125: done (1 left) 2024-09-10T17:56:46.318 INFO:tasks.rados.rados.0.smithi012.stdout:129: snap_remove snap 1 2024-09-10T17:56:46.765 INFO:tasks.rados.rados.0.smithi012.stdout:129: done (1 left) 2024-09-10T17:56:46.765 INFO:tasks.rados.rados.0.smithi012.stdout:130: delete oid 6 current snap is 6 2024-09-10T17:56:46.765 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 20 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-09-10T17:56:46.770 INFO:tasks.rados.rados.0.smithi012.stdout:128: done (1 left) 2024-09-10T17:56:46.770 INFO:tasks.rados.rados.0.smithi012.stdout:130: done (0 left) 2024-09-10T17:56:46.770 INFO:tasks.rados.rados.0.smithi012.stdout:131: snap_remove snap 5 2024-09-10T17:56:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:46 smithi012 ceph-mon[27356]: osdmap e91: 8 total, 8 up, 8 in 2024-09-10T17:56:46.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:46 smithi012 ceph-mon[37454]: osdmap e91: 8 total, 8 up, 8 in 2024-09-10T17:56:46.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:46 smithi089 ceph-mon[31467]: osdmap e91: 8 total, 8 up, 8 in 2024-09-10T17:56:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:131: done (0 left) 2024-09-10T17:56:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:132: rollback oid 17 current snap is 6 2024-09-10T17:56:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:132: done (0 left) 2024-09-10T17:56:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 6 2024-09-10T17:56:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:133: seq_num 65 ranges {0=696320,696320=401408} 2024-09-10T17:56:47.771 INFO:tasks.rados.rados.0.smithi012.stdout:133: writing smithi01278544-43 from 0 to 696320 tid 1 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:133: writing smithi01278544-43 from 696320 to 1097728 tid 2 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:134: read oid 11 snap -1 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:134: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:135: read oid 6 snap -1 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:135: expect deleted 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:136: copy_from oid 18 from oid 46 current snap is 6 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:137: read oid 41 snap -1 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:137: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:138: rmattr oid 37 current snap is 6 2024-09-10T17:56:47.776 INFO:tasks.rados.rados.0.smithi012.stdout:138: done (5 left) 2024-09-10T17:56:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:139: read oid 1 snap -1 2024-09-10T17:56:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:139: expect deleted 2024-09-10T17:56:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:140: rmattr oid 30 current snap is 6 2024-09-10T17:56:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:140: done (6 left) 2024-09-10T17:56:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:141: setattr oid 47 current snap is 6 2024-09-10T17:56:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:139: done (6 left) 2024-09-10T17:56:47.780 INFO:tasks.rados.rados.0.smithi012.stdout:142: copy_from oid 30 from oid 16 current snap is 6 2024-09-10T17:56:47.780 INFO:tasks.rados.rados.0.smithi012.stdout:143: setattr oid 34 current snap is 6 2024-09-10T17:56:47.780 INFO:tasks.rados.rados.0.smithi012.stdout:134: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:56:47.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:47 smithi012 ceph-mon[27356]: osdmap e92: 8 total, 8 up, 8 in 2024-09-10T17:56:47.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:47 smithi012 ceph-mon[27356]: pgmap v119: 121 pgs: 121 active+clean; 27 MiB data, 277 MiB used, 715 GiB / 715 GiB avail; 2.8 MiB/s rd, 808 KiB/s wr, 19 op/s 2024-09-10T17:56:47.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:47 smithi012 ceph-mon[27356]: osdmap e93: 8 total, 8 up, 8 in 2024-09-10T17:56:47.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:47 smithi012 ceph-mon[37454]: osdmap e92: 8 total, 8 up, 8 in 2024-09-10T17:56:47.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:47 smithi012 ceph-mon[37454]: pgmap v119: 121 pgs: 121 active+clean; 27 MiB data, 277 MiB used, 715 GiB / 715 GiB avail; 2.8 MiB/s rd, 808 KiB/s wr, 19 op/s 2024-09-10T17:56:47.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:47 smithi012 ceph-mon[37454]: osdmap e93: 8 total, 8 up, 8 in 2024-09-10T17:56:47.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:47 smithi089 ceph-mon[31467]: osdmap e92: 8 total, 8 up, 8 in 2024-09-10T17:56:47.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:47 smithi089 ceph-mon[31467]: pgmap v119: 121 pgs: 121 active+clean; 27 MiB data, 277 MiB used, 715 GiB / 715 GiB avail; 2.8 MiB/s rd, 808 KiB/s wr, 19 op/s 2024-09-10T17:56:47.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:47 smithi089 ceph-mon[31467]: osdmap e93: 8 total, 8 up, 8 in 2024-09-10T17:56:47.786 INFO:tasks.rados.rados.0.smithi012.stdout:137: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-10T17:56:47.810 INFO:tasks.rados.rados.0.smithi012.stdout:136: finishing copy_from racing read to smithi01278544-18 2024-09-10T17:56:47.810 INFO:tasks.rados.rados.0.smithi012.stdout:142: finishing copy_from racing read to smithi01278544-30 2024-09-10T17:56:47.810 INFO:tasks.rados.rados.0.smithi012.stdout:136: finishing copy_from to smithi01278544-18 2024-09-10T17:56:47.810 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 17 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:56:47.810 INFO:tasks.rados.rados.0.smithi012.stdout:133: finishing write tid 1 to smithi01278544-43 2024-09-10T17:56:47.810 INFO:tasks.rados.rados.0.smithi012.stdout:133: finishing write tid 2 to smithi01278544-43 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:133: finishing write tid 3 to smithi01278544-43 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:142: finishing copy_from to smithi01278544-30 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 6 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 46 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:133: finishing write tid 4 to smithi01278544-43 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:133: oid 43 updating version 0 to 45 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:133: oid 43 version 45 is already newer than 44 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:133: oid 43 version 45 is already newer than 43 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 45 (ObjNum 65 snap 6 seq_num 65) dirty exists 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:133: left oid 43 (ObjNum 65 snap 6 seq_num 65) 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:133: done (7 left) 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:134: done (6 left) 2024-09-10T17:56:47.811 INFO:tasks.rados.rados.0.smithi012.stdout:135: done (5 left) 2024-09-10T17:56:47.812 INFO:tasks.rados.rados.0.smithi012.stdout:136: done (4 left) 2024-09-10T17:56:47.812 INFO:tasks.rados.rados.0.smithi012.stdout:137: done (3 left) 2024-09-10T17:56:47.812 INFO:tasks.rados.rados.0.smithi012.stdout:141: done (2 left) 2024-09-10T17:56:47.812 INFO:tasks.rados.rados.0.smithi012.stdout:142: done (1 left) 2024-09-10T17:56:47.812 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 6 2024-09-10T17:56:47.812 INFO:tasks.rados.rados.0.smithi012.stdout:144: seq_num 66 ranges {1302528=712704,2015232=401408} 2024-09-10T17:56:47.821 INFO:tasks.rados.rados.0.smithi012.stdout:144: writing smithi01278544-24 from 1302528 to 2015232 tid 1 2024-09-10T17:56:47.823 INFO:tasks.rados.rados.0.smithi012.stdout:144: writing smithi01278544-24 from 2015232 to 2416640 tid 2 2024-09-10T17:56:47.823 INFO:tasks.rados.rados.0.smithi012.stdout:145: setattr oid 29 current snap is 6 2024-09-10T17:56:47.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 38 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-10T17:56:47.824 INFO:tasks.rados.rados.0.smithi012.stdout:143: done (2 left) 2024-09-10T17:56:47.824 INFO:tasks.rados.rados.0.smithi012.stdout:146: snap_create 2024-09-10T17:56:47.825 INFO:tasks.rados.rados.0.smithi012.stdout:144: finishing write tid 1 to smithi01278544-24 2024-09-10T17:56:47.826 INFO:tasks.rados.rados.0.smithi012.stdout:144: finishing write tid 2 to smithi01278544-24 2024-09-10T17:56:47.826 INFO:tasks.rados.rados.0.smithi012.stdout:144: finishing write tid 3 to smithi01278544-24 2024-09-10T17:56:47.827 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 15 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:56:47.827 INFO:tasks.rados.rados.0.smithi012.stdout:144: finishing write tid 4 to smithi01278544-24 2024-09-10T17:56:47.827 INFO:tasks.rados.rados.0.smithi012.stdout:144: oid 24 updating version 0 to 28 2024-09-10T17:56:47.827 INFO:tasks.rados.rados.0.smithi012.stdout:144: oid 24 updating version 28 to 29 2024-09-10T17:56:47.827 INFO:tasks.rados.rados.0.smithi012.stdout:144: oid 24 version 29 is already newer than 27 2024-09-10T17:56:47.827 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 29 (ObjNum 66 snap 6 seq_num 66) dirty exists 2024-09-10T17:56:47.827 INFO:tasks.rados.rados.0.smithi012.stdout:144: left oid 24 (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:56:48.770 INFO:tasks.rados.rados.0.smithi012.stdout:144: done (2 left) 2024-09-10T17:56:48.770 INFO:tasks.rados.rados.0.smithi012.stdout:145: done (1 left) 2024-09-10T17:56:48.770 INFO:tasks.rados.rados.0.smithi012.stdout:146: done (0 left) 2024-09-10T17:56:48.771 INFO:tasks.rados.rados.0.smithi012.stdout:147: snap_remove snap 6 2024-09-10T17:56:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:48 smithi012 ceph-mon[27356]: osdmap e94: 8 total, 8 up, 8 in 2024-09-10T17:56:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:48 smithi012 ceph-mon[27356]: pgmap v122: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2024-09-10T17:56:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:48 smithi012 ceph-mon[37454]: osdmap e94: 8 total, 8 up, 8 in 2024-09-10T17:56:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:48 smithi012 ceph-mon[37454]: pgmap v122: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2024-09-10T17:56:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:48 smithi089 ceph-mon[31467]: osdmap e94: 8 total, 8 up, 8 in 2024-09-10T17:56:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:48 smithi089 ceph-mon[31467]: pgmap v122: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2024-09-10T17:56:49.775 INFO:tasks.rados.rados.0.smithi012.stdout:147: done (0 left) 2024-09-10T17:56:49.775 INFO:tasks.rados.rados.0.smithi012.stdout:148: delete oid 1 current snap is 7 2024-09-10T17:56:49.779 INFO:tasks.rados.rados.0.smithi012.stdout:148: done (0 left) 2024-09-10T17:56:49.779 INFO:tasks.rados.rados.0.smithi012.stdout:149: snap_create 2024-09-10T17:56:50.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:49 smithi089 ceph-mon[31467]: osdmap e95: 8 total, 8 up, 8 in 2024-09-10T17:56:50.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:49 smithi012 ceph-mon[27356]: osdmap e95: 8 total, 8 up, 8 in 2024-09-10T17:56:50.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:49 smithi012 ceph-mon[37454]: osdmap e95: 8 total, 8 up, 8 in 2024-09-10T17:56:50.781 INFO:tasks.rados.rados.0.smithi012.stdout:149: done (0 left) 2024-09-10T17:56:50.781 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 8 2024-09-10T17:56:50.781 INFO:tasks.rados.rados.0.smithi012.stdout:150: seq_num 68 ranges {507904=745472,1253376=401408} 2024-09-10T17:56:50.788 INFO:tasks.rados.rados.0.smithi012.stdout:150: writing smithi01278544-31 from 507904 to 1253376 tid 1 2024-09-10T17:56:50.791 INFO:tasks.rados.rados.0.smithi012.stdout:150: writing smithi01278544-31 from 1253376 to 1654784 tid 2 2024-09-10T17:56:50.791 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 8 2024-09-10T17:56:50.791 INFO:tasks.rados.rados.0.smithi012.stdout:151: seq_num 69 ranges {253952=761856,1015808=401408} 2024-09-10T17:56:50.797 INFO:tasks.rados.rados.0.smithi012.stdout:151: writing smithi01278544-16 from 253952 to 1015808 tid 1 2024-09-10T17:56:50.800 INFO:tasks.rados.rados.0.smithi012.stdout:151: writing smithi01278544-16 from 1015808 to 1417216 tid 2 2024-09-10T17:56:50.801 INFO:tasks.rados.rados.0.smithi012.stdout:150: finishing write tid 1 to smithi01278544-31 2024-09-10T17:56:50.801 INFO:tasks.rados.rados.0.smithi012.stdout:150: finishing write tid 2 to smithi01278544-31 2024-09-10T17:56:50.801 INFO:tasks.rados.rados.0.smithi012.stdout:150: finishing write tid 3 to smithi01278544-31 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:150: finishing write tid 4 to smithi01278544-31 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:150: oid 31 updating version 0 to 29 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:150: oid 31 updating version 29 to 30 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:150: oid 31 version 30 is already newer than 28 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 30 (ObjNum 68 snap 8 seq_num 68) dirty exists 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:150: left oid 31 (ObjNum 68 snap 8 seq_num 68) 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:150: done (1 left) 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:152: copy_from oid 44 from oid 2 current snap is 8 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:153: read oid 25 snap 7 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:153: expect (ObjNum 36 snap 0 seq_num 36) 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:154: copy_from oid 21 from oid 35 current snap is 8 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:155: rollback oid 18 current snap is 8 2024-09-10T17:56:50.802 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 7 2024-09-10T17:56:50.803 INFO:tasks.rados.rados.0.smithi012.stdout:156: copy_from oid 38 from oid 24 current snap is 8 2024-09-10T17:56:50.803 INFO:tasks.rados.rados.0.smithi012.stdout:157: snap_create 2024-09-10T17:56:50.804 INFO:tasks.rados.rados.0.smithi012.stdout:151: finishing write tid 1 to smithi01278544-16 2024-09-10T17:56:50.804 INFO:tasks.rados.rados.0.smithi012.stdout:151: finishing write tid 2 to smithi01278544-16 2024-09-10T17:56:50.804 INFO:tasks.rados.rados.0.smithi012.stdout:151: finishing write tid 3 to smithi01278544-16 2024-09-10T17:56:50.805 INFO:tasks.rados.rados.0.smithi012.stdout:151: finishing write tid 4 to smithi01278544-16 2024-09-10T17:56:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:151: oid 16 updating version 0 to 22 2024-09-10T17:56:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:151: oid 16 version 22 is already newer than 21 2024-09-10T17:56:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:151: oid 16 version 22 is already newer than 20 2024-09-10T17:56:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 22 (ObjNum 69 snap 8 seq_num 69) dirty exists 2024-09-10T17:56:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:151: left oid 16 (ObjNum 69 snap 8 seq_num 69) 2024-09-10T17:56:50.808 INFO:tasks.rados.rados.0.smithi012.stdout:155: finishing rollback tid 0 to smithi01278544-18 2024-09-10T17:56:50.809 INFO:tasks.rados.rados.0.smithi012.stdout:155: finishing rollback tid 1 to smithi01278544-18 2024-09-10T17:56:50.809 INFO:tasks.rados.rados.0.smithi012.stdout:155: finishing rollback tid 2 to smithi01278544-18 2024-09-10T17:56:50.809 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 39 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:56:50.810 INFO:tasks.rados.rados.0.smithi012.stdout:153: expect (ObjNum 36 snap 0 seq_num 36) 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:154: finishing copy_from racing read to smithi01278544-21 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:154: finishing copy_from to smithi01278544-21 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 12 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:152: finishing copy_from racing read to smithi01278544-44 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:152: finishing copy_from to smithi01278544-44 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:156: finishing copy_from racing read to smithi01278544-38 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:156: finishing copy_from to smithi01278544-38 2024-09-10T17:56:50.830 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 29 (ObjNum 66 snap 6 seq_num 66) dirty exists 2024-09-10T17:56:51.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:50 smithi012 ceph-mon[27356]: osdmap e96: 8 total, 8 up, 8 in 2024-09-10T17:56:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:50 smithi012 ceph-mon[27356]: pgmap v125: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2024-09-10T17:56:51.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:50 smithi012 ceph-mon[37454]: osdmap e96: 8 total, 8 up, 8 in 2024-09-10T17:56:51.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:50 smithi012 ceph-mon[37454]: pgmap v125: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2024-09-10T17:56:51.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:50 smithi089 ceph-mon[31467]: osdmap e96: 8 total, 8 up, 8 in 2024-09-10T17:56:51.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:50 smithi089 ceph-mon[31467]: pgmap v125: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2024-09-10T17:56:51.766 INFO:tasks.rados.rados.0.smithi012.stdout:151: done (6 left) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:152: done (5 left) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:153: done (4 left) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:154: done (3 left) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:155: done (2 left) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:156: done (1 left) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:157: done (0 left) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:158: read oid 46 snap -1 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:158: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:159: read oid 7 snap 7 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:159: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-10T17:56:51.767 INFO:tasks.rados.rados.0.smithi012.stdout:160: snap_create 2024-09-10T17:56:51.772 INFO:tasks.rados.rados.0.smithi012.stdout:159: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-10T17:56:51.777 INFO:tasks.rados.rados.0.smithi012.stdout:158: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:56:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:51 smithi012 ceph-mon[27356]: osdmap e97: 8 total, 8 up, 8 in 2024-09-10T17:56:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:51 smithi012 ceph-mon[27356]: osdmap e98: 8 total, 8 up, 8 in 2024-09-10T17:56:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:51 smithi012 ceph-mon[37454]: osdmap e97: 8 total, 8 up, 8 in 2024-09-10T17:56:52.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:51 smithi012 ceph-mon[37454]: osdmap e98: 8 total, 8 up, 8 in 2024-09-10T17:56:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:51 smithi089 ceph-mon[31467]: osdmap e97: 8 total, 8 up, 8 in 2024-09-10T17:56:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:51 smithi089 ceph-mon[31467]: osdmap e98: 8 total, 8 up, 8 in 2024-09-10T17:56:52.767 INFO:tasks.rados.rados.0.smithi012.stdout:158: done (2 left) 2024-09-10T17:56:52.768 INFO:tasks.rados.rados.0.smithi012.stdout:159: done (1 left) 2024-09-10T17:56:52.768 INFO:tasks.rados.rados.0.smithi012.stdout:160: done (0 left) 2024-09-10T17:56:52.768 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 10 2024-09-10T17:56:52.768 INFO:tasks.rados.rados.0.smithi012.stdout:161: seq_num 70 ranges {204800=778240,983040=401408} 2024-09-10T17:56:52.773 INFO:tasks.rados.rados.0.smithi012.stdout:161: writing smithi01278544-13 from 204800 to 983040 tid 1 2024-09-10T17:56:52.776 INFO:tasks.rados.rados.0.smithi012.stdout:161: writing smithi01278544-13 from 983040 to 1384448 tid 2 2024-09-10T17:56:52.776 INFO:tasks.rados.rados.0.smithi012.stdout:162: copy_from oid 15 from oid 5 current snap is 10 2024-09-10T17:56:52.776 INFO:tasks.rados.rados.0.smithi012.stdout:163: rollback oid 19 current snap is 10 2024-09-10T17:56:52.776 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 19 to 8 2024-09-10T17:56:52.777 INFO:tasks.rados.rados.0.smithi012.stdout:164: copy_from oid 21 from oid 24 current snap is 10 2024-09-10T17:56:52.777 INFO:tasks.rados.rados.0.smithi012.stdout:165: copy_from oid 3 from oid 7 current snap is 10 2024-09-10T17:56:52.777 INFO:tasks.rados.rados.0.smithi012.stdout:166: read oid 33 snap -1 2024-09-10T17:56:52.777 INFO:tasks.rados.rados.0.smithi012.stdout:166: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-10T17:56:52.777 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 10 2024-09-10T17:56:52.777 INFO:tasks.rados.rados.0.smithi012.stdout:167: seq_num 71 ranges {1417216=794624,2211840=401408} 2024-09-10T17:56:52.794 INFO:tasks.rados.rados.0.smithi012.stdout:167: writing smithi01278544-16 from 1417216 to 2211840 tid 1 2024-09-10T17:56:52.797 INFO:tasks.rados.rados.0.smithi012.stdout:167: writing smithi01278544-16 from 2211840 to 2613248 tid 2 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:168: rmattr oid 34 current snap is 10 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:165: finishing copy_from racing read to smithi01278544-3 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:169: snap_remove snap 9 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:161: finishing write tid 1 to smithi01278544-13 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:161: finishing write tid 2 to smithi01278544-13 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:161: finishing write tid 3 to smithi01278544-13 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:162: finishing copy_from racing read to smithi01278544-15 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:161: finishing write tid 4 to smithi01278544-13 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:161: oid 13 updating version 0 to 33 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:161: oid 13 version 33 is already newer than 32 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:161: oid 13 updating version 33 to 34 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 34 (ObjNum 70 snap 10 seq_num 70) dirty exists 2024-09-10T17:56:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:161: left oid 13 (ObjNum 70 snap 10 seq_num 70) 2024-09-10T17:56:52.799 INFO:tasks.rados.rados.0.smithi012.stdout:166: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-10T17:56:52.817 INFO:tasks.rados.rados.0.smithi012.stdout:163: finishing rollback tid 0 to smithi01278544-19 2024-09-10T17:56:52.817 INFO:tasks.rados.rados.0.smithi012.stdout:163: finishing rollback tid 1 to smithi01278544-19 2024-09-10T17:56:52.817 INFO:tasks.rados.rados.0.smithi012.stdout:163: finishing rollback tid 2 to smithi01278544-19 2024-09-10T17:56:52.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 44 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-09-10T17:56:52.817 INFO:tasks.rados.rados.0.smithi012.stdout:165: finishing copy_from to smithi01278544-3 2024-09-10T17:56:52.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-10T17:56:52.817 INFO:tasks.rados.rados.0.smithi012.stdout:162: finishing copy_from to smithi01278544-15 2024-09-10T17:56:52.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-09-10T17:56:53.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:52 smithi012 ceph-mon[27356]: pgmap v128: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:52 smithi012 ceph-mon[27356]: osdmap e99: 8 total, 8 up, 8 in 2024-09-10T17:56:53.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:52 smithi012 ceph-mon[37454]: pgmap v128: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:53.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:52 smithi012 ceph-mon[37454]: osdmap e99: 8 total, 8 up, 8 in 2024-09-10T17:56:53.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:52 smithi089 ceph-mon[31467]: pgmap v128: 121 pgs: 121 active+clean; 27 MiB data, 279 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:56:53.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:52 smithi089 ceph-mon[31467]: osdmap e99: 8 total, 8 up, 8 in 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:161: done (8 left) 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:162: done (7 left) 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:163: done (6 left) 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:165: done (5 left) 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:166: done (4 left) 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:169: done (3 left) 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:170: rollback oid 45 current snap is 10 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 45 to 7 2024-09-10T17:56:53.795 INFO:tasks.rados.rados.0.smithi012.stdout:171: copy_from oid 43 from oid 44 current snap is 10 2024-09-10T17:56:53.796 INFO:tasks.rados.rados.0.smithi012.stdout:172: copy_from oid 26 from oid 50 current snap is 10 2024-09-10T17:56:53.796 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 10 2024-09-10T17:56:53.796 INFO:tasks.rados.rados.0.smithi012.stdout:173: seq_num 72 ranges {139264=409600,548864=524288,1073152=278528} 2024-09-10T17:56:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:173: writing smithi01278544-9 from 139264 to 548864 tid 1 2024-09-10T17:56:53.806 INFO:tasks.rados.rados.0.smithi012.stdout:173: writing smithi01278544-9 from 548864 to 1073152 tid 2 2024-09-10T17:56:53.808 INFO:tasks.rados.rados.0.smithi012.stdout:173: writing smithi01278544-9 from 1073152 to 1351680 tid 3 2024-09-10T17:56:53.809 INFO:tasks.rados.rados.0.smithi012.stdout:164: finishing copy_from racing read to smithi01278544-21 2024-09-10T17:56:53.810 INFO:tasks.rados.rados.0.smithi012.stdout:167: finishing write tid 1 to smithi01278544-16 2024-09-10T17:56:53.810 INFO:tasks.rados.rados.0.smithi012.stdout:164: finishing copy_from to smithi01278544-21 2024-09-10T17:56:53.810 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 29 (ObjNum 66 snap 6 seq_num 66) dirty exists 2024-09-10T17:56:53.810 INFO:tasks.rados.rados.0.smithi012.stdout:167: finishing write tid 2 to smithi01278544-16 2024-09-10T17:56:53.810 INFO:tasks.rados.rados.0.smithi012.stdout:167: finishing write tid 3 to smithi01278544-16 2024-09-10T17:56:53.810 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 48 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-10T17:56:53.810 INFO:tasks.rados.rados.0.smithi012.stdout:167: finishing write tid 4 to smithi01278544-16 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:167: oid 16 updating version 0 to 26 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:167: oid 16 version 26 is already newer than 24 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:167: oid 16 version 26 is already newer than 25 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 26 (ObjNum 71 snap 10 seq_num 71) dirty exists 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:167: left oid 16 (ObjNum 71 snap 10 seq_num 71) 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:170: finishing rollback tid 0 to smithi01278544-45 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:170: finishing rollback tid 1 to smithi01278544-45 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:170: finishing rollback tid 2 to smithi01278544-45 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 50 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:172: finishing copy_from racing read to smithi01278544-26 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:171: finishing copy_from racing read to smithi01278544-43 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:173: finishing write tid 1 to smithi01278544-9 2024-09-10T17:56:53.811 INFO:tasks.rados.rados.0.smithi012.stdout:172: finishing copy_from to smithi01278544-26 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 3 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:171: finishing copy_from to smithi01278544-43 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:164: done (6 left) 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:167: done (5 left) 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:168: done (4 left) 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:170: done (3 left) 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:171: done (2 left) 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:172: done (1 left) 2024-09-10T17:56:53.812 INFO:tasks.rados.rados.0.smithi012.stdout:174: setattr oid 50 current snap is 10 2024-09-10T17:56:53.813 INFO:tasks.rados.rados.0.smithi012.stdout:175: snap_remove snap 8 2024-09-10T17:56:54.283 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:56:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:56:53] "GET /metrics HTTP/1.1" 200 36003 "" "Prometheus/2.43.0" 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:175: done (2 left) 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:176: rmattr oid 43 current snap is 10 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:176: done (2 left) 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:177: copy_from oid 48 from oid 38 current snap is 10 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:173: finishing write tid 2 to smithi01278544-9 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:173: finishing write tid 3 to smithi01278544-9 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:173: finishing write tid 4 to smithi01278544-9 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:173: finishing write tid 5 to smithi01278544-9 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:173: oid 9 updating version 0 to 33 2024-09-10T17:56:54.800 INFO:tasks.rados.rados.0.smithi012.stdout:173: oid 9 version 33 is already newer than 32 2024-09-10T17:56:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:173: oid 9 version 33 is already newer than 30 2024-09-10T17:56:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:173: oid 9 version 33 is already newer than 31 2024-09-10T17:56:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 33 (ObjNum 72 snap 10 seq_num 72) dirty exists 2024-09-10T17:56:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:173: left oid 9 (ObjNum 72 snap 10 seq_num 72) 2024-09-10T17:56:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 5 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-10T17:56:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:173: done (2 left) 2024-09-10T17:56:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:174: done (1 left) 2024-09-10T17:56:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:178: snap_remove snap 7 2024-09-10T17:56:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:54 smithi012 ceph-mon[27356]: osdmap e100: 8 total, 8 up, 8 in 2024-09-10T17:56:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:54 smithi012 ceph-mon[27356]: pgmap v131: 121 pgs: 121 active+clean; 37 MiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-09-10T17:56:55.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:54 smithi012 ceph-mon[37454]: osdmap e100: 8 total, 8 up, 8 in 2024-09-10T17:56:55.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:54 smithi012 ceph-mon[37454]: pgmap v131: 121 pgs: 121 active+clean; 37 MiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-09-10T17:56:55.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:54 smithi089 ceph-mon[31467]: osdmap e100: 8 total, 8 up, 8 in 2024-09-10T17:56:55.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:54 smithi089 ceph-mon[31467]: pgmap v131: 121 pgs: 121 active+clean; 37 MiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-09-10T17:56:55.805 INFO:tasks.rados.rados.0.smithi012.stdout:178: done (1 left) 2024-09-10T17:56:55.805 INFO:tasks.rados.rados.0.smithi012.stdout:179: read oid 28 snap -1 2024-09-10T17:56:55.805 INFO:tasks.rados.rados.0.smithi012.stdout:179: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-10T17:56:55.805 INFO:tasks.rados.rados.0.smithi012.stdout:180: rollback oid 34 current snap is 10 2024-09-10T17:56:55.805 INFO:tasks.rados.rados.0.smithi012.stdout:180: done (2 left) 2024-09-10T17:56:55.805 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 10 2024-09-10T17:56:55.806 INFO:tasks.rados.rados.0.smithi012.stdout:181: seq_num 73 ranges {303104=425984,729088=409600,1138688=393216} 2024-09-10T17:56:55.809 INFO:tasks.rados.rados.0.smithi012.stdout:181: writing smithi01278544-19 from 303104 to 729088 tid 1 2024-09-10T17:56:55.812 INFO:tasks.rados.rados.0.smithi012.stdout:181: writing smithi01278544-19 from 729088 to 1138688 tid 2 2024-09-10T17:56:55.815 INFO:tasks.rados.rados.0.smithi012.stdout:181: writing smithi01278544-19 from 1138688 to 1531904 tid 3 2024-09-10T17:56:55.815 INFO:tasks.rados.rados.0.smithi012.stdout:182: read oid 42 snap -1 2024-09-10T17:56:55.815 INFO:tasks.rados.rados.0.smithi012.stdout:182: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:56:55.816 INFO:tasks.rados.rados.0.smithi012.stdout:177: finishing copy_from racing read to smithi01278544-48 2024-09-10T17:56:55.816 INFO:tasks.rados.rados.0.smithi012.stdout:177: finishing copy_from to smithi01278544-48 2024-09-10T17:56:55.816 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 29 (ObjNum 66 snap 6 seq_num 66) dirty exists 2024-09-10T17:56:55.816 INFO:tasks.rados.rados.0.smithi012.stdout:177: done (3 left) 2024-09-10T17:56:55.816 INFO:tasks.rados.rados.0.smithi012.stdout:183: rollback oid 46 current snap is 10 2024-09-10T17:56:55.816 INFO:tasks.rados.rados.0.smithi012.stdout:183: done (3 left) 2024-09-10T17:56:55.816 INFO:tasks.rados.rados.0.smithi012.stdout:184: snap_create 2024-09-10T17:56:55.817 INFO:tasks.rados.rados.0.smithi012.stdout:181: finishing write tid 1 to smithi01278544-19 2024-09-10T17:56:55.819 INFO:tasks.rados.rados.0.smithi012.stdout:179: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-10T17:56:55.834 INFO:tasks.rados.rados.0.smithi012.stdout:181: finishing write tid 2 to smithi01278544-19 2024-09-10T17:56:55.834 INFO:tasks.rados.rados.0.smithi012.stdout:181: finishing write tid 3 to smithi01278544-19 2024-09-10T17:56:55.834 INFO:tasks.rados.rados.0.smithi012.stdout:181: finishing write tid 4 to smithi01278544-19 2024-09-10T17:56:55.834 INFO:tasks.rados.rados.0.smithi012.stdout:182: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:56:55.851 INFO:tasks.rados.rados.0.smithi012.stdout:181: finishing write tid 5 to smithi01278544-19 2024-09-10T17:56:55.851 INFO:tasks.rados.rados.0.smithi012.stdout:181: oid 19 updating version 0 to 62 2024-09-10T17:56:55.851 INFO:tasks.rados.rados.0.smithi012.stdout:181: oid 19 version 62 is already newer than 61 2024-09-10T17:56:55.851 INFO:tasks.rados.rados.0.smithi012.stdout:181: oid 19 updating version 62 to 63 2024-09-10T17:56:55.852 INFO:tasks.rados.rados.0.smithi012.stdout:181: oid 19 updating version 63 to 64 2024-09-10T17:56:55.852 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 64 (ObjNum 73 snap 10 seq_num 73) dirty exists 2024-09-10T17:56:55.852 INFO:tasks.rados.rados.0.smithi012.stdout:181: left oid 19 (ObjNum 73 snap 10 seq_num 73) 2024-09-10T17:56:56.051 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:55 smithi012 ceph-mon[27356]: osdmap e101: 8 total, 8 up, 8 in 2024-09-10T17:56:56.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:55 smithi012 ceph-mon[37454]: osdmap e101: 8 total, 8 up, 8 in 2024-09-10T17:56:56.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:55 smithi089 ceph-mon[31467]: osdmap e101: 8 total, 8 up, 8 in 2024-09-10T17:56:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:179: done (3 left) 2024-09-10T17:56:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:181: done (2 left) 2024-09-10T17:56:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:182: done (1 left) 2024-09-10T17:56:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:184: done (0 left) 2024-09-10T17:56:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:185: delete oid 11 current snap is 11 2024-09-10T17:56:56.770 INFO:tasks.rados.rados.0.smithi012.stdout:185: done (0 left) 2024-09-10T17:56:56.771 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 11 2024-09-10T17:56:56.771 INFO:tasks.rados.rados.0.smithi012.stdout:186: seq_num 75 ranges {172032=458752,630784=581632,1212416=221184} 2024-09-10T17:56:56.774 INFO:tasks.rados.rados.0.smithi012.stdout:186: writing smithi01278544-44 from 172032 to 630784 tid 1 2024-09-10T17:56:56.777 INFO:tasks.rados.rados.0.smithi012.stdout:186: writing smithi01278544-44 from 630784 to 1212416 tid 2 2024-09-10T17:56:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:186: writing smithi01278544-44 from 1212416 to 1433600 tid 3 2024-09-10T17:56:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:187: snap_create 2024-09-10T17:56:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:186: finishing write tid 1 to smithi01278544-44 2024-09-10T17:56:56.780 INFO:tasks.rados.rados.0.smithi012.stdout:186: finishing write tid 2 to smithi01278544-44 2024-09-10T17:56:56.781 INFO:tasks.rados.rados.0.smithi012.stdout:186: finishing write tid 3 to smithi01278544-44 2024-09-10T17:56:56.781 INFO:tasks.rados.rados.0.smithi012.stdout:186: finishing write tid 4 to smithi01278544-44 2024-09-10T17:56:56.782 INFO:tasks.rados.rados.0.smithi012.stdout:186: finishing write tid 5 to smithi01278544-44 2024-09-10T17:56:56.782 INFO:tasks.rados.rados.0.smithi012.stdout:186: oid 44 updating version 0 to 41 2024-09-10T17:56:56.782 INFO:tasks.rados.rados.0.smithi012.stdout:186: oid 44 updating version 41 to 42 2024-09-10T17:56:56.782 INFO:tasks.rados.rados.0.smithi012.stdout:186: oid 44 updating version 42 to 43 2024-09-10T17:56:56.782 INFO:tasks.rados.rados.0.smithi012.stdout:186: oid 44 version 43 is already newer than 40 2024-09-10T17:56:56.782 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 43 (ObjNum 75 snap 11 seq_num 75) dirty exists 2024-09-10T17:56:56.782 INFO:tasks.rados.rados.0.smithi012.stdout:186: left oid 44 (ObjNum 75 snap 11 seq_num 75) 2024-09-10T17:56:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:56 smithi012 ceph-mon[27356]: osdmap e102: 8 total, 8 up, 8 in 2024-09-10T17:56:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:56 smithi012 ceph-mon[27356]: pgmap v134: 121 pgs: 121 active+clean; 37 MiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-09-10T17:56:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:56 smithi012 ceph-mon[27356]: osdmap e103: 8 total, 8 up, 8 in 2024-09-10T17:56:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:56 smithi012 ceph-mon[37454]: osdmap e102: 8 total, 8 up, 8 in 2024-09-10T17:56:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:56 smithi012 ceph-mon[37454]: pgmap v134: 121 pgs: 121 active+clean; 37 MiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-09-10T17:56:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:56 smithi012 ceph-mon[37454]: osdmap e103: 8 total, 8 up, 8 in 2024-09-10T17:56:57.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:56 smithi089 ceph-mon[31467]: osdmap e102: 8 total, 8 up, 8 in 2024-09-10T17:56:57.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:56 smithi089 ceph-mon[31467]: pgmap v134: 121 pgs: 121 active+clean; 37 MiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-09-10T17:56:57.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:56 smithi089 ceph-mon[31467]: osdmap e103: 8 total, 8 up, 8 in 2024-09-10T17:56:57.769 INFO:tasks.rados.rados.0.smithi012.stdout:186: done (1 left) 2024-09-10T17:56:57.769 INFO:tasks.rados.rados.0.smithi012.stdout:187: done (0 left) 2024-09-10T17:56:57.770 INFO:tasks.rados.rados.0.smithi012.stdout:188: snap_remove snap 10 2024-09-10T17:56:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: Upgrade: Target is version 19.3.0-4858-gbad1f558 (unknown) 2024-09-10T17:56:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e'] 2024-09-10T17:56:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-10T17:56:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e on smithi089 2024-09-10T17:56:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[27356]: osdmap e104: 8 total, 8 up, 8 in 2024-09-10T17:56:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: Upgrade: Target is version 19.3.0-4858-gbad1f558 (unknown) 2024-09-10T17:56:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e'] 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e on smithi089 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:57 smithi012 ceph-mon[37454]: osdmap e104: 8 total, 8 up, 8 in 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: Upgrade: Target is version 19.3.0-4858-gbad1f558 (unknown) 2024-09-10T17:56:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e'] 2024-09-10T17:56:58.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:56:58.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:56:58.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-10T17:56:58.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e on smithi089 2024-09-10T17:56:58.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:56:58.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:57 smithi089 ceph-mon[31467]: osdmap e104: 8 total, 8 up, 8 in 2024-09-10T17:56:58.770 INFO:tasks.rados.rados.0.smithi012.stdout:188: done (0 left) 2024-09-10T17:56:58.771 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 12 2024-09-10T17:56:58.771 INFO:tasks.rados.rados.0.smithi012.stdout:189: seq_num 76 ranges {794624=475136,1269760=458752,1728512=344064} 2024-09-10T17:56:58.777 INFO:tasks.rados.rados.0.smithi012.stdout:189: writing smithi01278544-22 from 794624 to 1269760 tid 1 2024-09-10T17:56:58.779 INFO:tasks.rados.rados.0.smithi012.stdout:189: writing smithi01278544-22 from 1269760 to 1728512 tid 2 2024-09-10T17:56:58.782 INFO:tasks.rados.rados.0.smithi012.stdout:189: writing smithi01278544-22 from 1728512 to 2072576 tid 3 2024-09-10T17:56:58.782 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 12 2024-09-10T17:56:58.782 INFO:tasks.rados.rados.0.smithi012.stdout:190: seq_num 77 ranges {0=491520,491520=794624,1286144=8192} 2024-09-10T17:56:58.784 INFO:tasks.rados.rados.0.smithi012.stdout:190: writing smithi01278544-10 from 0 to 491520 tid 1 2024-09-10T17:56:58.789 INFO:tasks.rados.rados.0.smithi012.stdout:190: writing smithi01278544-10 from 491520 to 1286144 tid 2 2024-09-10T17:56:58.789 INFO:tasks.rados.rados.0.smithi012.stdout:190: writing smithi01278544-10 from 1286144 to 1294336 tid 3 2024-09-10T17:56:58.789 INFO:tasks.rados.rados.0.smithi012.stdout:191: setattr oid 6 current snap is 12 2024-09-10T17:56:58.789 INFO:tasks.rados.rados.0.smithi012.stdout:189: finishing write tid 1 to smithi01278544-22 2024-09-10T17:56:58.789 INFO:tasks.rados.rados.0.smithi012.stdout:189: finishing write tid 2 to smithi01278544-22 2024-09-10T17:56:58.789 INFO:tasks.rados.rados.0.smithi012.stdout:189: finishing write tid 3 to smithi01278544-22 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:189: finishing write tid 4 to smithi01278544-22 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:189: finishing write tid 5 to smithi01278544-22 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:189: oid 22 updating version 0 to 56 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:189: oid 22 version 56 is already newer than 51 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:189: oid 22 version 56 is already newer than 55 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:189: oid 22 version 56 is already newer than 54 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 56 (ObjNum 76 snap 12 seq_num 76) dirty exists 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:189: left oid 22 (ObjNum 76 snap 12 seq_num 76) 2024-09-10T17:56:58.790 INFO:tasks.rados.rados.0.smithi012.stdout:190: finishing write tid 1 to smithi01278544-10 2024-09-10T17:56:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:189: done (2 left) 2024-09-10T17:56:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:192: read oid 12 snap 11 2024-09-10T17:56:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:192: expect deleted 2024-09-10T17:56:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 12 2024-09-10T17:56:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:193: seq_num 78 ranges {106496=516096,622592=679936,1302528=122880} 2024-09-10T17:56:58.795 INFO:tasks.rados.rados.0.smithi012.stdout:193: writing smithi01278544-3 from 106496 to 622592 tid 1 2024-09-10T17:56:58.799 INFO:tasks.rados.rados.0.smithi012.stdout:193: writing smithi01278544-3 from 622592 to 1302528 tid 2 2024-09-10T17:56:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:193: writing smithi01278544-3 from 1302528 to 1425408 tid 3 2024-09-10T17:56:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:194: snap_create 2024-09-10T17:56:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:190: finishing write tid 2 to smithi01278544-10 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:190: finishing write tid 3 to smithi01278544-10 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:190: finishing write tid 4 to smithi01278544-10 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:190: finishing write tid 5 to smithi01278544-10 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:190: oid 10 updating version 0 to 60 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:190: oid 10 version 60 is already newer than 58 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:190: oid 10 version 60 is already newer than 57 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:190: oid 10 version 60 is already newer than 59 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 60 (ObjNum 77 snap 12 seq_num 77) dirty exists 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:190: left oid 10 (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 33 (ObjNum 33 snap 0 seq_num 3896360144) dirty exists 2024-09-10T17:56:58.801 INFO:tasks.rados.rados.0.smithi012.stdout:193: finishing write tid 1 to smithi01278544-3 2024-09-10T17:56:58.802 INFO:tasks.rados.rados.0.smithi012.stdout:193: finishing write tid 2 to smithi01278544-3 2024-09-10T17:56:58.802 INFO:tasks.rados.rados.0.smithi012.stdout:193: finishing write tid 3 to smithi01278544-3 2024-09-10T17:56:58.803 INFO:tasks.rados.rados.0.smithi012.stdout:193: finishing write tid 4 to smithi01278544-3 2024-09-10T17:56:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:193: finishing write tid 5 to smithi01278544-3 2024-09-10T17:56:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:193: oid 3 updating version 0 to 49 2024-09-10T17:56:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:193: oid 3 updating version 49 to 50 2024-09-10T17:56:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:193: oid 3 version 50 is already newer than 47 2024-09-10T17:56:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:193: oid 3 version 50 is already newer than 48 2024-09-10T17:56:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 50 (ObjNum 78 snap 12 seq_num 78) dirty exists 2024-09-10T17:56:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:193: left oid 3 (ObjNum 78 snap 12 seq_num 78) 2024-09-10T17:56:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:58 smithi012 ceph-mon[27356]: pgmap v137: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail; 805 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T17:56:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:56:58 smithi012 ceph-mon[27356]: osdmap e105: 8 total, 8 up, 8 in 2024-09-10T17:56:59.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:58 smithi012 ceph-mon[37454]: pgmap v137: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail; 805 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T17:56:59.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:56:58 smithi012 ceph-mon[37454]: osdmap e105: 8 total, 8 up, 8 in 2024-09-10T17:56:59.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:58 smithi089 ceph-mon[31467]: pgmap v137: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail; 805 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T17:56:59.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:56:58 smithi089 ceph-mon[31467]: osdmap e105: 8 total, 8 up, 8 in 2024-09-10T17:56:59.773 INFO:tasks.rados.rados.0.smithi012.stdout:190: done (4 left) 2024-09-10T17:56:59.773 INFO:tasks.rados.rados.0.smithi012.stdout:191: done (3 left) 2024-09-10T17:56:59.773 INFO:tasks.rados.rados.0.smithi012.stdout:192: done (2 left) 2024-09-10T17:56:59.774 INFO:tasks.rados.rados.0.smithi012.stdout:193: done (1 left) 2024-09-10T17:56:59.774 INFO:tasks.rados.rados.0.smithi012.stdout:194: done (0 left) 2024-09-10T17:56:59.774 INFO:tasks.rados.rados.0.smithi012.stdout:195: snap_create 2024-09-10T17:57:00.780 INFO:tasks.rados.rados.0.smithi012.stdout:195: done (0 left) 2024-09-10T17:57:00.780 INFO:tasks.rados.rados.0.smithi012.stdout:196: read oid 45 snap -1 2024-09-10T17:57:00.781 INFO:tasks.rados.rados.0.smithi012.stdout:196: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:00.781 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 14 2024-09-10T17:57:00.781 INFO:tasks.rados.rados.0.smithi012.stdout:197: seq_num 79 ranges {1654784=532480,2187264=565248,2752512=237568} 2024-09-10T17:57:00.792 INFO:tasks.rados.rados.0.smithi012.stdout:197: writing smithi01278544-31 from 1654784 to 2187264 tid 1 2024-09-10T17:57:00.795 INFO:tasks.rados.rados.0.smithi012.stdout:197: writing smithi01278544-31 from 2187264 to 2752512 tid 2 2024-09-10T17:57:00.797 INFO:tasks.rados.rados.0.smithi012.stdout:197: writing smithi01278544-31 from 2752512 to 2990080 tid 3 2024-09-10T17:57:00.798 INFO:tasks.rados.rados.0.smithi012.stdout:198: read oid 49 snap -1 2024-09-10T17:57:00.798 INFO:tasks.rados.rados.0.smithi012.stdout:198: expect (ObjNum 55 snap 4 seq_num 55) 2024-09-10T17:57:00.798 INFO:tasks.rados.rados.0.smithi012.stdout:199: read oid 38 snap -1 2024-09-10T17:57:00.798 INFO:tasks.rados.rados.0.smithi012.stdout:199: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:00.798 INFO:tasks.rados.rados.0.smithi012.stdout:200: read oid 40 snap -1 2024-09-10T17:57:00.798 INFO:tasks.rados.rados.0.smithi012.stdout:200: expect (ObjNum 39 snap 0 seq_num 39) 2024-09-10T17:57:00.798 INFO:tasks.rados.rados.0.smithi012.stdout:201: snap_create 2024-09-10T17:57:00.798 INFO:tasks.rados.rados.0.smithi012.stdout:196: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:00.816 INFO:tasks.rados.rados.0.smithi012.stdout:197: finishing write tid 1 to smithi01278544-31 2024-09-10T17:57:00.816 INFO:tasks.rados.rados.0.smithi012.stdout:197: finishing write tid 2 to smithi01278544-31 2024-09-10T17:57:00.816 INFO:tasks.rados.rados.0.smithi012.stdout:197: finishing write tid 3 to smithi01278544-31 2024-09-10T17:57:00.816 INFO:tasks.rados.rados.0.smithi012.stdout:200: expect (ObjNum 39 snap 0 seq_num 39) 2024-09-10T17:57:00.834 INFO:tasks.rados.rados.0.smithi012.stdout:197: finishing write tid 4 to smithi01278544-31 2024-09-10T17:57:00.834 INFO:tasks.rados.rados.0.smithi012.stdout:198: expect (ObjNum 55 snap 4 seq_num 55) 2024-09-10T17:57:00.892 INFO:tasks.rados.rados.0.smithi012.stdout:199: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:00.983 INFO:tasks.rados.rados.0.smithi012.stdout:197: finishing write tid 5 to smithi01278544-31 2024-09-10T17:57:00.984 INFO:tasks.rados.rados.0.smithi012.stdout:197: oid 31 updating version 0 to 44 2024-09-10T17:57:00.984 INFO:tasks.rados.rados.0.smithi012.stdout:197: oid 31 updating version 44 to 45 2024-09-10T17:57:00.984 INFO:tasks.rados.rados.0.smithi012.stdout:197: oid 31 updating version 45 to 47 2024-09-10T17:57:00.984 INFO:tasks.rados.rados.0.smithi012.stdout:197: oid 31 version 47 is already newer than 46 2024-09-10T17:57:00.984 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 47 (ObjNum 79 snap 14 seq_num 79) dirty exists 2024-09-10T17:57:00.984 INFO:tasks.rados.rados.0.smithi012.stdout:197: left oid 31 (ObjNum 79 snap 14 seq_num 79) 2024-09-10T17:57:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:00 smithi012 ceph-mon[37454]: osdmap e106: 8 total, 8 up, 8 in 2024-09-10T17:57:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:00 smithi012 ceph-mon[37454]: pgmap v140: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail; 805 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T17:57:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:00 smithi012 ceph-mon[27356]: osdmap e106: 8 total, 8 up, 8 in 2024-09-10T17:57:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:00 smithi012 ceph-mon[27356]: pgmap v140: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail; 805 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T17:57:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:00 smithi089 ceph-mon[31467]: osdmap e106: 8 total, 8 up, 8 in 2024-09-10T17:57:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:00 smithi089 ceph-mon[31467]: pgmap v140: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail; 805 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T17:57:01.771 INFO:tasks.rados.rados.0.smithi012.stdout:196: done (5 left) 2024-09-10T17:57:01.771 INFO:tasks.rados.rados.0.smithi012.stdout:197: done (4 left) 2024-09-10T17:57:01.771 INFO:tasks.rados.rados.0.smithi012.stdout:198: done (3 left) 2024-09-10T17:57:01.771 INFO:tasks.rados.rados.0.smithi012.stdout:199: done (2 left) 2024-09-10T17:57:01.772 INFO:tasks.rados.rados.0.smithi012.stdout:200: done (1 left) 2024-09-10T17:57:01.772 INFO:tasks.rados.rados.0.smithi012.stdout:201: done (0 left) 2024-09-10T17:57:01.772 INFO:tasks.rados.rados.0.smithi012.stdout:202: snap_remove snap 14 2024-09-10T17:57:01.951 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T17:57:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:01 smithi012 ceph-mon[27356]: osdmap e107: 8 total, 8 up, 8 in 2024-09-10T17:57:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:01 smithi012 ceph-mon[27356]: osdmap e108: 8 total, 8 up, 8 in 2024-09-10T17:57:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:01 smithi012 ceph-mon[37454]: osdmap e107: 8 total, 8 up, 8 in 2024-09-10T17:57:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:01 smithi012 ceph-mon[37454]: osdmap e108: 8 total, 8 up, 8 in 2024-09-10T17:57:02.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:01 smithi089 ceph-mon[31467]: osdmap e107: 8 total, 8 up, 8 in 2024-09-10T17:57:02.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:01 smithi089 ceph-mon[31467]: osdmap e108: 8 total, 8 up, 8 in 2024-09-10T17:57:02.511 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (2m) 103s ago 3m 15.7M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (2m) 103s ago 2m 81.9M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (4m) 103s ago 4m 16.5M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (4m) 103s ago 4m 16.0M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,8765 running (8m) 103s ago 8m 438M - 18.2.4-837-g7a853b17 f21ba1eea74e d3a723eea923 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:9283,8765 running (9m) 103s ago 9m 487M - 18.2.4-837-g7a853b17 f21ba1eea74e 46d8d80f1292 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (9m) 103s ago 9m 48.1M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2f6698e39d41 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (8m) 103s ago 8m 42.7M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e bddaa233c388 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (8m) 103s ago 8m 40.7M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2ba771d7bc46 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (2m) 103s ago 2m 14.0M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T17:57:02.512 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (2m) 103s ago 2m 3598k - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (7m) 103s ago 7m 52.8M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e a54550a62cfe 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (7m) 103s ago 7m 44.6M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (6m) 103s ago 6m 42.5M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (6m) 103s ago 6m 49.9M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (6m) 103s ago 6m 45.3M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (5m) 103s ago 5m 51.1M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (5m) 103s ago 5m 51.1M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (4m) 103s ago 4m 49.6M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T17:57:02.513 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (2m) 103s ago 3m 29.3M - 2.43.0 a07b618ecd1d 9c8fe13e4a8e 2024-09-10T17:57:02.777 INFO:tasks.rados.rados.0.smithi012.stdout:202: done (0 left) 2024-09-10T17:57:02.778 INFO:tasks.rados.rados.0.smithi012.stdout:203: read oid 36 snap -1 2024-09-10T17:57:02.778 INFO:tasks.rados.rados.0.smithi012.stdout:203: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:57:02.778 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 15 2024-09-10T17:57:02.778 INFO:tasks.rados.rados.0.smithi012.stdout:204: seq_num 80 ranges {0=548864,548864=450560,999424=352256} 2024-09-10T17:57:02.780 INFO:tasks.rados.rados.0.smithi012.stdout:204: writing smithi01278544-1 from 0 to 548864 tid 1 2024-09-10T17:57:02.782 INFO:tasks.rados.rados.0.smithi012.stdout:204: writing smithi01278544-1 from 548864 to 999424 tid 2 2024-09-10T17:57:02.785 INFO:tasks.rados.rados.0.smithi012.stdout:204: writing smithi01278544-1 from 999424 to 1351680 tid 3 2024-09-10T17:57:02.785 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 15 2024-09-10T17:57:02.785 INFO:tasks.rados.rados.0.smithi012.stdout:205: seq_num 81 ranges {1351680=565248,1916928=737280,2654208=65536} 2024-09-10T17:57:02.796 INFO:tasks.rados.rados.0.smithi012.stdout:205: writing smithi01278544-9 from 1351680 to 1916928 tid 1 2024-09-10T17:57:02.800 INFO:tasks.rados.rados.0.smithi012.stdout:205: writing smithi01278544-9 from 1916928 to 2654208 tid 2 2024-09-10T17:57:02.801 INFO:tasks.rados.rados.0.smithi012.stdout:205: writing smithi01278544-9 from 2654208 to 2719744 tid 3 2024-09-10T17:57:02.802 INFO:tasks.rados.rados.0.smithi012.stdout:206: rmattr oid 11 current snap is 15 2024-09-10T17:57:02.802 INFO:tasks.rados.rados.0.smithi012.stdout:206: done (3 left) 2024-09-10T17:57:02.802 INFO:tasks.rados.rados.0.smithi012.stdout:207: snap_remove snap 13 2024-09-10T17:57:02.852 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:57:02.853 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T17:57:02.853 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:57:02.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:57:02.853 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T17:57:02.854 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:57:02.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:57:02.854 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T17:57:02.854 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:57:02.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:57:02.854 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T17:57:02.855 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:57:02.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:57:02.855 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T17:57:02.855 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 15 2024-09-10T17:57:02.855 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T17:57:02.855 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [], 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "0/20 daemons upgraded", 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e image on host smithi089", 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T17:57:03.134 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:57:03.135 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[27356]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.135 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[27356]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.135 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[27356]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.135 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[27356]: pgmap v143: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:03.135 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[27356]: osdmap e109: 8 total, 8 up, 8 in 2024-09-10T17:57:03.135 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[37454]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.135 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[37454]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.135 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[37454]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.136 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[37454]: pgmap v143: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:03.136 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:02 smithi012 ceph-mon[37454]: osdmap e109: 8 total, 8 up, 8 in 2024-09-10T17:57:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:02 smithi089 ceph-mon[31467]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:02 smithi089 ceph-mon[31467]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:02 smithi089 ceph-mon[31467]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:02 smithi089 ceph-mon[31467]: pgmap v143: 121 pgs: 121 active+clean; 38 MiB data, 297 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:02 smithi089 ceph-mon[31467]: osdmap e109: 8 total, 8 up, 8 in 2024-09-10T17:57:03.798 INFO:tasks.rados.rados.0.smithi012.stdout:207: done (3 left) 2024-09-10T17:57:03.798 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 15 2024-09-10T17:57:03.798 INFO:tasks.rados.rados.0.smithi012.stdout:208: seq_num 82 ranges {172032=581632,753664=622592,1376256=180224} 2024-09-10T17:57:03.802 INFO:tasks.rados.rados.0.smithi012.stdout:208: writing smithi01278544-2 from 172032 to 753664 tid 1 2024-09-10T17:57:03.805 INFO:tasks.rados.rados.0.smithi012.stdout:208: writing smithi01278544-2 from 753664 to 1376256 tid 2 2024-09-10T17:57:03.807 INFO:tasks.rados.rados.0.smithi012.stdout:208: writing smithi01278544-2 from 1376256 to 1556480 tid 3 2024-09-10T17:57:03.807 INFO:tasks.rados.rados.0.smithi012.stdout:209: copy_from oid 38 from oid 46 current snap is 15 2024-09-10T17:57:03.807 INFO:tasks.rados.rados.0.smithi012.stdout:203: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:57:03.815 INFO:tasks.rados.rados.0.smithi012.stdout:204: finishing write tid 1 to smithi01278544-1 2024-09-10T17:57:03.815 INFO:tasks.rados.rados.0.smithi012.stdout:204: finishing write tid 2 to smithi01278544-1 2024-09-10T17:57:03.815 INFO:tasks.rados.rados.0.smithi012.stdout:204: finishing write tid 3 to smithi01278544-1 2024-09-10T17:57:03.815 INFO:tasks.rados.rados.0.smithi012.stdout:204: finishing write tid 4 to smithi01278544-1 2024-09-10T17:57:03.815 INFO:tasks.rados.rados.0.smithi012.stdout:204: finishing write tid 5 to smithi01278544-1 2024-09-10T17:57:03.815 INFO:tasks.rados.rados.0.smithi012.stdout:204: oid 1 updating version 0 to 40 2024-09-10T17:57:03.815 INFO:tasks.rados.rados.0.smithi012.stdout:204: oid 1 updating version 40 to 41 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:204: oid 1 version 41 is already newer than 39 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:204: oid 1 version 41 is already newer than 38 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 41 (ObjNum 80 snap 15 seq_num 80) dirty exists 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:204: left oid 1 (ObjNum 80 snap 15 seq_num 80) 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: finishing write tid 1 to smithi01278544-9 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: finishing write tid 2 to smithi01278544-9 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: finishing write tid 3 to smithi01278544-9 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: finishing write tid 4 to smithi01278544-9 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: finishing write tid 5 to smithi01278544-9 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: oid 9 updating version 0 to 44 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: oid 9 updating version 44 to 45 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: oid 9 updating version 45 to 46 2024-09-10T17:57:03.816 INFO:tasks.rados.rados.0.smithi012.stdout:205: oid 9 version 46 is already newer than 43 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 46 (ObjNum 81 snap 15 seq_num 81) dirty exists 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:205: left oid 9 (ObjNum 81 snap 15 seq_num 81) 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:208: finishing write tid 1 to smithi01278544-2 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:208: finishing write tid 2 to smithi01278544-2 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:208: finishing write tid 3 to smithi01278544-2 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:208: finishing write tid 4 to smithi01278544-2 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:208: finishing write tid 5 to smithi01278544-2 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:208: oid 2 updating version 0 to 51 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:208: oid 2 updating version 51 to 52 2024-09-10T17:57:03.817 INFO:tasks.rados.rados.0.smithi012.stdout:208: oid 2 updating version 52 to 54 2024-09-10T17:57:03.818 INFO:tasks.rados.rados.0.smithi012.stdout:208: oid 2 version 54 is already newer than 53 2024-09-10T17:57:03.818 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 54 (ObjNum 82 snap 15 seq_num 82) dirty exists 2024-09-10T17:57:03.818 INFO:tasks.rados.rados.0.smithi012.stdout:208: left oid 2 (ObjNum 82 snap 15 seq_num 82) 2024-09-10T17:57:03.818 INFO:tasks.rados.rados.0.smithi012.stdout:203: done (4 left) 2024-09-10T17:57:03.818 INFO:tasks.rados.rados.0.smithi012.stdout:204: done (3 left) 2024-09-10T17:57:03.818 INFO:tasks.rados.rados.0.smithi012.stdout:205: done (2 left) 2024-09-10T17:57:03.818 INFO:tasks.rados.rados.0.smithi012.stdout:208: done (1 left) 2024-09-10T17:57:03.818 INFO:tasks.rados.rados.0.smithi012.stdout:210: snap_remove snap 11 2024-09-10T17:57:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:03 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/3150867780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:57:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:03 smithi012 ceph-mon[27356]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:04.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:57:03] "GET /metrics HTTP/1.1" 200 35998 "" "Prometheus/2.43.0" 2024-09-10T17:57:04.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:03 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/3150867780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:57:04.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:03 smithi012 ceph-mon[37454]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:04.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:03 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/3150867780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:57:04.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:03 smithi089 ceph-mon[31467]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:210: done (1 left) 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:211: rmattr oid 3 current snap is 15 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:211: done (1 left) 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:212: rmattr oid 29 current snap is 15 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:209: finishing copy_from racing read to smithi01278544-38 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:209: finishing copy_from to smithi01278544-38 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 17 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:209: done (1 left) 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:213: rmattr oid 20 current snap is 15 2024-09-10T17:57:04.806 INFO:tasks.rados.rados.0.smithi012.stdout:213: done (1 left) 2024-09-10T17:57:04.807 INFO:tasks.rados.rados.0.smithi012.stdout:214: read oid 5 snap -1 2024-09-10T17:57:04.807 INFO:tasks.rados.rados.0.smithi012.stdout:214: expect (ObjNum 4 snap 0 seq_num 4) 2024-09-10T17:57:04.807 INFO:tasks.rados.rados.0.smithi012.stdout:215: read oid 48 snap -1 2024-09-10T17:57:04.807 INFO:tasks.rados.rados.0.smithi012.stdout:215: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:04.807 INFO:tasks.rados.rados.0.smithi012.stdout:216: setattr oid 39 current snap is 15 2024-09-10T17:57:04.807 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 15 2024-09-10T17:57:04.807 INFO:tasks.rados.rados.0.smithi012.stdout:217: seq_num 83 ranges {761856=598016,1359872=499712,1859584=303104} 2024-09-10T17:57:04.815 INFO:tasks.rados.rados.0.smithi012.stdout:217: writing smithi01278544-38 from 761856 to 1359872 tid 1 2024-09-10T17:57:04.818 INFO:tasks.rados.rados.0.smithi012.stdout:217: writing smithi01278544-38 from 1359872 to 1859584 tid 2 2024-09-10T17:57:04.820 INFO:tasks.rados.rados.0.smithi012.stdout:217: writing smithi01278544-38 from 1859584 to 2162688 tid 3 2024-09-10T17:57:04.820 INFO:tasks.rados.rados.0.smithi012.stdout:218: copy_from oid 41 from oid 32 current snap is 15 2024-09-10T17:57:04.821 INFO:tasks.rados.rados.0.smithi012.stdout:214: expect (ObjNum 4 snap 0 seq_num 4) 2024-09-10T17:57:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 16 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:57:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 62 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-10T17:57:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:215: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:04.915 INFO:tasks.rados.rados.0.smithi012.stdout:218: finishing copy_from to smithi01278544-41 2024-09-10T17:57:04.915 INFO:tasks.rados.rados.0.smithi012.stdout:218: got expected ENOENT (src dne) 2024-09-10T17:57:04.915 INFO:tasks.rados.rados.0.smithi012.stdout:218: finishing copy_from racing read to smithi01278544-41 2024-09-10T17:57:04.915 INFO:tasks.rados.rados.0.smithi012.stdout:217: finishing write tid 1 to smithi01278544-38 2024-09-10T17:57:04.915 INFO:tasks.rados.rados.0.smithi012.stdout:217: finishing write tid 2 to smithi01278544-38 2024-09-10T17:57:04.915 INFO:tasks.rados.rados.0.smithi012.stdout:217: finishing write tid 3 to smithi01278544-38 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:217: finishing write tid 4 to smithi01278544-38 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:217: finishing write tid 5 to smithi01278544-38 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:217: oid 38 updating version 0 to 56 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:217: oid 38 version 56 is already newer than 55 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:217: oid 38 updating version 56 to 57 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:217: oid 38 updating version 57 to 58 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 58 (ObjNum 83 snap 15 seq_num 83) dirty exists 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:217: left oid 38 (ObjNum 83 snap 15 seq_num 83) 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:212: done (5 left) 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:214: done (4 left) 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:215: done (3 left) 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:216: done (2 left) 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:217: done (1 left) 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:218: done (0 left) 2024-09-10T17:57:04.916 INFO:tasks.rados.rados.0.smithi012.stdout:219: snap_create 2024-09-10T17:57:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:04 smithi012 ceph-mon[27356]: osdmap e110: 8 total, 8 up, 8 in 2024-09-10T17:57:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:04 smithi012 ceph-mon[27356]: pgmap v146: 121 pgs: 121 active+clean; 45 MiB data, 309 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2024-09-10T17:57:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:04 smithi012 ceph-mon[37454]: osdmap e110: 8 total, 8 up, 8 in 2024-09-10T17:57:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:04 smithi012 ceph-mon[37454]: pgmap v146: 121 pgs: 121 active+clean; 45 MiB data, 309 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2024-09-10T17:57:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:04 smithi089 ceph-mon[31467]: osdmap e110: 8 total, 8 up, 8 in 2024-09-10T17:57:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:04 smithi089 ceph-mon[31467]: pgmap v146: 121 pgs: 121 active+clean; 45 MiB data, 309 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2024-09-10T17:57:05.807 INFO:tasks.rados.rados.0.smithi012.stdout:219: done (0 left) 2024-09-10T17:57:05.807 INFO:tasks.rados.rados.0.smithi012.stdout:220: delete oid 31 current snap is 16 2024-09-10T17:57:05.814 INFO:tasks.rados.rados.0.smithi012.stdout:220: done (0 left) 2024-09-10T17:57:05.814 INFO:tasks.rados.rados.0.smithi012.stdout:221: delete oid 26 current snap is 16 2024-09-10T17:57:05.816 INFO:tasks.rados.rados.0.smithi012.stdout:221: done (0 left) 2024-09-10T17:57:05.816 INFO:tasks.rados.rados.0.smithi012.stdout:222: copy_from oid 20 from oid 42 current snap is 16 2024-09-10T17:57:05.817 INFO:tasks.rados.rados.0.smithi012.stdout:223: delete oid 5 current snap is 16 2024-09-10T17:57:05.819 INFO:tasks.rados.rados.0.smithi012.stdout:223: done (1 left) 2024-09-10T17:57:05.820 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 16 2024-09-10T17:57:05.820 INFO:tasks.rados.rados.0.smithi012.stdout:224: seq_num 87 ranges {1384448=663552,2048000=491520,2539520=311296} 2024-09-10T17:57:05.830 INFO:tasks.rados.rados.0.smithi012.stdout:224: writing smithi01278544-13 from 1384448 to 2048000 tid 1 2024-09-10T17:57:05.833 INFO:tasks.rados.rados.0.smithi012.stdout:224: writing smithi01278544-13 from 2048000 to 2539520 tid 2 2024-09-10T17:57:05.836 INFO:tasks.rados.rados.0.smithi012.stdout:224: writing smithi01278544-13 from 2539520 to 2850816 tid 3 2024-09-10T17:57:05.836 INFO:tasks.rados.rados.0.smithi012.stdout:225: read oid 19 snap -1 2024-09-10T17:57:05.836 INFO:tasks.rados.rados.0.smithi012.stdout:225: expect (ObjNum 73 snap 10 seq_num 73) 2024-09-10T17:57:05.836 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 16 2024-09-10T17:57:05.836 INFO:tasks.rados.rados.0.smithi012.stdout:222: finishing copy_from racing read to smithi01278544-20 2024-09-10T17:57:05.836 INFO:tasks.rados.rados.0.smithi012.stdout:222: finishing copy_from to smithi01278544-20 2024-09-10T17:57:05.836 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 14 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-10T17:57:05.836 INFO:tasks.rados.rados.0.smithi012.stdout:224: finishing write tid 1 to smithi01278544-13 2024-09-10T17:57:05.837 INFO:tasks.rados.rados.0.smithi012.stdout:226: seq_num 88 ranges {2416640=679936,3096576=778240,3874816=24576} 2024-09-10T17:57:05.853 INFO:tasks.rados.rados.0.smithi012.stdout:226: writing smithi01278544-21 from 2416640 to 3096576 tid 1 2024-09-10T17:57:05.858 INFO:tasks.rados.rados.0.smithi012.stdout:226: writing smithi01278544-21 from 3096576 to 3874816 tid 2 2024-09-10T17:57:05.858 INFO:tasks.rados.rados.0.smithi012.stdout:226: writing smithi01278544-21 from 3874816 to 3899392 tid 3 2024-09-10T17:57:05.858 INFO:tasks.rados.rados.0.smithi012.stdout:222: done (3 left) 2024-09-10T17:57:05.858 INFO:tasks.rados.rados.0.smithi012.stdout:227: delete oid 11 current snap is 16 2024-09-10T17:57:05.858 INFO:tasks.rados.rados.0.smithi012.stdout:224: finishing write tid 2 to smithi01278544-13 2024-09-10T17:57:05.858 INFO:tasks.rados.rados.0.smithi012.stdout:224: finishing write tid 3 to smithi01278544-13 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:224: finishing write tid 4 to smithi01278544-13 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:224: finishing write tid 5 to smithi01278544-13 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:224: oid 13 updating version 0 to 55 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:224: oid 13 updating version 55 to 56 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:224: oid 13 updating version 56 to 58 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:224: oid 13 version 58 is already newer than 57 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 58 (ObjNum 87 snap 16 seq_num 87) dirty exists 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:224: left oid 13 (ObjNum 87 snap 16 seq_num 87) 2024-09-10T17:57:05.859 INFO:tasks.rados.rados.0.smithi012.stdout:225: expect (ObjNum 73 snap 10 seq_num 73) 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: finishing write tid 1 to smithi01278544-21 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: finishing write tid 2 to smithi01278544-21 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: finishing write tid 3 to smithi01278544-21 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: finishing write tid 4 to smithi01278544-21 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: finishing write tid 5 to smithi01278544-21 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: oid 21 updating version 0 to 72 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: oid 21 updating version 72 to 73 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: oid 21 updating version 73 to 75 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:226: oid 21 version 75 is already newer than 74 2024-09-10T17:57:05.905 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 75 (ObjNum 88 snap 16 seq_num 88) dirty exists 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:226: left oid 21 (ObjNum 88 snap 16 seq_num 88) 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:224: done (3 left) 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:225: done (2 left) 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:226: done (1 left) 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:227: done (0 left) 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:228: read oid 38 snap -1 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:228: expect (ObjNum 83 snap 15 seq_num 83) 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:229: copy_from oid 41 from oid 6 current snap is 16 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:230: copy_from oid 30 from oid 19 current snap is 16 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:231: read oid 14 snap 15 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:231: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-10T17:57:05.906 INFO:tasks.rados.rados.0.smithi012.stdout:232: delete oid 4 current snap is 16 2024-09-10T17:57:05.907 INFO:tasks.rados.rados.0.smithi012.stdout:232: done (4 left) 2024-09-10T17:57:05.907 INFO:tasks.rados.rados.0.smithi012.stdout:233: rollback oid 9 current snap is 16 2024-09-10T17:57:05.907 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 15 2024-09-10T17:57:05.907 INFO:tasks.rados.rados.0.smithi012.stdout:234: delete oid 20 current snap is 16 2024-09-10T17:57:05.908 INFO:tasks.rados.rados.0.smithi012.stdout:231: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-10T17:57:05.915 INFO:tasks.rados.rados.0.smithi012.stdout:229: finishing copy_from racing read to smithi01278544-41 2024-09-10T17:57:05.916 INFO:tasks.rados.rados.0.smithi012.stdout:229: finishing copy_from to smithi01278544-41 2024-09-10T17:57:05.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 33 (ObjNum 65 snap 0 seq_num 1465676632) dirty exists 2024-09-10T17:57:05.916 INFO:tasks.rados.rados.0.smithi012.stdout:230: finishing copy_from racing read to smithi01278544-30 2024-09-10T17:57:05.916 INFO:tasks.rados.rados.0.smithi012.stdout:228: expect (ObjNum 83 snap 15 seq_num 83) 2024-09-10T17:57:05.987 INFO:tasks.rados.rados.0.smithi012.stdout:233: finishing rollback tid 0 to smithi01278544-9 2024-09-10T17:57:05.987 INFO:tasks.rados.rados.0.smithi012.stdout:233: finishing rollback tid 1 to smithi01278544-9 2024-09-10T17:57:05.987 INFO:tasks.rados.rados.0.smithi012.stdout:233: finishing rollback tid 2 to smithi01278544-9 2024-09-10T17:57:05.987 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 62 (ObjNum 81 snap 15 seq_num 81) dirty exists 2024-09-10T17:57:05.987 INFO:tasks.rados.rados.0.smithi012.stdout:230: finishing copy_from to smithi01278544-30 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 64 (ObjNum 73 snap 10 seq_num 73) dirty exists 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:228: done (5 left) 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:229: done (4 left) 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:230: done (3 left) 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:231: done (2 left) 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:233: done (1 left) 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:234: done (0 left) 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:235: copy_from oid 44 from oid 24 current snap is 16 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:236: rollback oid 13 current snap is 16 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 13 to 12 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 16 2024-09-10T17:57:05.988 INFO:tasks.rados.rados.0.smithi012.stdout:237: seq_num 92 ranges {270336=745472,1015808=761856,1777664=40960} 2024-09-10T17:57:05.992 INFO:tasks.rados.rados.0.smithi012.stdout:237: writing smithi01278544-17 from 270336 to 1015808 tid 1 2024-09-10T17:57:05.996 INFO:tasks.rados.rados.0.smithi012.stdout:237: writing smithi01278544-17 from 1015808 to 1777664 tid 2 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:237: writing smithi01278544-17 from 1777664 to 1818624 tid 3 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:238: rollback oid 35 current snap is 16 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 35 to 15 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:236: finishing rollback tid 0 to smithi01278544-13 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:236: finishing rollback tid 1 to smithi01278544-13 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:236: finishing rollback tid 2 to smithi01278544-13 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 65 (ObjNum 70 snap 10 seq_num 70) dirty exists 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:237: finishing write tid 1 to smithi01278544-17 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:236: done (3 left) 2024-09-10T17:57:05.997 INFO:tasks.rados.rados.0.smithi012.stdout:239: snap_remove snap 12 2024-09-10T17:57:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:05 smithi012 ceph-mon[27356]: osdmap e111: 8 total, 8 up, 8 in 2024-09-10T17:57:06.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:05 smithi012 ceph-mon[37454]: osdmap e111: 8 total, 8 up, 8 in 2024-09-10T17:57:06.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:05 smithi089 ceph-mon[31467]: osdmap e111: 8 total, 8 up, 8 in 2024-09-10T17:57:06.775 INFO:tasks.rados.rados.0.smithi012.stdout:239: done (3 left) 2024-09-10T17:57:06.776 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 16 2024-09-10T17:57:06.776 INFO:tasks.rados.rados.0.smithi012.stdout:240: seq_num 93 ranges {1531904=761856,2293760=647168,2940928=155648} 2024-09-10T17:57:06.789 INFO:tasks.rados.rados.0.smithi012.stdout:240: writing smithi01278544-19 from 1531904 to 2293760 tid 1 2024-09-10T17:57:06.793 INFO:tasks.rados.rados.0.smithi012.stdout:240: writing smithi01278544-19 from 2293760 to 2940928 tid 2 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:240: writing smithi01278544-19 from 2940928 to 3096576 tid 3 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:241: copy_from oid 33 from oid 18 current snap is 16 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:235: finishing copy_from racing read to smithi01278544-44 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:235: finishing copy_from to smithi01278544-44 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 29 (ObjNum 66 snap 6 seq_num 66) dirty exists 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:238: finishing rollback tid 0 to smithi01278544-35 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:238: finishing rollback tid 1 to smithi01278544-35 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:238: finishing rollback tid 2 to smithi01278544-35 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 67 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:237: finishing write tid 2 to smithi01278544-17 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:237: finishing write tid 3 to smithi01278544-17 2024-09-10T17:57:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:237: finishing write tid 4 to smithi01278544-17 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:237: finishing write tid 5 to smithi01278544-17 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:237: oid 17 updating version 0 to 11 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:237: oid 17 version 11 is already newer than 8 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:237: oid 17 version 11 is already newer than 9 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:237: oid 17 version 11 is already newer than 10 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 11 (ObjNum 92 snap 16 seq_num 92) dirty exists 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:237: left oid 17 (ObjNum 92 snap 16 seq_num 92) 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:240: finishing write tid 1 to smithi01278544-19 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:235: done (4 left) 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:237: done (3 left) 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:238: done (2 left) 2024-09-10T17:57:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:242: delete oid 15 current snap is 16 2024-09-10T17:57:06.797 INFO:tasks.rados.rados.0.smithi012.stdout:240: finishing write tid 2 to smithi01278544-19 2024-09-10T17:57:06.797 INFO:tasks.rados.rados.0.smithi012.stdout:240: finishing write tid 3 to smithi01278544-19 2024-09-10T17:57:06.797 INFO:tasks.rados.rados.0.smithi012.stdout:240: finishing write tid 4 to smithi01278544-19 2024-09-10T17:57:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:242: done (2 left) 2024-09-10T17:57:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:243: delete oid 41 current snap is 16 2024-09-10T17:57:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:240: finishing write tid 5 to smithi01278544-19 2024-09-10T17:57:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:240: oid 19 updating version 0 to 82 2024-09-10T17:57:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:240: oid 19 version 82 is already newer than 81 2024-09-10T17:57:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:240: oid 19 version 82 is already newer than 79 2024-09-10T17:57:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:240: oid 19 version 82 is already newer than 80 2024-09-10T17:57:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 82 (ObjNum 93 snap 16 seq_num 93) dirty exists 2024-09-10T17:57:06.799 INFO:tasks.rados.rados.0.smithi012.stdout:240: left oid 19 (ObjNum 93 snap 16 seq_num 93) 2024-09-10T17:57:06.799 INFO:tasks.rados.rados.0.smithi012.stdout:240: done (2 left) 2024-09-10T17:57:06.799 INFO:tasks.rados.rados.0.smithi012.stdout:243: done (1 left) 2024-09-10T17:57:06.799 INFO:tasks.rados.rados.0.smithi012.stdout:244: setattr oid 47 current snap is 16 2024-09-10T17:57:06.801 INFO:tasks.rados.rados.0.smithi012.stdout:241: finishing copy_from racing read to smithi01278544-33 2024-09-10T17:57:06.801 INFO:tasks.rados.rados.0.smithi012.stdout:241: finishing copy_from to smithi01278544-33 2024-09-10T17:57:06.801 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 39 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:57:06.802 INFO:tasks.rados.rados.0.smithi012.stdout:241: done (1 left) 2024-09-10T17:57:06.802 INFO:tasks.rados.rados.0.smithi012.stdout:245: snap_remove snap 15 2024-09-10T17:57:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:06 smithi012 ceph-mon[27356]: osdmap e112: 8 total, 8 up, 8 in 2024-09-10T17:57:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:06 smithi012 ceph-mon[27356]: pgmap v149: 121 pgs: 121 active+clean; 45 MiB data, 309 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2024-09-10T17:57:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:06 smithi012 ceph-mon[27356]: osdmap e113: 8 total, 8 up, 8 in 2024-09-10T17:57:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:06 smithi012 ceph-mon[37454]: osdmap e112: 8 total, 8 up, 8 in 2024-09-10T17:57:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:06 smithi012 ceph-mon[37454]: pgmap v149: 121 pgs: 121 active+clean; 45 MiB data, 309 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2024-09-10T17:57:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:06 smithi012 ceph-mon[37454]: osdmap e113: 8 total, 8 up, 8 in 2024-09-10T17:57:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:06 smithi089 ceph-mon[31467]: osdmap e112: 8 total, 8 up, 8 in 2024-09-10T17:57:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:06 smithi089 ceph-mon[31467]: pgmap v149: 121 pgs: 121 active+clean; 45 MiB data, 309 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2024-09-10T17:57:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:06 smithi089 ceph-mon[31467]: osdmap e113: 8 total, 8 up, 8 in 2024-09-10T17:57:07.778 INFO:tasks.rados.rados.0.smithi012.stdout:245: done (1 left) 2024-09-10T17:57:07.779 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 16 2024-09-10T17:57:07.779 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 64 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:57:07.779 INFO:tasks.rados.rados.0.smithi012.stdout:246: seq_num 96 ranges {606208=409600,1015808=696320,1712128=507904} 2024-09-10T17:57:07.784 INFO:tasks.rados.rados.0.smithi012.stdout:246: writing smithi01278544-37 from 606208 to 1015808 tid 1 2024-09-10T17:57:07.789 INFO:tasks.rados.rados.0.smithi012.stdout:246: writing smithi01278544-37 from 1015808 to 1712128 tid 2 2024-09-10T17:57:07.793 INFO:tasks.rados.rados.0.smithi012.stdout:246: writing smithi01278544-37 from 1712128 to 2220032 tid 3 2024-09-10T17:57:07.793 INFO:tasks.rados.rados.0.smithi012.stdout:244: done (1 left) 2024-09-10T17:57:07.793 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 16 2024-09-10T17:57:07.793 INFO:tasks.rados.rados.0.smithi012.stdout:246: finishing write tid 1 to smithi01278544-37 2024-09-10T17:57:07.793 INFO:tasks.rados.rados.0.smithi012.stdout:246: finishing write tid 2 to smithi01278544-37 2024-09-10T17:57:07.793 INFO:tasks.rados.rados.0.smithi012.stdout:247: seq_num 97 ranges {1556480=434176,1990656=581632,2572288=540672,3112960=81920} 2024-09-10T17:57:07.804 INFO:tasks.rados.rados.0.smithi012.stdout:247: writing smithi01278544-2 from 1556480 to 1990656 tid 1 2024-09-10T17:57:07.807 INFO:tasks.rados.rados.0.smithi012.stdout:247: writing smithi01278544-2 from 1990656 to 2572288 tid 2 2024-09-10T17:57:07.810 INFO:tasks.rados.rados.0.smithi012.stdout:247: writing smithi01278544-2 from 2572288 to 3112960 tid 3 2024-09-10T17:57:07.811 INFO:tasks.rados.rados.0.smithi012.stdout:247: writing smithi01278544-2 from 3112960 to 3194880 tid 4 2024-09-10T17:57:07.811 INFO:tasks.rados.rados.0.smithi012.stdout:248: copy_from oid 27 from oid 26 current snap is 16 2024-09-10T17:57:07.811 INFO:tasks.rados.rados.0.smithi012.stdout:246: finishing write tid 3 to smithi01278544-37 2024-09-10T17:57:07.811 INFO:tasks.rados.rados.0.smithi012.stdout:246: finishing write tid 4 to smithi01278544-37 2024-09-10T17:57:07.811 INFO:tasks.rados.rados.0.smithi012.stdout:246: finishing write tid 5 to smithi01278544-37 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:246: oid 37 updating version 0 to 84 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:246: oid 37 updating version 84 to 85 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:246: oid 37 updating version 85 to 86 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:246: oid 37 version 86 is already newer than 79 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 86 (ObjNum 96 snap 16 seq_num 96) dirty exists 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:246: left oid 37 (ObjNum 96 snap 16 seq_num 96) 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:247: finishing write tid 1 to smithi01278544-2 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:247: finishing write tid 2 to smithi01278544-2 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:246: done (2 left) 2024-09-10T17:57:07.812 INFO:tasks.rados.rados.0.smithi012.stdout:249: snap_create 2024-09-10T17:57:07.813 INFO:tasks.rados.rados.0.smithi012.stdout:248: finishing copy_from to smithi01278544-27 2024-09-10T17:57:07.813 INFO:tasks.rados.rados.0.smithi012.stdout:248: got expected ENOENT (src dne) 2024-09-10T17:57:07.813 INFO:tasks.rados.rados.0.smithi012.stdout:248: finishing copy_from racing read to smithi01278544-27 2024-09-10T17:57:07.813 INFO:tasks.rados.rados.0.smithi012.stdout:247: finishing write tid 3 to smithi01278544-2 2024-09-10T17:57:07.814 INFO:tasks.rados.rados.0.smithi012.stdout:247: finishing write tid 4 to smithi01278544-2 2024-09-10T17:57:07.814 INFO:tasks.rados.rados.0.smithi012.stdout:247: finishing write tid 5 to smithi01278544-2 2024-09-10T17:57:07.814 INFO:tasks.rados.rados.0.smithi012.stdout:247: finishing write tid 6 to smithi01278544-2 2024-09-10T17:57:07.815 INFO:tasks.rados.rados.0.smithi012.stdout:247: oid 2 updating version 0 to 67 2024-09-10T17:57:07.815 INFO:tasks.rados.rados.0.smithi012.stdout:247: oid 2 version 67 is already newer than 64 2024-09-10T17:57:07.815 INFO:tasks.rados.rados.0.smithi012.stdout:247: oid 2 version 67 is already newer than 63 2024-09-10T17:57:07.815 INFO:tasks.rados.rados.0.smithi012.stdout:247: oid 2 version 67 is already newer than 65 2024-09-10T17:57:07.815 INFO:tasks.rados.rados.0.smithi012.stdout:247: oid 2 version 67 is already newer than 66 2024-09-10T17:57:07.815 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 67 (ObjNum 97 snap 16 seq_num 97) dirty exists 2024-09-10T17:57:07.815 INFO:tasks.rados.rados.0.smithi012.stdout:247: left oid 2 (ObjNum 97 snap 16 seq_num 97) 2024-09-10T17:57:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:247: done (2 left) 2024-09-10T17:57:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:248: done (1 left) 2024-09-10T17:57:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:249: done (0 left) 2024-09-10T17:57:08.782 INFO:tasks.rados.rados.0.smithi012.stdout:250: snap_create 2024-09-10T17:57:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:08 smithi012 ceph-mon[27356]: osdmap e114: 8 total, 8 up, 8 in 2024-09-10T17:57:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:08 smithi012 ceph-mon[27356]: pgmap v152: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 34 op/s 2024-09-10T17:57:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:08 smithi012 ceph-mon[37454]: osdmap e114: 8 total, 8 up, 8 in 2024-09-10T17:57:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:08 smithi012 ceph-mon[37454]: pgmap v152: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 34 op/s 2024-09-10T17:57:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:08 smithi089 ceph-mon[31467]: osdmap e114: 8 total, 8 up, 8 in 2024-09-10T17:57:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:08 smithi089 ceph-mon[31467]: pgmap v152: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 34 op/s 2024-09-10T17:57:09.782 INFO:tasks.rados.rados.0.smithi012.stdout:250: done (0 left) 2024-09-10T17:57:09.782 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 18 2024-09-10T17:57:09.783 INFO:tasks.rados.rados.0.smithi012.stdout:251: seq_num 98 ranges {1818624=450560,2269184=466944,2736128=737280} 2024-09-10T17:57:09.794 INFO:tasks.rados.rados.0.smithi012.stdout:251: writing smithi01278544-17 from 1818624 to 2269184 tid 1 2024-09-10T17:57:09.797 INFO:tasks.rados.rados.0.smithi012.stdout:251: writing smithi01278544-17 from 2269184 to 2736128 tid 2 2024-09-10T17:57:09.801 INFO:tasks.rados.rados.0.smithi012.stdout:251: writing smithi01278544-17 from 2736128 to 3473408 tid 3 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:252: rollback oid 8 current snap is 18 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 8 to 17 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:251: finishing write tid 1 to smithi01278544-17 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:253: rmattr oid 26 current snap is 18 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:253: done (2 left) 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:254: delete oid 2 current snap is 18 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:251: finishing write tid 2 to smithi01278544-17 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:252: finishing rollback tid 1 to smithi01278544-8 2024-09-10T17:57:09.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 0 (ObjNum 4113 snap 0 seq_num 1634035807) dirty dne 2024-09-10T17:57:09.804 INFO:tasks.rados.rados.0.smithi012.stdout:252: done (2 left) 2024-09-10T17:57:09.804 INFO:tasks.rados.rados.0.smithi012.stdout:254: done (1 left) 2024-09-10T17:57:09.804 INFO:tasks.rados.rados.0.smithi012.stdout:255: rmattr oid 10 current snap is 18 2024-09-10T17:57:09.804 INFO:tasks.rados.rados.0.smithi012.stdout:255: done (1 left) 2024-09-10T17:57:09.804 INFO:tasks.rados.rados.0.smithi012.stdout:256: snap_create 2024-09-10T17:57:09.805 INFO:tasks.rados.rados.0.smithi012.stdout:251: finishing write tid 3 to smithi01278544-17 2024-09-10T17:57:09.805 INFO:tasks.rados.rados.0.smithi012.stdout:251: finishing write tid 4 to smithi01278544-17 2024-09-10T17:57:09.806 INFO:tasks.rados.rados.0.smithi012.stdout:251: finishing write tid 5 to smithi01278544-17 2024-09-10T17:57:09.806 INFO:tasks.rados.rados.0.smithi012.stdout:251: oid 17 updating version 0 to 24 2024-09-10T17:57:09.806 INFO:tasks.rados.rados.0.smithi012.stdout:251: oid 17 version 24 is already newer than 22 2024-09-10T17:57:09.806 INFO:tasks.rados.rados.0.smithi012.stdout:251: oid 17 version 24 is already newer than 21 2024-09-10T17:57:09.806 INFO:tasks.rados.rados.0.smithi012.stdout:251: oid 17 version 24 is already newer than 23 2024-09-10T17:57:09.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 24 (ObjNum 98 snap 18 seq_num 98) dirty exists 2024-09-10T17:57:09.806 INFO:tasks.rados.rados.0.smithi012.stdout:251: left oid 17 (ObjNum 98 snap 18 seq_num 98) 2024-09-10T17:57:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:09 smithi012 ceph-mon[27356]: osdmap e115: 8 total, 8 up, 8 in 2024-09-10T17:57:10.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:09 smithi012 ceph-mon[37454]: osdmap e115: 8 total, 8 up, 8 in 2024-09-10T17:57:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:09 smithi089 ceph-mon[31467]: osdmap e115: 8 total, 8 up, 8 in 2024-09-10T17:57:10.798 INFO:tasks.rados.rados.0.smithi012.stdout:251: done (1 left) 2024-09-10T17:57:10.798 INFO:tasks.rados.rados.0.smithi012.stdout:256: done (0 left) 2024-09-10T17:57:10.798 INFO:tasks.rados.rados.0.smithi012.stdout:257: copy_from oid 48 from oid 47 current snap is 19 2024-09-10T17:57:10.798 INFO:tasks.rados.rados.0.smithi012.stdout:258: read oid 34 snap -1 2024-09-10T17:57:10.798 INFO:tasks.rados.rados.0.smithi012.stdout:258: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:10.798 INFO:tasks.rados.rados.0.smithi012.stdout:259: copy_from oid 26 from oid 17 current snap is 19 2024-09-10T17:57:10.799 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 19 2024-09-10T17:57:10.799 INFO:tasks.rados.rados.0.smithi012.stdout:260: seq_num 100 ranges {0=483328,483328=688128,1171456=516096} 2024-09-10T17:57:10.800 INFO:tasks.rados.rados.0.smithi012.stdout:260: writing smithi01278544-2 from 0 to 483328 tid 1 2024-09-10T17:57:10.805 INFO:tasks.rados.rados.0.smithi012.stdout:260: writing smithi01278544-2 from 483328 to 1171456 tid 2 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:260: writing smithi01278544-2 from 1171456 to 1687552 tid 3 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:261: read oid 6 snap 16 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:261: expect (ObjNum -798012400 snap 22079 seq_num 3496542944) 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:262: read oid 39 snap -1 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:262: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:263: read oid 12 snap 17 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:263: expect deleted 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:264: rmattr oid 36 current snap is 19 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:264: done (7 left) 2024-09-10T17:57:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 19 2024-09-10T17:57:10.810 INFO:tasks.rados.rados.0.smithi012.stdout:265: seq_num 101 ranges {663552=499712,1163264=573440,1736704=524288,2260992=106496} 2024-09-10T17:57:10.815 INFO:tasks.rados.rados.0.smithi012.stdout:265: writing smithi01278544-40 from 663552 to 1163264 tid 1 2024-09-10T17:57:10.819 INFO:tasks.rados.rados.0.smithi012.stdout:265: writing smithi01278544-40 from 1163264 to 1736704 tid 2 2024-09-10T17:57:10.822 INFO:tasks.rados.rados.0.smithi012.stdout:265: writing smithi01278544-40 from 1736704 to 2260992 tid 3 2024-09-10T17:57:10.823 INFO:tasks.rados.rados.0.smithi012.stdout:265: writing smithi01278544-40 from 2260992 to 2367488 tid 4 2024-09-10T17:57:10.823 INFO:tasks.rados.rados.0.smithi012.stdout:266: read oid 49 snap -1 2024-09-10T17:57:10.823 INFO:tasks.rados.rados.0.smithi012.stdout:266: expect (ObjNum 55 snap 4 seq_num 55) 2024-09-10T17:57:10.823 INFO:tasks.rados.rados.0.smithi012.stdout:267: read oid 36 snap 16 2024-09-10T17:57:10.823 INFO:tasks.rados.rados.0.smithi012.stdout:267: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:57:10.823 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 19 2024-09-10T17:57:10.823 INFO:tasks.rados.rados.0.smithi012.stdout:258: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:10.840 INFO:tasks.rados.rados.0.smithi012.stdout:260: finishing write tid 1 to smithi01278544-2 2024-09-10T17:57:10.840 INFO:tasks.rados.rados.0.smithi012.stdout:257: finishing copy_from racing read to smithi01278544-48 2024-09-10T17:57:10.840 INFO:tasks.rados.rados.0.smithi012.stdout:260: finishing write tid 2 to smithi01278544-2 2024-09-10T17:57:10.840 INFO:tasks.rados.rados.0.smithi012.stdout:268: seq_num 102 ranges {761856=516096,1277952=450560,1728512=729088,2457600=24576} 2024-09-10T17:57:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:268: writing smithi01278544-33 from 761856 to 1277952 tid 1 2024-09-10T17:57:10.849 INFO:tasks.rados.rados.0.smithi012.stdout:268: writing smithi01278544-33 from 1277952 to 1728512 tid 2 2024-09-10T17:57:10.854 INFO:tasks.rados.rados.0.smithi012.stdout:268: writing smithi01278544-33 from 1728512 to 2457600 tid 3 2024-09-10T17:57:10.854 INFO:tasks.rados.rados.0.smithi012.stdout:268: writing smithi01278544-33 from 2457600 to 2482176 tid 4 2024-09-10T17:57:10.854 INFO:tasks.rados.rados.0.smithi012.stdout:258: done (10 left) 2024-09-10T17:57:10.854 INFO:tasks.rados.rados.0.smithi012.stdout:269: snap_remove snap 18 2024-09-10T17:57:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:10 smithi089 ceph-mon[31467]: osdmap e116: 8 total, 8 up, 8 in 2024-09-10T17:57:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:10 smithi089 ceph-mon[31467]: pgmap v155: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 34 op/s 2024-09-10T17:57:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:10 smithi012 ceph-mon[27356]: osdmap e116: 8 total, 8 up, 8 in 2024-09-10T17:57:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:10 smithi012 ceph-mon[27356]: pgmap v155: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 34 op/s 2024-09-10T17:57:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:10 smithi012 ceph-mon[37454]: osdmap e116: 8 total, 8 up, 8 in 2024-09-10T17:57:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:10 smithi012 ceph-mon[37454]: pgmap v155: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 34 op/s 2024-09-10T17:57:11.774 INFO:tasks.rados.rados.0.smithi012.stdout:269: done (10 left) 2024-09-10T17:57:11.774 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 19 2024-09-10T17:57:11.774 INFO:tasks.rados.rados.0.smithi012.stdout:270: seq_num 103 ranges {2613248=532480,3145728=737280,3883008=466944} 2024-09-10T17:57:11.791 INFO:tasks.rados.rados.0.smithi012.stdout:270: writing smithi01278544-16 from 2613248 to 3145728 tid 1 2024-09-10T17:57:11.795 INFO:tasks.rados.rados.0.smithi012.stdout:270: writing smithi01278544-16 from 3145728 to 3883008 tid 2 2024-09-10T17:57:11.799 INFO:tasks.rados.rados.0.smithi012.stdout:270: writing smithi01278544-16 from 3883008 to 4349952 tid 3 2024-09-10T17:57:11.799 INFO:tasks.rados.rados.0.smithi012.stdout:271: rollback oid 24 current snap is 19 2024-09-10T17:57:11.799 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 24 to 16 2024-09-10T17:57:11.799 INFO:tasks.rados.rados.0.smithi012.stdout:257: finishing copy_from to smithi01278544-48 2024-09-10T17:57:11.799 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 64 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:57:11.799 INFO:tasks.rados.rados.0.smithi012.stdout:261: expect (ObjNum -798012400 snap 22079 seq_num 3496542944) 2024-09-10T17:57:11.804 INFO:tasks.rados.rados.0.smithi012.stdout:260: finishing write tid 3 to smithi01278544-2 2024-09-10T17:57:11.804 INFO:tasks.rados.rados.0.smithi012.stdout:260: finishing write tid 4 to smithi01278544-2 2024-09-10T17:57:11.804 INFO:tasks.rados.rados.0.smithi012.stdout:260: finishing write tid 5 to smithi01278544-2 2024-09-10T17:57:11.804 INFO:tasks.rados.rados.0.smithi012.stdout:260: oid 2 updating version 0 to 72 2024-09-10T17:57:11.804 INFO:tasks.rados.rados.0.smithi012.stdout:260: oid 2 updating version 72 to 73 2024-09-10T17:57:11.804 INFO:tasks.rados.rados.0.smithi012.stdout:260: oid 2 version 73 is already newer than 71 2024-09-10T17:57:11.804 INFO:tasks.rados.rados.0.smithi012.stdout:260: oid 2 version 73 is already newer than 70 2024-09-10T17:57:11.804 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 73 (ObjNum 100 snap 19 seq_num 100) dirty exists 2024-09-10T17:57:11.805 INFO:tasks.rados.rados.0.smithi012.stdout:260: left oid 2 (ObjNum 100 snap 19 seq_num 100) 2024-09-10T17:57:11.805 INFO:tasks.rados.rados.0.smithi012.stdout:259: finishing copy_from racing read to smithi01278544-26 2024-09-10T17:57:11.805 INFO:tasks.rados.rados.0.smithi012.stdout:259: finishing copy_from to smithi01278544-26 2024-09-10T17:57:11.805 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 24 (ObjNum 98 snap 18 seq_num 98) dirty exists 2024-09-10T17:57:11.805 INFO:tasks.rados.rados.0.smithi012.stdout:262: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:57:11.826 INFO:tasks.rados.rados.0.smithi012.stdout:265: finishing write tid 1 to smithi01278544-40 2024-09-10T17:57:11.826 INFO:tasks.rados.rados.0.smithi012.stdout:265: finishing write tid 2 to smithi01278544-40 2024-09-10T17:57:11.826 INFO:tasks.rados.rados.0.smithi012.stdout:267: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:57:11.830 INFO:tasks.rados.rados.0.smithi012.stdout:265: finishing write tid 3 to smithi01278544-40 2024-09-10T17:57:11.830 INFO:tasks.rados.rados.0.smithi012.stdout:265: finishing write tid 4 to smithi01278544-40 2024-09-10T17:57:11.830 INFO:tasks.rados.rados.0.smithi012.stdout:265: finishing write tid 5 to smithi01278544-40 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:265: finishing write tid 6 to smithi01278544-40 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:265: oid 40 updating version 0 to 71 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:265: oid 40 updating version 71 to 72 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:265: oid 40 updating version 72 to 73 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:265: oid 40 updating version 73 to 74 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:265: oid 40 version 74 is already newer than 70 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 74 (ObjNum 101 snap 19 seq_num 101) dirty exists 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:265: left oid 40 (ObjNum 101 snap 19 seq_num 101) 2024-09-10T17:57:11.831 INFO:tasks.rados.rados.0.smithi012.stdout:266: expect (ObjNum 55 snap 4 seq_num 55) 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: finishing write tid 1 to smithi01278544-33 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: finishing write tid 2 to smithi01278544-33 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: finishing write tid 3 to smithi01278544-33 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: finishing write tid 4 to smithi01278544-33 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: finishing write tid 5 to smithi01278544-33 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: finishing write tid 6 to smithi01278544-33 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: oid 33 updating version 0 to 76 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: oid 33 updating version 76 to 78 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: oid 33 version 78 is already newer than 77 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: oid 33 updating version 78 to 79 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:268: oid 33 updating version 79 to 80 2024-09-10T17:57:11.891 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 80 (ObjNum 102 snap 19 seq_num 102) dirty exists 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:268: left oid 33 (ObjNum 102 snap 19 seq_num 102) 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:271: finishing rollback tid 0 to smithi01278544-24 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:271: finishing rollback tid 1 to smithi01278544-24 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:271: finishing rollback tid 2 to smithi01278544-24 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 46 (ObjNum 66 snap 6 seq_num 66) dirty exists 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:270: finishing write tid 1 to smithi01278544-16 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:270: finishing write tid 2 to smithi01278544-16 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:270: finishing write tid 3 to smithi01278544-16 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:270: finishing write tid 4 to smithi01278544-16 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:257: done (11 left) 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:259: done (10 left) 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:260: done (9 left) 2024-09-10T17:57:11.892 INFO:tasks.rados.rados.0.smithi012.stdout:261: done (8 left) 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:262: done (7 left) 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:263: done (6 left) 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:265: done (5 left) 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:266: done (4 left) 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:267: done (3 left) 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:268: done (2 left) 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:271: done (1 left) 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:272: rollback oid 50 current snap is 19 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 17 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:270: finishing write tid 5 to smithi01278544-16 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:270: oid 16 updating version 0 to 37 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:270: oid 16 version 37 is already newer than 36 2024-09-10T17:57:11.893 INFO:tasks.rados.rados.0.smithi012.stdout:270: oid 16 updating version 37 to 38 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:270: oid 16 version 38 is already newer than 35 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 38 (ObjNum 103 snap 19 seq_num 103) dirty exists 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:270: left oid 16 (ObjNum 103 snap 19 seq_num 103) 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:270: done (1 left) 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:273: rmattr oid 11 current snap is 19 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:273: done (1 left) 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:274: rollback oid 47 current snap is 19 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 16 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:275: rmattr oid 7 current snap is 19 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:275: done (2 left) 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:276: copy_from oid 34 from oid 27 current snap is 19 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:277: rollback oid 38 current snap is 19 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 38 to 16 2024-09-10T17:57:11.894 INFO:tasks.rados.rados.0.smithi012.stdout:278: snap_create 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:277: finishing rollback tid 0 to smithi01278544-38 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:274: finishing rollback tid 0 to smithi01278544-47 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:272: finishing rollback tid 0 to smithi01278544-50 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:272: finishing rollback tid 1 to smithi01278544-50 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:272: finishing rollback tid 2 to smithi01278544-50 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 13 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:274: finishing rollback tid 1 to smithi01278544-47 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:277: finishing rollback tid 1 to smithi01278544-38 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:274: finishing rollback tid 2 to smithi01278544-47 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 88 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:277: finishing rollback tid 2 to smithi01278544-38 2024-09-10T17:57:11.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 76 (ObjNum 83 snap 15 seq_num 83) dirty exists 2024-09-10T17:57:11.898 INFO:tasks.rados.rados.0.smithi012.stdout:276: finishing copy_from racing read to smithi01278544-34 2024-09-10T17:57:11.899 INFO:tasks.rados.rados.0.smithi012.stdout:276: finishing copy_from to smithi01278544-34 2024-09-10T17:57:11.899 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 11 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-09-10T17:57:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:11 smithi012 ceph-mon[27356]: osdmap e117: 8 total, 8 up, 8 in 2024-09-10T17:57:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:11 smithi012 ceph-mon[27356]: osdmap e118: 8 total, 8 up, 8 in 2024-09-10T17:57:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:11 smithi012 ceph-mon[37454]: osdmap e117: 8 total, 8 up, 8 in 2024-09-10T17:57:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:11 smithi012 ceph-mon[37454]: osdmap e118: 8 total, 8 up, 8 in 2024-09-10T17:57:12.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:11 smithi089 ceph-mon[31467]: osdmap e117: 8 total, 8 up, 8 in 2024-09-10T17:57:12.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:11 smithi089 ceph-mon[31467]: osdmap e118: 8 total, 8 up, 8 in 2024-09-10T17:57:12.805 INFO:tasks.rados.rados.0.smithi012.stdout:272: done (4 left) 2024-09-10T17:57:12.806 INFO:tasks.rados.rados.0.smithi012.stdout:274: done (3 left) 2024-09-10T17:57:12.806 INFO:tasks.rados.rados.0.smithi012.stdout:276: done (2 left) 2024-09-10T17:57:12.806 INFO:tasks.rados.rados.0.smithi012.stdout:277: done (1 left) 2024-09-10T17:57:12.806 INFO:tasks.rados.rados.0.smithi012.stdout:278: done (0 left) 2024-09-10T17:57:12.806 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 20 2024-09-10T17:57:12.806 INFO:tasks.rados.rados.0.smithi012.stdout:279: seq_num 104 ranges {4349952=548864,4898816=622592,5521408=581632} 2024-09-10T17:57:12.832 INFO:tasks.rados.rados.0.smithi012.stdout:279: writing smithi01278544-16 from 4349952 to 4898816 tid 1 2024-09-10T17:57:12.836 INFO:tasks.rados.rados.0.smithi012.stdout:279: writing smithi01278544-16 from 4898816 to 5521408 tid 2 2024-09-10T17:57:12.840 INFO:tasks.rados.rados.0.smithi012.stdout:279: writing smithi01278544-16 from 5521408 to 6103040 tid 3 2024-09-10T17:57:12.840 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 20 2024-09-10T17:57:12.840 INFO:tasks.rados.rados.0.smithi012.stdout:279: finishing write tid 1 to smithi01278544-16 2024-09-10T17:57:12.840 INFO:tasks.rados.rados.0.smithi012.stdout:279: finishing write tid 2 to smithi01278544-16 2024-09-10T17:57:12.840 INFO:tasks.rados.rados.0.smithi012.stdout:280: seq_num 105 ranges {761856=565248,1327104=507904,1835008=507904,2342912=188416} 2024-09-10T17:57:12.847 INFO:tasks.rados.rados.0.smithi012.stdout:280: writing smithi01278544-18 from 761856 to 1327104 tid 1 2024-09-10T17:57:12.850 INFO:tasks.rados.rados.0.smithi012.stdout:280: writing smithi01278544-18 from 1327104 to 1835008 tid 2 2024-09-10T17:57:12.853 INFO:tasks.rados.rados.0.smithi012.stdout:280: writing smithi01278544-18 from 1835008 to 2342912 tid 3 2024-09-10T17:57:12.854 INFO:tasks.rados.rados.0.smithi012.stdout:280: writing smithi01278544-18 from 2342912 to 2531328 tid 4 2024-09-10T17:57:12.854 INFO:tasks.rados.rados.0.smithi012.stdout:281: setattr oid 45 current snap is 20 2024-09-10T17:57:12.854 INFO:tasks.rados.rados.0.smithi012.stdout:279: finishing write tid 3 to smithi01278544-16 2024-09-10T17:57:12.854 INFO:tasks.rados.rados.0.smithi012.stdout:279: finishing write tid 4 to smithi01278544-16 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:279: finishing write tid 5 to smithi01278544-16 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:279: oid 16 updating version 0 to 41 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:279: oid 16 version 41 is already newer than 40 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:279: oid 16 updating version 41 to 43 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:279: oid 16 version 43 is already newer than 42 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 43 (ObjNum 104 snap 20 seq_num 104) dirty exists 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:279: left oid 16 (ObjNum 104 snap 20 seq_num 104) 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:280: finishing write tid 1 to smithi01278544-18 2024-09-10T17:57:12.855 INFO:tasks.rados.rados.0.smithi012.stdout:280: finishing write tid 2 to smithi01278544-18 2024-09-10T17:57:12.856 INFO:tasks.rados.rados.0.smithi012.stdout:279: done (2 left) 2024-09-10T17:57:12.856 INFO:tasks.rados.rados.0.smithi012.stdout:282: snap_remove snap 16 2024-09-10T17:57:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:12 smithi012 ceph-mon[27356]: pgmap v158: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:12 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:13.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:12 smithi012 ceph-mon[37454]: pgmap v158: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:13.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:12 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:13.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:12 smithi089 ceph-mon[31467]: pgmap v158: 121 pgs: 121 active+clean; 51 MiB data, 318 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:13.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:12 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:13.809 INFO:tasks.rados.rados.0.smithi012.stdout:282: done (2 left) 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:283: setattr oid 15 current snap is 20 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: finishing write tid 3 to smithi01278544-18 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: finishing write tid 4 to smithi01278544-18 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: finishing write tid 5 to smithi01278544-18 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: finishing write tid 6 to smithi01278544-18 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: oid 18 updating version 0 to 75 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: oid 18 updating version 75 to 76 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: oid 18 updating version 76 to 78 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: oid 18 updating version 78 to 79 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: oid 18 version 79 is already newer than 77 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 79 (ObjNum 105 snap 20 seq_num 105) dirty exists 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:280: left oid 18 (ObjNum 105 snap 20 seq_num 105) 2024-09-10T17:57:13.810 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 90 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-10T17:57:13.811 INFO:tasks.rados.rados.0.smithi012.stdout:280: done (2 left) 2024-09-10T17:57:13.811 INFO:tasks.rados.rados.0.smithi012.stdout:281: done (1 left) 2024-09-10T17:57:13.811 INFO:tasks.rados.rados.0.smithi012.stdout:284: snap_create 2024-09-10T17:57:13.816 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 80 (ObjNum 2241 snap 0 seq_num 3200229888) dirty exists 2024-09-10T17:57:14.186 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:13 smithi089 ceph-mon[31467]: osdmap e119: 8 total, 8 up, 8 in 2024-09-10T17:57:14.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:13 smithi012 ceph-mon[27356]: osdmap e119: 8 total, 8 up, 8 in 2024-09-10T17:57:14.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:57:13] "GET /metrics HTTP/1.1" 200 36004 "" "Prometheus/2.43.0" 2024-09-10T17:57:14.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:13 smithi012 ceph-mon[37454]: osdmap e119: 8 total, 8 up, 8 in 2024-09-10T17:57:14.821 INFO:tasks.rados.rados.0.smithi012.stdout:283: done (1 left) 2024-09-10T17:57:14.821 INFO:tasks.rados.rados.0.smithi012.stdout:284: done (0 left) 2024-09-10T17:57:14.821 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 21 2024-09-10T17:57:14.821 INFO:tasks.rados.rados.0.smithi012.stdout:285: seq_num 106 ranges {2482176=581632,3063808=794624,3858432=409600} 2024-09-10T17:57:14.837 INFO:tasks.rados.rados.0.smithi012.stdout:285: writing smithi01278544-33 from 2482176 to 3063808 tid 1 2024-09-10T17:57:14.842 INFO:tasks.rados.rados.0.smithi012.stdout:285: writing smithi01278544-33 from 3063808 to 3858432 tid 2 2024-09-10T17:57:14.845 INFO:tasks.rados.rados.0.smithi012.stdout:285: writing smithi01278544-33 from 3858432 to 4268032 tid 3 2024-09-10T17:57:14.845 INFO:tasks.rados.rados.0.smithi012.stdout:286: copy_from oid 18 from oid 13 current snap is 21 2024-09-10T17:57:14.845 INFO:tasks.rados.rados.0.smithi012.stdout:285: finishing write tid 1 to smithi01278544-33 2024-09-10T17:57:14.845 INFO:tasks.rados.rados.0.smithi012.stdout:287: snap_create 2024-09-10T17:57:14.847 INFO:tasks.rados.rados.0.smithi012.stdout:285: finishing write tid 2 to smithi01278544-33 2024-09-10T17:57:14.847 INFO:tasks.rados.rados.0.smithi012.stdout:285: finishing write tid 3 to smithi01278544-33 2024-09-10T17:57:14.847 INFO:tasks.rados.rados.0.smithi012.stdout:285: finishing write tid 4 to smithi01278544-33 2024-09-10T17:57:14.849 INFO:tasks.rados.rados.0.smithi012.stdout:285: finishing write tid 5 to smithi01278544-33 2024-09-10T17:57:14.849 INFO:tasks.rados.rados.0.smithi012.stdout:285: oid 33 updating version 0 to 102 2024-09-10T17:57:14.849 INFO:tasks.rados.rados.0.smithi012.stdout:285: oid 33 version 102 is already newer than 100 2024-09-10T17:57:14.849 INFO:tasks.rados.rados.0.smithi012.stdout:285: oid 33 version 102 is already newer than 101 2024-09-10T17:57:14.849 INFO:tasks.rados.rados.0.smithi012.stdout:285: oid 33 updating version 102 to 103 2024-09-10T17:57:14.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 103 (ObjNum 106 snap 21 seq_num 106) dirty exists 2024-09-10T17:57:14.849 INFO:tasks.rados.rados.0.smithi012.stdout:285: left oid 33 (ObjNum 106 snap 21 seq_num 106) 2024-09-10T17:57:14.858 INFO:tasks.rados.rados.0.smithi012.stdout:286: finishing copy_from racing read to smithi01278544-18 2024-09-10T17:57:14.858 INFO:tasks.rados.rados.0.smithi012.stdout:286: finishing copy_from to smithi01278544-18 2024-09-10T17:57:14.859 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 65 (ObjNum 70 snap 10 seq_num 70) dirty exists 2024-09-10T17:57:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:14 smithi012 ceph-mon[27356]: osdmap e120: 8 total, 8 up, 8 in 2024-09-10T17:57:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:14 smithi012 ceph-mon[27356]: pgmap v161: 121 pgs: 121 active+clean; 67 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 23 op/s 2024-09-10T17:57:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:14 smithi012 ceph-mon[37454]: osdmap e120: 8 total, 8 up, 8 in 2024-09-10T17:57:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:14 smithi012 ceph-mon[37454]: pgmap v161: 121 pgs: 121 active+clean; 67 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 23 op/s 2024-09-10T17:57:15.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:14 smithi089 ceph-mon[31467]: osdmap e120: 8 total, 8 up, 8 in 2024-09-10T17:57:15.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:14 smithi089 ceph-mon[31467]: pgmap v161: 121 pgs: 121 active+clean; 67 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 23 op/s 2024-09-10T17:57:15.823 INFO:tasks.rados.rados.0.smithi012.stdout:285: done (2 left) 2024-09-10T17:57:15.824 INFO:tasks.rados.rados.0.smithi012.stdout:286: done (1 left) 2024-09-10T17:57:15.824 INFO:tasks.rados.rados.0.smithi012.stdout:287: done (0 left) 2024-09-10T17:57:15.824 INFO:tasks.rados.rados.0.smithi012.stdout:288: snap_create 2024-09-10T17:57:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:15 smithi012 ceph-mon[27356]: osdmap e121: 8 total, 8 up, 8 in 2024-09-10T17:57:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:15 smithi012 ceph-mon[37454]: osdmap e121: 8 total, 8 up, 8 in 2024-09-10T17:57:16.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:15 smithi089 ceph-mon[31467]: osdmap e121: 8 total, 8 up, 8 in 2024-09-10T17:57:16.777 INFO:tasks.rados.rados.0.smithi012.stdout:288: done (0 left) 2024-09-10T17:57:16.777 INFO:tasks.rados.rados.0.smithi012.stdout:289: read oid 15 snap -1 2024-09-10T17:57:16.777 INFO:tasks.rados.rados.0.smithi012.stdout:289: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:57:16.777 INFO:tasks.rados.rados.0.smithi012.stdout:290: snap_create 2024-09-10T17:57:16.779 INFO:tasks.rados.rados.0.smithi012.stdout:289: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:57:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:16 smithi012 ceph-mon[27356]: osdmap e122: 8 total, 8 up, 8 in 2024-09-10T17:57:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:16 smithi012 ceph-mon[27356]: pgmap v164: 121 pgs: 121 active+clean; 67 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 23 op/s 2024-09-10T17:57:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:16 smithi012 ceph-mon[27356]: osdmap e123: 8 total, 8 up, 8 in 2024-09-10T17:57:17.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:16 smithi012 ceph-mon[37454]: osdmap e122: 8 total, 8 up, 8 in 2024-09-10T17:57:17.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:16 smithi012 ceph-mon[37454]: pgmap v164: 121 pgs: 121 active+clean; 67 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 23 op/s 2024-09-10T17:57:17.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:16 smithi012 ceph-mon[37454]: osdmap e123: 8 total, 8 up, 8 in 2024-09-10T17:57:17.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:16 smithi089 ceph-mon[31467]: osdmap e122: 8 total, 8 up, 8 in 2024-09-10T17:57:17.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:16 smithi089 ceph-mon[31467]: pgmap v164: 121 pgs: 121 active+clean; 67 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 23 op/s 2024-09-10T17:57:17.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:16 smithi089 ceph-mon[31467]: osdmap e123: 8 total, 8 up, 8 in 2024-09-10T17:57:17.778 INFO:tasks.rados.rados.0.smithi012.stdout:289: done (1 left) 2024-09-10T17:57:17.778 INFO:tasks.rados.rados.0.smithi012.stdout:290: done (0 left) 2024-09-10T17:57:17.778 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 24 2024-09-10T17:57:17.778 INFO:tasks.rados.rados.0.smithi012.stdout:291: seq_num 107 ranges {1269760=598016,1867776=729088,2596864=466944,3063808=8192} 2024-09-10T17:57:17.787 INFO:tasks.rados.rados.0.smithi012.stdout:291: writing smithi01278544-23 from 1269760 to 1867776 tid 1 2024-09-10T17:57:17.792 INFO:tasks.rados.rados.0.smithi012.stdout:291: writing smithi01278544-23 from 1867776 to 2596864 tid 2 2024-09-10T17:57:17.795 INFO:tasks.rados.rados.0.smithi012.stdout:291: writing smithi01278544-23 from 2596864 to 3063808 tid 3 2024-09-10T17:57:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:291: writing smithi01278544-23 from 3063808 to 3072000 tid 4 2024-09-10T17:57:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:292: rollback oid 9 current snap is 24 2024-09-10T17:57:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 22 2024-09-10T17:57:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:291: finishing write tid 1 to smithi01278544-23 2024-09-10T17:57:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:293: snap_remove snap 21 2024-09-10T17:57:18.790 INFO:tasks.rados.rados.0.smithi012.stdout:293: done (2 left) 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:294: rollback oid 25 current snap is 24 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 25 to 23 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:291: finishing write tid 2 to smithi01278544-23 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:292: finishing rollback tid 0 to smithi01278544-9 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:292: finishing rollback tid 1 to smithi01278544-9 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:291: finishing write tid 3 to smithi01278544-23 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:292: finishing rollback tid 2 to smithi01278544-9 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 84 (ObjNum 81 snap 15 seq_num 81) dirty exists 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:291: finishing write tid 4 to smithi01278544-23 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:291: finishing write tid 5 to smithi01278544-23 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:291: finishing write tid 6 to smithi01278544-23 2024-09-10T17:57:18.791 INFO:tasks.rados.rados.0.smithi012.stdout:291: oid 23 updating version 0 to 95 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:291: oid 23 version 95 is already newer than 94 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:291: oid 23 updating version 95 to 96 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:291: oid 23 version 96 is already newer than 92 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:291: oid 23 version 96 is already newer than 93 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 96 (ObjNum 107 snap 24 seq_num 107) dirty exists 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:291: left oid 23 (ObjNum 107 snap 24 seq_num 107) 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:291: done (2 left) 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:292: done (1 left) 2024-09-10T17:57:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:295: snap_create 2024-09-10T17:57:18.795 INFO:tasks.rados.rados.0.smithi012.stdout:294: finishing rollback tid 0 to smithi01278544-25 2024-09-10T17:57:18.796 INFO:tasks.rados.rados.0.smithi012.stdout:294: finishing rollback tid 1 to smithi01278544-25 2024-09-10T17:57:18.796 INFO:tasks.rados.rados.0.smithi012.stdout:294: finishing rollback tid 2 to smithi01278544-25 2024-09-10T17:57:18.796 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 78 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-10T17:57:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:18 smithi012 ceph-mon[27356]: osdmap e124: 8 total, 8 up, 8 in 2024-09-10T17:57:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:18 smithi012 ceph-mon[27356]: pgmap v167: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-10T17:57:19.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:18 smithi012 ceph-mon[37454]: osdmap e124: 8 total, 8 up, 8 in 2024-09-10T17:57:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:18 smithi012 ceph-mon[37454]: pgmap v167: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-10T17:57:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:18 smithi089 ceph-mon[31467]: osdmap e124: 8 total, 8 up, 8 in 2024-09-10T17:57:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:18 smithi089 ceph-mon[31467]: pgmap v167: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-10T17:57:19.790 INFO:tasks.rados.rados.0.smithi012.stdout:294: done (1 left) 2024-09-10T17:57:19.790 INFO:tasks.rados.rados.0.smithi012.stdout:295: done (0 left) 2024-09-10T17:57:19.790 INFO:tasks.rados.rados.0.smithi012.stdout:296: read oid 23 snap -1 2024-09-10T17:57:19.790 INFO:tasks.rados.rados.0.smithi012.stdout:296: expect (ObjNum 107 snap 24 seq_num 107) 2024-09-10T17:57:19.790 INFO:tasks.rados.rados.0.smithi012.stdout:297: delete oid 34 current snap is 25 2024-09-10T17:57:19.812 INFO:tasks.rados.rados.0.smithi012.stdout:296: expect (ObjNum 107 snap 24 seq_num 107) 2024-09-10T17:57:19.921 INFO:tasks.rados.rados.0.smithi012.stdout:296: done (1 left) 2024-09-10T17:57:19.922 INFO:tasks.rados.rados.0.smithi012.stdout:297: done (0 left) 2024-09-10T17:57:19.922 INFO:tasks.rados.rados.0.smithi012.stdout:298: delete oid 43 current snap is 25 2024-09-10T17:57:19.924 INFO:tasks.rados.rados.0.smithi012.stdout:298: done (0 left) 2024-09-10T17:57:19.925 INFO:tasks.rados.rados.0.smithi012.stdout:299: read oid 29 snap -1 2024-09-10T17:57:19.925 INFO:tasks.rados.rados.0.smithi012.stdout:299: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:19.925 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 25 2024-09-10T17:57:19.925 INFO:tasks.rados.rados.0.smithi012.stdout:300: seq_num 110 ranges {0=647168,647168=778240,1425408=425984} 2024-09-10T17:57:19.928 INFO:tasks.rados.rados.0.smithi012.stdout:300: writing smithi01278544-41 from 0 to 647168 tid 1 2024-09-10T17:57:19.932 INFO:tasks.rados.rados.0.smithi012.stdout:300: writing smithi01278544-41 from 647168 to 1425408 tid 2 2024-09-10T17:57:19.935 INFO:tasks.rados.rados.0.smithi012.stdout:300: writing smithi01278544-41 from 1425408 to 1851392 tid 3 2024-09-10T17:57:19.935 INFO:tasks.rados.rados.0.smithi012.stdout:301: read oid 27 snap -1 2024-09-10T17:57:19.935 INFO:tasks.rados.rados.0.smithi012.stdout:301: expect (ObjNum 50 snap 0 seq_num 50) 2024-09-10T17:57:19.935 INFO:tasks.rados.rados.0.smithi012.stdout:302: rollback oid 43 current snap is 25 2024-09-10T17:57:19.935 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 43 to 22 2024-09-10T17:57:19.935 INFO:tasks.rados.rados.0.smithi012.stdout:299: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:300: finishing write tid 1 to smithi01278544-41 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:300: finishing write tid 2 to smithi01278544-41 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:302: finishing rollback tid 1 to smithi01278544-43 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:302: finishing rollback tid 2 to smithi01278544-43 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 107 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:299: done (3 left) 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:302: done (2 left) 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:303: read oid 48 snap -1 2024-09-10T17:57:19.959 INFO:tasks.rados.rados.0.smithi012.stdout:303: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:300: finishing write tid 3 to smithi01278544-41 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:300: finishing write tid 4 to smithi01278544-41 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:304: read oid 36 snap -1 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:304: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:305: copy_from oid 13 from oid 40 current snap is 25 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:300: finishing write tid 5 to smithi01278544-41 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:300: oid 41 updating version 0 to 88 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:300: oid 41 updating version 88 to 89 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:300: oid 41 updating version 89 to 90 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:300: oid 41 version 90 is already newer than 87 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 90 (ObjNum 110 snap 25 seq_num 110) dirty exists 2024-09-10T17:57:19.960 INFO:tasks.rados.rados.0.smithi012.stdout:300: left oid 41 (ObjNum 110 snap 25 seq_num 110) 2024-09-10T17:57:19.961 INFO:tasks.rados.rados.0.smithi012.stdout:301: expect (ObjNum 50 snap 0 seq_num 50) 2024-09-10T17:57:20.002 INFO:tasks.rados.rados.0.smithi012.stdout:304: expect (ObjNum 10 snap 0 seq_num 10) 2024-09-10T17:57:20.007 INFO:tasks.rados.rados.0.smithi012.stdout:303: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:20.033 INFO:tasks.rados.rados.0.smithi012.stdout:305: finishing copy_from racing read to smithi01278544-13 2024-09-10T17:57:20.033 INFO:tasks.rados.rados.0.smithi012.stdout:305: finishing copy_from to smithi01278544-13 2024-09-10T17:57:20.033 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 74 (ObjNum 101 snap 19 seq_num 101) dirty exists 2024-09-10T17:57:20.033 INFO:tasks.rados.rados.0.smithi012.stdout:300: done (4 left) 2024-09-10T17:57:20.033 INFO:tasks.rados.rados.0.smithi012.stdout:301: done (3 left) 2024-09-10T17:57:20.033 INFO:tasks.rados.rados.0.smithi012.stdout:303: done (2 left) 2024-09-10T17:57:20.034 INFO:tasks.rados.rados.0.smithi012.stdout:304: done (1 left) 2024-09-10T17:57:20.034 INFO:tasks.rados.rados.0.smithi012.stdout:305: done (0 left) 2024-09-10T17:57:20.034 INFO:tasks.rados.rados.0.smithi012.stdout:306: read oid 44 snap -1 2024-09-10T17:57:20.034 INFO:tasks.rados.rados.0.smithi012.stdout:306: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:20.034 INFO:tasks.rados.rados.0.smithi012.stdout:307: copy_from oid 32 from oid 37 current snap is 25 2024-09-10T17:57:20.034 INFO:tasks.rados.rados.0.smithi012.stdout:308: snap_create 2024-09-10T17:57:20.044 INFO:tasks.rados.rados.0.smithi012.stdout:306: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:20.136 INFO:tasks.rados.rados.0.smithi012.stdout:307: finishing copy_from racing read to smithi01278544-32 2024-09-10T17:57:20.136 INFO:tasks.rados.rados.0.smithi012.stdout:307: finishing copy_from to smithi01278544-32 2024-09-10T17:57:20.136 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 86 (ObjNum 96 snap 16 seq_num 96) dirty exists 2024-09-10T17:57:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:19 smithi012 ceph-mon[27356]: osdmap e125: 8 total, 8 up, 8 in 2024-09-10T17:57:20.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:19 smithi012 ceph-mon[37454]: osdmap e125: 8 total, 8 up, 8 in 2024-09-10T17:57:20.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:19 smithi089 ceph-mon[31467]: osdmap e125: 8 total, 8 up, 8 in 2024-09-10T17:57:20.802 INFO:tasks.rados.rados.0.smithi012.stdout:306: done (2 left) 2024-09-10T17:57:20.803 INFO:tasks.rados.rados.0.smithi012.stdout:307: done (1 left) 2024-09-10T17:57:20.803 INFO:tasks.rados.rados.0.smithi012.stdout:308: done (0 left) 2024-09-10T17:57:20.803 INFO:tasks.rados.rados.0.smithi012.stdout:309: delete oid 32 current snap is 26 2024-09-10T17:57:20.805 INFO:tasks.rados.rados.0.smithi012.stdout:309: done (0 left) 2024-09-10T17:57:20.805 INFO:tasks.rados.rados.0.smithi012.stdout:310: delete oid 20 current snap is 26 2024-09-10T17:57:20.807 INFO:tasks.rados.rados.0.smithi012.stdout:310: done (0 left) 2024-09-10T17:57:20.807 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 26 2024-09-10T17:57:20.807 INFO:tasks.rados.rados.0.smithi012.stdout:311: seq_num 113 ranges {638976=696320,1335296=434176,1769472=466944,2236416=303104} 2024-09-10T17:57:20.814 INFO:tasks.rados.rados.0.smithi012.stdout:311: writing smithi01278544-42 from 638976 to 1335296 tid 1 2024-09-10T17:57:20.817 INFO:tasks.rados.rados.0.smithi012.stdout:311: writing smithi01278544-42 from 1335296 to 1769472 tid 2 2024-09-10T17:57:20.820 INFO:tasks.rados.rados.0.smithi012.stdout:311: writing smithi01278544-42 from 1769472 to 2236416 tid 3 2024-09-10T17:57:20.822 INFO:tasks.rados.rados.0.smithi012.stdout:311: writing smithi01278544-42 from 2236416 to 2539520 tid 4 2024-09-10T17:57:20.822 INFO:tasks.rados.rados.0.smithi012.stdout:312: snap_create 2024-09-10T17:57:20.822 INFO:tasks.rados.rados.0.smithi012.stdout:311: finishing write tid 1 to smithi01278544-42 2024-09-10T17:57:20.822 INFO:tasks.rados.rados.0.smithi012.stdout:311: finishing write tid 2 to smithi01278544-42 2024-09-10T17:57:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:311: finishing write tid 3 to smithi01278544-42 2024-09-10T17:57:20.824 INFO:tasks.rados.rados.0.smithi012.stdout:311: finishing write tid 4 to smithi01278544-42 2024-09-10T17:57:20.825 INFO:tasks.rados.rados.0.smithi012.stdout:311: finishing write tid 5 to smithi01278544-42 2024-09-10T17:57:20.826 INFO:tasks.rados.rados.0.smithi012.stdout:311: finishing write tid 6 to smithi01278544-42 2024-09-10T17:57:20.826 INFO:tasks.rados.rados.0.smithi012.stdout:311: oid 42 updating version 0 to 109 2024-09-10T17:57:20.826 INFO:tasks.rados.rados.0.smithi012.stdout:311: oid 42 updating version 109 to 111 2024-09-10T17:57:20.826 INFO:tasks.rados.rados.0.smithi012.stdout:311: oid 42 version 111 is already newer than 110 2024-09-10T17:57:20.826 INFO:tasks.rados.rados.0.smithi012.stdout:311: oid 42 updating version 111 to 113 2024-09-10T17:57:20.826 INFO:tasks.rados.rados.0.smithi012.stdout:311: oid 42 version 113 is already newer than 112 2024-09-10T17:57:20.826 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 113 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-09-10T17:57:20.826 INFO:tasks.rados.rados.0.smithi012.stdout:311: left oid 42 (ObjNum 113 snap 26 seq_num 113) 2024-09-10T17:57:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:20 smithi012 ceph-mon[27356]: osdmap e126: 8 total, 8 up, 8 in 2024-09-10T17:57:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:20 smithi012 ceph-mon[27356]: pgmap v170: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-10T17:57:21.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:20 smithi012 ceph-mon[37454]: osdmap e126: 8 total, 8 up, 8 in 2024-09-10T17:57:21.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:20 smithi012 ceph-mon[37454]: pgmap v170: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-10T17:57:21.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:20 smithi089 ceph-mon[31467]: osdmap e126: 8 total, 8 up, 8 in 2024-09-10T17:57:21.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:20 smithi089 ceph-mon[31467]: pgmap v170: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-10T17:57:21.779 INFO:tasks.rados.rados.0.smithi012.stdout:311: done (1 left) 2024-09-10T17:57:21.779 INFO:tasks.rados.rados.0.smithi012.stdout:312: done (0 left) 2024-09-10T17:57:21.779 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 27 2024-09-10T17:57:21.779 INFO:tasks.rados.rados.0.smithi012.stdout:313: seq_num 114 ranges {0=712704,712704=712704,1425408=491520} 2024-09-10T17:57:21.783 INFO:tasks.rados.rados.0.smithi012.stdout:313: writing smithi01278544-5 from 0 to 712704 tid 1 2024-09-10T17:57:21.787 INFO:tasks.rados.rados.0.smithi012.stdout:313: writing smithi01278544-5 from 712704 to 1425408 tid 2 2024-09-10T17:57:21.790 INFO:tasks.rados.rados.0.smithi012.stdout:313: writing smithi01278544-5 from 1425408 to 1916928 tid 3 2024-09-10T17:57:21.790 INFO:tasks.rados.rados.0.smithi012.stdout:314: rollback oid 31 current snap is 27 2024-09-10T17:57:21.790 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 25 2024-09-10T17:57:21.791 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 27 2024-09-10T17:57:21.791 INFO:tasks.rados.rados.0.smithi012.stdout:315: seq_num 115 ranges {1736704=729088,2465792=647168,3112960=434176,3547136=122880} 2024-09-10T17:57:21.804 INFO:tasks.rados.rados.0.smithi012.stdout:315: writing smithi01278544-49 from 1736704 to 2465792 tid 1 2024-09-10T17:57:21.807 INFO:tasks.rados.rados.0.smithi012.stdout:315: writing smithi01278544-49 from 2465792 to 3112960 tid 2 2024-09-10T17:57:21.810 INFO:tasks.rados.rados.0.smithi012.stdout:315: writing smithi01278544-49 from 3112960 to 3547136 tid 3 2024-09-10T17:57:21.811 INFO:tasks.rados.rados.0.smithi012.stdout:315: writing smithi01278544-49 from 3547136 to 3670016 tid 4 2024-09-10T17:57:21.811 INFO:tasks.rados.rados.0.smithi012.stdout:316: rmattr oid 41 current snap is 27 2024-09-10T17:57:21.811 INFO:tasks.rados.rados.0.smithi012.stdout:316: done (3 left) 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:317: read oid 7 snap -1 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:317: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:318: snap_create 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:314: finishing rollback tid 1 to smithi01278544-31 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 0 (ObjNum 33 snap 0 seq_num 3491042552) dirty dne 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:313: finishing write tid 1 to smithi01278544-5 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:313: finishing write tid 2 to smithi01278544-5 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:313: finishing write tid 3 to smithi01278544-5 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:313: finishing write tid 4 to smithi01278544-5 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:313: finishing write tid 5 to smithi01278544-5 2024-09-10T17:57:21.812 INFO:tasks.rados.rados.0.smithi012.stdout:313: oid 5 updating version 0 to 29 2024-09-10T17:57:21.813 INFO:tasks.rados.rados.0.smithi012.stdout:313: oid 5 version 29 is already newer than 28 2024-09-10T17:57:21.813 INFO:tasks.rados.rados.0.smithi012.stdout:313: oid 5 updating version 29 to 30 2024-09-10T17:57:21.813 INFO:tasks.rados.rados.0.smithi012.stdout:313: oid 5 version 30 is already newer than 27 2024-09-10T17:57:21.813 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 30 (ObjNum 114 snap 27 seq_num 114) dirty exists 2024-09-10T17:57:21.813 INFO:tasks.rados.rados.0.smithi012.stdout:313: left oid 5 (ObjNum 114 snap 27 seq_num 114) 2024-09-10T17:57:21.813 INFO:tasks.rados.rados.0.smithi012.stdout:315: finishing write tid 1 to smithi01278544-49 2024-09-10T17:57:21.813 INFO:tasks.rados.rados.0.smithi012.stdout:315: finishing write tid 2 to smithi01278544-49 2024-09-10T17:57:21.814 INFO:tasks.rados.rados.0.smithi012.stdout:315: finishing write tid 3 to smithi01278544-49 2024-09-10T17:57:21.814 INFO:tasks.rados.rados.0.smithi012.stdout:315: finishing write tid 4 to smithi01278544-49 2024-09-10T17:57:21.814 INFO:tasks.rados.rados.0.smithi012.stdout:315: finishing write tid 5 to smithi01278544-49 2024-09-10T17:57:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:315: finishing write tid 6 to smithi01278544-49 2024-09-10T17:57:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:315: oid 49 updating version 0 to 92 2024-09-10T17:57:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:315: oid 49 version 92 is already newer than 90 2024-09-10T17:57:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:315: oid 49 version 92 is already newer than 91 2024-09-10T17:57:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:315: oid 49 version 92 is already newer than 88 2024-09-10T17:57:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:315: oid 49 version 92 is already newer than 89 2024-09-10T17:57:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 92 (ObjNum 115 snap 27 seq_num 115) dirty exists 2024-09-10T17:57:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:315: left oid 49 (ObjNum 115 snap 27 seq_num 115) 2024-09-10T17:57:21.816 INFO:tasks.rados.rados.0.smithi012.stdout:317: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-10T17:57:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:21 smithi012 ceph-mon[27356]: osdmap e127: 8 total, 8 up, 8 in 2024-09-10T17:57:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:21 smithi012 ceph-mon[27356]: osdmap e128: 8 total, 8 up, 8 in 2024-09-10T17:57:22.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:21 smithi012 ceph-mon[37454]: osdmap e127: 8 total, 8 up, 8 in 2024-09-10T17:57:22.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:21 smithi012 ceph-mon[37454]: osdmap e128: 8 total, 8 up, 8 in 2024-09-10T17:57:22.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:21 smithi089 ceph-mon[31467]: osdmap e127: 8 total, 8 up, 8 in 2024-09-10T17:57:22.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:21 smithi089 ceph-mon[31467]: osdmap e128: 8 total, 8 up, 8 in 2024-09-10T17:57:22.812 INFO:tasks.rados.rados.0.smithi012.stdout:313: done (4 left) 2024-09-10T17:57:22.813 INFO:tasks.rados.rados.0.smithi012.stdout:314: done (3 left) 2024-09-10T17:57:22.813 INFO:tasks.rados.rados.0.smithi012.stdout:315: done (2 left) 2024-09-10T17:57:22.813 INFO:tasks.rados.rados.0.smithi012.stdout:317: done (1 left) 2024-09-10T17:57:22.813 INFO:tasks.rados.rados.0.smithi012.stdout:318: done (0 left) 2024-09-10T17:57:22.813 INFO:tasks.rados.rados.0.smithi012.stdout:319: delete oid 49 current snap is 28 2024-09-10T17:57:22.816 INFO:tasks.rados.rados.0.smithi012.stdout:319: done (0 left) 2024-09-10T17:57:22.816 INFO:tasks.rados.rados.0.smithi012.stdout:320: rollback oid 18 current snap is 28 2024-09-10T17:57:22.816 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 26 2024-09-10T17:57:22.816 INFO:tasks.rados.rados.0.smithi012.stdout:321: snap_create 2024-09-10T17:57:22.818 INFO:tasks.rados.rados.0.smithi012.stdout:320: finishing rollback tid 0 to smithi01278544-18 2024-09-10T17:57:22.819 INFO:tasks.rados.rados.0.smithi012.stdout:320: finishing rollback tid 1 to smithi01278544-18 2024-09-10T17:57:22.819 INFO:tasks.rados.rados.0.smithi012.stdout:320: finishing rollback tid 2 to smithi01278544-18 2024-09-10T17:57:22.819 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 98 (ObjNum 70 snap 10 seq_num 70) dirty exists 2024-09-10T17:57:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:22 smithi012 ceph-mon[27356]: pgmap v173: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:23.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:22 smithi012 ceph-mon[37454]: pgmap v173: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:23.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:22 smithi089 ceph-mon[31467]: pgmap v173: 121 pgs: 121 active+clean; 72 MiB data, 363 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:23.814 INFO:tasks.rados.rados.0.smithi012.stdout:320: done (1 left) 2024-09-10T17:57:23.814 INFO:tasks.rados.rados.0.smithi012.stdout:321: done (0 left) 2024-09-10T17:57:23.814 INFO:tasks.rados.rados.0.smithi012.stdout:322: rollback oid 41 current snap is 29 2024-09-10T17:57:23.814 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 27 2024-09-10T17:57:23.815 INFO:tasks.rados.rados.0.smithi012.stdout:323: rollback oid 18 current snap is 29 2024-09-10T17:57:23.815 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 22 2024-09-10T17:57:23.815 INFO:tasks.rados.rados.0.smithi012.stdout:324: rmattr oid 23 current snap is 29 2024-09-10T17:57:23.815 INFO:tasks.rados.rados.0.smithi012.stdout:325: copy_from oid 13 from oid 37 current snap is 29 2024-09-10T17:57:23.815 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 29 2024-09-10T17:57:23.815 INFO:tasks.rados.rados.0.smithi012.stdout:326: seq_num 117 ranges {172032=770048,942080=417792,1359872=442368,1802240=344064} 2024-09-10T17:57:23.819 INFO:tasks.rados.rados.0.smithi012.stdout:326: writing smithi01278544-36 from 172032 to 942080 tid 1 2024-09-10T17:57:23.821 INFO:tasks.rados.rados.0.smithi012.stdout:326: writing smithi01278544-36 from 942080 to 1359872 tid 2 2024-09-10T17:57:23.824 INFO:tasks.rados.rados.0.smithi012.stdout:326: writing smithi01278544-36 from 1359872 to 1802240 tid 3 2024-09-10T17:57:23.827 INFO:tasks.rados.rados.0.smithi012.stdout:326: writing smithi01278544-36 from 1802240 to 2146304 tid 4 2024-09-10T17:57:23.827 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 29 2024-09-10T17:57:23.827 INFO:tasks.rados.rados.0.smithi012.stdout:323: finishing rollback tid 0 to smithi01278544-18 2024-09-10T17:57:23.827 INFO:tasks.rados.rados.0.smithi012.stdout:323: finishing rollback tid 1 to smithi01278544-18 2024-09-10T17:57:23.827 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 102 (ObjNum 107 snap 24 seq_num 107) dirty exists 2024-09-10T17:57:23.827 INFO:tasks.rados.rados.0.smithi012.stdout:323: finishing rollback tid 2 to smithi01278544-18 2024-09-10T17:57:23.827 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 102 (ObjNum 70 snap 10 seq_num 70) dirty exists 2024-09-10T17:57:23.827 INFO:tasks.rados.rados.0.smithi012.stdout:326: finishing write tid 1 to smithi01278544-36 2024-09-10T17:57:23.828 INFO:tasks.rados.rados.0.smithi012.stdout:322: finishing rollback tid 0 to smithi01278544-41 2024-09-10T17:57:23.828 INFO:tasks.rados.rados.0.smithi012.stdout:322: finishing rollback tid 1 to smithi01278544-41 2024-09-10T17:57:23.828 INFO:tasks.rados.rados.0.smithi012.stdout:326: finishing write tid 2 to smithi01278544-36 2024-09-10T17:57:23.828 INFO:tasks.rados.rados.0.smithi012.stdout:322: finishing rollback tid 2 to smithi01278544-41 2024-09-10T17:57:23.828 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 96 (ObjNum 110 snap 25 seq_num 110) dirty exists 2024-09-10T17:57:23.828 INFO:tasks.rados.rados.0.smithi012.stdout:326: finishing write tid 3 to smithi01278544-36 2024-09-10T17:57:23.828 INFO:tasks.rados.rados.0.smithi012.stdout:327: seq_num 118 ranges {0=786432,786432=704512,1490944=499712} 2024-09-10T17:57:23.831 INFO:tasks.rados.rados.0.smithi012.stdout:327: writing smithi01278544-31 from 0 to 786432 tid 1 2024-09-10T17:57:23.836 INFO:tasks.rados.rados.0.smithi012.stdout:327: writing smithi01278544-31 from 786432 to 1490944 tid 2 2024-09-10T17:57:23.839 INFO:tasks.rados.rados.0.smithi012.stdout:327: writing smithi01278544-31 from 1490944 to 1990656 tid 3 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:322: done (5 left) 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:323: done (4 left) 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:324: done (3 left) 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:328: setattr oid 16 current snap is 29 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:326: finishing write tid 4 to smithi01278544-36 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:326: finishing write tid 5 to smithi01278544-36 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:326: finishing write tid 6 to smithi01278544-36 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:326: oid 36 updating version 0 to 50 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:326: oid 36 updating version 50 to 54 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:326: oid 36 version 54 is already newer than 52 2024-09-10T17:57:23.840 INFO:tasks.rados.rados.0.smithi012.stdout:326: oid 36 version 54 is already newer than 53 2024-09-10T17:57:23.841 INFO:tasks.rados.rados.0.smithi012.stdout:326: oid 36 version 54 is already newer than 51 2024-09-10T17:57:23.841 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 54 (ObjNum 117 snap 29 seq_num 117) dirty exists 2024-09-10T17:57:23.841 INFO:tasks.rados.rados.0.smithi012.stdout:326: left oid 36 (ObjNum 117 snap 29 seq_num 117) 2024-09-10T17:57:23.841 INFO:tasks.rados.rados.0.smithi012.stdout:325: finishing copy_from racing read to smithi01278544-13 2024-09-10T17:57:23.841 INFO:tasks.rados.rados.0.smithi012.stdout:325: finishing copy_from to smithi01278544-13 2024-09-10T17:57:23.841 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 86 (ObjNum 96 snap 16 seq_num 96) dirty exists 2024-09-10T17:57:23.841 INFO:tasks.rados.rados.0.smithi012.stdout:327: finishing write tid 1 to smithi01278544-31 2024-09-10T17:57:23.841 INFO:tasks.rados.rados.0.smithi012.stdout:327: finishing write tid 2 to smithi01278544-31 2024-09-10T17:57:23.842 INFO:tasks.rados.rados.0.smithi012.stdout:325: done (3 left) 2024-09-10T17:57:23.842 INFO:tasks.rados.rados.0.smithi012.stdout:326: done (2 left) 2024-09-10T17:57:23.842 INFO:tasks.rados.rados.0.smithi012.stdout:329: snap_create 2024-09-10T17:57:23.842 INFO:tasks.rados.rados.0.smithi012.stdout:327: finishing write tid 3 to smithi01278544-31 2024-09-10T17:57:23.842 INFO:tasks.rados.rados.0.smithi012.stdout:327: finishing write tid 4 to smithi01278544-31 2024-09-10T17:57:23.843 INFO:tasks.rados.rados.0.smithi012.stdout:327: finishing write tid 5 to smithi01278544-31 2024-09-10T17:57:23.843 INFO:tasks.rados.rados.0.smithi012.stdout:327: oid 31 updating version 0 to 100 2024-09-10T17:57:23.843 INFO:tasks.rados.rados.0.smithi012.stdout:327: oid 31 updating version 100 to 101 2024-09-10T17:57:23.843 INFO:tasks.rados.rados.0.smithi012.stdout:327: oid 31 version 101 is already newer than 99 2024-09-10T17:57:23.844 INFO:tasks.rados.rados.0.smithi012.stdout:327: oid 31 updating version 101 to 102 2024-09-10T17:57:23.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 102 (ObjNum 118 snap 29 seq_num 118) dirty exists 2024-09-10T17:57:23.844 INFO:tasks.rados.rados.0.smithi012.stdout:327: left oid 31 (ObjNum 118 snap 29 seq_num 118) 2024-09-10T17:57:23.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 47 (ObjNum 104 snap 20 seq_num 104) dirty exists 2024-09-10T17:57:24.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:23 smithi012 ceph-mon[37454]: osdmap e129: 8 total, 8 up, 8 in 2024-09-10T17:57:24.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:23 smithi012 ceph-mon[27356]: osdmap e129: 8 total, 8 up, 8 in 2024-09-10T17:57:24.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:57:23] "GET /metrics HTTP/1.1" 200 36004 "" "Prometheus/2.43.0" 2024-09-10T17:57:24.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:23 smithi089 ceph-mon[31467]: osdmap e129: 8 total, 8 up, 8 in 2024-09-10T17:57:24.828 INFO:tasks.rados.rados.0.smithi012.stdout:327: done (2 left) 2024-09-10T17:57:24.828 INFO:tasks.rados.rados.0.smithi012.stdout:328: done (1 left) 2024-09-10T17:57:24.828 INFO:tasks.rados.rados.0.smithi012.stdout:329: done (0 left) 2024-09-10T17:57:24.828 INFO:tasks.rados.rados.0.smithi012.stdout:330: copy_from oid 34 from oid 46 current snap is 30 2024-09-10T17:57:24.828 INFO:tasks.rados.rados.0.smithi012.stdout:331: snap_remove snap 29 2024-09-10T17:57:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:24 smithi012 ceph-mon[27356]: osdmap e130: 8 total, 8 up, 8 in 2024-09-10T17:57:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:24 smithi012 ceph-mon[27356]: pgmap v176: 121 pgs: 121 active+clean; 84 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2024-09-10T17:57:25.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:24 smithi012 ceph-mon[37454]: osdmap e130: 8 total, 8 up, 8 in 2024-09-10T17:57:25.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:24 smithi012 ceph-mon[37454]: pgmap v176: 121 pgs: 121 active+clean; 84 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2024-09-10T17:57:25.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:24 smithi089 ceph-mon[31467]: osdmap e130: 8 total, 8 up, 8 in 2024-09-10T17:57:25.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:24 smithi089 ceph-mon[31467]: pgmap v176: 121 pgs: 121 active+clean; 84 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2024-09-10T17:57:25.836 INFO:tasks.rados.rados.0.smithi012.stdout:331: done (1 left) 2024-09-10T17:57:25.836 INFO:tasks.rados.rados.0.smithi012.stdout:332: rollback oid 45 current snap is 30 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 45 to 22 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:330: finishing copy_from racing read to smithi01278544-34 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:330: finishing copy_from to smithi01278544-34 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 17 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:330: done (1 left) 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:333: read oid 28 snap -1 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:333: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:334: read oid 36 snap -1 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:334: expect (ObjNum 117 snap 29 seq_num 117) 2024-09-10T17:57:25.837 INFO:tasks.rados.rados.0.smithi012.stdout:335: delete oid 12 current snap is 30 2024-09-10T17:57:25.840 INFO:tasks.rados.rados.0.smithi012.stdout:335: done (3 left) 2024-09-10T17:57:25.840 INFO:tasks.rados.rados.0.smithi012.stdout:336: rollback oid 46 current snap is 30 2024-09-10T17:57:25.840 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 28 2024-09-10T17:57:25.840 INFO:tasks.rados.rados.0.smithi012.stdout:337: snap_remove snap 19 2024-09-10T17:57:26.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:25 smithi089 ceph-mon[31467]: osdmap e131: 8 total, 8 up, 8 in 2024-09-10T17:57:26.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:25 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:26.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:25 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:57:26.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:25 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:57:26.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:25 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:57:26.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:25 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[27356]: osdmap e131: 8 total, 8 up, 8 in 2024-09-10T17:57:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:57:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:57:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:57:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[37454]: osdmap e131: 8 total, 8 up, 8 in 2024-09-10T17:57:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:57:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:57:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:57:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:25 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:336: finishing rollback tid 0 to smithi01278544-46 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:336: finishing rollback tid 1 to smithi01278544-46 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:336: finishing rollback tid 2 to smithi01278544-46 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 62 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:332: finishing rollback tid 0 to smithi01278544-45 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:332: finishing rollback tid 1 to smithi01278544-45 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:332: finishing rollback tid 2 to smithi01278544-45 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 117 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-10T17:57:26.782 INFO:tasks.rados.rados.0.smithi012.stdout:333: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-10T17:57:26.799 INFO:tasks.rados.rados.0.smithi012.stdout:334: expect (ObjNum 117 snap 29 seq_num 117) 2024-09-10T17:57:26.861 INFO:tasks.rados.rados.0.smithi012.stdout:332: done (4 left) 2024-09-10T17:57:26.862 INFO:tasks.rados.rados.0.smithi012.stdout:333: done (3 left) 2024-09-10T17:57:26.862 INFO:tasks.rados.rados.0.smithi012.stdout:334: done (2 left) 2024-09-10T17:57:26.862 INFO:tasks.rados.rados.0.smithi012.stdout:336: done (1 left) 2024-09-10T17:57:26.862 INFO:tasks.rados.rados.0.smithi012.stdout:337: done (0 left) 2024-09-10T17:57:26.862 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 30 2024-09-10T17:57:26.862 INFO:tasks.rados.rados.0.smithi012.stdout:338: seq_num 120 ranges {0=417792,417792=475136,892928=622592,1515520=507904} 2024-09-10T17:57:26.863 INFO:tasks.rados.rados.0.smithi012.stdout:338: writing smithi01278544-4 from 0 to 417792 tid 1 2024-09-10T17:57:26.866 INFO:tasks.rados.rados.0.smithi012.stdout:338: writing smithi01278544-4 from 417792 to 892928 tid 2 2024-09-10T17:57:26.870 INFO:tasks.rados.rados.0.smithi012.stdout:338: writing smithi01278544-4 from 892928 to 1515520 tid 3 2024-09-10T17:57:26.873 INFO:tasks.rados.rados.0.smithi012.stdout:338: writing smithi01278544-4 from 1515520 to 2023424 tid 4 2024-09-10T17:57:26.874 INFO:tasks.rados.rados.0.smithi012.stdout:339: read oid 45 snap -1 2024-09-10T17:57:26.874 INFO:tasks.rados.rados.0.smithi012.stdout:339: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:26.874 INFO:tasks.rados.rados.0.smithi012.stdout:338: finishing write tid 1 to smithi01278544-4 2024-09-10T17:57:26.874 INFO:tasks.rados.rados.0.smithi012.stdout:338: finishing write tid 2 to smithi01278544-4 2024-09-10T17:57:26.874 INFO:tasks.rados.rados.0.smithi012.stdout:338: finishing write tid 3 to smithi01278544-4 2024-09-10T17:57:26.874 INFO:tasks.rados.rados.0.smithi012.stdout:340: copy_from oid 21 from oid 20 current snap is 30 2024-09-10T17:57:26.874 INFO:tasks.rados.rados.0.smithi012.stdout:341: setattr oid 33 current snap is 30 2024-09-10T17:57:26.874 INFO:tasks.rados.rados.0.smithi012.stdout:340: finishing copy_from to smithi01278544-21 2024-09-10T17:57:26.875 INFO:tasks.rados.rados.0.smithi012.stdout:340: got expected ENOENT (src dne) 2024-09-10T17:57:26.875 INFO:tasks.rados.rados.0.smithi012.stdout:340: finishing copy_from racing read to smithi01278544-21 2024-09-10T17:57:26.875 INFO:tasks.rados.rados.0.smithi012.stdout:340: done (3 left) 2024-09-10T17:57:26.875 INFO:tasks.rados.rados.0.smithi012.stdout:342: read oid 35 snap -1 2024-09-10T17:57:26.875 INFO:tasks.rados.rados.0.smithi012.stdout:342: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-10T17:57:26.876 INFO:tasks.rados.rados.0.smithi012.stdout:343: read oid 39 snap -1 2024-09-10T17:57:26.876 INFO:tasks.rados.rados.0.smithi012.stdout:343: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:57:26.876 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 30 2024-09-10T17:57:26.876 INFO:tasks.rados.rados.0.smithi012.stdout:344: seq_num 121 ranges {2367488=434176,2801664=753664,3555328=425984,3981312=425984} 2024-09-10T17:57:26.891 INFO:tasks.rados.rados.0.smithi012.stdout:344: writing smithi01278544-40 from 2367488 to 2801664 tid 1 2024-09-10T17:57:26.895 INFO:tasks.rados.rados.0.smithi012.stdout:344: writing smithi01278544-40 from 2801664 to 3555328 tid 2 2024-09-10T17:57:26.898 INFO:tasks.rados.rados.0.smithi012.stdout:344: writing smithi01278544-40 from 3555328 to 3981312 tid 3 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:344: writing smithi01278544-40 from 3981312 to 4407296 tid 4 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:345: read oid 46 snap -1 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:345: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:346: copy_from oid 22 from oid 7 current snap is 30 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:338: finishing write tid 4 to smithi01278544-4 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:338: finishing write tid 5 to smithi01278544-4 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:338: finishing write tid 6 to smithi01278544-4 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:338: oid 4 updating version 0 to 107 2024-09-10T17:57:26.901 INFO:tasks.rados.rados.0.smithi012.stdout:338: oid 4 updating version 107 to 108 2024-09-10T17:57:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:338: oid 4 version 108 is already newer than 105 2024-09-10T17:57:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:338: oid 4 version 108 is already newer than 106 2024-09-10T17:57:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:338: oid 4 updating version 108 to 109 2024-09-10T17:57:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 109 (ObjNum 120 snap 30 seq_num 120) dirty exists 2024-09-10T17:57:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:338: left oid 4 (ObjNum 120 snap 30 seq_num 120) 2024-09-10T17:57:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:342: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-10T17:57:26.918 INFO:tasks.rados.rados.0.smithi012.stdout:339: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:26.935 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 127 (ObjNum 106 snap 21 seq_num 106) dirty exists 2024-09-10T17:57:26.935 INFO:tasks.rados.rados.0.smithi012.stdout:343: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-10T17:57:26.955 INFO:tasks.rados.rados.0.smithi012.stdout:344: finishing write tid 1 to smithi01278544-40 2024-09-10T17:57:26.955 INFO:tasks.rados.rados.0.smithi012.stdout:344: finishing write tid 2 to smithi01278544-40 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: finishing write tid 3 to smithi01278544-40 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: finishing write tid 4 to smithi01278544-40 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: finishing write tid 5 to smithi01278544-40 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:346: finishing copy_from racing read to smithi01278544-22 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: finishing write tid 6 to smithi01278544-40 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: oid 40 updating version 0 to 131 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: oid 40 version 131 is already newer than 130 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: oid 40 version 131 is already newer than 129 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: oid 40 updating version 131 to 133 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: oid 40 version 133 is already newer than 132 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 133 (ObjNum 121 snap 30 seq_num 121) dirty exists 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:344: left oid 40 (ObjNum 121 snap 30 seq_num 121) 2024-09-10T17:57:26.956 INFO:tasks.rados.rados.0.smithi012.stdout:346: finishing copy_from to smithi01278544-22 2024-09-10T17:57:26.957 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-10T17:57:26.957 INFO:tasks.rados.rados.0.smithi012.stdout:345: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:26.976 INFO:tasks.rados.rados.0.smithi012.stdout:338: done (7 left) 2024-09-10T17:57:26.976 INFO:tasks.rados.rados.0.smithi012.stdout:339: done (6 left) 2024-09-10T17:57:26.976 INFO:tasks.rados.rados.0.smithi012.stdout:341: done (5 left) 2024-09-10T17:57:26.976 INFO:tasks.rados.rados.0.smithi012.stdout:342: done (4 left) 2024-09-10T17:57:26.976 INFO:tasks.rados.rados.0.smithi012.stdout:343: done (3 left) 2024-09-10T17:57:26.976 INFO:tasks.rados.rados.0.smithi012.stdout:344: done (2 left) 2024-09-10T17:57:26.976 INFO:tasks.rados.rados.0.smithi012.stdout:345: done (1 left) 2024-09-10T17:57:26.977 INFO:tasks.rados.rados.0.smithi012.stdout:346: done (0 left) 2024-09-10T17:57:26.977 INFO:tasks.rados.rados.0.smithi012.stdout:347: copy_from oid 12 from oid 33 current snap is 30 2024-09-10T17:57:26.977 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 30 2024-09-10T17:57:26.977 INFO:tasks.rados.rados.0.smithi012.stdout:348: seq_num 122 ranges {1916928=450560,2367488=688128,3055616=630784,3686400=286720} 2024-09-10T17:57:26.988 INFO:tasks.rados.rados.0.smithi012.stdout:348: writing smithi01278544-5 from 1916928 to 2367488 tid 1 2024-09-10T17:57:26.992 INFO:tasks.rados.rados.0.smithi012.stdout:348: writing smithi01278544-5 from 2367488 to 3055616 tid 2 2024-09-10T17:57:26.996 INFO:tasks.rados.rados.0.smithi012.stdout:348: writing smithi01278544-5 from 3055616 to 3686400 tid 3 2024-09-10T17:57:26.997 INFO:tasks.rados.rados.0.smithi012.stdout:348: writing smithi01278544-5 from 3686400 to 3973120 tid 4 2024-09-10T17:57:26.997 INFO:tasks.rados.rados.0.smithi012.stdout:349: read oid 24 snap -1 2024-09-10T17:57:26.998 INFO:tasks.rados.rados.0.smithi012.stdout:349: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:26.998 INFO:tasks.rados.rados.0.smithi012.stdout:350: read oid 46 snap 24 2024-09-10T17:57:26.998 INFO:tasks.rados.rados.0.smithi012.stdout:350: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:26.998 INFO:tasks.rados.rados.0.smithi012.stdout:351: setattr oid 4 current snap is 30 2024-09-10T17:57:26.998 INFO:tasks.rados.rados.0.smithi012.stdout:348: finishing write tid 1 to smithi01278544-5 2024-09-10T17:57:26.998 INFO:tasks.rados.rados.0.smithi012.stdout:347: finishing copy_from racing read to smithi01278544-12 2024-09-10T17:57:27.000 INFO:tasks.rados.rados.0.smithi012.stdout:348: finishing write tid 2 to smithi01278544-5 2024-09-10T17:57:27.000 INFO:tasks.rados.rados.0.smithi012.stdout:348: finishing write tid 3 to smithi01278544-5 2024-09-10T17:57:27.001 INFO:tasks.rados.rados.0.smithi012.stdout:348: finishing write tid 4 to smithi01278544-5 2024-09-10T17:57:27.001 INFO:tasks.rados.rados.0.smithi012.stdout:347: finishing copy_from to smithi01278544-12 2024-09-10T17:57:27.002 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 127 (ObjNum 106 snap 21 seq_num 106) dirty exists 2024-09-10T17:57:27.002 INFO:tasks.rados.rados.0.smithi012.stdout:348: finishing write tid 5 to smithi01278544-5 2024-09-10T17:57:27.002 INFO:tasks.rados.rados.0.smithi012.stdout:347: done (4 left) 2024-09-10T17:57:27.002 INFO:tasks.rados.rados.0.smithi012.stdout:352: snap_create 2024-09-10T17:57:27.002 INFO:tasks.rados.rados.0.smithi012.stdout:350: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:27.024 INFO:tasks.rados.rados.0.smithi012.stdout:348: finishing write tid 6 to smithi01278544-5 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:348: oid 5 updating version 0 to 36 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:348: oid 5 version 36 is already newer than 34 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:348: oid 5 version 36 is already newer than 32 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:348: oid 5 version 36 is already newer than 35 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:348: oid 5 version 36 is already newer than 33 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 36 (ObjNum 122 snap 30 seq_num 122) dirty exists 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:348: left oid 5 (ObjNum 122 snap 30 seq_num 122) 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 110 (ObjNum 120 snap 30 seq_num 120) dirty exists 2024-09-10T17:57:27.025 INFO:tasks.rados.rados.0.smithi012.stdout:349: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:27.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:26 smithi089 ceph-mon[31467]: Upgrade: Updating mgr.x 2024-09-10T17:57:27.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:26 smithi089 ceph-mon[31467]: Deploying daemon mgr.x on smithi089 2024-09-10T17:57:27.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:26 smithi089 ceph-mon[31467]: osdmap e132: 8 total, 8 up, 8 in 2024-09-10T17:57:27.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:26 smithi089 ceph-mon[31467]: pgmap v179: 121 pgs: 121 active+clean; 84 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2024-09-10T17:57:27.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:26 smithi089 ceph-mon[31467]: osdmap e133: 8 total, 8 up, 8 in 2024-09-10T17:57:27.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[27356]: Upgrade: Updating mgr.x 2024-09-10T17:57:27.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[27356]: Deploying daemon mgr.x on smithi089 2024-09-10T17:57:27.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[27356]: osdmap e132: 8 total, 8 up, 8 in 2024-09-10T17:57:27.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[27356]: pgmap v179: 121 pgs: 121 active+clean; 84 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2024-09-10T17:57:27.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[27356]: osdmap e133: 8 total, 8 up, 8 in 2024-09-10T17:57:27.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[37454]: Upgrade: Updating mgr.x 2024-09-10T17:57:27.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[37454]: Deploying daemon mgr.x on smithi089 2024-09-10T17:57:27.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[37454]: osdmap e132: 8 total, 8 up, 8 in 2024-09-10T17:57:27.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[37454]: pgmap v179: 121 pgs: 121 active+clean; 84 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2024-09-10T17:57:27.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:26 smithi012 ceph-mon[37454]: osdmap e133: 8 total, 8 up, 8 in 2024-09-10T17:57:27.852 INFO:tasks.rados.rados.0.smithi012.stdout:348: done (4 left) 2024-09-10T17:57:27.853 INFO:tasks.rados.rados.0.smithi012.stdout:349: done (3 left) 2024-09-10T17:57:27.853 INFO:tasks.rados.rados.0.smithi012.stdout:350: done (2 left) 2024-09-10T17:57:27.853 INFO:tasks.rados.rados.0.smithi012.stdout:351: done (1 left) 2024-09-10T17:57:27.853 INFO:tasks.rados.rados.0.smithi012.stdout:352: done (0 left) 2024-09-10T17:57:27.853 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 31 2024-09-10T17:57:27.853 INFO:tasks.rados.rados.0.smithi012.stdout:353: seq_num 123 ranges {2220032=466944,2686976=573440,3260416=794624,4055040=237568} 2024-09-10T17:57:27.867 INFO:tasks.rados.rados.0.smithi012.stdout:353: writing smithi01278544-13 from 2220032 to 2686976 tid 1 2024-09-10T17:57:27.870 INFO:tasks.rados.rados.0.smithi012.stdout:353: writing smithi01278544-13 from 2686976 to 3260416 tid 2 2024-09-10T17:57:27.875 INFO:tasks.rados.rados.0.smithi012.stdout:353: writing smithi01278544-13 from 3260416 to 4055040 tid 3 2024-09-10T17:57:27.877 INFO:tasks.rados.rados.0.smithi012.stdout:353: writing smithi01278544-13 from 4055040 to 4292608 tid 4 2024-09-10T17:57:27.877 INFO:tasks.rados.rados.0.smithi012.stdout:354: delete oid 37 current snap is 31 2024-09-10T17:57:27.877 INFO:tasks.rados.rados.0.smithi012.stdout:353: finishing write tid 1 to smithi01278544-13 2024-09-10T17:57:27.877 INFO:tasks.rados.rados.0.smithi012.stdout:353: finishing write tid 2 to smithi01278544-13 2024-09-10T17:57:27.879 INFO:tasks.rados.rados.0.smithi012.stdout:353: finishing write tid 3 to smithi01278544-13 2024-09-10T17:57:27.879 INFO:tasks.rados.rados.0.smithi012.stdout:353: finishing write tid 4 to smithi01278544-13 2024-09-10T17:57:27.879 INFO:tasks.rados.rados.0.smithi012.stdout:353: finishing write tid 5 to smithi01278544-13 2024-09-10T17:57:27.881 INFO:tasks.rados.rados.0.smithi012.stdout:353: finishing write tid 6 to smithi01278544-13 2024-09-10T17:57:27.881 INFO:tasks.rados.rados.0.smithi012.stdout:353: oid 13 updating version 0 to 115 2024-09-10T17:57:27.881 INFO:tasks.rados.rados.0.smithi012.stdout:353: oid 13 version 115 is already newer than 114 2024-09-10T17:57:27.881 INFO:tasks.rados.rados.0.smithi012.stdout:353: oid 13 version 115 is already newer than 112 2024-09-10T17:57:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:353: oid 13 updating version 115 to 116 2024-09-10T17:57:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:353: oid 13 version 116 is already newer than 113 2024-09-10T17:57:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 116 (ObjNum 123 snap 31 seq_num 123) dirty exists 2024-09-10T17:57:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:353: left oid 13 (ObjNum 123 snap 31 seq_num 123) 2024-09-10T17:57:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:353: done (1 left) 2024-09-10T17:57:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:354: done (0 left) 2024-09-10T17:57:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 31 2024-09-10T17:57:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:355: seq_num 125 ranges {606208=499712,1105920=745472,1851392=409600,2260992=450560} 2024-09-10T17:57:27.887 INFO:tasks.rados.rados.0.smithi012.stdout:355: writing smithi01278544-25 from 606208 to 1105920 tid 1 2024-09-10T17:57:27.891 INFO:tasks.rados.rados.0.smithi012.stdout:355: writing smithi01278544-25 from 1105920 to 1851392 tid 2 2024-09-10T17:57:27.893 INFO:tasks.rados.rados.0.smithi012.stdout:355: writing smithi01278544-25 from 1851392 to 2260992 tid 3 2024-09-10T17:57:27.896 INFO:tasks.rados.rados.0.smithi012.stdout:355: writing smithi01278544-25 from 2260992 to 2711552 tid 4 2024-09-10T17:57:27.896 INFO:tasks.rados.rados.0.smithi012.stdout:356: setattr oid 48 current snap is 31 2024-09-10T17:57:27.896 INFO:tasks.rados.rados.0.smithi012.stdout:355: finishing write tid 1 to smithi01278544-25 2024-09-10T17:57:27.896 INFO:tasks.rados.rados.0.smithi012.stdout:355: finishing write tid 2 to smithi01278544-25 2024-09-10T17:57:27.896 INFO:tasks.rados.rados.0.smithi012.stdout:355: finishing write tid 3 to smithi01278544-25 2024-09-10T17:57:27.898 INFO:tasks.rados.rados.0.smithi012.stdout:357: read oid 14 snap -1 2024-09-10T17:57:27.898 INFO:tasks.rados.rados.0.smithi012.stdout:357: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-10T17:57:27.898 INFO:tasks.rados.rados.0.smithi012.stdout:358: snap_create 2024-09-10T17:57:27.898 INFO:tasks.rados.rados.0.smithi012.stdout:355: finishing write tid 4 to smithi01278544-25 2024-09-10T17:57:27.898 INFO:tasks.rados.rados.0.smithi012.stdout:355: finishing write tid 5 to smithi01278544-25 2024-09-10T17:57:27.900 INFO:tasks.rados.rados.0.smithi012.stdout:355: finishing write tid 6 to smithi01278544-25 2024-09-10T17:57:27.900 INFO:tasks.rados.rados.0.smithi012.stdout:355: oid 25 updating version 0 to 129 2024-09-10T17:57:27.900 INFO:tasks.rados.rados.0.smithi012.stdout:355: oid 25 updating version 129 to 130 2024-09-10T17:57:27.900 INFO:tasks.rados.rados.0.smithi012.stdout:355: oid 25 updating version 130 to 132 2024-09-10T17:57:27.900 INFO:tasks.rados.rados.0.smithi012.stdout:355: oid 25 version 132 is already newer than 128 2024-09-10T17:57:27.900 INFO:tasks.rados.rados.0.smithi012.stdout:355: oid 25 version 132 is already newer than 131 2024-09-10T17:57:27.900 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 132 (ObjNum 125 snap 31 seq_num 125) dirty exists 2024-09-10T17:57:27.900 INFO:tasks.rados.rados.0.smithi012.stdout:355: left oid 25 (ObjNum 125 snap 31 seq_num 125) 2024-09-10T17:57:27.902 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 90 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:57:27.902 INFO:tasks.rados.rados.0.smithi012.stdout:357: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-10T17:57:28.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:27 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:28.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:27 smithi089 systemd[1]: Stopping Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:57:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:27 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:28.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:27 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:28.412 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:28 smithi089 podman[64040]: 2024-09-10 17:57:28.116533654 +0000 UTC m=+0.182774879 container died d3a723eea923dacb078bccdd608e3a9522a6188f24b0a0b00f6de910e7539e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T17:57:28.696 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:28 smithi089 podman[64040]: 2024-09-10 17:57:28.494812363 +0000 UTC m=+0.561053595 container cleanup d3a723eea923dacb078bccdd608e3a9522a6188f24b0a0b00f6de910e7539e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , RELEASE=reef-7a853b1, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T17:57:28.697 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:28 smithi089 bash[64040]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x 2024-09-10T17:57:28.858 INFO:tasks.rados.rados.0.smithi012.stdout:355: done (3 left) 2024-09-10T17:57:28.858 INFO:tasks.rados.rados.0.smithi012.stdout:356: done (2 left) 2024-09-10T17:57:28.858 INFO:tasks.rados.rados.0.smithi012.stdout:357: done (1 left) 2024-09-10T17:57:28.858 INFO:tasks.rados.rados.0.smithi012.stdout:358: done (0 left) 2024-09-10T17:57:28.858 INFO:tasks.rados.rados.0.smithi012.stdout:359: delete oid 27 current snap is 32 2024-09-10T17:57:28.861 INFO:tasks.rados.rados.0.smithi012.stdout:359: done (0 left) 2024-09-10T17:57:28.862 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 32 2024-09-10T17:57:28.862 INFO:tasks.rados.rados.0.smithi012.stdout:360: seq_num 127 ranges {1425408=532480,1957888=507904,2465792=778240,3244032=319488} 2024-09-10T17:57:28.872 INFO:tasks.rados.rados.0.smithi012.stdout:360: writing smithi01278544-3 from 1425408 to 1957888 tid 1 2024-09-10T17:57:28.875 INFO:tasks.rados.rados.0.smithi012.stdout:360: writing smithi01278544-3 from 1957888 to 2465792 tid 2 2024-09-10T17:57:28.879 INFO:tasks.rados.rados.0.smithi012.stdout:360: writing smithi01278544-3 from 2465792 to 3244032 tid 3 2024-09-10T17:57:28.881 INFO:tasks.rados.rados.0.smithi012.stdout:360: writing smithi01278544-3 from 3244032 to 3563520 tid 4 2024-09-10T17:57:28.881 INFO:tasks.rados.rados.0.smithi012.stdout:361: snap_create 2024-09-10T17:57:28.881 INFO:tasks.rados.rados.0.smithi012.stdout:360: finishing write tid 1 to smithi01278544-3 2024-09-10T17:57:28.881 INFO:tasks.rados.rados.0.smithi012.stdout:360: finishing write tid 2 to smithi01278544-3 2024-09-10T17:57:28.883 INFO:tasks.rados.rados.0.smithi012.stdout:360: finishing write tid 3 to smithi01278544-3 2024-09-10T17:57:28.884 INFO:tasks.rados.rados.0.smithi012.stdout:360: finishing write tid 4 to smithi01278544-3 2024-09-10T17:57:28.884 INFO:tasks.rados.rados.0.smithi012.stdout:360: finishing write tid 5 to smithi01278544-3 2024-09-10T17:57:28.884 INFO:tasks.rados.rados.0.smithi012.stdout:360: finishing write tid 6 to smithi01278544-3 2024-09-10T17:57:28.884 INFO:tasks.rados.rados.0.smithi012.stdout:360: oid 3 updating version 0 to 68 2024-09-10T17:57:28.885 INFO:tasks.rados.rados.0.smithi012.stdout:360: oid 3 updating version 68 to 69 2024-09-10T17:57:28.885 INFO:tasks.rados.rados.0.smithi012.stdout:360: oid 3 updating version 69 to 71 2024-09-10T17:57:28.885 INFO:tasks.rados.rados.0.smithi012.stdout:360: oid 3 version 71 is already newer than 70 2024-09-10T17:57:28.885 INFO:tasks.rados.rados.0.smithi012.stdout:360: oid 3 updating version 71 to 72 2024-09-10T17:57:28.885 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 72 (ObjNum 127 snap 32 seq_num 127) dirty exists 2024-09-10T17:57:28.885 INFO:tasks.rados.rados.0.smithi012.stdout:360: left oid 3 (ObjNum 127 snap 32 seq_num 127) 2024-09-10T17:57:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:28 smithi089 ceph-mon[31467]: osdmap e134: 8 total, 8 up, 8 in 2024-09-10T17:57:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:28 smithi089 ceph-mon[31467]: pgmap v182: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 45 op/s 2024-09-10T17:57:29.035 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:28 smithi089 podman[64053]: 2024-09-10 17:57:28.695934175 +0000 UTC m=+0.582567461 container remove d3a723eea923dacb078bccdd608e3a9522a6188f24b0a0b00f6de910e7539e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=reef-7a853b1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T17:57:29.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:28 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-10T17:57:29.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:28 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-09-10T17:57:29.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:28 smithi089 systemd[1]: Stopped Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:57:29.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:28 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x.service: Consumed 10.939s CPU time. 2024-09-10T17:57:29.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:28 smithi012 ceph-mon[27356]: osdmap e134: 8 total, 8 up, 8 in 2024-09-10T17:57:29.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:28 smithi012 ceph-mon[27356]: pgmap v182: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 45 op/s 2024-09-10T17:57:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:28 smithi012 ceph-mon[37454]: osdmap e134: 8 total, 8 up, 8 in 2024-09-10T17:57:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:28 smithi012 ceph-mon[37454]: pgmap v182: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 45 op/s 2024-09-10T17:57:29.378 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:29 smithi089 systemd[1]: Starting Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:57:29.379 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:29 smithi089 podman[64179]: 2024-09-10 17:57:29.170463903 +0000 UTC m=+0.015938028 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T17:57:29.379 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:29 smithi089 podman[64179]: 2024-09-10 17:57:29.280969869 +0000 UTC m=+0.126443995 container create 65268c62eeb7fe85f95171ff832a393c84c5e921e9164c77ca97172c2930cac9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T17:57:29.785 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:29 smithi089 podman[64179]: 2024-09-10 17:57:29.500366531 +0000 UTC m=+0.345840666 container init 65268c62eeb7fe85f95171ff832a393c84c5e921e9164c77ca97172c2930cac9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T17:57:29.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:29 smithi089 podman[64179]: 2024-09-10 17:57:29.503182594 +0000 UTC m=+0.348656720 container start 65268c62eeb7fe85f95171ff832a393c84c5e921e9164c77ca97172c2930cac9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T17:57:29.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:29 smithi089 ceph-mgr[64198]: -- 172.21.15.89:0/1094270244 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dae907d0e0 con 0x55dae905a800 2024-09-10T17:57:29.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:29 smithi089 bash[64179]: 65268c62eeb7fe85f95171ff832a393c84c5e921e9164c77ca97172c2930cac9 2024-09-10T17:57:29.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:29 smithi089 systemd[1]: Started Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:57:29.865 INFO:tasks.rados.rados.0.smithi012.stdout:360: done (1 left) 2024-09-10T17:57:29.865 INFO:tasks.rados.rados.0.smithi012.stdout:361: done (0 left) 2024-09-10T17:57:29.865 INFO:tasks.rados.rados.0.smithi012.stdout:362: rollback oid 27 current snap is 33 2024-09-10T17:57:29.865 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 32 2024-09-10T17:57:29.865 INFO:tasks.rados.rados.0.smithi012.stdout:363: setattr oid 20 current snap is 33 2024-09-10T17:57:29.867 INFO:tasks.rados.rados.0.smithi012.stdout:364: snap_create 2024-09-10T17:57:29.868 INFO:tasks.rados.rados.0.smithi012.stdout:362: finishing rollback tid 1 to smithi01278544-27 2024-09-10T17:57:29.868 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 66 (ObjNum 33 snap 0 seq_num 3496691752) dirty dne 2024-09-10T17:57:29.870 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 133 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T17:57:30.223 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:29 smithi089 ceph-mon[31467]: osdmap e135: 8 total, 8 up, 8 in 2024-09-10T17:57:30.224 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:29 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:30.224 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:29 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:30.224 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:29 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:29 smithi012 ceph-mon[27356]: osdmap e135: 8 total, 8 up, 8 in 2024-09-10T17:57:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:29 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:29 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:29 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:29 smithi012 ceph-mon[37454]: osdmap e135: 8 total, 8 up, 8 in 2024-09-10T17:57:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:29 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:29 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:29 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:30.873 INFO:tasks.rados.rados.0.smithi012.stdout:362: done (2 left) 2024-09-10T17:57:30.873 INFO:tasks.rados.rados.0.smithi012.stdout:363: done (1 left) 2024-09-10T17:57:30.873 INFO:tasks.rados.rados.0.smithi012.stdout:364: done (0 left) 2024-09-10T17:57:30.873 INFO:tasks.rados.rados.0.smithi012.stdout:365: read oid 46 snap -1 2024-09-10T17:57:30.873 INFO:tasks.rados.rados.0.smithi012.stdout:365: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:30.873 INFO:tasks.rados.rados.0.smithi012.stdout:366: snap_remove snap 17 2024-09-10T17:57:31.142 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:30 smithi089 ceph-mon[31467]: osdmap e136: 8 total, 8 up, 8 in 2024-09-10T17:57:31.142 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:30 smithi089 ceph-mon[31467]: pgmap v185: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 45 op/s 2024-09-10T17:57:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:30 smithi012 ceph-mon[27356]: osdmap e136: 8 total, 8 up, 8 in 2024-09-10T17:57:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:30 smithi012 ceph-mon[27356]: pgmap v185: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 45 op/s 2024-09-10T17:57:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:30 smithi012 ceph-mon[37454]: osdmap e136: 8 total, 8 up, 8 in 2024-09-10T17:57:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:30 smithi012 ceph-mon[37454]: pgmap v185: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 45 op/s 2024-09-10T17:57:31.781 INFO:tasks.rados.rados.0.smithi012.stdout:366: done (1 left) 2024-09-10T17:57:31.781 INFO:tasks.rados.rados.0.smithi012.stdout:367: read oid 12 snap -1 2024-09-10T17:57:31.781 INFO:tasks.rados.rados.0.smithi012.stdout:367: expect (ObjNum 106 snap 21 seq_num 106) 2024-09-10T17:57:31.781 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 34 2024-09-10T17:57:31.781 INFO:tasks.rados.rados.0.smithi012.stdout:368: seq_num 128 ranges {3899392=548864,4448256=794624,5242880=581632,5824512=229376} 2024-09-10T17:57:31.807 INFO:tasks.rados.rados.0.smithi012.stdout:368: writing smithi01278544-21 from 3899392 to 4448256 tid 1 2024-09-10T17:57:31.811 INFO:tasks.rados.rados.0.smithi012.stdout:368: writing smithi01278544-21 from 4448256 to 5242880 tid 2 2024-09-10T17:57:31.815 INFO:tasks.rados.rados.0.smithi012.stdout:368: writing smithi01278544-21 from 5242880 to 5824512 tid 3 2024-09-10T17:57:31.817 INFO:tasks.rados.rados.0.smithi012.stdout:368: writing smithi01278544-21 from 5824512 to 6053888 tid 4 2024-09-10T17:57:31.817 INFO:tasks.rados.rados.0.smithi012.stdout:369: snap_remove snap 23 2024-09-10T17:57:32.028 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:31 smithi089 ceph-mon[31467]: osdmap e137: 8 total, 8 up, 8 in 2024-09-10T17:57:32.028 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:31 smithi089 ceph-mon[31467]: osdmap e138: 8 total, 8 up, 8 in 2024-09-10T17:57:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:31 smithi012 ceph-mon[27356]: osdmap e137: 8 total, 8 up, 8 in 2024-09-10T17:57:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:31 smithi012 ceph-mon[27356]: osdmap e138: 8 total, 8 up, 8 in 2024-09-10T17:57:32.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:31 smithi012 ceph-mon[37454]: osdmap e137: 8 total, 8 up, 8 in 2024-09-10T17:57:32.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:31 smithi012 ceph-mon[37454]: osdmap e138: 8 total, 8 up, 8 in 2024-09-10T17:57:32.783 INFO:tasks.rados.rados.0.smithi012.stdout:369: done (3 left) 2024-09-10T17:57:32.784 INFO:tasks.rados.rados.0.smithi012.stdout:370: snap_create 2024-09-10T17:57:32.784 INFO:tasks.rados.rados.0.smithi012.stdout:365: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:32.806 INFO:tasks.rados.rados.0.smithi012.stdout:368: finishing write tid 1 to smithi01278544-21 2024-09-10T17:57:32.806 INFO:tasks.rados.rados.0.smithi012.stdout:367: expect (ObjNum 106 snap 21 seq_num 106) 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: finishing write tid 2 to smithi01278544-21 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: finishing write tid 3 to smithi01278544-21 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: finishing write tid 4 to smithi01278544-21 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: finishing write tid 5 to smithi01278544-21 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: finishing write tid 6 to smithi01278544-21 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: oid 21 updating version 0 to 115 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: oid 21 updating version 115 to 116 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: oid 21 version 116 is already newer than 113 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: oid 21 updating version 116 to 117 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: oid 21 version 117 is already newer than 114 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 117 (ObjNum 128 snap 34 seq_num 128) dirty exists 2024-09-10T17:57:32.974 INFO:tasks.rados.rados.0.smithi012.stdout:368: left oid 21 (ObjNum 128 snap 34 seq_num 128) 2024-09-10T17:57:33.142 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:32 smithi089 ceph-mon[31467]: pgmap v188: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:33.142 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:32 smithi089 ceph-mon[31467]: osdmap e139: 8 total, 8 up, 8 in 2024-09-10T17:57:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:32 smithi012 ceph-mon[27356]: pgmap v188: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:32 smithi012 ceph-mon[27356]: osdmap e139: 8 total, 8 up, 8 in 2024-09-10T17:57:33.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:32 smithi012 ceph-mon[37454]: pgmap v188: 121 pgs: 121 active+clean; 104 MiB data, 411 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:33.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:32 smithi012 ceph-mon[37454]: osdmap e139: 8 total, 8 up, 8 in 2024-09-10T17:57:33.432 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T17:57:33.786 INFO:tasks.rados.rados.0.smithi012.stdout:365: done (3 left) 2024-09-10T17:57:33.786 INFO:tasks.rados.rados.0.smithi012.stdout:367: done (2 left) 2024-09-10T17:57:33.786 INFO:tasks.rados.rados.0.smithi012.stdout:368: done (1 left) 2024-09-10T17:57:33.786 INFO:tasks.rados.rados.0.smithi012.stdout:370: done (0 left) 2024-09-10T17:57:33.786 INFO:tasks.rados.rados.0.smithi012.stdout:371: snap_remove snap 26 2024-09-10T17:57:33.990 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (2m) 2m ago 3m 15.7M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (3m) 2m ago 3m 81.9M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (5m) 2m ago 5m 16.5M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (5m) 2m ago 5m 16.0M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 starting - - - - 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:9283,8765 running (10m) 2m ago 10m 487M - 18.2.4-837-g7a853b17 f21ba1eea74e 46d8d80f1292 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (10m) 2m ago 10m 48.1M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2f6698e39d41 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (8m) 2m ago 8m 42.7M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e bddaa233c388 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (8m) 2m ago 8m 40.7M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2ba771d7bc46 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (3m) 2m ago 3m 14.0M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (3m) 2m ago 3m 3598k - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (8m) 2m ago 8m 52.8M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e a54550a62cfe 2024-09-10T17:57:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (7m) 2m ago 7m 44.6M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T17:57:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (7m) 2m ago 7m 42.5M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T17:57:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (7m) 2m ago 7m 49.9M 2993M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T17:57:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (6m) 2m ago 6m 45.3M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T17:57:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (6m) 2m ago 6m 51.1M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T17:57:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (5m) 2m ago 5m 51.1M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T17:57:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (5m) 2m ago 5m 49.6M 2991M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T17:57:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (2m) 2m ago 3m 29.3M - 2.43.0 a07b618ecd1d 9c8fe13e4a8e 2024-09-10T17:57:34.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:57:33] "GET /metrics HTTP/1.1" 200 36006 "" "Prometheus/2.43.0" 2024-09-10T17:57:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:33 smithi012 ceph-mon[27356]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:33 smithi012 ceph-mon[27356]: from='client.24923 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:33 smithi012 ceph-mon[27356]: osdmap e140: 8 total, 8 up, 8 in 2024-09-10T17:57:34.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:33 smithi012 ceph-mon[37454]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:34.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:33 smithi012 ceph-mon[37454]: from='client.24923 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:34.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:33 smithi012 ceph-mon[37454]: osdmap e140: 8 total, 8 up, 8 in 2024-09-10T17:57:34.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:33 smithi089 ceph-mon[31467]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:34.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:33 smithi089 ceph-mon[31467]: from='client.24923 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:34.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:33 smithi089 ceph-mon[31467]: osdmap e140: 8 total, 8 up, 8 in 2024-09-10T17:57:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:57:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T17:57:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:57:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:57:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T17:57:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:57:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:57:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 15 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T17:57:34.320 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:57:34.601 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:57:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T17:57:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T17:57:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T17:57:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [], 2024-09-10T17:57:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "", 2024-09-10T17:57:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T17:57:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T17:57:34.602 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:57:34.783 INFO:tasks.rados.rados.0.smithi012.stdout:371: done (0 left) 2024-09-10T17:57:34.783 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 35 2024-09-10T17:57:34.783 INFO:tasks.rados.rados.0.smithi012.stdout:372: seq_num 129 ranges {827392=565248,1392640=679936,2072576=786432,2859008=139264} 2024-09-10T17:57:34.791 INFO:tasks.rados.rados.0.smithi012.stdout:372: writing smithi01278544-50 from 827392 to 1392640 tid 1 2024-09-10T17:57:34.795 INFO:tasks.rados.rados.0.smithi012.stdout:372: writing smithi01278544-50 from 1392640 to 2072576 tid 2 2024-09-10T17:57:34.801 INFO:tasks.rados.rados.0.smithi012.stdout:372: writing smithi01278544-50 from 2072576 to 2859008 tid 3 2024-09-10T17:57:34.802 INFO:tasks.rados.rados.0.smithi012.stdout:372: writing smithi01278544-50 from 2859008 to 2998272 tid 4 2024-09-10T17:57:34.802 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 35 2024-09-10T17:57:34.802 INFO:tasks.rados.rados.0.smithi012.stdout:372: finishing write tid 1 to smithi01278544-50 2024-09-10T17:57:34.802 INFO:tasks.rados.rados.0.smithi012.stdout:372: finishing write tid 2 to smithi01278544-50 2024-09-10T17:57:34.803 INFO:tasks.rados.rados.0.smithi012.stdout:373: seq_num 130 ranges {2023424=581632,2605056=614400,3219456=598016,3817472=393216} 2024-09-10T17:57:34.816 INFO:tasks.rados.rados.0.smithi012.stdout:373: writing smithi01278544-4 from 2023424 to 2605056 tid 1 2024-09-10T17:57:34.820 INFO:tasks.rados.rados.0.smithi012.stdout:373: writing smithi01278544-4 from 2605056 to 3219456 tid 2 2024-09-10T17:57:34.824 INFO:tasks.rados.rados.0.smithi012.stdout:373: writing smithi01278544-4 from 3219456 to 3817472 tid 3 2024-09-10T17:57:34.826 INFO:tasks.rados.rados.0.smithi012.stdout:373: writing smithi01278544-4 from 3817472 to 4210688 tid 4 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:374: rmattr oid 9 current snap is 35 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:374: done (2 left) 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:375: delete oid 21 current snap is 35 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: finishing write tid 3 to smithi01278544-50 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: finishing write tid 4 to smithi01278544-50 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: finishing write tid 5 to smithi01278544-50 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: finishing write tid 6 to smithi01278544-50 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: oid 50 updating version 0 to 19 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: oid 50 updating version 19 to 23 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: oid 50 version 23 is already newer than 20 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: oid 50 version 23 is already newer than 22 2024-09-10T17:57:34.827 INFO:tasks.rados.rados.0.smithi012.stdout:372: oid 50 version 23 is already newer than 21 2024-09-10T17:57:34.828 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 23 (ObjNum 129 snap 35 seq_num 129) dirty exists 2024-09-10T17:57:34.828 INFO:tasks.rados.rados.0.smithi012.stdout:372: left oid 50 (ObjNum 129 snap 35 seq_num 129) 2024-09-10T17:57:34.828 INFO:tasks.rados.rados.0.smithi012.stdout:373: finishing write tid 1 to smithi01278544-4 2024-09-10T17:57:34.828 INFO:tasks.rados.rados.0.smithi012.stdout:373: finishing write tid 2 to smithi01278544-4 2024-09-10T17:57:34.828 INFO:tasks.rados.rados.0.smithi012.stdout:373: finishing write tid 3 to smithi01278544-4 2024-09-10T17:57:34.828 INFO:tasks.rados.rados.0.smithi012.stdout:372: done (2 left) 2024-09-10T17:57:34.828 INFO:tasks.rados.rados.0.smithi012.stdout:375: done (1 left) 2024-09-10T17:57:34.828 INFO:tasks.rados.rados.0.smithi012.stdout:376: read oid 29 snap -1 2024-09-10T17:57:34.829 INFO:tasks.rados.rados.0.smithi012.stdout:376: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:34.829 INFO:tasks.rados.rados.0.smithi012.stdout:377: delete oid 3 current snap is 35 2024-09-10T17:57:34.829 INFO:tasks.rados.rados.0.smithi012.stdout:373: finishing write tid 4 to smithi01278544-4 2024-09-10T17:57:34.830 INFO:tasks.rados.rados.0.smithi012.stdout:373: finishing write tid 5 to smithi01278544-4 2024-09-10T17:57:34.831 INFO:tasks.rados.rados.0.smithi012.stdout:377: done (2 left) 2024-09-10T17:57:34.831 INFO:tasks.rados.rados.0.smithi012.stdout:378: read oid 1 snap 33 2024-09-10T17:57:34.831 INFO:tasks.rados.rados.0.smithi012.stdout:378: expect (ObjNum 80 snap 15 seq_num 80) 2024-09-10T17:57:34.831 INFO:tasks.rados.rados.0.smithi012.stdout:379: setattr oid 2 current snap is 35 2024-09-10T17:57:34.832 INFO:tasks.rados.rados.0.smithi012.stdout:376: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:34.854 INFO:tasks.rados.rados.0.smithi012.stdout:373: finishing write tid 6 to smithi01278544-4 2024-09-10T17:57:34.854 INFO:tasks.rados.rados.0.smithi012.stdout:373: oid 4 updating version 0 to 135 2024-09-10T17:57:34.854 INFO:tasks.rados.rados.0.smithi012.stdout:373: oid 4 updating version 135 to 137 2024-09-10T17:57:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:373: oid 4 version 137 is already newer than 134 2024-09-10T17:57:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:373: oid 4 version 137 is already newer than 136 2024-09-10T17:57:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:373: oid 4 updating version 137 to 138 2024-09-10T17:57:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 138 (ObjNum 130 snap 35 seq_num 130) dirty exists 2024-09-10T17:57:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:373: left oid 4 (ObjNum 130 snap 35 seq_num 130) 2024-09-10T17:57:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:378: expect (ObjNum 80 snap 15 seq_num 80) 2024-09-10T17:57:34.890 INFO:tasks.rados.rados.0.smithi012.stdout:373: done (3 left) 2024-09-10T17:57:34.890 INFO:tasks.rados.rados.0.smithi012.stdout:376: done (2 left) 2024-09-10T17:57:34.890 INFO:tasks.rados.rados.0.smithi012.stdout:378: done (1 left) 2024-09-10T17:57:34.890 INFO:tasks.rados.rados.0.smithi012.stdout:380: setattr oid 30 current snap is 35 2024-09-10T17:57:34.892 INFO:tasks.rados.rados.0.smithi012.stdout:381: delete oid 40 current snap is 35 2024-09-10T17:57:34.893 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 122 (ObjNum 100 snap 19 seq_num 100) dirty exists 2024-09-10T17:57:34.894 INFO:tasks.rados.rados.0.smithi012.stdout:379: done (2 left) 2024-09-10T17:57:34.894 INFO:tasks.rados.rados.0.smithi012.stdout:381: done (1 left) 2024-09-10T17:57:34.894 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 35 2024-09-10T17:57:34.894 INFO:tasks.rados.rados.0.smithi012.stdout:382: seq_num 134 ranges {458752=647168,1105920=548864,1654784=573440,2228224=483328} 2024-09-10T17:57:34.900 INFO:tasks.rados.rados.0.smithi012.stdout:382: writing smithi01278544-28 from 458752 to 1105920 tid 1 2024-09-10T17:57:34.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: writing smithi01278544-28 from 1105920 to 1654784 tid 2 2024-09-10T17:57:34.907 INFO:tasks.rados.rados.0.smithi012.stdout:382: writing smithi01278544-28 from 1654784 to 2228224 tid 3 2024-09-10T17:57:34.910 INFO:tasks.rados.rados.0.smithi012.stdout:382: writing smithi01278544-28 from 2228224 to 2711552 tid 4 2024-09-10T17:57:34.910 INFO:tasks.rados.rados.0.smithi012.stdout:383: snap_remove snap 34 2024-09-10T17:57:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[27356]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2058892513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:57:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[27356]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[27356]: pgmap v191: 121 pgs: 121 active+clean; 103 MiB data, 410 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T17:57:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[27356]: osdmap e141: 8 total, 8 up, 8 in 2024-09-10T17:57:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[37454]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2058892513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:57:35.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[37454]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:35.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[37454]: pgmap v191: 121 pgs: 121 active+clean; 103 MiB data, 410 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T17:57:35.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:34 smithi012 ceph-mon[37454]: osdmap e141: 8 total, 8 up, 8 in 2024-09-10T17:57:35.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-mon[31467]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:35.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2058892513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:57:35.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-mon[31467]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:57:35.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-mon[31467]: pgmap v191: 121 pgs: 121 active+clean; 103 MiB data, 410 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T17:57:35.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-mon[31467]: osdmap e141: 8 total, 8 up, 8 in 2024-09-10T17:57:35.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:34] ENGINE Bus STARTING 2024-09-10T17:57:35.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: CherryPy Checker: 2024-09-10T17:57:35.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: The Application mounted at '' has an empty config. 2024-09-10T17:57:35.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:35.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:34] ENGINE Serving on http://:::9283 2024-09-10T17:57:35.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:34] ENGINE Bus STARTED 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:383: done (2 left) 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:384: copy_from oid 22 from oid 13 current snap is 35 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:385: read oid 32 snap -1 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:385: expect deleted 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:386: rollback oid 15 current snap is 35 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 15 to 33 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 88 (ObjNum 73 snap 10 seq_num 73) dirty exists 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:382: finishing write tid 1 to smithi01278544-28 2024-09-10T17:57:35.903 INFO:tasks.rados.rados.0.smithi012.stdout:382: finishing write tid 2 to smithi01278544-28 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: finishing write tid 3 to smithi01278544-28 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: finishing write tid 4 to smithi01278544-28 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: finishing write tid 5 to smithi01278544-28 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: finishing write tid 6 to smithi01278544-28 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: oid 28 updating version 0 to 7 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: oid 28 version 7 is already newer than 5 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: oid 28 updating version 7 to 8 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: oid 28 version 8 is already newer than 4 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: oid 28 version 8 is already newer than 6 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 8 (ObjNum 134 snap 35 seq_num 134) dirty exists 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: left oid 28 (ObjNum 134 snap 35 seq_num 134) 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:380: done (4 left) 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:382: done (3 left) 2024-09-10T17:57:35.904 INFO:tasks.rados.rados.0.smithi012.stdout:385: done (2 left) 2024-09-10T17:57:35.905 INFO:tasks.rados.rados.0.smithi012.stdout:387: snap_remove snap 28 2024-09-10T17:57:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[27356]: Standby manager daemon x restarted 2024-09-10T17:57:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[27356]: Standby manager daemon x started 2024-09-10T17:57:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:57:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:57:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:57:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:57:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[37454]: Standby manager daemon x restarted 2024-09-10T17:57:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[37454]: Standby manager daemon x started 2024-09-10T17:57:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:57:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:57:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:57:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:35 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:57:36.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:35 smithi089 ceph-mon[31467]: Standby manager daemon x restarted 2024-09-10T17:57:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:35 smithi089 ceph-mon[31467]: Standby manager daemon x started 2024-09-10T17:57:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:35 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:57:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:35 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:57:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:35 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:57:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:35 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:57:36.785 INFO:tasks.rados.rados.0.smithi012.stdout:387: done (2 left) 2024-09-10T17:57:36.785 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 35 2024-09-10T17:57:36.785 INFO:tasks.rados.rados.0.smithi012.stdout:388: seq_num 135 ranges {0=663552,663552=434176,1097728=786432,1884160=385024} 2024-09-10T17:57:36.789 INFO:tasks.rados.rados.0.smithi012.stdout:388: writing smithi01278544-49 from 0 to 663552 tid 1 2024-09-10T17:57:36.792 INFO:tasks.rados.rados.0.smithi012.stdout:388: writing smithi01278544-49 from 663552 to 1097728 tid 2 2024-09-10T17:57:36.798 INFO:tasks.rados.rados.0.smithi012.stdout:388: writing smithi01278544-49 from 1097728 to 1884160 tid 3 2024-09-10T17:57:36.801 INFO:tasks.rados.rados.0.smithi012.stdout:388: writing smithi01278544-49 from 1884160 to 2269184 tid 4 2024-09-10T17:57:36.802 INFO:tasks.rados.rados.0.smithi012.stdout:386: finishing rollback tid 0 to smithi01278544-15 2024-09-10T17:57:36.802 INFO:tasks.rados.rados.0.smithi012.stdout:386: finishing rollback tid 1 to smithi01278544-15 2024-09-10T17:57:36.802 INFO:tasks.rados.rados.0.smithi012.stdout:386: finishing rollback tid 2 to smithi01278544-15 2024-09-10T17:57:36.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 126 (ObjNum 65 snap 0 seq_num 1331322465) dirty exists 2024-09-10T17:57:36.803 INFO:tasks.rados.rados.0.smithi012.stdout:384: finishing copy_from racing read to smithi01278544-22 2024-09-10T17:57:36.803 INFO:tasks.rados.rados.0.smithi012.stdout:384: finishing copy_from to smithi01278544-22 2024-09-10T17:57:36.803 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 116 (ObjNum 123 snap 31 seq_num 123) dirty exists 2024-09-10T17:57:36.803 INFO:tasks.rados.rados.0.smithi012.stdout:388: finishing write tid 1 to smithi01278544-49 2024-09-10T17:57:36.803 INFO:tasks.rados.rados.0.smithi012.stdout:388: finishing write tid 2 to smithi01278544-49 2024-09-10T17:57:36.803 INFO:tasks.rados.rados.0.smithi012.stdout:384: done (2 left) 2024-09-10T17:57:36.803 INFO:tasks.rados.rados.0.smithi012.stdout:386: done (1 left) 2024-09-10T17:57:36.803 INFO:tasks.rados.rados.0.smithi012.stdout:389: delete oid 5 current snap is 35 2024-09-10T17:57:36.805 INFO:tasks.rados.rados.0.smithi012.stdout:388: finishing write tid 3 to smithi01278544-49 2024-09-10T17:57:36.805 INFO:tasks.rados.rados.0.smithi012.stdout:389: done (1 left) 2024-09-10T17:57:36.805 INFO:tasks.rados.rados.0.smithi012.stdout:390: read oid 25 snap 32 2024-09-10T17:57:36.805 INFO:tasks.rados.rados.0.smithi012.stdout:390: expect (ObjNum 125 snap 31 seq_num 125) 2024-09-10T17:57:36.805 INFO:tasks.rados.rados.0.smithi012.stdout:391: read oid 46 snap -1 2024-09-10T17:57:36.805 INFO:tasks.rados.rados.0.smithi012.stdout:391: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:36.805 INFO:tasks.rados.rados.0.smithi012.stdout:392: read oid 40 snap -1 2024-09-10T17:57:36.805 INFO:tasks.rados.rados.0.smithi012.stdout:392: expect deleted 2024-09-10T17:57:36.806 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 35 2024-09-10T17:57:36.806 INFO:tasks.rados.rados.0.smithi012.stdout:393: seq_num 137 ranges {778240=704512,1482752=655360,2138112=753664,2891776=196608} 2024-09-10T17:57:36.813 INFO:tasks.rados.rados.0.smithi012.stdout:393: writing smithi01278544-48 from 778240 to 1482752 tid 1 2024-09-10T17:57:36.817 INFO:tasks.rados.rados.0.smithi012.stdout:393: writing smithi01278544-48 from 1482752 to 2138112 tid 2 2024-09-10T17:57:36.821 INFO:tasks.rados.rados.0.smithi012.stdout:393: writing smithi01278544-48 from 2138112 to 2891776 tid 3 2024-09-10T17:57:36.823 INFO:tasks.rados.rados.0.smithi012.stdout:393: writing smithi01278544-48 from 2891776 to 3088384 tid 4 2024-09-10T17:57:36.823 INFO:tasks.rados.rados.0.smithi012.stdout:394: read oid 10 snap -1 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:394: expect (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:395: rollback oid 36 current snap is 35 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 31 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: finishing write tid 4 to smithi01278544-49 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: finishing write tid 5 to smithi01278544-49 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: finishing write tid 6 to smithi01278544-49 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: oid 49 updating version 0 to 136 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: oid 49 updating version 136 to 138 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: oid 49 version 138 is already newer than 137 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: oid 49 updating version 138 to 139 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: oid 49 version 139 is already newer than 133 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 139 (ObjNum 135 snap 35 seq_num 135) dirty exists 2024-09-10T17:57:36.824 INFO:tasks.rados.rados.0.smithi012.stdout:388: left oid 49 (ObjNum 135 snap 35 seq_num 135) 2024-09-10T17:57:36.825 INFO:tasks.rados.rados.0.smithi012.stdout:391: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:36.845 INFO:tasks.rados.rados.0.smithi012.stdout:393: finishing write tid 1 to smithi01278544-48 2024-09-10T17:57:36.845 INFO:tasks.rados.rados.0.smithi012.stdout:390: expect (ObjNum 125 snap 31 seq_num 125) 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:393: finishing write tid 2 to smithi01278544-48 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:393: finishing write tid 3 to smithi01278544-48 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:393: finishing write tid 4 to smithi01278544-48 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:393: finishing write tid 5 to smithi01278544-48 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:395: finishing rollback tid 0 to smithi01278544-36 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:395: finishing rollback tid 1 to smithi01278544-36 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:395: finishing rollback tid 2 to smithi01278544-36 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 70 (ObjNum 117 snap 29 seq_num 117) dirty exists 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:393: finishing write tid 6 to smithi01278544-48 2024-09-10T17:57:36.927 INFO:tasks.rados.rados.0.smithi012.stdout:393: oid 48 updating version 0 to 108 2024-09-10T17:57:36.928 INFO:tasks.rados.rados.0.smithi012.stdout:393: oid 48 version 108 is already newer than 107 2024-09-10T17:57:36.928 INFO:tasks.rados.rados.0.smithi012.stdout:393: oid 48 updating version 108 to 109 2024-09-10T17:57:36.928 INFO:tasks.rados.rados.0.smithi012.stdout:393: oid 48 updating version 109 to 110 2024-09-10T17:57:36.928 INFO:tasks.rados.rados.0.smithi012.stdout:393: oid 48 version 110 is already newer than 106 2024-09-10T17:57:36.928 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 110 (ObjNum 137 snap 35 seq_num 137) dirty exists 2024-09-10T17:57:36.928 INFO:tasks.rados.rados.0.smithi012.stdout:393: left oid 48 (ObjNum 137 snap 35 seq_num 137) 2024-09-10T17:57:36.928 INFO:tasks.rados.rados.0.smithi012.stdout:394: expect (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:57:36.961 INFO:tasks.rados.rados.0.smithi012.stdout:388: done (6 left) 2024-09-10T17:57:36.961 INFO:tasks.rados.rados.0.smithi012.stdout:390: done (5 left) 2024-09-10T17:57:36.961 INFO:tasks.rados.rados.0.smithi012.stdout:391: done (4 left) 2024-09-10T17:57:36.961 INFO:tasks.rados.rados.0.smithi012.stdout:392: done (3 left) 2024-09-10T17:57:36.961 INFO:tasks.rados.rados.0.smithi012.stdout:393: done (2 left) 2024-09-10T17:57:36.961 INFO:tasks.rados.rados.0.smithi012.stdout:394: done (1 left) 2024-09-10T17:57:36.961 INFO:tasks.rados.rados.0.smithi012.stdout:395: done (0 left) 2024-09-10T17:57:36.961 INFO:tasks.rados.rados.0.smithi012.stdout:396: delete oid 44 current snap is 35 2024-09-10T17:57:36.963 INFO:tasks.rados.rados.0.smithi012.stdout:396: done (0 left) 2024-09-10T17:57:36.963 INFO:tasks.rados.rados.0.smithi012.stdout:397: copy_from oid 28 from oid 37 current snap is 35 2024-09-10T17:57:36.963 INFO:tasks.rados.rados.0.smithi012.stdout:398: read oid 15 snap -1 2024-09-10T17:57:36.963 INFO:tasks.rados.rados.0.smithi012.stdout:398: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:57:36.963 INFO:tasks.rados.rados.0.smithi012.stdout:399: rmattr oid 32 current snap is 35 2024-09-10T17:57:36.963 INFO:tasks.rados.rados.0.smithi012.stdout:399: done (2 left) 2024-09-10T17:57:36.963 INFO:tasks.rados.rados.0.smithi012.stdout:400: rollback oid 7 current snap is 35 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 7 to 20 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:401: rollback oid 46 current snap is 35 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 22 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:402: read oid 45 snap -1 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:402: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:403: rollback oid 30 current snap is 35 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 31 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:404: delete oid 41 current snap is 35 2024-09-10T17:57:36.964 INFO:tasks.rados.rados.0.smithi012.stdout:398: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:57:36.967 INFO:tasks.rados.rados.0.smithi012.stdout:400: finishing rollback tid 0 to smithi01278544-7 2024-09-10T17:57:36.968 INFO:tasks.rados.rados.0.smithi012.stdout:401: finishing rollback tid 0 to smithi01278544-46 2024-09-10T17:57:36.968 INFO:tasks.rados.rados.0.smithi012.stdout:398: done (6 left) 2024-09-10T17:57:36.968 INFO:tasks.rados.rados.0.smithi012.stdout:404: done (5 left) 2024-09-10T17:57:36.968 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 35 2024-09-10T17:57:36.968 INFO:tasks.rados.rados.0.smithi012.stdout:403: finishing rollback tid 0 to smithi01278544-30 2024-09-10T17:57:36.968 INFO:tasks.rados.rados.0.smithi012.stdout:400: finishing rollback tid 1 to smithi01278544-7 2024-09-10T17:57:36.968 INFO:tasks.rados.rados.0.smithi012.stdout:405: seq_num 140 ranges {2146304=753664,2899968=704512,3604480=524288,4128768=376832} 2024-09-10T17:57:36.983 INFO:tasks.rados.rados.0.smithi012.stdout:405: writing smithi01278544-36 from 2146304 to 2899968 tid 1 2024-09-10T17:57:36.987 INFO:tasks.rados.rados.0.smithi012.stdout:405: writing smithi01278544-36 from 2899968 to 3604480 tid 2 2024-09-10T17:57:36.990 INFO:tasks.rados.rados.0.smithi012.stdout:405: writing smithi01278544-36 from 3604480 to 4128768 tid 3 2024-09-10T17:57:36.992 INFO:tasks.rados.rados.0.smithi012.stdout:405: writing smithi01278544-36 from 4128768 to 4505600 tid 4 2024-09-10T17:57:36.992 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 35 2024-09-10T17:57:36.992 INFO:tasks.rados.rados.0.smithi012.stdout:406: seq_num 141 ranges {3473408=770048,4243456=589824,4833280=729088,5562368=286720} 2024-09-10T17:57:37.015 INFO:tasks.rados.rados.0.smithi012.stdout:406: writing smithi01278544-26 from 3473408 to 4243456 tid 1 2024-09-10T17:57:37.019 INFO:tasks.rados.rados.0.smithi012.stdout:406: writing smithi01278544-26 from 4243456 to 4833280 tid 2 2024-09-10T17:57:37.023 INFO:tasks.rados.rados.0.smithi012.stdout:406: writing smithi01278544-26 from 4833280 to 5562368 tid 3 2024-09-10T17:57:37.025 INFO:tasks.rados.rados.0.smithi012.stdout:406: writing smithi01278544-26 from 5562368 to 5849088 tid 4 2024-09-10T17:57:37.025 INFO:tasks.rados.rados.0.smithi012.stdout:407: read oid 17 snap -1 2024-09-10T17:57:37.025 INFO:tasks.rados.rados.0.smithi012.stdout:407: expect (ObjNum 98 snap 18 seq_num 98) 2024-09-10T17:57:37.025 INFO:tasks.rados.rados.0.smithi012.stdout:408: read oid 24 snap -1 2024-09-10T17:57:37.025 INFO:tasks.rados.rados.0.smithi012.stdout:408: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:37.026 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 35 2024-09-10T17:57:37.026 INFO:tasks.rados.rados.0.smithi012.stdout:409: seq_num 142 ranges {3072000=786432,3858432=475136,4333568=540672,4874240=589824} 2024-09-10T17:57:37.046 INFO:tasks.rados.rados.0.smithi012.stdout:409: writing smithi01278544-23 from 3072000 to 3858432 tid 1 2024-09-10T17:57:37.049 INFO:tasks.rados.rados.0.smithi012.stdout:409: writing smithi01278544-23 from 3858432 to 4333568 tid 2 2024-09-10T17:57:37.052 INFO:tasks.rados.rados.0.smithi012.stdout:409: writing smithi01278544-23 from 4333568 to 4874240 tid 3 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:409: writing smithi01278544-23 from 4874240 to 5464064 tid 4 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:410: read oid 42 snap -1 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:410: expect (ObjNum 113 snap 26 seq_num 113) 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:411: read oid 34 snap -1 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:411: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:412: rmattr oid 44 current snap is 35 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:412: done (12 left) 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:413: setattr oid 43 current snap is 35 2024-09-10T17:57:37.056 INFO:tasks.rados.rados.0.smithi012.stdout:397: finishing copy_from to smithi01278544-28 2024-09-10T17:57:37.057 INFO:tasks.rados.rados.0.smithi012.stdout:397: got expected ENOENT (src dne) 2024-09-10T17:57:37.057 INFO:tasks.rados.rados.0.smithi012.stdout:397: finishing copy_from racing read to smithi01278544-28 2024-09-10T17:57:37.057 INFO:tasks.rados.rados.0.smithi012.stdout:402: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:403: finishing rollback tid 1 to smithi01278544-30 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:400: finishing rollback tid 2 to smithi01278544-7 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 6 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:403: finishing rollback tid 2 to smithi01278544-30 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 91 (ObjNum 73 snap 10 seq_num 73) dirty exists 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:401: finishing rollback tid 1 to smithi01278544-46 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:401: finishing rollback tid 2 to smithi01278544-46 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 107 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:405: finishing write tid 1 to smithi01278544-36 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:405: finishing write tid 2 to smithi01278544-36 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:405: finishing write tid 3 to smithi01278544-36 2024-09-10T17:57:37.076 INFO:tasks.rados.rados.0.smithi012.stdout:405: finishing write tid 4 to smithi01278544-36 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:405: finishing write tid 5 to smithi01278544-36 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:405: finishing write tid 6 to smithi01278544-36 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:405: oid 36 updating version 0 to 73 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:405: oid 36 updating version 73 to 74 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:405: oid 36 version 74 is already newer than 72 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:405: oid 36 version 74 is already newer than 71 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:405: oid 36 updating version 74 to 75 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 75 (ObjNum 140 snap 35 seq_num 140) dirty exists 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:405: left oid 36 (ObjNum 140 snap 35 seq_num 140) 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:406: finishing write tid 1 to smithi01278544-26 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:406: finishing write tid 2 to smithi01278544-26 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:406: finishing write tid 3 to smithi01278544-26 2024-09-10T17:57:37.077 INFO:tasks.rados.rados.0.smithi012.stdout:406: finishing write tid 4 to smithi01278544-26 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:406: finishing write tid 5 to smithi01278544-26 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:406: finishing write tid 6 to smithi01278544-26 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:406: oid 26 updating version 0 to 79 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:406: oid 26 version 79 is already newer than 77 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:406: oid 26 updating version 79 to 81 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:406: oid 26 version 81 is already newer than 80 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:406: oid 26 version 81 is already newer than 78 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 81 (ObjNum 141 snap 35 seq_num 141) dirty exists 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:406: left oid 26 (ObjNum 141 snap 35 seq_num 141) 2024-09-10T17:57:37.078 INFO:tasks.rados.rados.0.smithi012.stdout:407: expect (ObjNum 98 snap 18 seq_num 98) 2024-09-10T17:57:37.201 INFO:tasks.rados.rados.0.smithi012.stdout:408: expect (ObjNum 66 snap 6 seq_num 66) 2024-09-10T17:57:37.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:36 smithi012 ceph-mon[37454]: mgrmap e24: y(active, since 3m), standbys: x 2024-09-10T17:57:37.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:36 smithi012 ceph-mon[37454]: osdmap e142: 8 total, 8 up, 8 in 2024-09-10T17:57:37.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:36 smithi012 ceph-mon[37454]: pgmap v194: 121 pgs: 121 active+clean; 103 MiB data, 410 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T17:57:37.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:36 smithi012 ceph-mon[37454]: osdmap e143: 8 total, 8 up, 8 in 2024-09-10T17:57:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:36 smithi012 ceph-mon[27356]: mgrmap e24: y(active, since 3m), standbys: x 2024-09-10T17:57:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:36 smithi012 ceph-mon[27356]: osdmap e142: 8 total, 8 up, 8 in 2024-09-10T17:57:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:36 smithi012 ceph-mon[27356]: pgmap v194: 121 pgs: 121 active+clean; 103 MiB data, 410 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T17:57:37.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:36 smithi012 ceph-mon[27356]: osdmap e143: 8 total, 8 up, 8 in 2024-09-10T17:57:37.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:36 smithi089 ceph-mon[31467]: mgrmap e24: y(active, since 3m), standbys: x 2024-09-10T17:57:37.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:36 smithi089 ceph-mon[31467]: osdmap e142: 8 total, 8 up, 8 in 2024-09-10T17:57:37.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:36 smithi089 ceph-mon[31467]: pgmap v194: 121 pgs: 121 active+clean; 103 MiB data, 410 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T17:57:37.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:36 smithi089 ceph-mon[31467]: osdmap e143: 8 total, 8 up, 8 in 2024-09-10T17:57:37.291 INFO:tasks.rados.rados.0.smithi012.stdout:409: finishing write tid 1 to smithi01278544-23 2024-09-10T17:57:37.292 INFO:tasks.rados.rados.0.smithi012.stdout:409: finishing write tid 2 to smithi01278544-23 2024-09-10T17:57:37.292 INFO:tasks.rados.rados.0.smithi012.stdout:409: finishing write tid 3 to smithi01278544-23 2024-09-10T17:57:37.292 INFO:tasks.rados.rados.0.smithi012.stdout:409: finishing write tid 4 to smithi01278544-23 2024-09-10T17:57:37.292 INFO:tasks.rados.rados.0.smithi012.stdout:409: finishing write tid 5 to smithi01278544-23 2024-09-10T17:57:37.292 INFO:tasks.rados.rados.0.smithi012.stdout:411: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:409: finishing write tid 6 to smithi01278544-23 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:409: oid 23 updating version 0 to 141 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:409: oid 23 version 141 is already newer than 139 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:409: oid 23 version 141 is already newer than 138 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:409: oid 23 version 141 is already newer than 137 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:409: oid 23 version 141 is already newer than 140 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 141 (ObjNum 142 snap 35 seq_num 142) dirty exists 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:409: left oid 23 (ObjNum 142 snap 35 seq_num 142) 2024-09-10T17:57:37.312 INFO:tasks.rados.rados.0.smithi012.stdout:410: expect (ObjNum 113 snap 26 seq_num 113) 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 173 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:397: done (12 left) 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:400: done (11 left) 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:401: done (10 left) 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:402: done (9 left) 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:403: done (8 left) 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:405: done (7 left) 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:406: done (6 left) 2024-09-10T17:57:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:407: done (5 left) 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:408: done (4 left) 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:409: done (3 left) 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:410: done (2 left) 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:411: done (1 left) 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:413: done (0 left) 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:414: rmattr oid 27 current snap is 35 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:414: done (0 left) 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:415: setattr oid 40 current snap is 35 2024-09-10T17:57:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:416: snap_create 2024-09-10T17:57:37.392 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 174 (ObjNum 81 snap 0 seq_num 0) dirty exists 2024-09-10T17:57:37.903 INFO:tasks.rados.rados.0.smithi012.stdout:415: done (1 left) 2024-09-10T17:57:37.903 INFO:tasks.rados.rados.0.smithi012.stdout:416: done (0 left) 2024-09-10T17:57:37.903 INFO:tasks.rados.rados.0.smithi012.stdout:417: setattr oid 39 current snap is 36 2024-09-10T17:57:37.905 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 36 2024-09-10T17:57:37.905 INFO:tasks.rados.rados.0.smithi012.stdout:418: seq_num 143 ranges {4292608=802816,5095424=761856,5857280=745472,6602752=98304} 2024-09-10T17:57:37.933 INFO:tasks.rados.rados.0.smithi012.stdout:418: writing smithi01278544-22 from 4292608 to 5095424 tid 1 2024-09-10T17:57:37.937 INFO:tasks.rados.rados.0.smithi012.stdout:418: writing smithi01278544-22 from 5095424 to 5857280 tid 2 2024-09-10T17:57:37.941 INFO:tasks.rados.rados.0.smithi012.stdout:418: writing smithi01278544-22 from 5857280 to 6602752 tid 3 2024-09-10T17:57:37.942 INFO:tasks.rados.rados.0.smithi012.stdout:418: writing smithi01278544-22 from 6602752 to 6701056 tid 4 2024-09-10T17:57:37.942 INFO:tasks.rados.rados.0.smithi012.stdout:419: snap_remove snap 22 2024-09-10T17:57:38.916 INFO:tasks.rados.rados.0.smithi012.stdout:419: done (2 left) 2024-09-10T17:57:38.916 INFO:tasks.rados.rados.0.smithi012.stdout:420: rmattr oid 7 current snap is 36 2024-09-10T17:57:38.916 INFO:tasks.rados.rados.0.smithi012.stdout:420: done (2 left) 2024-09-10T17:57:38.916 INFO:tasks.rados.rados.0.smithi012.stdout:421: copy_from oid 19 from oid 37 current snap is 36 2024-09-10T17:57:38.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 134 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-10T17:57:38.916 INFO:tasks.rados.rados.0.smithi012.stdout:418: finishing write tid 1 to smithi01278544-22 2024-09-10T17:57:38.916 INFO:tasks.rados.rados.0.smithi012.stdout:418: finishing write tid 2 to smithi01278544-22 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: finishing write tid 3 to smithi01278544-22 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: finishing write tid 4 to smithi01278544-22 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: finishing write tid 5 to smithi01278544-22 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: finishing write tid 6 to smithi01278544-22 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: oid 22 updating version 0 to 138 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: oid 22 version 138 is already newer than 137 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: oid 22 updating version 138 to 139 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: oid 22 version 139 is already newer than 136 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: oid 22 version 139 is already newer than 135 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 139 (ObjNum 143 snap 36 seq_num 143) dirty exists 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: left oid 22 (ObjNum 143 snap 36 seq_num 143) 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:417: done (2 left) 2024-09-10T17:57:38.917 INFO:tasks.rados.rados.0.smithi012.stdout:418: done (1 left) 2024-09-10T17:57:38.918 INFO:tasks.rados.rados.0.smithi012.stdout:422: copy_from oid 48 from oid 31 current snap is 36 2024-09-10T17:57:38.918 INFO:tasks.rados.rados.0.smithi012.stdout:423: delete oid 16 current snap is 36 2024-09-10T17:57:38.924 INFO:tasks.rados.rados.0.smithi012.stdout:423: done (2 left) 2024-09-10T17:57:38.924 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 36 2024-09-10T17:57:38.924 INFO:tasks.rados.rados.0.smithi012.stdout:424: seq_num 145 ranges {0=32768} 2024-09-10T17:57:38.924 INFO:tasks.rados.rados.0.smithi012.stdout:424: writing smithi01278544-21 from 0 to 32768 tid 1 2024-09-10T17:57:38.924 INFO:tasks.rados.rados.0.smithi012.stdout:425: delete oid 39 current snap is 36 2024-09-10T17:57:38.926 INFO:tasks.rados.rados.0.smithi012.stdout:421: finishing copy_from to smithi01278544-19 2024-09-10T17:57:38.926 INFO:tasks.rados.rados.0.smithi012.stdout:421: got expected ENOENT (src dne) 2024-09-10T17:57:38.927 INFO:tasks.rados.rados.0.smithi012.stdout:421: finishing copy_from racing read to smithi01278544-19 2024-09-10T17:57:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:421: done (3 left) 2024-09-10T17:57:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:425: done (2 left) 2024-09-10T17:57:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 36 2024-09-10T17:57:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:426: seq_num 147 ranges {172032=65536} 2024-09-10T17:57:38.930 INFO:tasks.rados.rados.0.smithi012.stdout:426: writing smithi01278544-43 from 172032 to 237568 tid 1 2024-09-10T17:57:38.930 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 36 2024-09-10T17:57:38.930 INFO:tasks.rados.rados.0.smithi012.stdout:427: seq_num 148 ranges {2162688=81920} 2024-09-10T17:57:38.943 INFO:tasks.rados.rados.0.smithi012.stdout:427: writing smithi01278544-38 from 2162688 to 2244608 tid 1 2024-09-10T17:57:38.943 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 36 2024-09-10T17:57:38.943 INFO:tasks.rados.rados.0.smithi012.stdout:428: seq_num 149 ranges {0=98304} 2024-09-10T17:57:38.944 INFO:tasks.rados.rados.0.smithi012.stdout:428: writing smithi01278544-15 from 0 to 98304 tid 1 2024-09-10T17:57:38.944 INFO:tasks.rados.rados.0.smithi012.stdout:429: read oid 25 snap -1 2024-09-10T17:57:38.944 INFO:tasks.rados.rados.0.smithi012.stdout:429: expect (ObjNum 125 snap 31 seq_num 125) 2024-09-10T17:57:38.944 INFO:tasks.rados.rados.0.smithi012.stdout:430: snap_remove snap 31 2024-09-10T17:57:39.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:38 smithi012 ceph-mon[27356]: osdmap e144: 8 total, 8 up, 8 in 2024-09-10T17:57:39.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:38 smithi012 ceph-mon[27356]: pgmap v197: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2024-09-10T17:57:39.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:38 smithi012 ceph-mon[37454]: osdmap e144: 8 total, 8 up, 8 in 2024-09-10T17:57:39.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:38 smithi012 ceph-mon[37454]: pgmap v197: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2024-09-10T17:57:39.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:38 smithi089 ceph-mon[31467]: osdmap e144: 8 total, 8 up, 8 in 2024-09-10T17:57:39.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:38 smithi089 ceph-mon[31467]: pgmap v197: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2024-09-10T17:57:39.919 INFO:tasks.rados.rados.0.smithi012.stdout:430: done (6 left) 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:431: rollback oid 35 current snap is 36 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 35 to 32 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:432: delete oid 44 current snap is 36 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:424: finishing write tid 1 to smithi01278544-21 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:424: finishing write tid 2 to smithi01278544-21 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:424: finishing write tid 3 to smithi01278544-21 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:424: oid 21 updating version 0 to 147 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:424: oid 21 version 147 is already newer than 146 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 147 (ObjNum 145 snap 36 seq_num 145) dirty exists 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:424: left oid 21 (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:57:39.920 INFO:tasks.rados.rados.0.smithi012.stdout:426: finishing write tid 1 to smithi01278544-43 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:426: finishing write tid 2 to smithi01278544-43 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:426: finishing write tid 3 to smithi01278544-43 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:426: oid 43 updating version 0 to 181 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:426: oid 43 version 181 is already newer than 180 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 181 (ObjNum 147 snap 36 seq_num 147) dirty exists 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:426: left oid 43 (ObjNum 147 snap 36 seq_num 147) 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:422: finishing copy_from racing read to smithi01278544-48 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:422: finishing copy_from to smithi01278544-48 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 102 (ObjNum 118 snap 29 seq_num 118) dirty exists 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:427: finishing write tid 1 to smithi01278544-38 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:427: finishing write tid 2 to smithi01278544-38 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:427: finishing write tid 3 to smithi01278544-38 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:427: oid 38 updating version 0 to 119 2024-09-10T17:57:39.921 INFO:tasks.rados.rados.0.smithi012.stdout:427: oid 38 version 119 is already newer than 118 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 119 (ObjNum 148 snap 36 seq_num 148) dirty exists 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:427: left oid 38 (ObjNum 148 snap 36 seq_num 148) 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:428: finishing write tid 1 to smithi01278544-15 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:428: finishing write tid 2 to smithi01278544-15 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:428: finishing write tid 3 to smithi01278544-15 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:428: oid 15 updating version 0 to 149 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:428: oid 15 updating version 149 to 150 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 150 (ObjNum 149 snap 36 seq_num 149) dirty exists 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:428: left oid 15 (ObjNum 149 snap 36 seq_num 149) 2024-09-10T17:57:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:429: expect (ObjNum 125 snap 31 seq_num 125) 2024-09-10T17:57:40.006 INFO:tasks.rados.rados.0.smithi012.stdout:431: finishing rollback tid 0 to smithi01278544-35 2024-09-10T17:57:40.006 INFO:tasks.rados.rados.0.smithi012.stdout:431: finishing rollback tid 1 to smithi01278544-35 2024-09-10T17:57:40.006 INFO:tasks.rados.rados.0.smithi012.stdout:431: finishing rollback tid 2 to smithi01278544-35 2024-09-10T17:57:40.006 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 94 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-10T17:57:40.006 INFO:tasks.rados.rados.0.smithi012.stdout:422: done (7 left) 2024-09-10T17:57:40.006 INFO:tasks.rados.rados.0.smithi012.stdout:424: done (6 left) 2024-09-10T17:57:40.006 INFO:tasks.rados.rados.0.smithi012.stdout:426: done (5 left) 2024-09-10T17:57:40.006 INFO:tasks.rados.rados.0.smithi012.stdout:427: done (4 left) 2024-09-10T17:57:40.007 INFO:tasks.rados.rados.0.smithi012.stdout:428: done (3 left) 2024-09-10T17:57:40.007 INFO:tasks.rados.rados.0.smithi012.stdout:429: done (2 left) 2024-09-10T17:57:40.007 INFO:tasks.rados.rados.0.smithi012.stdout:431: done (1 left) 2024-09-10T17:57:40.007 INFO:tasks.rados.rados.0.smithi012.stdout:432: done (0 left) 2024-09-10T17:57:40.007 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 36 2024-09-10T17:57:40.007 INFO:tasks.rados.rados.0.smithi012.stdout:433: seq_num 151 ranges {2269184=131072} 2024-09-10T17:57:40.019 INFO:tasks.rados.rados.0.smithi012.stdout:433: writing smithi01278544-49 from 2269184 to 2400256 tid 1 2024-09-10T17:57:40.019 INFO:tasks.rados.rados.0.smithi012.stdout:434: snap_remove snap 33 2024-09-10T17:57:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:39 smithi012 ceph-mon[27356]: osdmap e145: 8 total, 8 up, 8 in 2024-09-10T17:57:40.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:39 smithi012 ceph-mon[37454]: osdmap e145: 8 total, 8 up, 8 in 2024-09-10T17:57:40.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:39 smithi089 ceph-mon[31467]: osdmap e145: 8 total, 8 up, 8 in 2024-09-10T17:57:40.924 INFO:tasks.rados.rados.0.smithi012.stdout:433: finishing write tid 1 to smithi01278544-49 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:433: finishing write tid 2 to smithi01278544-49 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:433: finishing write tid 3 to smithi01278544-49 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:433: oid 49 updating version 0 to 157 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:433: oid 49 version 157 is already newer than 156 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 157 (ObjNum 151 snap 36 seq_num 151) dirty exists 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:433: left oid 49 (ObjNum 151 snap 36 seq_num 151) 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:433: done (1 left) 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:434: done (0 left) 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:435: copy_from oid 5 from oid 32 current snap is 36 2024-09-10T17:57:40.925 INFO:tasks.rados.rados.0.smithi012.stdout:436: setattr oid 26 current snap is 36 2024-09-10T17:57:40.928 INFO:tasks.rados.rados.0.smithi012.stdout:437: rollback oid 29 current snap is 36 2024-09-10T17:57:40.928 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 29 to 27 2024-09-10T17:57:40.928 INFO:tasks.rados.rados.0.smithi012.stdout:438: setattr oid 40 current snap is 36 2024-09-10T17:57:40.931 INFO:tasks.rados.rados.0.smithi012.stdout:435: finishing copy_from to smithi01278544-5 2024-09-10T17:57:40.931 INFO:tasks.rados.rados.0.smithi012.stdout:435: got expected ENOENT (src dne) 2024-09-10T17:57:40.931 INFO:tasks.rados.rados.0.smithi012.stdout:435: finishing copy_from racing read to smithi01278544-5 2024-09-10T17:57:40.931 INFO:tasks.rados.rados.0.smithi012.stdout:435: done (3 left) 2024-09-10T17:57:40.932 INFO:tasks.rados.rados.0.smithi012.stdout:439: snap_create 2024-09-10T17:57:40.934 INFO:tasks.rados.rados.0.smithi012.stdout:437: finishing rollback tid 0 to smithi01278544-29 2024-09-10T17:57:40.934 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 95 (ObjNum 141 snap 35 seq_num 141) dirty exists 2024-09-10T17:57:40.936 INFO:tasks.rados.rados.0.smithi012.stdout:437: finishing rollback tid 1 to smithi01278544-29 2024-09-10T17:57:40.937 INFO:tasks.rados.rados.0.smithi012.stdout:437: finishing rollback tid 2 to smithi01278544-29 2024-09-10T17:57:40.937 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 19 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:57:40.939 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 193 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T17:57:41.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:40 smithi012 ceph-mon[27356]: osdmap e146: 8 total, 8 up, 8 in 2024-09-10T17:57:41.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:40 smithi012 ceph-mon[27356]: pgmap v200: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2024-09-10T17:57:41.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:40 smithi012 ceph-mon[37454]: osdmap e146: 8 total, 8 up, 8 in 2024-09-10T17:57:41.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:40 smithi012 ceph-mon[37454]: pgmap v200: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2024-09-10T17:57:41.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:40 smithi089 ceph-mon[31467]: osdmap e146: 8 total, 8 up, 8 in 2024-09-10T17:57:41.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:40 smithi089 ceph-mon[31467]: pgmap v200: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2024-09-10T17:57:41.784 INFO:tasks.rados.rados.0.smithi012.stdout:436: done (3 left) 2024-09-10T17:57:41.785 INFO:tasks.rados.rados.0.smithi012.stdout:437: done (2 left) 2024-09-10T17:57:41.785 INFO:tasks.rados.rados.0.smithi012.stdout:438: done (1 left) 2024-09-10T17:57:41.785 INFO:tasks.rados.rados.0.smithi012.stdout:439: done (0 left) 2024-09-10T17:57:41.785 INFO:tasks.rados.rados.0.smithi012.stdout:440: snap_create 2024-09-10T17:57:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:41 smithi012 ceph-mon[27356]: osdmap e147: 8 total, 8 up, 8 in 2024-09-10T17:57:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:41 smithi012 ceph-mon[27356]: osdmap e148: 8 total, 8 up, 8 in 2024-09-10T17:57:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:41 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:41 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:41 smithi012 ceph-mon[37454]: osdmap e147: 8 total, 8 up, 8 in 2024-09-10T17:57:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:41 smithi012 ceph-mon[37454]: osdmap e148: 8 total, 8 up, 8 in 2024-09-10T17:57:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:41 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:41 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:42.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:41 smithi089 ceph-mon[31467]: osdmap e147: 8 total, 8 up, 8 in 2024-09-10T17:57:42.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:41 smithi089 ceph-mon[31467]: osdmap e148: 8 total, 8 up, 8 in 2024-09-10T17:57:42.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:41 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:42.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:41 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:42.786 INFO:tasks.rados.rados.0.smithi012.stdout:440: done (0 left) 2024-09-10T17:57:42.786 INFO:tasks.rados.rados.0.smithi012.stdout:441: setattr oid 4 current snap is 38 2024-09-10T17:57:42.788 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 38 2024-09-10T17:57:42.789 INFO:tasks.rados.rados.0.smithi012.stdout:442: seq_num 152 ranges {221184=147456} 2024-09-10T17:57:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:442: writing smithi01278544-14 from 221184 to 368640 tid 1 2024-09-10T17:57:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:443: read oid 16 snap 36 2024-09-10T17:57:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:443: expect deleted 2024-09-10T17:57:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:444: rmattr oid 10 current snap is 38 2024-09-10T17:57:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:444: done (3 left) 2024-09-10T17:57:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:445: copy_from oid 41 from oid 17 current snap is 38 2024-09-10T17:57:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:446: delete oid 32 current snap is 38 2024-09-10T17:57:42.796 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 162 (ObjNum 130 snap 35 seq_num 130) dirty exists 2024-09-10T17:57:42.797 INFO:tasks.rados.rados.0.smithi012.stdout:442: finishing write tid 1 to smithi01278544-14 2024-09-10T17:57:42.797 INFO:tasks.rados.rados.0.smithi012.stdout:442: finishing write tid 2 to smithi01278544-14 2024-09-10T17:57:42.798 INFO:tasks.rados.rados.0.smithi012.stdout:441: done (4 left) 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:443: done (3 left) 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:446: done (2 left) 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:447: rmattr oid 20 current snap is 38 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:448: rollback oid 13 current snap is 38 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 13 to 37 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:449: copy_from oid 23 from oid 3 current snap is 38 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:450: read oid 6 snap -1 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:450: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:57:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:451: snap_remove snap 24 2024-09-10T17:57:43.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:43 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:43.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:43 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:43.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:43 smithi089 ceph-mon[31467]: pgmap v203: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:43.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:43 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:43.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:43 smithi089 ceph-mon[31467]: osdmap e149: 8 total, 8 up, 8 in 2024-09-10T17:57:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[27356]: pgmap v203: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[27356]: osdmap e149: 8 total, 8 up, 8 in 2024-09-10T17:57:43.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[37454]: pgmap v203: 121 pgs: 121 active+clean; 124 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-mon[37454]: osdmap e149: 8 total, 8 up, 8 in 2024-09-10T17:57:43.793 INFO:tasks.rados.rados.0.smithi012.stdout:451: done (6 left) 2024-09-10T17:57:43.793 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 38 2024-09-10T17:57:43.793 INFO:tasks.rados.rados.0.smithi012.stdout:450: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:57:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:442: finishing write tid 3 to smithi01278544-14 2024-09-10T17:57:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:442: oid 14 updating version 0 to 199 2024-09-10T17:57:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:442: oid 14 updating version 199 to 200 2024-09-10T17:57:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 200 (ObjNum 152 snap 38 seq_num 152) dirty exists 2024-09-10T17:57:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:442: left oid 14 (ObjNum 152 snap 38 seq_num 152) 2024-09-10T17:57:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:448: finishing rollback tid 0 to smithi01278544-13 2024-09-10T17:57:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:448: finishing rollback tid 1 to smithi01278544-13 2024-09-10T17:57:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:449: finishing copy_from to smithi01278544-23 2024-09-10T17:57:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:449: got expected ENOENT (src dne) 2024-09-10T17:57:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 141 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T17:57:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:449: finishing copy_from racing read to smithi01278544-23 2024-09-10T17:57:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:448: finishing rollback tid 2 to smithi01278544-13 2024-09-10T17:57:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 166 (ObjNum 123 snap 31 seq_num 123) dirty exists 2024-09-10T17:57:43.801 INFO:tasks.rados.rados.0.smithi012.stdout:445: finishing copy_from racing read to smithi01278544-41 2024-09-10T17:57:43.801 INFO:tasks.rados.rados.0.smithi012.stdout:445: finishing copy_from to smithi01278544-41 2024-09-10T17:57:43.801 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 24 (ObjNum 98 snap 18 seq_num 98) dirty exists 2024-09-10T17:57:43.801 INFO:tasks.rados.rados.0.smithi012.stdout:452: seq_num 154 ranges {0=180224} 2024-09-10T17:57:43.802 INFO:tasks.rados.rados.0.smithi012.stdout:452: writing smithi01278544-32 from 0 to 180224 tid 1 2024-09-10T17:57:43.802 INFO:tasks.rados.rados.0.smithi012.stdout:442: done (6 left) 2024-09-10T17:57:43.803 INFO:tasks.rados.rados.0.smithi012.stdout:445: done (5 left) 2024-09-10T17:57:43.803 INFO:tasks.rados.rados.0.smithi012.stdout:447: done (4 left) 2024-09-10T17:57:43.803 INFO:tasks.rados.rados.0.smithi012.stdout:448: done (3 left) 2024-09-10T17:57:43.803 INFO:tasks.rados.rados.0.smithi012.stdout:449: done (2 left) 2024-09-10T17:57:43.803 INFO:tasks.rados.rados.0.smithi012.stdout:450: done (1 left) 2024-09-10T17:57:43.803 INFO:tasks.rados.rados.0.smithi012.stdout:453: delete oid 1 current snap is 38 2024-09-10T17:57:43.805 INFO:tasks.rados.rados.0.smithi012.stdout:453: done (1 left) 2024-09-10T17:57:43.805 INFO:tasks.rados.rados.0.smithi012.stdout:454: snap_create 2024-09-10T17:57:43.807 INFO:tasks.rados.rados.0.smithi012.stdout:452: finishing write tid 1 to smithi01278544-32 2024-09-10T17:57:43.807 INFO:tasks.rados.rados.0.smithi012.stdout:452: finishing write tid 2 to smithi01278544-32 2024-09-10T17:57:43.808 INFO:tasks.rados.rados.0.smithi012.stdout:452: finishing write tid 3 to smithi01278544-32 2024-09-10T17:57:43.808 INFO:tasks.rados.rados.0.smithi012.stdout:452: oid 32 updating version 0 to 95 2024-09-10T17:57:43.808 INFO:tasks.rados.rados.0.smithi012.stdout:452: oid 32 updating version 95 to 96 2024-09-10T17:57:43.809 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 96 (ObjNum 154 snap 38 seq_num 154) dirty exists 2024-09-10T17:57:43.809 INFO:tasks.rados.rados.0.smithi012.stdout:452: left oid 32 (ObjNum 154 snap 38 seq_num 154) 2024-09-10T17:57:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:57:43] "GET /metrics HTTP/1.1" 200 36008 "" "Prometheus/2.43.0" 2024-09-10T17:57:44.797 INFO:tasks.rados.rados.0.smithi012.stdout:452: done (1 left) 2024-09-10T17:57:44.797 INFO:tasks.rados.rados.0.smithi012.stdout:454: done (0 left) 2024-09-10T17:57:44.797 INFO:tasks.rados.rados.0.smithi012.stdout:455: snap_create 2024-09-10T17:57:44.823 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:44 smithi089 ceph-mon[31467]: osdmap e150: 8 total, 8 up, 8 in 2024-09-10T17:57:44.823 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:44 smithi089 ceph-mon[31467]: pgmap v206: 121 pgs: 121 active+clean; 130 MiB data, 478 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2024-09-10T17:57:45.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:44 smithi012 ceph-mon[37454]: osdmap e150: 8 total, 8 up, 8 in 2024-09-10T17:57:45.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:44 smithi012 ceph-mon[37454]: pgmap v206: 121 pgs: 121 active+clean; 130 MiB data, 478 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2024-09-10T17:57:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:44 smithi012 ceph-mon[27356]: osdmap e150: 8 total, 8 up, 8 in 2024-09-10T17:57:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:44 smithi012 ceph-mon[27356]: pgmap v206: 121 pgs: 121 active+clean; 130 MiB data, 478 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2024-09-10T17:57:45.799 INFO:tasks.rados.rados.0.smithi012.stdout:455: done (0 left) 2024-09-10T17:57:45.799 INFO:tasks.rados.rados.0.smithi012.stdout:456: snap_remove snap 38 2024-09-10T17:57:46.151 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:45 smithi089 ceph-mon[31467]: osdmap e151: 8 total, 8 up, 8 in 2024-09-10T17:57:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:45 smithi012 ceph-mon[27356]: osdmap e151: 8 total, 8 up, 8 in 2024-09-10T17:57:46.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:45 smithi012 ceph-mon[37454]: osdmap e151: 8 total, 8 up, 8 in 2024-09-10T17:57:46.789 INFO:tasks.rados.rados.0.smithi012.stdout:456: done (0 left) 2024-09-10T17:57:46.789 INFO:tasks.rados.rados.0.smithi012.stdout:457: read oid 21 snap -1 2024-09-10T17:57:46.789 INFO:tasks.rados.rados.0.smithi012.stdout:457: expect (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:57:46.789 INFO:tasks.rados.rados.0.smithi012.stdout:458: snap_create 2024-09-10T17:57:46.793 INFO:tasks.rados.rados.0.smithi012.stdout:457: expect (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:57:47.111 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:46 smithi089 ceph-mon[31467]: osdmap e152: 8 total, 8 up, 8 in 2024-09-10T17:57:47.111 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:46 smithi089 ceph-mon[31467]: pgmap v209: 121 pgs: 121 active+clean; 130 MiB data, 478 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2024-09-10T17:57:47.111 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:46 smithi089 ceph-mon[31467]: osdmap e153: 8 total, 8 up, 8 in 2024-09-10T17:57:47.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:46 smithi012 ceph-mon[37454]: osdmap e152: 8 total, 8 up, 8 in 2024-09-10T17:57:47.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:46 smithi012 ceph-mon[37454]: pgmap v209: 121 pgs: 121 active+clean; 130 MiB data, 478 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2024-09-10T17:57:47.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:46 smithi012 ceph-mon[37454]: osdmap e153: 8 total, 8 up, 8 in 2024-09-10T17:57:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:46 smithi012 ceph-mon[27356]: osdmap e152: 8 total, 8 up, 8 in 2024-09-10T17:57:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:46 smithi012 ceph-mon[27356]: pgmap v209: 121 pgs: 121 active+clean; 130 MiB data, 478 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2024-09-10T17:57:47.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:46 smithi012 ceph-mon[27356]: osdmap e153: 8 total, 8 up, 8 in 2024-09-10T17:57:47.789 INFO:tasks.rados.rados.0.smithi012.stdout:457: done (1 left) 2024-09-10T17:57:47.789 INFO:tasks.rados.rados.0.smithi012.stdout:458: done (0 left) 2024-09-10T17:57:47.789 INFO:tasks.rados.rados.0.smithi012.stdout:459: copy_from oid 24 from oid 25 current snap is 41 2024-09-10T17:57:47.790 INFO:tasks.rados.rados.0.smithi012.stdout:460: snap_remove snap 27 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:460: done (1 left) 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:461: rollback oid 16 current snap is 41 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 20 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:462: read oid 35 snap 30 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:462: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:463: copy_from oid 34 from oid 39 current snap is 41 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:464: rollback oid 37 current snap is 41 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 37 to 39 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:465: rollback oid 33 current snap is 41 2024-09-10T17:57:47.947 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 33 to 36 2024-09-10T17:57:47.948 INFO:tasks.rados.rados.0.smithi012.stdout:466: delete oid 18 current snap is 41 2024-09-10T17:57:47.948 INFO:tasks.rados.rados.0.smithi012.stdout:459: finishing copy_from racing read to smithi01278544-24 2024-09-10T17:57:47.948 INFO:tasks.rados.rados.0.smithi012.stdout:459: finishing copy_from to smithi01278544-24 2024-09-10T17:57:47.948 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 132 (ObjNum 125 snap 31 seq_num 125) dirty exists 2024-09-10T17:57:47.952 INFO:tasks.rados.rados.0.smithi012.stdout:463: finishing copy_from to smithi01278544-34 2024-09-10T17:57:47.953 INFO:tasks.rados.rados.0.smithi012.stdout:463: got expected ENOENT (src dne) 2024-09-10T17:57:47.953 INFO:tasks.rados.rados.0.smithi012.stdout:463: finishing copy_from racing read to smithi01278544-34 2024-09-10T17:57:47.955 INFO:tasks.rados.rados.0.smithi012.stdout:462: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:464: finishing rollback tid 1 to smithi01278544-37 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 118 (ObjNum 129 snap 0 seq_num 3494352600) dirty dne 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:461: finishing rollback tid 1 to smithi01278544-16 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:461: finishing rollback tid 2 to smithi01278544-16 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 69 (ObjNum 104 snap 20 seq_num 104) dirty exists 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:465: finishing rollback tid 0 to smithi01278544-33 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:465: finishing rollback tid 1 to smithi01278544-33 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:465: finishing rollback tid 2 to smithi01278544-33 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 216 (ObjNum 106 snap 21 seq_num 106) dirty exists 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:459: done (6 left) 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:461: done (5 left) 2024-09-10T17:57:47.984 INFO:tasks.rados.rados.0.smithi012.stdout:462: done (4 left) 2024-09-10T17:57:47.985 INFO:tasks.rados.rados.0.smithi012.stdout:463: done (3 left) 2024-09-10T17:57:47.985 INFO:tasks.rados.rados.0.smithi012.stdout:464: done (2 left) 2024-09-10T17:57:47.985 INFO:tasks.rados.rados.0.smithi012.stdout:465: done (1 left) 2024-09-10T17:57:47.985 INFO:tasks.rados.rados.0.smithi012.stdout:466: done (0 left) 2024-09-10T17:57:47.985 INFO:tasks.rados.rados.0.smithi012.stdout:467: read oid 48 snap 32 2024-09-10T17:57:47.985 INFO:tasks.rados.rados.0.smithi012.stdout:467: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:47.985 INFO:tasks.rados.rados.0.smithi012.stdout:468: delete oid 19 current snap is 41 2024-09-10T17:57:47.987 INFO:tasks.rados.rados.0.smithi012.stdout:468: done (1 left) 2024-09-10T17:57:47.987 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 41 2024-09-10T17:57:47.987 INFO:tasks.rados.rados.0.smithi012.stdout:469: seq_num 158 ranges {2539520=253952} 2024-09-10T17:57:48.002 INFO:tasks.rados.rados.0.smithi012.stdout:469: writing smithi01278544-42 from 2539520 to 2793472 tid 1 2024-09-10T17:57:48.002 INFO:tasks.rados.rados.0.smithi012.stdout:470: snap_create 2024-09-10T17:57:48.002 INFO:tasks.rados.rados.0.smithi012.stdout:467: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:48.022 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:47 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:47] ENGINE Bus STOPPING 2024-09-10T17:57:48.022 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:48] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:57:48.022 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:48] ENGINE Bus STOPPED 2024-09-10T17:57:48.032 INFO:tasks.rados.rados.0.smithi012.stdout:469: finishing write tid 1 to smithi01278544-42 2024-09-10T17:57:48.033 INFO:tasks.rados.rados.0.smithi012.stdout:469: finishing write tid 2 to smithi01278544-42 2024-09-10T17:57:48.033 INFO:tasks.rados.rados.0.smithi012.stdout:469: finishing write tid 3 to smithi01278544-42 2024-09-10T17:57:48.033 INFO:tasks.rados.rados.0.smithi012.stdout:469: oid 42 updating version 0 to 229 2024-09-10T17:57:48.033 INFO:tasks.rados.rados.0.smithi012.stdout:469: oid 42 version 229 is already newer than 228 2024-09-10T17:57:48.033 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 229 (ObjNum 158 snap 41 seq_num 158) dirty exists 2024-09-10T17:57:48.033 INFO:tasks.rados.rados.0.smithi012.stdout:469: left oid 42 (ObjNum 158 snap 41 seq_num 158) 2024-09-10T17:57:48.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ignoring --setuser ceph since I am not root 2024-09-10T17:57:48.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ignoring --setgroup ceph since I am not root 2024-09-10T17:57:48.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:48.109+0000 7fc6bc547040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T17:57:48.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:48.167+0000 7fc6bc547040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T17:57:48.694 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:48.324+0000 7fc6bc547040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T17:57:48.694 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:48.392+0000 7fc6bc547040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T17:57:48.694 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:48.543+0000 7fc6bc547040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:57:48.695 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:48.693+0000 7fc6bc547040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T17:57:48.942 INFO:tasks.rados.rados.0.smithi012.stdout:467: done (2 left) 2024-09-10T17:57:48.942 INFO:tasks.rados.rados.0.smithi012.stdout:469: done (1 left) 2024-09-10T17:57:48.942 INFO:tasks.rados.rados.0.smithi012.stdout:470: done (0 left) 2024-09-10T17:57:48.942 INFO:tasks.rados.rados.0.smithi012.stdout:471: setattr oid 5 current snap is 42 2024-09-10T17:57:48.943 INFO:tasks.rados.rados.0.smithi012.stdout:472: rollback oid 50 current snap is 42 2024-09-10T17:57:48.943 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 35 2024-09-10T17:57:48.943 INFO:tasks.rados.rados.0.smithi012.stdout:473: setattr oid 47 current snap is 42 2024-09-10T17:57:48.944 INFO:tasks.rados.rados.0.smithi012.stdout:474: rollback oid 10 current snap is 42 2024-09-10T17:57:48.944 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 39 2024-09-10T17:57:48.944 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 42 2024-09-10T17:57:48.944 INFO:tasks.rados.rados.0.smithi012.stdout:475: seq_num 159 ranges {0=270336} 2024-09-10T17:57:48.946 INFO:tasks.rados.rados.0.smithi012.stdout:475: writing smithi01278544-11 from 0 to 270336 tid 1 2024-09-10T17:57:48.946 INFO:tasks.rados.rados.0.smithi012.stdout:476: snap_remove snap 30 2024-09-10T17:57:49.010 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: osdmap e154: 8 total, 8 up, 8 in 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: Activating manager daemon x 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: osdmap e155: 8 total, 8 up, 8 in 2024-09-10T17:57:49.011 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.14556 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: mgrmap e25: x(active, starting, since 0.00812433s) 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:57:49.012 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.664+0000 7f5ee332a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.664+0000 7f5ee332a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.664+0000 7f5ee332a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.013 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.664+0000 7f5ee332a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.664+0000 7f5ee332a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.665+0000 7f5ee6b31640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.665+0000 7f5ee6b31640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.665+0000 7f5ee6b31640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.665+0000 7f5ee6b31640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:48.665+0000 7f5ee6b31640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: Manager daemon x is now available 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.014 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T17:57:49.015 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:48 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T17:57:49.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: osdmap e154: 8 total, 8 up, 8 in 2024-09-10T17:57:49.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:49.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:57:49.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: Activating manager daemon x 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: osdmap e155: 8 total, 8 up, 8 in 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.14556 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: mgrmap e25: x(active, starting, since 0.00812433s) 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:57:49.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: Manager daemon x is now available 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: osdmap e154: 8 total, 8 up, 8 in 2024-09-10T17:57:49.032 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 172.21.15.12:0/1249092832' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: Activating manager daemon x 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: osdmap e155: 8 total, 8 up, 8 in 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.14556 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: mgrmap e25: x(active, starting, since 0.00812433s) 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:49.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:57:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: Manager daemon x is now available 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T17:57:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:48 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T17:57:49.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:49.027+0000 7fc6bc547040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T17:57:49.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:49.092+0000 7fc6bc547040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T17:57:49.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:49] ENGINE Bus STARTING 2024-09-10T17:57:49.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:49] ENGINE Serving on http://:::9283 2024-09-10T17:57:49.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:57:49] ENGINE Bus STARTED 2024-09-10T17:57:49.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:49.292+0000 7fc6bc547040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T17:57:49.951 INFO:tasks.rados.rados.0.smithi012.stdout:476: done (5 left) 2024-09-10T17:57:49.951 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 42 2024-09-10T17:57:49.951 INFO:tasks.rados.rados.0.smithi012.stdout:477: seq_num 160 ranges {5464064=286720} 2024-09-10T17:57:49.984 INFO:tasks.rados.rados.0.smithi012.stdout:477: writing smithi01278544-23 from 5464064 to 5750784 tid 1 2024-09-10T17:57:49.984 INFO:tasks.rados.rados.0.smithi012.stdout:478: rollback oid 20 current snap is 42 2024-09-10T17:57:49.984 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 39 2024-09-10T17:57:49.984 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 231 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:57:49.984 INFO:tasks.rados.rados.0.smithi012.stdout:472: finishing rollback tid 0 to smithi01278544-50 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:472: finishing rollback tid 1 to smithi01278544-50 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:472: finishing rollback tid 2 to smithi01278544-50 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 41 (ObjNum 129 snap 35 seq_num 129) dirty exists 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 49 (ObjNum 129 snap 0 seq_num 3496928592) dirty exists 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:474: finishing rollback tid 0 to smithi01278544-10 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:474: finishing rollback tid 1 to smithi01278544-10 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:474: finishing rollback tid 2 to smithi01278544-10 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 151 (ObjNum 77 snap 12 seq_num 77) dirty exists 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:475: finishing write tid 1 to smithi01278544-11 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:475: finishing write tid 2 to smithi01278544-11 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:471: done (6 left) 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:472: done (5 left) 2024-09-10T17:57:49.985 INFO:tasks.rados.rados.0.smithi012.stdout:473: done (4 left) 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:474: done (3 left) 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:479: rmattr oid 49 current snap is 42 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:479: done (3 left) 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:480: read oid 19 snap -1 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:480: expect deleted 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:481: snap_create 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:475: finishing write tid 3 to smithi01278544-11 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:475: oid 11 updating version 0 to 153 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:475: oid 11 version 153 is already newer than 152 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 153 (ObjNum 159 snap 42 seq_num 159) dirty exists 2024-09-10T17:57:49.986 INFO:tasks.rados.rados.0.smithi012.stdout:475: left oid 11 (ObjNum 159 snap 42 seq_num 159) 2024-09-10T17:57:49.987 INFO:tasks.rados.rados.0.smithi012.stdout:477: finishing write tid 1 to smithi01278544-23 2024-09-10T17:57:49.987 INFO:tasks.rados.rados.0.smithi012.stdout:478: finishing rollback tid 0 to smithi01278544-20 2024-09-10T17:57:49.987 INFO:tasks.rados.rados.0.smithi012.stdout:478: finishing rollback tid 1 to smithi01278544-20 2024-09-10T17:57:49.987 INFO:tasks.rados.rados.0.smithi012.stdout:477: finishing write tid 2 to smithi01278544-23 2024-09-10T17:57:49.987 INFO:tasks.rados.rados.0.smithi012.stdout:478: finishing rollback tid 2 to smithi01278544-20 2024-09-10T17:57:49.987 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 165 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-09-10T17:57:49.988 INFO:tasks.rados.rados.0.smithi012.stdout:477: finishing write tid 3 to smithi01278544-23 2024-09-10T17:57:49.988 INFO:tasks.rados.rados.0.smithi012.stdout:477: oid 23 updating version 0 to 178 2024-09-10T17:57:49.988 INFO:tasks.rados.rados.0.smithi012.stdout:477: oid 23 version 178 is already newer than 177 2024-09-10T17:57:49.988 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 178 (ObjNum 160 snap 42 seq_num 160) dirty exists 2024-09-10T17:57:49.988 INFO:tasks.rados.rados.0.smithi012.stdout:477: left oid 23 (ObjNum 160 snap 42 seq_num 160) 2024-09-10T17:57:50.223 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: Checking for cert/key for grafana.a 2024-09-10T17:57:50.223 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: Migrating grafana.a cert to cert store 2024-09-10T17:57:50.223 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: Migrating grafana.a key to cert store 2024-09-10T17:57:50.223 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: osdmap e156: 8 total, 8 up, 8 in 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: mgrmap e26: x(active, since 1.01713s) 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: pgmap v4: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: Deploying cephadm binary to smithi012 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[27356]: Deploying cephadm binary to smithi089 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: Checking for cert/key for grafana.a 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: Migrating grafana.a cert to cert store 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: Migrating grafana.a key to cert store 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: osdmap e156: 8 total, 8 up, 8 in 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: mgrmap e26: x(active, since 1.01713s) 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:57:50.224 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: pgmap v4: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:50.225 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: Deploying cephadm binary to smithi012 2024-09-10T17:57:50.225 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:49 smithi012 ceph-mon[37454]: Deploying cephadm binary to smithi089 2024-09-10T17:57:50.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: Checking for cert/key for grafana.a 2024-09-10T17:57:50.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: Migrating grafana.a cert to cert store 2024-09-10T17:57:50.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: Migrating grafana.a key to cert store 2024-09-10T17:57:50.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: osdmap e156: 8 total, 8 up, 8 in 2024-09-10T17:57:50.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: mgrmap e26: x(active, since 1.01713s) 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: pgmap v4: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: Deploying cephadm binary to smithi012 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-mon[31467]: Deploying cephadm binary to smithi089 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:49.822+0000 7f5eca07b640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:17:57:49] ENGINE Error in HTTPServer.serve 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: Traceback (most recent call last): 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: self._connections.run(self.expiration_interval) 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:57:50.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: self._run(expiration_interval) 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: s = self.context.wrap_socket( 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: return self.sslsocket_class._create( 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: self.do_handshake() 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: self._sslobj.do_handshake() 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:57:50.287 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:57:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:57:50.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:50.221+0000 7fc6bc547040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T17:57:50.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:50.290+0000 7fc6bc547040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T17:57:50.970 INFO:tasks.rados.rados.0.smithi012.stdout:475: done (4 left) 2024-09-10T17:57:50.970 INFO:tasks.rados.rados.0.smithi012.stdout:477: done (3 left) 2024-09-10T17:57:50.970 INFO:tasks.rados.rados.0.smithi012.stdout:478: done (2 left) 2024-09-10T17:57:50.970 INFO:tasks.rados.rados.0.smithi012.stdout:480: done (1 left) 2024-09-10T17:57:50.970 INFO:tasks.rados.rados.0.smithi012.stdout:481: done (0 left) 2024-09-10T17:57:50.970 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 43 2024-09-10T17:57:50.970 INFO:tasks.rados.rados.0.smithi012.stdout:482: seq_num 161 ranges {0=303104} 2024-09-10T17:57:50.971 INFO:tasks.rados.rados.0.smithi012.stdout:482: writing smithi01278544-3 from 0 to 303104 tid 1 2024-09-10T17:57:50.972 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 43 2024-09-10T17:57:50.972 INFO:tasks.rados.rados.0.smithi012.stdout:483: seq_num 162 ranges {2400256=319488} 2024-09-10T17:57:50.987 INFO:tasks.rados.rados.0.smithi012.stdout:483: writing smithi01278544-49 from 2400256 to 2719744 tid 1 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:484: read oid 32 snap 40 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:484: expect (ObjNum 154 snap 38 seq_num 154) 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:485: rollback oid 50 current snap is 43 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:482: finishing write tid 1 to smithi01278544-3 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:482: finishing write tid 2 to smithi01278544-3 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:482: finishing write tid 3 to smithi01278544-3 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:482: oid 3 updating version 0 to 156 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:482: oid 3 version 156 is already newer than 155 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 156 (ObjNum 161 snap 43 seq_num 161) dirty exists 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:482: left oid 3 (ObjNum 161 snap 43 seq_num 161) 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 42 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:482: done (3 left) 2024-09-10T17:57:50.988 INFO:tasks.rados.rados.0.smithi012.stdout:486: snap_create 2024-09-10T17:57:50.991 INFO:tasks.rados.rados.0.smithi012.stdout:484: expect (ObjNum 154 snap 38 seq_num 154) 2024-09-10T17:57:50.996 INFO:tasks.rados.rados.0.smithi012.stdout:485: finishing rollback tid 0 to smithi01278544-50 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:483: finishing write tid 1 to smithi01278544-49 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:483: finishing write tid 2 to smithi01278544-49 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:485: finishing rollback tid 1 to smithi01278544-50 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:485: finishing rollback tid 2 to smithi01278544-50 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 47 (ObjNum 129 snap 35 seq_num 129) dirty exists 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:483: finishing write tid 3 to smithi01278544-49 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:483: oid 49 updating version 0 to 187 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:483: oid 49 updating version 187 to 188 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 188 (ObjNum 162 snap 43 seq_num 162) dirty exists 2024-09-10T17:57:50.997 INFO:tasks.rados.rados.0.smithi012.stdout:483: left oid 49 (ObjNum 162 snap 43 seq_num 162) 2024-09-10T17:57:51.274 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.065+0000 7fc6bc547040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T17:57:51.274 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.187+0000 7fc6bc547040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[27356]: [10/Sep/2024:17:57:49] ENGINE Bus STARTING 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[27356]: [10/Sep/2024:17:57:49] ENGINE Serving on https://172.21.15.89:7150 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[27356]: [10/Sep/2024:17:57:49] ENGINE Error in HTTPServer.serve 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:57:51.275 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:57:51.276 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[27356]: [10/Sep/2024:17:57:49] ENGINE Serving on http://172.21.15.89:8765 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[27356]: [10/Sep/2024:17:57:49] ENGINE Bus STARTED 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[27356]: osdmap e157: 8 total, 8 up, 8 in 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[27356]: pgmap v6: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[37454]: [10/Sep/2024:17:57:49] ENGINE Bus STARTING 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[37454]: [10/Sep/2024:17:57:49] ENGINE Serving on https://172.21.15.89:7150 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[37454]: [10/Sep/2024:17:57:49] ENGINE Error in HTTPServer.serve 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.c.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:57:51.277 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: self.do_handshake() 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:57:51.278 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:57:51.279 INFO:journalctl@ceph.mon.c.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:57:51.279 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[37454]: [10/Sep/2024:17:57:49] ENGINE Serving on http://172.21.15.89:8765 2024-09-10T17:57:51.279 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[37454]: [10/Sep/2024:17:57:49] ENGINE Bus STARTED 2024-09-10T17:57:51.279 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[37454]: osdmap e157: 8 total, 8 up, 8 in 2024-09-10T17:57:51.279 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:50 smithi012 ceph-mon[37454]: pgmap v6: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:51.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:50 smithi089 ceph-mon[31467]: [10/Sep/2024:17:57:49] ENGINE Bus STARTING 2024-09-10T17:57:51.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:50 smithi089 ceph-mon[31467]: [10/Sep/2024:17:57:49] ENGINE Serving on https://172.21.15.89:7150 2024-09-10T17:57:51.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:50 smithi089 ceph-mon[31467]: [10/Sep/2024:17:57:49] ENGINE Error in HTTPServer.serve 2024-09-10T17:57:51.285 INFO:journalctl@ceph.mon.b.smithi089.stdout: Traceback (most recent call last): 2024-09-10T17:57:51.285 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._run(expiration_interval) 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: s = self.context.wrap_socket( 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: return self.sslsocket_class._create( 2024-09-10T17:57:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:57:51.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: self.do_handshake() 2024-09-10T17:57:51.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:57:51.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._sslobj.do_handshake() 2024-09-10T17:57:51.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:57:51.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:50 smithi089 ceph-mon[31467]: [10/Sep/2024:17:57:49] ENGINE Serving on http://172.21.15.89:8765 2024-09-10T17:57:51.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:50 smithi089 ceph-mon[31467]: [10/Sep/2024:17:57:49] ENGINE Bus STARTED 2024-09-10T17:57:51.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:50 smithi089 ceph-mon[31467]: osdmap e157: 8 total, 8 up, 8 in 2024-09-10T17:57:51.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:50 smithi089 ceph-mon[31467]: pgmap v6: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:51.531 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.337+0000 7fc6bc547040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T17:57:51.531 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.403+0000 7fc6bc547040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T17:57:51.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.558+0000 7fc6bc547040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T17:57:51.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.629+0000 7fc6bc547040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T17:57:51.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.694+0000 7fc6bc547040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T17:57:51.787 INFO:tasks.rados.rados.0.smithi012.stdout:483: done (3 left) 2024-09-10T17:57:51.787 INFO:tasks.rados.rados.0.smithi012.stdout:484: done (2 left) 2024-09-10T17:57:51.787 INFO:tasks.rados.rados.0.smithi012.stdout:485: done (1 left) 2024-09-10T17:57:51.787 INFO:tasks.rados.rados.0.smithi012.stdout:486: done (0 left) 2024-09-10T17:57:51.788 INFO:tasks.rados.rados.0.smithi012.stdout:487: read oid 22 snap -1 2024-09-10T17:57:51.788 INFO:tasks.rados.rados.0.smithi012.stdout:487: expect (ObjNum 143 snap 36 seq_num 143) 2024-09-10T17:57:51.788 INFO:tasks.rados.rados.0.smithi012.stdout:488: rollback oid 47 current snap is 44 2024-09-10T17:57:51.788 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 40 2024-09-10T17:57:51.788 INFO:tasks.rados.rados.0.smithi012.stdout:489: snap_remove snap 42 2024-09-10T17:57:52.158 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-mon[27356]: mgrmap e27: x(active, since 3s) 2024-09-10T17:57:52.158 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-mon[27356]: osdmap e158: 8 total, 8 up, 8 in 2024-09-10T17:57:52.158 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-mon[27356]: osdmap e159: 8 total, 8 up, 8 in 2024-09-10T17:57:52.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-mon[37454]: mgrmap e27: x(active, since 3s) 2024-09-10T17:57:52.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-mon[37454]: osdmap e158: 8 total, 8 up, 8 in 2024-09-10T17:57:52.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-mon[37454]: osdmap e159: 8 total, 8 up, 8 in 2024-09-10T17:57:52.158 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.885+0000 7fc6bc547040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T17:57:52.159 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:51.974+0000 7fc6bc547040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T17:57:52.159 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:52.049+0000 7fc6bc547040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T17:57:52.159 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:52.156+0000 7fc6bc547040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T17:57:52.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:51 smithi089 ceph-mon[31467]: mgrmap e27: x(active, since 3s) 2024-09-10T17:57:52.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:51 smithi089 ceph-mon[31467]: osdmap e158: 8 total, 8 up, 8 in 2024-09-10T17:57:52.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:51 smithi089 ceph-mon[31467]: osdmap e159: 8 total, 8 up, 8 in 2024-09-10T17:57:52.511 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:52.226+0000 7fc6bc547040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T17:57:52.512 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:52.287+0000 7fc6bc547040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T17:57:52.800 INFO:tasks.rados.rados.0.smithi012.stdout:489: done (2 left) 2024-09-10T17:57:52.800 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 44 2024-09-10T17:57:52.800 INFO:tasks.rados.rados.0.smithi012.stdout:490: seq_num 163 ranges {0=335872} 2024-09-10T17:57:52.802 INFO:tasks.rados.rados.0.smithi012.stdout:490: writing smithi01278544-6 from 0 to 335872 tid 1 2024-09-10T17:57:52.802 INFO:tasks.rados.rados.0.smithi012.stdout:491: copy_from oid 41 from oid 46 current snap is 44 2024-09-10T17:57:52.802 INFO:tasks.rados.rados.0.smithi012.stdout:488: finishing rollback tid 0 to smithi01278544-47 2024-09-10T17:57:52.802 INFO:tasks.rados.rados.0.smithi012.stdout:488: finishing rollback tid 1 to smithi01278544-47 2024-09-10T17:57:52.802 INFO:tasks.rados.rados.0.smithi012.stdout:488: finishing rollback tid 2 to smithi01278544-47 2024-09-10T17:57:52.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 247 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-10T17:57:52.802 INFO:tasks.rados.rados.0.smithi012.stdout:487: expect (ObjNum 143 snap 36 seq_num 143) 2024-09-10T17:57:53.055 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:52 smithi089 ceph-mon[31467]: pgmap v9: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:53.056 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:52 smithi089 ceph-mon[31467]: osdmap e160: 8 total, 8 up, 8 in 2024-09-10T17:57:53.111 INFO:tasks.rados.rados.0.smithi012.stdout:490: finishing write tid 1 to smithi01278544-6 2024-09-10T17:57:53.112 INFO:tasks.rados.rados.0.smithi012.stdout:490: finishing write tid 2 to smithi01278544-6 2024-09-10T17:57:53.112 INFO:tasks.rados.rados.0.smithi012.stdout:487: done (3 left) 2024-09-10T17:57:53.112 INFO:tasks.rados.rados.0.smithi012.stdout:488: done (2 left) 2024-09-10T17:57:53.112 INFO:tasks.rados.rados.0.smithi012.stdout:492: rollback oid 27 current snap is 44 2024-09-10T17:57:53.112 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 39 2024-09-10T17:57:53.112 INFO:tasks.rados.rados.0.smithi012.stdout:490: finishing write tid 3 to smithi01278544-6 2024-09-10T17:57:53.113 INFO:tasks.rados.rados.0.smithi012.stdout:490: oid 6 updating version 0 to 76 2024-09-10T17:57:53.113 INFO:tasks.rados.rados.0.smithi012.stdout:490: oid 6 version 76 is already newer than 75 2024-09-10T17:57:53.113 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 76 (ObjNum 163 snap 44 seq_num 163) dirty exists 2024-09-10T17:57:53.113 INFO:tasks.rados.rados.0.smithi012.stdout:490: left oid 6 (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:57:53.113 INFO:tasks.rados.rados.0.smithi012.stdout:491: finishing copy_from racing read to smithi01278544-41 2024-09-10T17:57:53.113 INFO:tasks.rados.rados.0.smithi012.stdout:491: finishing copy_from to smithi01278544-41 2024-09-10T17:57:53.114 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 107 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:57:53.114 INFO:tasks.rados.rados.0.smithi012.stdout:490: done (2 left) 2024-09-10T17:57:53.114 INFO:tasks.rados.rados.0.smithi012.stdout:491: done (1 left) 2024-09-10T17:57:53.114 INFO:tasks.rados.rados.0.smithi012.stdout:493: snap_remove snap 32 2024-09-10T17:57:53.243 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:52 smithi012 ceph-mon[27356]: pgmap v9: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:53.244 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:52 smithi012 ceph-mon[27356]: osdmap e160: 8 total, 8 up, 8 in 2024-09-10T17:57:53.244 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:52 smithi012 ceph-mon[37454]: pgmap v9: 121 pgs: 121 active+clean; 137 MiB data, 484 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:57:53.244 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:52 smithi012 ceph-mon[37454]: osdmap e160: 8 total, 8 up, 8 in 2024-09-10T17:57:53.245 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:53.135+0000 7fc6bc547040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T17:57:53.245 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:57:53] ENGINE Bus STARTING 2024-09-10T17:57:53.245 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: CherryPy Checker: 2024-09-10T17:57:53.245 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: The Application mounted at '' has an empty config. 2024-09-10T17:57:53.245 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: 2024-09-10T17:57:53.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:57:53] ENGINE Serving on http://:::9283 2024-09-10T17:57:53.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: [10/Sep/2024:17:57:53] ENGINE Bus STARTED 2024-09-10T17:57:53.980 INFO:tasks.rados.rados.0.smithi012.stdout:493: done (1 left) 2024-09-10T17:57:53.980 INFO:tasks.rados.rados.0.smithi012.stdout:494: snap_remove snap 25 2024-09-10T17:57:54.221 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:53 smithi089 ceph-mon[31467]: Standby manager daemon y started 2024-09-10T17:57:54.221 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:53 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T17:57:54.221 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:53 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:57:54.221 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:53 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T17:57:54.221 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:53 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:57:54.221 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:53 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:54.222 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:53 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:54.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[27585]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:57:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-10T17:57:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[27356]: Standby manager daemon y started 2024-09-10T17:57:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[37454]: Standby manager daemon y started 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.12:0/3285017669' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:57:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:54.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:53 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:54.990 INFO:tasks.rados.rados.0.smithi012.stdout:494: done (1 left) 2024-09-10T17:57:54.991 INFO:tasks.rados.rados.0.smithi012.stdout:495: read oid 35 snap -1 2024-09-10T17:57:54.991 INFO:tasks.rados.rados.0.smithi012.stdout:495: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-10T17:57:54.992 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 44 2024-09-10T17:57:54.992 INFO:tasks.rados.rados.0.smithi012.stdout:496: seq_num 164 ranges {2711552=352256} 2024-09-10T17:57:55.009 INFO:tasks.rados.rados.0.smithi012.stdout:496: writing smithi01278544-24 from 2711552 to 3063808 tid 1 2024-09-10T17:57:55.009 INFO:tasks.rados.rados.0.smithi012.stdout:497: rollback oid 14 current snap is 44 2024-09-10T17:57:55.009 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 14 to 41 2024-09-10T17:57:55.009 INFO:tasks.rados.rados.0.smithi012.stdout:492: finishing rollback tid 1 to smithi01278544-27 2024-09-10T17:57:55.010 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 66 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2024-09-10T17:57:55.010 INFO:tasks.rados.rados.0.smithi012.stdout:495: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-10T17:57:55.029 INFO:tasks.rados.rados.0.smithi012.stdout:497: finishing rollback tid 0 to smithi01278544-14 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:496: finishing write tid 1 to smithi01278544-24 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:496: finishing write tid 2 to smithi01278544-24 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:492: done (3 left) 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:495: done (2 left) 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:498: delete oid 29 current snap is 44 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:496: finishing write tid 3 to smithi01278544-24 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:496: oid 24 updating version 0 to 133 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:496: oid 24 updating version 133 to 134 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 134 (ObjNum 164 snap 44 seq_num 164) dirty exists 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:496: left oid 24 (ObjNum 164 snap 44 seq_num 164) 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:497: finishing rollback tid 1 to smithi01278544-14 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:497: finishing rollback tid 2 to smithi01278544-14 2024-09-10T17:57:55.030 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 269 (ObjNum 152 snap 38 seq_num 152) dirty exists 2024-09-10T17:57:55.031 INFO:tasks.rados.rados.0.smithi012.stdout:496: done (2 left) 2024-09-10T17:57:55.031 INFO:tasks.rados.rados.0.smithi012.stdout:497: done (1 left) 2024-09-10T17:57:55.031 INFO:tasks.rados.rados.0.smithi012.stdout:498: done (0 left) 2024-09-10T17:57:55.032 INFO:tasks.rados.rados.0.smithi012.stdout:499: read oid 6 snap -1 2024-09-10T17:57:55.032 INFO:tasks.rados.rados.0.smithi012.stdout:499: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:57:55.032 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 44 2024-09-10T17:57:55.032 INFO:tasks.rados.rados.0.smithi012.stdout:500: seq_num 166 ranges {4210688=385024} 2024-09-10T17:57:55.057 INFO:tasks.rados.rados.0.smithi012.stdout:500: writing smithi01278544-4 from 4210688 to 4595712 tid 1 2024-09-10T17:57:55.057 INFO:tasks.rados.rados.0.smithi012.stdout:501: delete oid 36 current snap is 44 2024-09-10T17:57:55.057 INFO:tasks.rados.rados.0.smithi012.stdout:499: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:500: finishing write tid 1 to smithi01278544-4 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:500: finishing write tid 2 to smithi01278544-4 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:500: finishing write tid 3 to smithi01278544-4 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:500: oid 4 updating version 0 to 202 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:500: oid 4 updating version 202 to 203 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 203 (ObjNum 166 snap 44 seq_num 166) dirty exists 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:500: left oid 4 (ObjNum 166 snap 44 seq_num 166) 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:499: done (2 left) 2024-09-10T17:57:55.070 INFO:tasks.rados.rados.0.smithi012.stdout:500: done (1 left) 2024-09-10T17:57:55.071 INFO:tasks.rados.rados.0.smithi012.stdout:501: done (0 left) 2024-09-10T17:57:55.071 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 44 2024-09-10T17:57:55.071 INFO:tasks.rados.rados.0.smithi012.stdout:502: seq_num 168 ranges {270336=417792} 2024-09-10T17:57:55.074 INFO:tasks.rados.rados.0.smithi012.stdout:502: writing smithi01278544-11 from 270336 to 688128 tid 1 2024-09-10T17:57:55.074 INFO:tasks.rados.rados.0.smithi012.stdout:503: read oid 47 snap -1 2024-09-10T17:57:55.074 INFO:tasks.rados.rados.0.smithi012.stdout:503: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:55.074 INFO:tasks.rados.rados.0.smithi012.stdout:504: read oid 10 snap -1 2024-09-10T17:57:55.074 INFO:tasks.rados.rados.0.smithi012.stdout:504: expect (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:57:55.074 INFO:tasks.rados.rados.0.smithi012.stdout:505: snap_create 2024-09-10T17:57:55.077 INFO:tasks.rados.rados.0.smithi012.stdout:502: finishing write tid 1 to smithi01278544-11 2024-09-10T17:57:55.077 INFO:tasks.rados.rados.0.smithi012.stdout:502: finishing write tid 2 to smithi01278544-11 2024-09-10T17:57:55.078 INFO:tasks.rados.rados.0.smithi012.stdout:503: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:57:55.104 INFO:tasks.rados.rados.0.smithi012.stdout:502: finishing write tid 3 to smithi01278544-11 2024-09-10T17:57:55.104 INFO:tasks.rados.rados.0.smithi012.stdout:502: oid 11 updating version 0 to 181 2024-09-10T17:57:55.104 INFO:tasks.rados.rados.0.smithi012.stdout:502: oid 11 updating version 181 to 182 2024-09-10T17:57:55.104 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 182 (ObjNum 168 snap 44 seq_num 168) dirty exists 2024-09-10T17:57:55.104 INFO:tasks.rados.rados.0.smithi012.stdout:502: left oid 11 (ObjNum 168 snap 44 seq_num 168) 2024-09-10T17:57:55.105 INFO:tasks.rados.rados.0.smithi012.stdout:504: expect (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:57:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: pgmap v11: 121 pgs: 121 active+clean; 138 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 186 KiB/s wr, 0 op/s 2024-09-10T17:57:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: mgrmap e28: x(active, since 6s), standbys: y 2024-09-10T17:57:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: osdmap e161: 8 total, 8 up, 8 in 2024-09-10T17:57:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:57:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi012 to 2481M 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: pgmap v11: 121 pgs: 121 active+clean; 138 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 186 KiB/s wr, 0 op/s 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: mgrmap e28: x(active, since 6s), standbys: y 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: osdmap e161: 8 total, 8 up, 8 in 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi012 to 2481M 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:54 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: pgmap v11: 121 pgs: 121 active+clean; 138 MiB data, 485 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 186 KiB/s wr, 0 op/s 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: mgrmap e28: x(active, since 6s), standbys: y 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: osdmap e161: 8 total, 8 up, 8 in 2024-09-10T17:57:55.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi012 to 2481M 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:54 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:55.994 INFO:tasks.rados.rados.0.smithi012.stdout:502: done (3 left) 2024-09-10T17:57:55.994 INFO:tasks.rados.rados.0.smithi012.stdout:503: done (2 left) 2024-09-10T17:57:55.994 INFO:tasks.rados.rados.0.smithi012.stdout:504: done (1 left) 2024-09-10T17:57:55.994 INFO:tasks.rados.rados.0.smithi012.stdout:505: done (0 left) 2024-09-10T17:57:55.994 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 45 2024-09-10T17:57:55.994 INFO:tasks.rados.rados.0.smithi012.stdout:506: seq_num 169 ranges {0=434176} 2024-09-10T17:57:55.996 INFO:tasks.rados.rados.0.smithi012.stdout:506: writing smithi01278544-39 from 0 to 434176 tid 1 2024-09-10T17:57:55.996 INFO:tasks.rados.rados.0.smithi012.stdout:507: read oid 48 snap -1 2024-09-10T17:57:55.996 INFO:tasks.rados.rados.0.smithi012.stdout:507: expect (ObjNum 118 snap 29 seq_num 118) 2024-09-10T17:57:55.996 INFO:tasks.rados.rados.0.smithi012.stdout:508: rollback oid 18 current snap is 45 2024-09-10T17:57:55.996 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 44 2024-09-10T17:57:55.997 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 45 2024-09-10T17:57:55.997 INFO:tasks.rados.rados.0.smithi012.stdout:509: seq_num 170 ranges {0=450560} 2024-09-10T17:57:55.999 INFO:tasks.rados.rados.0.smithi012.stdout:509: writing smithi01278544-44 from 0 to 450560 tid 1 2024-09-10T17:57:55.999 INFO:tasks.rados.rados.0.smithi012.stdout:510: snap_create 2024-09-10T17:57:55.999 INFO:tasks.rados.rados.0.smithi012.stdout:508: finishing rollback tid 1 to smithi01278544-18 2024-09-10T17:57:56.000 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 171 (ObjNum 33 snap 0 seq_num 3496749792) dirty dne 2024-09-10T17:57:56.002 INFO:tasks.rados.rados.0.smithi012.stdout:506: finishing write tid 1 to smithi01278544-39 2024-09-10T17:57:56.002 INFO:tasks.rados.rados.0.smithi012.stdout:506: finishing write tid 2 to smithi01278544-39 2024-09-10T17:57:56.003 INFO:tasks.rados.rados.0.smithi012.stdout:509: finishing write tid 1 to smithi01278544-44 2024-09-10T17:57:56.003 INFO:tasks.rados.rados.0.smithi012.stdout:509: finishing write tid 2 to smithi01278544-44 2024-09-10T17:57:56.004 INFO:tasks.rados.rados.0.smithi012.stdout:506: finishing write tid 3 to smithi01278544-39 2024-09-10T17:57:56.004 INFO:tasks.rados.rados.0.smithi012.stdout:506: oid 39 updating version 0 to 184 2024-09-10T17:57:56.004 INFO:tasks.rados.rados.0.smithi012.stdout:506: oid 39 version 184 is already newer than 183 2024-09-10T17:57:56.004 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 184 (ObjNum 169 snap 45 seq_num 169) dirty exists 2024-09-10T17:57:56.004 INFO:tasks.rados.rados.0.smithi012.stdout:506: left oid 39 (ObjNum 169 snap 45 seq_num 169) 2024-09-10T17:57:56.006 INFO:tasks.rados.rados.0.smithi012.stdout:509: finishing write tid 3 to smithi01278544-44 2024-09-10T17:57:56.006 INFO:tasks.rados.rados.0.smithi012.stdout:509: oid 44 updating version 0 to 172 2024-09-10T17:57:56.006 INFO:tasks.rados.rados.0.smithi012.stdout:509: oid 44 updating version 172 to 173 2024-09-10T17:57:56.006 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 173 (ObjNum 170 snap 45 seq_num 170) dirty exists 2024-09-10T17:57:56.006 INFO:tasks.rados.rados.0.smithi012.stdout:509: left oid 44 (ObjNum 170 snap 45 seq_num 170) 2024-09-10T17:57:56.007 INFO:tasks.rados.rados.0.smithi012.stdout:507: expect (ObjNum 118 snap 29 seq_num 118) 2024-09-10T17:57:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:55 smithi012 ceph-mon[27356]: osdmap e162: 8 total, 8 up, 8 in 2024-09-10T17:57:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:55 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:55 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:55 smithi012 ceph-mon[37454]: osdmap e162: 8 total, 8 up, 8 in 2024-09-10T17:57:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:55 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:55 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:56.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:55 smithi089 ceph-mon[31467]: osdmap e162: 8 total, 8 up, 8 in 2024-09-10T17:57:56.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:55 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:55 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:56.790 INFO:tasks.rados.rados.0.smithi012.stdout:506: done (4 left) 2024-09-10T17:57:56.790 INFO:tasks.rados.rados.0.smithi012.stdout:507: done (3 left) 2024-09-10T17:57:56.790 INFO:tasks.rados.rados.0.smithi012.stdout:508: done (2 left) 2024-09-10T17:57:56.790 INFO:tasks.rados.rados.0.smithi012.stdout:509: done (1 left) 2024-09-10T17:57:56.790 INFO:tasks.rados.rados.0.smithi012.stdout:510: done (0 left) 2024-09-10T17:57:56.790 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 46 2024-09-10T17:57:56.790 INFO:tasks.rados.rados.0.smithi012.stdout:511: seq_num 171 ranges {0=466944} 2024-09-10T17:57:56.792 INFO:tasks.rados.rados.0.smithi012.stdout:511: writing smithi01278544-18 from 0 to 466944 tid 1 2024-09-10T17:57:56.792 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 46 2024-09-10T17:57:56.792 INFO:tasks.rados.rados.0.smithi012.stdout:512: seq_num 172 ranges {434176=483328} 2024-09-10T17:57:56.798 INFO:tasks.rados.rados.0.smithi012.stdout:512: writing smithi01278544-39 from 434176 to 917504 tid 1 2024-09-10T17:57:56.798 INFO:tasks.rados.rados.0.smithi012.stdout:513: setattr oid 49 current snap is 46 2024-09-10T17:57:56.798 INFO:tasks.rados.rados.0.smithi012.stdout:511: finishing write tid 1 to smithi01278544-18 2024-09-10T17:57:56.798 INFO:tasks.rados.rados.0.smithi012.stdout:511: finishing write tid 2 to smithi01278544-18 2024-09-10T17:57:56.799 INFO:tasks.rados.rados.0.smithi012.stdout:511: finishing write tid 3 to smithi01278544-18 2024-09-10T17:57:56.799 INFO:tasks.rados.rados.0.smithi012.stdout:511: oid 18 updating version 0 to 206 2024-09-10T17:57:56.799 INFO:tasks.rados.rados.0.smithi012.stdout:511: oid 18 updating version 206 to 207 2024-09-10T17:57:56.799 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 207 (ObjNum 171 snap 46 seq_num 171) dirty exists 2024-09-10T17:57:56.799 INFO:tasks.rados.rados.0.smithi012.stdout:511: left oid 18 (ObjNum 171 snap 46 seq_num 171) 2024-09-10T17:57:56.799 INFO:tasks.rados.rados.0.smithi012.stdout:511: done (2 left) 2024-09-10T17:57:56.799 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 8 current snap is 46 2024-09-10T17:57:56.799 INFO:tasks.rados.rados.0.smithi012.stdout:514: seq_num 173 ranges {0=499712} 2024-09-10T17:57:56.802 INFO:tasks.rados.rados.0.smithi012.stdout:514: writing smithi01278544-8 from 0 to 499712 tid 1 2024-09-10T17:57:56.802 INFO:tasks.rados.rados.0.smithi012.stdout:515: rollback oid 23 current snap is 46 2024-09-10T17:57:56.802 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 23 to 40 2024-09-10T17:57:56.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 209 (ObjNum 162 snap 43 seq_num 162) dirty exists 2024-09-10T17:57:56.803 INFO:tasks.rados.rados.0.smithi012.stdout:513: done (3 left) 2024-09-10T17:57:56.803 INFO:tasks.rados.rados.0.smithi012.stdout:516: copy_from oid 12 from oid 27 current snap is 46 2024-09-10T17:57:56.803 INFO:tasks.rados.rados.0.smithi012.stdout:517: snap_remove snap 43 2024-09-10T17:57:57.269 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:56 smithi089 ceph-mon[31467]: pgmap v14: 121 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 116 active+clean; 139 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 470 KiB/s wr, 23 op/s 2024-09-10T17:57:57.270 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:56 smithi089 ceph-mon[31467]: osdmap e163: 8 total, 8 up, 8 in 2024-09-10T17:57:57.270 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:56 smithi089 ceph-mon[31467]: osdmap e164: 8 total, 8 up, 8 in 2024-09-10T17:57:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:56 smithi012 ceph-mon[27356]: pgmap v14: 121 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 116 active+clean; 139 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 470 KiB/s wr, 23 op/s 2024-09-10T17:57:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:56 smithi012 ceph-mon[27356]: osdmap e163: 8 total, 8 up, 8 in 2024-09-10T17:57:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:56 smithi012 ceph-mon[27356]: osdmap e164: 8 total, 8 up, 8 in 2024-09-10T17:57:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:56 smithi012 ceph-mon[37454]: pgmap v14: 121 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 116 active+clean; 139 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 470 KiB/s wr, 23 op/s 2024-09-10T17:57:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:56 smithi012 ceph-mon[37454]: osdmap e163: 8 total, 8 up, 8 in 2024-09-10T17:57:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:56 smithi012 ceph-mon[37454]: osdmap e164: 8 total, 8 up, 8 in 2024-09-10T17:57:57.791 INFO:tasks.rados.rados.0.smithi012.stdout:517: done (4 left) 2024-09-10T17:57:57.791 INFO:tasks.rados.rados.0.smithi012.stdout:518: copy_from oid 29 from oid 11 current snap is 46 2024-09-10T17:57:57.791 INFO:tasks.rados.rados.0.smithi012.stdout:512: finishing write tid 1 to smithi01278544-39 2024-09-10T17:57:57.791 INFO:tasks.rados.rados.0.smithi012.stdout:512: finishing write tid 2 to smithi01278544-39 2024-09-10T17:57:57.791 INFO:tasks.rados.rados.0.smithi012.stdout:516: finishing copy_from to smithi01278544-12 2024-09-10T17:57:57.791 INFO:tasks.rados.rados.0.smithi012.stdout:516: got expected ENOENT (src dne) 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:516: finishing copy_from racing read to smithi01278544-12 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:512: finishing write tid 3 to smithi01278544-39 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:512: oid 39 updating version 0 to 186 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:512: oid 39 updating version 186 to 187 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 187 (ObjNum 172 snap 46 seq_num 172) dirty exists 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:512: left oid 39 (ObjNum 172 snap 46 seq_num 172) 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:514: finishing write tid 1 to smithi01278544-8 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:515: finishing rollback tid 0 to smithi01278544-23 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:514: finishing write tid 2 to smithi01278544-8 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:515: finishing rollback tid 1 to smithi01278544-23 2024-09-10T17:57:57.792 INFO:tasks.rados.rados.0.smithi012.stdout:515: finishing rollback tid 2 to smithi01278544-23 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 194 (ObjNum 142 snap 35 seq_num 142) dirty exists 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:514: finishing write tid 3 to smithi01278544-8 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:514: oid 8 updating version 0 to 86 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:514: oid 8 version 86 is already newer than 85 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 86 (ObjNum 173 snap 46 seq_num 173) dirty exists 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:514: left oid 8 (ObjNum 173 snap 46 seq_num 173) 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:512: done (4 left) 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:514: done (3 left) 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:515: done (2 left) 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:516: done (1 left) 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:519: read oid 44 snap 41 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:519: expect deleted 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:520: copy_from oid 46 from oid 10 current snap is 46 2024-09-10T17:57:57.793 INFO:tasks.rados.rados.0.smithi012.stdout:521: delete oid 2 current snap is 46 2024-09-10T17:57:57.796 INFO:tasks.rados.rados.0.smithi012.stdout:519: done (3 left) 2024-09-10T17:57:57.796 INFO:tasks.rados.rados.0.smithi012.stdout:521: done (2 left) 2024-09-10T17:57:57.796 INFO:tasks.rados.rados.0.smithi012.stdout:522: snap_create 2024-09-10T17:57:57.801 INFO:tasks.rados.rados.0.smithi012.stdout:518: finishing copy_from racing read to smithi01278544-29 2024-09-10T17:57:57.803 INFO:tasks.rados.rados.0.smithi012.stdout:518: finishing copy_from to smithi01278544-29 2024-09-10T17:57:57.803 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 182 (ObjNum 168 snap 44 seq_num 168) dirty exists 2024-09-10T17:57:57.803 INFO:tasks.rados.rados.0.smithi012.stdout:520: finishing copy_from racing read to smithi01278544-46 2024-09-10T17:57:57.804 INFO:tasks.rados.rados.0.smithi012.stdout:520: finishing copy_from to smithi01278544-46 2024-09-10T17:57:57.804 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 151 (ObjNum 77 snap 12 seq_num 77) dirty exists 2024-09-10T17:57:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:518: done (2 left) 2024-09-10T17:57:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:520: done (1 left) 2024-09-10T17:57:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:522: done (0 left) 2024-09-10T17:57:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:523: read oid 45 snap -1 2024-09-10T17:57:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:523: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:524: setattr oid 1 current snap is 47 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:525: rmattr oid 34 current snap is 47 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:525: done (2 left) 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:526: read oid 10 snap -1 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:526: expect (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:527: rollback oid 46 current snap is 47 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 41 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:528: copy_from oid 25 from oid 44 current snap is 47 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:529: rollback oid 41 current snap is 47 2024-09-10T17:57:58.804 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 20 2024-09-10T17:57:58.805 INFO:tasks.rados.rados.0.smithi012.stdout:530: rollback oid 50 current snap is 47 2024-09-10T17:57:58.805 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 40 2024-09-10T17:57:58.805 INFO:tasks.rados.rados.0.smithi012.stdout:531: read oid 5 snap -1 2024-09-10T17:57:58.805 INFO:tasks.rados.rados.0.smithi012.stdout:531: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:57:58.805 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 47 2024-09-10T17:57:58.805 INFO:tasks.rados.rados.0.smithi012.stdout:532: seq_num 175 ranges {0=540672} 2024-09-10T17:57:58.807 INFO:tasks.rados.rados.0.smithi012.stdout:532: writing smithi01278544-36 from 0 to 540672 tid 1 2024-09-10T17:57:58.808 INFO:tasks.rados.rados.0.smithi012.stdout:533: rollback oid 49 current snap is 47 2024-09-10T17:57:58.808 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 49 to 39 2024-09-10T17:57:58.808 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 47 2024-09-10T17:57:58.808 INFO:tasks.rados.rados.0.smithi012.stdout:534: seq_num 176 ranges {917504=557056} 2024-09-10T17:57:58.819 INFO:tasks.rados.rados.0.smithi012.stdout:534: writing smithi01278544-39 from 917504 to 1474560 tid 1 2024-09-10T17:57:58.819 INFO:tasks.rados.rados.0.smithi012.stdout:535: rollback oid 28 current snap is 47 2024-09-10T17:57:58.819 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 28 to 40 2024-09-10T17:57:58.819 INFO:tasks.rados.rados.0.smithi012.stdout:523: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-10T17:57:58.838 INFO:tasks.rados.rados.0.smithi012.stdout:531: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:57:58.841 INFO:tasks.rados.rados.0.smithi012.stdout:530: finishing rollback tid 0 to smithi01278544-50 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:529: finishing rollback tid 0 to smithi01278544-41 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:529: finishing rollback tid 1 to smithi01278544-41 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 210 (ObjNum 177 snap 0 seq_num 0) dirty dne 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:532: finishing write tid 1 to smithi01278544-36 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:532: finishing write tid 2 to smithi01278544-36 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:533: finishing rollback tid 0 to smithi01278544-49 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 158 (ObjNum 609 snap 0 seq_num 3012986230) dirty exists 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:530: finishing rollback tid 1 to smithi01278544-50 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:530: finishing rollback tid 2 to smithi01278544-50 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 57 (ObjNum 129 snap 35 seq_num 129) dirty exists 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:533: finishing rollback tid 1 to smithi01278544-49 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:523: done (11 left) 2024-09-10T17:57:58.842 INFO:tasks.rados.rados.0.smithi012.stdout:524: done (10 left) 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:529: done (9 left) 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:530: done (8 left) 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:531: done (7 left) 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:536: rollback oid 42 current snap is 47 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 42 to 35 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:533: finishing rollback tid 2 to smithi01278544-49 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 217 (ObjNum 151 snap 36 seq_num 151) dirty exists 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:527: finishing rollback tid 0 to smithi01278544-46 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:527: finishing rollback tid 1 to smithi01278544-46 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:532: finishing write tid 3 to smithi01278544-36 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:532: oid 36 updating version 0 to 137 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:532: oid 36 version 137 is already newer than 136 2024-09-10T17:57:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 137 (ObjNum 175 snap 47 seq_num 175) dirty exists 2024-09-10T17:57:58.844 INFO:tasks.rados.rados.0.smithi012.stdout:532: left oid 36 (ObjNum 175 snap 47 seq_num 175) 2024-09-10T17:57:58.844 INFO:tasks.rados.rados.0.smithi012.stdout:527: finishing rollback tid 2 to smithi01278544-46 2024-09-10T17:57:58.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 179 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:57:58.844 INFO:tasks.rados.rados.0.smithi012.stdout:526: expect (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:57:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:528: finishing copy_from racing read to smithi01278544-25 2024-09-10T17:57:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:535: finishing rollback tid 0 to smithi01278544-28 2024-09-10T17:57:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:535: finishing rollback tid 1 to smithi01278544-28 2024-09-10T17:57:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:526: done (7 left) 2024-09-10T17:57:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:527: done (6 left) 2024-09-10T17:57:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:532: done (5 left) 2024-09-10T17:57:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:533: done (4 left) 2024-09-10T17:57:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:537: read oid 3 snap 46 2024-09-10T17:57:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:537: expect (ObjNum 161 snap 43 seq_num 161) 2024-09-10T17:57:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:538: copy_from oid 2 from oid 48 current snap is 47 2024-09-10T17:57:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:528: finishing copy_from to smithi01278544-25 2024-09-10T17:57:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 173 (ObjNum 170 snap 45 seq_num 170) dirty exists 2024-09-10T17:57:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:528: done (5 left) 2024-09-10T17:57:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:539: snap_remove snap 20 2024-09-10T17:57:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: osdmap e165: 8 total, 8 up, 8 in 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: pgmap v18: 121 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 116 active+clean; 139 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 305 KiB/s wr, 23 op/s 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: Adjusting osd_memory_target on smithi089 to 2479M 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: osdmap e165: 8 total, 8 up, 8 in 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: pgmap v18: 121 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 116 active+clean; 139 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 305 KiB/s wr, 23 op/s 2024-09-10T17:57:59.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: Adjusting osd_memory_target on smithi089 to 2479M 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:57:59.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.291 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.292 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:58 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: osdmap e165: 8 total, 8 up, 8 in 2024-09-10T17:57:59.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: pgmap v18: 121 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 116 active+clean; 139 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 305 KiB/s wr, 23 op/s 2024-09-10T17:57:59.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: Adjusting osd_memory_target on smithi089 to 2479M 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.296 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.296 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.296 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:57:59.296 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:57:59.296 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:57:59.296 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:57:59.296 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:58 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:57:59.819 INFO:tasks.rados.rados.0.smithi012.stdout:539: done (5 left) 2024-09-10T17:57:59.819 INFO:tasks.rados.rados.0.smithi012.stdout:540: snap_remove snap 39 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: osdmap e166: 8 total, 8 up, 8 in 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.113 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:57:59 smithi089 ceph-mon[31467]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:58:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: osdmap e166: 8 total, 8 up, 8 in 2024-09-10T17:58:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[27356]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: osdmap e166: 8 total, 8 up, 8 in 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:00.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:00.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:00.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:00.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:57:59 smithi012 ceph-mon[37454]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:58:00.825 INFO:tasks.rados.rados.0.smithi012.stdout:540: done (5 left) 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:541: rollback oid 19 current snap is 47 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 19 to 37 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:542: delete oid 31 current snap is 47 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:535: finishing rollback tid 2 to smithi01278544-28 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 32 (ObjNum 134 snap 35 seq_num 134) dirty exists 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:534: finishing write tid 1 to smithi01278544-39 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:534: finishing write tid 2 to smithi01278544-39 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:534: finishing write tid 3 to smithi01278544-39 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:534: oid 39 updating version 0 to 193 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:534: oid 39 updating version 193 to 194 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 194 (ObjNum 176 snap 47 seq_num 176) dirty exists 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:534: left oid 39 (ObjNum 176 snap 47 seq_num 176) 2024-09-10T17:58:00.826 INFO:tasks.rados.rados.0.smithi012.stdout:536: finishing rollback tid 0 to smithi01278544-42 2024-09-10T17:58:00.827 INFO:tasks.rados.rados.0.smithi012.stdout:536: finishing rollback tid 1 to smithi01278544-42 2024-09-10T17:58:00.827 INFO:tasks.rados.rados.0.smithi012.stdout:536: finishing rollback tid 2 to smithi01278544-42 2024-09-10T17:58:00.827 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 287 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-09-10T17:58:00.827 INFO:tasks.rados.rados.0.smithi012.stdout:537: expect (ObjNum 161 snap 43 seq_num 161) 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:538: finishing copy_from racing read to smithi01278544-2 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:538: finishing copy_from to smithi01278544-2 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 102 (ObjNum 118 snap 29 seq_num 118) dirty exists 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:534: done (6 left) 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:535: done (5 left) 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:536: done (4 left) 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:537: done (3 left) 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:538: done (2 left) 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:542: done (1 left) 2024-09-10T17:58:00.839 INFO:tasks.rados.rados.0.smithi012.stdout:543: read oid 10 snap -1 2024-09-10T17:58:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:543: expect (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:58:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:544: setattr oid 34 current snap is 47 2024-09-10T17:58:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:541: finishing rollback tid 1 to smithi01278544-19 2024-09-10T17:58:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:541: finishing rollback tid 2 to smithi01278544-19 2024-09-10T17:58:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 210 (ObjNum 93 snap 16 seq_num 93) dirty exists 2024-09-10T17:58:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:541: done (2 left) 2024-09-10T17:58:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:545: rmattr oid 27 current snap is 47 2024-09-10T17:58:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:545: done (2 left) 2024-09-10T17:58:00.841 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 47 2024-09-10T17:58:00.841 INFO:tasks.rados.rados.0.smithi012.stdout:546: seq_num 178 ranges {4595712=589824} 2024-09-10T17:58:00.869 INFO:tasks.rados.rados.0.smithi012.stdout:546: writing smithi01278544-4 from 4595712 to 5185536 tid 1 2024-09-10T17:58:00.869 INFO:tasks.rados.rados.0.smithi012.stdout:547: snap_create 2024-09-10T17:58:00.869 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 212 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:58:00.869 INFO:tasks.rados.rados.0.smithi012.stdout:543: expect (ObjNum 77 snap 12 seq_num 77) 2024-09-10T17:58:00.905 INFO:tasks.rados.rados.0.smithi012.stdout:546: finishing write tid 1 to smithi01278544-4 2024-09-10T17:58:00.905 INFO:tasks.rados.rados.0.smithi012.stdout:546: finishing write tid 2 to smithi01278544-4 2024-09-10T17:58:00.905 INFO:tasks.rados.rados.0.smithi012.stdout:546: finishing write tid 3 to smithi01278544-4 2024-09-10T17:58:00.905 INFO:tasks.rados.rados.0.smithi012.stdout:546: oid 4 updating version 0 to 223 2024-09-10T17:58:00.905 INFO:tasks.rados.rados.0.smithi012.stdout:546: oid 4 version 223 is already newer than 222 2024-09-10T17:58:00.905 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 223 (ObjNum 178 snap 47 seq_num 178) dirty exists 2024-09-10T17:58:00.906 INFO:tasks.rados.rados.0.smithi012.stdout:546: left oid 4 (ObjNum 178 snap 47 seq_num 178) 2024-09-10T17:58:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:00 smithi089 ceph-mon[31467]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:58:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:00 smithi089 ceph-mon[31467]: mgrmap e29: x(active, since 11s), standbys: y 2024-09-10T17:58:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:00 smithi089 ceph-mon[31467]: osdmap e167: 8 total, 8 up, 8 in 2024-09-10T17:58:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:00 smithi089 ceph-mon[31467]: pgmap v21: 121 pgs: 121 active+clean; 135 MiB data, 546 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 2.2 MiB/s wr, 45 op/s 2024-09-10T17:58:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:00 smithi012 ceph-mon[27356]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:58:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:00 smithi012 ceph-mon[27356]: mgrmap e29: x(active, since 11s), standbys: y 2024-09-10T17:58:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:00 smithi012 ceph-mon[27356]: osdmap e167: 8 total, 8 up, 8 in 2024-09-10T17:58:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:00 smithi012 ceph-mon[27356]: pgmap v21: 121 pgs: 121 active+clean; 135 MiB data, 546 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 2.2 MiB/s wr, 45 op/s 2024-09-10T17:58:01.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:00 smithi012 ceph-mon[37454]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:58:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:00 smithi012 ceph-mon[37454]: mgrmap e29: x(active, since 11s), standbys: y 2024-09-10T17:58:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:00 smithi012 ceph-mon[37454]: osdmap e167: 8 total, 8 up, 8 in 2024-09-10T17:58:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:00 smithi012 ceph-mon[37454]: pgmap v21: 121 pgs: 121 active+clean; 135 MiB data, 546 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 2.2 MiB/s wr, 45 op/s 2024-09-10T17:58:01.794 INFO:tasks.rados.rados.0.smithi012.stdout:543: done (3 left) 2024-09-10T17:58:01.794 INFO:tasks.rados.rados.0.smithi012.stdout:544: done (2 left) 2024-09-10T17:58:01.794 INFO:tasks.rados.rados.0.smithi012.stdout:546: done (1 left) 2024-09-10T17:58:01.794 INFO:tasks.rados.rados.0.smithi012.stdout:547: done (0 left) 2024-09-10T17:58:01.795 INFO:tasks.rados.rados.0.smithi012.stdout:548: snap_remove snap 45 2024-09-10T17:58:02.093 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:01 smithi089 ceph-mon[31467]: osdmap e168: 8 total, 8 up, 8 in 2024-09-10T17:58:02.093 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:01 smithi089 ceph-mon[31467]: osdmap e169: 8 total, 8 up, 8 in 2024-09-10T17:58:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:01 smithi012 ceph-mon[27356]: osdmap e168: 8 total, 8 up, 8 in 2024-09-10T17:58:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:01 smithi012 ceph-mon[27356]: osdmap e169: 8 total, 8 up, 8 in 2024-09-10T17:58:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:01 smithi012 ceph-mon[37454]: osdmap e168: 8 total, 8 up, 8 in 2024-09-10T17:58:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:01 smithi012 ceph-mon[37454]: osdmap e169: 8 total, 8 up, 8 in 2024-09-10T17:58:02.422 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:02.273Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T17:58:02.423 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:02.273Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T17:58:02.423 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:02.276Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T17:58:02.423 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:02.276Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T17:58:02.423 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:02 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:02.276Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T17:58:02.792 INFO:tasks.rados.rados.0.smithi012.stdout:548: done (0 left) 2024-09-10T17:58:02.792 INFO:tasks.rados.rados.0.smithi012.stdout:549: snap_remove snap 40 2024-09-10T17:58:03.035 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:02 smithi089 systemd[1]: Stopping Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:02 smithi089 ceph-mon[31467]: pgmap v24: 121 pgs: 121 active+clean; 135 MiB data, 546 MiB used, 715 GiB / 715 GiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 45 op/s 2024-09-10T17:58:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:02 smithi089 ceph-mon[31467]: osdmap e170: 8 total, 8 up, 8 in 2024-09-10T17:58:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:02 smithi012 ceph-mon[27356]: pgmap v24: 121 pgs: 121 active+clean; 135 MiB data, 546 MiB used, 715 GiB / 715 GiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 45 op/s 2024-09-10T17:58:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:02 smithi012 ceph-mon[27356]: osdmap e170: 8 total, 8 up, 8 in 2024-09-10T17:58:03.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:02 smithi012 ceph-mon[37454]: pgmap v24: 121 pgs: 121 active+clean; 135 MiB data, 546 MiB used, 715 GiB / 715 GiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 45 op/s 2024-09-10T17:58:03.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:02 smithi012 ceph-mon[37454]: osdmap e170: 8 total, 8 up, 8 in 2024-09-10T17:58:03.443 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.150Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.150Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.150Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-10T17:58:03.444 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[62109]: ts=2024-09-10T17:58:03.151Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-10T17:58:03.445 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 podman[72674]: 2024-09-10 17:58:03.16122986 +0000 UTC m=+0.144351146 container died 9c8fe13e4a8edaffbab8b908175662560d767049564ca487198d4854c4840bfc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:03.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 podman[72674]: 2024-09-10 17:58:03.533924999 +0000 UTC m=+0.517046290 container cleanup 9c8fe13e4a8edaffbab8b908175662560d767049564ca487198d4854c4840bfc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:03.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 bash[72674]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a 2024-09-10T17:58:03.797 INFO:tasks.rados.rados.0.smithi012.stdout:549: done (0 left) 2024-09-10T17:58:03.797 INFO:tasks.rados.rados.0.smithi012.stdout:550: rollback oid 12 current snap is 48 2024-09-10T17:58:03.797 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 12 to 37 2024-09-10T17:58:03.797 INFO:tasks.rados.rados.0.smithi012.stdout:551: read oid 21 snap -1 2024-09-10T17:58:03.797 INFO:tasks.rados.rados.0.smithi012.stdout:551: expect (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:58:03.797 INFO:tasks.rados.rados.0.smithi012.stdout:552: snap_remove snap 47 2024-09-10T17:58:04.164 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:04.165 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:03 smithi089 ceph-mon[31467]: osdmap e171: 8 total, 8 up, 8 in 2024-09-10T17:58:04.165 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 podman[72687]: 2024-09-10 17:58:03.8274946 +0000 UTC m=+0.666696375 container remove 9c8fe13e4a8edaffbab8b908175662560d767049564ca487198d4854c4840bfc (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:04.165 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-10T17:58:04.165 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 systemd[1]: Stopped Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:04.165 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service: Consumed 1.551s CPU time. 2024-09-10T17:58:04.165 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:03 smithi089 systemd[1]: Starting Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:03 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:03 smithi012 ceph-mon[27356]: osdmap e171: 8 total, 8 up, 8 in 2024-09-10T17:58:04.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:03 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:04.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:03 smithi012 ceph-mon[37454]: osdmap e171: 8 total, 8 up, 8 in 2024-09-10T17:58:04.448 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 podman[72780]: 2024-09-10 17:58:04.068128523 +0000 UTC m=+0.017210610 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-10T17:58:04.449 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 podman[72780]: 2024-09-10 17:58:04.237582159 +0000 UTC m=+0.186664230 container create 46dd12de2b06f0962bf9720f99fdca32be3cde14ab059eb662af885fd109fa64 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:04.449 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 podman[72780]: 2024-09-10 17:58:04.448149286 +0000 UTC m=+0.397231363 container init 46dd12de2b06f0962bf9720f99fdca32be3cde14ab059eb662af885fd109fa64 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:04.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 podman[72780]: 2024-09-10 17:58:04.45091584 +0000 UTC m=+0.399997921 container start 46dd12de2b06f0962bf9720f99fdca32be3cde14ab059eb662af885fd109fa64 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:04.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.475Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-10T17:58:04.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.475Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.475Z caller=main.go:570 level=info host_details="(Linux 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 x86_64 smithi089 (none))" 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.475Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.475Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.477Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.477Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.478Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.478Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.479Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.479Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.694µs 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.479Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.482Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.488Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.489Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-09-10T17:58:04.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.489Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=18.091µs wal_replay_duration=9.352808ms wbl_replay_duration=131ns total_replay_duration=9.388985ms 2024-09-10T17:58:04.788 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.490Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-10T17:58:04.788 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.490Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-10T17:58:04.788 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.490Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-10T17:58:04.788 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.514Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=23.889321ms db_storage=789ns remote_storage=1.012µs web_handler=370ns query_engine=775ns scrape=424.93µs scrape_sd=122.513µs notify=9.726µs notify_sd=21.143µs rules=22.943477ms tracing=6.588µs 2024-09-10T17:58:04.788 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.514Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-10T17:58:04.788 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:04.514Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-10T17:58:04.788 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 bash[72780]: 46dd12de2b06f0962bf9720f99fdca32be3cde14ab059eb662af885fd109fa64 2024-09-10T17:58:04.788 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:04 smithi089 systemd[1]: Started Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:04.798 INFO:tasks.rados.rados.0.smithi012.stdout:552: done (2 left) 2024-09-10T17:58:04.798 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 48 2024-09-10T17:58:04.798 INFO:tasks.rados.rados.0.smithi012.stdout:553: seq_num 179 ranges {450560=606208} 2024-09-10T17:58:04.804 INFO:tasks.rados.rados.0.smithi012.stdout:553: writing smithi01278544-44 from 450560 to 1056768 tid 1 2024-09-10T17:58:04.804 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 48 2024-09-10T17:58:04.804 INFO:tasks.rados.rados.0.smithi012.stdout:554: seq_num 180 ranges {2711552=622592} 2024-09-10T17:58:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:554: writing smithi01278544-28 from 2711552 to 3334144 tid 1 2024-09-10T17:58:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 48 2024-09-10T17:58:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:551: expect (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:58:04.825 INFO:tasks.rados.rados.0.smithi012.stdout:550: finishing rollback tid 0 to smithi01278544-12 2024-09-10T17:58:04.825 INFO:tasks.rados.rados.0.smithi012.stdout:550: finishing rollback tid 1 to smithi01278544-12 2024-09-10T17:58:04.825 INFO:tasks.rados.rados.0.smithi012.stdout:550: finishing rollback tid 2 to smithi01278544-12 2024-09-10T17:58:04.825 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 216 (ObjNum 106 snap 21 seq_num 106) dirty exists 2024-09-10T17:58:04.825 INFO:tasks.rados.rados.0.smithi012.stdout:555: seq_num 181 ranges {688128=638976} 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:555: writing smithi01278544-11 from 688128 to 1327104 tid 1 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:550: done (4 left) 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:551: done (3 left) 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 48 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:553: finishing write tid 1 to smithi01278544-44 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:553: finishing write tid 2 to smithi01278544-44 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:553: finishing write tid 3 to smithi01278544-44 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:553: oid 44 updating version 0 to 196 2024-09-10T17:58:04.833 INFO:tasks.rados.rados.0.smithi012.stdout:553: oid 44 version 196 is already newer than 195 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 196 (ObjNum 179 snap 48 seq_num 179) dirty exists 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:553: left oid 44 (ObjNum 179 snap 48 seq_num 179) 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:554: finishing write tid 1 to smithi01278544-28 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:554: finishing write tid 2 to smithi01278544-28 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:554: finishing write tid 3 to smithi01278544-28 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:554: oid 28 updating version 0 to 41 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:554: oid 28 updating version 41 to 42 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 42 (ObjNum 180 snap 48 seq_num 180) dirty exists 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:554: left oid 28 (ObjNum 180 snap 48 seq_num 180) 2024-09-10T17:58:04.834 INFO:tasks.rados.rados.0.smithi012.stdout:556: seq_num 182 ranges {6701056=655360} 2024-09-10T17:58:04.873 INFO:tasks.rados.rados.0.smithi012.stdout:556: writing smithi01278544-22 from 6701056 to 7356416 tid 1 2024-09-10T17:58:04.873 INFO:tasks.rados.rados.0.smithi012.stdout:553: done (3 left) 2024-09-10T17:58:04.873 INFO:tasks.rados.rados.0.smithi012.stdout:554: done (2 left) 2024-09-10T17:58:04.873 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 48 2024-09-10T17:58:04.873 INFO:tasks.rados.rados.0.smithi012.stdout:555: finishing write tid 1 to smithi01278544-11 2024-09-10T17:58:04.873 INFO:tasks.rados.rados.0.smithi012.stdout:557: seq_num 183 ranges {688128=671744} 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:557: writing smithi01278544-29 from 688128 to 1359872 tid 1 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:558: setattr oid 30 current snap is 48 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:555: finishing write tid 2 to smithi01278544-11 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:555: finishing write tid 3 to smithi01278544-11 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:555: oid 11 updating version 0 to 226 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:555: oid 11 updating version 226 to 227 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 227 (ObjNum 181 snap 48 seq_num 181) dirty exists 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:555: left oid 11 (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:556: finishing write tid 1 to smithi01278544-22 2024-09-10T17:58:04.881 INFO:tasks.rados.rados.0.smithi012.stdout:556: finishing write tid 2 to smithi01278544-22 2024-09-10T17:58:04.882 INFO:tasks.rados.rados.0.smithi012.stdout:556: finishing write tid 3 to smithi01278544-22 2024-09-10T17:58:04.882 INFO:tasks.rados.rados.0.smithi012.stdout:556: oid 22 updating version 0 to 230 2024-09-10T17:58:04.882 INFO:tasks.rados.rados.0.smithi012.stdout:556: oid 22 version 230 is already newer than 229 2024-09-10T17:58:04.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 230 (ObjNum 182 snap 48 seq_num 182) dirty exists 2024-09-10T17:58:04.882 INFO:tasks.rados.rados.0.smithi012.stdout:556: left oid 22 (ObjNum 182 snap 48 seq_num 182) 2024-09-10T17:58:04.883 INFO:tasks.rados.rados.0.smithi012.stdout:555: done (3 left) 2024-09-10T17:58:04.884 INFO:tasks.rados.rados.0.smithi012.stdout:556: done (2 left) 2024-09-10T17:58:04.884 INFO:tasks.rados.rados.0.smithi012.stdout:559: delete oid 7 current snap is 48 2024-09-10T17:58:04.887 INFO:tasks.rados.rados.0.smithi012.stdout:559: done (2 left) 2024-09-10T17:58:04.887 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 48 2024-09-10T17:58:04.887 INFO:tasks.rados.rados.0.smithi012.stdout:560: seq_num 185 ranges {3063808=704512} 2024-09-10T17:58:04.910 INFO:tasks.rados.rados.0.smithi012.stdout:560: writing smithi01278544-24 from 3063808 to 3768320 tid 1 2024-09-10T17:58:04.910 INFO:tasks.rados.rados.0.smithi012.stdout:561: copy_from oid 45 from oid 6 current snap is 48 2024-09-10T17:58:04.910 INFO:tasks.rados.rados.0.smithi012.stdout:557: finishing write tid 1 to smithi01278544-29 2024-09-10T17:58:04.910 INFO:tasks.rados.rados.0.smithi012.stdout:557: finishing write tid 2 to smithi01278544-29 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 97 (ObjNum 73 snap 10 seq_num 73) dirty exists 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:557: finishing write tid 3 to smithi01278544-29 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:557: oid 29 updating version 0 to 184 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:557: oid 29 version 184 is already newer than 183 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 184 (ObjNum 183 snap 48 seq_num 183) dirty exists 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:557: left oid 29 (ObjNum 183 snap 48 seq_num 183) 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:557: done (3 left) 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:558: done (2 left) 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:562: rollback oid 9 current snap is 48 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 44 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:563: copy_from oid 32 from oid 18 current snap is 48 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:564: copy_from oid 17 from oid 7 current snap is 48 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 48 2024-09-10T17:58:04.911 INFO:tasks.rados.rados.0.smithi012.stdout:565: seq_num 186 ranges {6103040=720896} 2024-09-10T17:58:04.948 INFO:tasks.rados.rados.0.smithi012.stdout:565: writing smithi01278544-16 from 6103040 to 6823936 tid 1 2024-09-10T17:58:04.948 INFO:tasks.rados.rados.0.smithi012.stdout:566: snap_remove snap 36 2024-09-10T17:58:04.961 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T17:58:05.205 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[27356]: pgmap v27: 121 pgs: 121 active+clean; 132 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 144 KiB/s wr, 0 op/s 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[27356]: osdmap e172: 8 total, 8 up, 8 in 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[37454]: pgmap v27: 121 pgs: 121 active+clean; 132 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 144 KiB/s wr, 0 op/s 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:05.206 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:05.207 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:04 smithi012 ceph-mon[37454]: osdmap e172: 8 total, 8 up, 8 in 2024-09-10T17:58:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-mon[31467]: pgmap v27: 121 pgs: 121 active+clean; 132 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 144 KiB/s wr, 0 op/s 2024-09-10T17:58:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:04 smithi089 ceph-mon[31467]: osdmap e172: 8 total, 8 up, 8 in 2024-09-10T17:58:05.551 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T17:58:05.551 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (3m) 11s ago 4m 28.9M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (3m) 10s ago 3m 89.0M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (5m) 11s ago 5m 17.5M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (5m) 10s ago 5m 17.7M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (36s) 10s ago 9m 500M - 19.3.0-4858-gbad1f558 542e6e6af07c 65268c62eeb7 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:9283,8765 running (10m) 11s ago 10m 277M - 18.2.4-837-g7a853b17 f21ba1eea74e 46d8d80f1292 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (10m) 11s ago 10m 54.2M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2f6698e39d41 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (9m) 10s ago 9m 45.8M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e bddaa233c388 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (9m) 11s ago 9m 42.7M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2ba771d7bc46 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (3m) 11s ago 3m 15.3M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (3m) 10s ago 3m 16.8M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (8m) 11s ago 8m 100M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e a54550a62cfe 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (8m) 11s ago 8m 82.5M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T17:58:05.552 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (7m) 11s ago 7m 91.3M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T17:58:05.553 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (7m) 11s ago 7m 83.0M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T17:58:05.553 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (7m) 10s ago 7m 108M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T17:58:05.553 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (6m) 10s ago 6m 91.7M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T17:58:05.553 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (6m) 10s ago 6m 86.1M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T17:58:05.553 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (6m) 10s ago 6m 74.3M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T17:58:05.553 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 starting - - - - 2024-09-10T17:58:05.847 INFO:tasks.rados.rados.0.smithi012.stdout:564: finishing copy_from to smithi01278544-17 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:564: got expected ENOENT (src dne) 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:564: finishing copy_from racing read to smithi01278544-17 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:562: finishing rollback tid 0 to smithi01278544-9 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:560: finishing write tid 1 to smithi01278544-24 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:560: finishing write tid 2 to smithi01278544-24 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:563: finishing copy_from racing read to smithi01278544-32 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:562: finishing rollback tid 1 to smithi01278544-9 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:562: finishing rollback tid 2 to smithi01278544-9 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 170 (ObjNum 81 snap 15 seq_num 81) dirty exists 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:561: finishing copy_from racing read to smithi01278544-45 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:563: finishing copy_from to smithi01278544-32 2024-09-10T17:58:05.848 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 207 (ObjNum 171 snap 46 seq_num 171) dirty exists 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:560: finishing write tid 3 to smithi01278544-24 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:560: oid 24 updating version 0 to 153 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:560: oid 24 version 153 is already newer than 152 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 153 (ObjNum 185 snap 48 seq_num 185) dirty exists 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:560: left oid 24 (ObjNum 185 snap 48 seq_num 185) 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:561: finishing copy_from to smithi01278544-45 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 76 (ObjNum 163 snap 44 seq_num 163) dirty exists 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:565: finishing write tid 1 to smithi01278544-16 2024-09-10T17:58:05.849 INFO:tasks.rados.rados.0.smithi012.stdout:565: finishing write tid 2 to smithi01278544-16 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:565: finishing write tid 3 to smithi01278544-16 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:565: oid 16 updating version 0 to 99 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:565: oid 16 version 99 is already newer than 98 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 99 (ObjNum 186 snap 48 seq_num 186) dirty exists 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:565: left oid 16 (ObjNum 186 snap 48 seq_num 186) 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:560: done (6 left) 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:561: done (5 left) 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:562: done (4 left) 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:563: done (3 left) 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:564: done (2 left) 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:565: done (1 left) 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:566: done (0 left) 2024-09-10T17:58:05.850 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 48 2024-09-10T17:58:05.851 INFO:tasks.rados.rados.0.smithi012.stdout:567: seq_num 187 ranges {2998272=737280} 2024-09-10T17:58:05.869 INFO:tasks.rados.rados.0.smithi012.stdout:567: writing smithi01278544-50 from 2998272 to 3735552 tid 1 2024-09-10T17:58:05.869 INFO:tasks.rados.rados.0.smithi012.stdout:568: read oid 22 snap -1 2024-09-10T17:58:05.869 INFO:tasks.rados.rados.0.smithi012.stdout:568: expect (ObjNum 182 snap 48 seq_num 182) 2024-09-10T17:58:05.869 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 48 2024-09-10T17:58:05.869 INFO:tasks.rados.rados.0.smithi012.stdout:569: seq_num 188 ranges {2719744=753664} 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:569: writing smithi01278544-9 from 2719744 to 3473408 tid 1 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:570: snap_create 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:567: finishing write tid 1 to smithi01278544-50 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:567: finishing write tid 2 to smithi01278544-50 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:567: finishing write tid 3 to smithi01278544-50 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:567: oid 50 updating version 0 to 69 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:567: oid 50 version 69 is already newer than 68 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 69 (ObjNum 187 snap 48 seq_num 187) dirty exists 2024-09-10T17:58:05.888 INFO:tasks.rados.rados.0.smithi012.stdout:567: left oid 50 (ObjNum 187 snap 48 seq_num 187) 2024-09-10T17:58:05.892 INFO:tasks.rados.rados.0.smithi012.stdout:569: finishing write tid 1 to smithi01278544-9 2024-09-10T17:58:05.892 INFO:tasks.rados.rados.0.smithi012.stdout:569: finishing write tid 2 to smithi01278544-9 2024-09-10T17:58:05.894 INFO:tasks.rados.rados.0.smithi012.stdout:569: finishing write tid 3 to smithi01278544-9 2024-09-10T17:58:05.894 INFO:tasks.rados.rados.0.smithi012.stdout:569: oid 9 updating version 0 to 176 2024-09-10T17:58:05.894 INFO:tasks.rados.rados.0.smithi012.stdout:569: oid 9 version 176 is already newer than 175 2024-09-10T17:58:05.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 176 (ObjNum 188 snap 48 seq_num 188) dirty exists 2024-09-10T17:58:05.895 INFO:tasks.rados.rados.0.smithi012.stdout:569: left oid 9 (ObjNum 188 snap 48 seq_num 188) 2024-09-10T17:58:05.898 INFO:tasks.rados.rados.0.smithi012.stdout:568: expect (ObjNum 182 snap 48 seq_num 182) 2024-09-10T17:58:05.922 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:58:05.922 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T17:58:05.922 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:58:05.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:58:05.922 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T17:58:05.922 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 1, 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 1 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 14, 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 1 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T17:58:05.923 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:58:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:05 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:05 smithi089 ceph-mon[31467]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-10T17:58:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:05 smithi089 ceph-mon[31467]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-10T17:58:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:05 smithi089 ceph-mon[31467]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:05 smithi089 ceph-mon[31467]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[27356]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[27356]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[27356]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[27356]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[27356]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[37454]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[37454]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[37454]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:06.184 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:05 smithi012 ceph-mon[37454]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:06.226 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:58:06.227 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T17:58:06.227 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T17:58:06.227 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T17:58:06.227 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [], 2024-09-10T17:58:06.227 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "1/20 daemons upgraded", 2024-09-10T17:58:06.227 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T17:58:06.227 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T17:58:06.227 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:58:06.853 INFO:tasks.rados.rados.0.smithi012.stdout:567: done (3 left) 2024-09-10T17:58:06.853 INFO:tasks.rados.rados.0.smithi012.stdout:568: done (2 left) 2024-09-10T17:58:06.853 INFO:tasks.rados.rados.0.smithi012.stdout:569: done (1 left) 2024-09-10T17:58:06.853 INFO:tasks.rados.rados.0.smithi012.stdout:570: done (0 left) 2024-09-10T17:58:06.853 INFO:tasks.rados.rados.0.smithi012.stdout:571: delete oid 2 current snap is 49 2024-09-10T17:58:06.856 INFO:tasks.rados.rados.0.smithi012.stdout:571: done (0 left) 2024-09-10T17:58:06.856 INFO:tasks.rados.rados.0.smithi012.stdout:572: delete oid 5 current snap is 49 2024-09-10T17:58:06.859 INFO:tasks.rados.rados.0.smithi012.stdout:572: done (0 left) 2024-09-10T17:58:06.859 INFO:tasks.rados.rados.0.smithi012.stdout:573: read oid 43 snap -1 2024-09-10T17:58:06.860 INFO:tasks.rados.rados.0.smithi012.stdout:573: expect (ObjNum 147 snap 36 seq_num 147) 2024-09-10T17:58:06.860 INFO:tasks.rados.rados.0.smithi012.stdout:574: read oid 45 snap 48 2024-09-10T17:58:06.860 INFO:tasks.rados.rados.0.smithi012.stdout:574: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:58:06.860 INFO:tasks.rados.rados.0.smithi012.stdout:575: snap_remove snap 44 2024-09-10T17:58:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: osdmap e173: 8 total, 8 up, 8 in 2024-09-10T17:58:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/2363429975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: pgmap v30: 121 pgs: 121 active+clean; 116 MiB data, 555 MiB used, 715 GiB / 715 GiB avail; 973 KiB/s rd, 144 KiB/s wr, 8 op/s 2024-09-10T17:58:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: Upgrade: Updating mgr.y 2024-09-10T17:58:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: Deploying daemon mgr.y on smithi012 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[27356]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: osdmap e173: 8 total, 8 up, 8 in 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/2363429975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: pgmap v30: 121 pgs: 121 active+clean; 116 MiB data, 555 MiB used, 715 GiB / 715 GiB avail; 973 KiB/s rd, 144 KiB/s wr, 8 op/s 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: Upgrade: Updating mgr.y 2024-09-10T17:58:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: Deploying daemon mgr.y on smithi012 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:06 smithi012 ceph-mon[37454]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: osdmap e173: 8 total, 8 up, 8 in 2024-09-10T17:58:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/2363429975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: pgmap v30: 121 pgs: 121 active+clean; 116 MiB data, 555 MiB used, 715 GiB / 715 GiB avail; 973 KiB/s rd, 144 KiB/s wr, 8 op/s 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: Upgrade: Updating mgr.y 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: Deploying daemon mgr.y on smithi012 2024-09-10T17:58:07.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:06 smithi089 ceph-mon[31467]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:07.855 INFO:tasks.rados.rados.0.smithi012.stdout:575: done (2 left) 2024-09-10T17:58:07.855 INFO:tasks.rados.rados.0.smithi012.stdout:576: copy_from oid 12 from oid 24 current snap is 49 2024-09-10T17:58:07.856 INFO:tasks.rados.rados.0.smithi012.stdout:577: read oid 9 snap -1 2024-09-10T17:58:07.856 INFO:tasks.rados.rados.0.smithi012.stdout:577: expect (ObjNum 188 snap 48 seq_num 188) 2024-09-10T17:58:07.856 INFO:tasks.rados.rados.0.smithi012.stdout:578: rollback oid 4 current snap is 49 2024-09-10T17:58:07.856 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 48 2024-09-10T17:58:07.856 INFO:tasks.rados.rados.0.smithi012.stdout:579: delete oid 35 current snap is 49 2024-09-10T17:58:07.856 INFO:tasks.rados.rados.0.smithi012.stdout:573: expect (ObjNum 147 snap 36 seq_num 147) 2024-09-10T17:58:07.873 INFO:tasks.rados.rados.0.smithi012.stdout:574: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:578: finishing rollback tid 0 to smithi01278544-4 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:578: finishing rollback tid 1 to smithi01278544-4 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:573: done (5 left) 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:574: done (4 left) 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:579: done (3 left) 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:580: read oid 21 snap -1 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:580: expect (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:581: read oid 36 snap -1 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:581: expect (ObjNum 175 snap 47 seq_num 175) 2024-09-10T17:58:07.890 INFO:tasks.rados.rados.0.smithi012.stdout:582: snap_remove snap 37 2024-09-10T17:58:08.164 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:07 smithi012 ceph-mon[27356]: osdmap e174: 8 total, 8 up, 8 in 2024-09-10T17:58:08.165 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:07 smithi012 ceph-mon[37454]: osdmap e174: 8 total, 8 up, 8 in 2024-09-10T17:58:08.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:07 smithi089 ceph-mon[31467]: osdmap e174: 8 total, 8 up, 8 in 2024-09-10T17:58:08.462 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:08 smithi012 systemd[1]: Stopping Ceph mgr.y for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:08.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:08 smithi012 podman[81195]: 2024-09-10 17:58:08.461077526 +0000 UTC m=+0.148570024 container died 46d8d80f1292be4db6e3e9158af6b5cf9102f014d6f2cadc85dcf384a9a010ce (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-7a853b1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T17:58:08.866 INFO:tasks.rados.rados.0.smithi012.stdout:582: done (5 left) 2024-09-10T17:58:08.866 INFO:tasks.rados.rados.0.smithi012.stdout:583: snap_remove snap 46 2024-09-10T17:58:09.110 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:08 smithi012 ceph-mon[27356]: osdmap e175: 8 total, 8 up, 8 in 2024-09-10T17:58:09.110 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:08 smithi012 ceph-mon[27356]: pgmap v33: 121 pgs: 121 active+clean; 116 MiB data, 555 MiB used, 715 GiB / 715 GiB avail; 972 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T17:58:09.110 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 podman[81195]: 2024-09-10 17:58:09.089427048 +0000 UTC m=+0.776919545 container cleanup 46d8d80f1292be4db6e3e9158af6b5cf9102f014d6f2cadc85dcf384a9a010ce (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, RELEASE=reef-7a853b1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T17:58:09.111 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 bash[81195]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y 2024-09-10T17:58:09.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:08 smithi012 ceph-mon[37454]: osdmap e175: 8 total, 8 up, 8 in 2024-09-10T17:58:09.111 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:08 smithi012 ceph-mon[37454]: pgmap v33: 121 pgs: 121 active+clean; 116 MiB data, 555 MiB used, 715 GiB / 715 GiB avail; 972 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T17:58:09.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:08 smithi089 ceph-mon[31467]: osdmap e175: 8 total, 8 up, 8 in 2024-09-10T17:58:09.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:08 smithi089 ceph-mon[31467]: pgmap v33: 121 pgs: 121 active+clean; 116 MiB data, 555 MiB used, 715 GiB / 715 GiB avail; 972 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T17:58:09.550 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 podman[81208]: 2024-09-10 17:58:09.291361017 +0000 UTC m=+0.828406793 container remove 46d8d80f1292be4db6e3e9158af6b5cf9102f014d6f2cadc85dcf384a9a010ce (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=reef-7a853b1, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T17:58:09.550 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-10T17:58:09.550 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-10T17:58:09.550 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 systemd[1]: Stopped Ceph mgr.y for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:09.551 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y.service: Consumed 49.396s CPU time. 2024-09-10T17:58:09.862 INFO:tasks.rados.rados.0.smithi012.stdout:583: done (5 left) 2024-09-10T17:58:09.862 INFO:tasks.rados.rados.0.smithi012.stdout:584: rollback oid 32 current snap is 49 2024-09-10T17:58:09.862 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 32 to 48 2024-09-10T17:58:09.862 INFO:tasks.rados.rados.0.smithi012.stdout:578: finishing rollback tid 2 to smithi01278544-4 2024-09-10T17:58:09.863 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 249 (ObjNum 178 snap 47 seq_num 178) dirty exists 2024-09-10T17:58:09.863 INFO:tasks.rados.rados.0.smithi012.stdout:576: finishing copy_from racing read to smithi01278544-12 2024-09-10T17:58:09.863 INFO:tasks.rados.rados.0.smithi012.stdout:576: finishing copy_from to smithi01278544-12 2024-09-10T17:58:09.863 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 153 (ObjNum 185 snap 48 seq_num 185) dirty exists 2024-09-10T17:58:09.863 INFO:tasks.rados.rados.0.smithi012.stdout:577: expect (ObjNum 188 snap 48 seq_num 188) 2024-09-10T17:58:09.866 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 systemd[1]: Starting Ceph mgr.y for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:10.030 INFO:tasks.rados.rados.0.smithi012.stdout:580: expect (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:58:10.030 INFO:tasks.rados.rados.0.smithi012.stdout:581: expect (ObjNum 175 snap 47 seq_num 175) 2024-09-10T17:58:10.045 INFO:tasks.rados.rados.0.smithi012.stdout:584: finishing rollback tid 0 to smithi01278544-32 2024-09-10T17:58:10.045 INFO:tasks.rados.rados.0.smithi012.stdout:584: finishing rollback tid 1 to smithi01278544-32 2024-09-10T17:58:10.045 INFO:tasks.rados.rados.0.smithi012.stdout:576: done (5 left) 2024-09-10T17:58:10.045 INFO:tasks.rados.rados.0.smithi012.stdout:577: done (4 left) 2024-09-10T17:58:10.045 INFO:tasks.rados.rados.0.smithi012.stdout:578: done (3 left) 2024-09-10T17:58:10.045 INFO:tasks.rados.rados.0.smithi012.stdout:580: done (2 left) 2024-09-10T17:58:10.046 INFO:tasks.rados.rados.0.smithi012.stdout:581: done (1 left) 2024-09-10T17:58:10.046 INFO:tasks.rados.rados.0.smithi012.stdout:585: delete oid 29 current snap is 49 2024-09-10T17:58:10.046 INFO:tasks.rados.rados.0.smithi012.stdout:584: finishing rollback tid 2 to smithi01278544-32 2024-09-10T17:58:10.046 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 211 (ObjNum 171 snap 46 seq_num 171) dirty exists 2024-09-10T17:58:10.047 INFO:tasks.rados.rados.0.smithi012.stdout:584: done (1 left) 2024-09-10T17:58:10.047 INFO:tasks.rados.rados.0.smithi012.stdout:585: done (0 left) 2024-09-10T17:58:10.047 INFO:tasks.rados.rados.0.smithi012.stdout:586: read oid 39 snap -1 2024-09-10T17:58:10.047 INFO:tasks.rados.rados.0.smithi012.stdout:586: expect (ObjNum 176 snap 47 seq_num 176) 2024-09-10T17:58:10.047 INFO:tasks.rados.rados.0.smithi012.stdout:587: read oid 26 snap -1 2024-09-10T17:58:10.047 INFO:tasks.rados.rados.0.smithi012.stdout:587: expect (ObjNum 141 snap 35 seq_num 141) 2024-09-10T17:58:10.047 INFO:tasks.rados.rados.0.smithi012.stdout:588: snap_create 2024-09-10T17:58:10.057 INFO:tasks.rados.rados.0.smithi012.stdout:586: expect (ObjNum 176 snap 47 seq_num 176) 2024-09-10T17:58:10.122 INFO:tasks.rados.rados.0.smithi012.stdout:587: expect (ObjNum 141 snap 35 seq_num 141) 2024-09-10T17:58:10.179 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:09 smithi012 ceph-mon[27356]: osdmap e176: 8 total, 8 up, 8 in 2024-09-10T17:58:10.179 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:09 smithi012 ceph-mon[37454]: osdmap e176: 8 total, 8 up, 8 in 2024-09-10T17:58:10.180 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 podman[81336]: 2024-09-10 17:58:09.854232624 +0000 UTC m=+0.016438007 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T17:58:10.180 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:09 smithi012 podman[81336]: 2024-09-10 17:58:09.975800441 +0000 UTC m=+0.138005814 container create 5fc00b3b01dbc7b748bc9c36b8338080e3c7782d229335e8506890b1fcee649c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T17:58:10.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:09 smithi089 ceph-mon[31467]: osdmap e176: 8 total, 8 up, 8 in 2024-09-10T17:58:10.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:10 smithi012 podman[81336]: 2024-09-10 17:58:10.17894572 +0000 UTC m=+0.341151115 container init 5fc00b3b01dbc7b748bc9c36b8338080e3c7782d229335e8506890b1fcee649c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T17:58:10.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:10 smithi012 podman[81336]: 2024-09-10 17:58:10.185006531 +0000 UTC m=+0.347211904 container start 5fc00b3b01dbc7b748bc9c36b8338080e3c7782d229335e8506890b1fcee649c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T17:58:10.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mgr[81355]: -- 172.21.15.12:0/2305899755 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dd8c4d70e0 con 0x55dd8c4b5400 2024-09-10T17:58:10.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:10 smithi012 bash[81336]: 5fc00b3b01dbc7b748bc9c36b8338080e3c7782d229335e8506890b1fcee649c 2024-09-10T17:58:10.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:10 smithi012 systemd[1]: Started Ceph mgr.y for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:10.876 INFO:tasks.rados.rados.0.smithi012.stdout:586: done (2 left) 2024-09-10T17:58:10.876 INFO:tasks.rados.rados.0.smithi012.stdout:587: done (1 left) 2024-09-10T17:58:10.876 INFO:tasks.rados.rados.0.smithi012.stdout:588: done (0 left) 2024-09-10T17:58:10.876 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 50 2024-09-10T17:58:10.876 INFO:tasks.rados.rados.0.smithi012.stdout:589: seq_num 193 ranges {1056768=434176,1490944=401408} 2024-09-10T17:58:10.884 INFO:tasks.rados.rados.0.smithi012.stdout:589: writing smithi01278544-44 from 1056768 to 1490944 tid 1 2024-09-10T17:58:10.888 INFO:tasks.rados.rados.0.smithi012.stdout:589: writing smithi01278544-44 from 1490944 to 1892352 tid 2 2024-09-10T17:58:10.888 INFO:tasks.rados.rados.0.smithi012.stdout:590: rmattr oid 6 current snap is 50 2024-09-10T17:58:10.888 INFO:tasks.rados.rados.0.smithi012.stdout:591: rmattr oid 49 current snap is 50 2024-09-10T17:58:10.888 INFO:tasks.rados.rados.0.smithi012.stdout:591: done (2 left) 2024-09-10T17:58:10.888 INFO:tasks.rados.rados.0.smithi012.stdout:592: rmattr oid 49 current snap is 50 2024-09-10T17:58:10.888 INFO:tasks.rados.rados.0.smithi012.stdout:592: done (2 left) 2024-09-10T17:58:10.888 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 50 2024-09-10T17:58:10.889 INFO:tasks.rados.rados.0.smithi012.stdout:593: seq_num 194 ranges {0=458752,458752=401408} 2024-09-10T17:58:10.891 INFO:tasks.rados.rados.0.smithi012.stdout:593: writing smithi01278544-35 from 0 to 458752 tid 1 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:593: writing smithi01278544-35 from 458752 to 860160 tid 2 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 50 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:589: finishing write tid 1 to smithi01278544-44 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:589: finishing write tid 2 to smithi01278544-44 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:589: finishing write tid 3 to smithi01278544-44 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:589: finishing write tid 4 to smithi01278544-44 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:589: oid 44 updating version 0 to 209 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:589: oid 44 updating version 209 to 210 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:589: oid 44 version 210 is already newer than 208 2024-09-10T17:58:10.895 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 210 (ObjNum 193 snap 50 seq_num 193) dirty exists 2024-09-10T17:58:10.896 INFO:tasks.rados.rados.0.smithi012.stdout:589: left oid 44 (ObjNum 193 snap 50 seq_num 193) 2024-09-10T17:58:10.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 109 (ObjNum 163 snap 44 seq_num 163) dirty exists 2024-09-10T17:58:10.896 INFO:tasks.rados.rados.0.smithi012.stdout:594: seq_num 195 ranges {5849088=475136,6324224=401408} 2024-09-10T17:58:10.931 INFO:tasks.rados.rados.0.smithi012.stdout:594: writing smithi01278544-26 from 5849088 to 6324224 tid 1 2024-09-10T17:58:10.934 INFO:tasks.rados.rados.0.smithi012.stdout:594: writing smithi01278544-26 from 6324224 to 6725632 tid 2 2024-09-10T17:58:10.934 INFO:tasks.rados.rados.0.smithi012.stdout:589: done (3 left) 2024-09-10T17:58:10.934 INFO:tasks.rados.rados.0.smithi012.stdout:590: done (2 left) 2024-09-10T17:58:10.934 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 50 2024-09-10T17:58:10.934 INFO:tasks.rados.rados.0.smithi012.stdout:593: finishing write tid 1 to smithi01278544-35 2024-09-10T17:58:10.934 INFO:tasks.rados.rados.0.smithi012.stdout:593: finishing write tid 2 to smithi01278544-35 2024-09-10T17:58:10.934 INFO:tasks.rados.rados.0.smithi012.stdout:593: finishing write tid 3 to smithi01278544-35 2024-09-10T17:58:10.934 INFO:tasks.rados.rados.0.smithi012.stdout:593: finishing write tid 4 to smithi01278544-35 2024-09-10T17:58:10.935 INFO:tasks.rados.rados.0.smithi012.stdout:593: oid 35 updating version 0 to 214 2024-09-10T17:58:10.935 INFO:tasks.rados.rados.0.smithi012.stdout:593: oid 35 version 214 is already newer than 212 2024-09-10T17:58:10.935 INFO:tasks.rados.rados.0.smithi012.stdout:593: oid 35 version 214 is already newer than 213 2024-09-10T17:58:10.935 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 214 (ObjNum 194 snap 50 seq_num 194) dirty exists 2024-09-10T17:58:10.935 INFO:tasks.rados.rados.0.smithi012.stdout:593: left oid 35 (ObjNum 194 snap 50 seq_num 194) 2024-09-10T17:58:10.935 INFO:tasks.rados.rados.0.smithi012.stdout:595: seq_num 196 ranges {5464064=491520,5955584=401408} 2024-09-10T17:58:10.969 INFO:tasks.rados.rados.0.smithi012.stdout:595: writing smithi01278544-23 from 5464064 to 5955584 tid 1 2024-09-10T17:58:10.972 INFO:tasks.rados.rados.0.smithi012.stdout:595: writing smithi01278544-23 from 5955584 to 6356992 tid 2 2024-09-10T17:58:10.972 INFO:tasks.rados.rados.0.smithi012.stdout:593: done (2 left) 2024-09-10T17:58:10.972 INFO:tasks.rados.rados.0.smithi012.stdout:596: read oid 20 snap -1 2024-09-10T17:58:10.972 INFO:tasks.rados.rados.0.smithi012.stdout:596: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:597: setattr oid 36 current snap is 50 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:594: finishing write tid 1 to smithi01278544-26 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:594: finishing write tid 2 to smithi01278544-26 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:594: finishing write tid 3 to smithi01278544-26 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:594: finishing write tid 4 to smithi01278544-26 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:594: oid 26 updating version 0 to 168 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:594: oid 26 updating version 168 to 169 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:594: oid 26 version 169 is already newer than 167 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 169 (ObjNum 195 snap 50 seq_num 195) dirty exists 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:594: left oid 26 (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:58:10.973 INFO:tasks.rados.rados.0.smithi012.stdout:596: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:58:10.977 INFO:tasks.rados.rados.0.smithi012.stdout:595: finishing write tid 1 to smithi01278544-23 2024-09-10T17:58:10.977 INFO:tasks.rados.rados.0.smithi012.stdout:595: finishing write tid 2 to smithi01278544-23 2024-09-10T17:58:10.977 INFO:tasks.rados.rados.0.smithi012.stdout:595: finishing write tid 3 to smithi01278544-23 2024-09-10T17:58:10.977 INFO:tasks.rados.rados.0.smithi012.stdout:595: finishing write tid 4 to smithi01278544-23 2024-09-10T17:58:10.977 INFO:tasks.rados.rados.0.smithi012.stdout:595: oid 23 updating version 0 to 244 2024-09-10T17:58:10.977 INFO:tasks.rados.rados.0.smithi012.stdout:595: oid 23 version 244 is already newer than 243 2024-09-10T17:58:10.978 INFO:tasks.rados.rados.0.smithi012.stdout:595: oid 23 version 244 is already newer than 242 2024-09-10T17:58:10.978 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 244 (ObjNum 196 snap 50 seq_num 196) dirty exists 2024-09-10T17:58:10.978 INFO:tasks.rados.rados.0.smithi012.stdout:595: left oid 23 (ObjNum 196 snap 50 seq_num 196) 2024-09-10T17:58:10.978 INFO:tasks.rados.rados.0.smithi012.stdout:594: done (3 left) 2024-09-10T17:58:10.978 INFO:tasks.rados.rados.0.smithi012.stdout:595: done (2 left) 2024-09-10T17:58:10.978 INFO:tasks.rados.rados.0.smithi012.stdout:596: done (1 left) 2024-09-10T17:58:10.978 INFO:tasks.rados.rados.0.smithi012.stdout:598: setattr oid 33 current snap is 50 2024-09-10T17:58:10.979 INFO:tasks.rados.rados.0.smithi012.stdout:599: snap_create 2024-09-10T17:58:10.979 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 171 (ObjNum 175 snap 47 seq_num 175) dirty exists 2024-09-10T17:58:10.982 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 351 (ObjNum 106 snap 21 seq_num 106) dirty exists 2024-09-10T17:58:11.255 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:10 smithi089 ceph-mon[31467]: osdmap e177: 8 total, 8 up, 8 in 2024-09-10T17:58:11.255 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:10 smithi089 ceph-mon[31467]: pgmap v36: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:58:11.256 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:10 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.256 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:10 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.256 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:10 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:11.256 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:10 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.256 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:10 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[27356]: osdmap e177: 8 total, 8 up, 8 in 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[27356]: pgmap v36: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[37454]: osdmap e177: 8 total, 8 up, 8 in 2024-09-10T17:58:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[37454]: pgmap v36: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:58:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:10 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:11.793 INFO:tasks.rados.rados.0.smithi012.stdout:597: done (2 left) 2024-09-10T17:58:11.793 INFO:tasks.rados.rados.0.smithi012.stdout:598: done (1 left) 2024-09-10T17:58:11.793 INFO:tasks.rados.rados.0.smithi012.stdout:599: done (0 left) 2024-09-10T17:58:11.793 INFO:tasks.rados.rados.0.smithi012.stdout:600: rollback oid 32 current snap is 51 2024-09-10T17:58:11.793 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 32 to 49 2024-09-10T17:58:11.793 INFO:tasks.rados.rados.0.smithi012.stdout:601: snap_remove snap 50 2024-09-10T17:58:12.122 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:11 smithi012 ceph-mon[27356]: osdmap e178: 8 total, 8 up, 8 in 2024-09-10T17:58:12.122 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:11 smithi012 ceph-mon[27356]: osdmap e179: 8 total, 8 up, 8 in 2024-09-10T17:58:12.122 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:11 smithi012 ceph-mon[37454]: osdmap e178: 8 total, 8 up, 8 in 2024-09-10T17:58:12.123 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:11 smithi012 ceph-mon[37454]: osdmap e179: 8 total, 8 up, 8 in 2024-09-10T17:58:12.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:11 smithi089 ceph-mon[31467]: osdmap e178: 8 total, 8 up, 8 in 2024-09-10T17:58:12.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:11 smithi089 ceph-mon[31467]: osdmap e179: 8 total, 8 up, 8 in 2024-09-10T17:58:12.796 INFO:tasks.rados.rados.0.smithi012.stdout:601: done (1 left) 2024-09-10T17:58:12.796 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 51 2024-09-10T17:58:12.796 INFO:tasks.rados.rados.0.smithi012.stdout:602: seq_num 197 ranges {3768320=507904,4276224=401408} 2024-09-10T17:58:12.819 INFO:tasks.rados.rados.0.smithi012.stdout:602: writing smithi01278544-24 from 3768320 to 4276224 tid 1 2024-09-10T17:58:12.822 INFO:tasks.rados.rados.0.smithi012.stdout:602: writing smithi01278544-24 from 4276224 to 4677632 tid 2 2024-09-10T17:58:12.823 INFO:tasks.rados.rados.0.smithi012.stdout:600: finishing rollback tid 0 to smithi01278544-32 2024-09-10T17:58:12.823 INFO:tasks.rados.rados.0.smithi012.stdout:600: finishing rollback tid 1 to smithi01278544-32 2024-09-10T17:58:12.823 INFO:tasks.rados.rados.0.smithi012.stdout:600: finishing rollback tid 2 to smithi01278544-32 2024-09-10T17:58:12.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 217 (ObjNum 171 snap 46 seq_num 171) dirty exists 2024-09-10T17:58:12.823 INFO:tasks.rados.rados.0.smithi012.stdout:600: done (1 left) 2024-09-10T17:58:12.823 INFO:tasks.rados.rados.0.smithi012.stdout:603: copy_from oid 35 from oid 27 current snap is 51 2024-09-10T17:58:12.823 INFO:tasks.rados.rados.0.smithi012.stdout:604: snap_create 2024-09-10T17:58:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:602: finishing write tid 1 to smithi01278544-24 2024-09-10T17:58:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:603: finishing copy_from to smithi01278544-35 2024-09-10T17:58:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:603: got expected ENOENT (src dne) 2024-09-10T17:58:12.826 INFO:tasks.rados.rados.0.smithi012.stdout:602: finishing write tid 2 to smithi01278544-24 2024-09-10T17:58:12.826 INFO:tasks.rados.rados.0.smithi012.stdout:602: finishing write tid 3 to smithi01278544-24 2024-09-10T17:58:12.826 INFO:tasks.rados.rados.0.smithi012.stdout:603: finishing copy_from racing read to smithi01278544-35 2024-09-10T17:58:12.827 INFO:tasks.rados.rados.0.smithi012.stdout:602: finishing write tid 4 to smithi01278544-24 2024-09-10T17:58:12.827 INFO:tasks.rados.rados.0.smithi012.stdout:602: oid 24 updating version 0 to 173 2024-09-10T17:58:12.827 INFO:tasks.rados.rados.0.smithi012.stdout:602: oid 24 updating version 173 to 175 2024-09-10T17:58:12.827 INFO:tasks.rados.rados.0.smithi012.stdout:602: oid 24 version 175 is already newer than 174 2024-09-10T17:58:12.827 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 175 (ObjNum 197 snap 51 seq_num 197) dirty exists 2024-09-10T17:58:12.827 INFO:tasks.rados.rados.0.smithi012.stdout:602: left oid 24 (ObjNum 197 snap 51 seq_num 197) 2024-09-10T17:58:12.876 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:58:12] "GET /metrics HTTP/1.1" 200 36088 "" "Prometheus/2.43.0" 2024-09-10T17:58:13.176 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:12 smithi012 ceph-mon[27356]: pgmap v39: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:58:13.176 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:12 smithi012 ceph-mon[27356]: osdmap e180: 8 total, 8 up, 8 in 2024-09-10T17:58:13.176 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:12 smithi012 ceph-mon[37454]: pgmap v39: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:58:13.176 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:12 smithi012 ceph-mon[37454]: osdmap e180: 8 total, 8 up, 8 in 2024-09-10T17:58:13.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:12 smithi089 ceph-mon[31467]: pgmap v39: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 8.6 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:58:13.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:12 smithi089 ceph-mon[31467]: osdmap e180: 8 total, 8 up, 8 in 2024-09-10T17:58:13.798 INFO:tasks.rados.rados.0.smithi012.stdout:602: done (2 left) 2024-09-10T17:58:13.798 INFO:tasks.rados.rados.0.smithi012.stdout:603: done (1 left) 2024-09-10T17:58:13.798 INFO:tasks.rados.rados.0.smithi012.stdout:604: done (0 left) 2024-09-10T17:58:13.798 INFO:tasks.rados.rados.0.smithi012.stdout:605: read oid 39 snap -1 2024-09-10T17:58:13.798 INFO:tasks.rados.rados.0.smithi012.stdout:605: expect (ObjNum 176 snap 47 seq_num 176) 2024-09-10T17:58:13.798 INFO:tasks.rados.rados.0.smithi012.stdout:606: read oid 8 snap 41 2024-09-10T17:58:13.798 INFO:tasks.rados.rados.0.smithi012.stdout:606: expect deleted 2024-09-10T17:58:13.799 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 52 2024-09-10T17:58:13.799 INFO:tasks.rados.rados.0.smithi012.stdout:607: seq_num 198 ranges {0=524288,524288=401408} 2024-09-10T17:58:13.800 INFO:tasks.rados.rados.0.smithi012.stdout:607: writing smithi01278544-20 from 0 to 524288 tid 1 2024-09-10T17:58:13.803 INFO:tasks.rados.rados.0.smithi012.stdout:607: writing smithi01278544-20 from 524288 to 925696 tid 2 2024-09-10T17:58:13.803 INFO:tasks.rados.rados.0.smithi012.stdout:608: read oid 11 snap 51 2024-09-10T17:58:13.804 INFO:tasks.rados.rados.0.smithi012.stdout:608: expect (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:13.804 INFO:tasks.rados.rados.0.smithi012.stdout:609: rollback oid 31 current snap is 52 2024-09-10T17:58:13.804 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 51 2024-09-10T17:58:13.804 INFO:tasks.rados.rados.0.smithi012.stdout:606: done (4 left) 2024-09-10T17:58:13.804 INFO:tasks.rados.rados.0.smithi012.stdout:610: rollback oid 5 current snap is 52 2024-09-10T17:58:13.804 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 5 to 48 2024-09-10T17:58:13.804 INFO:tasks.rados.rados.0.smithi012.stdout:611: setattr oid 22 current snap is 52 2024-09-10T17:58:13.806 INFO:tasks.rados.rados.0.smithi012.stdout:605: expect (ObjNum 176 snap 47 seq_num 176) 2024-09-10T17:58:13.869 INFO:tasks.rados.rados.0.smithi012.stdout:607: finishing write tid 1 to smithi01278544-20 2024-09-10T17:58:13.885 INFO:tasks.rados.rados.0.smithi012.stdout:610: finishing rollback tid 1 to smithi01278544-5 2024-09-10T17:58:13.885 INFO:tasks.rados.rados.0.smithi012.stdout:609: finishing rollback tid 1 to smithi01278544-31 2024-09-10T17:58:13.885 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 216 (ObjNum 33 snap 0 seq_num 3422116618) dirty dne 2024-09-10T17:58:13.885 INFO:tasks.rados.rados.0.smithi012.stdout:610: finishing rollback tid 2 to smithi01278544-5 2024-09-10T17:58:13.885 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 61 (ObjNum 465 snap 0 seq_num 3013241403) dirty exists 2024-09-10T17:58:13.886 INFO:tasks.rados.rados.0.smithi012.stdout:607: finishing write tid 2 to smithi01278544-20 2024-09-10T17:58:13.886 INFO:tasks.rados.rados.0.smithi012.stdout:607: finishing write tid 3 to smithi01278544-20 2024-09-10T17:58:13.886 INFO:tasks.rados.rados.0.smithi012.stdout:608: expect (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:13.919 INFO:tasks.rados.rados.0.smithi012.stdout:607: finishing write tid 4 to smithi01278544-20 2024-09-10T17:58:13.919 INFO:tasks.rados.rados.0.smithi012.stdout:607: oid 20 updating version 0 to 272 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:607: oid 20 updating version 272 to 273 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:607: oid 20 updating version 273 to 274 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 274 (ObjNum 198 snap 52 seq_num 198) dirty exists 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:607: left oid 20 (ObjNum 198 snap 52 seq_num 198) 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 276 (ObjNum 182 snap 48 seq_num 182) dirty exists 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:605: done (5 left) 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:607: done (4 left) 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:608: done (3 left) 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:609: done (2 left) 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:610: done (1 left) 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:611: done (0 left) 2024-09-10T17:58:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:612: delete oid 25 current snap is 52 2024-09-10T17:58:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:612: done (0 left) 2024-09-10T17:58:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:613: delete oid 49 current snap is 52 2024-09-10T17:58:13.923 INFO:tasks.rados.rados.0.smithi012.stdout:613: done (0 left) 2024-09-10T17:58:13.923 INFO:tasks.rados.rados.0.smithi012.stdout:614: rmattr oid 13 current snap is 52 2024-09-10T17:58:13.923 INFO:tasks.rados.rados.0.smithi012.stdout:614: done (0 left) 2024-09-10T17:58:13.923 INFO:tasks.rados.rados.0.smithi012.stdout:615: read oid 1 snap -1 2024-09-10T17:58:13.923 INFO:tasks.rados.rados.0.smithi012.stdout:615: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:58:13.923 INFO:tasks.rados.rados.0.smithi012.stdout:616: delete oid 8 current snap is 52 2024-09-10T17:58:13.924 INFO:tasks.rados.rados.0.smithi012.stdout:615: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:58:13.928 INFO:tasks.rados.rados.0.smithi012.stdout:615: done (1 left) 2024-09-10T17:58:13.928 INFO:tasks.rados.rados.0.smithi012.stdout:616: done (0 left) 2024-09-10T17:58:13.928 INFO:tasks.rados.rados.0.smithi012.stdout:617: rollback oid 9 current snap is 52 2024-09-10T17:58:13.928 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 51 2024-09-10T17:58:13.928 INFO:tasks.rados.rados.0.smithi012.stdout:618: read oid 6 snap -1 2024-09-10T17:58:13.928 INFO:tasks.rados.rados.0.smithi012.stdout:618: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:58:13.928 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 52 2024-09-10T17:58:13.929 INFO:tasks.rados.rados.0.smithi012.stdout:619: seq_num 202 ranges {540672=589824,1130496=401408} 2024-09-10T17:58:13.936 INFO:tasks.rados.rados.0.smithi012.stdout:619: writing smithi01278544-36 from 540672 to 1130496 tid 1 2024-09-10T17:58:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:619: writing smithi01278544-36 from 1130496 to 1531904 tid 2 2024-09-10T17:58:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:620: copy_from oid 22 from oid 44 current snap is 52 2024-09-10T17:58:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:617: finishing rollback tid 0 to smithi01278544-9 2024-09-10T17:58:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:617: finishing rollback tid 1 to smithi01278544-9 2024-09-10T17:58:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:621: delete oid 41 current snap is 52 2024-09-10T17:58:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:618: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:58:13.951 INFO:tasks.rados.rados.0.smithi012.stdout:617: finishing rollback tid 2 to smithi01278544-9 2024-09-10T17:58:13.951 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 188 (ObjNum 188 snap 48 seq_num 188) dirty exists 2024-09-10T17:58:13.951 INFO:tasks.rados.rados.0.smithi012.stdout:619: finishing write tid 1 to smithi01278544-36 2024-09-10T17:58:13.951 INFO:tasks.rados.rados.0.smithi012.stdout:619: finishing write tid 2 to smithi01278544-36 2024-09-10T17:58:13.951 INFO:tasks.rados.rados.0.smithi012.stdout:617: done (4 left) 2024-09-10T17:58:13.951 INFO:tasks.rados.rados.0.smithi012.stdout:618: done (3 left) 2024-09-10T17:58:13.951 INFO:tasks.rados.rados.0.smithi012.stdout:621: done (2 left) 2024-09-10T17:58:13.951 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 52 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:619: finishing write tid 3 to smithi01278544-36 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:619: finishing write tid 4 to smithi01278544-36 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:619: oid 36 updating version 0 to 178 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:619: oid 36 updating version 178 to 179 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:619: oid 36 version 179 is already newer than 177 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 179 (ObjNum 202 snap 52 seq_num 202) dirty exists 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:619: left oid 36 (ObjNum 202 snap 52 seq_num 202) 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:620: finishing copy_from racing read to smithi01278544-22 2024-09-10T17:58:13.952 INFO:tasks.rados.rados.0.smithi012.stdout:622: seq_num 204 ranges {0=622592,622592=401408} 2024-09-10T17:58:13.954 INFO:tasks.rados.rados.0.smithi012.stdout:622: writing smithi01278544-40 from 0 to 622592 tid 1 2024-09-10T17:58:13.957 INFO:tasks.rados.rados.0.smithi012.stdout:622: writing smithi01278544-40 from 622592 to 1024000 tid 2 2024-09-10T17:58:13.957 INFO:tasks.rados.rados.0.smithi012.stdout:619: done (2 left) 2024-09-10T17:58:13.957 INFO:tasks.rados.rados.0.smithi012.stdout:623: snap_create 2024-09-10T17:58:13.957 INFO:tasks.rados.rados.0.smithi012.stdout:620: finishing copy_from to smithi01278544-22 2024-09-10T17:58:13.957 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 210 (ObjNum 193 snap 50 seq_num 193) dirty exists 2024-09-10T17:58:13.960 INFO:tasks.rados.rados.0.smithi012.stdout:622: finishing write tid 1 to smithi01278544-40 2024-09-10T17:58:13.961 INFO:tasks.rados.rados.0.smithi012.stdout:622: finishing write tid 2 to smithi01278544-40 2024-09-10T17:58:13.961 INFO:tasks.rados.rados.0.smithi012.stdout:622: finishing write tid 3 to smithi01278544-40 2024-09-10T17:58:13.962 INFO:tasks.rados.rados.0.smithi012.stdout:622: finishing write tid 4 to smithi01278544-40 2024-09-10T17:58:13.962 INFO:tasks.rados.rados.0.smithi012.stdout:622: oid 40 updating version 0 to 353 2024-09-10T17:58:13.962 INFO:tasks.rados.rados.0.smithi012.stdout:622: oid 40 updating version 353 to 354 2024-09-10T17:58:13.962 INFO:tasks.rados.rados.0.smithi012.stdout:622: oid 40 updating version 354 to 355 2024-09-10T17:58:13.962 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 355 (ObjNum 204 snap 52 seq_num 204) dirty exists 2024-09-10T17:58:13.962 INFO:tasks.rados.rados.0.smithi012.stdout:622: left oid 40 (ObjNum 204 snap 52 seq_num 204) 2024-09-10T17:58:14.806 INFO:tasks.rados.rados.0.smithi012.stdout:620: done (2 left) 2024-09-10T17:58:14.806 INFO:tasks.rados.rados.0.smithi012.stdout:622: done (1 left) 2024-09-10T17:58:14.806 INFO:tasks.rados.rados.0.smithi012.stdout:623: done (0 left) 2024-09-10T17:58:14.806 INFO:tasks.rados.rados.0.smithi012.stdout:624: delete oid 35 current snap is 53 2024-09-10T17:58:14.809 INFO:tasks.rados.rados.0.smithi012.stdout:624: done (0 left) 2024-09-10T17:58:14.809 INFO:tasks.rados.rados.0.smithi012.stdout:625: snap_create 2024-09-10T17:58:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:14 smithi089 ceph-mon[31467]: osdmap e181: 8 total, 8 up, 8 in 2024-09-10T17:58:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:14 smithi089 ceph-mon[31467]: pgmap v42: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:14 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:14 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:14 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:14 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[27356]: osdmap e181: 8 total, 8 up, 8 in 2024-09-10T17:58:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[27356]: pgmap v42: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[37454]: osdmap e181: 8 total, 8 up, 8 in 2024-09-10T17:58:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[37454]: pgmap v42: 121 pgs: 121 active+clean; 126 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:14 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:15.810 INFO:tasks.rados.rados.0.smithi012.stdout:625: done (0 left) 2024-09-10T17:58:15.810 INFO:tasks.rados.rados.0.smithi012.stdout:626: snap_create 2024-09-10T17:58:15.810 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:15] ENGINE Bus STARTING 2024-09-10T17:58:15.810 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: CherryPy Checker: 2024-09-10T17:58:15.810 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: The Application mounted at '' has an empty config. 2024-09-10T17:58:15.811 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:16.100 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:15] ENGINE Serving on http://:::9283 2024-09-10T17:58:16.100 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:15] ENGINE Bus STARTED 2024-09-10T17:58:16.100 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: osdmap e182: 8 total, 8 up, 8 in 2024-09-10T17:58:16.100 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: Standby manager daemon y restarted 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: Standby manager daemon y started 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: osdmap e182: 8 total, 8 up, 8 in 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: Standby manager daemon y restarted 2024-09-10T17:58:16.101 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: Standby manager daemon y started 2024-09-10T17:58:16.102 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T17:58:16.102 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:16.102 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T17:58:16.102 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:15 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:16.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: osdmap e182: 8 total, 8 up, 8 in 2024-09-10T17:58:16.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: Standby manager daemon y restarted 2024-09-10T17:58:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: Standby manager daemon y started 2024-09-10T17:58:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T17:58:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T17:58:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:15 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:16.822 INFO:tasks.rados.rados.0.smithi012.stdout:626: done (0 left) 2024-09-10T17:58:16.822 INFO:tasks.rados.rados.0.smithi012.stdout:627: read oid 22 snap -1 2024-09-10T17:58:16.822 INFO:tasks.rados.rados.0.smithi012.stdout:627: expect (ObjNum 193 snap 50 seq_num 193) 2024-09-10T17:58:16.822 INFO:tasks.rados.rados.0.smithi012.stdout:628: snap_remove snap 35 2024-09-10T17:58:16.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:16 smithi012 ceph-mon[27356]: osdmap e183: 8 total, 8 up, 8 in 2024-09-10T17:58:16.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:16 smithi012 ceph-mon[27356]: pgmap v45: 121 pgs: 121 active+clean; 133 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.2 MiB/s wr, 35 op/s 2024-09-10T17:58:16.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:16 smithi012 ceph-mon[27356]: mgrmap e30: x(active, since 28s), standbys: y 2024-09-10T17:58:16.930 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:16 smithi012 ceph-mon[37454]: osdmap e183: 8 total, 8 up, 8 in 2024-09-10T17:58:16.931 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:16 smithi012 ceph-mon[37454]: pgmap v45: 121 pgs: 121 active+clean; 133 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.2 MiB/s wr, 35 op/s 2024-09-10T17:58:16.931 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:16 smithi012 ceph-mon[37454]: mgrmap e30: x(active, since 28s), standbys: y 2024-09-10T17:58:17.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:16 smithi089 ceph-mon[31467]: osdmap e183: 8 total, 8 up, 8 in 2024-09-10T17:58:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:16 smithi089 ceph-mon[31467]: pgmap v45: 121 pgs: 121 active+clean; 133 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.2 MiB/s wr, 35 op/s 2024-09-10T17:58:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:16 smithi089 ceph-mon[31467]: mgrmap e30: x(active, since 28s), standbys: y 2024-09-10T17:58:17.828 INFO:tasks.rados.rados.0.smithi012.stdout:628: done (1 left) 2024-09-10T17:58:17.828 INFO:tasks.rados.rados.0.smithi012.stdout:629: read oid 48 snap -1 2024-09-10T17:58:17.828 INFO:tasks.rados.rados.0.smithi012.stdout:629: expect (ObjNum 118 snap 29 seq_num 118) 2024-09-10T17:58:17.828 INFO:tasks.rados.rados.0.smithi012.stdout:630: rmattr oid 49 current snap is 55 2024-09-10T17:58:17.828 INFO:tasks.rados.rados.0.smithi012.stdout:630: done (2 left) 2024-09-10T17:58:17.828 INFO:tasks.rados.rados.0.smithi012.stdout:631: delete oid 2 current snap is 55 2024-09-10T17:58:17.828 INFO:tasks.rados.rados.0.smithi012.stdout:627: expect (ObjNum 193 snap 50 seq_num 193) 2024-09-10T17:58:17.907 INFO:tasks.rados.rados.0.smithi012.stdout:629: expect (ObjNum 118 snap 29 seq_num 118) 2024-09-10T17:58:17.960 INFO:tasks.rados.rados.0.smithi012.stdout:627: done (2 left) 2024-09-10T17:58:17.960 INFO:tasks.rados.rados.0.smithi012.stdout:629: done (1 left) 2024-09-10T17:58:17.960 INFO:tasks.rados.rados.0.smithi012.stdout:631: done (0 left) 2024-09-10T17:58:17.960 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 55 2024-09-10T17:58:17.960 INFO:tasks.rados.rados.0.smithi012.stdout:632: seq_num 207 ranges {5185536=671744,5857280=401408} 2024-09-10T17:58:17.991 INFO:tasks.rados.rados.0.smithi012.stdout:632: writing smithi01278544-4 from 5185536 to 5857280 tid 1 2024-09-10T17:58:17.994 INFO:tasks.rados.rados.0.smithi012.stdout:632: writing smithi01278544-4 from 5857280 to 6258688 tid 2 2024-09-10T17:58:17.994 INFO:tasks.rados.rados.0.smithi012.stdout:633: read oid 11 snap -1 2024-09-10T17:58:17.994 INFO:tasks.rados.rados.0.smithi012.stdout:633: expect (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:17.994 INFO:tasks.rados.rados.0.smithi012.stdout:634: read oid 42 snap 54 2024-09-10T17:58:17.994 INFO:tasks.rados.rados.0.smithi012.stdout:634: expect (ObjNum 113 snap 26 seq_num 113) 2024-09-10T17:58:17.994 INFO:tasks.rados.rados.0.smithi012.stdout:635: setattr oid 18 current snap is 55 2024-09-10T17:58:17.997 INFO:tasks.rados.rados.0.smithi012.stdout:636: snap_remove snap 52 2024-09-10T17:58:18.113 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:17 smithi012 ceph-mon[27356]: osdmap e184: 8 total, 8 up, 8 in 2024-09-10T17:58:18.113 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:17 smithi012 ceph-mon[37454]: osdmap e184: 8 total, 8 up, 8 in 2024-09-10T17:58:18.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:17 smithi089 ceph-mon[31467]: osdmap e184: 8 total, 8 up, 8 in 2024-09-10T17:58:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:632: finishing write tid 1 to smithi01278544-4 2024-09-10T17:58:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:632: finishing write tid 2 to smithi01278544-4 2024-09-10T17:58:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:632: finishing write tid 3 to smithi01278544-4 2024-09-10T17:58:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 275 (ObjNum 171 snap 46 seq_num 171) dirty exists 2024-09-10T17:58:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:633: expect (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:18.859 INFO:tasks.rados.rados.0.smithi012.stdout:632: finishing write tid 4 to smithi01278544-4 2024-09-10T17:58:18.860 INFO:tasks.rados.rados.0.smithi012.stdout:632: oid 4 updating version 0 to 274 2024-09-10T17:58:18.860 INFO:tasks.rados.rados.0.smithi012.stdout:632: oid 4 updating version 274 to 275 2024-09-10T17:58:18.860 INFO:tasks.rados.rados.0.smithi012.stdout:632: oid 4 version 275 is already newer than 273 2024-09-10T17:58:18.860 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 275 (ObjNum 207 snap 55 seq_num 207) dirty exists 2024-09-10T17:58:18.860 INFO:tasks.rados.rados.0.smithi012.stdout:632: left oid 4 (ObjNum 207 snap 55 seq_num 207) 2024-09-10T17:58:18.861 INFO:tasks.rados.rados.0.smithi012.stdout:634: expect (ObjNum 113 snap 26 seq_num 113) 2024-09-10T17:58:18.913 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:18] ENGINE Bus STOPPING 2024-09-10T17:58:18.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: osdmap e185: 8 total, 8 up, 8 in 2024-09-10T17:58:18.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: pgmap v48: 121 pgs: 121 active+clean; 133 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.2 MiB/s wr, 35 op/s 2024-09-10T17:58:18.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:18.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: Activating manager daemon y 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: osdmap e186: 8 total, 8 up, 8 in 2024-09-10T17:58:18.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.24826 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: mgrmap e31: y(active, starting, since 0.00665091s) 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:58:18.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:58:18.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: osdmap e185: 8 total, 8 up, 8 in 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: pgmap v48: 121 pgs: 121 active+clean; 133 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.2 MiB/s wr, 35 op/s 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: Activating manager daemon y 2024-09-10T17:58:18.918 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: osdmap e186: 8 total, 8 up, 8 in 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.24826 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: mgrmap e31: y(active, starting, since 0.00665091s) 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:58:18.919 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:58:18.920 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:58:18.920 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:58:18.920 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:58:18.920 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:58:18.920 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:58:18.937 INFO:tasks.rados.rados.0.smithi012.stdout:632: done (4 left) 2024-09-10T17:58:18.937 INFO:tasks.rados.rados.0.smithi012.stdout:633: done (3 left) 2024-09-10T17:58:18.937 INFO:tasks.rados.rados.0.smithi012.stdout:634: done (2 left) 2024-09-10T17:58:18.937 INFO:tasks.rados.rados.0.smithi012.stdout:635: done (1 left) 2024-09-10T17:58:18.937 INFO:tasks.rados.rados.0.smithi012.stdout:636: done (0 left) 2024-09-10T17:58:18.937 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 55 2024-09-10T17:58:18.937 INFO:tasks.rados.rados.0.smithi012.stdout:637: seq_num 208 ranges {0=688128,688128=401408} 2024-09-10T17:58:18.940 INFO:tasks.rados.rados.0.smithi012.stdout:637: writing smithi01278544-29 from 0 to 688128 tid 1 2024-09-10T17:58:18.942 INFO:tasks.rados.rados.0.smithi012.stdout:637: writing smithi01278544-29 from 688128 to 1089536 tid 2 2024-09-10T17:58:18.943 INFO:tasks.rados.rados.0.smithi012.stdout:638: snap_create 2024-09-10T17:58:18.945 INFO:tasks.rados.rados.0.smithi012.stdout:637: finishing write tid 1 to smithi01278544-29 2024-09-10T17:58:18.945 INFO:tasks.rados.rados.0.smithi012.stdout:637: finishing write tid 2 to smithi01278544-29 2024-09-10T17:58:18.945 INFO:tasks.rados.rados.0.smithi012.stdout:637: finishing write tid 3 to smithi01278544-29 2024-09-10T17:58:18.946 INFO:tasks.rados.rados.0.smithi012.stdout:637: finishing write tid 4 to smithi01278544-29 2024-09-10T17:58:18.946 INFO:tasks.rados.rados.0.smithi012.stdout:637: oid 29 updating version 0 to 186 2024-09-10T17:58:18.947 INFO:tasks.rados.rados.0.smithi012.stdout:637: oid 29 updating version 186 to 188 2024-09-10T17:58:18.947 INFO:tasks.rados.rados.0.smithi012.stdout:637: oid 29 version 188 is already newer than 187 2024-09-10T17:58:18.947 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 188 (ObjNum 208 snap 55 seq_num 208) dirty exists 2024-09-10T17:58:18.947 INFO:tasks.rados.rados.0.smithi012.stdout:637: left oid 29 (ObjNum 208 snap 55 seq_num 208) 2024-09-10T17:58:19.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:58:19.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:18 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:18] ENGINE Bus STOPPED 2024-09-10T17:58:19.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:58:18.802+0000 7f5f73865640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-10T17:58:19.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: ignoring --setuser ceph since I am not root 2024-09-10T17:58:19.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: ignoring --setgroup ceph since I am not root 2024-09-10T17:58:19.285 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mgr[64198]: -- 172.21.15.89:0/2794399410 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629c96a30e0 con 0x5629c9681400 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: osdmap e185: 8 total, 8 up, 8 in 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: pgmap v48: 121 pgs: 121 active+clean; 133 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.2 MiB/s wr, 35 op/s 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' 2024-09-10T17:58:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 172.21.15.89:0/3811454870' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: Activating manager daemon y 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: osdmap e186: 8 total, 8 up, 8 in 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.24826 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: mgrmap e31: y(active, starting, since 0.00665091s) 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:58:19.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:58:19.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:18 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:58:19.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.477+0000 7f3af997f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.477+0000 7f3af997f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.477+0000 7f3af997f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.477+0000 7f3af997f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.477+0000 7f3af997f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.478+0000 7f3afc985640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.478+0000 7f3afc985640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.478+0000 7f3afc985640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.478+0000 7f3afc985640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:19.478+0000 7f3afc985640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:58:19.845 INFO:tasks.rados.rados.0.smithi012.stdout:637: done (1 left) 2024-09-10T17:58:19.845 INFO:tasks.rados.rados.0.smithi012.stdout:638: done (0 left) 2024-09-10T17:58:19.845 INFO:tasks.rados.rados.0.smithi012.stdout:639: setattr oid 43 current snap is 56 2024-09-10T17:58:19.846 INFO:tasks.rados.rados.0.smithi012.stdout:640: snap_remove snap 49 2024-09-10T17:58:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:19 smithi089 ceph-mon[31467]: Manager daemon y is now available 2024-09-10T17:58:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:19 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:19 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:19 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:19 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:58:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:19 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:58:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[27356]: Manager daemon y is now available 2024-09-10T17:58:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:58:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:58:20.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:19] ENGINE Bus STARTING 2024-09-10T17:58:20.285 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:19] ENGINE Serving on http://:::9283 2024-09-10T17:58:20.285 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:19] ENGINE Bus STARTED 2024-09-10T17:58:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[37454]: Manager daemon y is now available 2024-09-10T17:58:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:58:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:19 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:58:20.855 INFO:tasks.rados.rados.0.smithi012.stdout:640: done (1 left) 2024-09-10T17:58:20.855 INFO:tasks.rados.rados.0.smithi012.stdout:641: read oid 21 snap -1 2024-09-10T17:58:20.855 INFO:tasks.rados.rados.0.smithi012.stdout:641: expect (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:58:20.855 INFO:tasks.rados.rados.0.smithi012.stdout:642: snap_remove snap 54 2024-09-10T17:58:21.203 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:20 smithi012 ceph-mon[27356]: osdmap e187: 8 total, 8 up, 8 in 2024-09-10T17:58:21.203 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:20 smithi012 ceph-mon[27356]: mgrmap e32: y(active, since 1.04961s) 2024-09-10T17:58:21.203 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:20 smithi012 ceph-mon[27356]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:21.203 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:20 smithi012 ceph-mon[27356]: pgmap v4: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:21.204 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:20 smithi012 ceph-mon[37454]: osdmap e187: 8 total, 8 up, 8 in 2024-09-10T17:58:21.204 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:20 smithi012 ceph-mon[37454]: mgrmap e32: y(active, since 1.04961s) 2024-09-10T17:58:21.204 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:20 smithi012 ceph-mon[37454]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:21.204 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:20 smithi012 ceph-mon[37454]: pgmap v4: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:21.211 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:20 smithi089 ceph-mon[31467]: osdmap e187: 8 total, 8 up, 8 in 2024-09-10T17:58:21.211 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:20 smithi089 ceph-mon[31467]: mgrmap e32: y(active, since 1.04961s) 2024-09-10T17:58:21.211 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:20 smithi089 ceph-mon[31467]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:21.211 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:20 smithi089 ceph-mon[31467]: pgmap v4: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:21.797 INFO:tasks.rados.rados.0.smithi012.stdout:642: done (2 left) 2024-09-10T17:58:21.797 INFO:tasks.rados.rados.0.smithi012.stdout:643: copy_from oid 46 from oid 26 current snap is 56 2024-09-10T17:58:21.797 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 371 (ObjNum 147 snap 36 seq_num 147) dirty exists 2024-09-10T17:58:21.797 INFO:tasks.rados.rados.0.smithi012.stdout:639: done (2 left) 2024-09-10T17:58:21.797 INFO:tasks.rados.rados.0.smithi012.stdout:644: copy_from oid 16 from oid 20 current snap is 56 2024-09-10T17:58:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:641: expect (ObjNum 145 snap 36 seq_num 145) 2024-09-10T17:58:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:641: done (2 left) 2024-09-10T17:58:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:645: snap_remove snap 55 2024-09-10T17:58:22.155 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:21 smithi089 ceph-mon[31467]: pgmap v5: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:22.156 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:21 smithi089 ceph-mon[31467]: osdmap e188: 8 total, 8 up, 8 in 2024-09-10T17:58:22.156 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:21 smithi089 ceph-mon[31467]: osdmap e189: 8 total, 8 up, 8 in 2024-09-10T17:58:22.216 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-mon[27356]: pgmap v5: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:22.216 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-mon[27356]: osdmap e188: 8 total, 8 up, 8 in 2024-09-10T17:58:22.216 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-mon[27356]: osdmap e189: 8 total, 8 up, 8 in 2024-09-10T17:58:22.216 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-mon[37454]: pgmap v5: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:22.216 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-mon[37454]: osdmap e188: 8 total, 8 up, 8 in 2024-09-10T17:58:22.216 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-mon[37454]: osdmap e189: 8 total, 8 up, 8 in 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:21.986+0000 7f3ad66bc640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:17:58:21] ENGINE Error in HTTPServer.serve 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: Traceback (most recent call last): 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: self._connections.run(self.expiration_interval) 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: self._run(expiration_interval) 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:58:22.217 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: s = self.context.wrap_socket( 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: return self.sslsocket_class._create( 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: self.do_handshake() 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: self._sslobj.do_handshake() 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:58:22.218 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:58:22.804 INFO:tasks.rados.rados.0.smithi012.stdout:645: done (2 left) 2024-09-10T17:58:22.804 INFO:tasks.rados.rados.0.smithi012.stdout:646: delete oid 24 current snap is 56 2024-09-10T17:58:22.804 INFO:tasks.rados.rados.0.smithi012.stdout:644: finishing copy_from racing read to smithi01278544-16 2024-09-10T17:58:22.804 INFO:tasks.rados.rados.0.smithi012.stdout:644: finishing copy_from to smithi01278544-16 2024-09-10T17:58:22.804 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 274 (ObjNum 198 snap 52 seq_num 198) dirty exists 2024-09-10T17:58:22.804 INFO:tasks.rados.rados.0.smithi012.stdout:643: finishing copy_from racing read to smithi01278544-46 2024-09-10T17:58:22.804 INFO:tasks.rados.rados.0.smithi012.stdout:643: finishing copy_from to smithi01278544-46 2024-09-10T17:58:22.804 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 169 (ObjNum 195 snap 50 seq_num 195) dirty exists 2024-09-10T17:58:22.807 INFO:tasks.rados.rados.0.smithi012.stdout:643: done (2 left) 2024-09-10T17:58:22.807 INFO:tasks.rados.rados.0.smithi012.stdout:644: done (1 left) 2024-09-10T17:58:22.808 INFO:tasks.rados.rados.0.smithi012.stdout:646: done (0 left) 2024-09-10T17:58:22.808 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 56 2024-09-10T17:58:22.808 INFO:tasks.rados.rados.0.smithi012.stdout:647: seq_num 210 ranges {0=720896,720896=401408} 2024-09-10T17:58:22.812 INFO:tasks.rados.rados.0.smithi012.stdout:647: writing smithi01278544-24 from 0 to 720896 tid 1 2024-09-10T17:58:22.814 INFO:tasks.rados.rados.0.smithi012.stdout:647: writing smithi01278544-24 from 720896 to 1122304 tid 2 2024-09-10T17:58:22.814 INFO:tasks.rados.rados.0.smithi012.stdout:648: copy_from oid 49 from oid 22 current snap is 56 2024-09-10T17:58:22.814 INFO:tasks.rados.rados.0.smithi012.stdout:649: delete oid 35 current snap is 56 2024-09-10T17:58:22.815 INFO:tasks.rados.rados.0.smithi012.stdout:649: done (2 left) 2024-09-10T17:58:22.816 INFO:tasks.rados.rados.0.smithi012.stdout:650: read oid 11 snap -1 2024-09-10T17:58:22.816 INFO:tasks.rados.rados.0.smithi012.stdout:650: expect (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:22.816 INFO:tasks.rados.rados.0.smithi012.stdout:651: snap_remove snap 48 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[27356]: [10/Sep/2024:17:58:21] ENGINE Bus STARTING 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[27356]: [10/Sep/2024:17:58:21] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[27356]: [10/Sep/2024:17:58:21] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[27356]: [10/Sep/2024:17:58:21] ENGINE Bus STARTED 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[27356]: [10/Sep/2024:17:58:21] ENGINE Error in HTTPServer.serve 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:58:23.206 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:58:23.207 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[27356]: mgrmap e33: y(active, since 4s) 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[27356]: osdmap e190: 8 total, 8 up, 8 in 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[37454]: [10/Sep/2024:17:58:21] ENGINE Bus STARTING 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[37454]: [10/Sep/2024:17:58:21] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[37454]: [10/Sep/2024:17:58:21] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[37454]: [10/Sep/2024:17:58:21] ENGINE Bus STARTED 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[37454]: [10/Sep/2024:17:58:21] ENGINE Error in HTTPServer.serve 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.c.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:58:23.208 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: self.do_handshake() 2024-09-10T17:58:23.209 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:58:23.210 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:58:23.210 INFO:journalctl@ceph.mon.c.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:58:23.210 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[37454]: mgrmap e33: y(active, since 4s) 2024-09-10T17:58:23.210 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:22 smithi012 ceph-mon[37454]: osdmap e190: 8 total, 8 up, 8 in 2024-09-10T17:58:23.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:22 smithi089 ceph-mon[31467]: [10/Sep/2024:17:58:21] ENGINE Bus STARTING 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:22 smithi089 ceph-mon[31467]: [10/Sep/2024:17:58:21] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:22 smithi089 ceph-mon[31467]: [10/Sep/2024:17:58:21] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:22 smithi089 ceph-mon[31467]: [10/Sep/2024:17:58:21] ENGINE Bus STARTED 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:22 smithi089 ceph-mon[31467]: [10/Sep/2024:17:58:21] ENGINE Error in HTTPServer.serve 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: Traceback (most recent call last): 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._run(expiration_interval) 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:58:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: s = self.context.wrap_socket( 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: return self.sslsocket_class._create( 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: self.do_handshake() 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._sslobj.do_handshake() 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:22 smithi089 ceph-mon[31467]: mgrmap e33: y(active, since 4s) 2024-09-10T17:58:23.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:22 smithi089 ceph-mon[31467]: osdmap e190: 8 total, 8 up, 8 in 2024-09-10T17:58:23.811 INFO:tasks.rados.rados.0.smithi012.stdout:651: done (3 left) 2024-09-10T17:58:23.811 INFO:tasks.rados.rados.0.smithi012.stdout:652: snap_remove snap 41 2024-09-10T17:58:24.101 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:23 smithi089 ceph-mon[31467]: pgmap v9: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:24.101 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:23 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.102 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:23 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.102 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:23 smithi089 ceph-mon[31467]: osdmap e191: 8 total, 8 up, 8 in 2024-09-10T17:58:24.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:23 smithi012 ceph-mon[27356]: pgmap v9: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:24.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:23 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:23 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:23 smithi012 ceph-mon[27356]: osdmap e191: 8 total, 8 up, 8 in 2024-09-10T17:58:24.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:23 smithi012 ceph-mon[37454]: pgmap v9: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:24.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:23 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:23 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:23 smithi012 ceph-mon[37454]: osdmap e191: 8 total, 8 up, 8 in 2024-09-10T17:58:24.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:58:24] ENGINE Bus STARTING 2024-09-10T17:58:24.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: CherryPy Checker: 2024-09-10T17:58:24.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: The Application mounted at '' has an empty config. 2024-09-10T17:58:24.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: 2024-09-10T17:58:24.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:58:24] ENGINE Serving on http://:::9283 2024-09-10T17:58:24.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[64194]: [10/Sep/2024:17:58:24] ENGINE Bus STARTED 2024-09-10T17:58:24.808 INFO:tasks.rados.rados.0.smithi012.stdout:652: done (3 left) 2024-09-10T17:58:24.808 INFO:tasks.rados.rados.0.smithi012.stdout:653: setattr oid 12 current snap is 56 2024-09-10T17:58:24.808 INFO:tasks.rados.rados.0.smithi012.stdout:647: finishing write tid 1 to smithi01278544-24 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:647: finishing write tid 2 to smithi01278544-24 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:647: finishing write tid 3 to smithi01278544-24 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:647: finishing write tid 4 to smithi01278544-24 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:647: oid 24 updating version 0 to 194 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:647: oid 24 updating version 194 to 196 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:647: oid 24 version 196 is already newer than 195 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 196 (ObjNum 210 snap 56 seq_num 210) dirty exists 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:647: left oid 24 (ObjNum 210 snap 56 seq_num 210) 2024-09-10T17:58:24.809 INFO:tasks.rados.rados.0.smithi012.stdout:650: expect (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:24.869 INFO:tasks.rados.rados.0.smithi012.stdout:648: finishing copy_from racing read to smithi01278544-49 2024-09-10T17:58:24.869 INFO:tasks.rados.rados.0.smithi012.stdout:648: finishing copy_from to smithi01278544-49 2024-09-10T17:58:24.869 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 210 (ObjNum 193 snap 50 seq_num 193) dirty exists 2024-09-10T17:58:24.869 INFO:tasks.rados.rados.0.smithi012.stdout:647: done (3 left) 2024-09-10T17:58:24.869 INFO:tasks.rados.rados.0.smithi012.stdout:648: done (2 left) 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:650: done (1 left) 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:654: copy_from oid 15 from oid 10 current snap is 56 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:655: rollback oid 19 current snap is 56 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 19 to 53 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:656: read oid 36 snap -1 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:656: expect (ObjNum 202 snap 52 seq_num 202) 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:657: read oid 39 snap 51 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:657: expect (ObjNum 176 snap 47 seq_num 176) 2024-09-10T17:58:24.870 INFO:tasks.rados.rados.0.smithi012.stdout:658: snap_create 2024-09-10T17:58:24.871 INFO:tasks.rados.rados.0.smithi012.stdout:655: finishing rollback tid 0 to smithi01278544-19 2024-09-10T17:58:24.871 INFO:tasks.rados.rados.0.smithi012.stdout:655: finishing rollback tid 1 to smithi01278544-19 2024-09-10T17:58:24.871 INFO:tasks.rados.rados.0.smithi012.stdout:655: finishing rollback tid 2 to smithi01278544-19 2024-09-10T17:58:24.871 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 262 (ObjNum 93 snap 16 seq_num 93) dirty exists 2024-09-10T17:58:24.876 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 317 (ObjNum 185 snap 48 seq_num 185) dirty exists 2024-09-10T17:58:24.880 INFO:tasks.rados.rados.0.smithi012.stdout:656: expect (ObjNum 202 snap 52 seq_num 202) 2024-09-10T17:58:24.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: Standby manager daemon x started 2024-09-10T17:58:24.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:58:24.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:24.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:58:24.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:24.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[27356]: osdmap e192: 8 total, 8 up, 8 in 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: Standby manager daemon x started 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.886 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.886 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.886 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.886 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:24.886 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:24 smithi012 ceph-mon[37454]: osdmap e192: 8 total, 8 up, 8 in 2024-09-10T17:58:24.933 INFO:tasks.rados.rados.0.smithi012.stdout:654: finishing copy_from racing read to smithi01278544-15 2024-09-10T17:58:24.933 INFO:tasks.rados.rados.0.smithi012.stdout:657: expect (ObjNum 176 snap 47 seq_num 176) 2024-09-10T17:58:24.994 INFO:tasks.rados.rados.0.smithi012.stdout:654: finishing copy_from to smithi01278544-15 2024-09-10T17:58:24.994 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 151 (ObjNum 77 snap 12 seq_num 77) dirty exists 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: Standby manager daemon x started 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/575192305' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:24 smithi089 ceph-mon[31467]: osdmap e192: 8 total, 8 up, 8 in 2024-09-10T17:58:25.868 INFO:tasks.rados.rados.0.smithi012.stdout:653: done (5 left) 2024-09-10T17:58:25.868 INFO:tasks.rados.rados.0.smithi012.stdout:654: done (4 left) 2024-09-10T17:58:25.868 INFO:tasks.rados.rados.0.smithi012.stdout:655: done (3 left) 2024-09-10T17:58:25.868 INFO:tasks.rados.rados.0.smithi012.stdout:656: done (2 left) 2024-09-10T17:58:25.868 INFO:tasks.rados.rados.0.smithi012.stdout:657: done (1 left) 2024-09-10T17:58:25.868 INFO:tasks.rados.rados.0.smithi012.stdout:658: done (0 left) 2024-09-10T17:58:25.868 INFO:tasks.rados.rados.0.smithi012.stdout:659: snap_remove snap 51 2024-09-10T17:58:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:25 smithi012 ceph-mon[27356]: pgmap v12: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:25 smithi012 ceph-mon[27356]: mgrmap e34: y(active, since 6s), standbys: x 2024-09-10T17:58:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:25 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:58:25.968 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:25 smithi012 ceph-mon[37454]: pgmap v12: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:25.968 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:25 smithi012 ceph-mon[37454]: mgrmap e34: y(active, since 6s), standbys: x 2024-09-10T17:58:25.968 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:25 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:58:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:25 smithi089 ceph-mon[31467]: pgmap v12: 121 pgs: 121 active+clean; 118 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:25 smithi089 ceph-mon[31467]: mgrmap e34: y(active, since 6s), standbys: x 2024-09-10T17:58:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:25 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:58:26.872 INFO:tasks.rados.rados.0.smithi012.stdout:659: done (0 left) 2024-09-10T17:58:26.872 INFO:tasks.rados.rados.0.smithi012.stdout:660: snap_create 2024-09-10T17:58:27.146 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:26 smithi012 ceph-mon[27356]: osdmap e193: 8 total, 8 up, 8 in 2024-09-10T17:58:27.147 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:26 smithi012 ceph-mon[37454]: osdmap e193: 8 total, 8 up, 8 in 2024-09-10T17:58:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:26 smithi089 ceph-mon[31467]: osdmap e193: 8 total, 8 up, 8 in 2024-09-10T17:58:27.874 INFO:tasks.rados.rados.0.smithi012.stdout:660: done (0 left) 2024-09-10T17:58:27.874 INFO:tasks.rados.rados.0.smithi012.stdout:661: read oid 1 snap -1 2024-09-10T17:58:27.874 INFO:tasks.rados.rados.0.smithi012.stdout:661: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:58:27.875 INFO:tasks.rados.rados.0.smithi012.stdout:662: copy_from oid 27 from oid 46 current snap is 58 2024-09-10T17:58:27.875 INFO:tasks.rados.rados.0.smithi012.stdout:663: rollback oid 29 current snap is 58 2024-09-10T17:58:27.875 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 29 to 53 2024-09-10T17:58:27.875 INFO:tasks.rados.rados.0.smithi012.stdout:664: setattr oid 49 current snap is 58 2024-09-10T17:58:27.876 INFO:tasks.rados.rados.0.smithi012.stdout:665: delete oid 24 current snap is 58 2024-09-10T17:58:27.878 INFO:tasks.rados.rados.0.smithi012.stdout:663: finishing rollback tid 0 to smithi01278544-29 2024-09-10T17:58:27.879 INFO:tasks.rados.rados.0.smithi012.stdout:661: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:58:27.884 INFO:tasks.rados.rados.0.smithi012.stdout:663: finishing rollback tid 1 to smithi01278544-29 2024-09-10T17:58:27.884 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 190 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-09-10T17:58:27.884 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 304 (ObjNum 193 snap 50 seq_num 193) dirty exists 2024-09-10T17:58:27.884 INFO:tasks.rados.rados.0.smithi012.stdout:661: done (4 left) 2024-09-10T17:58:27.884 INFO:tasks.rados.rados.0.smithi012.stdout:663: done (3 left) 2024-09-10T17:58:27.884 INFO:tasks.rados.rados.0.smithi012.stdout:664: done (2 left) 2024-09-10T17:58:27.884 INFO:tasks.rados.rados.0.smithi012.stdout:665: done (1 left) 2024-09-10T17:58:27.884 INFO:tasks.rados.rados.0.smithi012.stdout:666: snap_create 2024-09-10T17:58:27.901 INFO:tasks.rados.rados.0.smithi012.stdout:662: finishing copy_from racing read to smithi01278544-27 2024-09-10T17:58:27.905 INFO:tasks.rados.rados.0.smithi012.stdout:662: finishing copy_from to smithi01278544-27 2024-09-10T17:58:27.905 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 169 (ObjNum 195 snap 50 seq_num 195) dirty exists 2024-09-10T17:58:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[27356]: pgmap v14: 121 pgs: 121 active+clean; 104 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-09-10T17:58:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[27356]: osdmap e194: 8 total, 8 up, 8 in 2024-09-10T17:58:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[37454]: pgmap v14: 121 pgs: 121 active+clean; 104 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-09-10T17:58:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[37454]: osdmap e194: 8 total, 8 up, 8 in 2024-09-10T17:58:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:27 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:27 smithi089 ceph-mon[31467]: pgmap v14: 121 pgs: 121 active+clean; 104 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-09-10T17:58:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:27 smithi089 ceph-mon[31467]: osdmap e194: 8 total, 8 up, 8 in 2024-09-10T17:58:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:27 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:27 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:27 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:27 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:28.887 INFO:tasks.rados.rados.0.smithi012.stdout:662: done (1 left) 2024-09-10T17:58:28.887 INFO:tasks.rados.rados.0.smithi012.stdout:666: done (0 left) 2024-09-10T17:58:28.887 INFO:tasks.rados.rados.0.smithi012.stdout:667: delete oid 9 current snap is 59 2024-09-10T17:58:28.891 INFO:tasks.rados.rados.0.smithi012.stdout:667: done (0 left) 2024-09-10T17:58:28.891 INFO:tasks.rados.rados.0.smithi012.stdout:668: snap_create 2024-09-10T17:58:29.145 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:58:29.145 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:58:29.145 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: osdmap e195: 8 total, 8 up, 8 in 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.146 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:28 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:58:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:58:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: osdmap e195: 8 total, 8 up, 8 in 2024-09-10T17:58:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:29.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: osdmap e195: 8 total, 8 up, 8 in 2024-09-10T17:58:29.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:29.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:58:29.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:29.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:28 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:29.894 INFO:tasks.rados.rados.0.smithi012.stdout:668: done (0 left) 2024-09-10T17:58:29.894 INFO:tasks.rados.rados.0.smithi012.stdout:669: rmattr oid 13 current snap is 60 2024-09-10T17:58:29.894 INFO:tasks.rados.rados.0.smithi012.stdout:669: done (0 left) 2024-09-10T17:58:29.894 INFO:tasks.rados.rados.0.smithi012.stdout:670: snap_create 2024-09-10T17:58:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:58:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:58:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: pgmap v17: 121 pgs: 121 active+clean; 104 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-09-10T17:58:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: osdmap e196: 8 total, 8 up, 8 in 2024-09-10T17:58:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:58:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:29 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: pgmap v17: 121 pgs: 121 active+clean; 104 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: osdmap e196: 8 total, 8 up, 8 in 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: Reconfiguring daemon prometheus.a on smithi089 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: pgmap v17: 121 pgs: 121 active+clean; 104 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 27 op/s 2024-09-10T17:58:30.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: osdmap e196: 8 total, 8 up, 8 in 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.288 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:30.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:29 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:30.896 INFO:tasks.rados.rados.0.smithi012.stdout:670: done (0 left) 2024-09-10T17:58:30.897 INFO:tasks.rados.rados.0.smithi012.stdout:671: copy_from oid 43 from oid 39 current snap is 61 2024-09-10T17:58:30.897 INFO:tasks.rados.rados.0.smithi012.stdout:672: delete oid 49 current snap is 61 2024-09-10T17:58:30.902 INFO:tasks.rados.rados.0.smithi012.stdout:672: done (1 left) 2024-09-10T17:58:30.902 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 61 2024-09-10T17:58:30.902 INFO:tasks.rados.rados.0.smithi012.stdout:673: seq_num 215 ranges {6356992=409600,6766592=532480,7299072=270336} 2024-09-10T17:58:30.939 INFO:tasks.rados.rados.0.smithi012.stdout:673: writing smithi01278544-23 from 6356992 to 6766592 tid 1 2024-09-10T17:58:30.942 INFO:tasks.rados.rados.0.smithi012.stdout:673: writing smithi01278544-23 from 6766592 to 7299072 tid 2 2024-09-10T17:58:30.944 INFO:tasks.rados.rados.0.smithi012.stdout:673: writing smithi01278544-23 from 7299072 to 7569408 tid 3 2024-09-10T17:58:30.944 INFO:tasks.rados.rados.0.smithi012.stdout:674: rollback oid 3 current snap is 61 2024-09-10T17:58:30.945 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 56 2024-09-10T17:58:30.945 INFO:tasks.rados.rados.0.smithi012.stdout:671: finishing copy_from racing read to smithi01278544-43 2024-09-10T17:58:30.945 INFO:tasks.rados.rados.0.smithi012.stdout:671: finishing copy_from to smithi01278544-43 2024-09-10T17:58:30.945 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 194 (ObjNum 176 snap 47 seq_num 176) dirty exists 2024-09-10T17:58:30.945 INFO:tasks.rados.rados.0.smithi012.stdout:671: done (2 left) 2024-09-10T17:58:30.945 INFO:tasks.rados.rados.0.smithi012.stdout:675: snap_create 2024-09-10T17:58:30.945 INFO:tasks.rados.rados.0.smithi012.stdout:673: finishing write tid 1 to smithi01278544-23 2024-09-10T17:58:30.946 INFO:tasks.rados.rados.0.smithi012.stdout:673: finishing write tid 2 to smithi01278544-23 2024-09-10T17:58:30.947 INFO:tasks.rados.rados.0.smithi012.stdout:673: finishing write tid 3 to smithi01278544-23 2024-09-10T17:58:30.947 INFO:tasks.rados.rados.0.smithi012.stdout:674: finishing rollback tid 0 to smithi01278544-3 2024-09-10T17:58:30.947 INFO:tasks.rados.rados.0.smithi012.stdout:673: finishing write tid 4 to smithi01278544-23 2024-09-10T17:58:30.947 INFO:tasks.rados.rados.0.smithi012.stdout:674: finishing rollback tid 1 to smithi01278544-3 2024-09-10T17:58:30.947 INFO:tasks.rados.rados.0.smithi012.stdout:674: finishing rollback tid 2 to smithi01278544-3 2024-09-10T17:58:30.947 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 231 (ObjNum 161 snap 43 seq_num 161) dirty exists 2024-09-10T17:58:30.948 INFO:tasks.rados.rados.0.smithi012.stdout:673: finishing write tid 5 to smithi01278544-23 2024-09-10T17:58:30.948 INFO:tasks.rados.rados.0.smithi012.stdout:673: oid 23 updating version 0 to 269 2024-09-10T17:58:30.948 INFO:tasks.rados.rados.0.smithi012.stdout:673: oid 23 version 269 is already newer than 267 2024-09-10T17:58:30.948 INFO:tasks.rados.rados.0.smithi012.stdout:673: oid 23 version 269 is already newer than 268 2024-09-10T17:58:30.948 INFO:tasks.rados.rados.0.smithi012.stdout:673: oid 23 version 269 is already newer than 266 2024-09-10T17:58:30.948 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 269 (ObjNum 215 snap 61 seq_num 215) dirty exists 2024-09-10T17:58:30.948 INFO:tasks.rados.rados.0.smithi012.stdout:673: left oid 23 (ObjNum 215 snap 61 seq_num 215) 2024-09-10T17:58:31.258 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:30 smithi089 ceph-mon[31467]: osdmap e197: 8 total, 8 up, 8 in 2024-09-10T17:58:31.258 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:30 smithi089 ceph-mon[31467]: mgrmap e35: y(active, since 11s), standbys: x 2024-09-10T17:58:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:30 smithi012 ceph-mon[27356]: osdmap e197: 8 total, 8 up, 8 in 2024-09-10T17:58:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:30 smithi012 ceph-mon[27356]: mgrmap e35: y(active, since 11s), standbys: x 2024-09-10T17:58:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:30 smithi012 ceph-mon[37454]: osdmap e197: 8 total, 8 up, 8 in 2024-09-10T17:58:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:30 smithi012 ceph-mon[37454]: mgrmap e35: y(active, since 11s), standbys: x 2024-09-10T17:58:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:673: done (2 left) 2024-09-10T17:58:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:674: done (1 left) 2024-09-10T17:58:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:675: done (0 left) 2024-09-10T17:58:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:676: read oid 42 snap -1 2024-09-10T17:58:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:676: expect (ObjNum 113 snap 26 seq_num 113) 2024-09-10T17:58:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:677: read oid 24 snap -1 2024-09-10T17:58:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:677: expect deleted 2024-09-10T17:58:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:678: snap_create 2024-09-10T17:58:31.816 INFO:tasks.rados.rados.0.smithi012.stdout:676: expect (ObjNum 113 snap 26 seq_num 113) 2024-09-10T17:58:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:31 smithi089 ceph-mon[31467]: pgmap v20: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 26 op/s 2024-09-10T17:58:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:31 smithi089 ceph-mon[31467]: osdmap e198: 8 total, 8 up, 8 in 2024-09-10T17:58:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:31 smithi089 ceph-mon[31467]: osdmap e199: 8 total, 8 up, 8 in 2024-09-10T17:58:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:31 smithi012 ceph-mon[27356]: pgmap v20: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 26 op/s 2024-09-10T17:58:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:31 smithi012 ceph-mon[27356]: osdmap e198: 8 total, 8 up, 8 in 2024-09-10T17:58:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:31 smithi012 ceph-mon[27356]: osdmap e199: 8 total, 8 up, 8 in 2024-09-10T17:58:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:31 smithi012 ceph-mon[37454]: pgmap v20: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 26 op/s 2024-09-10T17:58:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:31 smithi012 ceph-mon[37454]: osdmap e198: 8 total, 8 up, 8 in 2024-09-10T17:58:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:31 smithi012 ceph-mon[37454]: osdmap e199: 8 total, 8 up, 8 in 2024-09-10T17:58:32.525 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 systemd[1]: Stopping Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-10T17:58:32.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-10T17:58:32.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-10T17:58:32.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-10T17:58:32.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[72794]: ts=2024-09-10T17:58:32.524Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-10T17:58:32.787 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:32 smithi089 podman[75224]: 2024-09-10 17:58:32.534270228 +0000 UTC m=+0.140942382 container died 46dd12de2b06f0962bf9720f99fdca32be3cde14ab059eb662af885fd109fa64 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:32.804 INFO:tasks.rados.rados.0.smithi012.stdout:676: done (2 left) 2024-09-10T17:58:32.804 INFO:tasks.rados.rados.0.smithi012.stdout:677: done (1 left) 2024-09-10T17:58:32.804 INFO:tasks.rados.rados.0.smithi012.stdout:678: done (0 left) 2024-09-10T17:58:32.804 INFO:tasks.rados.rados.0.smithi012.stdout:679: delete oid 10 current snap is 63 2024-09-10T17:58:32.808 INFO:tasks.rados.rados.0.smithi012.stdout:679: done (0 left) 2024-09-10T17:58:32.808 INFO:tasks.rados.rados.0.smithi012.stdout:680: snap_create 2024-09-10T17:58:33.285 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 podman[75224]: 2024-09-10 17:58:33.167028406 +0000 UTC m=+0.773700557 container cleanup 46dd12de2b06f0962bf9720f99fdca32be3cde14ab059eb662af885fd109fa64 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:33.285 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 bash[75224]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a 2024-09-10T17:58:33.785 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 podman[75236]: 2024-09-10 17:58:33.384909239 +0000 UTC m=+0.853196799 container remove 46dd12de2b06f0962bf9720f99fdca32be3cde14ab059eb662af885fd109fa64 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:33.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-10T17:58:33.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 systemd[1]: Stopped Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:33.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service: Consumed 1.024s CPU time. 2024-09-10T17:58:33.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 systemd[1]: Starting Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:680: done (0 left) 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:681: read oid 17 snap -1 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:681: expect (ObjNum 98 snap 18 seq_num 98) 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:682: rollback oid 6 current snap is 64 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 6 to 53 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:683: read oid 27 snap 53 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:683: expect deleted 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:684: copy_from oid 18 from oid 22 current snap is 64 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:685: rmattr oid 14 current snap is 64 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:685: done (4 left) 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 64 2024-09-10T17:58:33.810 INFO:tasks.rados.rados.0.smithi012.stdout:686: seq_num 217 ranges {1327104=442368,1769472=696320,2465792=106496} 2024-09-10T17:58:33.821 INFO:tasks.rados.rados.0.smithi012.stdout:686: writing smithi01278544-11 from 1327104 to 1769472 tid 1 2024-09-10T17:58:33.826 INFO:tasks.rados.rados.0.smithi012.stdout:686: writing smithi01278544-11 from 1769472 to 2465792 tid 2 2024-09-10T17:58:33.827 INFO:tasks.rados.rados.0.smithi012.stdout:686: writing smithi01278544-11 from 2465792 to 2572288 tid 3 2024-09-10T17:58:33.827 INFO:tasks.rados.rados.0.smithi012.stdout:687: setattr oid 25 current snap is 64 2024-09-10T17:58:33.827 INFO:tasks.rados.rados.0.smithi012.stdout:682: finishing rollback tid 0 to smithi01278544-6 2024-09-10T17:58:33.827 INFO:tasks.rados.rados.0.smithi012.stdout:682: finishing rollback tid 1 to smithi01278544-6 2024-09-10T17:58:33.827 INFO:tasks.rados.rados.0.smithi012.stdout:682: finishing rollback tid 2 to smithi01278544-6 2024-09-10T17:58:33.827 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 277 (ObjNum 163 snap 44 seq_num 163) dirty exists 2024-09-10T17:58:33.827 INFO:tasks.rados.rados.0.smithi012.stdout:686: finishing write tid 1 to smithi01278544-11 2024-09-10T17:58:33.827 INFO:tasks.rados.rados.0.smithi012.stdout:684: finishing copy_from racing read to smithi01278544-18 2024-09-10T17:58:33.828 INFO:tasks.rados.rados.0.smithi012.stdout:682: done (5 left) 2024-09-10T17:58:33.828 INFO:tasks.rados.rados.0.smithi012.stdout:683: done (4 left) 2024-09-10T17:58:33.828 INFO:tasks.rados.rados.0.smithi012.stdout:688: read oid 3 snap -1 2024-09-10T17:58:33.828 INFO:tasks.rados.rados.0.smithi012.stdout:688: expect (ObjNum 161 snap 43 seq_num 161) 2024-09-10T17:58:33.828 INFO:tasks.rados.rados.0.smithi012.stdout:689: delete oid 43 current snap is 64 2024-09-10T17:58:33.828 INFO:tasks.rados.rados.0.smithi012.stdout:681: expect (ObjNum 98 snap 18 seq_num 98) 2024-09-10T17:58:33.954 INFO:tasks.rados.rados.0.smithi012.stdout:684: finishing copy_from to smithi01278544-18 2024-09-10T17:58:33.954 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 210 (ObjNum 193 snap 50 seq_num 193) dirty exists 2024-09-10T17:58:33.954 INFO:tasks.rados.rados.0.smithi012.stdout:686: finishing write tid 2 to smithi01278544-11 2024-09-10T17:58:33.954 INFO:tasks.rados.rados.0.smithi012.stdout:686: finishing write tid 3 to smithi01278544-11 2024-09-10T17:58:33.955 INFO:tasks.rados.rados.0.smithi012.stdout:686: finishing write tid 4 to smithi01278544-11 2024-09-10T17:58:33.955 INFO:tasks.rados.rados.0.smithi012.stdout:681: done (5 left) 2024-09-10T17:58:33.955 INFO:tasks.rados.rados.0.smithi012.stdout:684: done (4 left) 2024-09-10T17:58:33.955 INFO:tasks.rados.rados.0.smithi012.stdout:689: done (3 left) 2024-09-10T17:58:33.955 INFO:tasks.rados.rados.0.smithi012.stdout:690: delete oid 15 current snap is 64 2024-09-10T17:58:33.955 INFO:tasks.rados.rados.0.smithi012.stdout:688: expect (ObjNum 161 snap 43 seq_num 161) 2024-09-10T17:58:33.962 INFO:tasks.rados.rados.0.smithi012.stdout:686: finishing write tid 5 to smithi01278544-11 2024-09-10T17:58:33.962 INFO:tasks.rados.rados.0.smithi012.stdout:686: oid 11 updating version 0 to 332 2024-09-10T17:58:33.962 INFO:tasks.rados.rados.0.smithi012.stdout:686: oid 11 version 332 is already newer than 329 2024-09-10T17:58:33.962 INFO:tasks.rados.rados.0.smithi012.stdout:686: oid 11 version 332 is already newer than 331 2024-09-10T17:58:33.962 INFO:tasks.rados.rados.0.smithi012.stdout:686: oid 11 version 332 is already newer than 330 2024-09-10T17:58:33.963 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 332 (ObjNum 217 snap 64 seq_num 217) dirty exists 2024-09-10T17:58:33.963 INFO:tasks.rados.rados.0.smithi012.stdout:686: left oid 11 (ObjNum 217 snap 64 seq_num 217) 2024-09-10T17:58:33.963 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 333 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T17:58:33.963 INFO:tasks.rados.rados.0.smithi012.stdout:686: done (3 left) 2024-09-10T17:58:33.963 INFO:tasks.rados.rados.0.smithi012.stdout:687: done (2 left) 2024-09-10T17:58:33.963 INFO:tasks.rados.rados.0.smithi012.stdout:688: done (1 left) 2024-09-10T17:58:33.963 INFO:tasks.rados.rados.0.smithi012.stdout:690: done (0 left) 2024-09-10T17:58:33.963 INFO:tasks.rados.rados.0.smithi012.stdout:691: delete oid 30 current snap is 64 2024-09-10T17:58:33.964 INFO:tasks.rados.rados.0.smithi012.stdout:691: done (0 left) 2024-09-10T17:58:33.965 INFO:tasks.rados.rados.0.smithi012.stdout:692: snap_create 2024-09-10T17:58:34.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:33 smithi089 ceph-mon[31467]: osdmap e200: 8 total, 8 up, 8 in 2024-09-10T17:58:34.115 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:33 smithi089 ceph-mon[31467]: pgmap v24: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2024-09-10T17:58:34.115 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 podman[75330]: 2024-09-10 17:58:33.738518564 +0000 UTC m=+0.016317069 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-10T17:58:34.115 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:33 smithi089 podman[75330]: 2024-09-10 17:58:33.894748434 +0000 UTC m=+0.172546925 container create 023c2089aef02417d4888cb976c51afb74393361f219a7b4970376d3890c43a1 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:34.115 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 podman[75330]: 2024-09-10 17:58:34.114146694 +0000 UTC m=+0.391945187 container init 023c2089aef02417d4888cb976c51afb74393361f219a7b4970376d3890c43a1 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:34.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:33 smithi012 ceph-mon[37454]: osdmap e200: 8 total, 8 up, 8 in 2024-09-10T17:58:34.160 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:33 smithi012 ceph-mon[37454]: pgmap v24: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2024-09-10T17:58:34.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:33 smithi012 ceph-mon[27356]: osdmap e200: 8 total, 8 up, 8 in 2024-09-10T17:58:34.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:33 smithi012 ceph-mon[27356]: pgmap v24: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2024-09-10T17:58:34.391 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 podman[75330]: 2024-09-10 17:58:34.117379266 +0000 UTC m=+0.395177775 container start 023c2089aef02417d4888cb976c51afb74393361f219a7b4970376d3890c43a1 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T17:58:34.391 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.141Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-10T17:58:34.391 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.141Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-10T17:58:34.391 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.141Z caller=main.go:570 level=info host_details="(Linux 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 x86_64 smithi089 (none))" 2024-09-10T17:58:34.391 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.141Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.141Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.142Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.142Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.144Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.144Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.145Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.145Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=10.675µs 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.145Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.147Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.154Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.156Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.156Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-09-10T17:58:34.392 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.156Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=70.227µs wal_replay_duration=10.55942ms wbl_replay_duration=134ns total_replay_duration=10.704247ms 2024-09-10T17:58:34.393 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.158Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-10T17:58:34.393 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.158Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-10T17:58:34.393 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.158Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-10T17:58:34.393 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.176Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.489285ms db_storage=769ns remote_storage=1.061µs web_handler=359ns query_engine=601ns scrape=407.426µs scrape_sd=143.575µs notify=16.914µs notify_sd=20.372µs rules=17.571359ms tracing=5.741µs 2024-09-10T17:58:34.393 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.176Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-10T17:58:34.393 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T17:58:34.176Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-10T17:58:34.393 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 bash[75330]: 023c2089aef02417d4888cb976c51afb74393361f219a7b4970376d3890c43a1 2024-09-10T17:58:34.393 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 17:58:34 smithi089 systemd[1]: Started Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:34.810 INFO:tasks.rados.rados.0.smithi012.stdout:692: done (0 left) 2024-09-10T17:58:34.810 INFO:tasks.rados.rados.0.smithi012.stdout:693: snap_create 2024-09-10T17:58:34.945 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-mon[31467]: osdmap e201: 8 total, 8 up, 8 in 2024-09-10T17:58:34.945 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:34.945 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:34.945 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:34.945 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:34.945 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:34 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[37454]: osdmap e201: 8 total, 8 up, 8 in 2024-09-10T17:58:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:35.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[27356]: osdmap e201: 8 total, 8 up, 8 in 2024-09-10T17:58:35.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:35.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:35.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:35.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:35.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:34 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:35.813 INFO:tasks.rados.rados.0.smithi012.stdout:693: done (0 left) 2024-09-10T17:58:35.813 INFO:tasks.rados.rados.0.smithi012.stdout:694: copy_from oid 48 from oid 1 current snap is 66 2024-09-10T17:58:35.813 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 66 2024-09-10T17:58:35.813 INFO:tasks.rados.rados.0.smithi012.stdout:695: seq_num 221 ranges {0=507904,507904=688128,1196032=114688} 2024-09-10T17:58:35.815 INFO:tasks.rados.rados.0.smithi012.stdout:695: writing smithi01278544-41 from 0 to 507904 tid 1 2024-09-10T17:58:35.820 INFO:tasks.rados.rados.0.smithi012.stdout:695: writing smithi01278544-41 from 507904 to 1196032 tid 2 2024-09-10T17:58:35.821 INFO:tasks.rados.rados.0.smithi012.stdout:695: writing smithi01278544-41 from 1196032 to 1310720 tid 3 2024-09-10T17:58:35.821 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 66 2024-09-10T17:58:35.821 INFO:tasks.rados.rados.0.smithi012.stdout:696: seq_num 222 ranges {0=524288,524288=565248,1089536=237568} 2024-09-10T17:58:35.824 INFO:tasks.rados.rados.0.smithi012.stdout:696: writing smithi01278544-25 from 0 to 524288 tid 1 2024-09-10T17:58:35.827 INFO:tasks.rados.rados.0.smithi012.stdout:696: writing smithi01278544-25 from 524288 to 1089536 tid 2 2024-09-10T17:58:35.830 INFO:tasks.rados.rados.0.smithi012.stdout:696: writing smithi01278544-25 from 1089536 to 1327104 tid 3 2024-09-10T17:58:35.830 INFO:tasks.rados.rados.0.smithi012.stdout:697: rmattr oid 32 current snap is 66 2024-09-10T17:58:35.830 INFO:tasks.rados.rados.0.smithi012.stdout:697: done (3 left) 2024-09-10T17:58:35.830 INFO:tasks.rados.rados.0.smithi012.stdout:698: read oid 36 snap -1 2024-09-10T17:58:35.830 INFO:tasks.rados.rados.0.smithi012.stdout:698: expect (ObjNum 202 snap 52 seq_num 202) 2024-09-10T17:58:35.830 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 66 2024-09-10T17:58:35.830 INFO:tasks.rados.rados.0.smithi012.stdout:694: finishing copy_from racing read to smithi01278544-48 2024-09-10T17:58:35.830 INFO:tasks.rados.rados.0.smithi012.stdout:699: seq_num 223 ranges {3735552=540672,4276224=450560,4726784=352256} 2024-09-10T17:58:35.853 INFO:tasks.rados.rados.0.smithi012.stdout:699: writing smithi01278544-50 from 3735552 to 4276224 tid 1 2024-09-10T17:58:35.856 INFO:tasks.rados.rados.0.smithi012.stdout:699: writing smithi01278544-50 from 4276224 to 4726784 tid 2 2024-09-10T17:58:35.858 INFO:tasks.rados.rados.0.smithi012.stdout:699: writing smithi01278544-50 from 4726784 to 5079040 tid 3 2024-09-10T17:58:35.858 INFO:tasks.rados.rados.0.smithi012.stdout:700: rollback oid 18 current snap is 66 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 62 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:694: finishing copy_from to smithi01278544-48 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 158 (ObjNum -798128592 snap 22079 seq_num 304) dirty exists 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:695: finishing write tid 1 to smithi01278544-41 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:696: finishing write tid 1 to smithi01278544-25 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:695: finishing write tid 2 to smithi01278544-41 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:695: finishing write tid 3 to smithi01278544-41 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:695: finishing write tid 4 to smithi01278544-41 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:696: finishing write tid 2 to smithi01278544-25 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:696: finishing write tid 3 to smithi01278544-25 2024-09-10T17:58:35.859 INFO:tasks.rados.rados.0.smithi012.stdout:696: finishing write tid 4 to smithi01278544-25 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:695: finishing write tid 5 to smithi01278544-41 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:695: oid 41 updating version 0 to 292 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:695: oid 41 updating version 292 to 293 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:695: oid 41 updating version 293 to 295 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:695: oid 41 version 295 is already newer than 294 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 295 (ObjNum 221 snap 66 seq_num 221) dirty exists 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:695: left oid 41 (ObjNum 221 snap 66 seq_num 221) 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:696: finishing write tid 5 to smithi01278544-25 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:696: oid 25 updating version 0 to 337 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:696: oid 25 updating version 337 to 338 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:696: oid 25 version 338 is already newer than 335 2024-09-10T17:58:35.860 INFO:tasks.rados.rados.0.smithi012.stdout:696: oid 25 version 338 is already newer than 336 2024-09-10T17:58:35.861 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 338 (ObjNum 222 snap 66 seq_num 222) dirty exists 2024-09-10T17:58:35.861 INFO:tasks.rados.rados.0.smithi012.stdout:696: left oid 25 (ObjNum 222 snap 66 seq_num 222) 2024-09-10T17:58:35.861 INFO:tasks.rados.rados.0.smithi012.stdout:698: expect (ObjNum 202 snap 52 seq_num 202) 2024-09-10T17:58:35.910 INFO:tasks.rados.rados.0.smithi012.stdout:699: finishing write tid 1 to smithi01278544-50 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: finishing write tid 2 to smithi01278544-50 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: finishing write tid 3 to smithi01278544-50 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: finishing write tid 4 to smithi01278544-50 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: finishing write tid 5 to smithi01278544-50 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: oid 50 updating version 0 to 81 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: oid 50 updating version 81 to 84 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: oid 50 version 84 is already newer than 83 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: oid 50 version 84 is already newer than 82 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 84 (ObjNum 223 snap 66 seq_num 223) dirty exists 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:699: left oid 50 (ObjNum 223 snap 66 seq_num 223) 2024-09-10T17:58:35.911 INFO:tasks.rados.rados.0.smithi012.stdout:700: finishing rollback tid 0 to smithi01278544-18 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:700: finishing rollback tid 1 to smithi01278544-18 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:694: done (5 left) 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:695: done (4 left) 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:696: done (3 left) 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:698: done (2 left) 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:699: done (1 left) 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:701: snap_create 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:700: finishing rollback tid 2 to smithi01278544-18 2024-09-10T17:58:35.912 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 314 (ObjNum 171 snap 46 seq_num 171) dirty exists 2024-09-10T17:58:36.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:35 smithi089 ceph-mon[31467]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:36.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:35 smithi089 ceph-mon[31467]: osdmap e202: 8 total, 8 up, 8 in 2024-09-10T17:58:36.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:35 smithi089 ceph-mon[31467]: pgmap v27: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:36.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:35 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:36.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:35 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:58:36.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:35 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[37454]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[37454]: osdmap e202: 8 total, 8 up, 8 in 2024-09-10T17:58:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[37454]: pgmap v27: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:58:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:36.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[27356]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T17:58:36.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[27356]: osdmap e202: 8 total, 8 up, 8 in 2024-09-10T17:58:36.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[27356]: pgmap v27: 121 pgs: 121 active+clean; 100 MiB data, 661 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:36.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T17:58:36.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T17:58:36.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:35 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:36.547 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T17:58:36.831 INFO:tasks.rados.rados.0.smithi012.stdout:700: done (1 left) 2024-09-10T17:58:36.832 INFO:tasks.rados.rados.0.smithi012.stdout:701: done (0 left) 2024-09-10T17:58:36.832 INFO:tasks.rados.rados.0.smithi012.stdout:702: copy_from oid 48 from oid 7 current snap is 67 2024-09-10T17:58:36.832 INFO:tasks.rados.rados.0.smithi012.stdout:703: read oid 2 snap -1 2024-09-10T17:58:36.832 INFO:tasks.rados.rados.0.smithi012.stdout:703: expect deleted 2024-09-10T17:58:36.832 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 67 2024-09-10T17:58:36.832 INFO:tasks.rados.rados.0.smithi012.stdout:704: seq_num 224 ranges {4292608=557056,4849664=737280,5586944=65536} 2024-09-10T17:58:36.858 INFO:tasks.rados.rados.0.smithi012.stdout:704: writing smithi01278544-13 from 4292608 to 4849664 tid 1 2024-09-10T17:58:36.862 INFO:tasks.rados.rados.0.smithi012.stdout:704: writing smithi01278544-13 from 4849664 to 5586944 tid 2 2024-09-10T17:58:36.863 INFO:tasks.rados.rados.0.smithi012.stdout:704: writing smithi01278544-13 from 5586944 to 5652480 tid 3 2024-09-10T17:58:36.863 INFO:tasks.rados.rados.0.smithi012.stdout:705: read oid 47 snap -1 2024-09-10T17:58:36.863 INFO:tasks.rados.rados.0.smithi012.stdout:705: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:58:36.863 INFO:tasks.rados.rados.0.smithi012.stdout:706: setattr oid 20 current snap is 67 2024-09-10T17:58:36.864 INFO:tasks.rados.rados.0.smithi012.stdout:702: finishing copy_from to smithi01278544-48 2024-09-10T17:58:36.864 INFO:tasks.rados.rados.0.smithi012.stdout:702: got expected ENOENT (src dne) 2024-09-10T17:58:36.864 INFO:tasks.rados.rados.0.smithi012.stdout:702: finishing copy_from racing read to smithi01278544-48 2024-09-10T17:58:36.864 INFO:tasks.rados.rados.0.smithi012.stdout:704: finishing write tid 1 to smithi01278544-13 2024-09-10T17:58:36.865 INFO:tasks.rados.rados.0.smithi012.stdout:702: done (4 left) 2024-09-10T17:58:36.865 INFO:tasks.rados.rados.0.smithi012.stdout:703: done (3 left) 2024-09-10T17:58:36.865 INFO:tasks.rados.rados.0.smithi012.stdout:707: read oid 19 snap 65 2024-09-10T17:58:36.866 INFO:tasks.rados.rados.0.smithi012.stdout:707: expect (ObjNum 93 snap 16 seq_num 93) 2024-09-10T17:58:36.866 INFO:tasks.rados.rados.0.smithi012.stdout:708: delete oid 23 current snap is 67 2024-09-10T17:58:36.868 INFO:tasks.rados.rados.0.smithi012.stdout:704: finishing write tid 2 to smithi01278544-13 2024-09-10T17:58:36.868 INFO:tasks.rados.rados.0.smithi012.stdout:704: finishing write tid 3 to smithi01278544-13 2024-09-10T17:58:36.869 INFO:tasks.rados.rados.0.smithi012.stdout:704: finishing write tid 4 to smithi01278544-13 2024-09-10T17:58:36.869 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 340 (ObjNum 198 snap 52 seq_num 198) dirty exists 2024-09-10T17:58:36.869 INFO:tasks.rados.rados.0.smithi012.stdout:705: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:58:36.897 INFO:tasks.rados.rados.0.smithi012.stdout:704: finishing write tid 5 to smithi01278544-13 2024-09-10T17:58:36.897 INFO:tasks.rados.rados.0.smithi012.stdout:704: oid 13 updating version 0 to 297 2024-09-10T17:58:36.897 INFO:tasks.rados.rados.0.smithi012.stdout:704: oid 13 updating version 297 to 298 2024-09-10T17:58:36.897 INFO:tasks.rados.rados.0.smithi012.stdout:704: oid 13 updating version 298 to 299 2024-09-10T17:58:36.897 INFO:tasks.rados.rados.0.smithi012.stdout:704: oid 13 updating version 299 to 300 2024-09-10T17:58:36.897 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 300 (ObjNum 224 snap 67 seq_num 224) dirty exists 2024-09-10T17:58:36.898 INFO:tasks.rados.rados.0.smithi012.stdout:704: left oid 13 (ObjNum 224 snap 67 seq_num 224) 2024-09-10T17:58:36.898 INFO:tasks.rados.rados.0.smithi012.stdout:707: expect (ObjNum 93 snap 16 seq_num 93) 2024-09-10T17:58:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:704: done (4 left) 2024-09-10T17:58:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:705: done (3 left) 2024-09-10T17:58:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:706: done (2 left) 2024-09-10T17:58:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:707: done (1 left) 2024-09-10T17:58:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:708: done (0 left) 2024-09-10T17:58:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 67 2024-09-10T17:58:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:709: seq_num 226 ranges {925696=589824,1515520=507904,2023424=294912} 2024-09-10T17:58:37.017 INFO:tasks.rados.rados.0.smithi012.stdout:709: writing smithi01278544-16 from 925696 to 1515520 tid 1 2024-09-10T17:58:37.021 INFO:tasks.rados.rados.0.smithi012.stdout:709: writing smithi01278544-16 from 1515520 to 2023424 tid 2 2024-09-10T17:58:37.023 INFO:tasks.rados.rados.0.smithi012.stdout:709: writing smithi01278544-16 from 2023424 to 2318336 tid 3 2024-09-10T17:58:37.023 INFO:tasks.rados.rados.0.smithi012.stdout:710: copy_from oid 47 from oid 37 current snap is 67 2024-09-10T17:58:37.023 INFO:tasks.rados.rados.0.smithi012.stdout:711: snap_remove snap 63 2024-09-10T17:58:37.140 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (3m) 13s ago 4m 28.9M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (4m) 13s ago 4m 89.6M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (6m) 13s ago 6m 17.7M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (6m) 13s ago 6m 18.2M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (67s) 13s ago 9m 127M - 19.3.0-4858-gbad1f558 542e6e6af07c 65268c62eeb7 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (27s) 13s ago 11m 488M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (11m) 13s ago 11m 57.4M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2f6698e39d41 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (10m) 13s ago 10m 53.0M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e bddaa233c388 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (9m) 13s ago 9m 48.1M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2ba771d7bc46 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (4m) 13s ago 4m 15.5M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (4m) 13s ago 4m 16.9M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T17:58:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (9m) 13s ago 9m 119M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e a54550a62cfe 2024-09-10T17:58:37.142 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (8m) 13s ago 8m 101M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T17:58:37.142 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (8m) 13s ago 8m 112M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T17:58:37.142 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (8m) 13s ago 8m 101M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T17:58:37.142 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (7m) 13s ago 7m 140M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T17:58:37.142 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (7m) 13s ago 7m 105M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T17:58:37.142 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (6m) 13s ago 6m 95.4M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T17:58:37.142 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (6m) 13s ago 6m 79.8M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T17:58:37.142 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 starting - - - - 2024-09-10T17:58:37.142 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:36 smithi012 ceph-mon[27356]: Upgrade: Updating mgr.x 2024-09-10T17:58:37.142 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:36 smithi012 ceph-mon[27356]: Deploying daemon mgr.x on smithi089 2024-09-10T17:58:37.143 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:36 smithi012 ceph-mon[27356]: osdmap e203: 8 total, 8 up, 8 in 2024-09-10T17:58:37.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:36 smithi012 ceph-mon[37454]: Upgrade: Updating mgr.x 2024-09-10T17:58:37.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:36 smithi012 ceph-mon[37454]: Deploying daemon mgr.x on smithi089 2024-09-10T17:58:37.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:36 smithi012 ceph-mon[37454]: osdmap e203: 8 total, 8 up, 8 in 2024-09-10T17:58:37.204 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:36 smithi089 ceph-mon[31467]: Upgrade: Updating mgr.x 2024-09-10T17:58:37.204 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:36 smithi089 ceph-mon[31467]: Deploying daemon mgr.x on smithi089 2024-09-10T17:58:37.204 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:36 smithi089 ceph-mon[31467]: osdmap e203: 8 total, 8 up, 8 in 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:58:37.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:58:37.490 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T17:58:37.490 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 13, 2024-09-10T17:58:37.490 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T17:58:37.490 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T17:58:37.490 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:58:37.535 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:37 smithi089 systemd[1]: Stopping Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr" 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "2/20 daemons upgraded", 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T17:58:37.785 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:58:37.805 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:37 smithi089 podman[75677]: 2024-09-10 17:58:37.53476419 +0000 UTC m=+0.145079481 container died 65268c62eeb7fe85f95171ff832a393c84c5e921e9164c77ca97172c2930cac9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:711: done (2 left) 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:712: read oid 20 snap -1 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:712: expect (ObjNum 198 snap 52 seq_num 198) 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:713: setattr oid 14 current snap is 67 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:709: finishing write tid 1 to smithi01278544-16 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:710: finishing copy_from to smithi01278544-47 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:710: got expected ENOENT (src dne) 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:710: finishing copy_from racing read to smithi01278544-47 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:709: finishing write tid 2 to smithi01278544-16 2024-09-10T17:58:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:709: finishing write tid 3 to smithi01278544-16 2024-09-10T17:58:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:709: finishing write tid 4 to smithi01278544-16 2024-09-10T17:58:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:709: finishing write tid 5 to smithi01278544-16 2024-09-10T17:58:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:709: oid 16 updating version 0 to 280 2024-09-10T17:58:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:709: oid 16 version 280 is already newer than 278 2024-09-10T17:58:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:709: oid 16 updating version 280 to 281 2024-09-10T17:58:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:709: oid 16 version 281 is already newer than 279 2024-09-10T17:58:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 281 (ObjNum 226 snap 67 seq_num 226) dirty exists 2024-09-10T17:58:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:709: left oid 16 (ObjNum 226 snap 67 seq_num 226) 2024-09-10T17:58:37.833 INFO:tasks.rados.rados.0.smithi012.stdout:709: done (3 left) 2024-09-10T17:58:37.833 INFO:tasks.rados.rados.0.smithi012.stdout:710: done (2 left) 2024-09-10T17:58:37.833 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 67 2024-09-10T17:58:37.833 INFO:tasks.rados.rados.0.smithi012.stdout:714: seq_num 227 ranges {0=606208,606208=794624,1400832=8192} 2024-09-10T17:58:37.836 INFO:tasks.rados.rados.0.smithi012.stdout:714: writing smithi01278544-7 from 0 to 606208 tid 1 2024-09-10T17:58:37.842 INFO:tasks.rados.rados.0.smithi012.stdout:714: writing smithi01278544-7 from 606208 to 1400832 tid 2 2024-09-10T17:58:37.842 INFO:tasks.rados.rados.0.smithi012.stdout:714: writing smithi01278544-7 from 1400832 to 1409024 tid 3 2024-09-10T17:58:37.842 INFO:tasks.rados.rados.0.smithi012.stdout:715: rollback oid 37 current snap is 67 2024-09-10T17:58:37.842 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 37 to 53 2024-09-10T17:58:37.842 INFO:tasks.rados.rados.0.smithi012.stdout:712: expect (ObjNum 198 snap 52 seq_num 198) 2024-09-10T17:58:37.873 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 411 (ObjNum 152 snap 38 seq_num 152) dirty exists 2024-09-10T17:58:37.873 INFO:tasks.rados.rados.0.smithi012.stdout:714: finishing write tid 1 to smithi01278544-7 2024-09-10T17:58:37.873 INFO:tasks.rados.rados.0.smithi012.stdout:712: done (3 left) 2024-09-10T17:58:37.873 INFO:tasks.rados.rados.0.smithi012.stdout:713: done (2 left) 2024-09-10T17:58:37.873 INFO:tasks.rados.rados.0.smithi012.stdout:716: snap_remove snap 62 2024-09-10T17:58:38.165 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:37 smithi089 ceph-mon[31467]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.166 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:37 smithi089 ceph-mon[31467]: pgmap v29: 121 pgs: 121 active+clean; 106 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-09-10T17:58:38.166 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:37 smithi089 ceph-mon[31467]: osdmap e204: 8 total, 8 up, 8 in 2024-09-10T17:58:38.166 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:37 smithi089 ceph-mon[31467]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.166 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:37 smithi089 ceph-mon[31467]: from='client.25097 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.166 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:37 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/1715563851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:38.166 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:37 smithi089 podman[75677]: 2024-09-10 17:58:37.912772807 +0000 UTC m=+0.523088109 container cleanup 65268c62eeb7fe85f95171ff832a393c84c5e921e9164c77ca97172c2930cac9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T17:58:38.166 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:37 smithi089 bash[75677]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x 2024-09-10T17:58:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[27356]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[27356]: pgmap v29: 121 pgs: 121 active+clean; 106 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-09-10T17:58:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[27356]: osdmap e204: 8 total, 8 up, 8 in 2024-09-10T17:58:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[27356]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[27356]: from='client.25097 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[27356]: from='client.? 172.21.15.12:0/1715563851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[37454]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[37454]: pgmap v29: 121 pgs: 121 active+clean; 106 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-09-10T17:58:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[37454]: osdmap e204: 8 total, 8 up, 8 in 2024-09-10T17:58:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[37454]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[37454]: from='client.25097 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:37 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/1715563851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:38.487 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 podman[75690]: 2024-09-10 17:58:38.164323402 +0000 UTC m=+0.631500662 container remove 65268c62eeb7fe85f95171ff832a393c84c5e921e9164c77ca97172c2930cac9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T17:58:38.488 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-10T17:58:38.488 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-09-10T17:58:38.488 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 systemd[1]: Stopped Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:38.488 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x.service: Consumed 17.304s CPU time. 2024-09-10T17:58:38.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 systemd[1]: Starting Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:38.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 podman[75817]: 2024-09-10 17:58:38.599173488 +0000 UTC m=+0.015841789 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T17:58:38.786 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 podman[75817]: 2024-09-10 17:58:38.724703775 +0000 UTC m=+0.141372077 container create 0de40d6da7f2364610b413a2984bb0cc508b81e98bd395c7899b3d17990a421e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T17:58:38.837 INFO:tasks.rados.rados.0.smithi012.stdout:716: done (2 left) 2024-09-10T17:58:38.837 INFO:tasks.rados.rados.0.smithi012.stdout:717: copy_from oid 43 from oid 39 current snap is 67 2024-09-10T17:58:38.837 INFO:tasks.rados.rados.0.smithi012.stdout:715: finishing rollback tid 1 to smithi01278544-37 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: finishing write tid 2 to smithi01278544-7 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: finishing write tid 3 to smithi01278544-7 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: finishing write tid 4 to smithi01278544-7 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: finishing write tid 5 to smithi01278544-7 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: oid 7 updating version 0 to 42 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: oid 7 version 42 is already newer than 40 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: oid 7 version 42 is already newer than 39 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: oid 7 version 42 is already newer than 41 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 42 (ObjNum 227 snap 67 seq_num 227) dirty exists 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: left oid 7 (ObjNum 227 snap 67 seq_num 227) 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:714: done (2 left) 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:715: done (1 left) 2024-09-10T17:58:38.838 INFO:tasks.rados.rados.0.smithi012.stdout:718: copy_from oid 46 from oid 16 current snap is 67 2024-09-10T17:58:38.839 INFO:tasks.rados.rados.0.smithi012.stdout:719: delete oid 28 current snap is 67 2024-09-10T17:58:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:719: done (2 left) 2024-09-10T17:58:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:720: snap_remove snap 57 2024-09-10T17:58:39.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:38 smithi012 ceph-mon[27356]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:39.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:38 smithi012 ceph-mon[27356]: osdmap e205: 8 total, 8 up, 8 in 2024-09-10T17:58:39.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:38 smithi012 ceph-mon[37454]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:39.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:38 smithi012 ceph-mon[37454]: osdmap e205: 8 total, 8 up, 8 in 2024-09-10T17:58:39.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:38 smithi089 ceph-mon[31467]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:58:39.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:38 smithi089 ceph-mon[31467]: osdmap e205: 8 total, 8 up, 8 in 2024-09-10T17:58:39.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 podman[75817]: 2024-09-10 17:58:38.953103634 +0000 UTC m=+0.369771934 container init 0de40d6da7f2364610b413a2984bb0cc508b81e98bd395c7899b3d17990a421e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T17:58:39.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 podman[75817]: 2024-09-10 17:58:38.956054601 +0000 UTC m=+0.372722904 container start 0de40d6da7f2364610b413a2984bb0cc508b81e98bd395c7899b3d17990a421e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T17:58:39.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:38 smithi089 ceph-mgr[75836]: -- 172.21.15.89:0/252352616 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d70bb8f0e0 con 0x55d70bb6d400 2024-09-10T17:58:39.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:39 smithi089 bash[75817]: 0de40d6da7f2364610b413a2984bb0cc508b81e98bd395c7899b3d17990a421e 2024-09-10T17:58:39.286 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:39 smithi089 systemd[1]: Started Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:39.845 INFO:tasks.rados.rados.0.smithi012.stdout:720: done (2 left) 2024-09-10T17:58:39.845 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 67 2024-09-10T17:58:39.845 INFO:tasks.rados.rados.0.smithi012.stdout:717: finishing copy_from racing read to smithi01278544-43 2024-09-10T17:58:39.845 INFO:tasks.rados.rados.0.smithi012.stdout:718: finishing copy_from racing read to smithi01278544-46 2024-09-10T17:58:39.845 INFO:tasks.rados.rados.0.smithi012.stdout:717: finishing copy_from to smithi01278544-43 2024-09-10T17:58:39.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 194 (ObjNum 176 snap 47 seq_num 176) dirty exists 2024-09-10T17:58:39.846 INFO:tasks.rados.rados.0.smithi012.stdout:718: finishing copy_from to smithi01278544-46 2024-09-10T17:58:39.846 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 281 (ObjNum 226 snap 67 seq_num 226) dirty exists 2024-09-10T17:58:39.846 INFO:tasks.rados.rados.0.smithi012.stdout:721: seq_num 229 ranges {2572288=638976,3211264=606208,3817472=196608} 2024-09-10T17:58:39.863 INFO:tasks.rados.rados.0.smithi012.stdout:721: writing smithi01278544-11 from 2572288 to 3211264 tid 1 2024-09-10T17:58:39.866 INFO:tasks.rados.rados.0.smithi012.stdout:721: writing smithi01278544-11 from 3211264 to 3817472 tid 2 2024-09-10T17:58:39.868 INFO:tasks.rados.rados.0.smithi012.stdout:721: writing smithi01278544-11 from 3817472 to 4014080 tid 3 2024-09-10T17:58:39.868 INFO:tasks.rados.rados.0.smithi012.stdout:717: done (2 left) 2024-09-10T17:58:39.868 INFO:tasks.rados.rados.0.smithi012.stdout:718: done (1 left) 2024-09-10T17:58:39.868 INFO:tasks.rados.rados.0.smithi012.stdout:722: delete oid 3 current snap is 67 2024-09-10T17:58:39.868 INFO:tasks.rados.rados.0.smithi012.stdout:721: finishing write tid 1 to smithi01278544-11 2024-09-10T17:58:39.869 INFO:tasks.rados.rados.0.smithi012.stdout:722: done (1 left) 2024-09-10T17:58:39.869 INFO:tasks.rados.rados.0.smithi012.stdout:723: snap_remove snap 66 2024-09-10T17:58:40.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:39 smithi089 ceph-mon[31467]: pgmap v32: 121 pgs: 121 active+clean; 106 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-09-10T17:58:40.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:39 smithi089 ceph-mon[31467]: osdmap e206: 8 total, 8 up, 8 in 2024-09-10T17:58:40.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:39 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:39 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:39 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:40.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:39 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:39 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[27356]: pgmap v32: 121 pgs: 121 active+clean; 106 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-09-10T17:58:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[27356]: osdmap e206: 8 total, 8 up, 8 in 2024-09-10T17:58:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[37454]: pgmap v32: 121 pgs: 121 active+clean; 106 MiB data, 670 MiB used, 715 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2024-09-10T17:58:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[37454]: osdmap e206: 8 total, 8 up, 8 in 2024-09-10T17:58:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:39 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:40.855 INFO:tasks.rados.rados.0.smithi012.stdout:723: done (1 left) 2024-09-10T17:58:40.856 INFO:tasks.rados.rados.0.smithi012.stdout:724: read oid 9 snap -1 2024-09-10T17:58:40.856 INFO:tasks.rados.rados.0.smithi012.stdout:724: expect deleted 2024-09-10T17:58:40.856 INFO:tasks.rados.rados.0.smithi012.stdout:725: snap_remove snap 60 2024-09-10T17:58:41.097 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:40 smithi089 ceph-mon[31467]: osdmap e207: 8 total, 8 up, 8 in 2024-09-10T17:58:41.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:40 smithi012 ceph-mon[27356]: osdmap e207: 8 total, 8 up, 8 in 2024-09-10T17:58:41.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:40 smithi012 ceph-mon[37454]: osdmap e207: 8 total, 8 up, 8 in 2024-09-10T17:58:41.807 INFO:tasks.rados.rados.0.smithi012.stdout:725: done (2 left) 2024-09-10T17:58:41.807 INFO:tasks.rados.rados.0.smithi012.stdout:726: read oid 47 snap -1 2024-09-10T17:58:41.807 INFO:tasks.rados.rados.0.smithi012.stdout:726: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:58:41.807 INFO:tasks.rados.rados.0.smithi012.stdout:727: snap_remove snap 61 2024-09-10T17:58:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:41 smithi089 ceph-mon[31467]: pgmap v35: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.8 MiB/s wr, 24 op/s 2024-09-10T17:58:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:41 smithi089 ceph-mon[31467]: osdmap e208: 8 total, 8 up, 8 in 2024-09-10T17:58:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:41 smithi089 ceph-mon[31467]: osdmap e209: 8 total, 8 up, 8 in 2024-09-10T17:58:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:41 smithi012 ceph-mon[27356]: pgmap v35: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.8 MiB/s wr, 24 op/s 2024-09-10T17:58:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:41 smithi012 ceph-mon[27356]: osdmap e208: 8 total, 8 up, 8 in 2024-09-10T17:58:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:41 smithi012 ceph-mon[27356]: osdmap e209: 8 total, 8 up, 8 in 2024-09-10T17:58:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:41 smithi012 ceph-mon[37454]: pgmap v35: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.8 MiB/s wr, 24 op/s 2024-09-10T17:58:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:41 smithi012 ceph-mon[37454]: osdmap e208: 8 total, 8 up, 8 in 2024-09-10T17:58:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:41 smithi012 ceph-mon[37454]: osdmap e209: 8 total, 8 up, 8 in 2024-09-10T17:58:42.801 INFO:tasks.rados.rados.0.smithi012.stdout:727: done (3 left) 2024-09-10T17:58:42.801 INFO:tasks.rados.rados.0.smithi012.stdout:728: snap_remove snap 64 2024-09-10T17:58:43.809 INFO:tasks.rados.rados.0.smithi012.stdout:728: done (3 left) 2024-09-10T17:58:43.809 INFO:tasks.rados.rados.0.smithi012.stdout:729: snap_remove snap 65 2024-09-10T17:58:44.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:43 smithi089 ceph-mon[31467]: osdmap e210: 8 total, 8 up, 8 in 2024-09-10T17:58:44.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:43 smithi089 ceph-mon[31467]: pgmap v39: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.9 MiB/s wr, 24 op/s 2024-09-10T17:58:44.252 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:43 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:44.252 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:43 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:58:43] "GET /metrics HTTP/1.1" 200 36082 "" "Prometheus/2.43.0" 2024-09-10T17:58:44.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-mon[27356]: osdmap e210: 8 total, 8 up, 8 in 2024-09-10T17:58:44.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-mon[27356]: pgmap v39: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.9 MiB/s wr, 24 op/s 2024-09-10T17:58:44.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:44.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-mon[37454]: osdmap e210: 8 total, 8 up, 8 in 2024-09-10T17:58:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-mon[37454]: pgmap v39: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.9 MiB/s wr, 24 op/s 2024-09-10T17:58:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:43 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:44.535 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: [10/Sep/2024:17:58:44] ENGINE Bus STARTING 2024-09-10T17:58:44.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: CherryPy Checker: 2024-09-10T17:58:44.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: The Application mounted at '' has an empty config. 2024-09-10T17:58:44.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: 2024-09-10T17:58:44.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: [10/Sep/2024:17:58:44] ENGINE Serving on http://:::9283 2024-09-10T17:58:44.536 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: [10/Sep/2024:17:58:44] ENGINE Bus STARTED 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:729: done (3 left) 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:730: snap_create 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:721: finishing write tid 2 to smithi01278544-11 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:721: finishing write tid 3 to smithi01278544-11 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:721: finishing write tid 4 to smithi01278544-11 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:721: finishing write tid 5 to smithi01278544-11 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:721: oid 11 updating version 0 to 359 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:721: oid 11 version 359 is already newer than 358 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:721: oid 11 updating version 359 to 361 2024-09-10T17:58:44.814 INFO:tasks.rados.rados.0.smithi012.stdout:721: oid 11 version 361 is already newer than 360 2024-09-10T17:58:44.815 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 361 (ObjNum 229 snap 67 seq_num 229) dirty exists 2024-09-10T17:58:44.815 INFO:tasks.rados.rados.0.smithi012.stdout:721: left oid 11 (ObjNum 229 snap 67 seq_num 229) 2024-09-10T17:58:44.815 INFO:tasks.rados.rados.0.smithi012.stdout:726: expect (ObjNum 46 snap 0 seq_num 46) 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: osdmap e211: 8 total, 8 up, 8 in 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: Standby manager daemon x restarted 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: Standby manager daemon x started 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:58:44.909 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:44 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: osdmap e211: 8 total, 8 up, 8 in 2024-09-10T17:58:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: Standby manager daemon x restarted 2024-09-10T17:58:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: Standby manager daemon x started 2024-09-10T17:58:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[27356]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: osdmap e211: 8 total, 8 up, 8 in 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: Standby manager daemon x restarted 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: Standby manager daemon x started 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:58:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:58:45.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:44 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/1925370081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:58:45.825 INFO:tasks.rados.rados.0.smithi012.stdout:721: done (3 left) 2024-09-10T17:58:45.825 INFO:tasks.rados.rados.0.smithi012.stdout:724: done (2 left) 2024-09-10T17:58:45.825 INFO:tasks.rados.rados.0.smithi012.stdout:726: done (1 left) 2024-09-10T17:58:45.825 INFO:tasks.rados.rados.0.smithi012.stdout:730: done (0 left) 2024-09-10T17:58:45.825 INFO:tasks.rados.rados.0.smithi012.stdout:731: rollback oid 21 current snap is 68 2024-09-10T17:58:45.825 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 67 2024-09-10T17:58:45.825 INFO:tasks.rados.rados.0.smithi012.stdout:732: copy_from oid 28 from oid 37 current snap is 68 2024-09-10T17:58:45.825 INFO:tasks.rados.rados.0.smithi012.stdout:733: delete oid 1 current snap is 68 2024-09-10T17:58:45.828 INFO:tasks.rados.rados.0.smithi012.stdout:731: finishing rollback tid 0 to smithi01278544-21 2024-09-10T17:58:45.829 INFO:tasks.rados.rados.0.smithi012.stdout:732: finishing copy_from to smithi01278544-28 2024-09-10T17:58:45.829 INFO:tasks.rados.rados.0.smithi012.stdout:732: got expected ENOENT (src dne) 2024-09-10T17:58:45.830 INFO:tasks.rados.rados.0.smithi012.stdout:732: finishing copy_from racing read to smithi01278544-28 2024-09-10T17:58:45.830 INFO:tasks.rados.rados.0.smithi012.stdout:731: finishing rollback tid 1 to smithi01278544-21 2024-09-10T17:58:45.830 INFO:tasks.rados.rados.0.smithi012.stdout:731: finishing rollback tid 2 to smithi01278544-21 2024-09-10T17:58:45.830 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 291 (ObjNum 145 snap 36 seq_num 145) dirty exists 2024-09-10T17:58:45.831 INFO:tasks.rados.rados.0.smithi012.stdout:731: done (2 left) 2024-09-10T17:58:45.831 INFO:tasks.rados.rados.0.smithi012.stdout:732: done (1 left) 2024-09-10T17:58:45.831 INFO:tasks.rados.rados.0.smithi012.stdout:733: done (0 left) 2024-09-10T17:58:45.831 INFO:tasks.rados.rados.0.smithi012.stdout:734: delete oid 15 current snap is 68 2024-09-10T17:58:45.834 INFO:tasks.rados.rados.0.smithi012.stdout:734: done (0 left) 2024-09-10T17:58:45.834 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 68 2024-09-10T17:58:45.834 INFO:tasks.rados.rados.0.smithi012.stdout:735: seq_num 233 ranges {0=712704,712704=548864,1261568=253952} 2024-09-10T17:58:45.837 INFO:tasks.rados.rados.0.smithi012.stdout:735: writing smithi01278544-28 from 0 to 712704 tid 1 2024-09-10T17:58:45.841 INFO:tasks.rados.rados.0.smithi012.stdout:735: writing smithi01278544-28 from 712704 to 1261568 tid 2 2024-09-10T17:58:45.843 INFO:tasks.rados.rados.0.smithi012.stdout:735: writing smithi01278544-28 from 1261568 to 1515520 tid 3 2024-09-10T17:58:45.843 INFO:tasks.rados.rados.0.smithi012.stdout:736: rmattr oid 34 current snap is 68 2024-09-10T17:58:45.843 INFO:tasks.rados.rados.0.smithi012.stdout:735: finishing write tid 1 to smithi01278544-28 2024-09-10T17:58:45.843 INFO:tasks.rados.rados.0.smithi012.stdout:737: snap_create 2024-09-10T17:58:45.844 INFO:tasks.rados.rados.0.smithi012.stdout:735: finishing write tid 2 to smithi01278544-28 2024-09-10T17:58:45.845 INFO:tasks.rados.rados.0.smithi012.stdout:735: finishing write tid 3 to smithi01278544-28 2024-09-10T17:58:45.845 INFO:tasks.rados.rados.0.smithi012.stdout:735: finishing write tid 4 to smithi01278544-28 2024-09-10T17:58:45.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 293 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-10T17:58:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:735: finishing write tid 5 to smithi01278544-28 2024-09-10T17:58:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:735: oid 28 updating version 0 to 72 2024-09-10T17:58:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:735: oid 28 version 72 is already newer than 70 2024-09-10T17:58:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:735: oid 28 version 72 is already newer than 69 2024-09-10T17:58:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:735: oid 28 version 72 is already newer than 71 2024-09-10T17:58:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 72 (ObjNum 233 snap 68 seq_num 233) dirty exists 2024-09-10T17:58:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:735: left oid 28 (ObjNum 233 snap 68 seq_num 233) 2024-09-10T17:58:45.994 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:45 smithi089 ceph-mon[31467]: osdmap e212: 8 total, 8 up, 8 in 2024-09-10T17:58:45.994 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:45 smithi089 ceph-mon[31467]: pgmap v42: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:45.994 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:45 smithi089 ceph-mon[31467]: mgrmap e36: y(active, since 26s), standbys: x 2024-09-10T17:58:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:45 smithi012 ceph-mon[27356]: osdmap e212: 8 total, 8 up, 8 in 2024-09-10T17:58:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:45 smithi012 ceph-mon[27356]: pgmap v42: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:45 smithi012 ceph-mon[27356]: mgrmap e36: y(active, since 26s), standbys: x 2024-09-10T17:58:46.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:45 smithi012 ceph-mon[37454]: osdmap e212: 8 total, 8 up, 8 in 2024-09-10T17:58:46.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:45 smithi012 ceph-mon[37454]: pgmap v42: 121 pgs: 2 active+clean+snaptrim, 119 active+clean; 118 MiB data, 706 MiB used, 715 GiB / 715 GiB avail 2024-09-10T17:58:46.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:45 smithi012 ceph-mon[37454]: mgrmap e36: y(active, since 26s), standbys: x 2024-09-10T17:58:46.829 INFO:tasks.rados.rados.0.smithi012.stdout:735: done (2 left) 2024-09-10T17:58:46.829 INFO:tasks.rados.rados.0.smithi012.stdout:736: done (1 left) 2024-09-10T17:58:46.829 INFO:tasks.rados.rados.0.smithi012.stdout:737: done (0 left) 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:738: rmattr oid 35 current snap is 69 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:738: done (0 left) 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:739: read oid 27 snap -1 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:739: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:740: read oid 37 snap -1 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:740: expect deleted 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:741: read oid 5 snap -1 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:741: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:742: rollback oid 8 current snap is 69 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 8 to 59 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 69 2024-09-10T17:58:46.830 INFO:tasks.rados.rados.0.smithi012.stdout:743: seq_num 234 ranges {778240=729088,1507328=434176,1941504=368640} 2024-09-10T17:58:46.837 INFO:tasks.rados.rados.0.smithi012.stdout:743: writing smithi01278544-47 from 778240 to 1507328 tid 1 2024-09-10T17:58:46.839 INFO:tasks.rados.rados.0.smithi012.stdout:743: writing smithi01278544-47 from 1507328 to 1941504 tid 2 2024-09-10T17:58:46.842 INFO:tasks.rados.rados.0.smithi012.stdout:743: writing smithi01278544-47 from 1941504 to 2310144 tid 3 2024-09-10T17:58:46.842 INFO:tasks.rados.rados.0.smithi012.stdout:744: read oid 28 snap -1 2024-09-10T17:58:46.842 INFO:tasks.rados.rados.0.smithi012.stdout:744: expect (ObjNum 233 snap 68 seq_num 233) 2024-09-10T17:58:46.842 INFO:tasks.rados.rados.0.smithi012.stdout:745: snap_remove snap 53 2024-09-10T17:58:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:46 smithi089 ceph-mon[31467]: osdmap e213: 8 total, 8 up, 8 in 2024-09-10T17:58:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:46 smithi012 ceph-mon[27356]: osdmap e213: 8 total, 8 up, 8 in 2024-09-10T17:58:47.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:46 smithi012 ceph-mon[37454]: osdmap e213: 8 total, 8 up, 8 in 2024-09-10T17:58:47.842 INFO:tasks.rados.rados.0.smithi012.stdout:745: done (6 left) 2024-09-10T17:58:47.842 INFO:tasks.rados.rados.0.smithi012.stdout:746: copy_from oid 23 from oid 41 current snap is 69 2024-09-10T17:58:47.842 INFO:tasks.rados.rados.0.smithi012.stdout:747: rmattr oid 42 current snap is 69 2024-09-10T17:58:47.842 INFO:tasks.rados.rados.0.smithi012.stdout:747: done (7 left) 2024-09-10T17:58:47.842 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 69 2024-09-10T17:58:47.842 INFO:tasks.rados.rados.0.smithi012.stdout:748: seq_num 235 ranges {1474560=745472,2220032=712704,2932736=90112} 2024-09-10T17:58:47.859 INFO:tasks.rados.rados.0.smithi012.stdout:748: writing smithi01278544-39 from 1474560 to 2220032 tid 1 2024-09-10T17:58:47.863 INFO:tasks.rados.rados.0.smithi012.stdout:748: writing smithi01278544-39 from 2220032 to 2932736 tid 2 2024-09-10T17:58:47.865 INFO:tasks.rados.rados.0.smithi012.stdout:748: writing smithi01278544-39 from 2932736 to 3022848 tid 3 2024-09-10T17:58:47.865 INFO:tasks.rados.rados.0.smithi012.stdout:749: read oid 11 snap 59 2024-09-10T17:58:47.865 INFO:tasks.rados.rados.0.smithi012.stdout:749: expect (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:47.865 INFO:tasks.rados.rados.0.smithi012.stdout:750: read oid 26 snap -1 2024-09-10T17:58:47.865 INFO:tasks.rados.rados.0.smithi012.stdout:750: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:58:47.865 INFO:tasks.rados.rados.0.smithi012.stdout:742: finishing rollback tid 1 to smithi01278544-8 2024-09-10T17:58:47.865 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 0 (ObjNum 289 snap 0 seq_num 3496418128) dirty dne 2024-09-10T17:58:47.865 INFO:tasks.rados.rados.0.smithi012.stdout:741: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T17:58:47.867 INFO:tasks.rados.rados.0.smithi012.stdout:743: finishing write tid 1 to smithi01278544-47 2024-09-10T17:58:47.867 INFO:tasks.rados.rados.0.smithi012.stdout:743: finishing write tid 2 to smithi01278544-47 2024-09-10T17:58:47.867 INFO:tasks.rados.rados.0.smithi012.stdout:743: finishing write tid 3 to smithi01278544-47 2024-09-10T17:58:47.867 INFO:tasks.rados.rados.0.smithi012.stdout:743: finishing write tid 4 to smithi01278544-47 2024-09-10T17:58:47.867 INFO:tasks.rados.rados.0.smithi012.stdout:743: finishing write tid 5 to smithi01278544-47 2024-09-10T17:58:47.867 INFO:tasks.rados.rados.0.smithi012.stdout:743: oid 47 updating version 0 to 439 2024-09-10T17:58:47.867 INFO:tasks.rados.rados.0.smithi012.stdout:743: oid 47 updating version 439 to 441 2024-09-10T17:58:47.867 INFO:tasks.rados.rados.0.smithi012.stdout:743: oid 47 version 441 is already newer than 438 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:743: oid 47 version 441 is already newer than 440 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 441 (ObjNum 234 snap 69 seq_num 234) dirty exists 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:743: left oid 47 (ObjNum 234 snap 69 seq_num 234) 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:740: done (9 left) 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:741: done (8 left) 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:742: done (7 left) 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:743: done (6 left) 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 69 2024-09-10T17:58:47.868 INFO:tasks.rados.rados.0.smithi012.stdout:744: expect (ObjNum 233 snap 68 seq_num 233) 2024-09-10T17:58:47.908 INFO:tasks.rados.rados.0.smithi012.stdout:739: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:58:48.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: pgmap v44: 121 pgs: 121 active+clean; 115 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 603 KiB/s rd, 350 KiB/s wr, 2 op/s 2024-09-10T17:58:48.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: osdmap e214: 8 total, 8 up, 8 in 2024-09-10T17:58:48.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:48.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:48.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:48.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:48.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-10T17:58:48.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-10T17:58:48.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-10T17:58:48.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-10T17:58:48.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T17:58:48.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-10T17:58:48.083 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: pgmap v44: 121 pgs: 121 active+clean; 115 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 603 KiB/s rd, 350 KiB/s wr, 2 op/s 2024-09-10T17:58:48.083 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: osdmap e214: 8 total, 8 up, 8 in 2024-09-10T17:58:48.084 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.084 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.084 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:48.084 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:48.084 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.085 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:48.085 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:48.085 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.085 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-10T17:58:48.085 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-10T17:58:48.085 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-10T17:58:48.086 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-10T17:58:48.086 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T17:58:48.086 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:47 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-10T17:58:48.278 INFO:tasks.rados.rados.0.smithi012.stdout:746: finishing copy_from racing read to smithi01278544-23 2024-09-10T17:58:48.279 INFO:tasks.rados.rados.0.smithi012.stdout:748: finishing write tid 1 to smithi01278544-39 2024-09-10T17:58:48.279 INFO:tasks.rados.rados.0.smithi012.stdout:746: finishing copy_from to smithi01278544-23 2024-09-10T17:58:48.279 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 295 (ObjNum 221 snap 66 seq_num 221) dirty exists 2024-09-10T17:58:48.279 INFO:tasks.rados.rados.0.smithi012.stdout:751: seq_num 236 ranges {1892352=761856,2654208=647168,3301376=155648} 2024-09-10T17:58:48.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: pgmap v44: 121 pgs: 121 active+clean; 115 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 603 KiB/s rd, 350 KiB/s wr, 2 op/s 2024-09-10T17:58:48.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: osdmap e214: 8 total, 8 up, 8 in 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-10T17:58:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T17:58:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:47 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-10T17:58:48.293 INFO:tasks.rados.rados.0.smithi012.stdout:751: writing smithi01278544-44 from 1892352 to 2654208 tid 1 2024-09-10T17:58:48.296 INFO:tasks.rados.rados.0.smithi012.stdout:751: writing smithi01278544-44 from 2654208 to 3301376 tid 2 2024-09-10T17:58:48.298 INFO:tasks.rados.rados.0.smithi012.stdout:751: writing smithi01278544-44 from 3301376 to 3457024 tid 3 2024-09-10T17:58:48.298 INFO:tasks.rados.rados.0.smithi012.stdout:739: done (6 left) 2024-09-10T17:58:48.298 INFO:tasks.rados.rados.0.smithi012.stdout:744: done (5 left) 2024-09-10T17:58:48.298 INFO:tasks.rados.rados.0.smithi012.stdout:746: done (4 left) 2024-09-10T17:58:48.298 INFO:tasks.rados.rados.0.smithi012.stdout:752: copy_from oid 28 from oid 13 current snap is 69 2024-09-10T17:58:48.298 INFO:tasks.rados.rados.0.smithi012.stdout:748: finishing write tid 2 to smithi01278544-39 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:748: finishing write tid 3 to smithi01278544-39 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:748: finishing write tid 4 to smithi01278544-39 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:748: finishing write tid 5 to smithi01278544-39 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:748: oid 39 updating version 0 to 400 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:748: oid 39 version 400 is already newer than 399 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:748: oid 39 updating version 400 to 402 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:748: oid 39 version 402 is already newer than 401 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 402 (ObjNum 235 snap 69 seq_num 235) dirty exists 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:748: left oid 39 (ObjNum 235 snap 69 seq_num 235) 2024-09-10T17:58:48.299 INFO:tasks.rados.rados.0.smithi012.stdout:749: expect (ObjNum 181 snap 48 seq_num 181) 2024-09-10T17:58:48.352 INFO:tasks.rados.rados.0.smithi012.stdout:750: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:58:48.720 INFO:tasks.rados.rados.0.smithi012.stdout:751: finishing write tid 1 to smithi01278544-44 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: finishing write tid 2 to smithi01278544-44 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: finishing write tid 3 to smithi01278544-44 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: finishing write tid 4 to smithi01278544-44 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: finishing write tid 5 to smithi01278544-44 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: oid 44 updating version 0 to 285 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: oid 44 version 285 is already newer than 283 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: oid 44 version 285 is already newer than 284 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: oid 44 updating version 285 to 286 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 286 (ObjNum 236 snap 69 seq_num 236) dirty exists 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:751: left oid 44 (ObjNum 236 snap 69 seq_num 236) 2024-09-10T17:58:48.721 INFO:tasks.rados.rados.0.smithi012.stdout:752: finishing copy_from racing read to smithi01278544-28 2024-09-10T17:58:48.722 INFO:tasks.rados.rados.0.smithi012.stdout:752: finishing copy_from to smithi01278544-28 2024-09-10T17:58:48.722 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 300 (ObjNum 224 snap 67 seq_num 224) dirty exists 2024-09-10T17:58:48.722 INFO:tasks.rados.rados.0.smithi012.stdout:748: done (4 left) 2024-09-10T17:58:48.722 INFO:tasks.rados.rados.0.smithi012.stdout:749: done (3 left) 2024-09-10T17:58:48.722 INFO:tasks.rados.rados.0.smithi012.stdout:750: done (2 left) 2024-09-10T17:58:48.722 INFO:tasks.rados.rados.0.smithi012.stdout:751: done (1 left) 2024-09-10T17:58:48.722 INFO:tasks.rados.rados.0.smithi012.stdout:752: done (0 left) 2024-09-10T17:58:48.722 INFO:tasks.rados.rados.0.smithi012.stdout:753: delete oid 7 current snap is 69 2024-09-10T17:58:48.723 INFO:tasks.rados.rados.0.smithi012.stdout:753: done (0 left) 2024-09-10T17:58:48.723 INFO:tasks.rados.rados.0.smithi012.stdout:754: read oid 1 snap -1 2024-09-10T17:58:48.723 INFO:tasks.rados.rados.0.smithi012.stdout:754: expect deleted 2024-09-10T17:58:48.723 INFO:tasks.rados.rados.0.smithi012.stdout:755: read oid 48 snap 67 2024-09-10T17:58:48.723 INFO:tasks.rados.rados.0.smithi012.stdout:755: expect (ObjNum -798590032 snap 22079 seq_num 2818925792) 2024-09-10T17:58:48.723 INFO:tasks.rados.rados.0.smithi012.stdout:756: rmattr oid 16 current snap is 69 2024-09-10T17:58:48.723 INFO:tasks.rados.rados.0.smithi012.stdout:757: rmattr oid 49 current snap is 69 2024-09-10T17:58:48.723 INFO:tasks.rados.rados.0.smithi012.stdout:757: done (3 left) 2024-09-10T17:58:48.724 INFO:tasks.rados.rados.0.smithi012.stdout:758: snap_remove snap 68 2024-09-10T17:58:48.845 INFO:tasks.rados.rados.0.smithi012.stdout:758: done (3 left) 2024-09-10T17:58:48.845 INFO:tasks.rados.rados.0.smithi012.stdout:759: snap_create 2024-09-10T17:58:48.845 INFO:tasks.rados.rados.0.smithi012.stdout:755: expect (ObjNum -798590032 snap 22079 seq_num 2818925792) 2024-09-10T17:58:48.848 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 282 (ObjNum 226 snap 67 seq_num 226) dirty exists 2024-09-10T17:58:49.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:48 smithi012 ceph-mon[27356]: Upgrade: Setting container_image for all mgr 2024-09-10T17:58:49.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:48 smithi012 ceph-mon[27356]: Upgrade: It appears safe to stop mon.a 2024-09-10T17:58:49.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:48 smithi012 ceph-mon[27356]: osdmap e215: 8 total, 8 up, 8 in 2024-09-10T17:58:49.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:48 smithi012 ceph-mon[37454]: Upgrade: Setting container_image for all mgr 2024-09-10T17:58:49.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:48 smithi012 ceph-mon[37454]: Upgrade: It appears safe to stop mon.a 2024-09-10T17:58:49.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:48 smithi012 ceph-mon[37454]: osdmap e215: 8 total, 8 up, 8 in 2024-09-10T17:58:49.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:48 smithi089 ceph-mon[31467]: Upgrade: Setting container_image for all mgr 2024-09-10T17:58:49.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:48 smithi089 ceph-mon[31467]: Upgrade: It appears safe to stop mon.a 2024-09-10T17:58:49.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:48 smithi089 ceph-mon[31467]: osdmap e215: 8 total, 8 up, 8 in 2024-09-10T17:58:49.848 INFO:tasks.rados.rados.0.smithi012.stdout:754: done (3 left) 2024-09-10T17:58:49.848 INFO:tasks.rados.rados.0.smithi012.stdout:755: done (2 left) 2024-09-10T17:58:49.848 INFO:tasks.rados.rados.0.smithi012.stdout:756: done (1 left) 2024-09-10T17:58:49.848 INFO:tasks.rados.rados.0.smithi012.stdout:759: done (0 left) 2024-09-10T17:58:49.848 INFO:tasks.rados.rados.0.smithi012.stdout:760: snap_create 2024-09-10T17:58:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: pgmap v47: 121 pgs: 121 active+clean; 115 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 604 KiB/s rd, 351 KiB/s wr, 2 op/s 2024-09-10T17:58:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: osdmap e216: 8 total, 8 up, 8 in 2024-09-10T17:58:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: Upgrade: Updating mon.a 2024-09-10T17:58:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:58:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: Deploying daemon mon.a on smithi012 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: pgmap v47: 121 pgs: 121 active+clean; 115 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 604 KiB/s rd, 351 KiB/s wr, 2 op/s 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: osdmap e216: 8 total, 8 up, 8 in 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: Upgrade: Updating mon.a 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: Deploying daemon mon.a on smithi012 2024-09-10T17:58:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:49 smithi012 ceph-mon[27356]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: pgmap v47: 121 pgs: 121 active+clean; 115 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 604 KiB/s rd, 351 KiB/s wr, 2 op/s 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: osdmap e216: 8 total, 8 up, 8 in 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: Upgrade: Updating mon.a 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: Deploying daemon mon.a on smithi012 2024-09-10T17:58:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:49 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:58:50.851 INFO:tasks.rados.rados.0.smithi012.stdout:760: done (0 left) 2024-09-10T17:58:50.851 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 71 2024-09-10T17:58:50.851 INFO:tasks.rados.rados.0.smithi012.stdout:761: seq_num 238 ranges {466944=794624,1261568=417792,1679360=385024} 2024-09-10T17:58:50.858 INFO:tasks.rados.rados.0.smithi012.stdout:761: writing smithi01278544-18 from 466944 to 1261568 tid 1 2024-09-10T17:58:50.860 INFO:tasks.rados.rados.0.smithi012.stdout:761: writing smithi01278544-18 from 1261568 to 1679360 tid 2 2024-09-10T17:58:50.863 INFO:tasks.rados.rados.0.smithi012.stdout:761: writing smithi01278544-18 from 1679360 to 2064384 tid 3 2024-09-10T17:58:50.863 INFO:tasks.rados.rados.0.smithi012.stdout:762: copy_from oid 5 from oid 33 current snap is 71 2024-09-10T17:58:50.863 INFO:tasks.rados.rados.0.smithi012.stdout:763: snap_remove snap 69 2024-09-10T17:58:51.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:50 smithi012 systemd[1]: Stopping Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:51.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:50 smithi012 ceph-mon[27356]: osdmap e217: 8 total, 8 up, 8 in 2024-09-10T17:58:51.080 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:50 smithi012 ceph-mon[37454]: osdmap e217: 8 total, 8 up, 8 in 2024-09-10T17:58:51.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:50 smithi089 ceph-mon[31467]: osdmap e217: 8 total, 8 up, 8 in 2024-09-10T17:58:51.405 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:51] ENGINE Bus STOPPING 2024-09-10T17:58:51.405 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a[27352]: 2024-09-10T17:58:51.077+0000 7f681bf8b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T17:58:51.405 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a[27352]: 2024-09-10T17:58:51.077+0000 7f681bf8b640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T17:58:51.405 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 podman[89437]: 2024-09-10 17:58:51.109214325 +0000 UTC m=+0.131292922 container died 2f6698e39d41ac16c2f5802996fc8754dec11b740f542cb1df21a63f848631ee (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=reef-7a853b1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T17:58:51.755 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 podman[89437]: 2024-09-10 17:58:51.511682096 +0000 UTC m=+0.533760694 container cleanup 2f6698e39d41ac16c2f5802996fc8754dec11b740f542cb1df21a63f848631ee (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-7a853b1, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T17:58:51.755 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 bash[89437]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a 2024-09-10T17:58:51.756 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:51] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:58:51.756 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:51] ENGINE Bus STOPPED 2024-09-10T17:58:51.756 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:51] ENGINE Bus STARTING 2024-09-10T17:58:51.756 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:51] ENGINE Serving on http://:::9283 2024-09-10T17:58:51.756 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:58:51] ENGINE Bus STARTED 2024-09-10T17:58:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 podman[89448]: 2024-09-10 17:58:51.754691219 +0000 UTC m=+0.647686638 container remove 2f6698e39d41ac16c2f5802996fc8754dec11b740f542cb1df21a63f848631ee (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, RELEASE=reef-7a853b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T17:58:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T17:58:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 systemd[1]: Stopped Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:51 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a.service: Consumed 14.937s CPU time. 2024-09-10T17:58:52.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 systemd[1]: Starting Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:58:52.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 podman[89592]: 2024-09-10 17:58:52.205989461 +0000 UTC m=+0.018102657 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T17:58:52.465 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 podman[89592]: 2024-09-10 17:58:52.339647592 +0000 UTC m=+0.151760819 container create 1cb889155ac02839b59e81fa0f684ac75d1e3ec37581a33964539f206a4b909b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T17:58:52.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 podman[89592]: 2024-09-10 17:58:52.586154516 +0000 UTC m=+0.398267700 container init 1cb889155ac02839b59e81fa0f684ac75d1e3ec37581a33964539f206a4b909b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 podman[89592]: 2024-09-10 17:58:52.589598625 +0000 UTC m=+0.401711820 container start 1cb889155ac02839b59e81fa0f684ac75d1e3ec37581a33964539f206a4b909b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev), process ceph-mon, pid 2 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: pidfile_write: ignore empty --pid-file 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: load: jerasure load: lrc 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: RocksDB version: 7.9.2 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Git sha 0 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Compile date 2024-09-10 10:24:02 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: DB SUMMARY 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: DB Session ID: D7PG993FKZ1F7QITVO5I 2024-09-10T17:58:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: CURRENT file: CURRENT 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1518 Bytes 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000032.sst 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000030.log size: 4206246 ; 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.error_if_exists: 0 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.create_if_missing: 0 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.paranoid_checks: 1 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.env: 0x557850641120 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.info_log: 0x557852b85700 2024-09-10T17:58:52.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T17:58:52.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.statistics: (nil) 2024-09-10T17:58:52.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.use_fsync: 0 2024-09-10T17:58:52.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_log_file_size: 0 2024-09-10T17:58:52.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T17:58:52.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.allow_fallocate: 1 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.use_direct_reads: 0 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.db_log_dir: 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.wal_dir: 2024-09-10T17:58:52.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.write_buffer_manager: 0x557852b89b80 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T17:58:52.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.unordered_write: 0 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.row_cache: None 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.wal_filter: None 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.two_write_queues: 0 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T17:58:52.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.wal_compression: 0 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.atomic_flush: 0 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.log_readahead_size: 0 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T17:58:52.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_background_jobs: 2 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_background_compactions: -1 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_subcompactions: 1 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_open_files: -1 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T17:58:52.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_background_flushes: -1 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Compression algorithms supported: 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: kZSTD supported: 0 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: kXpressCompression supported: 0 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: kBZip2Compression supported: 0 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: kLZ4Compression supported: 1 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: kZlibCompression supported: 1 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: kSnappyCompression supported: 1 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T17:58:52.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.merge_operator: 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_filter: None 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557852b85320) 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks: 1 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T17:58:52.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_top_level_index_and_filter: 1 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_type: 0 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_index_type: 0 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_shortening: 1 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: checksum: 4 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: no_block_cache: 0 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache: 0x557852b79610 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_name: BinnedLRUCache 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_options: 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: capacity : 536870912 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_shard_bits : 4 2024-09-10T17:58:52.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: strict_capacity_limit : 0 2024-09-10T17:58:52.797 INFO:journalctl@ceph.mon.a.smithi012.stdout: high_pri_pool_ratio: 0.000 2024-09-10T17:58:52.797 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_compressed: (nil) 2024-09-10T17:58:52.797 INFO:journalctl@ceph.mon.a.smithi012.stdout: persistent_cache: (nil) 2024-09-10T17:58:52.799 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size: 4096 2024-09-10T17:58:52.799 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size_deviation: 10 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_restart_interval: 16 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_block_restart_interval: 1 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: metadata_block_size: 4096 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: partition_filters: 0 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: use_delta_encoding: 1 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: filter_policy: bloomfilter 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: whole_key_filtering: 1 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: verify_compression: 0 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: read_amp_bytes_per_bit: 0 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: format_version: 5 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_index_compression: 1 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_align: 0 2024-09-10T17:58:52.800 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_auto_readahead_size: 262144 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout: prepopulate_block_cache: 0 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout: initial_auto_readahead_size: 8192 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression: NoCompression 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.num_levels: 7 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T17:58:52.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:58:52.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T17:58:52.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T17:58:52.804 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.inplace_update_support: 0 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.bloom_locality: 0 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.max_successive_merges: 0 2024-09-10T17:58:52.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.ttl: 2592000 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.enable_blob_files: false 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.min_blob_size: 0 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T17:58:52.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12756, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f6dd0c20-5756-43ac-ab02-f2077f36cbd9 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991132617153, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991132629201, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 3936177, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12757, "largest_seqno": 14529, "table_properties": {"data_size": 3926656, "index_size": 6491, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1989, "raw_key_size": 19136, "raw_average_key_size": 24, "raw_value_size": 3908794, "raw_average_value_size": 4960, "num_data_blocks": 286, "num_entries": 788, "num_filter_entries": 788, "num_deletions": 37, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725991132, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f6dd0c20-5756-43ac-ab02-f2077f36cbd9", "db_session_id": "D7PG993FKZ1F7QITVO5I", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991132629329, "job": 1, "event": "recovery_finished"} 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-10T17:58:52.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557852ba8e00 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: DB pointer 0x557852caa000 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** DB Stats ** 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:58:52.808 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: L0 1/0 3.75 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 632.4 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: L6 1/0 7.52 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: Sum 2/0 11.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 632.4 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 632.4 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 632.4 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-10T17:58:52.809 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative compaction: 0.00 GB write, 235.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval compaction: 0.00 GB write, 235.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache BinnedLRUCache@0x557852b79610#2 capacity: 512.00 MB usage: 8.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,6.58 KB,0.00125468%) Misc(1,0.00 KB,0%) 2024-09-10T17:58:52.810 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: starting mon.a rank 0 at public addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] at bind addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: mon.a@-1(???) e3 preinit fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: mon.a@-1(???).mds e7 new map 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: mon.a@-1(???).mds e7 print_map 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: e7 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: legacy client fscid: 1 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: Filesystem 'cephfs' (1) 2024-09-10T17:58:52.811 INFO:journalctl@ceph.mon.a.smithi012.stdout: fs_name cephfs 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: epoch 7 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: created 2024-09-10T17:52:41.361507+0000 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: modified 2024-09-10T17:52:53.075075+0000 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: tableserver 0 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: root 0 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: session_timeout 60 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: session_autoclose 300 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_file_size 1099511627776 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_xattr_size 65536 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: required_client_features {} 2024-09-10T17:58:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: last_failure 0 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: last_failure_osd_epoch 0 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_mds 1 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: in 0 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: up {0=24340} 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: failed 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: damaged 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: stopped 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_pools [3] 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: metadata_pool 2 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: inline_data disabled 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: balancer 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: bal_rank_mask -1 2024-09-10T17:58:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: standby_count_wanted 0 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout: qdb_cluster leader: 0 members: 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout: [mds.b{0:24340} state up:active seq 5 addr [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout: Standby daemons: 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout: [mds.a{-1:24335} state up:standby seq 1 addr [v2:172.21.15.12:6834/705014602,v1:172.21.15.12:6835/705014602] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: mon.a@-1(???).osd e218 crush map has features 3314933069573799936, adjusting msgr requires 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: mon.a@-1(???).osd e218 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: mon.a@-1(???).osd e218 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: mon.a@-1(???).osd e218 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 ceph-mon[89611]: mon.a@-1(???).paxosservice(auth 1..18) refresh upgraded, format 0 -> 3 2024-09-10T17:58:52.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 bash[89592]: 1cb889155ac02839b59e81fa0f684ac75d1e3ec37581a33964539f206a4b909b 2024-09-10T17:58:52.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:52 smithi012 systemd[1]: Started Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:58:54.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:58:53] "GET /metrics HTTP/1.1" 200 36081 "" "Prometheus/2.43.0" 2024-09-10T17:58:55.722 INFO:tasks.rados.rados.0.smithi012.stdout:763: done (2 left) 2024-09-10T17:58:55.722 INFO:tasks.rados.rados.0.smithi012.stdout:764: rollback oid 46 current snap is 71 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 67 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: finishing write tid 1 to smithi01278544-18 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: finishing write tid 2 to smithi01278544-18 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: finishing write tid 3 to smithi01278544-18 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: finishing write tid 4 to smithi01278544-18 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: finishing write tid 5 to smithi01278544-18 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: oid 18 updating version 0 to 352 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: oid 18 version 352 is already newer than 350 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: oid 18 version 352 is already newer than 351 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: oid 18 version 352 is already newer than 349 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 352 (ObjNum 238 snap 71 seq_num 238) dirty exists 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:761: left oid 18 (ObjNum 238 snap 71 seq_num 238) 2024-09-10T17:58:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:762: finishing copy_from racing read to smithi01278544-5 2024-09-10T17:58:55.724 INFO:tasks.rados.rados.0.smithi012.stdout:762: finishing copy_from to smithi01278544-5 2024-09-10T17:58:55.724 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 351 (ObjNum 106 snap 21 seq_num 106) dirty exists 2024-09-10T17:58:55.724 INFO:tasks.rados.rados.0.smithi012.stdout:761: done (2 left) 2024-09-10T17:58:55.724 INFO:tasks.rados.rados.0.smithi012.stdout:762: done (1 left) 2024-09-10T17:58:55.724 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 71 2024-09-10T17:58:55.724 INFO:tasks.rados.rados.0.smithi012.stdout:765: seq_num 239 ranges {1310720=409600,1720320=704512,2424832=499712} 2024-09-10T17:58:55.731 INFO:tasks.rados.rados.0.smithi012.stdout:765: writing smithi01278544-41 from 1310720 to 1720320 tid 1 2024-09-10T17:58:55.736 INFO:tasks.rados.rados.0.smithi012.stdout:765: writing smithi01278544-41 from 1720320 to 2424832 tid 2 2024-09-10T17:58:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:765: writing smithi01278544-41 from 2424832 to 2924544 tid 3 2024-09-10T17:58:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 71 2024-09-10T17:58:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:764: finishing rollback tid 0 to smithi01278544-46 2024-09-10T17:58:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:764: finishing rollback tid 1 to smithi01278544-46 2024-09-10T17:58:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:764: finishing rollback tid 2 to smithi01278544-46 2024-09-10T17:58:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 289 (ObjNum 226 snap 67 seq_num 226) dirty exists 2024-09-10T17:58:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:765: finishing write tid 1 to smithi01278544-41 2024-09-10T17:58:55.741 INFO:tasks.rados.rados.0.smithi012.stdout:765: finishing write tid 2 to smithi01278544-41 2024-09-10T17:58:55.741 INFO:tasks.rados.rados.0.smithi012.stdout:766: seq_num 240 ranges {1310720=425984,1736704=589824,2326528=483328,2809856=131072} 2024-09-10T17:58:55.749 INFO:tasks.rados.rados.0.smithi012.stdout:766: writing smithi01278544-23 from 1310720 to 1736704 tid 1 2024-09-10T17:58:55.754 INFO:tasks.rados.rados.0.smithi012.stdout:766: writing smithi01278544-23 from 1736704 to 2326528 tid 2 2024-09-10T17:58:55.757 INFO:tasks.rados.rados.0.smithi012.stdout:766: writing smithi01278544-23 from 2326528 to 2809856 tid 3 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:766: writing smithi01278544-23 from 2809856 to 2940928 tid 4 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:764: done (2 left) 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:767: snap_create 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:765: finishing write tid 3 to smithi01278544-41 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:765: finishing write tid 4 to smithi01278544-41 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:765: finishing write tid 5 to smithi01278544-41 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:765: oid 41 updating version 0 to 325 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:765: oid 41 version 325 is already newer than 322 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:765: oid 41 version 325 is already newer than 324 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:765: oid 41 version 325 is already newer than 323 2024-09-10T17:58:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 325 (ObjNum 239 snap 71 seq_num 239) dirty exists 2024-09-10T17:58:55.759 INFO:tasks.rados.rados.0.smithi012.stdout:765: left oid 41 (ObjNum 239 snap 71 seq_num 239) 2024-09-10T17:58:55.759 INFO:tasks.rados.rados.0.smithi012.stdout:766: finishing write tid 1 to smithi01278544-23 2024-09-10T17:58:55.759 INFO:tasks.rados.rados.0.smithi012.stdout:766: finishing write tid 2 to smithi01278544-23 2024-09-10T17:58:55.760 INFO:tasks.rados.rados.0.smithi012.stdout:766: finishing write tid 3 to smithi01278544-23 2024-09-10T17:58:55.760 INFO:tasks.rados.rados.0.smithi012.stdout:766: finishing write tid 4 to smithi01278544-23 2024-09-10T17:58:55.760 INFO:tasks.rados.rados.0.smithi012.stdout:766: finishing write tid 5 to smithi01278544-23 2024-09-10T17:58:55.761 INFO:tasks.rados.rados.0.smithi012.stdout:766: finishing write tid 6 to smithi01278544-23 2024-09-10T17:58:55.761 INFO:tasks.rados.rados.0.smithi012.stdout:766: oid 23 updating version 0 to 307 2024-09-10T17:58:55.761 INFO:tasks.rados.rados.0.smithi012.stdout:766: oid 23 version 307 is already newer than 305 2024-09-10T17:58:55.761 INFO:tasks.rados.rados.0.smithi012.stdout:766: oid 23 version 307 is already newer than 306 2024-09-10T17:58:55.761 INFO:tasks.rados.rados.0.smithi012.stdout:766: oid 23 updating version 307 to 308 2024-09-10T17:58:55.762 INFO:tasks.rados.rados.0.smithi012.stdout:766: oid 23 version 308 is already newer than 304 2024-09-10T17:58:55.762 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 308 (ObjNum 240 snap 71 seq_num 240) dirty exists 2024-09-10T17:58:55.762 INFO:tasks.rados.rados.0.smithi012.stdout:766: left oid 23 (ObjNum 240 snap 71 seq_num 240) 2024-09-10T17:58:56.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ignoring --setuser ceph since I am not root 2024-09-10T17:58:56.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ignoring --setgroup ceph since I am not root 2024-09-10T17:58:56.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mgr[81355]: -- 172.21.15.12:0/2683183600 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e14cfb30e0 con 0x55e14cf91400 2024-09-10T17:58:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: pgmap v52: 121 pgs: 121 active+clean; 114 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: pgmap v53: 121 pgs: 121 active+clean; 114 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: mon.a calling monitor election 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: monmap epoch 3 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:58:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: last_changed 2024-09-10T17:48:45.134479+0000 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: min_mon_release 18 (reef) 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: election_strategy: 1 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: osdmap e218: 8 total, 8 up, 8 in 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: mgrmap e36: y(active, since 36s), standbys: x 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: overall HEALTH_OK 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: from='mgr.15129 ' entity='' 2024-09-10T17:58:56.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[89611]: mgrmap e37: y(active, since 36s), standbys: x 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: pgmap v52: 121 pgs: 121 active+clean; 114 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: pgmap v53: 121 pgs: 121 active+clean; 114 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: mon.a calling monitor election 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: monmap epoch 3 2024-09-10T17:58:56.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: last_changed 2024-09-10T17:48:45.134479+0000 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: min_mon_release 18 (reef) 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: election_strategy: 1 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: osdmap e218: 8 total, 8 up, 8 in 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: mgrmap e36: y(active, since 36s), standbys: x 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: overall HEALTH_OK 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: from='mgr.15129 ' entity='' 2024-09-10T17:58:56.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:55 smithi012 ceph-mon[37454]: mgrmap e37: y(active, since 36s), standbys: x 2024-09-10T17:58:56.039 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: ignoring --setuser ceph since I am not root 2024-09-10T17:58:56.039 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: ignoring --setgroup ceph since I am not root 2024-09-10T17:58:56.039 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mgr[75836]: -- 172.21.15.89:0/3932613572 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f4684450e0 con 0x55f468423000 2024-09-10T17:58:56.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:58:56.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:58:56.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:58:56.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:58:56.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: from='mgr.15129 172.21.15.12:0/3849560392' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: pgmap v52: 121 pgs: 121 active+clean; 114 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: pgmap v53: 121 pgs: 121 active+clean; 114 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: mon.a calling monitor election 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: monmap epoch 3 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: last_changed 2024-09-10T17:48:45.134479+0000 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: min_mon_release 18 (reef) 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: election_strategy: 1 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:58:56.040 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:58:56.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:58:56.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:58:56.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: osdmap e218: 8 total, 8 up, 8 in 2024-09-10T17:58:56.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: mgrmap e36: y(active, since 36s), standbys: x 2024-09-10T17:58:56.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: overall HEALTH_OK 2024-09-10T17:58:56.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: from='mgr.15129 ' entity='' 2024-09-10T17:58:56.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:55 smithi089 ceph-mon[31467]: mgrmap e37: y(active, since 36s), standbys: x 2024-09-10T17:58:56.727 INFO:tasks.rados.rados.0.smithi012.stdout:765: done (2 left) 2024-09-10T17:58:56.727 INFO:tasks.rados.rados.0.smithi012.stdout:766: done (1 left) 2024-09-10T17:58:56.727 INFO:tasks.rados.rados.0.smithi012.stdout:767: done (0 left) 2024-09-10T17:58:56.727 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 72 2024-09-10T17:58:56.727 INFO:tasks.rados.rados.0.smithi012.stdout:768: seq_num 241 ranges {335872=442368,778240=466944,1245184=688128,1933312=49152} 2024-09-10T17:58:56.730 INFO:tasks.rados.rados.0.smithi012.stdout:768: writing smithi01278544-45 from 335872 to 778240 tid 1 2024-09-10T17:58:56.733 INFO:tasks.rados.rados.0.smithi012.stdout:768: writing smithi01278544-45 from 778240 to 1245184 tid 2 2024-09-10T17:58:56.738 INFO:tasks.rados.rados.0.smithi012.stdout:768: writing smithi01278544-45 from 1245184 to 1933312 tid 3 2024-09-10T17:58:56.738 INFO:tasks.rados.rados.0.smithi012.stdout:768: writing smithi01278544-45 from 1933312 to 1982464 tid 4 2024-09-10T17:58:56.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 72 2024-09-10T17:58:56.738 INFO:tasks.rados.rados.0.smithi012.stdout:768: finishing write tid 1 to smithi01278544-45 2024-09-10T17:58:56.738 INFO:tasks.rados.rados.0.smithi012.stdout:768: finishing write tid 2 to smithi01278544-45 2024-09-10T17:58:56.739 INFO:tasks.rados.rados.0.smithi012.stdout:769: seq_num 242 ranges {0=458752,458752=753664,1212416=450560} 2024-09-10T17:58:56.741 INFO:tasks.rados.rados.0.smithi012.stdout:769: writing smithi01278544-10 from 0 to 458752 tid 1 2024-09-10T17:58:56.746 INFO:tasks.rados.rados.0.smithi012.stdout:769: writing smithi01278544-10 from 458752 to 1212416 tid 2 2024-09-10T17:58:56.748 INFO:tasks.rados.rados.0.smithi012.stdout:769: writing smithi01278544-10 from 1212416 to 1662976 tid 3 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:770: delete oid 7 current snap is 72 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: finishing write tid 3 to smithi01278544-45 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: finishing write tid 4 to smithi01278544-45 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: finishing write tid 5 to smithi01278544-45 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: finishing write tid 6 to smithi01278544-45 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: oid 45 updating version 0 to 454 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: oid 45 version 454 is already newer than 452 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: oid 45 updating version 454 to 455 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: oid 45 version 455 is already newer than 451 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: oid 45 version 455 is already newer than 453 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 455 (ObjNum 241 snap 72 seq_num 241) dirty exists 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:768: left oid 45 (ObjNum 241 snap 72 seq_num 241) 2024-09-10T17:58:56.749 INFO:tasks.rados.rados.0.smithi012.stdout:769: finishing write tid 1 to smithi01278544-10 2024-09-10T17:58:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:769: finishing write tid 2 to smithi01278544-10 2024-09-10T17:58:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:769: finishing write tid 3 to smithi01278544-10 2024-09-10T17:58:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:769: finishing write tid 4 to smithi01278544-10 2024-09-10T17:58:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:768: done (2 left) 2024-09-10T17:58:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:770: done (1 left) 2024-09-10T17:58:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:771: rmattr oid 20 current snap is 72 2024-09-10T17:58:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 72 2024-09-10T17:58:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:772: seq_num 244 ranges {2310144=491520,2801664=573440,3375104=458752,3833856=172032} 2024-09-10T17:58:56.768 INFO:tasks.rados.rados.0.smithi012.stdout:772: writing smithi01278544-47 from 2310144 to 2801664 tid 1 2024-09-10T17:58:56.771 INFO:tasks.rados.rados.0.smithi012.stdout:772: writing smithi01278544-47 from 2801664 to 3375104 tid 2 2024-09-10T17:58:56.773 INFO:tasks.rados.rados.0.smithi012.stdout:772: writing smithi01278544-47 from 3375104 to 3833856 tid 3 2024-09-10T17:58:56.775 INFO:tasks.rados.rados.0.smithi012.stdout:772: writing smithi01278544-47 from 3833856 to 4005888 tid 4 2024-09-10T17:58:56.775 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 72 2024-09-10T17:58:56.775 INFO:tasks.rados.rados.0.smithi012.stdout:769: finishing write tid 5 to smithi01278544-10 2024-09-10T17:58:56.775 INFO:tasks.rados.rados.0.smithi012.stdout:769: oid 10 updating version 0 to 408 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:769: oid 10 version 408 is already newer than 407 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:769: oid 10 version 408 is already newer than 405 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:769: oid 10 version 408 is already newer than 406 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 408 (ObjNum 242 snap 72 seq_num 242) dirty exists 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:769: left oid 10 (ObjNum 242 snap 72 seq_num 242) 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 410 (ObjNum 198 snap 52 seq_num 198) dirty exists 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:772: finishing write tid 1 to smithi01278544-47 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:772: finishing write tid 2 to smithi01278544-47 2024-09-10T17:58:56.776 INFO:tasks.rados.rados.0.smithi012.stdout:773: seq_num 245 ranges {0=507904,507904=458752,966656=671744,1638400=73728} 2024-09-10T17:58:56.778 INFO:tasks.rados.rados.0.smithi012.stdout:773: writing smithi01278544-48 from 0 to 507904 tid 1 2024-09-10T17:58:56.781 INFO:tasks.rados.rados.0.smithi012.stdout:773: writing smithi01278544-48 from 507904 to 966656 tid 2 2024-09-10T17:58:56.785 INFO:tasks.rados.rados.0.smithi012.stdout:773: writing smithi01278544-48 from 966656 to 1638400 tid 3 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:773: writing smithi01278544-48 from 1638400 to 1712128 tid 4 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:769: done (3 left) 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:771: done (2 left) 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:774: delete oid 20 current snap is 72 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:772: finishing write tid 3 to smithi01278544-47 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:772: finishing write tid 4 to smithi01278544-47 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:772: finishing write tid 5 to smithi01278544-47 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:772: finishing write tid 6 to smithi01278544-47 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:772: oid 47 updating version 0 to 460 2024-09-10T17:58:56.786 INFO:tasks.rados.rados.0.smithi012.stdout:772: oid 47 version 460 is already newer than 459 2024-09-10T17:58:56.787 INFO:tasks.rados.rados.0.smithi012.stdout:772: oid 47 version 460 is already newer than 458 2024-09-10T17:58:56.787 INFO:tasks.rados.rados.0.smithi012.stdout:772: oid 47 updating version 460 to 461 2024-09-10T17:58:56.787 INFO:tasks.rados.rados.0.smithi012.stdout:772: oid 47 version 461 is already newer than 457 2024-09-10T17:58:56.787 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 461 (ObjNum 244 snap 72 seq_num 244) dirty exists 2024-09-10T17:58:56.787 INFO:tasks.rados.rados.0.smithi012.stdout:772: left oid 47 (ObjNum 244 snap 72 seq_num 244) 2024-09-10T17:58:56.787 INFO:tasks.rados.rados.0.smithi012.stdout:773: finishing write tid 1 to smithi01278544-48 2024-09-10T17:58:56.787 INFO:tasks.rados.rados.0.smithi012.stdout:773: finishing write tid 2 to smithi01278544-48 2024-09-10T17:58:56.787 INFO:tasks.rados.rados.0.smithi012.stdout:772: done (2 left) 2024-09-10T17:58:56.788 INFO:tasks.rados.rados.0.smithi012.stdout:774: done (1 left) 2024-09-10T17:58:56.788 INFO:tasks.rados.rados.0.smithi012.stdout:775: snap_create 2024-09-10T17:58:56.788 INFO:tasks.rados.rados.0.smithi012.stdout:773: finishing write tid 3 to smithi01278544-48 2024-09-10T17:58:56.788 INFO:tasks.rados.rados.0.smithi012.stdout:773: finishing write tid 4 to smithi01278544-48 2024-09-10T17:58:56.789 INFO:tasks.rados.rados.0.smithi012.stdout:773: finishing write tid 5 to smithi01278544-48 2024-09-10T17:58:56.793 INFO:tasks.rados.rados.0.smithi012.stdout:773: finishing write tid 6 to smithi01278544-48 2024-09-10T17:58:56.793 INFO:tasks.rados.rados.0.smithi012.stdout:773: oid 48 updating version 0 to 238 2024-09-10T17:58:56.793 INFO:tasks.rados.rados.0.smithi012.stdout:773: oid 48 version 238 is already newer than 236 2024-09-10T17:58:56.793 INFO:tasks.rados.rados.0.smithi012.stdout:773: oid 48 version 238 is already newer than 234 2024-09-10T17:58:56.793 INFO:tasks.rados.rados.0.smithi012.stdout:773: oid 48 version 238 is already newer than 235 2024-09-10T17:58:56.793 INFO:tasks.rados.rados.0.smithi012.stdout:773: oid 48 version 238 is already newer than 237 2024-09-10T17:58:56.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 238 (ObjNum 245 snap 72 seq_num 245) dirty exists 2024-09-10T17:58:56.793 INFO:tasks.rados.rados.0.smithi012.stdout:773: left oid 48 (ObjNum 245 snap 72 seq_num 245) 2024-09-10T17:58:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:56 smithi012 ceph-mon[89611]: osdmap e219: 8 total, 8 up, 8 in 2024-09-10T17:58:57.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:56 smithi012 ceph-mon[37454]: osdmap e219: 8 total, 8 up, 8 in 2024-09-10T17:58:57.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:56 smithi089 ceph-mon[31467]: osdmap e219: 8 total, 8 up, 8 in 2024-09-10T17:58:57.646 INFO:tasks.rados.rados.0.smithi012.stdout:773: done (1 left) 2024-09-10T17:58:57.646 INFO:tasks.rados.rados.0.smithi012.stdout:775: done (0 left) 2024-09-10T17:58:57.646 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 73 2024-09-10T17:58:57.646 INFO:tasks.rados.rados.0.smithi012.stdout:776: seq_num 247 ranges {5652480=540672,6193152=622592,6815744=581632} 2024-09-10T17:58:57.679 INFO:tasks.rados.rados.0.smithi012.stdout:776: writing smithi01278544-13 from 5652480 to 6193152 tid 1 2024-09-10T17:58:57.683 INFO:tasks.rados.rados.0.smithi012.stdout:776: writing smithi01278544-13 from 6193152 to 6815744 tid 2 2024-09-10T17:58:57.687 INFO:tasks.rados.rados.0.smithi012.stdout:776: writing smithi01278544-13 from 6815744 to 7397376 tid 3 2024-09-10T17:58:57.687 INFO:tasks.rados.rados.0.smithi012.stdout:777: delete oid 50 current snap is 73 2024-09-10T17:58:57.687 INFO:tasks.rados.rados.0.smithi012.stdout:776: finishing write tid 1 to smithi01278544-13 2024-09-10T17:58:57.687 INFO:tasks.rados.rados.0.smithi012.stdout:776: finishing write tid 2 to smithi01278544-13 2024-09-10T17:58:57.689 INFO:tasks.rados.rados.0.smithi012.stdout:777: done (1 left) 2024-09-10T17:58:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:778: rollback oid 21 current snap is 73 2024-09-10T17:58:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 59 2024-09-10T17:58:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:779: snap_remove snap 70 2024-09-10T17:58:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:57 smithi012 ceph-mon[89611]: osdmap e220: 8 total, 8 up, 8 in 2024-09-10T17:58:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:57 smithi012 ceph-mon[89611]: osdmap e221: 8 total, 8 up, 8 in 2024-09-10T17:58:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:57 smithi012 ceph-mon[37454]: osdmap e220: 8 total, 8 up, 8 in 2024-09-10T17:58:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:57 smithi012 ceph-mon[37454]: osdmap e221: 8 total, 8 up, 8 in 2024-09-10T17:58:58.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:57 smithi089 ceph-mon[31467]: osdmap e220: 8 total, 8 up, 8 in 2024-09-10T17:58:58.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:57 smithi089 ceph-mon[31467]: osdmap e221: 8 total, 8 up, 8 in 2024-09-10T17:58:58.647 INFO:tasks.rados.rados.0.smithi012.stdout:776: finishing write tid 3 to smithi01278544-13 2024-09-10T17:58:58.647 INFO:tasks.rados.rados.0.smithi012.stdout:776: finishing write tid 4 to smithi01278544-13 2024-09-10T17:58:58.647 INFO:tasks.rados.rados.0.smithi012.stdout:776: finishing write tid 5 to smithi01278544-13 2024-09-10T17:58:58.647 INFO:tasks.rados.rados.0.smithi012.stdout:776: oid 13 updating version 0 to 328 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:776: oid 13 version 328 is already newer than 327 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:776: oid 13 updating version 328 to 329 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:776: oid 13 updating version 329 to 330 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 330 (ObjNum 247 snap 73 seq_num 247) dirty exists 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:776: left oid 13 (ObjNum 247 snap 73 seq_num 247) 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:778: finishing rollback tid 0 to smithi01278544-21 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:778: finishing rollback tid 1 to smithi01278544-21 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:778: finishing rollback tid 2 to smithi01278544-21 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 312 (ObjNum 145 snap 36 seq_num 145) dirty exists 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:776: done (2 left) 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:778: done (1 left) 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:779: done (0 left) 2024-09-10T17:58:58.648 INFO:tasks.rados.rados.0.smithi012.stdout:780: snap_create 2024-09-10T17:58:59.653 INFO:tasks.rados.rados.0.smithi012.stdout:780: done (0 left) 2024-09-10T17:58:59.653 INFO:tasks.rados.rados.0.smithi012.stdout:781: read oid 46 snap -1 2024-09-10T17:58:59.654 INFO:tasks.rados.rados.0.smithi012.stdout:781: expect (ObjNum 226 snap 67 seq_num 226) 2024-09-10T17:58:59.654 INFO:tasks.rados.rados.0.smithi012.stdout:782: rmattr oid 20 current snap is 74 2024-09-10T17:58:59.654 INFO:tasks.rados.rados.0.smithi012.stdout:782: done (1 left) 2024-09-10T17:58:59.654 INFO:tasks.rados.rados.0.smithi012.stdout:783: delete oid 8 current snap is 74 2024-09-10T17:58:59.655 INFO:tasks.rados.rados.0.smithi012.stdout:783: done (1 left) 2024-09-10T17:58:59.655 INFO:tasks.rados.rados.0.smithi012.stdout:784: snap_create 2024-09-10T17:58:59.668 INFO:tasks.rados.rados.0.smithi012.stdout:781: expect (ObjNum 226 snap 67 seq_num 226) 2024-09-10T17:59:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:58:59 smithi012 ceph-mon[89611]: osdmap e222: 8 total, 8 up, 8 in 2024-09-10T17:59:00.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:58:59 smithi012 ceph-mon[37454]: osdmap e222: 8 total, 8 up, 8 in 2024-09-10T17:59:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:58:59 smithi089 ceph-mon[31467]: osdmap e222: 8 total, 8 up, 8 in 2024-09-10T17:59:00.657 INFO:tasks.rados.rados.0.smithi012.stdout:781: done (1 left) 2024-09-10T17:59:00.657 INFO:tasks.rados.rados.0.smithi012.stdout:784: done (0 left) 2024-09-10T17:59:00.657 INFO:tasks.rados.rados.0.smithi012.stdout:785: setattr oid 42 current snap is 75 2024-09-10T17:59:00.658 INFO:tasks.rados.rados.0.smithi012.stdout:786: delete oid 12 current snap is 75 2024-09-10T17:59:00.663 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 467 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-09-10T17:59:00.664 INFO:tasks.rados.rados.0.smithi012.stdout:785: done (1 left) 2024-09-10T17:59:00.664 INFO:tasks.rados.rados.0.smithi012.stdout:786: done (0 left) 2024-09-10T17:59:00.664 INFO:tasks.rados.rados.0.smithi012.stdout:787: read oid 29 snap 71 2024-09-10T17:59:00.664 INFO:tasks.rados.rados.0.smithi012.stdout:787: expect deleted 2024-09-10T17:59:00.664 INFO:tasks.rados.rados.0.smithi012.stdout:788: rollback oid 39 current snap is 75 2024-09-10T17:59:00.665 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 59 2024-09-10T17:59:00.665 INFO:tasks.rados.rados.0.smithi012.stdout:789: rollback oid 14 current snap is 75 2024-09-10T17:59:00.665 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 14 to 56 2024-09-10T17:59:00.665 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 75 2024-09-10T17:59:00.665 INFO:tasks.rados.rados.0.smithi012.stdout:790: seq_num 251 ranges {0=606208,606208=614400,1220608=589824} 2024-09-10T17:59:00.668 INFO:tasks.rados.rados.0.smithi012.stdout:790: writing smithi01278544-2 from 0 to 606208 tid 1 2024-09-10T17:59:00.671 INFO:tasks.rados.rados.0.smithi012.stdout:790: writing smithi01278544-2 from 606208 to 1220608 tid 2 2024-09-10T17:59:00.675 INFO:tasks.rados.rados.0.smithi012.stdout:790: writing smithi01278544-2 from 1220608 to 1810432 tid 3 2024-09-10T17:59:00.675 INFO:tasks.rados.rados.0.smithi012.stdout:791: rollback oid 11 current snap is 75 2024-09-10T17:59:00.675 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 73 2024-09-10T17:59:00.675 INFO:tasks.rados.rados.0.smithi012.stdout:788: finishing rollback tid 0 to smithi01278544-39 2024-09-10T17:59:00.675 INFO:tasks.rados.rados.0.smithi012.stdout:789: finishing rollback tid 0 to smithi01278544-14 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:789: finishing rollback tid 1 to smithi01278544-14 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:788: finishing rollback tid 1 to smithi01278544-39 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:789: finishing rollback tid 2 to smithi01278544-14 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 471 (ObjNum 152 snap 38 seq_num 152) dirty exists 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:788: finishing rollback tid 2 to smithi01278544-39 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 419 (ObjNum 176 snap 47 seq_num 176) dirty exists 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:790: finishing write tid 1 to smithi01278544-2 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:790: finishing write tid 2 to smithi01278544-2 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:787: done (4 left) 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:788: done (3 left) 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:789: done (2 left) 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:792: read oid 12 snap -1 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:792: expect deleted 2024-09-10T17:59:00.676 INFO:tasks.rados.rados.0.smithi012.stdout:793: snap_create 2024-09-10T17:59:00.678 INFO:tasks.rados.rados.0.smithi012.stdout:791: finishing rollback tid 0 to smithi01278544-11 2024-09-10T17:59:00.678 INFO:tasks.rados.rados.0.smithi012.stdout:790: finishing write tid 3 to smithi01278544-2 2024-09-10T17:59:00.678 INFO:tasks.rados.rados.0.smithi012.stdout:790: finishing write tid 4 to smithi01278544-2 2024-09-10T17:59:00.679 INFO:tasks.rados.rados.0.smithi012.stdout:791: finishing rollback tid 1 to smithi01278544-11 2024-09-10T17:59:00.679 INFO:tasks.rados.rados.0.smithi012.stdout:791: finishing rollback tid 2 to smithi01278544-11 2024-09-10T17:59:00.679 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 423 (ObjNum 229 snap 67 seq_num 229) dirty exists 2024-09-10T17:59:00.679 INFO:tasks.rados.rados.0.smithi012.stdout:790: finishing write tid 5 to smithi01278544-2 2024-09-10T17:59:00.679 INFO:tasks.rados.rados.0.smithi012.stdout:790: oid 2 updating version 0 to 360 2024-09-10T17:59:00.679 INFO:tasks.rados.rados.0.smithi012.stdout:790: oid 2 version 360 is already newer than 358 2024-09-10T17:59:00.680 INFO:tasks.rados.rados.0.smithi012.stdout:790: oid 2 version 360 is already newer than 359 2024-09-10T17:59:00.680 INFO:tasks.rados.rados.0.smithi012.stdout:790: oid 2 version 360 is already newer than 357 2024-09-10T17:59:00.680 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 360 (ObjNum 251 snap 75 seq_num 251) dirty exists 2024-09-10T17:59:00.680 INFO:tasks.rados.rados.0.smithi012.stdout:790: left oid 2 (ObjNum 251 snap 75 seq_num 251) 2024-09-10T17:59:00.972 INFO:tasks.rados.rados.0.smithi012.stdout:790: done (3 left) 2024-09-10T17:59:00.972 INFO:tasks.rados.rados.0.smithi012.stdout:791: done (2 left) 2024-09-10T17:59:00.972 INFO:tasks.rados.rados.0.smithi012.stdout:792: done (1 left) 2024-09-10T17:59:00.972 INFO:tasks.rados.rados.0.smithi012.stdout:793: done (0 left) 2024-09-10T17:59:00.972 INFO:tasks.rados.rados.0.smithi012.stdout:794: snap_remove snap 74 2024-09-10T17:59:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:00 smithi012 ceph-mon[89611]: osdmap e223: 8 total, 8 up, 8 in 2024-09-10T17:59:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:00 smithi012 ceph-mon[37454]: osdmap e223: 8 total, 8 up, 8 in 2024-09-10T17:59:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:00 smithi089 ceph-mon[31467]: osdmap e223: 8 total, 8 up, 8 in 2024-09-10T17:59:01.035 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:59:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: [10/Sep/2024:17:59:00] ENGINE Bus STARTING 2024-09-10T17:59:01.035 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:59:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: CherryPy Checker: 2024-09-10T17:59:01.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:59:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: The Application mounted at '' has an empty config. 2024-09-10T17:59:01.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:59:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: 2024-09-10T17:59:01.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:59:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: [10/Sep/2024:17:59:00] ENGINE Serving on http://:::9283 2024-09-10T17:59:01.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 17:59:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x[75832]: [10/Sep/2024:17:59:00] ENGINE Bus STARTED 2024-09-10T17:59:01.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: osdmap e224: 8 total, 8 up, 8 in 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: Standby manager daemon x restarted 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: Standby manager daemon x started 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: Active manager daemon y restarted 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: Activating manager daemon y 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: osdmap e225: 8 total, 8 up, 8 in 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: mgrmap e38: y(active, starting, since 0.00672512s), standbys: x 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:01.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:59:01.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: Manager daemon y is now available 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.480+0000 7f7a69354640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.480+0000 7f7a69354640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.480+0000 7f7a69354640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.480+0000 7f7a69354640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.480+0000 7f7a69354640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.481+0000 7f7a6cb5b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.481+0000 7f7a6cb5b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.787 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.481+0000 7f7a6cb5b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.481+0000 7f7a6cb5b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.481+0000 7f7a6cb5b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:59:01.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: osdmap e224: 8 total, 8 up, 8 in 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: Standby manager daemon x restarted 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: Standby manager daemon x started 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: Active manager daemon y restarted 2024-09-10T17:59:01.789 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: Activating manager daemon y 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: osdmap e225: 8 total, 8 up, 8 in 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: mgrmap e38: y(active, starting, since 0.00672512s), standbys: x 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:59:01.790 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: Manager daemon y is now available 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-10T17:59:01.791 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:59:01.792 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-10T17:59:01.983 INFO:tasks.rados.rados.0.smithi012.stdout:794: done (0 left) 2024-09-10T17:59:01.983 INFO:tasks.rados.rados.0.smithi012.stdout:795: rmattr oid 41 current snap is 76 2024-09-10T17:59:01.984 INFO:tasks.rados.rados.0.smithi012.stdout:795: done (0 left) 2024-09-10T17:59:01.984 INFO:tasks.rados.rados.0.smithi012.stdout:796: snap_remove snap 67 2024-09-10T17:59:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: osdmap e224: 8 total, 8 up, 8 in 2024-09-10T17:59:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: Standby manager daemon x restarted 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: Standby manager daemon x started 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.? 172.21.15.89:0/3973667769' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: Active manager daemon y restarted 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: Activating manager daemon y 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: osdmap e225: 8 total, 8 up, 8 in 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: mgrmap e38: y(active, starting, since 0.00672512s), standbys: x 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T17:59:02.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: Manager daemon y is now available 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-10T17:59:02.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:01 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-10T17:59:02.091 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:01.969+0000 7f7a9b686640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-10T17:59:02.091 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:01] ENGINE Bus STARTING 2024-09-10T17:59:02.092 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: CherryPy Checker: 2024-09-10T17:59:02.092 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: The Application mounted at '' has an empty config. 2024-09-10T17:59:02.092 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:02.092 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:02] ENGINE Serving on http://:::9283 2024-09-10T17:59:02.525 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:02] ENGINE Bus STARTED 2024-09-10T17:59:02.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:02.697+0000 7f7a4995b640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:17:59:02] ENGINE Error in HTTPServer.serve 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: Traceback (most recent call last): 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: self._connections.run(self.expiration_interval) 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: self._run(expiration_interval) 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: s = self.context.wrap_socket( 2024-09-10T17:59:02.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:59:02.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: return self.sslsocket_class._create( 2024-09-10T17:59:02.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:59:02.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: self.do_handshake() 2024-09-10T17:59:02.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:59:02.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: self._sslobj.do_handshake() 2024-09-10T17:59:02.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:59:02.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:02.997 INFO:tasks.rados.rados.0.smithi012.stdout:796: done (0 left) 2024-09-10T17:59:02.997 INFO:tasks.rados.rados.0.smithi012.stdout:797: setattr oid 11 current snap is 76 2024-09-10T17:59:03.002 INFO:tasks.rados.rados.0.smithi012.stdout:798: rmattr oid 31 current snap is 76 2024-09-10T17:59:03.002 INFO:tasks.rados.rados.0.smithi012.stdout:798: done (1 left) 2024-09-10T17:59:03.002 INFO:tasks.rados.rados.0.smithi012.stdout:799: rollback oid 42 current snap is 76 2024-09-10T17:59:03.003 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 42 to 56 2024-09-10T17:59:03.003 INFO:tasks.rados.rados.0.smithi012.stdout:800: rollback oid 38 current snap is 76 2024-09-10T17:59:03.003 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 38 to 71 2024-09-10T17:59:03.003 INFO:tasks.rados.rados.0.smithi012.stdout:801: snap_create 2024-09-10T17:59:03.007 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 435 (ObjNum 229 snap 67 seq_num 229) dirty exists 2024-09-10T17:59:03.008 INFO:tasks.rados.rados.0.smithi012.stdout:800: finishing rollback tid 0 to smithi01278544-38 2024-09-10T17:59:03.008 INFO:tasks.rados.rados.0.smithi012.stdout:800: finishing rollback tid 1 to smithi01278544-38 2024-09-10T17:59:03.008 INFO:tasks.rados.rados.0.smithi012.stdout:800: finishing rollback tid 2 to smithi01278544-38 2024-09-10T17:59:03.009 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 248 (ObjNum 148 snap 36 seq_num 148) dirty exists 2024-09-10T17:59:03.010 INFO:tasks.rados.rados.0.smithi012.stdout:799: finishing rollback tid 0 to smithi01278544-42 2024-09-10T17:59:03.010 INFO:tasks.rados.rados.0.smithi012.stdout:799: finishing rollback tid 1 to smithi01278544-42 2024-09-10T17:59:03.011 INFO:tasks.rados.rados.0.smithi012.stdout:799: finishing rollback tid 2 to smithi01278544-42 2024-09-10T17:59:03.011 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 483 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-09-10T17:59:03.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:02 smithi089 ceph-mon[31467]: mgrmap e39: y(active, since 1.00997s), standbys: x 2024-09-10T17:59:03.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:02 smithi089 ceph-mon[31467]: osdmap e226: 8 total, 8 up, 8 in 2024-09-10T17:59:03.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:02 smithi089 ceph-mon[31467]: [10/Sep/2024:17:59:02] ENGINE Bus STARTING 2024-09-10T17:59:03.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:02 smithi089 ceph-mon[31467]: [10/Sep/2024:17:59:02] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:59:03.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:02 smithi089 ceph-mon[31467]: [10/Sep/2024:17:59:02] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:59:03.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:02 smithi089 ceph-mon[31467]: [10/Sep/2024:17:59:02] ENGINE Bus STARTED 2024-09-10T17:59:03.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:02 smithi089 ceph-mon[31467]: [10/Sep/2024:17:59:02] ENGINE Error in HTTPServer.serve 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: Traceback (most recent call last): 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._run(expiration_interval) 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: s = self.context.wrap_socket( 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: return self.sslsocket_class._create( 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:59:03.240 INFO:journalctl@ceph.mon.b.smithi089.stdout: self.do_handshake() 2024-09-10T17:59:03.241 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:59:03.241 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._sslobj.do_handshake() 2024-09-10T17:59:03.241 INFO:journalctl@ceph.mon.b.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[89611]: mgrmap e39: y(active, since 1.00997s), standbys: x 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[89611]: osdmap e226: 8 total, 8 up, 8 in 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[89611]: [10/Sep/2024:17:59:02] ENGINE Bus STARTING 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[89611]: [10/Sep/2024:17:59:02] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[89611]: [10/Sep/2024:17:59:02] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[89611]: [10/Sep/2024:17:59:02] ENGINE Bus STARTED 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[89611]: [10/Sep/2024:17:59:02] ENGINE Error in HTTPServer.serve 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:59:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:59:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[37454]: mgrmap e39: y(active, since 1.00997s), standbys: x 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[37454]: osdmap e226: 8 total, 8 up, 8 in 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[37454]: [10/Sep/2024:17:59:02] ENGINE Bus STARTING 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[37454]: [10/Sep/2024:17:59:02] ENGINE Serving on http://172.21.15.12:8765 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[37454]: [10/Sep/2024:17:59:02] ENGINE Serving on https://172.21.15.12:7150 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[37454]: [10/Sep/2024:17:59:02] ENGINE Bus STARTED 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:02 smithi012 ceph-mon[37454]: [10/Sep/2024:17:59:02] ENGINE Error in HTTPServer.serve 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout: Traceback (most recent call last): 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._run(expiration_interval) 2024-09-10T17:59:03.286 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: s = self.context.wrap_socket( 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: return self.sslsocket_class._create( 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: self.do_handshake() 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: self._sslobj.do_handshake() 2024-09-10T17:59:03.287 INFO:journalctl@ceph.mon.c.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T17:59:03.999 INFO:tasks.rados.rados.0.smithi012.stdout:797: done (3 left) 2024-09-10T17:59:03.999 INFO:tasks.rados.rados.0.smithi012.stdout:799: done (2 left) 2024-09-10T17:59:03.999 INFO:tasks.rados.rados.0.smithi012.stdout:800: done (1 left) 2024-09-10T17:59:03.999 INFO:tasks.rados.rados.0.smithi012.stdout:801: done (0 left) 2024-09-10T17:59:03.999 INFO:tasks.rados.rados.0.smithi012.stdout:802: rollback oid 43 current snap is 77 2024-09-10T17:59:03.999 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 43 to 56 2024-09-10T17:59:03.999 INFO:tasks.rados.rados.0.smithi012.stdout:803: snap_create 2024-09-10T17:59:04.001 INFO:tasks.rados.rados.0.smithi012.stdout:802: finishing rollback tid 0 to smithi01278544-43 2024-09-10T17:59:04.002 INFO:tasks.rados.rados.0.smithi012.stdout:802: finishing rollback tid 1 to smithi01278544-43 2024-09-10T17:59:04.002 INFO:tasks.rados.rados.0.smithi012.stdout:802: finishing rollback tid 2 to smithi01278544-43 2024-09-10T17:59:04.002 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 491 (ObjNum 147 snap 36 seq_num 147) dirty exists 2024-09-10T17:59:04.261 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:03 smithi012 ceph-mon[89611]: pgmap v5: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail; 87 MiB/s rd, 102 MiB/s wr, 1.16k op/s 2024-09-10T17:59:04.261 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:03 smithi012 ceph-mon[89611]: osdmap e227: 8 total, 8 up, 8 in 2024-09-10T17:59:04.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:03 smithi012 ceph-mon[89611]: mgrmap e40: y(active, since 2s), standbys: x 2024-09-10T17:59:04.262 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:59:03] "GET /metrics HTTP/1.1" 200 33339 "" "Prometheus/2.43.0" 2024-09-10T17:59:04.262 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:03 smithi012 ceph-mon[37454]: pgmap v5: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail; 87 MiB/s rd, 102 MiB/s wr, 1.16k op/s 2024-09-10T17:59:04.262 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:03 smithi012 ceph-mon[37454]: osdmap e227: 8 total, 8 up, 8 in 2024-09-10T17:59:04.262 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:03 smithi012 ceph-mon[37454]: mgrmap e40: y(active, since 2s), standbys: x 2024-09-10T17:59:04.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:03 smithi089 ceph-mon[31467]: pgmap v5: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail; 87 MiB/s rd, 102 MiB/s wr, 1.16k op/s 2024-09-10T17:59:04.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:03 smithi089 ceph-mon[31467]: osdmap e227: 8 total, 8 up, 8 in 2024-09-10T17:59:04.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:03 smithi089 ceph-mon[31467]: mgrmap e40: y(active, since 2s), standbys: x 2024-09-10T17:59:05.009 INFO:tasks.rados.rados.0.smithi012.stdout:802: done (1 left) 2024-09-10T17:59:05.010 INFO:tasks.rados.rados.0.smithi012.stdout:803: done (0 left) 2024-09-10T17:59:05.010 INFO:tasks.rados.rados.0.smithi012.stdout:804: rmattr oid 29 current snap is 78 2024-09-10T17:59:05.010 INFO:tasks.rados.rados.0.smithi012.stdout:804: done (0 left) 2024-09-10T17:59:05.010 INFO:tasks.rados.rados.0.smithi012.stdout:805: snap_create 2024-09-10T17:59:05.143 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:05 smithi012 ceph-mon[89611]: osdmap e228: 8 total, 8 up, 8 in 2024-09-10T17:59:05.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:05 smithi012 ceph-mon[37454]: osdmap e228: 8 total, 8 up, 8 in 2024-09-10T17:59:05.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:05 smithi089 ceph-mon[31467]: osdmap e228: 8 total, 8 up, 8 in 2024-09-10T17:59:06.008 INFO:tasks.rados.rados.0.smithi012.stdout:805: done (0 left) 2024-09-10T17:59:06.008 INFO:tasks.rados.rados.0.smithi012.stdout:806: delete oid 33 current snap is 79 2024-09-10T17:59:06.014 INFO:tasks.rados.rados.0.smithi012.stdout:806: done (0 left) 2024-09-10T17:59:06.014 INFO:tasks.rados.rados.0.smithi012.stdout:807: setattr oid 48 current snap is 79 2024-09-10T17:59:06.015 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 79 2024-09-10T17:59:06.015 INFO:tasks.rados.rados.0.smithi012.stdout:808: seq_num 253 ranges {1810432=647168,2457600=786432,3244032=417792} 2024-09-10T17:59:06.029 INFO:tasks.rados.rados.0.smithi012.stdout:808: writing smithi01278544-2 from 1810432 to 2457600 tid 1 2024-09-10T17:59:06.034 INFO:tasks.rados.rados.0.smithi012.stdout:808: writing smithi01278544-2 from 2457600 to 3244032 tid 2 2024-09-10T17:59:06.037 INFO:tasks.rados.rados.0.smithi012.stdout:808: writing smithi01278544-2 from 3244032 to 3661824 tid 3 2024-09-10T17:59:06.037 INFO:tasks.rados.rados.0.smithi012.stdout:809: read oid 37 snap -1 2024-09-10T17:59:06.038 INFO:tasks.rados.rados.0.smithi012.stdout:809: expect deleted 2024-09-10T17:59:06.038 INFO:tasks.rados.rados.0.smithi012.stdout:810: copy_from oid 40 from oid 33 current snap is 79 2024-09-10T17:59:06.038 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 250 (ObjNum 245 snap 72 seq_num 245) dirty exists 2024-09-10T17:59:06.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: finishing write tid 1 to smithi01278544-2 2024-09-10T17:59:06.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: finishing write tid 2 to smithi01278544-2 2024-09-10T17:59:06.038 INFO:tasks.rados.rados.0.smithi012.stdout:807: done (3 left) 2024-09-10T17:59:06.038 INFO:tasks.rados.rados.0.smithi012.stdout:811: snap_remove snap 72 2024-09-10T17:59:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[89611]: pgmap v8: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail; 29 MiB/s rd, 34 MiB/s wr, 387 op/s 2024-09-10T17:59:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[89611]: osdmap e229: 8 total, 8 up, 8 in 2024-09-10T17:59:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[89611]: mgrmap e41: y(active, since 4s), standbys: x 2024-09-10T17:59:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[37454]: pgmap v8: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail; 29 MiB/s rd, 34 MiB/s wr, 387 op/s 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[37454]: osdmap e229: 8 total, 8 up, 8 in 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[37454]: mgrmap e41: y(active, since 4s), standbys: x 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:06 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:06 smithi089 ceph-mon[31467]: pgmap v8: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail; 29 MiB/s rd, 34 MiB/s wr, 387 op/s 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:06 smithi089 ceph-mon[31467]: osdmap e229: 8 total, 8 up, 8 in 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:06 smithi089 ceph-mon[31467]: mgrmap e41: y(active, since 4s), standbys: x 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:06 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:06.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:06 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.037 INFO:tasks.rados.rados.0.smithi012.stdout:811: done (3 left) 2024-09-10T17:59:07.037 INFO:tasks.rados.rados.0.smithi012.stdout:812: setattr oid 27 current snap is 79 2024-09-10T17:59:07.037 INFO:tasks.rados.rados.0.smithi012.stdout:810: finishing copy_from to smithi01278544-40 2024-09-10T17:59:07.037 INFO:tasks.rados.rados.0.smithi012.stdout:810: got expected ENOENT (src dne) 2024-09-10T17:59:07.037 INFO:tasks.rados.rados.0.smithi012.stdout:810: finishing copy_from racing read to smithi01278544-40 2024-09-10T17:59:07.037 INFO:tasks.rados.rados.0.smithi012.stdout:808: finishing write tid 3 to smithi01278544-2 2024-09-10T17:59:07.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: finishing write tid 4 to smithi01278544-2 2024-09-10T17:59:07.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: finishing write tid 5 to smithi01278544-2 2024-09-10T17:59:07.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: oid 2 updating version 0 to 364 2024-09-10T17:59:07.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: oid 2 updating version 364 to 367 2024-09-10T17:59:07.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: oid 2 version 367 is already newer than 365 2024-09-10T17:59:07.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: oid 2 version 367 is already newer than 366 2024-09-10T17:59:07.038 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 367 (ObjNum 253 snap 79 seq_num 253) dirty exists 2024-09-10T17:59:07.038 INFO:tasks.rados.rados.0.smithi012.stdout:808: left oid 2 (ObjNum 253 snap 79 seq_num 253) 2024-09-10T17:59:07.040 INFO:tasks.rados.rados.0.smithi012.stdout:808: done (3 left) 2024-09-10T17:59:07.040 INFO:tasks.rados.rados.0.smithi012.stdout:809: done (2 left) 2024-09-10T17:59:07.040 INFO:tasks.rados.rados.0.smithi012.stdout:810: done (1 left) 2024-09-10T17:59:07.040 INFO:tasks.rados.rados.0.smithi012.stdout:813: snap_create 2024-09-10T17:59:07.044 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 290 (ObjNum 195 snap 50 seq_num 195) dirty exists 2024-09-10T17:59:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[89611]: osdmap e230: 8 total, 8 up, 8 in 2024-09-10T17:59:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[37454]: osdmap e230: 8 total, 8 up, 8 in 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:07 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:07 smithi089 ceph-mon[31467]: osdmap e230: 8 total, 8 up, 8 in 2024-09-10T17:59:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:07 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:07 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:07 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:07 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:07 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:07 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:07.647 INFO:tasks.rados.rados.0.smithi012.stdout:812: done (1 left) 2024-09-10T17:59:07.647 INFO:tasks.rados.rados.0.smithi012.stdout:813: done (0 left) 2024-09-10T17:59:07.647 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 80 2024-09-10T17:59:07.647 INFO:tasks.rados.rados.0.smithi012.stdout:814: seq_num 254 ranges {0=663552,663552=663552,1327104=540672} 2024-09-10T17:59:07.651 INFO:tasks.rados.rados.0.smithi012.stdout:814: writing smithi01278544-37 from 0 to 663552 tid 1 2024-09-10T17:59:07.655 INFO:tasks.rados.rados.0.smithi012.stdout:814: writing smithi01278544-37 from 663552 to 1327104 tid 2 2024-09-10T17:59:07.659 INFO:tasks.rados.rados.0.smithi012.stdout:814: writing smithi01278544-37 from 1327104 to 1867776 tid 3 2024-09-10T17:59:07.659 INFO:tasks.rados.rados.0.smithi012.stdout:815: snap_create 2024-09-10T17:59:07.659 INFO:tasks.rados.rados.0.smithi012.stdout:814: finishing write tid 1 to smithi01278544-37 2024-09-10T17:59:07.659 INFO:tasks.rados.rados.0.smithi012.stdout:814: finishing write tid 2 to smithi01278544-37 2024-09-10T17:59:07.662 INFO:tasks.rados.rados.0.smithi012.stdout:814: finishing write tid 3 to smithi01278544-37 2024-09-10T17:59:07.662 INFO:tasks.rados.rados.0.smithi012.stdout:814: finishing write tid 4 to smithi01278544-37 2024-09-10T17:59:07.665 INFO:tasks.rados.rados.0.smithi012.stdout:814: finishing write tid 5 to smithi01278544-37 2024-09-10T17:59:07.665 INFO:tasks.rados.rados.0.smithi012.stdout:814: oid 37 updating version 0 to 344 2024-09-10T17:59:07.665 INFO:tasks.rados.rados.0.smithi012.stdout:814: oid 37 version 344 is already newer than 341 2024-09-10T17:59:07.665 INFO:tasks.rados.rados.0.smithi012.stdout:814: oid 37 version 344 is already newer than 343 2024-09-10T17:59:07.666 INFO:tasks.rados.rados.0.smithi012.stdout:814: oid 37 version 344 is already newer than 342 2024-09-10T17:59:07.666 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 344 (ObjNum 254 snap 80 seq_num 254) dirty exists 2024-09-10T17:59:07.666 INFO:tasks.rados.rados.0.smithi012.stdout:814: left oid 37 (ObjNum 254 snap 80 seq_num 254) 2024-09-10T17:59:08.110 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T17:59:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:08 smithi012 ceph-mon[89611]: pgmap v11: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:08 smithi012 ceph-mon[89611]: osdmap e231: 8 total, 8 up, 8 in 2024-09-10T17:59:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:08 smithi012 ceph-mon[89611]: osdmap e232: 8 total, 8 up, 8 in 2024-09-10T17:59:08.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:08 smithi012 ceph-mon[37454]: pgmap v11: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:08.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:08 smithi012 ceph-mon[37454]: osdmap e231: 8 total, 8 up, 8 in 2024-09-10T17:59:08.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:08 smithi012 ceph-mon[37454]: osdmap e232: 8 total, 8 up, 8 in 2024-09-10T17:59:08.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:08 smithi089 ceph-mon[31467]: pgmap v11: 121 pgs: 121 active+clean; 133 MiB data, 803 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:08.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:08 smithi089 ceph-mon[31467]: osdmap e231: 8 total, 8 up, 8 in 2024-09-10T17:59:08.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:08 smithi089 ceph-mon[31467]: osdmap e232: 8 total, 8 up, 8 in 2024-09-10T17:59:08.653 INFO:tasks.rados.rados.0.smithi012.stdout:814: done (1 left) 2024-09-10T17:59:08.653 INFO:tasks.rados.rados.0.smithi012.stdout:815: done (0 left) 2024-09-10T17:59:08.653 INFO:tasks.rados.rados.0.smithi012.stdout:816: read oid 11 snap 71 2024-09-10T17:59:08.654 INFO:tasks.rados.rados.0.smithi012.stdout:816: expect (ObjNum 229 snap 67 seq_num 229) 2024-09-10T17:59:08.654 INFO:tasks.rados.rados.0.smithi012.stdout:817: snap_create 2024-09-10T17:59:08.672 INFO:tasks.rados.rados.0.smithi012.stdout:816: expect (ObjNum 229 snap 67 seq_num 229) 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (4m) 3s ago 5m 27.4M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (4m) 2s ago 4m 89.6M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (6m) 3s ago 6m 18.2M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (6m) 2s ago 6m 18.9M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (30s) 2s ago 10m 451M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (58s) 3s ago 11m 490M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (16s) 3s ago 12m 34.1M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (10m) 2s ago 10m 61.5M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e bddaa233c388 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (10m) 3s ago 10m 55.7M 2048M 18.2.4-837-g7a853b17 f21ba1eea74e 2ba771d7bc46 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (4m) 3s ago 4m 16.0M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T17:59:08.702 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (4m) 2s ago 4m 17.0M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (9m) 3s ago 9m 143M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e a54550a62cfe 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (9m) 3s ago 9m 121M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (9m) 3s ago 9m 134M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (8m) 3s ago 8m 124M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (8m) 2s ago 8m 163M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (7m) 2s ago 7m 121M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (7m) 2s ago 7m 123M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (7m) 2s ago 7m 95.6M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T17:59:08.703 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (34s) 2s ago 5m 48.2M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T17:59:09.063 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:59:09.063 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T17:59:09.063 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2, 2024-09-10T17:59:09.063 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 1 2024-09-10T17:59:09.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:59:09.063 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T17:59:09.063 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 12, 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T17:59:09.064 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:59:09.366 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:59:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T17:59:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T17:59:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T17:59:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T17:59:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr" 2024-09-10T17:59:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T17:59:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "3/20 daemons upgraded", 2024-09-10T17:59:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "", 2024-09-10T17:59:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T17:59:09.367 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:59:09.662 INFO:tasks.rados.rados.0.smithi012.stdout:816: done (1 left) 2024-09-10T17:59:09.662 INFO:tasks.rados.rados.0.smithi012.stdout:817: done (0 left) 2024-09-10T17:59:09.662 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 82 2024-09-10T17:59:09.662 INFO:tasks.rados.rados.0.smithi012.stdout:818: seq_num 255 ranges {1662976=679936,2342912=548864,2891776=598016,3489792=57344} 2024-09-10T17:59:09.674 INFO:tasks.rados.rados.0.smithi012.stdout:818: writing smithi01278544-10 from 1662976 to 2342912 tid 1 2024-09-10T17:59:09.677 INFO:tasks.rados.rados.0.smithi012.stdout:818: writing smithi01278544-10 from 2342912 to 2891776 tid 2 2024-09-10T17:59:09.680 INFO:tasks.rados.rados.0.smithi012.stdout:818: writing smithi01278544-10 from 2891776 to 3489792 tid 3 2024-09-10T17:59:09.681 INFO:tasks.rados.rados.0.smithi012.stdout:818: writing smithi01278544-10 from 3489792 to 3547136 tid 4 2024-09-10T17:59:09.681 INFO:tasks.rados.rados.0.smithi012.stdout:819: copy_from oid 5 from oid 16 current snap is 82 2024-09-10T17:59:09.681 INFO:tasks.rados.rados.0.smithi012.stdout:820: copy_from oid 36 from oid 3 current snap is 82 2024-09-10T17:59:09.681 INFO:tasks.rados.rados.0.smithi012.stdout:821: read oid 6 snap -1 2024-09-10T17:59:09.681 INFO:tasks.rados.rados.0.smithi012.stdout:821: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:59:09.681 INFO:tasks.rados.rados.0.smithi012.stdout:822: delete oid 13 current snap is 82 2024-09-10T17:59:09.682 INFO:tasks.rados.rados.0.smithi012.stdout:818: finishing write tid 1 to smithi01278544-10 2024-09-10T17:59:09.682 INFO:tasks.rados.rados.0.smithi012.stdout:820: finishing copy_from to smithi01278544-36 2024-09-10T17:59:09.682 INFO:tasks.rados.rados.0.smithi012.stdout:820: got expected ENOENT (src dne) 2024-09-10T17:59:09.682 INFO:tasks.rados.rados.0.smithi012.stdout:820: finishing copy_from racing read to smithi01278544-36 2024-09-10T17:59:09.683 INFO:tasks.rados.rados.0.smithi012.stdout:818: finishing write tid 2 to smithi01278544-10 2024-09-10T17:59:09.684 INFO:tasks.rados.rados.0.smithi012.stdout:821: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: finishing write tid 3 to smithi01278544-10 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: finishing write tid 4 to smithi01278544-10 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: finishing write tid 5 to smithi01278544-10 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: finishing write tid 6 to smithi01278544-10 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: oid 10 updating version 0 to 449 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: oid 10 version 449 is already newer than 448 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: oid 10 version 449 is already newer than 447 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: oid 10 updating version 449 to 450 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: oid 10 updating version 450 to 451 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 451 (ObjNum 255 snap 82 seq_num 255) dirty exists 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:818: left oid 10 (ObjNum 255 snap 82 seq_num 255) 2024-09-10T17:59:09.697 INFO:tasks.rados.rados.0.smithi012.stdout:819: finishing copy_from racing read to smithi01278544-5 2024-09-10T17:59:09.698 INFO:tasks.rados.rados.0.smithi012.stdout:818: done (4 left) 2024-09-10T17:59:09.698 INFO:tasks.rados.rados.0.smithi012.stdout:820: done (3 left) 2024-09-10T17:59:09.698 INFO:tasks.rados.rados.0.smithi012.stdout:821: done (2 left) 2024-09-10T17:59:09.698 INFO:tasks.rados.rados.0.smithi012.stdout:822: done (1 left) 2024-09-10T17:59:09.698 INFO:tasks.rados.rados.0.smithi012.stdout:823: snap_create 2024-09-10T17:59:09.698 INFO:tasks.rados.rados.0.smithi012.stdout:819: finishing copy_from to smithi01278544-5 2024-09-10T17:59:09.698 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 282 (ObjNum 226 snap 67 seq_num 226) dirty exists 2024-09-10T17:59:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[89611]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[89611]: from='client.25160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[89611]: osdmap e233: 8 total, 8 up, 8 in 2024-09-10T17:59:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[89611]: from='client.25166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/542497905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:59:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[37454]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[37454]: from='client.25160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[37454]: osdmap e233: 8 total, 8 up, 8 in 2024-09-10T17:59:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[37454]: from='client.25166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:09 smithi012 ceph-mon[37454]: from='client.? 172.21.15.12:0/542497905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:59:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:09 smithi089 ceph-mon[31467]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:09 smithi089 ceph-mon[31467]: from='client.25160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:09 smithi089 ceph-mon[31467]: osdmap e233: 8 total, 8 up, 8 in 2024-09-10T17:59:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:09 smithi089 ceph-mon[31467]: from='client.25166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:09 smithi089 ceph-mon[31467]: from='client.? 172.21.15.12:0/542497905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:59:10.668 INFO:tasks.rados.rados.0.smithi012.stdout:819: done (1 left) 2024-09-10T17:59:10.668 INFO:tasks.rados.rados.0.smithi012.stdout:823: done (0 left) 2024-09-10T17:59:10.668 INFO:tasks.rados.rados.0.smithi012.stdout:824: setattr oid 39 current snap is 83 2024-09-10T17:59:10.669 INFO:tasks.rados.rados.0.smithi012.stdout:825: read oid 37 snap -1 2024-09-10T17:59:10.669 INFO:tasks.rados.rados.0.smithi012.stdout:825: expect (ObjNum 254 snap 80 seq_num 254) 2024-09-10T17:59:10.669 INFO:tasks.rados.rados.0.smithi012.stdout:826: read oid 25 snap -1 2024-09-10T17:59:10.669 INFO:tasks.rados.rados.0.smithi012.stdout:826: expect (ObjNum 222 snap 66 seq_num 222) 2024-09-10T17:59:10.669 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 83 2024-09-10T17:59:10.669 INFO:tasks.rados.rados.0.smithi012.stdout:827: seq_num 257 ranges {4005888=712704,4718592=720896,5439488=483328} 2024-09-10T17:59:10.694 INFO:tasks.rados.rados.0.smithi012.stdout:827: writing smithi01278544-47 from 4005888 to 4718592 tid 1 2024-09-10T17:59:10.699 INFO:tasks.rados.rados.0.smithi012.stdout:827: writing smithi01278544-47 from 4718592 to 5439488 tid 2 2024-09-10T17:59:10.702 INFO:tasks.rados.rados.0.smithi012.stdout:827: writing smithi01278544-47 from 5439488 to 5922816 tid 3 2024-09-10T17:59:10.703 INFO:tasks.rados.rados.0.smithi012.stdout:828: copy_from oid 42 from oid 26 current snap is 83 2024-09-10T17:59:10.703 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 453 (ObjNum 176 snap 47 seq_num 176) dirty exists 2024-09-10T17:59:10.703 INFO:tasks.rados.rados.0.smithi012.stdout:824: done (4 left) 2024-09-10T17:59:10.703 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 83 2024-09-10T17:59:10.703 INFO:tasks.rados.rados.0.smithi012.stdout:825: expect (ObjNum 254 snap 80 seq_num 254) 2024-09-10T17:59:10.756 INFO:tasks.rados.rados.0.smithi012.stdout:826: expect (ObjNum 222 snap 66 seq_num 222) 2024-09-10T17:59:10.796 INFO:tasks.rados.rados.0.smithi012.stdout:827: finishing write tid 1 to smithi01278544-47 2024-09-10T17:59:10.796 INFO:tasks.rados.rados.0.smithi012.stdout:827: finishing write tid 2 to smithi01278544-47 2024-09-10T17:59:10.796 INFO:tasks.rados.rados.0.smithi012.stdout:827: finishing write tid 3 to smithi01278544-47 2024-09-10T17:59:10.796 INFO:tasks.rados.rados.0.smithi012.stdout:827: finishing write tid 4 to smithi01278544-47 2024-09-10T17:59:10.796 INFO:tasks.rados.rados.0.smithi012.stdout:827: finishing write tid 5 to smithi01278544-47 2024-09-10T17:59:10.796 INFO:tasks.rados.rados.0.smithi012.stdout:827: oid 47 updating version 0 to 506 2024-09-10T17:59:10.796 INFO:tasks.rados.rados.0.smithi012.stdout:827: oid 47 version 506 is already newer than 504 2024-09-10T17:59:10.796 INFO:tasks.rados.rados.0.smithi012.stdout:827: oid 47 version 506 is already newer than 505 2024-09-10T17:59:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:827: oid 47 version 506 is already newer than 503 2024-09-10T17:59:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 506 (ObjNum 257 snap 83 seq_num 257) dirty exists 2024-09-10T17:59:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:827: left oid 47 (ObjNum 257 snap 83 seq_num 257) 2024-09-10T17:59:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:828: finishing copy_from racing read to smithi01278544-42 2024-09-10T17:59:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:828: finishing copy_from to smithi01278544-42 2024-09-10T17:59:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 169 (ObjNum 195 snap 50 seq_num 195) dirty exists 2024-09-10T17:59:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:829: seq_num 258 ranges {0=729088,729088=606208,1335296=598016} 2024-09-10T17:59:10.800 INFO:tasks.rados.rados.0.smithi012.stdout:829: writing smithi01278544-12 from 0 to 729088 tid 1 2024-09-10T17:59:10.803 INFO:tasks.rados.rados.0.smithi012.stdout:829: writing smithi01278544-12 from 729088 to 1335296 tid 2 2024-09-10T17:59:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:829: writing smithi01278544-12 from 1335296 to 1933312 tid 3 2024-09-10T17:59:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:825: done (4 left) 2024-09-10T17:59:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:826: done (3 left) 2024-09-10T17:59:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:827: done (2 left) 2024-09-10T17:59:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:828: done (1 left) 2024-09-10T17:59:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:830: delete oid 34 current snap is 83 2024-09-10T17:59:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:829: finishing write tid 1 to smithi01278544-12 2024-09-10T17:59:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:829: finishing write tid 2 to smithi01278544-12 2024-09-10T17:59:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:830: done (1 left) 2024-09-10T17:59:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 83 2024-09-10T17:59:10.809 INFO:tasks.rados.rados.0.smithi012.stdout:831: seq_num 260 ranges {1712128=761856,2473984=417792,2891776=786432} 2024-09-10T17:59:10.823 INFO:tasks.rados.rados.0.smithi012.stdout:831: writing smithi01278544-48 from 1712128 to 2473984 tid 1 2024-09-10T17:59:10.825 INFO:tasks.rados.rados.0.smithi012.stdout:831: writing smithi01278544-48 from 2473984 to 2891776 tid 2 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:831: writing smithi01278544-48 from 2891776 to 3678208 tid 3 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:832: snap_create 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:829: finishing write tid 3 to smithi01278544-12 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:829: finishing write tid 4 to smithi01278544-12 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:829: finishing write tid 5 to smithi01278544-12 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:829: oid 12 updating version 0 to 454 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:829: oid 12 updating version 454 to 456 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:829: oid 12 version 456 is already newer than 455 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:829: oid 12 updating version 456 to 457 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 457 (ObjNum 258 snap 83 seq_num 258) dirty exists 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:829: left oid 12 (ObjNum 258 snap 83 seq_num 258) 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:831: finishing write tid 1 to smithi01278544-48 2024-09-10T17:59:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:831: finishing write tid 2 to smithi01278544-48 2024-09-10T17:59:10.833 INFO:tasks.rados.rados.0.smithi012.stdout:831: finishing write tid 3 to smithi01278544-48 2024-09-10T17:59:10.833 INFO:tasks.rados.rados.0.smithi012.stdout:831: finishing write tid 4 to smithi01278544-48 2024-09-10T17:59:10.836 INFO:tasks.rados.rados.0.smithi012.stdout:831: finishing write tid 5 to smithi01278544-48 2024-09-10T17:59:10.836 INFO:tasks.rados.rados.0.smithi012.stdout:831: oid 48 updating version 0 to 257 2024-09-10T17:59:10.836 INFO:tasks.rados.rados.0.smithi012.stdout:831: oid 48 updating version 257 to 258 2024-09-10T17:59:10.836 INFO:tasks.rados.rados.0.smithi012.stdout:831: oid 48 updating version 258 to 259 2024-09-10T17:59:10.836 INFO:tasks.rados.rados.0.smithi012.stdout:831: oid 48 version 259 is already newer than 256 2024-09-10T17:59:10.837 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 259 (ObjNum 260 snap 83 seq_num 260) dirty exists 2024-09-10T17:59:10.837 INFO:tasks.rados.rados.0.smithi012.stdout:831: left oid 48 (ObjNum 260 snap 83 seq_num 260) 2024-09-10T17:59:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[89611]: pgmap v15: 121 pgs: 121 active+clean; 133 MiB data, 874 MiB used, 714 GiB / 715 GiB avail; 45 KiB/s rd, 455 KiB/s wr, 31 op/s 2024-09-10T17:59:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[89611]: from='client.25178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[89611]: osdmap e234: 8 total, 8 up, 8 in 2024-09-10T17:59:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:59:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:59:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[37454]: pgmap v15: 121 pgs: 121 active+clean; 133 MiB data, 874 MiB used, 714 GiB / 715 GiB avail; 45 KiB/s rd, 455 KiB/s wr, 31 op/s 2024-09-10T17:59:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[37454]: from='client.25178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[37454]: osdmap e234: 8 total, 8 up, 8 in 2024-09-10T17:59:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:59:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:10 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:59:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:10 smithi089 ceph-mon[31467]: pgmap v15: 121 pgs: 121 active+clean; 133 MiB data, 874 MiB used, 714 GiB / 715 GiB avail; 45 KiB/s rd, 455 KiB/s wr, 31 op/s 2024-09-10T17:59:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:10 smithi089 ceph-mon[31467]: from='client.25178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:10 smithi089 ceph-mon[31467]: osdmap e234: 8 total, 8 up, 8 in 2024-09-10T17:59:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:10 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:10 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:10 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:59:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:10 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T17:59:11.675 INFO:tasks.rados.rados.0.smithi012.stdout:829: done (2 left) 2024-09-10T17:59:11.675 INFO:tasks.rados.rados.0.smithi012.stdout:831: done (1 left) 2024-09-10T17:59:11.676 INFO:tasks.rados.rados.0.smithi012.stdout:832: done (0 left) 2024-09-10T17:59:11.676 INFO:tasks.rados.rados.0.smithi012.stdout:833: snap_remove snap 71 2024-09-10T17:59:11.923 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:59:11.923 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:59:11.923 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:59:11.923 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: osdmap e235: 8 total, 8 up, 8 in 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T17:59:11.924 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:11.925 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: osdmap e235: 8 total, 8 up, 8 in 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:59:11.926 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.928 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.929 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:11.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-10T17:59:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-10T17:59:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:59:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T17:59:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: osdmap e235: 8 total, 8 up, 8 in 2024-09-10T17:59:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-09-10T17:59:12.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:12.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T17:59:12.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:11 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T17:59:12.650 INFO:tasks.rados.rados.0.smithi012.stdout:833: done (0 left) 2024-09-10T17:59:12.650 INFO:tasks.rados.rados.0.smithi012.stdout:834: rmattr oid 46 current snap is 84 2024-09-10T17:59:12.650 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 84 2024-09-10T17:59:12.650 INFO:tasks.rados.rados.0.smithi012.stdout:835: seq_num 261 ranges {3678208=778240,4456448=704512,5160960=499712} 2024-09-10T17:59:12.675 INFO:tasks.rados.rados.0.smithi012.stdout:835: writing smithi01278544-48 from 3678208 to 4456448 tid 1 2024-09-10T17:59:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:835: writing smithi01278544-48 from 4456448 to 5160960 tid 2 2024-09-10T17:59:12.682 INFO:tasks.rados.rados.0.smithi012.stdout:835: writing smithi01278544-48 from 5160960 to 5660672 tid 3 2024-09-10T17:59:12.682 INFO:tasks.rados.rados.0.smithi012.stdout:836: delete oid 18 current snap is 84 2024-09-10T17:59:12.683 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 291 (ObjNum 226 snap 67 seq_num 226) dirty exists 2024-09-10T17:59:12.683 INFO:tasks.rados.rados.0.smithi012.stdout:835: finishing write tid 1 to smithi01278544-48 2024-09-10T17:59:12.683 INFO:tasks.rados.rados.0.smithi012.stdout:835: finishing write tid 2 to smithi01278544-48 2024-09-10T17:59:12.685 INFO:tasks.rados.rados.0.smithi012.stdout:835: finishing write tid 3 to smithi01278544-48 2024-09-10T17:59:12.686 INFO:tasks.rados.rados.0.smithi012.stdout:835: finishing write tid 4 to smithi01278544-48 2024-09-10T17:59:12.687 INFO:tasks.rados.rados.0.smithi012.stdout:835: finishing write tid 5 to smithi01278544-48 2024-09-10T17:59:12.687 INFO:tasks.rados.rados.0.smithi012.stdout:835: oid 48 updating version 0 to 265 2024-09-10T17:59:12.687 INFO:tasks.rados.rados.0.smithi012.stdout:835: oid 48 updating version 265 to 268 2024-09-10T17:59:12.687 INFO:tasks.rados.rados.0.smithi012.stdout:835: oid 48 version 268 is already newer than 266 2024-09-10T17:59:12.687 INFO:tasks.rados.rados.0.smithi012.stdout:835: oid 48 version 268 is already newer than 267 2024-09-10T17:59:12.687 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 268 (ObjNum 261 snap 84 seq_num 261) dirty exists 2024-09-10T17:59:12.687 INFO:tasks.rados.rados.0.smithi012.stdout:835: left oid 48 (ObjNum 261 snap 84 seq_num 261) 2024-09-10T17:59:12.688 INFO:tasks.rados.rados.0.smithi012.stdout:834: done (2 left) 2024-09-10T17:59:12.688 INFO:tasks.rados.rados.0.smithi012.stdout:835: done (1 left) 2024-09-10T17:59:12.688 INFO:tasks.rados.rados.0.smithi012.stdout:836: done (0 left) 2024-09-10T17:59:12.688 INFO:tasks.rados.rados.0.smithi012.stdout:837: read oid 10 snap -1 2024-09-10T17:59:12.688 INFO:tasks.rados.rados.0.smithi012.stdout:837: expect (ObjNum 255 snap 82 seq_num 255) 2024-09-10T17:59:12.689 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 84 2024-09-10T17:59:12.689 INFO:tasks.rados.rados.0.smithi012.stdout:838: seq_num 263 ranges {0=409600,409600=475136,884736=557056,1441792=573440} 2024-09-10T17:59:12.690 INFO:tasks.rados.rados.0.smithi012.stdout:838: writing smithi01278544-29 from 0 to 409600 tid 1 2024-09-10T17:59:12.692 INFO:tasks.rados.rados.0.smithi012.stdout:838: writing smithi01278544-29 from 409600 to 884736 tid 2 2024-09-10T17:59:12.696 INFO:tasks.rados.rados.0.smithi012.stdout:838: writing smithi01278544-29 from 884736 to 1441792 tid 3 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:838: writing smithi01278544-29 from 1441792 to 2015232 tid 4 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:839: read oid 20 snap -1 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:839: expect deleted 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:838: finishing write tid 1 to smithi01278544-29 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:838: finishing write tid 2 to smithi01278544-29 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:838: finishing write tid 3 to smithi01278544-29 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:840: rmattr oid 32 current snap is 84 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:840: done (3 left) 2024-09-10T17:59:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:841: delete oid 23 current snap is 84 2024-09-10T17:59:12.702 INFO:tasks.rados.rados.0.smithi012.stdout:841: done (3 left) 2024-09-10T17:59:12.702 INFO:tasks.rados.rados.0.smithi012.stdout:842: copy_from oid 43 from oid 2 current snap is 84 2024-09-10T17:59:12.702 INFO:tasks.rados.rados.0.smithi012.stdout:843: snap_remove snap 58 2024-09-10T17:59:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[89611]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:59:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[89611]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:59:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[89611]: pgmap v18: 121 pgs: 121 active+clean; 133 MiB data, 874 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[89611]: Upgrade: It appears safe to stop mon.c 2024-09-10T17:59:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[89611]: osdmap e236: 8 total, 8 up, 8 in 2024-09-10T17:59:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[89611]: osdmap e237: 8 total, 8 up, 8 in 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[37454]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[37454]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[37454]: pgmap v18: 121 pgs: 121 active+clean; 133 MiB data, 874 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[37454]: Upgrade: It appears safe to stop mon.c 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[37454]: osdmap e236: 8 total, 8 up, 8 in 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:12 smithi012 ceph-mon[37454]: osdmap e237: 8 total, 8 up, 8 in 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:12 smithi089 ceph-mon[31467]: Updating smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:12 smithi089 ceph-mon[31467]: Updating smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T17:59:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:12 smithi089 ceph-mon[31467]: pgmap v18: 121 pgs: 121 active+clean; 133 MiB data, 874 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:12 smithi089 ceph-mon[31467]: Upgrade: It appears safe to stop mon.c 2024-09-10T17:59:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:12 smithi089 ceph-mon[31467]: osdmap e236: 8 total, 8 up, 8 in 2024-09-10T17:59:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:12 smithi089 ceph-mon[31467]: osdmap e237: 8 total, 8 up, 8 in 2024-09-10T17:59:13.678 INFO:tasks.rados.rados.0.smithi012.stdout:843: done (4 left) 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:844: snap_create 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: finishing write tid 4 to smithi01278544-29 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: finishing write tid 5 to smithi01278544-29 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: finishing write tid 6 to smithi01278544-29 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: oid 29 updating version 0 to 193 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: oid 29 version 193 is already newer than 191 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: oid 29 version 193 is already newer than 192 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: oid 29 updating version 193 to 194 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: oid 29 updating version 194 to 195 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 195 (ObjNum 263 snap 84 seq_num 263) dirty exists 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:838: left oid 29 (ObjNum 263 snap 84 seq_num 263) 2024-09-10T17:59:13.679 INFO:tasks.rados.rados.0.smithi012.stdout:837: expect (ObjNum 255 snap 82 seq_num 255) 2024-09-10T17:59:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:842: finishing copy_from racing read to smithi01278544-43 2024-09-10T17:59:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:842: finishing copy_from to smithi01278544-43 2024-09-10T17:59:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 367 (ObjNum 253 snap 79 seq_num 253) dirty exists 2024-09-10T17:59:14.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:59:13] "GET /metrics HTTP/1.1" 200 33339 "" "Prometheus/2.43.0" 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[89611]: Upgrade: Updating mon.c 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[89611]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[89611]: Deploying daemon mon.c on smithi012 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[89611]: pgmap v21: 121 pgs: 121 active+clean; 151 MiB data, 902 MiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 4.4 MiB/s wr, 33 op/s 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[89611]: osdmap e238: 8 total, 8 up, 8 in 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[37454]: Upgrade: Updating mon.c 2024-09-10T17:59:14.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[37454]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:14.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:59:14.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:59:14.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[37454]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:59:14.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[37454]: Deploying daemon mon.c on smithi012 2024-09-10T17:59:14.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[37454]: pgmap v21: 121 pgs: 121 active+clean; 151 MiB data, 902 MiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 4.4 MiB/s wr, 33 op/s 2024-09-10T17:59:14.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:13 smithi012 ceph-mon[37454]: osdmap e238: 8 total, 8 up, 8 in 2024-09-10T17:59:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:13 smithi089 ceph-mon[31467]: Upgrade: Updating mon.c 2024-09-10T17:59:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:13 smithi089 ceph-mon[31467]: from='mgr.25039 ' entity='mgr.y' 2024-09-10T17:59:14.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:13 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T17:59:14.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:13 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T17:59:14.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:13 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T17:59:14.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:13 smithi089 ceph-mon[31467]: Deploying daemon mon.c on smithi012 2024-09-10T17:59:14.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:13 smithi089 ceph-mon[31467]: pgmap v21: 121 pgs: 121 active+clean; 151 MiB data, 902 MiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 4.4 MiB/s wr, 33 op/s 2024-09-10T17:59:14.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:13 smithi089 ceph-mon[31467]: osdmap e238: 8 total, 8 up, 8 in 2024-09-10T17:59:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:837: done (4 left) 2024-09-10T17:59:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:838: done (3 left) 2024-09-10T17:59:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:839: done (2 left) 2024-09-10T17:59:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:842: done (1 left) 2024-09-10T17:59:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:844: done (0 left) 2024-09-10T17:59:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 85 2024-09-10T17:59:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:845: seq_num 265 ranges {32768=442368,475136=647168,1122304=573440,1695744=385024} 2024-09-10T17:59:14.680 INFO:tasks.rados.rados.0.smithi012.stdout:845: writing smithi01278544-21 from 32768 to 475136 tid 1 2024-09-10T17:59:14.684 INFO:tasks.rados.rados.0.smithi012.stdout:845: writing smithi01278544-21 from 475136 to 1122304 tid 2 2024-09-10T17:59:14.688 INFO:tasks.rados.rados.0.smithi012.stdout:845: writing smithi01278544-21 from 1122304 to 1695744 tid 3 2024-09-10T17:59:14.691 INFO:tasks.rados.rados.0.smithi012.stdout:845: writing smithi01278544-21 from 1695744 to 2080768 tid 4 2024-09-10T17:59:14.692 INFO:tasks.rados.rados.0.smithi012.stdout:846: rollback oid 42 current snap is 85 2024-09-10T17:59:14.692 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 42 to 82 2024-09-10T17:59:14.692 INFO:tasks.rados.rados.0.smithi012.stdout:845: finishing write tid 1 to smithi01278544-21 2024-09-10T17:59:14.692 INFO:tasks.rados.rados.0.smithi012.stdout:845: finishing write tid 2 to smithi01278544-21 2024-09-10T17:59:14.692 INFO:tasks.rados.rados.0.smithi012.stdout:845: finishing write tid 3 to smithi01278544-21 2024-09-10T17:59:14.692 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 85 2024-09-10T17:59:14.692 INFO:tasks.rados.rados.0.smithi012.stdout:847: seq_num 266 ranges {5922816=458752,6381568=524288,6905856=729088,7634944=352256} 2024-09-10T17:59:14.726 INFO:tasks.rados.rados.0.smithi012.stdout:847: writing smithi01278544-47 from 5922816 to 6381568 tid 1 2024-09-10T17:59:14.729 INFO:tasks.rados.rados.0.smithi012.stdout:847: writing smithi01278544-47 from 6381568 to 6905856 tid 2 2024-09-10T17:59:14.734 INFO:tasks.rados.rados.0.smithi012.stdout:847: writing smithi01278544-47 from 6905856 to 7634944 tid 3 2024-09-10T17:59:14.736 INFO:tasks.rados.rados.0.smithi012.stdout:847: writing smithi01278544-47 from 7634944 to 7987200 tid 4 2024-09-10T17:59:14.736 INFO:tasks.rados.rados.0.smithi012.stdout:848: copy_from oid 13 from oid 7 current snap is 85 2024-09-10T17:59:14.736 INFO:tasks.rados.rados.0.smithi012.stdout:845: finishing write tid 4 to smithi01278544-21 2024-09-10T17:59:14.736 INFO:tasks.rados.rados.0.smithi012.stdout:845: finishing write tid 5 to smithi01278544-21 2024-09-10T17:59:14.736 INFO:tasks.rados.rados.0.smithi012.stdout:846: finishing rollback tid 0 to smithi01278544-42 2024-09-10T17:59:14.736 INFO:tasks.rados.rados.0.smithi012.stdout:846: finishing rollback tid 1 to smithi01278544-42 2024-09-10T17:59:14.736 INFO:tasks.rados.rados.0.smithi012.stdout:845: finishing write tid 6 to smithi01278544-21 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:845: oid 21 updating version 0 to 338 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:845: oid 21 updating version 338 to 342 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:845: oid 21 version 342 is already newer than 341 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:845: oid 21 version 342 is already newer than 340 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:845: oid 21 version 342 is already newer than 339 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 342 (ObjNum 265 snap 85 seq_num 265) dirty exists 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:845: left oid 21 (ObjNum 265 snap 85 seq_num 265) 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:846: finishing rollback tid 2 to smithi01278544-42 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 538 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:847: finishing write tid 1 to smithi01278544-47 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:847: finishing write tid 2 to smithi01278544-47 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:845: done (3 left) 2024-09-10T17:59:14.737 INFO:tasks.rados.rados.0.smithi012.stdout:846: done (2 left) 2024-09-10T17:59:14.738 INFO:tasks.rados.rados.0.smithi012.stdout:849: snap_create 2024-09-10T17:59:14.738 INFO:tasks.rados.rados.0.smithi012.stdout:848: finishing copy_from to smithi01278544-13 2024-09-10T17:59:14.738 INFO:tasks.rados.rados.0.smithi012.stdout:848: got expected ENOENT (src dne) 2024-09-10T17:59:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:848: finishing copy_from racing read to smithi01278544-13 2024-09-10T17:59:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:847: finishing write tid 3 to smithi01278544-47 2024-09-10T17:59:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:847: finishing write tid 4 to smithi01278544-47 2024-09-10T17:59:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:847: finishing write tid 5 to smithi01278544-47 2024-09-10T17:59:14.740 INFO:tasks.rados.rados.0.smithi012.stdout:847: finishing write tid 6 to smithi01278544-47 2024-09-10T17:59:14.740 INFO:tasks.rados.rados.0.smithi012.stdout:847: oid 47 updating version 0 to 544 2024-09-10T17:59:14.740 INFO:tasks.rados.rados.0.smithi012.stdout:847: oid 47 version 544 is already newer than 543 2024-09-10T17:59:14.740 INFO:tasks.rados.rados.0.smithi012.stdout:847: oid 47 version 544 is already newer than 542 2024-09-10T17:59:14.740 INFO:tasks.rados.rados.0.smithi012.stdout:847: oid 47 version 544 is already newer than 540 2024-09-10T17:59:14.741 INFO:tasks.rados.rados.0.smithi012.stdout:847: oid 47 version 544 is already newer than 541 2024-09-10T17:59:14.741 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 544 (ObjNum 266 snap 85 seq_num 266) dirty exists 2024-09-10T17:59:14.741 INFO:tasks.rados.rados.0.smithi012.stdout:847: left oid 47 (ObjNum 266 snap 85 seq_num 266) 2024-09-10T17:59:14.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-mon[89611]: mgrmap e42: y(active, since 12s), standbys: x 2024-09-10T17:59:14.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-mon[89611]: osdmap e239: 8 total, 8 up, 8 in 2024-09-10T17:59:14.933 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:14 smithi012 systemd[1]: Stopping Ceph mon.c for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:59:14.933 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-mon[37454]: mgrmap e42: y(active, since 12s), standbys: x 2024-09-10T17:59:14.933 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-mon[37454]: osdmap e239: 8 total, 8 up, 8 in 2024-09-10T17:59:15.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:14 smithi089 ceph-mon[31467]: mgrmap e42: y(active, since 12s), standbys: x 2024-09-10T17:59:15.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:14 smithi089 ceph-mon[31467]: osdmap e239: 8 total, 8 up, 8 in 2024-09-10T17:59:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c[37450]: 2024-09-10T17:59:14.931+0000 7f0e3f34d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T17:59:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c[37450]: 2024-09-10T17:59:14.931+0000 7f0e3f34d640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T17:59:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:15 smithi012 podman[91859]: 2024-09-10 17:59:15.053816841 +0000 UTC m=+0.228902617 container died 2ba771d7bc46af4a446218fe1763223153aff98d08439ee645621fe245a99aa9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T17:59:15.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:14] ENGINE Bus STOPPING 2024-09-10T17:59:15.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:14] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T17:59:15.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:14] ENGINE Bus STOPPED 2024-09-10T17:59:15.285 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:14] ENGINE Bus STARTING 2024-09-10T17:59:15.285 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:15] ENGINE Serving on http://:::9283 2024-09-10T17:59:15.285 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:17:59:15] ENGINE Bus STARTED 2024-09-10T17:59:15.716 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:15 smithi012 podman[91859]: 2024-09-10 17:59:15.497513797 +0000 UTC m=+0.672599560 container cleanup 2ba771d7bc46af4a446218fe1763223153aff98d08439ee645621fe245a99aa9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T17:59:15.716 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:15 smithi012 bash[91859]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c 2024-09-10T17:59:15.987 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:15 smithi012 podman[91882]: 2024-09-10 17:59:15.71537046 +0000 UTC m=+0.659429492 container remove 2ba771d7bc46af4a446218fe1763223153aff98d08439ee645621fe245a99aa9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=reef-7a853b1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T17:59:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:15 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-10T17:59:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:15 smithi012 systemd[1]: Stopped Ceph mon.c for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:59:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:15 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.c.service: Consumed 8.513s CPU time. 2024-09-10T17:59:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 systemd[1]: Starting Ceph mon.c for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:59:16.670 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 podman[92010]: 2024-09-10 17:59:16.302848234 +0000 UTC m=+0.016268240 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T17:59:16.671 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 podman[92010]: 2024-09-10 17:59:16.416234842 +0000 UTC m=+0.129654837 container create 9cece0ad58dabebf6d726086528f3d5146d68b35c16bd211469eed8cb80a46d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T17:59:16.671 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 podman[92010]: 2024-09-10 17:59:16.644016892 +0000 UTC m=+0.357436897 container init 9cece0ad58dabebf6d726086528f3d5146d68b35c16bd211469eed8cb80a46d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T17:59:16.671 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 podman[92010]: 2024-09-10 17:59:16.647547521 +0000 UTC m=+0.360967519 container start 9cece0ad58dabebf6d726086528f3d5146d68b35c16bd211469eed8cb80a46d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T17:59:16.671 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T17:59:16.671 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev), process ceph-mon, pid 2 2024-09-10T17:59:16.671 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: pidfile_write: ignore empty --pid-file 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: load: jerasure load: lrc 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: RocksDB version: 7.9.2 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Git sha 0 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Compile date 2024-09-10 10:24:02 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: DB SUMMARY 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: DB Session ID: 7GX4H8EOGMGP0W9DGDZD 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: CURRENT file: CURRENT 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000027.sst 2024-09-10T17:59:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000025.log size: 10000989 ; 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.error_if_exists: 0 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.create_if_missing: 0 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.paranoid_checks: 1 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.env: 0x561654915120 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.info_log: 0x56165675f700 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.statistics: (nil) 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.use_fsync: 0 2024-09-10T17:59:17.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_log_file_size: 0 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.allow_fallocate: 1 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.use_direct_reads: 0 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.db_log_dir: 2024-09-10T17:59:17.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.wal_dir: 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.write_buffer_manager: 0x561656763b80 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T17:59:17.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.unordered_write: 0 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.row_cache: None 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.wal_filter: None 2024-09-10T17:59:17.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.two_write_queues: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.wal_compression: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.atomic_flush: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T17:59:17.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.log_readahead_size: 0 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_background_jobs: 2 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_background_compactions: -1 2024-09-10T17:59:17.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_subcompactions: 1 2024-09-10T17:59:17.042 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_open_files: -1 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T17:59:17.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_background_flushes: -1 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Compression algorithms supported: 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: kZSTD supported: 0 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: kXpressCompression supported: 0 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: kBZip2Compression supported: 0 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: kLZ4Compression supported: 1 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: kZlibCompression supported: 1 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: kSnappyCompression supported: 1 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 2024-09-10T17:59:17.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.merge_operator: 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_filter: None 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56165675f320) 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout: cache_index_and_filter_blocks: 1 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout: pin_top_level_index_and_filter: 1 2024-09-10T17:59:17.045 INFO:journalctl@ceph.mon.c.smithi012.stdout: index_type: 0 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: data_block_index_type: 0 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: index_shortening: 1 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: checksum: 4 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: no_block_cache: 0 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_cache: 0x561656753610 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_cache_name: BinnedLRUCache 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_cache_options: 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: capacity : 536870912 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: num_shard_bits : 4 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: strict_capacity_limit : 0 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: high_pri_pool_ratio: 0.000 2024-09-10T17:59:17.046 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_cache_compressed: (nil) 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: persistent_cache: (nil) 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_size: 4096 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_size_deviation: 10 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_restart_interval: 16 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: index_block_restart_interval: 1 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: metadata_block_size: 4096 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: partition_filters: 0 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: use_delta_encoding: 1 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: filter_policy: bloomfilter 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: whole_key_filtering: 1 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: verify_compression: 0 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: read_amp_bytes_per_bit: 0 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: format_version: 5 2024-09-10T17:59:17.047 INFO:journalctl@ceph.mon.c.smithi012.stdout: enable_index_compression: 1 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout: block_align: 0 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout: max_auto_readahead_size: 262144 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout: prepopulate_block_cache: 0 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout: initial_auto_readahead_size: 8192 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression: NoCompression 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.num_levels: 7 2024-09-10T17:59:17.048 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T17:59:17.049 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T17:59:17.050 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T17:59:17.051 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T17:59:17.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T17:59:17.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T17:59:17.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T17:59:17.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T17:59:17.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T17:59:17.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T17:59:17.052 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.inplace_update_support: 0 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T17:59:17.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.bloom_locality: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.max_successive_merges: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.ttl: 2592000 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.enable_blob_files: false 2024-09-10T17:59:17.054 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.min_blob_size: 0 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 13370, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5233aa9e-2852-44e0-b47e-67dbde59e0e8 2024-09-10T17:59:17.055 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991156675036, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991156699803, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 6192012, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13375, "largest_seqno": 16080, "table_properties": {"data_size": 6179065, "index_size": 9085, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2821, "raw_key_size": 27110, "raw_average_key_size": 24, "raw_value_size": 6153996, "raw_average_value_size": 5475, "num_data_blocks": 395, "num_entries": 1124, "num_filter_entries": 1124, "num_deletions": 42, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725991156, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5233aa9e-2852-44e0-b47e-67dbde59e0e8", "db_session_id": "7GX4H8EOGMGP0W9DGDZD", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991156699950, "job": 1, "event": "recovery_finished"} 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561656782e00 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: DB pointer 0x561656884000 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout: ** DB Stats ** 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:59:17.056 INFO:journalctl@ceph.mon.c.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: L0 1/0 5.91 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 526.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: L6 1/0 7.52 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: Sum 2/0 13.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 526.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-09-10T17:59:17.057 INFO:journalctl@ceph.mon.c.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 526.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 526.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: Flush(GB): cumulative 0.006, interval 0.006 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T17:59:17.058 INFO:journalctl@ceph.mon.c.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout: Cumulative compaction: 0.01 GB write, 212.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout: Interval compaction: 0.01 GB write, 212.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout: Block cache BinnedLRUCache@0x561656753610#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,3.03 KB,0.000578165%) IndexBlock(1,9.08 KB,0.00173151%) Misc(1,0.00 KB,0%) 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: starting mon.c rank 2 at public addrs [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] at bind addrs [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: mon.c@-1(???) e3 preinit fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: mon.c@-1(???).mds e7 new map 2024-09-10T17:59:17.059 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: mon.c@-1(???).mds e7 print_map 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: e7 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: legacy client fscid: 1 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: Filesystem 'cephfs' (1) 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: fs_name cephfs 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: epoch 7 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: created 2024-09-10T17:52:41.361507+0000 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: modified 2024-09-10T17:52:53.075075+0000 2024-09-10T17:59:17.060 INFO:journalctl@ceph.mon.c.smithi012.stdout: tableserver 0 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: root 0 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: session_timeout 60 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: session_autoclose 300 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: max_file_size 1099511627776 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: max_xattr_size 65536 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: required_client_features {} 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: last_failure 0 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: last_failure_osd_epoch 0 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: max_mds 1 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: in 0 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: up {0=24340} 2024-09-10T17:59:17.061 INFO:journalctl@ceph.mon.c.smithi012.stdout: failed 2024-09-10T17:59:17.062 INFO:journalctl@ceph.mon.c.smithi012.stdout: damaged 2024-09-10T17:59:17.062 INFO:journalctl@ceph.mon.c.smithi012.stdout: stopped 2024-09-10T17:59:17.062 INFO:journalctl@ceph.mon.c.smithi012.stdout: data_pools [3] 2024-09-10T17:59:17.062 INFO:journalctl@ceph.mon.c.smithi012.stdout: metadata_pool 2 2024-09-10T17:59:17.062 INFO:journalctl@ceph.mon.c.smithi012.stdout: inline_data disabled 2024-09-10T17:59:17.062 INFO:journalctl@ceph.mon.c.smithi012.stdout: balancer 2024-09-10T17:59:17.062 INFO:journalctl@ceph.mon.c.smithi012.stdout: bal_rank_mask -1 2024-09-10T17:59:17.062 INFO:journalctl@ceph.mon.c.smithi012.stdout: standby_count_wanted 0 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout: qdb_cluster leader: 0 members: 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout: [mds.b{0:24340} state up:active seq 5 addr [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout: Standby daemons: 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout: 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout: [mds.a{-1:24335} state up:standby seq 1 addr [v2:172.21.15.12:6834/705014602,v1:172.21.15.12:6835/705014602] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: mon.c@-1(???).osd e239 crush map has features 3314933069573799936, adjusting msgr requires 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: mon.c@-1(???).osd e239 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: mon.c@-1(???).osd e239 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: mon.c@-1(???).osd e239 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 ceph-mon[92029]: mon.c@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-09-10T17:59:17.063 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 bash[92010]: 9cece0ad58dabebf6d726086528f3d5146d68b35c16bd211469eed8cb80a46d2 2024-09-10T17:59:17.064 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:16 smithi012 systemd[1]: Started Ceph mon.c for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:59:22.949 INFO:tasks.rados.rados.0.smithi012.stdout:847: done (2 left) 2024-09-10T17:59:22.950 INFO:tasks.rados.rados.0.smithi012.stdout:848: done (1 left) 2024-09-10T17:59:22.950 INFO:tasks.rados.rados.0.smithi012.stdout:849: done (0 left) 2024-09-10T17:59:22.950 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 86 2024-09-10T17:59:22.950 INFO:tasks.rados.rados.0.smithi012.stdout:850: seq_num 267 ranges {0=475136,475136=458752,933888=540672,1474560=606208} 2024-09-10T17:59:22.952 INFO:tasks.rados.rados.0.smithi012.stdout:850: writing smithi01278544-15 from 0 to 475136 tid 1 2024-09-10T17:59:22.955 INFO:tasks.rados.rados.0.smithi012.stdout:850: writing smithi01278544-15 from 475136 to 933888 tid 2 2024-09-10T17:59:22.958 INFO:tasks.rados.rados.0.smithi012.stdout:850: writing smithi01278544-15 from 933888 to 1474560 tid 3 2024-09-10T17:59:22.963 INFO:tasks.rados.rados.0.smithi012.stdout:850: writing smithi01278544-15 from 1474560 to 2080768 tid 4 2024-09-10T17:59:22.963 INFO:tasks.rados.rados.0.smithi012.stdout:851: delete oid 31 current snap is 86 2024-09-10T17:59:22.963 INFO:tasks.rados.rados.0.smithi012.stdout:850: finishing write tid 1 to smithi01278544-15 2024-09-10T17:59:22.963 INFO:tasks.rados.rados.0.smithi012.stdout:850: finishing write tid 2 to smithi01278544-15 2024-09-10T17:59:22.963 INFO:tasks.rados.rados.0.smithi012.stdout:850: finishing write tid 3 to smithi01278544-15 2024-09-10T17:59:22.964 INFO:tasks.rados.rados.0.smithi012.stdout:851: done (1 left) 2024-09-10T17:59:22.965 INFO:tasks.rados.rados.0.smithi012.stdout:852: snap_create 2024-09-10T17:59:22.966 INFO:tasks.rados.rados.0.smithi012.stdout:850: finishing write tid 4 to smithi01278544-15 2024-09-10T17:59:22.967 INFO:tasks.rados.rados.0.smithi012.stdout:850: finishing write tid 5 to smithi01278544-15 2024-09-10T17:59:22.970 INFO:tasks.rados.rados.0.smithi012.stdout:850: finishing write tid 6 to smithi01278544-15 2024-09-10T17:59:22.970 INFO:tasks.rados.rados.0.smithi012.stdout:850: oid 15 updating version 0 to 378 2024-09-10T17:59:22.970 INFO:tasks.rados.rados.0.smithi012.stdout:850: oid 15 updating version 378 to 380 2024-09-10T17:59:22.970 INFO:tasks.rados.rados.0.smithi012.stdout:850: oid 15 version 380 is already newer than 376 2024-09-10T17:59:22.970 INFO:tasks.rados.rados.0.smithi012.stdout:850: oid 15 version 380 is already newer than 377 2024-09-10T17:59:22.970 INFO:tasks.rados.rados.0.smithi012.stdout:850: oid 15 version 380 is already newer than 379 2024-09-10T17:59:22.970 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 380 (ObjNum 267 snap 86 seq_num 267) dirty exists 2024-09-10T17:59:22.970 INFO:tasks.rados.rados.0.smithi012.stdout:850: left oid 15 (ObjNum 267 snap 86 seq_num 267) 2024-09-10T17:59:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: mon.c calling monitor election 2024-09-10T17:59:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: mon.b calling monitor election 2024-09-10T17:59:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: mon.a calling monitor election 2024-09-10T17:59:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: monmap epoch 3 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: last_changed 2024-09-10T17:48:45.134479+0000 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: min_mon_release 18 (reef) 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: election_strategy: 1 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:59:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: osdmap e240: 8 total, 8 up, 8 in 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: mgrmap e42: y(active, since 21s), standbys: x 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[89611]: overall HEALTH_OK 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: mon.c calling monitor election 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: mon.b calling monitor election 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: mon.a calling monitor election 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: monmap epoch 3 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: last_changed 2024-09-10T17:48:45.134479+0000 2024-09-10T17:59:23.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: min_mon_release 18 (reef) 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: election_strategy: 1 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: osdmap e240: 8 total, 8 up, 8 in 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: mgrmap e42: y(active, since 21s), standbys: x 2024-09-10T17:59:23.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:22 smithi012 ceph-mon[92029]: overall HEALTH_OK 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: mon.c calling monitor election 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: mon.b calling monitor election 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: mon.a calling monitor election 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: monmap epoch 3 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: last_changed 2024-09-10T17:48:45.134479+0000 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: min_mon_release 18 (reef) 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: election_strategy: 1 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:59:23.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:59:23.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:59:23.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:59:23.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: osdmap e240: 8 total, 8 up, 8 in 2024-09-10T17:59:23.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: mgrmap e42: y(active, since 21s), standbys: x 2024-09-10T17:59:23.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:22 smithi089 ceph-mon[31467]: overall HEALTH_OK 2024-09-10T17:59:23.963 INFO:tasks.rados.rados.0.smithi012.stdout:850: done (1 left) 2024-09-10T17:59:23.964 INFO:tasks.rados.rados.0.smithi012.stdout:852: done (0 left) 2024-09-10T17:59:23.964 INFO:tasks.rados.rados.0.smithi012.stdout:853: copy_from oid 33 from oid 44 current snap is 87 2024-09-10T17:59:23.964 INFO:tasks.rados.rados.0.smithi012.stdout:854: delete oid 3 current snap is 87 2024-09-10T17:59:23.973 INFO:tasks.rados.rados.0.smithi012.stdout:854: done (1 left) 2024-09-10T17:59:23.973 INFO:tasks.rados.rados.0.smithi012.stdout:855: snap_remove snap 82 2024-09-10T17:59:24.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:23 smithi012 ceph-mon[89611]: osdmap e241: 8 total, 8 up, 8 in 2024-09-10T17:59:24.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:23 smithi012 ceph-mon[89611]: pgmap v30: 121 pgs: 121 active+clean; 163 MiB data, 974 MiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 4 op/s 2024-09-10T17:59:24.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:59:23] "GET /metrics HTTP/1.1" 200 36078 "" "Prometheus/2.43.0" 2024-09-10T17:59:24.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:23 smithi012 ceph-mon[92029]: osdmap e241: 8 total, 8 up, 8 in 2024-09-10T17:59:24.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:23 smithi012 ceph-mon[92029]: pgmap v30: 121 pgs: 121 active+clean; 163 MiB data, 974 MiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 4 op/s 2024-09-10T17:59:24.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:23 smithi089 ceph-mon[31467]: osdmap e241: 8 total, 8 up, 8 in 2024-09-10T17:59:24.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:23 smithi089 ceph-mon[31467]: pgmap v30: 121 pgs: 121 active+clean; 163 MiB data, 974 MiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 4 op/s 2024-09-10T17:59:24.970 INFO:tasks.rados.rados.0.smithi012.stdout:855: done (1 left) 2024-09-10T17:59:24.970 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 87 2024-09-10T17:59:24.971 INFO:tasks.rados.rados.0.smithi012.stdout:853: finishing copy_from racing read to smithi01278544-33 2024-09-10T17:59:24.971 INFO:tasks.rados.rados.0.smithi012.stdout:853: finishing copy_from to smithi01278544-33 2024-09-10T17:59:24.971 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 286 (ObjNum 236 snap 69 seq_num 236) dirty exists 2024-09-10T17:59:24.971 INFO:tasks.rados.rados.0.smithi012.stdout:856: seq_num 270 ranges {2080768=524288,2605056=516096,3121152=761856,3883008=327680} 2024-09-10T17:59:24.985 INFO:tasks.rados.rados.0.smithi012.stdout:856: writing smithi01278544-21 from 2080768 to 2605056 tid 1 2024-09-10T17:59:24.988 INFO:tasks.rados.rados.0.smithi012.stdout:856: writing smithi01278544-21 from 2605056 to 3121152 tid 2 2024-09-10T17:59:24.993 INFO:tasks.rados.rados.0.smithi012.stdout:856: writing smithi01278544-21 from 3121152 to 3883008 tid 3 2024-09-10T17:59:24.995 INFO:tasks.rados.rados.0.smithi012.stdout:856: writing smithi01278544-21 from 3883008 to 4210688 tid 4 2024-09-10T17:59:24.995 INFO:tasks.rados.rados.0.smithi012.stdout:853: done (1 left) 2024-09-10T17:59:24.995 INFO:tasks.rados.rados.0.smithi012.stdout:857: read oid 26 snap -1 2024-09-10T17:59:24.995 INFO:tasks.rados.rados.0.smithi012.stdout:857: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:59:24.996 INFO:tasks.rados.rados.0.smithi012.stdout:858: snap_remove snap 86 2024-09-10T17:59:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:24 smithi012 ceph-mon[89611]: osdmap e242: 8 total, 8 up, 8 in 2024-09-10T17:59:25.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:24 smithi012 ceph-mon[92029]: osdmap e242: 8 total, 8 up, 8 in 2024-09-10T17:59:25.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:24 smithi089 ceph-mon[31467]: osdmap e242: 8 total, 8 up, 8 in 2024-09-10T17:59:25.973 INFO:tasks.rados.rados.0.smithi012.stdout:858: done (2 left) 2024-09-10T17:59:25.973 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 87 2024-09-10T17:59:25.973 INFO:tasks.rados.rados.0.smithi012.stdout:856: finishing write tid 1 to smithi01278544-21 2024-09-10T17:59:25.973 INFO:tasks.rados.rados.0.smithi012.stdout:859: seq_num 271 ranges {1892352=540672,2433024=802816,3235840=516096,3751936=286720} 2024-09-10T17:59:25.986 INFO:tasks.rados.rados.0.smithi012.stdout:859: writing smithi01278544-22 from 1892352 to 2433024 tid 1 2024-09-10T17:59:25.990 INFO:tasks.rados.rados.0.smithi012.stdout:859: writing smithi01278544-22 from 2433024 to 3235840 tid 2 2024-09-10T17:59:25.993 INFO:tasks.rados.rados.0.smithi012.stdout:859: writing smithi01278544-22 from 3235840 to 3751936 tid 3 2024-09-10T17:59:25.995 INFO:tasks.rados.rados.0.smithi012.stdout:859: writing smithi01278544-22 from 3751936 to 4038656 tid 4 2024-09-10T17:59:25.995 INFO:tasks.rados.rados.0.smithi012.stdout:856: finishing write tid 2 to smithi01278544-21 2024-09-10T17:59:25.995 INFO:tasks.rados.rados.0.smithi012.stdout:856: finishing write tid 3 to smithi01278544-21 2024-09-10T17:59:25.995 INFO:tasks.rados.rados.0.smithi012.stdout:856: finishing write tid 4 to smithi01278544-21 2024-09-10T17:59:25.996 INFO:tasks.rados.rados.0.smithi012.stdout:856: finishing write tid 5 to smithi01278544-21 2024-09-10T17:59:25.996 INFO:tasks.rados.rados.0.smithi012.stdout:856: finishing write tid 6 to smithi01278544-21 2024-09-10T17:59:25.996 INFO:tasks.rados.rados.0.smithi012.stdout:856: oid 21 updating version 0 to 350 2024-09-10T17:59:25.996 INFO:tasks.rados.rados.0.smithi012.stdout:856: oid 21 updating version 350 to 351 2024-09-10T17:59:25.996 INFO:tasks.rados.rados.0.smithi012.stdout:856: oid 21 updating version 351 to 353 2024-09-10T17:59:25.996 INFO:tasks.rados.rados.0.smithi012.stdout:856: oid 21 version 353 is already newer than 352 2024-09-10T17:59:25.996 INFO:tasks.rados.rados.0.smithi012.stdout:856: oid 21 updating version 353 to 354 2024-09-10T17:59:25.996 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 354 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-09-10T17:59:25.997 INFO:tasks.rados.rados.0.smithi012.stdout:856: left oid 21 (ObjNum 270 snap 87 seq_num 270) 2024-09-10T17:59:25.997 INFO:tasks.rados.rados.0.smithi012.stdout:857: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:59:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:25 smithi012 ceph-mon[89611]: osdmap e243: 8 total, 8 up, 8 in 2024-09-10T17:59:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:25 smithi012 ceph-mon[89611]: pgmap v33: 121 pgs: 121 active+clean; 163 MiB data, 974 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:25 smithi012 ceph-mon[92029]: osdmap e243: 8 total, 8 up, 8 in 2024-09-10T17:59:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:25 smithi012 ceph-mon[92029]: pgmap v33: 121 pgs: 121 active+clean; 163 MiB data, 974 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:25 smithi089 ceph-mon[31467]: osdmap e243: 8 total, 8 up, 8 in 2024-09-10T17:59:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:25 smithi089 ceph-mon[31467]: pgmap v33: 121 pgs: 121 active+clean; 163 MiB data, 974 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:25 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:25 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:26.377 INFO:tasks.rados.rados.0.smithi012.stdout:859: finishing write tid 1 to smithi01278544-22 2024-09-10T17:59:26.377 INFO:tasks.rados.rados.0.smithi012.stdout:859: finishing write tid 2 to smithi01278544-22 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: finishing write tid 3 to smithi01278544-22 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: finishing write tid 4 to smithi01278544-22 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: finishing write tid 5 to smithi01278544-22 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: finishing write tid 6 to smithi01278544-22 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: oid 22 updating version 0 to 480 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: oid 22 updating version 480 to 482 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: oid 22 version 482 is already newer than 479 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: oid 22 version 482 is already newer than 481 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: oid 22 updating version 482 to 483 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 483 (ObjNum 271 snap 87 seq_num 271) dirty exists 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: left oid 22 (ObjNum 271 snap 87 seq_num 271) 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:856: done (2 left) 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:857: done (1 left) 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:859: done (0 left) 2024-09-10T17:59:26.378 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 87 2024-09-10T17:59:26.379 INFO:tasks.rados.rados.0.smithi012.stdout:860: seq_num 272 ranges {4014080=565248,4579328=688128,5267456=729088,5996544=188416} 2024-09-10T17:59:26.402 INFO:tasks.rados.rados.0.smithi012.stdout:860: writing smithi01278544-11 from 4014080 to 4579328 tid 1 2024-09-10T17:59:26.405 INFO:tasks.rados.rados.0.smithi012.stdout:860: writing smithi01278544-11 from 4579328 to 5267456 tid 2 2024-09-10T17:59:26.409 INFO:tasks.rados.rados.0.smithi012.stdout:860: writing smithi01278544-11 from 5267456 to 5996544 tid 3 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:860: writing smithi01278544-11 from 5996544 to 6184960 tid 4 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:861: rollback oid 25 current snap is 87 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 25 to 80 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:860: finishing write tid 1 to smithi01278544-11 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:862: rollback oid 48 current snap is 87 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 48 to 81 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:860: finishing write tid 2 to smithi01278544-11 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:863: rmattr oid 8 current snap is 87 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:863: done (3 left) 2024-09-10T17:59:26.411 INFO:tasks.rados.rados.0.smithi012.stdout:864: read oid 33 snap -1 2024-09-10T17:59:26.412 INFO:tasks.rados.rados.0.smithi012.stdout:864: expect (ObjNum 236 snap 69 seq_num 236) 2024-09-10T17:59:26.412 INFO:tasks.rados.rados.0.smithi012.stdout:865: snap_create 2024-09-10T17:59:26.414 INFO:tasks.rados.rados.0.smithi012.stdout:862: finishing rollback tid 0 to smithi01278544-48 2024-09-10T17:59:26.416 INFO:tasks.rados.rados.0.smithi012.stdout:862: finishing rollback tid 1 to smithi01278544-48 2024-09-10T17:59:26.416 INFO:tasks.rados.rados.0.smithi012.stdout:862: finishing rollback tid 2 to smithi01278544-48 2024-09-10T17:59:26.416 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 282 (ObjNum 245 snap 72 seq_num 245) dirty exists 2024-09-10T17:59:26.418 INFO:tasks.rados.rados.0.smithi012.stdout:860: finishing write tid 3 to smithi01278544-11 2024-09-10T17:59:26.418 INFO:tasks.rados.rados.0.smithi012.stdout:860: finishing write tid 4 to smithi01278544-11 2024-09-10T17:59:26.418 INFO:tasks.rados.rados.0.smithi012.stdout:860: finishing write tid 5 to smithi01278544-11 2024-09-10T17:59:26.419 INFO:tasks.rados.rados.0.smithi012.stdout:861: finishing rollback tid 0 to smithi01278544-25 2024-09-10T17:59:26.419 INFO:tasks.rados.rados.0.smithi012.stdout:861: finishing rollback tid 1 to smithi01278544-25 2024-09-10T17:59:26.420 INFO:tasks.rados.rados.0.smithi012.stdout:860: finishing write tid 6 to smithi01278544-11 2024-09-10T17:59:26.420 INFO:tasks.rados.rados.0.smithi012.stdout:860: oid 11 updating version 0 to 486 2024-09-10T17:59:26.421 INFO:tasks.rados.rados.0.smithi012.stdout:860: oid 11 updating version 486 to 487 2024-09-10T17:59:26.421 INFO:tasks.rados.rados.0.smithi012.stdout:860: oid 11 version 487 is already newer than 485 2024-09-10T17:59:26.421 INFO:tasks.rados.rados.0.smithi012.stdout:860: oid 11 updating version 487 to 488 2024-09-10T17:59:26.421 INFO:tasks.rados.rados.0.smithi012.stdout:860: oid 11 updating version 488 to 489 2024-09-10T17:59:26.421 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 489 (ObjNum 272 snap 87 seq_num 272) dirty exists 2024-09-10T17:59:26.421 INFO:tasks.rados.rados.0.smithi012.stdout:860: left oid 11 (ObjNum 272 snap 87 seq_num 272) 2024-09-10T17:59:26.421 INFO:tasks.rados.rados.0.smithi012.stdout:861: finishing rollback tid 2 to smithi01278544-25 2024-09-10T17:59:26.421 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 493 (ObjNum 222 snap 66 seq_num 222) dirty exists 2024-09-10T17:59:26.423 INFO:tasks.rados.rados.0.smithi012.stdout:864: expect (ObjNum 236 snap 69 seq_num 236) 2024-09-10T17:59:26.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:26 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:26.711+0000 7f7a9b686640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T17:59:27.051 INFO:tasks.rados.rados.0.smithi012.stdout:860: done (4 left) 2024-09-10T17:59:27.051 INFO:tasks.rados.rados.0.smithi012.stdout:861: done (3 left) 2024-09-10T17:59:27.051 INFO:tasks.rados.rados.0.smithi012.stdout:862: done (2 left) 2024-09-10T17:59:27.051 INFO:tasks.rados.rados.0.smithi012.stdout:864: done (1 left) 2024-09-10T17:59:27.051 INFO:tasks.rados.rados.0.smithi012.stdout:865: done (0 left) 2024-09-10T17:59:27.051 INFO:tasks.rados.rados.0.smithi012.stdout:866: snap_remove snap 83 2024-09-10T17:59:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:26 smithi012 ceph-mon[89611]: osdmap e244: 8 total, 8 up, 8 in 2024-09-10T17:59:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:26 smithi012 ceph-mon[92029]: osdmap e244: 8 total, 8 up, 8 in 2024-09-10T17:59:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:26 smithi089 ceph-mon[31467]: osdmap e244: 8 total, 8 up, 8 in 2024-09-10T17:59:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:26 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:26 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:27.661 INFO:tasks.rados.rados.0.smithi012.stdout:866: done (0 left) 2024-09-10T17:59:27.661 INFO:tasks.rados.rados.0.smithi012.stdout:867: read oid 47 snap -1 2024-09-10T17:59:27.661 INFO:tasks.rados.rados.0.smithi012.stdout:867: expect (ObjNum 266 snap 85 seq_num 266) 2024-09-10T17:59:27.661 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 88 2024-09-10T17:59:27.661 INFO:tasks.rados.rados.0.smithi012.stdout:868: seq_num 273 ranges {2244608=581632,2826240=565248,3391488=532480,3923968=507904} 2024-09-10T17:59:27.673 INFO:tasks.rados.rados.0.smithi012.stdout:868: writing smithi01278544-38 from 2244608 to 2826240 tid 1 2024-09-10T17:59:27.677 INFO:tasks.rados.rados.0.smithi012.stdout:868: writing smithi01278544-38 from 2826240 to 3391488 tid 2 2024-09-10T17:59:27.680 INFO:tasks.rados.rados.0.smithi012.stdout:868: writing smithi01278544-38 from 3391488 to 3923968 tid 3 2024-09-10T17:59:27.683 INFO:tasks.rados.rados.0.smithi012.stdout:868: writing smithi01278544-38 from 3923968 to 4431872 tid 4 2024-09-10T17:59:27.683 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 88 2024-09-10T17:59:27.684 INFO:tasks.rados.rados.0.smithi012.stdout:869: seq_num 274 ranges {0=598016,598016=499712,1097728=745472,1843200=360448} 2024-09-10T17:59:27.687 INFO:tasks.rados.rados.0.smithi012.stdout:869: writing smithi01278544-1 from 0 to 598016 tid 1 2024-09-10T17:59:27.690 INFO:tasks.rados.rados.0.smithi012.stdout:869: writing smithi01278544-1 from 598016 to 1097728 tid 2 2024-09-10T17:59:27.695 INFO:tasks.rados.rados.0.smithi012.stdout:869: writing smithi01278544-1 from 1097728 to 1843200 tid 3 2024-09-10T17:59:27.698 INFO:tasks.rados.rados.0.smithi012.stdout:869: writing smithi01278544-1 from 1843200 to 2203648 tid 4 2024-09-10T17:59:27.698 INFO:tasks.rados.rados.0.smithi012.stdout:868: finishing write tid 1 to smithi01278544-38 2024-09-10T17:59:27.698 INFO:tasks.rados.rados.0.smithi012.stdout:868: finishing write tid 2 to smithi01278544-38 2024-09-10T17:59:27.698 INFO:tasks.rados.rados.0.smithi012.stdout:868: finishing write tid 3 to smithi01278544-38 2024-09-10T17:59:27.698 INFO:tasks.rados.rados.0.smithi012.stdout:868: finishing write tid 4 to smithi01278544-38 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: finishing write tid 5 to smithi01278544-38 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: finishing write tid 6 to smithi01278544-38 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: oid 38 updating version 0 to 289 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: oid 38 version 289 is already newer than 288 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: oid 38 updating version 289 to 290 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: oid 38 version 290 is already newer than 286 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: oid 38 version 290 is already newer than 287 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 290 (ObjNum 273 snap 88 seq_num 273) dirty exists 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: left oid 38 (ObjNum 273 snap 88 seq_num 273) 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:869: finishing write tid 1 to smithi01278544-1 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:869: finishing write tid 2 to smithi01278544-1 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:868: done (2 left) 2024-09-10T17:59:27.699 INFO:tasks.rados.rados.0.smithi012.stdout:870: snap_remove snap 73 2024-09-10T17:59:28.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[89611]: pgmap v35: 121 pgs: 121 active+clean; 169 MiB data, 1006 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 6 op/s 2024-09-10T17:59:28.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[89611]: osdmap e245: 8 total, 8 up, 8 in 2024-09-10T17:59:28.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[89611]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[89611]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[89611]: osdmap e246: 8 total, 8 up, 8 in 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[92029]: pgmap v35: 121 pgs: 121 active+clean; 169 MiB data, 1006 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 6 op/s 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[92029]: osdmap e245: 8 total, 8 up, 8 in 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[92029]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[92029]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:28.154 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T17:59:28.155 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T17:59:28.155 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T17:59:28.155 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:28 smithi012 ceph-mon[92029]: osdmap e246: 8 total, 8 up, 8 in 2024-09-10T17:59:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:28 smithi089 ceph-mon[31467]: pgmap v35: 121 pgs: 121 active+clean; 169 MiB data, 1006 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 6 op/s 2024-09-10T17:59:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:28 smithi089 ceph-mon[31467]: osdmap e245: 8 total, 8 up, 8 in 2024-09-10T17:59:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:28 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-09-10T17:59:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:28 smithi089 ceph-mon[31467]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-09-10T17:59:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:28 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T17:59:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:28 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T17:59:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:28 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T17:59:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:28 smithi089 ceph-mon[31467]: osdmap e246: 8 total, 8 up, 8 in 2024-09-10T17:59:28.658 INFO:tasks.rados.rados.0.smithi012.stdout:870: done (2 left) 2024-09-10T17:59:28.659 INFO:tasks.rados.rados.0.smithi012.stdout:871: rmattr oid 24 current snap is 88 2024-09-10T17:59:28.659 INFO:tasks.rados.rados.0.smithi012.stdout:867: expect (ObjNum 266 snap 85 seq_num 266) 2024-09-10T17:59:29.102 INFO:tasks.rados.rados.0.smithi012.stdout:869: finishing write tid 3 to smithi01278544-1 2024-09-10T17:59:29.102 INFO:tasks.rados.rados.0.smithi012.stdout:869: finishing write tid 4 to smithi01278544-1 2024-09-10T17:59:29.102 INFO:tasks.rados.rados.0.smithi012.stdout:867: done (2 left) 2024-09-10T17:59:29.102 INFO:tasks.rados.rados.0.smithi012.stdout:871: done (1 left) 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:872: setattr oid 17 current snap is 88 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: finishing write tid 5 to smithi01278544-1 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: finishing write tid 6 to smithi01278544-1 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: oid 1 updating version 0 to 295 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: oid 1 version 295 is already newer than 294 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: oid 1 version 295 is already newer than 291 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: oid 1 version 295 is already newer than 292 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: oid 1 version 295 is already newer than 293 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 295 (ObjNum 274 snap 88 seq_num 274) dirty exists 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: left oid 1 (ObjNum 274 snap 88 seq_num 274) 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:869: done (1 left) 2024-09-10T17:59:29.103 INFO:tasks.rados.rados.0.smithi012.stdout:873: snap_remove snap 77 2024-09-10T17:59:29.662 INFO:tasks.rados.rados.0.smithi012.stdout:873: done (1 left) 2024-09-10T17:59:29.662 INFO:tasks.rados.rados.0.smithi012.stdout:874: rollback oid 16 current snap is 88 2024-09-10T17:59:29.663 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 85 2024-09-10T17:59:29.663 INFO:tasks.rados.rados.0.smithi012.stdout:875: snap_remove snap 80 2024-09-10T17:59:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: osdmap e247: 8 total, 8 up, 8 in 2024-09-10T17:59:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "quorum_status"} : dispatch 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon ok-to-stop", "ids": ["b"]} : dispatch 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: osdmap e247: 8 total, 8 up, 8 in 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T17:59:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T17:59:29.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T17:59:29.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "quorum_status"} : dispatch 2024-09-10T17:59:29.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon ok-to-stop", "ids": ["b"]} : dispatch 2024-09-10T17:59:29.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: osdmap e247: 8 total, 8 up, 8 in 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "quorum_status"} : dispatch 2024-09-10T17:59:29.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:29 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon ok-to-stop", "ids": ["b"]} : dispatch 2024-09-10T17:59:30.664 INFO:tasks.rados.rados.0.smithi012.stdout:875: done (2 left) 2024-09-10T17:59:30.665 INFO:tasks.rados.rados.0.smithi012.stdout:876: read oid 28 snap -1 2024-09-10T17:59:30.665 INFO:tasks.rados.rados.0.smithi012.stdout:876: expect (ObjNum 224 snap 67 seq_num 224) 2024-09-10T17:59:30.665 INFO:tasks.rados.rados.0.smithi012.stdout:877: copy_from oid 15 from oid 9 current snap is 88 2024-09-10T17:59:30.665 INFO:tasks.rados.rados.0.smithi012.stdout:878: snap_remove snap 56 2024-09-10T17:59:30.961 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:30 smithi089 ceph-mon[31467]: pgmap v39: 121 pgs: 121 active+clean; 175 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-09-10T17:59:30.962 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:30 smithi089 ceph-mon[31467]: Upgrade: It appears safe to stop mon.b 2024-09-10T17:59:30.962 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:30 smithi089 ceph-mon[31467]: osdmap e248: 8 total, 8 up, 8 in 2024-09-10T17:59:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:30 smithi012 ceph-mon[89611]: pgmap v39: 121 pgs: 121 active+clean; 175 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-09-10T17:59:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:30 smithi012 ceph-mon[89611]: Upgrade: It appears safe to stop mon.b 2024-09-10T17:59:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:30 smithi012 ceph-mon[89611]: osdmap e248: 8 total, 8 up, 8 in 2024-09-10T17:59:31.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:30 smithi012 ceph-mon[92029]: pgmap v39: 121 pgs: 121 active+clean; 175 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-09-10T17:59:31.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:30 smithi012 ceph-mon[92029]: Upgrade: It appears safe to stop mon.b 2024-09-10T17:59:31.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:30 smithi012 ceph-mon[92029]: osdmap e248: 8 total, 8 up, 8 in 2024-09-10T17:59:31.666 INFO:tasks.rados.rados.0.smithi012.stdout:878: done (4 left) 2024-09-10T17:59:31.666 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 88 2024-09-10T17:59:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:879: seq_num 275 ranges {2318336=614400,2932736=786432,3719168=499712,4218880=319488} 2024-09-10T17:59:31.684 INFO:tasks.rados.rados.0.smithi012.stdout:879: writing smithi01278544-46 from 2318336 to 2932736 tid 1 2024-09-10T17:59:31.689 INFO:tasks.rados.rados.0.smithi012.stdout:879: writing smithi01278544-46 from 2932736 to 3719168 tid 2 2024-09-10T17:59:31.692 INFO:tasks.rados.rados.0.smithi012.stdout:879: writing smithi01278544-46 from 3719168 to 4218880 tid 3 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:879: writing smithi01278544-46 from 4218880 to 4538368 tid 4 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:880: delete oid 11 current snap is 88 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 352 (ObjNum 98 snap 18 seq_num 98) dirty exists 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:874: finishing rollback tid 0 to smithi01278544-16 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:874: finishing rollback tid 1 to smithi01278544-16 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:874: finishing rollback tid 2 to smithi01278544-16 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 285 (ObjNum 226 snap 67 seq_num 226) dirty exists 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:877: finishing copy_from to smithi01278544-15 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:877: got expected ENOENT (src dne) 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:877: finishing copy_from racing read to smithi01278544-15 2024-09-10T17:59:31.696 INFO:tasks.rados.rados.0.smithi012.stdout:876: expect (ObjNum 224 snap 67 seq_num 224) 2024-09-10T17:59:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:879: finishing write tid 1 to smithi01278544-46 2024-09-10T17:59:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:879: finishing write tid 2 to smithi01278544-46 2024-09-10T17:59:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:879: finishing write tid 3 to smithi01278544-46 2024-09-10T17:59:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:879: finishing write tid 4 to smithi01278544-46 2024-09-10T17:59:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:879: finishing write tid 5 to smithi01278544-46 2024-09-10T17:59:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:879: finishing write tid 6 to smithi01278544-46 2024-09-10T17:59:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:879: oid 46 updating version 0 to 319 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:879: oid 46 version 319 is already newer than 318 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:879: oid 46 version 319 is already newer than 317 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:879: oid 46 updating version 319 to 320 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:879: oid 46 updating version 320 to 321 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 321 (ObjNum 275 snap 88 seq_num 275) dirty exists 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:879: left oid 46 (ObjNum 275 snap 88 seq_num 275) 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:872: done (5 left) 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:874: done (4 left) 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:876: done (3 left) 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:877: done (2 left) 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:879: done (1 left) 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:880: done (0 left) 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 88 2024-09-10T17:59:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:881: seq_num 277 ranges {2924544=647168,3571712=557056,4128768=516096,4644864=532480} 2024-09-10T17:59:31.980 INFO:tasks.rados.rados.0.smithi012.stdout:881: writing smithi01278544-41 from 2924544 to 3571712 tid 1 2024-09-10T17:59:31.983 INFO:tasks.rados.rados.0.smithi012.stdout:881: writing smithi01278544-41 from 3571712 to 4128768 tid 2 2024-09-10T17:59:31.986 INFO:tasks.rados.rados.0.smithi012.stdout:881: writing smithi01278544-41 from 4128768 to 4644864 tid 3 2024-09-10T17:59:31.990 INFO:tasks.rados.rados.0.smithi012.stdout:881: writing smithi01278544-41 from 4644864 to 5177344 tid 4 2024-09-10T17:59:31.990 INFO:tasks.rados.rados.0.smithi012.stdout:882: rollback oid 47 current snap is 88 2024-09-10T17:59:31.990 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 76 2024-09-10T17:59:31.990 INFO:tasks.rados.rados.0.smithi012.stdout:881: finishing write tid 1 to smithi01278544-41 2024-09-10T17:59:31.990 INFO:tasks.rados.rados.0.smithi012.stdout:881: finishing write tid 2 to smithi01278544-41 2024-09-10T17:59:31.990 INFO:tasks.rados.rados.0.smithi012.stdout:881: finishing write tid 3 to smithi01278544-41 2024-09-10T17:59:31.990 INFO:tasks.rados.rados.0.smithi012.stdout:883: snap_create 2024-09-10T17:59:31.993 INFO:tasks.rados.rados.0.smithi012.stdout:881: finishing write tid 4 to smithi01278544-41 2024-09-10T17:59:31.993 INFO:tasks.rados.rados.0.smithi012.stdout:881: finishing write tid 5 to smithi01278544-41 2024-09-10T17:59:31.994 INFO:tasks.rados.rados.0.smithi012.stdout:882: finishing rollback tid 0 to smithi01278544-47 2024-09-10T17:59:31.995 INFO:tasks.rados.rados.0.smithi012.stdout:882: finishing rollback tid 1 to smithi01278544-47 2024-09-10T17:59:31.995 INFO:tasks.rados.rados.0.smithi012.stdout:882: finishing rollback tid 2 to smithi01278544-47 2024-09-10T17:59:31.995 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 597 (ObjNum 244 snap 72 seq_num 244) dirty exists 2024-09-10T17:59:31.996 INFO:tasks.rados.rados.0.smithi012.stdout:881: finishing write tid 6 to smithi01278544-41 2024-09-10T17:59:31.996 INFO:tasks.rados.rados.0.smithi012.stdout:881: oid 41 updating version 0 to 362 2024-09-10T17:59:31.996 INFO:tasks.rados.rados.0.smithi012.stdout:881: oid 41 updating version 362 to 363 2024-09-10T17:59:31.996 INFO:tasks.rados.rados.0.smithi012.stdout:881: oid 41 updating version 363 to 364 2024-09-10T17:59:31.996 INFO:tasks.rados.rados.0.smithi012.stdout:881: oid 41 updating version 364 to 365 2024-09-10T17:59:31.996 INFO:tasks.rados.rados.0.smithi012.stdout:881: oid 41 version 365 is already newer than 361 2024-09-10T17:59:31.996 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 365 (ObjNum 277 snap 88 seq_num 277) dirty exists 2024-09-10T17:59:31.996 INFO:tasks.rados.rados.0.smithi012.stdout:881: left oid 41 (ObjNum 277 snap 88 seq_num 277) 2024-09-10T17:59:32.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:31 smithi089 ceph-mon[31467]: osdmap e249: 8 total, 8 up, 8 in 2024-09-10T17:59:32.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:31 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:32.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:31 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:32.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:31 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:32.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:31 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:32.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:31 smithi089 ceph-mon[31467]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T17:59:32.020 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:31 smithi089 ceph-mon[31467]: osdmap e250: 8 total, 8 up, 8 in 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[89611]: osdmap e249: 8 total, 8 up, 8 in 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[89611]: osdmap e250: 8 total, 8 up, 8 in 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[92029]: osdmap e249: 8 total, 8 up, 8 in 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T17:59:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:31 smithi012 ceph-mon[92029]: osdmap e250: 8 total, 8 up, 8 in 2024-09-10T17:59:32.698 INFO:tasks.rados.rados.0.smithi012.stdout:881: done (2 left) 2024-09-10T17:59:32.698 INFO:tasks.rados.rados.0.smithi012.stdout:882: done (1 left) 2024-09-10T17:59:32.698 INFO:tasks.rados.rados.0.smithi012.stdout:883: done (0 left) 2024-09-10T17:59:32.698 INFO:tasks.rados.rados.0.smithi012.stdout:884: rmattr oid 32 current snap is 89 2024-09-10T17:59:32.698 INFO:tasks.rados.rados.0.smithi012.stdout:884: done (0 left) 2024-09-10T17:59:32.699 INFO:tasks.rados.rados.0.smithi012.stdout:885: read oid 50 snap -1 2024-09-10T17:59:32.699 INFO:tasks.rados.rados.0.smithi012.stdout:885: expect deleted 2024-09-10T17:59:32.699 INFO:tasks.rados.rados.0.smithi012.stdout:886: rollback oid 48 current snap is 89 2024-09-10T17:59:32.699 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 48 to 78 2024-09-10T17:59:32.699 INFO:tasks.rados.rados.0.smithi012.stdout:887: delete oid 5 current snap is 89 2024-09-10T17:59:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:885: done (2 left) 2024-09-10T17:59:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:887: done (1 left) 2024-09-10T17:59:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:888: delete oid 45 current snap is 89 2024-09-10T17:59:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:886: finishing rollback tid 0 to smithi01278544-48 2024-09-10T17:59:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:886: finishing rollback tid 1 to smithi01278544-48 2024-09-10T17:59:32.705 INFO:tasks.rados.rados.0.smithi012.stdout:886: finishing rollback tid 2 to smithi01278544-48 2024-09-10T17:59:32.705 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 319 (ObjNum 245 snap 72 seq_num 245) dirty exists 2024-09-10T17:59:32.707 INFO:tasks.rados.rados.0.smithi012.stdout:886: done (1 left) 2024-09-10T17:59:32.707 INFO:tasks.rados.rados.0.smithi012.stdout:888: done (0 left) 2024-09-10T17:59:32.707 INFO:tasks.rados.rados.0.smithi012.stdout:889: copy_from oid 25 from oid 31 current snap is 89 2024-09-10T17:59:32.707 INFO:tasks.rados.rados.0.smithi012.stdout:890: read oid 49 snap 81 2024-09-10T17:59:32.707 INFO:tasks.rados.rados.0.smithi012.stdout:890: expect deleted 2024-09-10T17:59:32.707 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 89 2024-09-10T17:59:32.707 INFO:tasks.rados.rados.0.smithi012.stdout:891: seq_num 280 ranges {0=696320,696320=606208,1302528=688128,1990656=311296} 2024-09-10T17:59:32.711 INFO:tasks.rados.rados.0.smithi012.stdout:891: writing smithi01278544-23 from 0 to 696320 tid 1 2024-09-10T17:59:32.714 INFO:tasks.rados.rados.0.smithi012.stdout:891: writing smithi01278544-23 from 696320 to 1302528 tid 2 2024-09-10T17:59:32.718 INFO:tasks.rados.rados.0.smithi012.stdout:891: writing smithi01278544-23 from 1302528 to 1990656 tid 3 2024-09-10T17:59:32.720 INFO:tasks.rados.rados.0.smithi012.stdout:891: writing smithi01278544-23 from 1990656 to 2301952 tid 4 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:892: copy_from oid 32 from oid 42 current snap is 89 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:889: finishing copy_from to smithi01278544-25 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:889: got expected ENOENT (src dne) 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:889: finishing copy_from racing read to smithi01278544-25 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:891: finishing write tid 1 to smithi01278544-23 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:891: finishing write tid 2 to smithi01278544-23 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:889: done (3 left) 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:890: done (2 left) 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 89 2024-09-10T17:59:32.721 INFO:tasks.rados.rados.0.smithi012.stdout:893: seq_num 281 ranges {3547136=712704,4259840=491520,4751360=491520,5242880=622592} 2024-09-10T17:59:32.744 INFO:tasks.rados.rados.0.smithi012.stdout:893: writing smithi01278544-10 from 3547136 to 4259840 tid 1 2024-09-10T17:59:32.747 INFO:tasks.rados.rados.0.smithi012.stdout:893: writing smithi01278544-10 from 4259840 to 4751360 tid 2 2024-09-10T17:59:32.749 INFO:tasks.rados.rados.0.smithi012.stdout:893: writing smithi01278544-10 from 4751360 to 5242880 tid 3 2024-09-10T17:59:32.753 INFO:tasks.rados.rados.0.smithi012.stdout:893: writing smithi01278544-10 from 5242880 to 5865472 tid 4 2024-09-10T17:59:32.753 INFO:tasks.rados.rados.0.smithi012.stdout:894: read oid 13 snap 75 2024-09-10T17:59:32.753 INFO:tasks.rados.rados.0.smithi012.stdout:894: expect (ObjNum 247 snap 73 seq_num 247) 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:895: read oid 8 snap -1 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:895: expect deleted 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:896: read oid 1 snap 88 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:896: expect (ObjNum 274 snap 88 seq_num 274) 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:897: snap_create 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:891: finishing write tid 3 to smithi01278544-23 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:891: finishing write tid 4 to smithi01278544-23 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:891: finishing write tid 5 to smithi01278544-23 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:891: finishing write tid 6 to smithi01278544-23 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:891: oid 23 updating version 0 to 389 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:891: oid 23 version 389 is already newer than 385 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:891: oid 23 version 389 is already newer than 387 2024-09-10T17:59:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:891: oid 23 version 389 is already newer than 386 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:891: oid 23 version 389 is already newer than 388 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 389 (ObjNum 280 snap 89 seq_num 280) dirty exists 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:891: left oid 23 (ObjNum 280 snap 89 seq_num 280) 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:892: finishing copy_from racing read to smithi01278544-32 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:892: finishing copy_from to smithi01278544-32 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 538 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:893: finishing write tid 1 to smithi01278544-10 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:893: finishing write tid 2 to smithi01278544-10 2024-09-10T17:59:32.755 INFO:tasks.rados.rados.0.smithi012.stdout:893: finishing write tid 3 to smithi01278544-10 2024-09-10T17:59:32.757 INFO:tasks.rados.rados.0.smithi012.stdout:893: finishing write tid 4 to smithi01278544-10 2024-09-10T17:59:32.757 INFO:tasks.rados.rados.0.smithi012.stdout:893: finishing write tid 5 to smithi01278544-10 2024-09-10T17:59:32.758 INFO:tasks.rados.rados.0.smithi012.stdout:893: finishing write tid 6 to smithi01278544-10 2024-09-10T17:59:32.758 INFO:tasks.rados.rados.0.smithi012.stdout:893: oid 10 updating version 0 to 551 2024-09-10T17:59:32.758 INFO:tasks.rados.rados.0.smithi012.stdout:893: oid 10 version 551 is already newer than 548 2024-09-10T17:59:32.759 INFO:tasks.rados.rados.0.smithi012.stdout:893: oid 10 version 551 is already newer than 550 2024-09-10T17:59:32.759 INFO:tasks.rados.rados.0.smithi012.stdout:893: oid 10 version 551 is already newer than 549 2024-09-10T17:59:32.759 INFO:tasks.rados.rados.0.smithi012.stdout:893: oid 10 version 551 is already newer than 547 2024-09-10T17:59:32.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 551 (ObjNum 281 snap 89 seq_num 281) dirty exists 2024-09-10T17:59:32.759 INFO:tasks.rados.rados.0.smithi012.stdout:893: left oid 10 (ObjNum 281 snap 89 seq_num 281) 2024-09-10T17:59:32.762 INFO:tasks.rados.rados.0.smithi012.stdout:896: expect (ObjNum 274 snap 88 seq_num 274) 2024-09-10T17:59:32.822 INFO:tasks.rados.rados.0.smithi012.stdout:894: expect (ObjNum 247 snap 73 seq_num 247) 2024-09-10T17:59:32.849 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:32 smithi089 systemd[1]: Stopping Ceph mon.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:59:32.849 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:32 smithi089 ceph-mon[31467]: pgmap v42: 121 pgs: 121 active+clean; 175 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:32.850 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:32 smithi089 ceph-mon[31467]: Upgrade: Updating mon.b 2024-09-10T17:59:32.850 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:32 smithi089 ceph-mon[31467]: Deploying daemon mon.b on smithi089 2024-09-10T17:59:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:32 smithi012 ceph-mon[89611]: pgmap v42: 121 pgs: 121 active+clean; 175 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:32 smithi012 ceph-mon[89611]: Upgrade: Updating mon.b 2024-09-10T17:59:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:32 smithi012 ceph-mon[89611]: Deploying daemon mon.b on smithi089 2024-09-10T17:59:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:32 smithi012 ceph-mon[92029]: pgmap v42: 121 pgs: 121 active+clean; 175 MiB data, 1010 MiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:32 smithi012 ceph-mon[92029]: Upgrade: Updating mon.b 2024-09-10T17:59:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:32 smithi012 ceph-mon[92029]: Deploying daemon mon.b on smithi089 2024-09-10T17:59:33.191 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b[31442]: 2024-09-10T17:59:32.847+0000 7fb992643640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T17:59:33.191 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b[31442]: 2024-09-10T17:59:32.847+0000 7fb992643640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T17:59:33.191 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:32 smithi089 podman[83969]: 2024-09-10 17:59:32.909425305 +0000 UTC m=+0.169702702 container died bddaa233c388b8ab15492a58e458aa6cb069ea36804126b49fa8d54cf50078a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=reef-7a853b1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T17:59:33.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:33 smithi089 podman[83969]: 2024-09-10 17:59:33.297505569 +0000 UTC m=+0.557782966 container cleanup bddaa233c388b8ab15492a58e458aa6cb069ea36804126b49fa8d54cf50078a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T17:59:33.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:33 smithi089 bash[83969]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b 2024-09-10T17:59:33.918 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:33 smithi089 podman[83981]: 2024-09-10 17:59:33.573915516 +0000 UTC m=+0.657744925 container remove bddaa233c388b8ab15492a58e458aa6cb069ea36804126b49fa8d54cf50078a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T17:59:33.918 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:33 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-10T17:59:33.918 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:33 smithi089 systemd[1]: Stopped Ceph mon.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:59:33.918 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:33 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.b.service: Consumed 8.800s CPU time. 2024-09-10T17:59:34.274 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:33 smithi089 systemd[1]: Starting Ceph mon.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T17:59:34.274 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 podman[84113]: 2024-09-10 17:59:34.030332051 +0000 UTC m=+0.016569800 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T17:59:34.274 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 podman[84113]: 2024-09-10 17:59:34.141602003 +0000 UTC m=+0.127839738 container create 9c846e5fd93fb49b319b6577e0d7cab16aec988a122b08c4bae45433ff44c63d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T17:59:34.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:59:33] "GET /metrics HTTP/1.1" 200 36086 "" "Prometheus/2.43.0" 2024-09-10T17:59:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 podman[84113]: 2024-09-10 17:59:34.40282846 +0000 UTC m=+0.389066195 container init 9c846e5fd93fb49b319b6577e0d7cab16aec988a122b08c4bae45433ff44c63d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T17:59:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 podman[84113]: 2024-09-10 17:59:34.406106094 +0000 UTC m=+0.392343830 container start 9c846e5fd93fb49b319b6577e0d7cab16aec988a122b08c4bae45433ff44c63d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T17:59:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T17:59:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev), process ceph-mon, pid 2 2024-09-10T17:59:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: pidfile_write: ignore empty --pid-file 2024-09-10T17:59:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: load: jerasure load: lrc 2024-09-10T17:59:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: RocksDB version: 7.9.2 2024-09-10T17:59:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Git sha 0 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Compile date 2024-09-10 10:24:02 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: DB SUMMARY 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: DB Session ID: B2CP6FTM0H0DDST0VFW0 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: CURRENT file: CURRENT 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000027.sst 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000025.log size: 10877129 ; 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.error_if_exists: 0 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.create_if_missing: 0 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.paranoid_checks: 1 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T17:59:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T17:59:34.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T17:59:34.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.env: 0x560ca4db8120 2024-09-10T17:59:34.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T17:59:34.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.info_log: 0x560ca6311700 2024-09-10T17:59:34.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T17:59:34.789 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.statistics: (nil) 2024-09-10T17:59:34.789 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.use_fsync: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_log_file_size: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.allow_fallocate: 1 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.use_direct_reads: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T17:59:34.790 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.db_log_dir: 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.wal_dir: 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.write_buffer_manager: 0x560ca6315b80 2024-09-10T17:59:34.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.unordered_write: 0 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T17:59:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.row_cache: None 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.wal_filter: None 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.two_write_queues: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.wal_compression: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.atomic_flush: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.log_readahead_size: 0 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T17:59:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_background_jobs: 2 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_background_compactions: -1 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_subcompactions: 1 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T17:59:34.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_open_files: -1 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_background_flushes: -1 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Compression algorithms supported: 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: kZSTD supported: 0 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: kXpressCompression supported: 0 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: kBZip2Compression supported: 0 2024-09-10T17:59:34.795 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: kLZ4Compression supported: 1 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: kZlibCompression supported: 1 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: kSnappyCompression supported: 1 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.merge_operator: 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_filter: None 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T17:59:34.796 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560ca6311320) 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_type: 0 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: data_block_index_type: 0 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_shortening: 1 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: checksum: 4 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: no_block_cache: 0 2024-09-10T17:59:34.797 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache: 0x560ca6305610 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_options: 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: capacity : 536870912 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: num_shard_bits : 4 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: strict_capacity_limit : 0 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_compressed: (nil) 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: persistent_cache: (nil) 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_size: 4096 2024-09-10T17:59:34.798 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_size_deviation: 10 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_restart_interval: 16 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_block_restart_interval: 1 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: metadata_block_size: 4096 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: partition_filters: 0 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: use_delta_encoding: 1 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: filter_policy: bloomfilter 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: whole_key_filtering: 1 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: verify_compression: 0 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-09-10T17:59:34.799 INFO:journalctl@ceph.mon.b.smithi089.stdout: format_version: 5 2024-09-10T17:59:34.800 INFO:journalctl@ceph.mon.b.smithi089.stdout: enable_index_compression: 1 2024-09-10T17:59:34.800 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_align: 0 2024-09-10T17:59:34.800 INFO:journalctl@ceph.mon.b.smithi089.stdout: max_auto_readahead_size: 262144 2024-09-10T17:59:34.800 INFO:journalctl@ceph.mon.b.smithi089.stdout: prepopulate_block_cache: 0 2024-09-10T17:59:34.800 INFO:journalctl@ceph.mon.b.smithi089.stdout: initial_auto_readahead_size: 8192 2024-09-10T17:59:34.800 INFO:journalctl@ceph.mon.b.smithi089.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T17:59:34.800 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T17:59:34.800 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression: NoCompression 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.num_levels: 7 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T17:59:34.801 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T17:59:34.802 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T17:59:34.803 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T17:59:34.804 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T17:59:34.805 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.inplace_update_support: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.bloom_locality: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.max_successive_merges: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.ttl: 2592000 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T17:59:34.806 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.enable_blob_files: false 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.min_blob_size: 0 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T17:59:34.807 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 13450, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 86d359c5-09cb-471f-991f-6a5b3482ab8d 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991174432552, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991174458546, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 6706403, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13455, "largest_seqno": 16832, "table_properties": {"data_size": 6691128, "index_size": 10388, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3845, "raw_key_size": 34949, "raw_average_key_size": 22, "raw_value_size": 6659386, "raw_average_value_size": 4358, "num_data_blocks": 452, "num_entries": 1528, "num_filter_entries": 1528, "num_deletions": 295, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725991174, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "86d359c5-09cb-471f-991f-6a5b3482ab8d", "db_session_id": "B2CP6FTM0H0DDST0VFW0", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725991174458647, "job": 1, "event": "recovery_finished"} 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-10T17:59:34.808 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560ca6334e00 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: DB pointer 0x560ca6436000 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** DB Stats ** 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:59:34.809 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: L0 1/0 6.40 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 538.2 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: L6 1/0 7.52 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: Sum 2/0 13.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 538.2 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 538.2 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-09-10T17:59:34.810 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 538.2 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: Flush(GB): cumulative 0.006, interval 0.006 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T17:59:34.811 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative compaction: 0.01 GB write, 221.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval compaction: 0.01 GB write, 221.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout: Block cache BinnedLRUCache@0x560ca6305610#2 capacity: 512.00 MB usage: 16.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,12.08 KB,0.00230372%) Misc(1,0.00 KB,0%) 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: starting mon.b rank 1 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: mon.b@-1(???) e3 preinit fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: mon.b@-1(???).mds e7 new map 2024-09-10T17:59:34.812 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: mon.b@-1(???).mds e7 print_map 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: e7 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: legacy client fscid: 1 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: Filesystem 'cephfs' (1) 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: fs_name cephfs 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: epoch 7 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: created 2024-09-10T17:52:41.361507+0000 2024-09-10T17:59:34.813 INFO:journalctl@ceph.mon.b.smithi089.stdout: modified 2024-09-10T17:52:53.075075+0000 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: tableserver 0 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: root 0 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: session_timeout 60 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: session_autoclose 300 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: max_file_size 1099511627776 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: max_xattr_size 65536 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: required_client_features {} 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: last_failure 0 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: last_failure_osd_epoch 0 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: max_mds 1 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: in 0 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: up {0=24340} 2024-09-10T17:59:34.814 INFO:journalctl@ceph.mon.b.smithi089.stdout: failed 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: damaged 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: stopped 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: data_pools [3] 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: metadata_pool 2 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: inline_data disabled 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: balancer 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: bal_rank_mask -1 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: standby_count_wanted 0 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: qdb_cluster leader: 0 members: 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: [mds.b{0:24340} state up:active seq 5 addr [v2:172.21.15.89:6832/3197689939,v1:172.21.15.89:6833/3197689939] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: Standby daemons: 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-10T17:59:34.815 INFO:journalctl@ceph.mon.b.smithi089.stdout: [mds.a{-1:24335} state up:standby seq 1 addr [v2:172.21.15.12:6834/705014602,v1:172.21.15.12:6835/705014602] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T17:59:34.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: mon.b@-1(???).osd e251 crush map has features 3314933069573799936, adjusting msgr requires 2024-09-10T17:59:34.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: mon.b@-1(???).osd e251 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:59:34.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: mon.b@-1(???).osd e251 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:59:34.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: mon.b@-1(???).osd e251 crush map has features 432629308056666112, adjusting msgr requires 2024-09-10T17:59:34.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 ceph-mon[84132]: mon.b@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-10T17:59:34.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 bash[84113]: 9c846e5fd93fb49b319b6577e0d7cab16aec988a122b08c4bae45433ff44c63d 2024-09-10T17:59:34.816 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:34 smithi089 systemd[1]: Started Ceph mon.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T17:59:36.105 INFO:tasks.rados.rados.0.smithi012.stdout:891: done (6 left) 2024-09-10T17:59:36.105 INFO:tasks.rados.rados.0.smithi012.stdout:892: done (5 left) 2024-09-10T17:59:36.105 INFO:tasks.rados.rados.0.smithi012.stdout:893: done (4 left) 2024-09-10T17:59:36.105 INFO:tasks.rados.rados.0.smithi012.stdout:894: done (3 left) 2024-09-10T17:59:36.105 INFO:tasks.rados.rados.0.smithi012.stdout:895: done (2 left) 2024-09-10T17:59:36.105 INFO:tasks.rados.rados.0.smithi012.stdout:896: done (1 left) 2024-09-10T17:59:36.105 INFO:tasks.rados.rados.0.smithi012.stdout:897: done (0 left) 2024-09-10T17:59:36.106 INFO:tasks.rados.rados.0.smithi012.stdout:898: read oid 3 snap -1 2024-09-10T17:59:36.106 INFO:tasks.rados.rados.0.smithi012.stdout:898: expect deleted 2024-09-10T17:59:36.106 INFO:tasks.rados.rados.0.smithi012.stdout:899: copy_from oid 50 from oid 8 current snap is 90 2024-09-10T17:59:36.106 INFO:tasks.rados.rados.0.smithi012.stdout:900: snap_remove snap 76 2024-09-10T17:59:36.460 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: pgmap v46: 121 pgs: 121 active+clean; 174 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-10T17:59:36.460 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: mon.a calling monitor election 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: mon.b calling monitor election 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: mon.c calling monitor election 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: monmap epoch 4 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: last_changed 2024-09-10T17:59:35.091858+0000 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: min_mon_release 19 (squid) 2024-09-10T17:59:36.461 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: election_strategy: 1 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: osdmap e251: 8 total, 8 up, 8 in 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: mgrmap e42: y(active, since 34s), standbys: x 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: overall HEALTH_OK 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:36.462 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T17:59:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: pgmap v46: 121 pgs: 121 active+clean; 174 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-10T17:59:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T17:59:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: mon.a calling monitor election 2024-09-10T17:59:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: mon.b calling monitor election 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: mon.c calling monitor election 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: monmap epoch 4 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: last_changed 2024-09-10T17:59:35.091858+0000 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: min_mon_release 19 (squid) 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: election_strategy: 1 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:59:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: osdmap e251: 8 total, 8 up, 8 in 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: mgrmap e42: y(active, since 34s), standbys: x 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: overall HEALTH_OK 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: pgmap v46: 121 pgs: 121 active+clean; 174 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T17:59:36.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: mon.a calling monitor election 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: mon.b calling monitor election 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: mon.c calling monitor election 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: monmap epoch 4 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: fsid 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: last_changed 2024-09-10T17:59:35.091858+0000 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: created 2024-09-10T17:47:02.984611+0000 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: min_mon_release 19 (squid) 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: election_strategy: 1 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-10T17:59:36.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: 2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-10T17:59:36.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T17:59:36.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: osdmap e251: 8 total, 8 up, 8 in 2024-09-10T17:59:36.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: mgrmap e42: y(active, since 34s), standbys: x 2024-09-10T17:59:36.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: overall HEALTH_OK 2024-09-10T17:59:36.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:36.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:36.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T17:59:37.106 INFO:tasks.rados.rados.0.smithi012.stdout:900: done (2 left) 2024-09-10T17:59:37.107 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 90 2024-09-10T17:59:37.107 INFO:tasks.rados.rados.0.smithi012.stdout:899: finishing copy_from to smithi01278544-50 2024-09-10T17:59:37.107 INFO:tasks.rados.rados.0.smithi012.stdout:899: got expected ENOENT (src dne) 2024-09-10T17:59:37.107 INFO:tasks.rados.rados.0.smithi012.stdout:899: finishing copy_from racing read to smithi01278544-50 2024-09-10T17:59:37.107 INFO:tasks.rados.rados.0.smithi012.stdout:901: seq_num 282 ranges {4431872=729088,5160960=425984,5586944=704512,6291456=475136} 2024-09-10T17:59:37.135 INFO:tasks.rados.rados.0.smithi012.stdout:901: writing smithi01278544-38 from 4431872 to 5160960 tid 1 2024-09-10T17:59:37.137 INFO:tasks.rados.rados.0.smithi012.stdout:901: writing smithi01278544-38 from 5160960 to 5586944 tid 2 2024-09-10T17:59:37.141 INFO:tasks.rados.rados.0.smithi012.stdout:901: writing smithi01278544-38 from 5586944 to 6291456 tid 3 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:901: writing smithi01278544-38 from 6291456 to 6766592 tid 4 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:898: done (2 left) 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:899: done (1 left) 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:902: read oid 41 snap -1 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:902: expect (ObjNum 277 snap 88 seq_num 277) 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 90 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:901: finishing write tid 1 to smithi01278544-38 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:901: finishing write tid 2 to smithi01278544-38 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:901: finishing write tid 3 to smithi01278544-38 2024-09-10T17:59:37.145 INFO:tasks.rados.rados.0.smithi012.stdout:903: seq_num 283 ranges {3457024=745472,4202496=712704,4915200=458752,5373952=434176} 2024-09-10T17:59:37.169 INFO:tasks.rados.rados.0.smithi012.stdout:903: writing smithi01278544-33 from 3457024 to 4202496 tid 1 2024-09-10T17:59:37.173 INFO:tasks.rados.rados.0.smithi012.stdout:903: writing smithi01278544-33 from 4202496 to 4915200 tid 2 2024-09-10T17:59:37.176 INFO:tasks.rados.rados.0.smithi012.stdout:903: writing smithi01278544-33 from 4915200 to 5373952 tid 3 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:903: writing smithi01278544-33 from 5373952 to 5808128 tid 4 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:904: delete oid 1 current snap is 90 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:901: finishing write tid 4 to smithi01278544-38 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:901: finishing write tid 5 to smithi01278544-38 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:901: finishing write tid 6 to smithi01278544-38 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:901: oid 38 updating version 0 to 326 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:901: oid 38 version 326 is already newer than 325 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:901: oid 38 updating version 326 to 328 2024-09-10T17:59:37.180 INFO:tasks.rados.rados.0.smithi012.stdout:901: oid 38 version 328 is already newer than 327 2024-09-10T17:59:37.181 INFO:tasks.rados.rados.0.smithi012.stdout:901: oid 38 updating version 328 to 329 2024-09-10T17:59:37.181 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 329 (ObjNum 282 snap 90 seq_num 282) dirty exists 2024-09-10T17:59:37.181 INFO:tasks.rados.rados.0.smithi012.stdout:901: left oid 38 (ObjNum 282 snap 90 seq_num 282) 2024-09-10T17:59:37.181 INFO:tasks.rados.rados.0.smithi012.stdout:902: expect (ObjNum 277 snap 88 seq_num 277) 2024-09-10T17:59:37.388 INFO:tasks.rados.rados.0.smithi012.stdout:903: finishing write tid 1 to smithi01278544-33 2024-09-10T17:59:37.388 INFO:tasks.rados.rados.0.smithi012.stdout:903: finishing write tid 2 to smithi01278544-33 2024-09-10T17:59:37.388 INFO:tasks.rados.rados.0.smithi012.stdout:903: finishing write tid 3 to smithi01278544-33 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: finishing write tid 4 to smithi01278544-33 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: finishing write tid 5 to smithi01278544-33 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: finishing write tid 6 to smithi01278544-33 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: oid 33 updating version 0 to 608 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: oid 33 version 608 is already newer than 606 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: oid 33 version 608 is already newer than 601 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: oid 33 updating version 608 to 609 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: oid 33 version 609 is already newer than 607 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 609 (ObjNum 283 snap 90 seq_num 283) dirty exists 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: left oid 33 (ObjNum 283 snap 90 seq_num 283) 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:901: done (3 left) 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:902: done (2 left) 2024-09-10T17:59:37.389 INFO:tasks.rados.rados.0.smithi012.stdout:903: done (1 left) 2024-09-10T17:59:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:904: done (0 left) 2024-09-10T17:59:37.390 INFO:tasks.rados.rados.0.smithi012.stdout:905: snap_remove snap 81 2024-09-10T17:59:37.446 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:37 smithi089 ceph-mon[84132]: osdmap e252: 8 total, 8 up, 8 in 2024-09-10T17:59:37.446 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:37 smithi089 ceph-mon[84132]: osdmap e253: 8 total, 8 up, 8 in 2024-09-10T17:59:37.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:37 smithi012 ceph-mon[89611]: osdmap e252: 8 total, 8 up, 8 in 2024-09-10T17:59:37.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:37 smithi012 ceph-mon[89611]: osdmap e253: 8 total, 8 up, 8 in 2024-09-10T17:59:37.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:37 smithi012 ceph-mon[92029]: osdmap e252: 8 total, 8 up, 8 in 2024-09-10T17:59:37.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:37 smithi012 ceph-mon[92029]: osdmap e253: 8 total, 8 up, 8 in 2024-09-10T17:59:37.653 INFO:tasks.rados.rados.0.smithi012.stdout:905: done (0 left) 2024-09-10T17:59:37.653 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 90 2024-09-10T17:59:37.653 INFO:tasks.rados.rados.0.smithi012.stdout:906: seq_num 285 ranges {0=778240,778240=475136,1253376=475136,1728512=655360} 2024-09-10T17:59:37.658 INFO:tasks.rados.rados.0.smithi012.stdout:906: writing smithi01278544-45 from 0 to 778240 tid 1 2024-09-10T17:59:37.661 INFO:tasks.rados.rados.0.smithi012.stdout:906: writing smithi01278544-45 from 778240 to 1253376 tid 2 2024-09-10T17:59:37.664 INFO:tasks.rados.rados.0.smithi012.stdout:906: writing smithi01278544-45 from 1253376 to 1728512 tid 3 2024-09-10T17:59:37.669 INFO:tasks.rados.rados.0.smithi012.stdout:906: writing smithi01278544-45 from 1728512 to 2383872 tid 4 2024-09-10T17:59:37.669 INFO:tasks.rados.rados.0.smithi012.stdout:907: copy_from oid 41 from oid 49 current snap is 90 2024-09-10T17:59:37.669 INFO:tasks.rados.rados.0.smithi012.stdout:906: finishing write tid 1 to smithi01278544-45 2024-09-10T17:59:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:906: finishing write tid 2 to smithi01278544-45 2024-09-10T17:59:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:908: snap_remove snap 88 2024-09-10T17:59:38.657 INFO:tasks.rados.rados.0.smithi012.stdout:908: done (2 left) 2024-09-10T17:59:38.658 INFO:tasks.rados.rados.0.smithi012.stdout:909: snap_remove snap 75 2024-09-10T17:59:38.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:38 smithi089 ceph-mon[84132]: pgmap v48: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:59:38.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:38 smithi089 ceph-mon[84132]: osdmap e254: 8 total, 8 up, 8 in 2024-09-10T17:59:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:38 smithi012 ceph-mon[89611]: pgmap v48: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:59:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:38 smithi012 ceph-mon[89611]: osdmap e254: 8 total, 8 up, 8 in 2024-09-10T17:59:39.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:38 smithi012 ceph-mon[92029]: pgmap v48: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 21 op/s 2024-09-10T17:59:39.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:38 smithi012 ceph-mon[92029]: osdmap e254: 8 total, 8 up, 8 in 2024-09-10T17:59:39.670 INFO:tasks.rados.rados.0.smithi012.stdout:909: done (2 left) 2024-09-10T17:59:39.670 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 90 2024-09-10T17:59:39.670 INFO:tasks.rados.rados.0.smithi012.stdout:907: finishing copy_from to smithi01278544-41 2024-09-10T17:59:39.670 INFO:tasks.rados.rados.0.smithi012.stdout:907: got expected ENOENT (src dne) 2024-09-10T17:59:39.670 INFO:tasks.rados.rados.0.smithi012.stdout:910: seq_num 286 ranges {0=794624,794624=761856,1556480=679936,2236416=163840} 2024-09-10T17:59:39.674 INFO:tasks.rados.rados.0.smithi012.stdout:910: writing smithi01278544-5 from 0 to 794624 tid 1 2024-09-10T17:59:39.679 INFO:tasks.rados.rados.0.smithi012.stdout:910: writing smithi01278544-5 from 794624 to 1556480 tid 2 2024-09-10T17:59:39.684 INFO:tasks.rados.rados.0.smithi012.stdout:910: writing smithi01278544-5 from 1556480 to 2236416 tid 3 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:910: writing smithi01278544-5 from 2236416 to 2400256 tid 4 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:911: read oid 4 snap -1 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:911: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:912: snap_create 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:906: finishing write tid 3 to smithi01278544-45 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:907: finishing copy_from racing read to smithi01278544-41 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:906: finishing write tid 4 to smithi01278544-45 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:906: finishing write tid 5 to smithi01278544-45 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:906: finishing write tid 6 to smithi01278544-45 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:906: oid 45 updating version 0 to 626 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:906: oid 45 updating version 626 to 628 2024-09-10T17:59:39.687 INFO:tasks.rados.rados.0.smithi012.stdout:906: oid 45 version 628 is already newer than 627 2024-09-10T17:59:39.688 INFO:tasks.rados.rados.0.smithi012.stdout:906: oid 45 version 628 is already newer than 621 2024-09-10T17:59:39.688 INFO:tasks.rados.rados.0.smithi012.stdout:906: oid 45 version 628 is already newer than 620 2024-09-10T17:59:39.688 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 628 (ObjNum 285 snap 90 seq_num 285) dirty exists 2024-09-10T17:59:39.688 INFO:tasks.rados.rados.0.smithi012.stdout:906: left oid 45 (ObjNum 285 snap 90 seq_num 285) 2024-09-10T17:59:39.688 INFO:tasks.rados.rados.0.smithi012.stdout:910: finishing write tid 1 to smithi01278544-5 2024-09-10T17:59:39.688 INFO:tasks.rados.rados.0.smithi012.stdout:910: finishing write tid 2 to smithi01278544-5 2024-09-10T17:59:39.690 INFO:tasks.rados.rados.0.smithi012.stdout:910: finishing write tid 3 to smithi01278544-5 2024-09-10T17:59:39.690 INFO:tasks.rados.rados.0.smithi012.stdout:910: finishing write tid 4 to smithi01278544-5 2024-09-10T17:59:39.690 INFO:tasks.rados.rados.0.smithi012.stdout:910: finishing write tid 5 to smithi01278544-5 2024-09-10T17:59:39.694 INFO:tasks.rados.rados.0.smithi012.stdout:910: finishing write tid 6 to smithi01278544-5 2024-09-10T17:59:39.694 INFO:tasks.rados.rados.0.smithi012.stdout:910: oid 5 updating version 0 to 357 2024-09-10T17:59:39.694 INFO:tasks.rados.rados.0.smithi012.stdout:910: oid 5 version 357 is already newer than 354 2024-09-10T17:59:39.694 INFO:tasks.rados.rados.0.smithi012.stdout:910: oid 5 version 357 is already newer than 355 2024-09-10T17:59:39.694 INFO:tasks.rados.rados.0.smithi012.stdout:910: oid 5 updating version 357 to 358 2024-09-10T17:59:39.694 INFO:tasks.rados.rados.0.smithi012.stdout:910: oid 5 version 358 is already newer than 356 2024-09-10T17:59:39.694 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 358 (ObjNum 286 snap 90 seq_num 286) dirty exists 2024-09-10T17:59:39.694 INFO:tasks.rados.rados.0.smithi012.stdout:910: left oid 5 (ObjNum 286 snap 90 seq_num 286) 2024-09-10T17:59:39.712 INFO:tasks.rados.rados.0.smithi012.stdout:911: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T17:59:39.716 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T17:59:39.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:39 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T17:59:39.470+0000 7f7a9b686640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T17:59:39.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:39 smithi012 ceph-mon[89611]: osdmap e255: 8 total, 8 up, 8 in 2024-09-10T17:59:39.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:39.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:39.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:39 smithi012 ceph-mon[92029]: osdmap e255: 8 total, 8 up, 8 in 2024-09-10T17:59:39.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:39.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:39 smithi089 ceph-mon[84132]: osdmap e255: 8 total, 8 up, 8 in 2024-09-10T17:59:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.308 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T17:59:40.308 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (4m) 14s ago 5m 27.4M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T17:59:40.308 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (5m) 0s ago 5m 87.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T17:59:40.308 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (7m) 14s ago 7m 18.3M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T17:59:40.308 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (7m) 0s ago 7m 19.6M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T17:59:40.308 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (61s) 0s ago 10m 452M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T17:59:40.308 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (90s) 14s ago 12m 516M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (48s) 14s ago 12m 39.4M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (6s) 0s ago 11m 27.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (23s) 14s ago 10m 26.8M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (5m) 14s ago 5m 15.5M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (5m) 0s ago 5m 16.9M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (10m) 14s ago 10m 152M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e a54550a62cfe 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (9m) 14s ago 9m 121M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (9m) 14s ago 9m 151M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (9m) 14s ago 9m 134M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (8m) 0s ago 8m 186M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T17:59:40.309 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (8m) 0s ago 8m 136M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T17:59:40.310 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (8m) 0s ago 8m 141M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T17:59:40.310 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (7m) 0s ago 7m 98.9M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T17:59:40.310 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (66s) 0s ago 6m 50.4M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T17:59:40.657 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:59:40.657 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T17:59:40.657 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T17:59:40.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 10, 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 5 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T17:59:40.658 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:59:40.670 INFO:tasks.rados.rados.0.smithi012.stdout:906: done (4 left) 2024-09-10T17:59:40.670 INFO:tasks.rados.rados.0.smithi012.stdout:907: done (3 left) 2024-09-10T17:59:40.671 INFO:tasks.rados.rados.0.smithi012.stdout:910: done (2 left) 2024-09-10T17:59:40.671 INFO:tasks.rados.rados.0.smithi012.stdout:911: done (1 left) 2024-09-10T17:59:40.671 INFO:tasks.rados.rados.0.smithi012.stdout:912: done (0 left) 2024-09-10T17:59:40.671 INFO:tasks.rados.rados.0.smithi012.stdout:913: copy_from oid 2 from oid 18 current snap is 91 2024-09-10T17:59:40.671 INFO:tasks.rados.rados.0.smithi012.stdout:914: snap_create 2024-09-10T17:59:40.671 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:40 smithi089 ceph-mon[84132]: pgmap v52: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-09-10T17:59:40.671 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:40 smithi089 ceph-mon[84132]: osdmap e256: 8 total, 8 up, 8 in 2024-09-10T17:59:40.671 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:40 smithi089 ceph-mon[84132]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:40.672 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.672 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.672 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:40 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1913532964' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T17:59:40.673 INFO:tasks.rados.rados.0.smithi012.stdout:913: finishing copy_from to smithi01278544-2 2024-09-10T17:59:40.673 INFO:tasks.rados.rados.0.smithi012.stdout:913: got expected ENOENT (src dne) 2024-09-10T17:59:40.673 INFO:tasks.rados.rados.0.smithi012.stdout:913: finishing copy_from racing read to smithi01278544-2 2024-09-10T17:59:40.959 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T17:59:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T17:59:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T17:59:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T17:59:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T17:59:40.959 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T17:59:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T17:59:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T17:59:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "5/20 daemons upgraded", 2024-09-10T17:59:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading mon daemons", 2024-09-10T17:59:40.960 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T17:59:40.960 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T17:59:40.960 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[89611]: pgmap v52: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-09-10T17:59:40.960 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[89611]: osdmap e256: 8 total, 8 up, 8 in 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[89611]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1913532964' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[92029]: pgmap v52: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[92029]: osdmap e256: 8 total, 8 up, 8 in 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[92029]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:40.961 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:40 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1913532964' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T17:59:41.677 INFO:tasks.rados.rados.0.smithi012.stdout:913: done (1 left) 2024-09-10T17:59:41.677 INFO:tasks.rados.rados.0.smithi012.stdout:914: done (0 left) 2024-09-10T17:59:41.677 INFO:tasks.rados.rados.0.smithi012.stdout:915: read oid 19 snap -1 2024-09-10T17:59:41.677 INFO:tasks.rados.rados.0.smithi012.stdout:915: expect (ObjNum 93 snap 16 seq_num 93) 2024-09-10T17:59:41.677 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 92 2024-09-10T17:59:41.677 INFO:tasks.rados.rados.0.smithi012.stdout:916: seq_num 287 ranges {3457024=8192} 2024-09-10T17:59:41.696 INFO:tasks.rados.rados.0.smithi012.stdout:916: writing smithi01278544-44 from 3457024 to 3465216 tid 1 2024-09-10T17:59:41.696 INFO:tasks.rados.rados.0.smithi012.stdout:917: snap_create 2024-09-10T17:59:41.696 INFO:tasks.rados.rados.0.smithi012.stdout:915: expect (ObjNum 93 snap 16 seq_num 93) 2024-09-10T17:59:41.752 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:41 smithi089 ceph-mon[84132]: from='client.44111 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:41.752 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:41 smithi089 ceph-mon[84132]: from='client.44117 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:41.752 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:41 smithi089 ceph-mon[84132]: osdmap e257: 8 total, 8 up, 8 in 2024-09-10T17:59:41.809 INFO:tasks.rados.rados.0.smithi012.stdout:916: finishing write tid 1 to smithi01278544-44 2024-09-10T17:59:41.809 INFO:tasks.rados.rados.0.smithi012.stdout:916: finishing write tid 2 to smithi01278544-44 2024-09-10T17:59:41.809 INFO:tasks.rados.rados.0.smithi012.stdout:916: finishing write tid 3 to smithi01278544-44 2024-09-10T17:59:41.809 INFO:tasks.rados.rados.0.smithi012.stdout:916: oid 44 updating version 0 to 333 2024-09-10T17:59:41.809 INFO:tasks.rados.rados.0.smithi012.stdout:916: oid 44 updating version 333 to 334 2024-09-10T17:59:41.809 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 334 (ObjNum 287 snap 92 seq_num 287) dirty exists 2024-09-10T17:59:41.809 INFO:tasks.rados.rados.0.smithi012.stdout:916: left oid 44 (ObjNum 287 snap 92 seq_num 287) 2024-09-10T17:59:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:41 smithi012 ceph-mon[89611]: from='client.44111 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:41 smithi012 ceph-mon[89611]: from='client.44117 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:41 smithi012 ceph-mon[89611]: osdmap e257: 8 total, 8 up, 8 in 2024-09-10T17:59:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:41 smithi012 ceph-mon[92029]: from='client.44111 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:41 smithi012 ceph-mon[92029]: from='client.44117 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:41 smithi012 ceph-mon[92029]: osdmap e257: 8 total, 8 up, 8 in 2024-09-10T17:59:42.685 INFO:tasks.rados.rados.0.smithi012.stdout:915: done (2 left) 2024-09-10T17:59:42.685 INFO:tasks.rados.rados.0.smithi012.stdout:916: done (1 left) 2024-09-10T17:59:42.685 INFO:tasks.rados.rados.0.smithi012.stdout:917: done (0 left) 2024-09-10T17:59:42.685 INFO:tasks.rados.rados.0.smithi012.stdout:918: copy_from oid 44 from oid 47 current snap is 93 2024-09-10T17:59:42.685 INFO:tasks.rados.rados.0.smithi012.stdout:919: copy_from oid 18 from oid 21 current snap is 93 2024-09-10T17:59:42.685 INFO:tasks.rados.rados.0.smithi012.stdout:920: snap_create 2024-09-10T17:59:42.713 INFO:tasks.rados.rados.0.smithi012.stdout:919: finishing copy_from racing read to smithi01278544-18 2024-09-10T17:59:42.714 INFO:tasks.rados.rados.0.smithi012.stdout:918: finishing copy_from racing read to smithi01278544-44 2024-09-10T17:59:42.719 INFO:tasks.rados.rados.0.smithi012.stdout:919: finishing copy_from to smithi01278544-18 2024-09-10T17:59:42.720 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 354 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-09-10T17:59:42.720 INFO:tasks.rados.rados.0.smithi012.stdout:918: finishing copy_from to smithi01278544-44 2024-09-10T17:59:42.720 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 597 (ObjNum 244 snap 72 seq_num 244) dirty exists 2024-09-10T17:59:42.922 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:42 smithi089 ceph-mon[84132]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:42.922 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:42 smithi089 ceph-mon[84132]: pgmap v55: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:42.922 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:42 smithi089 ceph-mon[84132]: osdmap e258: 8 total, 8 up, 8 in 2024-09-10T17:59:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:42 smithi012 ceph-mon[89611]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:43.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:42 smithi012 ceph-mon[89611]: pgmap v55: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:43.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:42 smithi012 ceph-mon[89611]: osdmap e258: 8 total, 8 up, 8 in 2024-09-10T17:59:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:42 smithi012 ceph-mon[92029]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T17:59:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:42 smithi012 ceph-mon[92029]: pgmap v55: 121 pgs: 121 active+clean; 183 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:42 smithi012 ceph-mon[92029]: osdmap e258: 8 total, 8 up, 8 in 2024-09-10T17:59:43.691 INFO:tasks.rados.rados.0.smithi012.stdout:918: done (2 left) 2024-09-10T17:59:43.691 INFO:tasks.rados.rados.0.smithi012.stdout:919: done (1 left) 2024-09-10T17:59:43.691 INFO:tasks.rados.rados.0.smithi012.stdout:920: done (0 left) 2024-09-10T17:59:43.691 INFO:tasks.rados.rados.0.smithi012.stdout:921: read oid 16 snap 89 2024-09-10T17:59:43.691 INFO:tasks.rados.rados.0.smithi012.stdout:921: expect (ObjNum 226 snap 67 seq_num 226) 2024-09-10T17:59:43.692 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 94 2024-09-10T17:59:43.692 INFO:tasks.rados.rados.0.smithi012.stdout:922: seq_num 288 ranges {0=24576} 2024-09-10T17:59:43.692 INFO:tasks.rados.rados.0.smithi012.stdout:922: writing smithi01278544-20 from 0 to 24576 tid 1 2024-09-10T17:59:43.692 INFO:tasks.rados.rados.0.smithi012.stdout:923: snap_remove snap 87 2024-09-10T17:59:43.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: osdmap e259: 8 total, 8 up, 8 in 2024-09-10T17:59:43.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:43.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:43.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:43.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T17:59:43.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:43.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: osdmap e259: 8 total, 8 up, 8 in 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:43.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:44.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: osdmap e259: 8 total, 8 up, 8 in 2024-09-10T17:59:44.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:44.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:44.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:44.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T17:59:44.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:44.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:44.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:44.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:43 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:59:43] "GET /metrics HTTP/1.1" 200 36086 "" "Prometheus/2.43.0" 2024-09-10T17:59:44.691 INFO:tasks.rados.rados.0.smithi012.stdout:923: done (2 left) 2024-09-10T17:59:44.691 INFO:tasks.rados.rados.0.smithi012.stdout:924: setattr oid 49 current snap is 94 2024-09-10T17:59:44.692 INFO:tasks.rados.rados.0.smithi012.stdout:922: finishing write tid 1 to smithi01278544-20 2024-09-10T17:59:44.692 INFO:tasks.rados.rados.0.smithi012.stdout:922: finishing write tid 2 to smithi01278544-20 2024-09-10T17:59:44.692 INFO:tasks.rados.rados.0.smithi012.stdout:921: expect (ObjNum 226 snap 67 seq_num 226) 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:922: finishing write tid 3 to smithi01278544-20 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:922: oid 20 updating version 0 to 585 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:922: oid 20 version 585 is already newer than 584 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 585 (ObjNum 288 snap 94 seq_num 288) dirty exists 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:922: left oid 20 (ObjNum 288 snap 94 seq_num 288) 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:921: done (2 left) 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:922: done (1 left) 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:925: rmattr oid 42 current snap is 94 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:925: done (1 left) 2024-09-10T17:59:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:926: snap_remove snap 79 2024-09-10T17:59:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:44 smithi012 ceph-mon[89611]: pgmap v58: 121 pgs: 121 active+clean; 191 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-10T17:59:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:44 smithi012 ceph-mon[89611]: Reconfiguring mon.a (monmap changed)... 2024-09-10T17:59:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:44 smithi012 ceph-mon[89611]: Reconfiguring daemon mon.a on smithi012 2024-09-10T17:59:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:44 smithi012 ceph-mon[89611]: osdmap e260: 8 total, 8 up, 8 in 2024-09-10T17:59:45.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:44 smithi012 ceph-mon[92029]: pgmap v58: 121 pgs: 121 active+clean; 191 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-10T17:59:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:44 smithi012 ceph-mon[92029]: Reconfiguring mon.a (monmap changed)... 2024-09-10T17:59:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:44 smithi012 ceph-mon[92029]: Reconfiguring daemon mon.a on smithi012 2024-09-10T17:59:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:44 smithi012 ceph-mon[92029]: osdmap e260: 8 total, 8 up, 8 in 2024-09-10T17:59:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:44 smithi089 ceph-mon[84132]: pgmap v58: 121 pgs: 121 active+clean; 191 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-10T17:59:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:44 smithi089 ceph-mon[84132]: Reconfiguring mon.a (monmap changed)... 2024-09-10T17:59:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:44 smithi089 ceph-mon[84132]: Reconfiguring daemon mon.a on smithi012 2024-09-10T17:59:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:44 smithi089 ceph-mon[84132]: osdmap e260: 8 total, 8 up, 8 in 2024-09-10T17:59:45.704 INFO:tasks.rados.rados.0.smithi012.stdout:926: done (1 left) 2024-09-10T17:59:45.705 INFO:tasks.rados.rados.0.smithi012.stdout:927: rollback oid 1 current snap is 94 2024-09-10T17:59:45.705 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 92 2024-09-10T17:59:45.705 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 410 (ObjNum 433 snap 0 seq_num 3013093470) dirty exists 2024-09-10T17:59:45.705 INFO:tasks.rados.rados.0.smithi012.stdout:924: done (1 left) 2024-09-10T17:59:45.705 INFO:tasks.rados.rados.0.smithi012.stdout:928: delete oid 5 current snap is 94 2024-09-10T17:59:45.711 INFO:tasks.rados.rados.0.smithi012.stdout:928: done (1 left) 2024-09-10T17:59:45.711 INFO:tasks.rados.rados.0.smithi012.stdout:929: delete oid 21 current snap is 94 2024-09-10T17:59:45.713 INFO:tasks.rados.rados.0.smithi012.stdout:927: finishing rollback tid 1 to smithi01278544-1 2024-09-10T17:59:45.713 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 331 (ObjNum 33 snap 0 seq_num 3496969232) dirty dne 2024-09-10T17:59:45.718 INFO:tasks.rados.rados.0.smithi012.stdout:927: done (1 left) 2024-09-10T17:59:45.718 INFO:tasks.rados.rados.0.smithi012.stdout:929: done (0 left) 2024-09-10T17:59:45.718 INFO:tasks.rados.rados.0.smithi012.stdout:930: snap_remove snap 91 2024-09-10T17:59:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[89611]: osdmap e261: 8 total, 8 up, 8 in 2024-09-10T17:59:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T17:59:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T17:59:45.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:45.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[92029]: osdmap e261: 8 total, 8 up, 8 in 2024-09-10T17:59:45.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:45.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:45.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T17:59:45.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T17:59:45.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:46.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:45 smithi089 ceph-mon[84132]: osdmap e261: 8 total, 8 up, 8 in 2024-09-10T17:59:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T17:59:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T17:59:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:46.708 INFO:tasks.rados.rados.0.smithi012.stdout:930: done (0 left) 2024-09-10T17:59:46.708 INFO:tasks.rados.rados.0.smithi012.stdout:931: snap_remove snap 92 2024-09-10T17:59:46.959 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: Reconfiguring mgr.y (monmap changed)... 2024-09-10T17:59:46.959 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: Reconfiguring daemon mgr.y on smithi012 2024-09-10T17:59:46.960 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: pgmap v61: 121 pgs: 121 active+clean; 191 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-10T17:59:46.960 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: osdmap e262: 8 total, 8 up, 8 in 2024-09-10T17:59:46.960 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T17:59:46.960 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:46.960 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:46.960 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:46.960 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:46.960 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:47.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: Reconfiguring mgr.y (monmap changed)... 2024-09-10T17:59:47.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: Reconfiguring daemon mgr.y on smithi012 2024-09-10T17:59:47.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: pgmap v61: 121 pgs: 121 active+clean; 191 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-10T17:59:47.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: osdmap e262: 8 total, 8 up, 8 in 2024-09-10T17:59:47.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T17:59:47.010 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:47.010 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:47.010 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:47.010 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:47.010 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:47.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: Reconfiguring mgr.y (monmap changed)... 2024-09-10T17:59:47.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: Reconfiguring daemon mgr.y on smithi012 2024-09-10T17:59:47.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: pgmap v61: 121 pgs: 121 active+clean; 191 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-10T17:59:47.011 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: osdmap e262: 8 total, 8 up, 8 in 2024-09-10T17:59:47.011 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T17:59:47.011 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:47.011 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:47.011 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:47.011 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:47.011 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:47.655 INFO:tasks.rados.rados.0.smithi012.stdout:931: done (0 left) 2024-09-10T17:59:47.655 INFO:tasks.rados.rados.0.smithi012.stdout:932: snap_create 2024-09-10T17:59:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:47 smithi012 ceph-mon[89611]: Reconfiguring mon.c (monmap changed)... 2024-09-10T17:59:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:47 smithi012 ceph-mon[89611]: Reconfiguring daemon mon.c on smithi012 2024-09-10T17:59:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:47 smithi012 ceph-mon[89611]: osdmap e263: 8 total, 8 up, 8 in 2024-09-10T17:59:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:47 smithi012 ceph-mon[89611]: osdmap e264: 8 total, 8 up, 8 in 2024-09-10T17:59:48.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:47 smithi012 ceph-mon[92029]: Reconfiguring mon.c (monmap changed)... 2024-09-10T17:59:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:47 smithi012 ceph-mon[92029]: Reconfiguring daemon mon.c on smithi012 2024-09-10T17:59:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:47 smithi012 ceph-mon[92029]: osdmap e263: 8 total, 8 up, 8 in 2024-09-10T17:59:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:47 smithi012 ceph-mon[92029]: osdmap e264: 8 total, 8 up, 8 in 2024-09-10T17:59:48.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:47 smithi089 ceph-mon[84132]: Reconfiguring mon.c (monmap changed)... 2024-09-10T17:59:48.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:47 smithi089 ceph-mon[84132]: Reconfiguring daemon mon.c on smithi012 2024-09-10T17:59:48.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:47 smithi089 ceph-mon[84132]: osdmap e263: 8 total, 8 up, 8 in 2024-09-10T17:59:48.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:47 smithi089 ceph-mon[84132]: osdmap e264: 8 total, 8 up, 8 in 2024-09-10T17:59:48.657 INFO:tasks.rados.rados.0.smithi012.stdout:932: done (0 left) 2024-09-10T17:59:48.658 INFO:tasks.rados.rados.0.smithi012.stdout:933: rollback oid 48 current snap is 95 2024-09-10T17:59:48.658 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 48 to 85 2024-09-10T17:59:48.658 INFO:tasks.rados.rados.0.smithi012.stdout:934: copy_from oid 4 from oid 24 current snap is 95 2024-09-10T17:59:48.658 INFO:tasks.rados.rados.0.smithi012.stdout:935: snap_create 2024-09-10T17:59:48.660 INFO:tasks.rados.rados.0.smithi012.stdout:934: finishing copy_from to smithi01278544-4 2024-09-10T17:59:48.660 INFO:tasks.rados.rados.0.smithi012.stdout:934: got expected ENOENT (src dne) 2024-09-10T17:59:48.661 INFO:tasks.rados.rados.0.smithi012.stdout:934: finishing copy_from racing read to smithi01278544-4 2024-09-10T17:59:48.663 INFO:tasks.rados.rados.0.smithi012.stdout:933: finishing rollback tid 0 to smithi01278544-48 2024-09-10T17:59:48.664 INFO:tasks.rados.rados.0.smithi012.stdout:933: finishing rollback tid 1 to smithi01278544-48 2024-09-10T17:59:48.664 INFO:tasks.rados.rados.0.smithi012.stdout:933: finishing rollback tid 2 to smithi01278544-48 2024-09-10T17:59:48.664 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 358 (ObjNum 261 snap 84 seq_num 261) dirty exists 2024-09-10T17:59:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[89611]: pgmap v64: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T17:59:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T17:59:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[89611]: osdmap e265: 8 total, 8 up, 8 in 2024-09-10T17:59:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[92029]: pgmap v64: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T17:59:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T17:59:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:48 smithi012 ceph-mon[92029]: osdmap e265: 8 total, 8 up, 8 in 2024-09-10T17:59:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:48 smithi089 ceph-mon[84132]: pgmap v64: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T17:59:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T17:59:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:48 smithi089 ceph-mon[84132]: osdmap e265: 8 total, 8 up, 8 in 2024-09-10T17:59:49.659 INFO:tasks.rados.rados.0.smithi012.stdout:933: done (2 left) 2024-09-10T17:59:49.659 INFO:tasks.rados.rados.0.smithi012.stdout:934: done (1 left) 2024-09-10T17:59:49.659 INFO:tasks.rados.rados.0.smithi012.stdout:935: done (0 left) 2024-09-10T17:59:49.660 INFO:tasks.rados.rados.0.smithi012.stdout:936: read oid 34 snap 89 2024-09-10T17:59:49.660 INFO:tasks.rados.rados.0.smithi012.stdout:936: expect deleted 2024-09-10T17:59:49.660 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 96 2024-09-10T17:59:49.660 INFO:tasks.rados.rados.0.smithi012.stdout:937: seq_num 291 ranges {2383872=81920} 2024-09-10T17:59:49.673 INFO:tasks.rados.rados.0.smithi012.stdout:937: writing smithi01278544-45 from 2383872 to 2465792 tid 1 2024-09-10T17:59:49.673 INFO:tasks.rados.rados.0.smithi012.stdout:938: delete oid 48 current snap is 96 2024-09-10T17:59:49.678 INFO:tasks.rados.rados.0.smithi012.stdout:937: finishing write tid 1 to smithi01278544-45 2024-09-10T17:59:49.679 INFO:tasks.rados.rados.0.smithi012.stdout:937: finishing write tid 2 to smithi01278544-45 2024-09-10T17:59:49.680 INFO:tasks.rados.rados.0.smithi012.stdout:937: finishing write tid 3 to smithi01278544-45 2024-09-10T17:59:49.680 INFO:tasks.rados.rados.0.smithi012.stdout:937: oid 45 updating version 0 to 658 2024-09-10T17:59:49.680 INFO:tasks.rados.rados.0.smithi012.stdout:937: oid 45 updating version 658 to 659 2024-09-10T17:59:49.681 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 659 (ObjNum 291 snap 96 seq_num 291) dirty exists 2024-09-10T17:59:49.681 INFO:tasks.rados.rados.0.smithi012.stdout:937: left oid 45 (ObjNum 291 snap 96 seq_num 291) 2024-09-10T17:59:49.681 INFO:tasks.rados.rados.0.smithi012.stdout:936: done (2 left) 2024-09-10T17:59:49.681 INFO:tasks.rados.rados.0.smithi012.stdout:937: done (1 left) 2024-09-10T17:59:49.681 INFO:tasks.rados.rados.0.smithi012.stdout:938: done (0 left) 2024-09-10T17:59:49.681 INFO:tasks.rados.rados.0.smithi012.stdout:939: setattr oid 29 current snap is 96 2024-09-10T17:59:49.682 INFO:tasks.rados.rados.0.smithi012.stdout:940: rollback oid 3 current snap is 96 2024-09-10T17:59:49.683 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 95 2024-09-10T17:59:49.683 INFO:tasks.rados.rados.0.smithi012.stdout:941: snap_create 2024-09-10T17:59:49.684 INFO:tasks.rados.rados.0.smithi012.stdout:940: finishing rollback tid 1 to smithi01278544-3 2024-09-10T17:59:49.684 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 282 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-09-10T17:59:49.685 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 196 (ObjNum 263 snap 84 seq_num 263) dirty exists 2024-09-10T17:59:50.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:49 smithi012 ceph-mon[89611]: Reconfiguring osd.0 (monmap changed)... 2024-09-10T17:59:50.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:49 smithi012 ceph-mon[89611]: Reconfiguring daemon osd.0 on smithi012 2024-09-10T17:59:50.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:49 smithi012 ceph-mon[89611]: osdmap e266: 8 total, 8 up, 8 in 2024-09-10T17:59:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:49 smithi012 ceph-mon[92029]: Reconfiguring osd.0 (monmap changed)... 2024-09-10T17:59:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:49 smithi012 ceph-mon[92029]: Reconfiguring daemon osd.0 on smithi012 2024-09-10T17:59:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:49 smithi012 ceph-mon[92029]: osdmap e266: 8 total, 8 up, 8 in 2024-09-10T17:59:50.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:49 smithi089 ceph-mon[84132]: Reconfiguring osd.0 (monmap changed)... 2024-09-10T17:59:50.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:49 smithi089 ceph-mon[84132]: Reconfiguring daemon osd.0 on smithi012 2024-09-10T17:59:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:49 smithi089 ceph-mon[84132]: osdmap e266: 8 total, 8 up, 8 in 2024-09-10T17:59:50.661 INFO:tasks.rados.rados.0.smithi012.stdout:939: done (2 left) 2024-09-10T17:59:50.661 INFO:tasks.rados.rados.0.smithi012.stdout:940: done (1 left) 2024-09-10T17:59:50.661 INFO:tasks.rados.rados.0.smithi012.stdout:941: done (0 left) 2024-09-10T17:59:50.661 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 97 2024-09-10T17:59:50.661 INFO:tasks.rados.rados.0.smithi012.stdout:942: seq_num 293 ranges {1531904=114688} 2024-09-10T17:59:50.670 INFO:tasks.rados.rados.0.smithi012.stdout:942: writing smithi01278544-36 from 1531904 to 1646592 tid 1 2024-09-10T17:59:50.670 INFO:tasks.rados.rados.0.smithi012.stdout:943: read oid 24 snap -1 2024-09-10T17:59:50.670 INFO:tasks.rados.rados.0.smithi012.stdout:943: expect deleted 2024-09-10T17:59:50.670 INFO:tasks.rados.rados.0.smithi012.stdout:944: snap_remove snap 78 2024-09-10T17:59:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[89611]: pgmap v67: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T17:59:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[89611]: osdmap e267: 8 total, 8 up, 8 in 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[92029]: pgmap v67: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:50 smithi012 ceph-mon[92029]: osdmap e267: 8 total, 8 up, 8 in 2024-09-10T17:59:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:50 smithi089 ceph-mon[84132]: pgmap v67: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T17:59:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T17:59:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:50 smithi089 ceph-mon[84132]: osdmap e267: 8 total, 8 up, 8 in 2024-09-10T17:59:51.666 INFO:tasks.rados.rados.0.smithi012.stdout:944: done (2 left) 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:945: read oid 22 snap -1 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:945: expect (ObjNum 271 snap 87 seq_num 271) 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:946: read oid 46 snap -1 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:946: expect (ObjNum 275 snap 88 seq_num 275) 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 97 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:942: finishing write tid 1 to smithi01278544-36 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:942: finishing write tid 2 to smithi01278544-36 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:942: finishing write tid 3 to smithi01278544-36 2024-09-10T17:59:51.667 INFO:tasks.rados.rados.0.smithi012.stdout:942: oid 36 updating version 0 to 223 2024-09-10T17:59:51.668 INFO:tasks.rados.rados.0.smithi012.stdout:942: oid 36 version 223 is already newer than 222 2024-09-10T17:59:51.668 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 223 (ObjNum 293 snap 97 seq_num 293) dirty exists 2024-09-10T17:59:51.668 INFO:tasks.rados.rados.0.smithi012.stdout:942: left oid 36 (ObjNum 293 snap 97 seq_num 293) 2024-09-10T17:59:51.668 INFO:tasks.rados.rados.0.smithi012.stdout:947: seq_num 294 ranges {3096576=131072} 2024-09-10T17:59:51.684 INFO:tasks.rados.rados.0.smithi012.stdout:947: writing smithi01278544-19 from 3096576 to 3227648 tid 1 2024-09-10T17:59:51.685 INFO:tasks.rados.rados.0.smithi012.stdout:942: done (4 left) 2024-09-10T17:59:51.685 INFO:tasks.rados.rados.0.smithi012.stdout:943: done (3 left) 2024-09-10T17:59:51.685 INFO:tasks.rados.rados.0.smithi012.stdout:948: read oid 4 snap -1 2024-09-10T17:59:51.685 INFO:tasks.rados.rados.0.smithi012.stdout:948: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T17:59:51.685 INFO:tasks.rados.rados.0.smithi012.stdout:949: read oid 43 snap -1 2024-09-10T17:59:51.686 INFO:tasks.rados.rados.0.smithi012.stdout:949: expect (ObjNum 253 snap 79 seq_num 253) 2024-09-10T17:59:51.686 INFO:tasks.rados.rados.0.smithi012.stdout:950: read oid 26 snap 90 2024-09-10T17:59:51.686 INFO:tasks.rados.rados.0.smithi012.stdout:950: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:59:51.686 INFO:tasks.rados.rados.0.smithi012.stdout:951: copy_from oid 10 from oid 7 current snap is 97 2024-09-10T17:59:51.686 INFO:tasks.rados.rados.0.smithi012.stdout:952: snap_remove snap 59 2024-09-10T17:59:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[89611]: Reconfiguring osd.1 (monmap changed)... 2024-09-10T17:59:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[89611]: Reconfiguring daemon osd.1 on smithi012 2024-09-10T17:59:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T17:59:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[89611]: osdmap e268: 8 total, 8 up, 8 in 2024-09-10T17:59:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[92029]: Reconfiguring osd.1 (monmap changed)... 2024-09-10T17:59:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[92029]: Reconfiguring daemon osd.1 on smithi012 2024-09-10T17:59:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T17:59:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:52.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:51 smithi012 ceph-mon[92029]: osdmap e268: 8 total, 8 up, 8 in 2024-09-10T17:59:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:51 smithi089 ceph-mon[84132]: Reconfiguring osd.1 (monmap changed)... 2024-09-10T17:59:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:51 smithi089 ceph-mon[84132]: Reconfiguring daemon osd.1 on smithi012 2024-09-10T17:59:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:51 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:51 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:51 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T17:59:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:51 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:51 smithi089 ceph-mon[84132]: osdmap e268: 8 total, 8 up, 8 in 2024-09-10T17:59:52.664 INFO:tasks.rados.rados.0.smithi012.stdout:947: finishing write tid 1 to smithi01278544-19 2024-09-10T17:59:52.665 INFO:tasks.rados.rados.0.smithi012.stdout:947: finishing write tid 2 to smithi01278544-19 2024-09-10T17:59:52.665 INFO:tasks.rados.rados.0.smithi012.stdout:947: finishing write tid 3 to smithi01278544-19 2024-09-10T17:59:52.665 INFO:tasks.rados.rados.0.smithi012.stdout:947: oid 19 updating version 0 to 422 2024-09-10T17:59:52.665 INFO:tasks.rados.rados.0.smithi012.stdout:947: oid 19 version 422 is already newer than 421 2024-09-10T17:59:52.665 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 422 (ObjNum 294 snap 97 seq_num 294) dirty exists 2024-09-10T17:59:52.665 INFO:tasks.rados.rados.0.smithi012.stdout:947: left oid 19 (ObjNum 294 snap 97 seq_num 294) 2024-09-10T17:59:52.665 INFO:tasks.rados.rados.0.smithi012.stdout:945: expect (ObjNum 271 snap 87 seq_num 271) 2024-09-10T17:59:52.834 INFO:tasks.rados.rados.0.smithi012.stdout:951: finishing copy_from to smithi01278544-10 2024-09-10T17:59:52.834 INFO:tasks.rados.rados.0.smithi012.stdout:951: got expected ENOENT (src dne) 2024-09-10T17:59:52.834 INFO:tasks.rados.rados.0.smithi012.stdout:951: finishing copy_from racing read to smithi01278544-10 2024-09-10T17:59:52.835 INFO:tasks.rados.rados.0.smithi012.stdout:946: expect (ObjNum 275 snap 88 seq_num 275) 2024-09-10T17:59:52.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:52 smithi012 ceph-mon[89611]: pgmap v70: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:52.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:52 smithi012 ceph-mon[89611]: Reconfiguring osd.2 (monmap changed)... 2024-09-10T17:59:52.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:52 smithi012 ceph-mon[89611]: Reconfiguring daemon osd.2 on smithi012 2024-09-10T17:59:52.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:52 smithi012 ceph-mon[89611]: osdmap e269: 8 total, 8 up, 8 in 2024-09-10T17:59:52.979 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:52 smithi012 ceph-mon[92029]: pgmap v70: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:52.979 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:52 smithi012 ceph-mon[92029]: Reconfiguring osd.2 (monmap changed)... 2024-09-10T17:59:52.979 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:52 smithi012 ceph-mon[92029]: Reconfiguring daemon osd.2 on smithi012 2024-09-10T17:59:52.979 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:52 smithi012 ceph-mon[92029]: osdmap e269: 8 total, 8 up, 8 in 2024-09-10T17:59:53.009 INFO:tasks.rados.rados.0.smithi012.stdout:949: expect (ObjNum 253 snap 79 seq_num 253) 2024-09-10T17:59:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:52 smithi089 ceph-mon[84132]: pgmap v70: 121 pgs: 121 active+clean; 197 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-09-10T17:59:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:52 smithi089 ceph-mon[84132]: Reconfiguring osd.2 (monmap changed)... 2024-09-10T17:59:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:52 smithi089 ceph-mon[84132]: Reconfiguring daemon osd.2 on smithi012 2024-09-10T17:59:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:52 smithi089 ceph-mon[84132]: osdmap e269: 8 total, 8 up, 8 in 2024-09-10T17:59:53.136 INFO:tasks.rados.rados.0.smithi012.stdout:948: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T17:59:53.572 INFO:tasks.rados.rados.0.smithi012.stdout:950: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T17:59:53.940 INFO:tasks.rados.rados.0.smithi012.stdout:945: done (7 left) 2024-09-10T17:59:53.940 INFO:tasks.rados.rados.0.smithi012.stdout:946: done (6 left) 2024-09-10T17:59:53.940 INFO:tasks.rados.rados.0.smithi012.stdout:947: done (5 left) 2024-09-10T17:59:53.940 INFO:tasks.rados.rados.0.smithi012.stdout:948: done (4 left) 2024-09-10T17:59:53.940 INFO:tasks.rados.rados.0.smithi012.stdout:949: done (3 left) 2024-09-10T17:59:53.940 INFO:tasks.rados.rados.0.smithi012.stdout:950: done (2 left) 2024-09-10T17:59:53.940 INFO:tasks.rados.rados.0.smithi012.stdout:951: done (1 left) 2024-09-10T17:59:53.940 INFO:tasks.rados.rados.0.smithi012.stdout:952: done (0 left) 2024-09-10T17:59:53.941 INFO:tasks.rados.rados.0.smithi012.stdout:953: copy_from oid 43 from oid 15 current snap is 97 2024-09-10T17:59:53.941 INFO:tasks.rados.rados.0.smithi012.stdout:954: snap_remove snap 84 2024-09-10T17:59:54.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 17:59:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:17:59:53] "GET /metrics HTTP/1.1" 200 36084 "" "Prometheus/2.43.0" 2024-09-10T17:59:54.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[89611]: pgmap v73: 121 pgs: 121 active+clean; 189 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 80 KiB/s wr, 13 op/s 2024-09-10T17:59:54.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:54.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:54.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[89611]: Reconfiguring osd.3 (monmap changed)... 2024-09-10T17:59:54.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T17:59:54.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:54.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[89611]: Reconfiguring daemon osd.3 on smithi012 2024-09-10T17:59:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[92029]: pgmap v73: 121 pgs: 121 active+clean; 189 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 80 KiB/s wr, 13 op/s 2024-09-10T17:59:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[92029]: Reconfiguring osd.3 (monmap changed)... 2024-09-10T17:59:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T17:59:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:54 smithi012 ceph-mon[92029]: Reconfiguring daemon osd.3 on smithi012 2024-09-10T17:59:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:54 smithi089 ceph-mon[84132]: pgmap v73: 121 pgs: 121 active+clean; 189 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 80 KiB/s wr, 13 op/s 2024-09-10T17:59:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:54 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:54 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:54 smithi089 ceph-mon[84132]: Reconfiguring osd.3 (monmap changed)... 2024-09-10T17:59:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:54 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T17:59:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:54 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:54 smithi089 ceph-mon[84132]: Reconfiguring daemon osd.3 on smithi012 2024-09-10T17:59:54.735 INFO:tasks.rados.rados.0.smithi012.stdout:954: done (1 left) 2024-09-10T17:59:54.736 INFO:tasks.rados.rados.0.smithi012.stdout:955: snap_create 2024-09-10T17:59:54.736 INFO:tasks.rados.rados.0.smithi012.stdout:953: finishing copy_from racing read to smithi01278544-43 2024-09-10T17:59:54.736 INFO:tasks.rados.rados.0.smithi012.stdout:953: finishing copy_from to smithi01278544-43 2024-09-10T17:59:54.736 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 380 (ObjNum 267 snap 86 seq_num 267) dirty exists 2024-09-10T17:59:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:953: done (1 left) 2024-09-10T17:59:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:955: done (0 left) 2024-09-10T17:59:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:956: snap_remove snap 85 2024-09-10T17:59:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[89611]: Reconfiguring mds.a (monmap changed)... 2024-09-10T17:59:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T17:59:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[89611]: Reconfiguring daemon mds.a on smithi012 2024-09-10T17:59:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[89611]: osdmap e270: 8 total, 8 up, 8 in 2024-09-10T17:59:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[92029]: Reconfiguring mds.a (monmap changed)... 2024-09-10T17:59:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T17:59:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:56.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[92029]: Reconfiguring daemon mds.a on smithi012 2024-09-10T17:59:56.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:55 smithi012 ceph-mon[92029]: osdmap e270: 8 total, 8 up, 8 in 2024-09-10T17:59:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:55 smithi089 ceph-mon[84132]: Reconfiguring mds.a (monmap changed)... 2024-09-10T17:59:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T17:59:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:55 smithi089 ceph-mon[84132]: Reconfiguring daemon mds.a on smithi012 2024-09-10T17:59:56.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:55 smithi089 ceph-mon[84132]: osdmap e270: 8 total, 8 up, 8 in 2024-09-10T17:59:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:956: done (0 left) 2024-09-10T17:59:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 98 2024-09-10T17:59:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:957: seq_num 295 ranges {1327104=147456} 2024-09-10T17:59:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:957: writing smithi01278544-25 from 1327104 to 1474560 tid 1 2024-09-10T17:59:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:958: copy_from oid 1 from oid 10 current snap is 98 2024-09-10T17:59:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:959: read oid 46 snap -1 2024-09-10T17:59:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:959: expect (ObjNum 275 snap 88 seq_num 275) 2024-09-10T17:59:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:960: read oid 38 snap -1 2024-09-10T17:59:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:960: expect (ObjNum 282 snap 90 seq_num 282) 2024-09-10T17:59:56.753 INFO:tasks.rados.rados.0.smithi012.stdout:961: rollback oid 18 current snap is 98 2024-09-10T17:59:56.753 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 95 2024-09-10T17:59:56.753 INFO:tasks.rados.rados.0.smithi012.stdout:962: delete oid 28 current snap is 98 2024-09-10T17:59:56.757 INFO:tasks.rados.rados.0.smithi012.stdout:962: done (5 left) 2024-09-10T17:59:56.757 INFO:tasks.rados.rados.0.smithi012.stdout:963: copy_from oid 17 from oid 6 current snap is 98 2024-09-10T17:59:56.757 INFO:tasks.rados.rados.0.smithi012.stdout:964: setattr oid 4 current snap is 98 2024-09-10T17:59:56.761 INFO:tasks.rados.rados.0.smithi012.stdout:961: finishing rollback tid 0 to smithi01278544-18 2024-09-10T17:59:56.761 INFO:tasks.rados.rados.0.smithi012.stdout:961: finishing rollback tid 1 to smithi01278544-18 2024-09-10T17:59:56.761 INFO:tasks.rados.rados.0.smithi012.stdout:961: finishing rollback tid 2 to smithi01278544-18 2024-09-10T17:59:56.761 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 426 (ObjNum 270 snap 87 seq_num 270) dirty exists 2024-09-10T17:59:56.761 INFO:tasks.rados.rados.0.smithi012.stdout:961: done (6 left) 2024-09-10T17:59:56.761 INFO:tasks.rados.rados.0.smithi012.stdout:965: snap_create 2024-09-10T17:59:56.761 INFO:tasks.rados.rados.0.smithi012.stdout:957: finishing write tid 1 to smithi01278544-25 2024-09-10T17:59:56.762 INFO:tasks.rados.rados.0.smithi012.stdout:957: finishing write tid 2 to smithi01278544-25 2024-09-10T17:59:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:957: finishing write tid 3 to smithi01278544-25 2024-09-10T17:59:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:957: oid 25 updating version 0 to 640 2024-09-10T17:59:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:957: oid 25 version 640 is already newer than 639 2024-09-10T17:59:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 640 (ObjNum 295 snap 98 seq_num 295) dirty exists 2024-09-10T17:59:56.766 INFO:tasks.rados.rados.0.smithi012.stdout:957: left oid 25 (ObjNum 295 snap 98 seq_num 295) 2024-09-10T17:59:56.772 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 395 (ObjNum 207 snap 55 seq_num 207) dirty exists 2024-09-10T17:59:56.777 INFO:tasks.rados.rados.0.smithi012.stdout:963: finishing copy_from racing read to smithi01278544-17 2024-09-10T17:59:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:959: expect (ObjNum 275 snap 88 seq_num 275) 2024-09-10T17:59:56.960 INFO:tasks.rados.rados.0.smithi012.stdout:963: finishing copy_from to smithi01278544-17 2024-09-10T17:59:56.960 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 277 (ObjNum 163 snap 44 seq_num 163) dirty exists 2024-09-10T17:59:56.960 INFO:tasks.rados.rados.0.smithi012.stdout:960: expect (ObjNum 282 snap 90 seq_num 282) 2024-09-10T17:59:56.978 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:56 smithi089 ceph-mon[84132]: pgmap v75: 121 pgs: 121 active+clean; 189 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 74 KiB/s wr, 12 op/s 2024-09-10T17:59:56.978 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:56 smithi089 ceph-mon[84132]: osdmap e271: 8 total, 8 up, 8 in 2024-09-10T17:59:56.978 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:56.978 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:56.978 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:56.978 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:56.978 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[89611]: pgmap v75: 121 pgs: 121 active+clean; 189 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 74 KiB/s wr, 12 op/s 2024-09-10T17:59:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[89611]: osdmap e271: 8 total, 8 up, 8 in 2024-09-10T17:59:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[92029]: pgmap v75: 121 pgs: 121 active+clean; 189 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 74 KiB/s wr, 12 op/s 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[92029]: osdmap e271: 8 total, 8 up, 8 in 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T17:59:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:57.296 INFO:tasks.rados.rados.0.smithi012.stdout:958: finishing copy_from racing read to smithi01278544-1 2024-09-10T17:59:57.296 INFO:tasks.rados.rados.0.smithi012.stdout:958: finishing copy_from to smithi01278544-1 2024-09-10T17:59:57.296 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 551 (ObjNum 281 snap 89 seq_num 281) dirty exists 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:957: done (6 left) 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:958: done (5 left) 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:959: done (4 left) 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:960: done (3 left) 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:963: done (2 left) 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:964: done (1 left) 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:965: done (0 left) 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 99 2024-09-10T17:59:57.663 INFO:tasks.rados.rados.0.smithi012.stdout:966: seq_num 297 ranges {335872=180224} 2024-09-10T17:59:57.665 INFO:tasks.rados.rados.0.smithi012.stdout:966: writing smithi01278544-6 from 335872 to 516096 tid 1 2024-09-10T17:59:57.666 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 99 2024-09-10T17:59:57.666 INFO:tasks.rados.rados.0.smithi012.stdout:967: seq_num 298 ranges {4005888=196608} 2024-09-10T17:59:57.689 INFO:tasks.rados.rados.0.smithi012.stdout:967: writing smithi01278544-44 from 4005888 to 4202496 tid 1 2024-09-10T17:59:57.689 INFO:tasks.rados.rados.0.smithi012.stdout:968: read oid 50 snap -1 2024-09-10T17:59:57.689 INFO:tasks.rados.rados.0.smithi012.stdout:968: expect deleted 2024-09-10T17:59:57.689 INFO:tasks.rados.rados.0.smithi012.stdout:969: snap_create 2024-09-10T17:59:57.689 INFO:tasks.rados.rados.0.smithi012.stdout:966: finishing write tid 1 to smithi01278544-6 2024-09-10T17:59:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:966: finishing write tid 2 to smithi01278544-6 2024-09-10T17:59:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:966: finishing write tid 3 to smithi01278544-6 2024-09-10T17:59:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:966: oid 6 updating version 0 to 287 2024-09-10T17:59:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:966: oid 6 version 287 is already newer than 286 2024-09-10T17:59:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 287 (ObjNum 297 snap 99 seq_num 297) dirty exists 2024-09-10T17:59:57.690 INFO:tasks.rados.rados.0.smithi012.stdout:966: left oid 6 (ObjNum 297 snap 99 seq_num 297) 2024-09-10T17:59:57.695 INFO:tasks.rados.rados.0.smithi012.stdout:967: finishing write tid 1 to smithi01278544-44 2024-09-10T17:59:57.695 INFO:tasks.rados.rados.0.smithi012.stdout:967: finishing write tid 2 to smithi01278544-44 2024-09-10T17:59:57.697 INFO:tasks.rados.rados.0.smithi012.stdout:967: finishing write tid 3 to smithi01278544-44 2024-09-10T17:59:57.697 INFO:tasks.rados.rados.0.smithi012.stdout:967: oid 44 updating version 0 to 598 2024-09-10T17:59:57.697 INFO:tasks.rados.rados.0.smithi012.stdout:967: oid 44 updating version 598 to 599 2024-09-10T17:59:57.697 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 599 (ObjNum 298 snap 99 seq_num 298) dirty exists 2024-09-10T17:59:57.697 INFO:tasks.rados.rados.0.smithi012.stdout:967: left oid 44 (ObjNum 298 snap 99 seq_num 298) 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: Reconfiguring mon.b (monmap changed)... 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: Reconfiguring daemon mon.b on smithi089 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: osdmap e272: 8 total, 8 up, 8 in 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: pgmap v78: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: osdmap e273: 8 total, 8 up, 8 in 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: Reconfiguring mgr.x (monmap changed)... 2024-09-10T17:59:58.030 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T17:59:58.031 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T17:59:58.031 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:58.031 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:57 smithi089 ceph-mon[84132]: Reconfiguring daemon mgr.x on smithi089 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: Reconfiguring mon.b (monmap changed)... 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: Reconfiguring daemon mon.b on smithi089 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: osdmap e272: 8 total, 8 up, 8 in 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: pgmap v78: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: osdmap e273: 8 total, 8 up, 8 in 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: Reconfiguring mgr.x (monmap changed)... 2024-09-10T17:59:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[92029]: Reconfiguring daemon mgr.x on smithi089 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: Reconfiguring mon.b (monmap changed)... 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: Reconfiguring daemon mon.b on smithi089 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: osdmap e272: 8 total, 8 up, 8 in 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: pgmap v78: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: osdmap e273: 8 total, 8 up, 8 in 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: Reconfiguring mgr.x (monmap changed)... 2024-09-10T17:59:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T17:59:58.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T17:59:58.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:58.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:57 smithi012 ceph-mon[89611]: Reconfiguring daemon mgr.x on smithi089 2024-09-10T17:59:58.669 INFO:tasks.rados.rados.0.smithi012.stdout:966: done (3 left) 2024-09-10T17:59:58.669 INFO:tasks.rados.rados.0.smithi012.stdout:967: done (2 left) 2024-09-10T17:59:58.669 INFO:tasks.rados.rados.0.smithi012.stdout:968: done (1 left) 2024-09-10T17:59:58.669 INFO:tasks.rados.rados.0.smithi012.stdout:969: done (0 left) 2024-09-10T17:59:58.669 INFO:tasks.rados.rados.0.smithi012.stdout:970: snap_create 2024-09-10T17:59:59.676 INFO:tasks.rados.rados.0.smithi012.stdout:970: done (0 left) 2024-09-10T17:59:59.676 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 101 2024-09-10T17:59:59.676 INFO:tasks.rados.rados.0.smithi012.stdout:971: seq_num 299 ranges {0=212992} 2024-09-10T17:59:59.677 INFO:tasks.rados.rados.0.smithi012.stdout:971: writing smithi01278544-5 from 0 to 212992 tid 1 2024-09-10T17:59:59.677 INFO:tasks.rados.rados.0.smithi012.stdout:972: read oid 22 snap -1 2024-09-10T17:59:59.677 INFO:tasks.rados.rados.0.smithi012.stdout:972: expect (ObjNum 271 snap 87 seq_num 271) 2024-09-10T17:59:59.677 INFO:tasks.rados.rados.0.smithi012.stdout:973: rollback oid 47 current snap is 101 2024-09-10T17:59:59.677 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 100 2024-09-10T17:59:59.678 INFO:tasks.rados.rados.0.smithi012.stdout:974: delete oid 15 current snap is 101 2024-09-10T17:59:59.681 INFO:tasks.rados.rados.0.smithi012.stdout:971: finishing write tid 1 to smithi01278544-5 2024-09-10T17:59:59.684 INFO:tasks.rados.rados.0.smithi012.stdout:974: done (3 left) 2024-09-10T17:59:59.684 INFO:tasks.rados.rados.0.smithi012.stdout:975: rollback oid 35 current snap is 101 2024-09-10T17:59:59.684 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 35 to 94 2024-09-10T17:59:59.684 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 101 2024-09-10T17:59:59.684 INFO:tasks.rados.rados.0.smithi012.stdout:976: seq_num 301 ranges {1474560=245760} 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:976: writing smithi01278544-25 from 1474560 to 1720320 tid 1 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:977: delete oid 2 current snap is 101 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:971: finishing write tid 2 to smithi01278544-5 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:975: finishing rollback tid 1 to smithi01278544-35 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 0 (ObjNum 33 snap 0 seq_num 3491047216) dirty dne 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:973: finishing rollback tid 0 to smithi01278544-47 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:971: finishing write tid 3 to smithi01278544-5 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:971: oid 5 updating version 0 to 361 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:971: oid 5 version 361 is already newer than 360 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 361 (ObjNum 299 snap 101 seq_num 299) dirty exists 2024-09-10T17:59:59.694 INFO:tasks.rados.rados.0.smithi012.stdout:971: left oid 5 (ObjNum 299 snap 101 seq_num 299) 2024-09-10T17:59:59.695 INFO:tasks.rados.rados.0.smithi012.stdout:973: finishing rollback tid 1 to smithi01278544-47 2024-09-10T17:59:59.695 INFO:tasks.rados.rados.0.smithi012.stdout:973: finishing rollback tid 2 to smithi01278544-47 2024-09-10T17:59:59.695 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 701 (ObjNum 244 snap 72 seq_num 244) dirty exists 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:971: done (5 left) 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:973: done (4 left) 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:975: done (3 left) 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:977: done (2 left) 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:978: rollback oid 8 current snap is 101 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 8 to 90 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:979: read oid 4 snap -1 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:979: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:980: read oid 41 snap 94 2024-09-10T17:59:59.697 INFO:tasks.rados.rados.0.smithi012.stdout:980: expect (ObjNum 277 snap 88 seq_num 277) 2024-09-10T17:59:59.698 INFO:tasks.rados.rados.0.smithi012.stdout:981: setattr oid 50 current snap is 101 2024-09-10T17:59:59.698 INFO:tasks.rados.rados.0.smithi012.stdout:982: copy_from oid 16 from oid 23 current snap is 101 2024-09-10T17:59:59.698 INFO:tasks.rados.rados.0.smithi012.stdout:983: delete oid 10 current snap is 101 2024-09-10T17:59:59.699 INFO:tasks.rados.rados.0.smithi012.stdout:972: expect (ObjNum 271 snap 87 seq_num 271) 2024-09-10T17:59:59.772 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:59 smithi089 ceph-mon[84132]: osdmap e274: 8 total, 8 up, 8 in 2024-09-10T17:59:59.772 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:59.772 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T17:59:59.773 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T17:59:59.773 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 17:59:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T17:59:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:976: finishing write tid 1 to smithi01278544-25 2024-09-10T17:59:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:978: finishing rollback tid 1 to smithi01278544-8 2024-09-10T17:59:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 0 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2024-09-10T17:59:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:976: finishing write tid 2 to smithi01278544-25 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:972: done (7 left) 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:978: done (6 left) 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:983: done (5 left) 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:984: setattr oid 32 current snap is 101 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:976: finishing write tid 3 to smithi01278544-25 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:976: oid 25 updating version 0 to 642 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:976: oid 25 updating version 642 to 643 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 643 (ObjNum 301 snap 101 seq_num 301) dirty exists 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:976: left oid 25 (ObjNum 301 snap 101 seq_num 301) 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 117 (ObjNum 33 snap 0 seq_num 3496786096) dirty exists 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:982: finishing copy_from racing read to smithi01278544-16 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:982: finishing copy_from to smithi01278544-16 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 389 (ObjNum 280 snap 89 seq_num 280) dirty exists 2024-09-10T17:59:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:979: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T18:00:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[89611]: osdmap e274: 8 total, 8 up, 8 in 2024-09-10T18:00:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T18:00:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[92029]: osdmap e274: 8 total, 8 up, 8 in 2024-09-10T18:00:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T18:00:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 17:59:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:00.306 INFO:tasks.rados.rados.0.smithi012.stdout:980: expect (ObjNum 277 snap 88 seq_num 277) 2024-09-10T18:00:00.511 INFO:tasks.rados.rados.0.smithi012.stdout:976: done (5 left) 2024-09-10T18:00:00.511 INFO:tasks.rados.rados.0.smithi012.stdout:979: done (4 left) 2024-09-10T18:00:00.511 INFO:tasks.rados.rados.0.smithi012.stdout:980: done (3 left) 2024-09-10T18:00:00.511 INFO:tasks.rados.rados.0.smithi012.stdout:981: done (2 left) 2024-09-10T18:00:00.511 INFO:tasks.rados.rados.0.smithi012.stdout:982: done (1 left) 2024-09-10T18:00:00.511 INFO:tasks.rados.rados.0.smithi012.stdout:985: rollback oid 26 current snap is 101 2024-09-10T18:00:00.511 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 26 to 90 2024-09-10T18:00:00.511 INFO:tasks.rados.rados.0.smithi012.stdout:986: delete oid 42 current snap is 101 2024-09-10T18:00:00.513 INFO:tasks.rados.rados.0.smithi012.stdout:986: done (2 left) 2024-09-10T18:00:00.513 INFO:tasks.rados.rados.0.smithi012.stdout:987: copy_from oid 49 from oid 42 current snap is 101 2024-09-10T18:00:00.513 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 101 2024-09-10T18:00:00.513 INFO:tasks.rados.rados.0.smithi012.stdout:988: seq_num 305 ranges {212992=311296} 2024-09-10T18:00:00.516 INFO:tasks.rados.rados.0.smithi012.stdout:988: writing smithi01278544-5 from 212992 to 524288 tid 1 2024-09-10T18:00:00.516 INFO:tasks.rados.rados.0.smithi012.stdout:989: delete oid 48 current snap is 101 2024-09-10T18:00:00.516 INFO:tasks.rados.rados.0.smithi012.stdout:987: finishing copy_from to smithi01278544-49 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:987: got expected ENOENT (src dne) 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:987: finishing copy_from racing read to smithi01278544-49 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:985: finishing rollback tid 0 to smithi01278544-26 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 539 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:985: finishing rollback tid 1 to smithi01278544-26 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:985: finishing rollback tid 2 to smithi01278544-26 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 235 (ObjNum 195 snap 50 seq_num 195) dirty exists 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:984: done (4 left) 2024-09-10T18:00:00.517 INFO:tasks.rados.rados.0.smithi012.stdout:985: done (3 left) 2024-09-10T18:00:00.518 INFO:tasks.rados.rados.0.smithi012.stdout:987: done (2 left) 2024-09-10T18:00:00.518 INFO:tasks.rados.rados.0.smithi012.stdout:989: done (1 left) 2024-09-10T18:00:00.518 INFO:tasks.rados.rados.0.smithi012.stdout:990: snap_create 2024-09-10T18:00:00.518 INFO:tasks.rados.rados.0.smithi012.stdout:988: finishing write tid 1 to smithi01278544-5 2024-09-10T18:00:00.518 INFO:tasks.rados.rados.0.smithi012.stdout:988: finishing write tid 2 to smithi01278544-5 2024-09-10T18:00:00.519 INFO:tasks.rados.rados.0.smithi012.stdout:988: finishing write tid 3 to smithi01278544-5 2024-09-10T18:00:00.519 INFO:tasks.rados.rados.0.smithi012.stdout:988: oid 5 updating version 0 to 362 2024-09-10T18:00:00.519 INFO:tasks.rados.rados.0.smithi012.stdout:988: oid 5 updating version 362 to 363 2024-09-10T18:00:00.519 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 363 (ObjNum 305 snap 101 seq_num 305) dirty exists 2024-09-10T18:00:00.519 INFO:tasks.rados.rados.0.smithi012.stdout:988: left oid 5 (ObjNum 305 snap 101 seq_num 305) 2024-09-10T18:00:00.680 INFO:tasks.rados.rados.0.smithi012.stdout:988: done (1 left) 2024-09-10T18:00:00.680 INFO:tasks.rados.rados.0.smithi012.stdout:990: done (0 left) 2024-09-10T18:00:00.680 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 102 2024-09-10T18:00:00.680 INFO:tasks.rados.rados.0.smithi012.stdout:991: seq_num 307 ranges {4005888=344064} 2024-09-10T18:00:00.704 INFO:tasks.rados.rados.0.smithi012.stdout:991: writing smithi01278544-47 from 4005888 to 4349952 tid 1 2024-09-10T18:00:00.704 INFO:tasks.rados.rados.0.smithi012.stdout:992: snap_remove snap 99 2024-09-10T18:00:00.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: pgmap v81: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-09-10T18:00:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: Reconfiguring osd.4 (monmap changed)... 2024-09-10T18:00:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: Reconfiguring daemon osd.4 on smithi089 2024-09-10T18:00:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: osdmap e275: 8 total, 8 up, 8 in 2024-09-10T18:00:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: overall HEALTH_OK 2024-09-10T18:00:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T18:00:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:00 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: pgmap v81: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-09-10T18:00:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: Reconfiguring osd.4 (monmap changed)... 2024-09-10T18:00:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: Reconfiguring daemon osd.4 on smithi089 2024-09-10T18:00:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: osdmap e275: 8 total, 8 up, 8 in 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: overall HEALTH_OK 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: pgmap v81: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 8.1 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: Reconfiguring osd.4 (monmap changed)... 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: Reconfiguring daemon osd.4 on smithi089 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: osdmap e275: 8 total, 8 up, 8 in 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: overall HEALTH_OK 2024-09-10T18:00:01.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:01.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:01.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T18:00:01.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:00 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:01.690 INFO:tasks.rados.rados.0.smithi012.stdout:992: done (1 left) 2024-09-10T18:00:01.690 INFO:tasks.rados.rados.0.smithi012.stdout:993: delete oid 9 current snap is 102 2024-09-10T18:00:01.690 INFO:tasks.rados.rados.0.smithi012.stdout:991: finishing write tid 1 to smithi01278544-47 2024-09-10T18:00:01.690 INFO:tasks.rados.rados.0.smithi012.stdout:991: finishing write tid 2 to smithi01278544-47 2024-09-10T18:00:01.691 INFO:tasks.rados.rados.0.smithi012.stdout:991: finishing write tid 3 to smithi01278544-47 2024-09-10T18:00:01.691 INFO:tasks.rados.rados.0.smithi012.stdout:991: oid 47 updating version 0 to 705 2024-09-10T18:00:01.691 INFO:tasks.rados.rados.0.smithi012.stdout:991: oid 47 updating version 705 to 706 2024-09-10T18:00:01.691 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 706 (ObjNum 307 snap 102 seq_num 307) dirty exists 2024-09-10T18:00:01.691 INFO:tasks.rados.rados.0.smithi012.stdout:991: left oid 47 (ObjNum 307 snap 102 seq_num 307) 2024-09-10T18:00:01.696 INFO:tasks.rados.rados.0.smithi012.stdout:991: done (1 left) 2024-09-10T18:00:01.696 INFO:tasks.rados.rados.0.smithi012.stdout:993: done (0 left) 2024-09-10T18:00:01.696 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 102 2024-09-10T18:00:01.696 INFO:tasks.rados.rados.0.smithi012.stdout:994: seq_num 309 ranges {4538368=376832} 2024-09-10T18:00:01.725 INFO:tasks.rados.rados.0.smithi012.stdout:994: writing smithi01278544-46 from 4538368 to 4915200 tid 1 2024-09-10T18:00:01.725 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 102 2024-09-10T18:00:01.725 INFO:tasks.rados.rados.0.smithi012.stdout:995: seq_num 310 ranges {0=401408} 2024-09-10T18:00:01.726 INFO:tasks.rados.rados.0.smithi012.stdout:995: writing smithi01278544-15 from 0 to 401408 tid 1 2024-09-10T18:00:01.726 INFO:tasks.rados.rados.0.smithi012.stdout:996: read oid 31 snap -1 2024-09-10T18:00:01.726 INFO:tasks.rados.rados.0.smithi012.stdout:996: expect deleted 2024-09-10T18:00:01.726 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 102 2024-09-10T18:00:01.727 INFO:tasks.rados.rados.0.smithi012.stdout:997: seq_num 311 ranges {2301952=417792} 2024-09-10T18:00:01.740 INFO:tasks.rados.rados.0.smithi012.stdout:997: writing smithi01278544-23 from 2301952 to 2719744 tid 1 2024-09-10T18:00:01.740 INFO:tasks.rados.rados.0.smithi012.stdout:998: snap_remove snap 100 2024-09-10T18:00:01.976 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:01 smithi089 ceph-mon[84132]: Reconfiguring osd.5 (monmap changed)... 2024-09-10T18:00:01.977 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:01 smithi089 ceph-mon[84132]: Reconfiguring daemon osd.5 on smithi089 2024-09-10T18:00:01.977 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:01 smithi089 ceph-mon[84132]: osdmap e276: 8 total, 8 up, 8 in 2024-09-10T18:00:01.977 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:01 smithi012 ceph-mon[89611]: Reconfiguring osd.5 (monmap changed)... 2024-09-10T18:00:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:01 smithi012 ceph-mon[89611]: Reconfiguring daemon osd.5 on smithi089 2024-09-10T18:00:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:01 smithi012 ceph-mon[89611]: osdmap e276: 8 total, 8 up, 8 in 2024-09-10T18:00:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:01 smithi012 ceph-mon[92029]: Reconfiguring osd.5 (monmap changed)... 2024-09-10T18:00:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:01 smithi012 ceph-mon[92029]: Reconfiguring daemon osd.5 on smithi089 2024-09-10T18:00:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:01 smithi012 ceph-mon[92029]: osdmap e276: 8 total, 8 up, 8 in 2024-09-10T18:00:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:02.663 INFO:tasks.rados.rados.0.smithi012.stdout:998: done (4 left) 2024-09-10T18:00:02.663 INFO:tasks.rados.rados.0.smithi012.stdout:999: rmattr oid 47 current snap is 102 2024-09-10T18:00:02.663 INFO:tasks.rados.rados.0.smithi012.stdout:994: finishing write tid 1 to smithi01278544-46 2024-09-10T18:00:02.663 INFO:tasks.rados.rados.0.smithi012.stdout:994: finishing write tid 2 to smithi01278544-46 2024-09-10T18:00:02.663 INFO:tasks.rados.rados.0.smithi012.stdout:995: finishing write tid 1 to smithi01278544-15 2024-09-10T18:00:02.663 INFO:tasks.rados.rados.0.smithi012.stdout:995: finishing write tid 2 to smithi01278544-15 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:994: finishing write tid 3 to smithi01278544-46 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:994: oid 46 updating version 0 to 601 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:994: oid 46 version 601 is already newer than 600 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 601 (ObjNum 309 snap 102 seq_num 309) dirty exists 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:994: left oid 46 (ObjNum 309 snap 102 seq_num 309) 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:995: finishing write tid 3 to smithi01278544-15 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:995: oid 15 updating version 0 to 436 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:995: oid 15 version 436 is already newer than 435 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 436 (ObjNum 310 snap 102 seq_num 310) dirty exists 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:995: left oid 15 (ObjNum 310 snap 102 seq_num 310) 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:997: finishing write tid 1 to smithi01278544-23 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:997: finishing write tid 2 to smithi01278544-23 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:997: finishing write tid 3 to smithi01278544-23 2024-09-10T18:00:02.664 INFO:tasks.rados.rados.0.smithi012.stdout:997: oid 23 updating version 0 to 447 2024-09-10T18:00:02.665 INFO:tasks.rados.rados.0.smithi012.stdout:997: oid 23 version 447 is already newer than 446 2024-09-10T18:00:02.665 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 447 (ObjNum 311 snap 102 seq_num 311) dirty exists 2024-09-10T18:00:02.665 INFO:tasks.rados.rados.0.smithi012.stdout:997: left oid 23 (ObjNum 311 snap 102 seq_num 311) 2024-09-10T18:00:02.665 INFO:tasks.rados.rados.0.smithi012.stdout:994: done (4 left) 2024-09-10T18:00:02.665 INFO:tasks.rados.rados.0.smithi012.stdout:995: done (3 left) 2024-09-10T18:00:02.665 INFO:tasks.rados.rados.0.smithi012.stdout:996: done (2 left) 2024-09-10T18:00:02.665 INFO:tasks.rados.rados.0.smithi012.stdout:997: done (1 left) 2024-09-10T18:00:02.665 INFO:tasks.rados.rados.0.smithi012.stdout:1000: snap_remove snap 93 2024-09-10T18:00:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[89611]: pgmap v84: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[89611]: osdmap e277: 8 total, 8 up, 8 in 2024-09-10T18:00:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T18:00:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[89611]: osdmap e278: 8 total, 8 up, 8 in 2024-09-10T18:00:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[92029]: pgmap v84: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[92029]: osdmap e277: 8 total, 8 up, 8 in 2024-09-10T18:00:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T18:00:03.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:03.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:02 smithi012 ceph-mon[92029]: osdmap e278: 8 total, 8 up, 8 in 2024-09-10T18:00:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:02 smithi089 ceph-mon[84132]: pgmap v84: 121 pgs: 121 active+clean; 131 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:02 smithi089 ceph-mon[84132]: osdmap e277: 8 total, 8 up, 8 in 2024-09-10T18:00:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T18:00:03.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:03.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:02 smithi089 ceph-mon[84132]: osdmap e278: 8 total, 8 up, 8 in 2024-09-10T18:00:03.662 INFO:tasks.rados.rados.0.smithi012.stdout:1000: done (1 left) 2024-09-10T18:00:03.662 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 102 2024-09-10T18:00:03.662 INFO:tasks.rados.rados.0.smithi012.stdout:1001: seq_num 312 ranges {1867776=434176} 2024-09-10T18:00:03.676 INFO:tasks.rados.rados.0.smithi012.stdout:1001: writing smithi01278544-37 from 1867776 to 2301952 tid 1 2024-09-10T18:00:03.676 INFO:tasks.rados.rados.0.smithi012.stdout:1002: read oid 4 snap -1 2024-09-10T18:00:03.676 INFO:tasks.rados.rados.0.smithi012.stdout:1002: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T18:00:03.676 INFO:tasks.rados.rados.0.smithi012.stdout:1003: copy_from oid 39 from oid 5 current snap is 102 2024-09-10T18:00:03.677 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 711 (ObjNum 307 snap 102 seq_num 307) dirty exists 2024-09-10T18:00:03.677 INFO:tasks.rados.rados.0.smithi012.stdout:999: done (3 left) 2024-09-10T18:00:03.677 INFO:tasks.rados.rados.0.smithi012.stdout:1004: rollback oid 11 current snap is 102 2024-09-10T18:00:03.677 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 89 2024-09-10T18:00:03.677 INFO:tasks.rados.rados.0.smithi012.stdout:1005: copy_from oid 49 from oid 7 current snap is 102 2024-09-10T18:00:03.677 INFO:tasks.rados.rados.0.smithi012.stdout:1006: setattr oid 22 current snap is 102 2024-09-10T18:00:03.678 INFO:tasks.rados.rados.0.smithi012.stdout:1004: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:00:03.678 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 0 (ObjNum 33 snap 0 seq_num 3494356928) dirty dne 2024-09-10T18:00:03.678 INFO:tasks.rados.rados.0.smithi012.stdout:1005: finishing copy_from to smithi01278544-49 2024-09-10T18:00:03.678 INFO:tasks.rados.rados.0.smithi012.stdout:1005: got expected ENOENT (src dne) 2024-09-10T18:00:03.678 INFO:tasks.rados.rados.0.smithi012.stdout:1005: finishing copy_from racing read to smithi01278544-49 2024-09-10T18:00:03.678 INFO:tasks.rados.rados.0.smithi012.stdout:1004: done (5 left) 2024-09-10T18:00:03.679 INFO:tasks.rados.rados.0.smithi012.stdout:1005: done (4 left) 2024-09-10T18:00:03.679 INFO:tasks.rados.rados.0.smithi012.stdout:1007: delete oid 49 current snap is 102 2024-09-10T18:00:03.680 INFO:tasks.rados.rados.0.smithi012.stdout:1001: finishing write tid 1 to smithi01278544-37 2024-09-10T18:00:03.681 INFO:tasks.rados.rados.0.smithi012.stdout:1007: done (4 left) 2024-09-10T18:00:03.681 INFO:tasks.rados.rados.0.smithi012.stdout:1008: read oid 33 snap -1 2024-09-10T18:00:03.682 INFO:tasks.rados.rados.0.smithi012.stdout:1008: expect (ObjNum 283 snap 90 seq_num 283) 2024-09-10T18:00:03.682 INFO:tasks.rados.rados.0.smithi012.stdout:1009: delete oid 18 current snap is 102 2024-09-10T18:00:03.684 INFO:tasks.rados.rados.0.smithi012.stdout:1003: finishing copy_from racing read to smithi01278544-39 2024-09-10T18:00:03.684 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 659 (ObjNum 271 snap 87 seq_num 271) dirty exists 2024-09-10T18:00:03.684 INFO:tasks.rados.rados.0.smithi012.stdout:1001: finishing write tid 2 to smithi01278544-37 2024-09-10T18:00:03.685 INFO:tasks.rados.rados.0.smithi012.stdout:1006: done (5 left) 2024-09-10T18:00:03.685 INFO:tasks.rados.rados.0.smithi012.stdout:1009: done (4 left) 2024-09-10T18:00:03.685 INFO:tasks.rados.rados.0.smithi012.stdout:1010: snap_remove snap 96 2024-09-10T18:00:03.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[89611]: Reconfiguring osd.6 (monmap changed)... 2024-09-10T18:00:03.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[89611]: Reconfiguring daemon osd.6 on smithi089 2024-09-10T18:00:03.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T18:00:03.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:03.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[89611]: osdmap e279: 8 total, 8 up, 8 in 2024-09-10T18:00:03.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[92029]: Reconfiguring osd.6 (monmap changed)... 2024-09-10T18:00:03.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[92029]: Reconfiguring daemon osd.6 on smithi089 2024-09-10T18:00:03.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T18:00:03.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:03.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-mon[92029]: osdmap e279: 8 total, 8 up, 8 in 2024-09-10T18:00:03.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:03 smithi089 ceph-mon[84132]: Reconfiguring osd.6 (monmap changed)... 2024-09-10T18:00:03.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:03 smithi089 ceph-mon[84132]: Reconfiguring daemon osd.6 on smithi089 2024-09-10T18:00:03.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:03 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:03 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:03.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:03 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T18:00:03.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:03 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:03.987 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:03 smithi089 ceph-mon[84132]: osdmap e279: 8 total, 8 up, 8 in 2024-09-10T18:00:04.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:00:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:00:03] "GET /metrics HTTP/1.1" 200 36081 "" "Prometheus/2.43.0" 2024-09-10T18:00:04.665 INFO:tasks.rados.rados.0.smithi012.stdout:1010: done (4 left) 2024-09-10T18:00:04.665 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 102 2024-09-10T18:00:04.665 INFO:tasks.rados.rados.0.smithi012.stdout:1003: finishing copy_from to smithi01278544-39 2024-09-10T18:00:04.665 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 363 (ObjNum 305 snap 101 seq_num 305) dirty exists 2024-09-10T18:00:04.666 INFO:tasks.rados.rados.0.smithi012.stdout:1011: seq_num 315 ranges {6725632=483328} 2024-09-10T18:00:04.706 INFO:tasks.rados.rados.0.smithi012.stdout:1011: writing smithi01278544-26 from 6725632 to 7208960 tid 1 2024-09-10T18:00:04.706 INFO:tasks.rados.rados.0.smithi012.stdout:1003: done (4 left) 2024-09-10T18:00:04.706 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 102 2024-09-10T18:00:04.706 INFO:tasks.rados.rados.0.smithi012.stdout:1012: seq_num 316 ranges {2301952=499712} 2024-09-10T18:00:04.722 INFO:tasks.rados.rados.0.smithi012.stdout:1012: writing smithi01278544-16 from 2301952 to 2801664 tid 1 2024-09-10T18:00:04.722 INFO:tasks.rados.rados.0.smithi012.stdout:1013: copy_from oid 45 from oid 30 current snap is 102 2024-09-10T18:00:04.722 INFO:tasks.rados.rados.0.smithi012.stdout:1001: finishing write tid 3 to smithi01278544-37 2024-09-10T18:00:04.722 INFO:tasks.rados.rados.0.smithi012.stdout:1001: oid 37 updating version 0 to 400 2024-09-10T18:00:04.722 INFO:tasks.rados.rados.0.smithi012.stdout:1001: oid 37 version 400 is already newer than 399 2024-09-10T18:00:04.722 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 400 (ObjNum 312 snap 102 seq_num 312) dirty exists 2024-09-10T18:00:04.722 INFO:tasks.rados.rados.0.smithi012.stdout:1001: left oid 37 (ObjNum 312 snap 102 seq_num 312) 2024-09-10T18:00:04.722 INFO:tasks.rados.rados.0.smithi012.stdout:1002: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T18:00:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:04 smithi012 ceph-mon[89611]: pgmap v87: 121 pgs: 121 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2024-09-10T18:00:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:04 smithi012 ceph-mon[89611]: Reconfiguring osd.7 (monmap changed)... 2024-09-10T18:00:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:04 smithi012 ceph-mon[89611]: Reconfiguring daemon osd.7 on smithi089 2024-09-10T18:00:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:04 smithi012 ceph-mon[89611]: osdmap e280: 8 total, 8 up, 8 in 2024-09-10T18:00:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:04 smithi012 ceph-mon[92029]: pgmap v87: 121 pgs: 121 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2024-09-10T18:00:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:04 smithi012 ceph-mon[92029]: Reconfiguring osd.7 (monmap changed)... 2024-09-10T18:00:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:04 smithi012 ceph-mon[92029]: Reconfiguring daemon osd.7 on smithi089 2024-09-10T18:00:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:04 smithi012 ceph-mon[92029]: osdmap e280: 8 total, 8 up, 8 in 2024-09-10T18:00:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:04 smithi089 ceph-mon[84132]: pgmap v87: 121 pgs: 121 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2024-09-10T18:00:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:04 smithi089 ceph-mon[84132]: Reconfiguring osd.7 (monmap changed)... 2024-09-10T18:00:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:04 smithi089 ceph-mon[84132]: Reconfiguring daemon osd.7 on smithi089 2024-09-10T18:00:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:04 smithi089 ceph-mon[84132]: osdmap e280: 8 total, 8 up, 8 in 2024-09-10T18:00:05.161 INFO:tasks.rados.rados.0.smithi012.stdout:1008: expect (ObjNum 283 snap 90 seq_num 283) 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1011: finishing write tid 1 to smithi01278544-26 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1011: finishing write tid 2 to smithi01278544-26 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1011: finishing write tid 3 to smithi01278544-26 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1011: oid 26 updating version 0 to 249 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1011: oid 26 updating version 249 to 250 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 250 (ObjNum 315 snap 102 seq_num 315) dirty exists 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1011: left oid 26 (ObjNum 315 snap 102 seq_num 315) 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1013: finishing copy_from to smithi01278544-45 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1013: got expected ENOENT (src dne) 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1013: finishing copy_from racing read to smithi01278544-45 2024-09-10T18:00:05.425 INFO:tasks.rados.rados.0.smithi012.stdout:1012: finishing write tid 1 to smithi01278544-16 2024-09-10T18:00:05.426 INFO:tasks.rados.rados.0.smithi012.stdout:1001: done (5 left) 2024-09-10T18:00:05.426 INFO:tasks.rados.rados.0.smithi012.stdout:1002: done (4 left) 2024-09-10T18:00:05.426 INFO:tasks.rados.rados.0.smithi012.stdout:1008: done (3 left) 2024-09-10T18:00:05.426 INFO:tasks.rados.rados.0.smithi012.stdout:1011: done (2 left) 2024-09-10T18:00:05.426 INFO:tasks.rados.rados.0.smithi012.stdout:1013: done (1 left) 2024-09-10T18:00:05.426 INFO:tasks.rados.rados.0.smithi012.stdout:1014: snap_remove snap 95 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1014: done (1 left) 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1015: read oid 4 snap 90 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1015: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1016: read oid 26 snap 101 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1016: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1017: snap_create 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1012: finishing write tid 2 to smithi01278544-16 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1012: finishing write tid 3 to smithi01278544-16 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1012: oid 16 updating version 0 to 390 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:1012: oid 16 updating version 390 to 391 2024-09-10T18:00:05.720 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 391 (ObjNum 316 snap 102 seq_num 316) dirty exists 2024-09-10T18:00:05.721 INFO:tasks.rados.rados.0.smithi012.stdout:1012: left oid 16 (ObjNum 316 snap 102 seq_num 316) 2024-09-10T18:00:05.749 INFO:tasks.rados.rados.0.smithi012.stdout:1015: expect (ObjNum 207 snap 55 seq_num 207) 2024-09-10T18:00:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[89611]: Reconfiguring mds.b (monmap changed)... 2024-09-10T18:00:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:00:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:06.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[89611]: Reconfiguring daemon mds.b on smithi089 2024-09-10T18:00:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[92029]: Reconfiguring mds.b (monmap changed)... 2024-09-10T18:00:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:00:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:05 smithi012 ceph-mon[92029]: Reconfiguring daemon mds.b on smithi089 2024-09-10T18:00:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:05 smithi089 ceph-mon[84132]: Reconfiguring mds.b (monmap changed)... 2024-09-10T18:00:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:00:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:05 smithi089 ceph-mon[84132]: Reconfiguring daemon mds.b on smithi089 2024-09-10T18:00:06.184 INFO:tasks.rados.rados.0.smithi012.stdout:1016: expect (ObjNum 195 snap 50 seq_num 195) 2024-09-10T18:00:06.723 INFO:tasks.rados.rados.0.smithi012.stdout:1012: done (3 left) 2024-09-10T18:00:06.723 INFO:tasks.rados.rados.0.smithi012.stdout:1015: done (2 left) 2024-09-10T18:00:06.723 INFO:tasks.rados.rados.0.smithi012.stdout:1016: done (1 left) 2024-09-10T18:00:06.723 INFO:tasks.rados.rados.0.smithi012.stdout:1017: done (0 left) 2024-09-10T18:00:06.723 INFO:tasks.rados.rados.0.smithi012.stdout:1018: copy_from oid 36 from oid 47 current snap is 103 2024-09-10T18:00:06.724 INFO:tasks.rados.rados.0.smithi012.stdout:1019: read oid 46 snap 97 2024-09-10T18:00:06.724 INFO:tasks.rados.rados.0.smithi012.stdout:1019: expect (ObjNum 275 snap 88 seq_num 275) 2024-09-10T18:00:06.724 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 103 2024-09-10T18:00:06.724 INFO:tasks.rados.rados.0.smithi012.stdout:1020: seq_num 317 ranges {5177344=516096} 2024-09-10T18:00:06.755 INFO:tasks.rados.rados.0.smithi012.stdout:1020: writing smithi01278544-41 from 5177344 to 5693440 tid 1 2024-09-10T18:00:06.755 INFO:tasks.rados.rados.0.smithi012.stdout:1021: delete oid 23 current snap is 103 2024-09-10T18:00:06.755 INFO:tasks.rados.rados.0.smithi012.stdout:1019: expect (ObjNum 275 snap 88 seq_num 275) 2024-09-10T18:00:06.935 INFO:tasks.rados.rados.0.smithi012.stdout:1018: finishing copy_from racing read to smithi01278544-36 2024-09-10T18:00:06.935 INFO:tasks.rados.rados.0.smithi012.stdout:1018: finishing copy_from to smithi01278544-36 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 711 (ObjNum 307 snap 102 seq_num 307) dirty exists 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:1020: finishing write tid 1 to smithi01278544-41 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:1020: finishing write tid 2 to smithi01278544-41 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:1020: finishing write tid 3 to smithi01278544-41 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:1020: oid 41 updating version 0 to 411 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:1020: oid 41 version 411 is already newer than 410 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 411 (ObjNum 317 snap 103 seq_num 317) dirty exists 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:1020: left oid 41 (ObjNum 317 snap 103 seq_num 317) 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:1018: done (3 left) 2024-09-10T18:00:06.936 INFO:tasks.rados.rados.0.smithi012.stdout:1019: done (2 left) 2024-09-10T18:00:06.937 INFO:tasks.rados.rados.0.smithi012.stdout:1020: done (1 left) 2024-09-10T18:00:06.937 INFO:tasks.rados.rados.0.smithi012.stdout:1021: done (0 left) 2024-09-10T18:00:06.937 INFO:tasks.rados.rados.0.smithi012.stdout:1022: rollback oid 50 current snap is 103 2024-09-10T18:00:06.937 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 98 2024-09-10T18:00:06.937 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 103 2024-09-10T18:00:06.937 INFO:tasks.rados.rados.0.smithi012.stdout:1023: seq_num 319 ranges {2015232=548864} 2024-09-10T18:00:06.949 INFO:tasks.rados.rados.0.smithi012.stdout:1023: writing smithi01278544-29 from 2015232 to 2564096 tid 1 2024-09-10T18:00:06.949 INFO:tasks.rados.rados.0.smithi012.stdout:1024: snap_remove snap 102 2024-09-10T18:00:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: pgmap v90: 121 pgs: 121 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2024-09-10T18:00:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: osdmap e281: 8 total, 8 up, 8 in 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.b"} : dispatch 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-10T18:00:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: pgmap v90: 121 pgs: 121 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: osdmap e281: 8 total, 8 up, 8 in 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.b"} : dispatch 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-10T18:00:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: pgmap v90: 121 pgs: 121 active+clean; 135 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: osdmap e281: 8 total, 8 up, 8 in 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.b"} : dispatch 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-10T18:00:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-10T18:00:07.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:07.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:07.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-10T18:00:07.733 INFO:tasks.rados.rados.0.smithi012.stdout:1024: done (2 left) 2024-09-10T18:00:07.733 INFO:tasks.rados.rados.0.smithi012.stdout:1025: snap_remove snap 90 2024-09-10T18:00:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all mon 2024-09-10T18:00:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all crash 2024-09-10T18:00:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T18:00:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[92029]: Upgrade: osd.0 is safe to restart 2024-09-10T18:00:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[92029]: osdmap e282: 8 total, 8 up, 8 in 2024-09-10T18:00:08.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all mon 2024-09-10T18:00:08.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all crash 2024-09-10T18:00:08.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T18:00:08.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[89611]: Upgrade: osd.0 is safe to restart 2024-09-10T18:00:08.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:07 smithi012 ceph-mon[89611]: osdmap e282: 8 total, 8 up, 8 in 2024-09-10T18:00:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:07 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all mon 2024-09-10T18:00:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:07 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all crash 2024-09-10T18:00:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:07 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T18:00:08.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:07 smithi089 ceph-mon[84132]: Upgrade: osd.0 is safe to restart 2024-09-10T18:00:08.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:07 smithi089 ceph-mon[84132]: osdmap e282: 8 total, 8 up, 8 in 2024-09-10T18:00:08.738 INFO:tasks.rados.rados.0.smithi012.stdout:1025: done (2 left) 2024-09-10T18:00:08.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 103 2024-09-10T18:00:08.738 INFO:tasks.rados.rados.0.smithi012.stdout:1022: finishing rollback tid 0 to smithi01278544-50 2024-09-10T18:00:08.738 INFO:tasks.rados.rados.0.smithi012.stdout:1026: seq_num 320 ranges {4038656=565248} 2024-09-10T18:00:08.764 INFO:tasks.rados.rados.0.smithi012.stdout:1026: writing smithi01278544-22 from 4038656 to 4603904 tid 1 2024-09-10T18:00:08.764 INFO:tasks.rados.rados.0.smithi012.stdout:1027: read oid 21 snap -1 2024-09-10T18:00:08.764 INFO:tasks.rados.rados.0.smithi012.stdout:1027: expect deleted 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:1028: delete oid 40 current snap is 103 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:1022: finishing rollback tid 1 to smithi01278544-50 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 120 (ObjNum 81 snap 0 seq_num 0) dirty dne 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:1023: finishing write tid 1 to smithi01278544-29 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:1023: finishing write tid 2 to smithi01278544-29 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:1023: finishing write tid 3 to smithi01278544-29 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:1023: oid 29 updating version 0 to 198 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:1023: oid 29 version 198 is already newer than 197 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 198 (ObjNum 319 snap 103 seq_num 319) dirty exists 2024-09-10T18:00:08.765 INFO:tasks.rados.rados.0.smithi012.stdout:1023: left oid 29 (ObjNum 319 snap 103 seq_num 319) 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:1026: finishing write tid 1 to smithi01278544-22 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:1022: done (4 left) 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:1023: done (3 left) 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:1027: done (2 left) 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:1028: done (1 left) 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:1029: rollback oid 27 current snap is 103 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 89 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 103 2024-09-10T18:00:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:1030: seq_num 322 ranges {0=598016} 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1030: writing smithi01278544-49 from 0 to 598016 tid 1 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1031: rollback oid 30 current snap is 103 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 89 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1026: finishing write tid 2 to smithi01278544-22 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1032: delete oid 35 current snap is 103 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1026: finishing write tid 3 to smithi01278544-22 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1026: oid 22 updating version 0 to 687 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1026: oid 22 version 687 is already newer than 686 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 687 (ObjNum 320 snap 103 seq_num 320) dirty exists 2024-09-10T18:00:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1026: left oid 22 (ObjNum 320 snap 103 seq_num 320) 2024-09-10T18:00:08.773 INFO:tasks.rados.rados.0.smithi012.stdout:1031: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:00:08.773 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-09-10T18:00:08.773 INFO:tasks.rados.rados.0.smithi012.stdout:1029: finishing rollback tid 0 to smithi01278544-27 2024-09-10T18:00:08.773 INFO:tasks.rados.rados.0.smithi012.stdout:1029: finishing rollback tid 1 to smithi01278544-27 2024-09-10T18:00:08.773 INFO:tasks.rados.rados.0.smithi012.stdout:1029: finishing rollback tid 2 to smithi01278544-27 2024-09-10T18:00:08.773 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 604 (ObjNum 195 snap 50 seq_num 195) dirty exists 2024-09-10T18:00:08.774 INFO:tasks.rados.rados.0.smithi012.stdout:1026: done (4 left) 2024-09-10T18:00:08.774 INFO:tasks.rados.rados.0.smithi012.stdout:1029: done (3 left) 2024-09-10T18:00:08.774 INFO:tasks.rados.rados.0.smithi012.stdout:1031: done (2 left) 2024-09-10T18:00:08.774 INFO:tasks.rados.rados.0.smithi012.stdout:1032: done (1 left) 2024-09-10T18:00:08.774 INFO:tasks.rados.rados.0.smithi012.stdout:1033: delete oid 18 current snap is 103 2024-09-10T18:00:08.775 INFO:tasks.rados.rados.0.smithi012.stdout:1030: finishing write tid 1 to smithi01278544-49 2024-09-10T18:00:08.775 INFO:tasks.rados.rados.0.smithi012.stdout:1030: finishing write tid 2 to smithi01278544-49 2024-09-10T18:00:08.776 INFO:tasks.rados.rados.0.smithi012.stdout:1033: done (1 left) 2024-09-10T18:00:08.776 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 103 2024-09-10T18:00:08.776 INFO:tasks.rados.rados.0.smithi012.stdout:1034: seq_num 325 ranges {6725632=647168} 2024-09-10T18:00:08.817 INFO:tasks.rados.rados.0.smithi012.stdout:1034: writing smithi01278544-27 from 6725632 to 7372800 tid 1 2024-09-10T18:00:08.817 INFO:tasks.rados.rados.0.smithi012.stdout:1035: rmattr oid 19 current snap is 103 2024-09-10T18:00:08.817 INFO:tasks.rados.rados.0.smithi012.stdout:1035: done (2 left) 2024-09-10T18:00:08.817 INFO:tasks.rados.rados.0.smithi012.stdout:1036: read oid 35 snap 89 2024-09-10T18:00:08.817 INFO:tasks.rados.rados.0.smithi012.stdout:1036: expect deleted 2024-09-10T18:00:08.817 INFO:tasks.rados.rados.0.smithi012.stdout:1037: snap_remove snap 94 2024-09-10T18:00:08.817 INFO:tasks.rados.rados.0.smithi012.stdout:1030: finishing write tid 3 to smithi01278544-49 2024-09-10T18:00:08.818 INFO:tasks.rados.rados.0.smithi012.stdout:1030: oid 49 updating version 0 to 471 2024-09-10T18:00:08.818 INFO:tasks.rados.rados.0.smithi012.stdout:1030: oid 49 updating version 471 to 472 2024-09-10T18:00:08.818 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 472 (ObjNum 322 snap 103 seq_num 322) dirty exists 2024-09-10T18:00:08.818 INFO:tasks.rados.rados.0.smithi012.stdout:1030: left oid 49 (ObjNum 322 snap 103 seq_num 322) 2024-09-10T18:00:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[89611]: pgmap v93: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2024-09-10T18:00:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[89611]: osdmap e283: 8 total, 8 up, 8 in 2024-09-10T18:00:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T18:00:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[92029]: pgmap v93: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[92029]: osdmap e283: 8 total, 8 up, 8 in 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:08 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:08 smithi089 ceph-mon[84132]: pgmap v93: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:08 smithi089 ceph-mon[84132]: osdmap e283: 8 total, 8 up, 8 in 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:08 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:08 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T18:00:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:08 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:09.746 INFO:tasks.rados.rados.0.smithi012.stdout:1030: done (3 left) 2024-09-10T18:00:09.746 INFO:tasks.rados.rados.0.smithi012.stdout:1037: done (2 left) 2024-09-10T18:00:09.746 INFO:tasks.rados.rados.0.smithi012.stdout:1038: read oid 12 snap -1 2024-09-10T18:00:09.746 INFO:tasks.rados.rados.0.smithi012.stdout:1038: expect (ObjNum 258 snap 83 seq_num 258) 2024-09-10T18:00:09.747 INFO:tasks.rados.rados.0.smithi012.stdout:1039: snap_remove snap 101 2024-09-10T18:00:09.747 INFO:tasks.rados.rados.0.smithi012.stdout:1034: finishing write tid 1 to smithi01278544-27 2024-09-10T18:00:09.747 INFO:tasks.rados.rados.0.smithi012.stdout:1034: finishing write tid 2 to smithi01278544-27 2024-09-10T18:00:09.747 INFO:tasks.rados.rados.0.smithi012.stdout:1034: finishing write tid 3 to smithi01278544-27 2024-09-10T18:00:09.747 INFO:tasks.rados.rados.0.smithi012.stdout:1034: oid 27 updating version 0 to 606 2024-09-10T18:00:09.747 INFO:tasks.rados.rados.0.smithi012.stdout:1034: oid 27 version 606 is already newer than 605 2024-09-10T18:00:09.747 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 606 (ObjNum 325 snap 103 seq_num 325) dirty exists 2024-09-10T18:00:09.747 INFO:tasks.rados.rados.0.smithi012.stdout:1034: left oid 27 (ObjNum 325 snap 103 seq_num 325) 2024-09-10T18:00:10.003 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:09 smithi012 ceph-mon[89611]: Upgrade: Updating osd.0 2024-09-10T18:00:10.003 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:09 smithi012 ceph-mon[89611]: Deploying daemon osd.0 on smithi012 2024-09-10T18:00:10.003 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:09 smithi012 ceph-mon[89611]: osdmap e284: 8 total, 8 up, 8 in 2024-09-10T18:00:10.003 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:09 smithi012 ceph-mon[92029]: Upgrade: Updating osd.0 2024-09-10T18:00:10.003 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:09 smithi012 ceph-mon[92029]: Deploying daemon osd.0 on smithi012 2024-09-10T18:00:10.003 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:09 smithi012 ceph-mon[92029]: osdmap e284: 8 total, 8 up, 8 in 2024-09-10T18:00:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:09 smithi089 ceph-mon[84132]: Upgrade: Updating osd.0 2024-09-10T18:00:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:09 smithi089 ceph-mon[84132]: Deploying daemon osd.0 on smithi012 2024-09-10T18:00:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:09 smithi089 ceph-mon[84132]: osdmap e284: 8 total, 8 up, 8 in 2024-09-10T18:00:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1034: done (3 left) 2024-09-10T18:00:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1036: done (2 left) 2024-09-10T18:00:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1039: done (1 left) 2024-09-10T18:00:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1040: copy_from oid 6 from oid 44 current snap is 103 2024-09-10T18:00:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1038: expect (ObjNum 258 snap 83 seq_num 258) 2024-09-10T18:00:10.817 INFO:tasks.rados.rados.0.smithi012.stdout:1040: finishing copy_from racing read to smithi01278544-6 2024-09-10T18:00:10.817 INFO:tasks.rados.rados.0.smithi012.stdout:1040: finishing copy_from to smithi01278544-6 2024-09-10T18:00:10.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 599 (ObjNum 298 snap 99 seq_num 298) dirty exists 2024-09-10T18:00:10.817 INFO:tasks.rados.rados.0.smithi012.stdout:1038: done (1 left) 2024-09-10T18:00:10.817 INFO:tasks.rados.rados.0.smithi012.stdout:1040: done (0 left) 2024-09-10T18:00:10.817 INFO:tasks.rados.rados.0.smithi012.stdout:1041: snap_create 2024-09-10T18:00:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:10 smithi012 ceph-mon[89611]: pgmap v96: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2024-09-10T18:00:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:10 smithi012 ceph-mon[89611]: osdmap e285: 8 total, 8 up, 8 in 2024-09-10T18:00:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:10 smithi012 ceph-mon[92029]: pgmap v96: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2024-09-10T18:00:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:10 smithi012 ceph-mon[92029]: osdmap e285: 8 total, 8 up, 8 in 2024-09-10T18:00:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:10 smithi089 ceph-mon[84132]: pgmap v96: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2024-09-10T18:00:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:10 smithi089 ceph-mon[84132]: osdmap e285: 8 total, 8 up, 8 in 2024-09-10T18:00:11.329 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:00:11.457 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:11 smithi012 systemd[1]: Stopping Ceph osd.0 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:00:11.765 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[41356]: 2024-09-10T18:00:11.469+0000 7f8350966640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:00:11.765 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[41356]: 2024-09-10T18:00:11.469+0000 7f8350966640 -1 osd.0 286 *** Got signal Terminated *** 2024-09-10T18:00:11.765 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[41356]: 2024-09-10T18:00:11.469+0000 7f8350966640 -1 osd.0 286 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:00:11.768 INFO:tasks.rados.rados.0.smithi012.stdout:1041: done (0 left) 2024-09-10T18:00:11.768 INFO:tasks.rados.rados.0.smithi012.stdout:1042: delete oid 39 current snap is 104 2024-09-10T18:00:11.782 INFO:tasks.rados.rados.0.smithi012.stdout:1042: done (0 left) 2024-09-10T18:00:11.782 INFO:tasks.rados.rados.0.smithi012.stdout:1043: rollback oid 33 current snap is 104 2024-09-10T18:00:11.782 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 33 to 103 2024-09-10T18:00:11.782 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 104 2024-09-10T18:00:11.782 INFO:tasks.rados.rados.0.smithi012.stdout:1044: seq_num 327 ranges {1933312=679936} 2024-09-10T18:00:11.796 INFO:tasks.rados.rados.0.smithi012.stdout:1044: writing smithi01278544-12 from 1933312 to 2613248 tid 1 2024-09-10T18:00:11.796 INFO:tasks.rados.rados.0.smithi012.stdout:1045: rollback oid 42 current snap is 104 2024-09-10T18:00:11.796 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 42 to 97 2024-09-10T18:00:11.797 INFO:tasks.rados.rados.0.smithi012.stdout:1043: finishing rollback tid 0 to smithi01278544-33 2024-09-10T18:00:11.797 INFO:tasks.rados.rados.0.smithi012.stdout:1046: snap_remove snap 89 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (5m) 46s ago 6m 27.4M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (6m) 32s ago 6m 87.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (7m) 46s ago 7m 18.3M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (7m) 32s ago 7m 19.6M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (93s) 32s ago 11m 452M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (2m) 46s ago 12m 516M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (79s) 46s ago 13m 39.4M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:00:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (37s) 32s ago 11m 27.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (55s) 46s ago 11m 26.8M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (5m) 46s ago 5m 15.5M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (5m) 32s ago 5m 16.9M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (10m) 46s ago 10m 152M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e a54550a62cfe 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (10m) 46s ago 10m 121M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (10m) 46s ago 10m 151M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (9m) 46s ago 9m 134M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (9m) 32s ago 9m 186M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T18:00:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (8m) 32s ago 8m 136M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T18:00:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (8m) 32s ago 8m 141M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T18:00:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (8m) 32s ago 8m 98.9M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T18:00:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (98s) 32s ago 6m 50.4M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:00:12.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[92029]: osdmap e286: 8 total, 8 up, 8 in 2024-09-10T18:00:12.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[92029]: pgmap v99: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:12.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[92029]: from='client.44135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:12.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[92029]: osd.0 marked itself down and dead 2024-09-10T18:00:12.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[92029]: from='client.34227 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:12.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[89611]: osdmap e286: 8 total, 8 up, 8 in 2024-09-10T18:00:12.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[89611]: pgmap v99: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:12.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[89611]: from='client.44135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:12.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[89611]: osd.0 marked itself down and dead 2024-09-10T18:00:12.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:11 smithi012 ceph-mon[89611]: from='client.34227 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:12.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:11 smithi089 ceph-mon[84132]: osdmap e286: 8 total, 8 up, 8 in 2024-09-10T18:00:12.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:11 smithi089 ceph-mon[84132]: pgmap v99: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:12.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:11 smithi089 ceph-mon[84132]: from='client.44135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:11 smithi089 ceph-mon[84132]: osd.0 marked itself down and dead 2024-09-10T18:00:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:11 smithi089 ceph-mon[84132]: from='client.34227 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:00:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:00:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:00:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 7 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 9, 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 5 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:00:12.308 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:00:12.613 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "5/20 daemons upgraded", 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:00:12.614 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:00:12.615 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:12 smithi012 podman[96795]: 2024-09-10 18:00:12.324070252 +0000 UTC m=+0.958675481 container died a54550a62cfe0d5c17e0c629630cecda24eb779ba34f237e9bdd371918610162 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=reef-7a853b1, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:1043: finishing rollback tid 1 to smithi01278544-33 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:1043: finishing rollback tid 2 to smithi01278544-33 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 765 (ObjNum 283 snap 90 seq_num 283) dirty exists 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:1045: finishing rollback tid 1 to smithi01278544-42 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:1045: finishing rollback tid 2 to smithi01278544-42 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 767 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:1044: finishing write tid 1 to smithi01278544-12 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:1044: finishing write tid 2 to smithi01278544-12 2024-09-10T18:00:12.663 INFO:tasks.rados.rados.0.smithi012.stdout:1044: finishing write tid 3 to smithi01278544-12 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1044: oid 12 updating version 0 to 703 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1044: oid 12 updating version 703 to 704 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 704 (ObjNum 327 snap 104 seq_num 327) dirty exists 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1044: left oid 12 (ObjNum 327 snap 104 seq_num 327) 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1043: done (3 left) 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1044: done (2 left) 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1045: done (1 left) 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1046: done (0 left) 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1047: read oid 35 snap -1 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1047: expect deleted 2024-09-10T18:00:12.664 INFO:tasks.rados.rados.0.smithi012.stdout:1048: setattr oid 4 current snap is 104 2024-09-10T18:00:12.667 INFO:tasks.rados.rados.0.smithi012.stdout:1049: delete oid 29 current snap is 104 2024-09-10T18:00:12.680 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 431 (ObjNum 207 snap 55 seq_num 207) dirty exists 2024-09-10T18:00:12.682 INFO:tasks.rados.rados.0.smithi012.stdout:1047: done (2 left) 2024-09-10T18:00:12.683 INFO:tasks.rados.rados.0.smithi012.stdout:1048: done (1 left) 2024-09-10T18:00:12.683 INFO:tasks.rados.rados.0.smithi012.stdout:1049: done (0 left) 2024-09-10T18:00:12.683 INFO:tasks.rados.rados.0.smithi012.stdout:1050: snap_create 2024-09-10T18:00:13.034 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:12 smithi012 podman[96795]: 2024-09-10 18:00:12.794535579 +0000 UTC m=+1.429140807 container cleanup a54550a62cfe0d5c17e0c629630cecda24eb779ba34f237e9bdd371918610162 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, RELEASE=reef-7a853b1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T18:00:13.034 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:12 smithi012 bash[96795]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0 2024-09-10T18:00:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[89611]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:00:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[89611]: osdmap e287: 8 total, 7 up, 8 in 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[89611]: from='client.44147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/196432802' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[89611]: from='client.34245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[89611]: osdmap e288: 8 total, 7 up, 8 in 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[92029]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[92029]: osdmap e287: 8 total, 7 up, 8 in 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[92029]: from='client.44147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/196432802' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[92029]: from='client.34245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:12 smithi012 ceph-mon[92029]: osdmap e288: 8 total, 7 up, 8 in 2024-09-10T18:00:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:12 smithi089 ceph-mon[84132]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:00:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:12 smithi089 ceph-mon[84132]: osdmap e287: 8 total, 7 up, 8 in 2024-09-10T18:00:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:12 smithi089 ceph-mon[84132]: from='client.44147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:12 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/196432802' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:12 smithi089 ceph-mon[84132]: from='client.34245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:12 smithi089 ceph-mon[84132]: osdmap e288: 8 total, 7 up, 8 in 2024-09-10T18:00:13.416 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:13 smithi012 podman[96876]: 2024-09-10 18:00:13.076080565 +0000 UTC m=+0.752723044 container remove a54550a62cfe0d5c17e0c629630cecda24eb779ba34f237e9bdd371918610162 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=reef-7a853b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:00:13.663 INFO:tasks.rados.rados.0.smithi012.stdout:1050: done (0 left) 2024-09-10T18:00:13.663 INFO:tasks.rados.rados.0.smithi012.stdout:1051: rollback oid 41 current snap is 105 2024-09-10T18:00:13.663 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 97 2024-09-10T18:00:13.663 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 105 2024-09-10T18:00:13.663 INFO:tasks.rados.rados.0.smithi012.stdout:1052: seq_num 329 ranges {6258688=712704} 2024-09-10T18:00:13.701 INFO:tasks.rados.rados.0.smithi012.stdout:1052: writing smithi01278544-4 from 6258688 to 6971392 tid 1 2024-09-10T18:00:13.701 INFO:tasks.rados.rados.0.smithi012.stdout:1053: delete oid 19 current snap is 105 2024-09-10T18:00:13.701 INFO:tasks.rados.rados.0.smithi012.stdout:1051: finishing rollback tid 0 to smithi01278544-41 2024-09-10T18:00:13.702 INFO:tasks.rados.rados.0.smithi012.stdout:1051: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:00:13.702 INFO:tasks.rados.rados.0.smithi012.stdout:1051: finishing rollback tid 2 to smithi01278544-41 2024-09-10T18:00:13.702 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 435 (ObjNum 277 snap 88 seq_num 277) dirty exists 2024-09-10T18:00:13.703 INFO:tasks.rados.rados.0.smithi012.stdout:1051: done (2 left) 2024-09-10T18:00:13.703 INFO:tasks.rados.rados.0.smithi012.stdout:1053: done (1 left) 2024-09-10T18:00:13.703 INFO:tasks.rados.rados.0.smithi012.stdout:1054: rollback oid 6 current snap is 105 2024-09-10T18:00:13.703 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 6 to 103 2024-09-10T18:00:13.703 INFO:tasks.rados.rados.0.smithi012.stdout:1055: snap_remove snap 98 2024-09-10T18:00:13.742 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:13 smithi012 podman[96988]: 2024-09-10 18:00:13.319272694 +0000 UTC m=+0.016755597 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:00:13.742 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:13 smithi012 podman[96988]: 2024-09-10 18:00:13.422071319 +0000 UTC m=+0.119554215 container create 0908d3ec5b1abc01417bc817420e6e674387710466607299c9e2c104dd5a653e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T18:00:13.742 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:13 smithi012 podman[96988]: 2024-09-10 18:00:13.641332544 +0000 UTC m=+0.338815440 container init 0908d3ec5b1abc01417bc817420e6e674387710466607299c9e2c104dd5a653e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T18:00:13.742 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:13 smithi012 podman[96988]: 2024-09-10 18:00:13.645108841 +0000 UTC m=+0.342591739 container start 0908d3ec5b1abc01417bc817420e6e674387710466607299c9e2c104dd5a653e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T18:00:13.742 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:13 smithi012 podman[96988]: 2024-09-10 18:00:13.741388818 +0000 UTC m=+0.438871726 container attach 0908d3ec5b1abc01417bc817420e6e674387710466607299c9e2c104dd5a653e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T18:00:14.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:00:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:00:13] "GET /metrics HTTP/1.1" 200 36081 "" "Prometheus/2.43.0" 2024-09-10T18:00:14.034 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:13 smithi012 podman[96988]: 2024-09-10 18:00:13.853276522 +0000 UTC m=+0.550759427 container died 0908d3ec5b1abc01417bc817420e6e674387710466607299c9e2c104dd5a653e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1055: done (2 left) 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1056: rmattr oid 26 current snap is 105 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1052: finishing write tid 1 to smithi01278544-4 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1052: finishing write tid 2 to smithi01278544-4 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1054: finishing rollback tid 0 to smithi01278544-6 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1054: finishing rollback tid 1 to smithi01278544-6 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1054: finishing rollback tid 2 to smithi01278544-6 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 602 (ObjNum 298 snap 99 seq_num 298) dirty exists 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1052: finishing write tid 3 to smithi01278544-4 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1052: oid 4 updating version 0 to 438 2024-09-10T18:00:14.670 INFO:tasks.rados.rados.0.smithi012.stdout:1052: oid 4 version 438 is already newer than 437 2024-09-10T18:00:14.671 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 438 (ObjNum 329 snap 105 seq_num 329) dirty exists 2024-09-10T18:00:14.671 INFO:tasks.rados.rados.0.smithi012.stdout:1052: left oid 4 (ObjNum 329 snap 105 seq_num 329) 2024-09-10T18:00:14.671 INFO:tasks.rados.rados.0.smithi012.stdout:1052: done (2 left) 2024-09-10T18:00:14.671 INFO:tasks.rados.rados.0.smithi012.stdout:1054: done (1 left) 2024-09-10T18:00:14.671 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 105 2024-09-10T18:00:14.671 INFO:tasks.rados.rados.0.smithi012.stdout:1057: seq_num 331 ranges {401408=753664} 2024-09-10T18:00:14.677 INFO:tasks.rados.rados.0.smithi012.stdout:1057: writing smithi01278544-15 from 401408 to 1155072 tid 1 2024-09-10T18:00:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:1058: rollback oid 46 current snap is 105 2024-09-10T18:00:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 97 2024-09-10T18:00:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:1059: rmattr oid 22 current snap is 105 2024-09-10T18:00:14.678 INFO:tasks.rados.rados.0.smithi012.stdout:1060: delete oid 13 current snap is 105 2024-09-10T18:00:14.683 INFO:tasks.rados.rados.0.smithi012.stdout:1058: finishing rollback tid 0 to smithi01278544-46 2024-09-10T18:00:14.683 INFO:tasks.rados.rados.0.smithi012.stdout:1058: finishing rollback tid 1 to smithi01278544-46 2024-09-10T18:00:14.684 INFO:tasks.rados.rados.0.smithi012.stdout:1058: finishing rollback tid 2 to smithi01278544-46 2024-09-10T18:00:14.684 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 609 (ObjNum 275 snap 88 seq_num 275) dirty exists 2024-09-10T18:00:14.686 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 716 (ObjNum 320 snap 103 seq_num 320) dirty exists 2024-09-10T18:00:14.689 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 712 (ObjNum 315 snap 102 seq_num 315) dirty exists 2024-09-10T18:00:14.689 INFO:tasks.rados.rados.0.smithi012.stdout:1056: done (4 left) 2024-09-10T18:00:14.689 INFO:tasks.rados.rados.0.smithi012.stdout:1058: done (3 left) 2024-09-10T18:00:14.689 INFO:tasks.rados.rados.0.smithi012.stdout:1059: done (2 left) 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1060: done (1 left) 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1061: read oid 17 snap -1 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1061: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1057: finishing write tid 1 to smithi01278544-15 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1057: finishing write tid 2 to smithi01278544-15 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1062: read oid 32 snap -1 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1062: expect (ObjNum 113 snap 26 seq_num 113) 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1063: read oid 40 snap 104 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1063: expect deleted 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 105 2024-09-10T18:00:14.690 INFO:tasks.rados.rados.0.smithi012.stdout:1064: seq_num 333 ranges {5808128=786432} 2024-09-10T18:00:14.730 INFO:tasks.rados.rados.0.smithi012.stdout:1064: writing smithi01278544-33 from 5808128 to 6594560 tid 1 2024-09-10T18:00:14.730 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 105 2024-09-10T18:00:14.730 INFO:tasks.rados.rados.0.smithi012.stdout:1057: finishing write tid 3 to smithi01278544-15 2024-09-10T18:00:14.730 INFO:tasks.rados.rados.0.smithi012.stdout:1057: oid 15 updating version 0 to 495 2024-09-10T18:00:14.730 INFO:tasks.rados.rados.0.smithi012.stdout:1057: oid 15 updating version 495 to 496 2024-09-10T18:00:14.731 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 496 (ObjNum 331 snap 105 seq_num 331) dirty exists 2024-09-10T18:00:14.731 INFO:tasks.rados.rados.0.smithi012.stdout:1057: left oid 15 (ObjNum 331 snap 105 seq_num 331) 2024-09-10T18:00:14.731 INFO:tasks.rados.rados.0.smithi012.stdout:1065: seq_num 334 ranges {524288=802816} 2024-09-10T18:00:14.738 INFO:tasks.rados.rados.0.smithi012.stdout:1065: writing smithi01278544-5 from 524288 to 1327104 tid 1 2024-09-10T18:00:14.738 INFO:tasks.rados.rados.0.smithi012.stdout:1057: done (5 left) 2024-09-10T18:00:14.738 INFO:tasks.rados.rados.0.smithi012.stdout:1066: rmattr oid 42 current snap is 105 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1066: done (5 left) 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1067: read oid 20 snap -1 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1067: expect (ObjNum 288 snap 94 seq_num 288) 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1068: rmattr oid 15 current snap is 105 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1068: done (6 left) 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1069: rmattr oid 37 current snap is 105 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1069: done (6 left) 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1070: copy_from oid 29 from oid 30 current snap is 105 2024-09-10T18:00:14.739 INFO:tasks.rados.rados.0.smithi012.stdout:1061: expect (ObjNum 163 snap 44 seq_num 163) 2024-09-10T18:00:14.750 INFO:tasks.rados.rados.0.smithi012.stdout:1062: expect (ObjNum 113 snap 26 seq_num 113) 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1064: finishing write tid 1 to smithi01278544-33 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1064: finishing write tid 2 to smithi01278544-33 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1064: finishing write tid 3 to smithi01278544-33 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1064: oid 33 updating version 0 to 788 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1064: oid 33 version 788 is already newer than 787 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 788 (ObjNum 333 snap 105 seq_num 333) dirty exists 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1064: left oid 33 (ObjNum 333 snap 105 seq_num 333) 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1070: finishing copy_from to smithi01278544-29 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1070: got expected ENOENT (src dne) 2024-09-10T18:00:14.833 INFO:tasks.rados.rados.0.smithi012.stdout:1070: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:00:14.834 INFO:tasks.rados.rados.0.smithi012.stdout:1067: expect (ObjNum 288 snap 94 seq_num 288) 2024-09-10T18:00:14.834 INFO:tasks.rados.rados.0.smithi012.stdout:1065: finishing write tid 1 to smithi01278544-5 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1065: finishing write tid 2 to smithi01278544-5 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1065: finishing write tid 3 to smithi01278544-5 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1065: oid 5 updating version 0 to 364 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1065: oid 5 updating version 364 to 365 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 365 (ObjNum 334 snap 105 seq_num 334) dirty exists 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1065: left oid 5 (ObjNum 334 snap 105 seq_num 334) 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1061: done (6 left) 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1062: done (5 left) 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1063: done (4 left) 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1064: done (3 left) 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1065: done (2 left) 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1067: done (1 left) 2024-09-10T18:00:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:1070: done (0 left) 2024-09-10T18:00:14.836 INFO:tasks.rados.rados.0.smithi012.stdout:1071: snap_create 2024-09-10T18:00:14.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:14 smithi012 ceph-mon[89611]: pgmap v102: 121 pgs: 54 peering, 67 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-09-10T18:00:14.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:14 smithi012 ceph-mon[89611]: osdmap e289: 8 total, 7 up, 8 in 2024-09-10T18:00:14.854 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:14 smithi012 ceph-mon[89611]: Health check failed: Reduced data availability: 11 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-10T18:00:14.854 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:14 smithi012 ceph-mon[92029]: pgmap v102: 121 pgs: 54 peering, 67 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-09-10T18:00:14.854 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:14 smithi012 ceph-mon[92029]: osdmap e289: 8 total, 7 up, 8 in 2024-09-10T18:00:14.854 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:14 smithi012 ceph-mon[92029]: Health check failed: Reduced data availability: 11 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-10T18:00:14.854 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:14 smithi012 podman[97011]: 2024-09-10 18:00:14.59540845 +0000 UTC m=+0.732488561 container remove 0908d3ec5b1abc01417bc817420e6e674387710466607299c9e2c104dd5a653e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:00:14.854 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:14 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-10T18:00:14.854 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:14 smithi012 systemd[1]: Stopped Ceph osd.0 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:00:14.854 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:14 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.0.service: Consumed 11.033s CPU time. 2024-09-10T18:00:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:14 smithi089 ceph-mon[84132]: pgmap v102: 121 pgs: 54 peering, 67 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-09-10T18:00:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:14 smithi089 ceph-mon[84132]: osdmap e289: 8 total, 7 up, 8 in 2024-09-10T18:00:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:14 smithi089 ceph-mon[84132]: Health check failed: Reduced data availability: 11 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-10T18:00:15.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:14 smithi012 systemd[1]: Starting Ceph osd.0 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:00:15.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 podman[97107]: 2024-09-10 18:00:14.96749129 +0000 UTC m=+0.016484010 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:00:15.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 podman[97107]: 2024-09-10 18:00:15.088370871 +0000 UTC m=+0.137363578 container create 8f7a2df993ffbde7bbf6ebd5d894310fc76b60e1550d5bdf36b6ffb8f4382c01 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T18:00:15.487 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 podman[97107]: 2024-09-10 18:00:15.349293319 +0000 UTC m=+0.398286025 container init 8f7a2df993ffbde7bbf6ebd5d894310fc76b60e1550d5bdf36b6ffb8f4382c01 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T18:00:15.487 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 podman[97107]: 2024-09-10 18:00:15.352826775 +0000 UTC m=+0.401819482 container start 8f7a2df993ffbde7bbf6ebd5d894310fc76b60e1550d5bdf36b6ffb8f4382c01 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T18:00:15.487 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 podman[97107]: 2024-09-10 18:00:15.449106576 +0000 UTC m=+0.498099293 container attach 8f7a2df993ffbde7bbf6ebd5d894310fc76b60e1550d5bdf36b6ffb8f4382c01 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T18:00:15.678 INFO:tasks.rados.rados.0.smithi012.stdout:1071: done (0 left) 2024-09-10T18:00:15.679 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 106 2024-09-10T18:00:15.679 INFO:tasks.rados.rados.0.smithi012.stdout:1072: seq_num 335 ranges {0=417792,417792=401408} 2024-09-10T18:00:15.680 INFO:tasks.rados.rados.0.smithi012.stdout:1072: writing smithi01278544-28 from 0 to 417792 tid 1 2024-09-10T18:00:15.683 INFO:tasks.rados.rados.0.smithi012.stdout:1072: writing smithi01278544-28 from 417792 to 819200 tid 2 2024-09-10T18:00:15.683 INFO:tasks.rados.rados.0.smithi012.stdout:1073: rmattr oid 39 current snap is 106 2024-09-10T18:00:15.683 INFO:tasks.rados.rados.0.smithi012.stdout:1073: done (1 left) 2024-09-10T18:00:15.683 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 106 2024-09-10T18:00:15.683 INFO:tasks.rados.rados.0.smithi012.stdout:1074: seq_num 336 ranges {0=434176,434176=401408} 2024-09-10T18:00:15.686 INFO:tasks.rados.rados.0.smithi012.stdout:1074: writing smithi01278544-34 from 0 to 434176 tid 1 2024-09-10T18:00:15.689 INFO:tasks.rados.rados.0.smithi012.stdout:1074: writing smithi01278544-34 from 434176 to 835584 tid 2 2024-09-10T18:00:15.689 INFO:tasks.rados.rados.0.smithi012.stdout:1075: copy_from oid 3 from oid 13 current snap is 106 2024-09-10T18:00:15.689 INFO:tasks.rados.rados.0.smithi012.stdout:1072: finishing write tid 1 to smithi01278544-28 2024-09-10T18:00:15.689 INFO:tasks.rados.rados.0.smithi012.stdout:1072: finishing write tid 2 to smithi01278544-28 2024-09-10T18:00:15.689 INFO:tasks.rados.rados.0.smithi012.stdout:1072: finishing write tid 3 to smithi01278544-28 2024-09-10T18:00:15.689 INFO:tasks.rados.rados.0.smithi012.stdout:1076: copy_from oid 32 from oid 12 current snap is 106 2024-09-10T18:00:15.689 INFO:tasks.rados.rados.0.smithi012.stdout:1077: snap_create 2024-09-10T18:00:15.691 INFO:tasks.rados.rados.0.smithi012.stdout:1075: finishing copy_from to smithi01278544-3 2024-09-10T18:00:15.691 INFO:tasks.rados.rados.0.smithi012.stdout:1075: got expected ENOENT (src dne) 2024-09-10T18:00:15.691 INFO:tasks.rados.rados.0.smithi012.stdout:1075: finishing copy_from racing read to smithi01278544-3 2024-09-10T18:00:15.691 INFO:tasks.rados.rados.0.smithi012.stdout:1074: finishing write tid 1 to smithi01278544-34 2024-09-10T18:00:15.692 INFO:tasks.rados.rados.0.smithi012.stdout:1074: finishing write tid 2 to smithi01278544-34 2024-09-10T18:00:15.692 INFO:tasks.rados.rados.0.smithi012.stdout:1074: finishing write tid 3 to smithi01278544-34 2024-09-10T18:00:15.693 INFO:tasks.rados.rados.0.smithi012.stdout:1072: finishing write tid 4 to smithi01278544-28 2024-09-10T18:00:15.693 INFO:tasks.rados.rados.0.smithi012.stdout:1072: oid 28 updating version 0 to 304 2024-09-10T18:00:15.693 INFO:tasks.rados.rados.0.smithi012.stdout:1072: oid 28 version 304 is already newer than 302 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:1072: oid 28 version 304 is already newer than 303 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 304 (ObjNum 335 snap 106 seq_num 335) dirty exists 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:1072: left oid 28 (ObjNum 335 snap 106 seq_num 335) 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:1074: finishing write tid 4 to smithi01278544-34 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:1074: oid 34 updating version 0 to 482 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:1074: oid 34 updating version 482 to 484 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:1074: oid 34 version 484 is already newer than 483 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 484 (ObjNum 336 snap 106 seq_num 336) dirty exists 2024-09-10T18:00:15.694 INFO:tasks.rados.rados.0.smithi012.stdout:1074: left oid 34 (ObjNum 336 snap 106 seq_num 336) 2024-09-10T18:00:15.702 INFO:tasks.rados.rados.0.smithi012.stdout:1076: finishing copy_from racing read to smithi01278544-32 2024-09-10T18:00:15.703 INFO:tasks.rados.rados.0.smithi012.stdout:1076: finishing copy_from to smithi01278544-32 2024-09-10T18:00:15.703 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 704 (ObjNum 327 snap 104 seq_num 327) dirty exists 2024-09-10T18:00:15.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:15 smithi012 ceph-mon[89611]: osdmap e290: 8 total, 7 up, 8 in 2024-09-10T18:00:15.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:15 smithi012 ceph-mon[92029]: osdmap e290: 8 total, 7 up, 8 in 2024-09-10T18:00:15.785 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:00:15.785 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 bash[97107]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:00:15.785 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:00:15.785 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 bash[97107]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:00:15.937 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:15 smithi089 ceph-mon[84132]: osdmap e290: 8 total, 7 up, 8 in 2024-09-10T18:00:16.253 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T18:00:16.253 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 bash[97107]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T18:00:16.253 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T18:00:16.253 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:15 smithi012 bash[97107]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T18:00:16.253 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T18:00:16.253 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 bash[97107]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T18:00:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T18:00:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 bash[97107]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T18:00:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-10T18:00:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 bash[97107]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-10T18:00:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T18:00:16.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 bash[97107]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T18:00:16.535 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate[97122]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-10T18:00:16.535 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 bash[97107]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-10T18:00:16.535 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 podman[97107]: 2024-09-10 18:00:16.281931409 +0000 UTC m=+1.330924124 container died 8f7a2df993ffbde7bbf6ebd5d894310fc76b60e1550d5bdf36b6ffb8f4382c01 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:00:16.683 INFO:tasks.rados.rados.0.smithi012.stdout:1072: done (4 left) 2024-09-10T18:00:16.683 INFO:tasks.rados.rados.0.smithi012.stdout:1074: done (3 left) 2024-09-10T18:00:16.683 INFO:tasks.rados.rados.0.smithi012.stdout:1075: done (2 left) 2024-09-10T18:00:16.683 INFO:tasks.rados.rados.0.smithi012.stdout:1076: done (1 left) 2024-09-10T18:00:16.684 INFO:tasks.rados.rados.0.smithi012.stdout:1077: done (0 left) 2024-09-10T18:00:16.684 INFO:tasks.rados.rados.0.smithi012.stdout:1078: snap_create 2024-09-10T18:00:16.955 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:16 smithi089 ceph-mon[84132]: pgmap v105: 121 pgs: 54 peering, 67 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-09-10T18:00:16.955 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:16 smithi089 ceph-mon[84132]: osdmap e291: 8 total, 7 up, 8 in 2024-09-10T18:00:16.955 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:16.955 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:16.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-mon[89611]: pgmap v105: 121 pgs: 54 peering, 67 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-09-10T18:00:16.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-mon[89611]: osdmap e291: 8 total, 7 up, 8 in 2024-09-10T18:00:16.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:16.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:16.979 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-mon[92029]: pgmap v105: 121 pgs: 54 peering, 67 active+clean; 145 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-09-10T18:00:16.979 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-mon[92029]: osdmap e291: 8 total, 7 up, 8 in 2024-09-10T18:00:16.980 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:16.980 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:17.284 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:16 smithi012 podman[97253]: 2024-09-10 18:00:16.978278459 +0000 UTC m=+0.686333199 container remove 8f7a2df993ffbde7bbf6ebd5d894310fc76b60e1550d5bdf36b6ffb8f4382c01 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T18:00:17.284 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:17 smithi012 podman[97311]: 2024-09-10 18:00:17.094635998 +0000 UTC m=+0.017019845 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:00:17.284 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:17 smithi012 podman[97311]: 2024-09-10 18:00:17.209212783 +0000 UTC m=+0.131596657 container create 9e9fabb2b979ae5352d1ce55df6c1ef03cae089bb936c00ed55778105b423d9c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:00:17.684 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:17 smithi012 podman[97311]: 2024-09-10 18:00:17.440187502 +0000 UTC m=+0.362571358 container init 9e9fabb2b979ae5352d1ce55df6c1ef03cae089bb936c00ed55778105b423d9c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:00:17.684 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:17 smithi012 podman[97311]: 2024-09-10 18:00:17.443562845 +0000 UTC m=+0.365946677 container start 9e9fabb2b979ae5352d1ce55df6c1ef03cae089bb936c00ed55778105b423d9c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:00:17.684 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-osd[97330]: -- 172.21.15.12:0/3953212410 <== mon.2 v2:172.21.15.12:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55885a5cba40 con 0x55885a5a9c00 2024-09-10T18:00:17.684 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:17 smithi012 bash[97311]: 9e9fabb2b979ae5352d1ce55df6c1ef03cae089bb936c00ed55778105b423d9c 2024-09-10T18:00:17.684 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:17 smithi012 systemd[1]: Started Ceph osd.0 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:00:17.687 INFO:tasks.rados.rados.0.smithi012.stdout:1078: done (0 left) 2024-09-10T18:00:17.687 INFO:tasks.rados.rados.0.smithi012.stdout:1079: snap_remove snap 106 2024-09-10T18:00:18.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-mon[92029]: osdmap e292: 8 total, 7 up, 8 in 2024-09-10T18:00:18.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:18.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:18.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:18.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-mon[89611]: osdmap e292: 8 total, 7 up, 8 in 2024-09-10T18:00:18.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:18.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:18.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:18.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:17 smithi089 ceph-mon[84132]: osdmap e292: 8 total, 7 up, 8 in 2024-09-10T18:00:18.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:18.688 INFO:tasks.rados.rados.0.smithi012.stdout:1079: done (0 left) 2024-09-10T18:00:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:1080: rollback oid 5 current snap is 108 2024-09-10T18:00:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 5 to 104 2024-09-10T18:00:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 108 2024-09-10T18:00:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:1081: seq_num 337 ranges {0=450560,450560=401408} 2024-09-10T18:00:18.691 INFO:tasks.rados.rados.0.smithi012.stdout:1081: writing smithi01278544-29 from 0 to 450560 tid 1 2024-09-10T18:00:18.695 INFO:tasks.rados.rados.0.smithi012.stdout:1081: writing smithi01278544-29 from 450560 to 851968 tid 2 2024-09-10T18:00:18.695 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 108 2024-09-10T18:00:18.695 INFO:tasks.rados.rados.0.smithi012.stdout:1080: finishing rollback tid 0 to smithi01278544-5 2024-09-10T18:00:18.695 INFO:tasks.rados.rados.0.smithi012.stdout:1080: finishing rollback tid 1 to smithi01278544-5 2024-09-10T18:00:18.695 INFO:tasks.rados.rados.0.smithi012.stdout:1082: seq_num 338 ranges {0=466944,466944=401408} 2024-09-10T18:00:18.698 INFO:tasks.rados.rados.0.smithi012.stdout:1082: writing smithi01278544-10 from 0 to 466944 tid 1 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:1082: writing smithi01278544-10 from 466944 to 868352 tid 2 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:1083: delete oid 26 current snap is 108 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:1080: finishing rollback tid 2 to smithi01278544-5 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 368 (ObjNum 305 snap 101 seq_num 305) dirty exists 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:1081: finishing write tid 1 to smithi01278544-29 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:1081: finishing write tid 2 to smithi01278544-29 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:1081: finishing write tid 3 to smithi01278544-29 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:1081: finishing write tid 4 to smithi01278544-29 2024-09-10T18:00:18.701 INFO:tasks.rados.rados.0.smithi012.stdout:1081: oid 29 updating version 0 to 201 2024-09-10T18:00:18.702 INFO:tasks.rados.rados.0.smithi012.stdout:1081: oid 29 version 201 is already newer than 200 2024-09-10T18:00:18.702 INFO:tasks.rados.rados.0.smithi012.stdout:1081: oid 29 updating version 201 to 202 2024-09-10T18:00:18.702 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 202 (ObjNum 337 snap 108 seq_num 337) dirty exists 2024-09-10T18:00:18.702 INFO:tasks.rados.rados.0.smithi012.stdout:1081: left oid 29 (ObjNum 337 snap 108 seq_num 337) 2024-09-10T18:00:18.703 INFO:tasks.rados.rados.0.smithi012.stdout:1082: finishing write tid 1 to smithi01278544-10 2024-09-10T18:00:18.704 INFO:tasks.rados.rados.0.smithi012.stdout:1082: finishing write tid 2 to smithi01278544-10 2024-09-10T18:00:18.704 INFO:tasks.rados.rados.0.smithi012.stdout:1082: finishing write tid 3 to smithi01278544-10 2024-09-10T18:00:18.704 INFO:tasks.rados.rados.0.smithi012.stdout:1080: done (3 left) 2024-09-10T18:00:18.705 INFO:tasks.rados.rados.0.smithi012.stdout:1081: done (2 left) 2024-09-10T18:00:18.705 INFO:tasks.rados.rados.0.smithi012.stdout:1083: done (1 left) 2024-09-10T18:00:18.705 INFO:tasks.rados.rados.0.smithi012.stdout:1084: read oid 39 snap -1 2024-09-10T18:00:18.705 INFO:tasks.rados.rados.0.smithi012.stdout:1084: expect deleted 2024-09-10T18:00:18.705 INFO:tasks.rados.rados.0.smithi012.stdout:1085: snap_remove snap 105 2024-09-10T18:00:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:18 smithi012 ceph-mon[89611]: pgmap v108: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s; 54/339 objects degraded (15.929%) 2024-09-10T18:00:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:18 smithi012 ceph-mon[89611]: Health check failed: Degraded data redundancy: 54/339 objects degraded (15.929%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:18 smithi012 ceph-mon[89611]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 11 pgs inactive, 14 pgs peering) 2024-09-10T18:00:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:18 smithi012 ceph-mon[89611]: osdmap e293: 8 total, 7 up, 8 in 2024-09-10T18:00:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:18 smithi012 ceph-mon[92029]: pgmap v108: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s; 54/339 objects degraded (15.929%) 2024-09-10T18:00:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:18 smithi012 ceph-mon[92029]: Health check failed: Degraded data redundancy: 54/339 objects degraded (15.929%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:18 smithi012 ceph-mon[92029]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 11 pgs inactive, 14 pgs peering) 2024-09-10T18:00:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:18 smithi012 ceph-mon[92029]: osdmap e293: 8 total, 7 up, 8 in 2024-09-10T18:00:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:18 smithi089 ceph-mon[84132]: pgmap v108: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s; 54/339 objects degraded (15.929%) 2024-09-10T18:00:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:18 smithi089 ceph-mon[84132]: Health check failed: Degraded data redundancy: 54/339 objects degraded (15.929%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:18 smithi089 ceph-mon[84132]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 11 pgs inactive, 14 pgs peering) 2024-09-10T18:00:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:18 smithi089 ceph-mon[84132]: osdmap e293: 8 total, 7 up, 8 in 2024-09-10T18:00:19.534 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:19 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[97326]: 2024-09-10T18:00:19.096+0000 7f85592ec640 -1 Falling back to public interface 2024-09-10T18:00:19.697 INFO:tasks.rados.rados.0.smithi012.stdout:1085: done (2 left) 2024-09-10T18:00:19.697 INFO:tasks.rados.rados.0.smithi012.stdout:1086: snap_remove snap 104 2024-09-10T18:00:20.017 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:19 smithi012 ceph-mon[89611]: osdmap e294: 8 total, 7 up, 8 in 2024-09-10T18:00:20.018 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:19 smithi012 ceph-mon[92029]: osdmap e294: 8 total, 7 up, 8 in 2024-09-10T18:00:20.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:19 smithi089 ceph-mon[84132]: osdmap e294: 8 total, 7 up, 8 in 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:1086: done (2 left) 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 108 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:1082: finishing write tid 4 to smithi01278544-10 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:1082: oid 10 updating version 0 to 727 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:1082: oid 10 updating version 727 to 728 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:1082: oid 10 updating version 728 to 729 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 729 (ObjNum 338 snap 108 seq_num 338) dirty exists 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:1082: left oid 10 (ObjNum 338 snap 108 seq_num 338) 2024-09-10T18:00:20.709 INFO:tasks.rados.rados.0.smithi012.stdout:1087: seq_num 340 ranges {4349952=499712,4849664=401408} 2024-09-10T18:00:20.735 INFO:tasks.rados.rados.0.smithi012.stdout:1087: writing smithi01278544-47 from 4349952 to 4849664 tid 1 2024-09-10T18:00:20.738 INFO:tasks.rados.rados.0.smithi012.stdout:1087: writing smithi01278544-47 from 4849664 to 5251072 tid 2 2024-09-10T18:00:20.738 INFO:tasks.rados.rados.0.smithi012.stdout:1082: done (2 left) 2024-09-10T18:00:20.738 INFO:tasks.rados.rados.0.smithi012.stdout:1088: copy_from oid 24 from oid 27 current snap is 108 2024-09-10T18:00:20.738 INFO:tasks.rados.rados.0.smithi012.stdout:1084: done (2 left) 2024-09-10T18:00:20.738 INFO:tasks.rados.rados.0.smithi012.stdout:1089: snap_create 2024-09-10T18:00:20.740 INFO:tasks.rados.rados.0.smithi012.stdout:1087: finishing write tid 1 to smithi01278544-47 2024-09-10T18:00:20.743 INFO:tasks.rados.rados.0.smithi012.stdout:1087: finishing write tid 2 to smithi01278544-47 2024-09-10T18:00:20.743 INFO:tasks.rados.rados.0.smithi012.stdout:1087: finishing write tid 3 to smithi01278544-47 2024-09-10T18:00:20.744 INFO:tasks.rados.rados.0.smithi012.stdout:1087: finishing write tid 4 to smithi01278544-47 2024-09-10T18:00:20.744 INFO:tasks.rados.rados.0.smithi012.stdout:1087: oid 47 updating version 0 to 793 2024-09-10T18:00:20.744 INFO:tasks.rados.rados.0.smithi012.stdout:1087: oid 47 updating version 793 to 794 2024-09-10T18:00:20.744 INFO:tasks.rados.rados.0.smithi012.stdout:1087: oid 47 version 794 is already newer than 792 2024-09-10T18:00:20.745 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 794 (ObjNum 340 snap 108 seq_num 340) dirty exists 2024-09-10T18:00:20.745 INFO:tasks.rados.rados.0.smithi012.stdout:1087: left oid 47 (ObjNum 340 snap 108 seq_num 340) 2024-09-10T18:00:20.767 INFO:tasks.rados.rados.0.smithi012.stdout:1088: finishing copy_from racing read to smithi01278544-24 2024-09-10T18:00:20.773 INFO:tasks.rados.rados.0.smithi012.stdout:1088: finishing copy_from to smithi01278544-24 2024-09-10T18:00:20.773 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 606 (ObjNum 325 snap 103 seq_num 325) dirty exists 2024-09-10T18:00:20.865 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:20 smithi012 ceph-mon[89611]: pgmap v111: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s; 54/339 objects degraded (15.929%) 2024-09-10T18:00:20.865 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:20 smithi012 ceph-mon[89611]: osdmap e295: 8 total, 7 up, 8 in 2024-09-10T18:00:20.865 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:20 smithi012 ceph-mon[92029]: pgmap v111: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s; 54/339 objects degraded (15.929%) 2024-09-10T18:00:20.865 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:20 smithi012 ceph-mon[92029]: osdmap e295: 8 total, 7 up, 8 in 2024-09-10T18:00:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:20 smithi089 ceph-mon[84132]: pgmap v111: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s; 54/339 objects degraded (15.929%) 2024-09-10T18:00:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:20 smithi089 ceph-mon[84132]: osdmap e295: 8 total, 7 up, 8 in 2024-09-10T18:00:21.719 INFO:tasks.rados.rados.0.smithi012.stdout:1087: done (2 left) 2024-09-10T18:00:21.719 INFO:tasks.rados.rados.0.smithi012.stdout:1088: done (1 left) 2024-09-10T18:00:21.719 INFO:tasks.rados.rados.0.smithi012.stdout:1089: done (0 left) 2024-09-10T18:00:21.719 INFO:tasks.rados.rados.0.smithi012.stdout:1090: delete oid 3 current snap is 109 2024-09-10T18:00:21.722 INFO:tasks.rados.rados.0.smithi012.stdout:1090: done (0 left) 2024-09-10T18:00:21.723 INFO:tasks.rados.rados.0.smithi012.stdout:1091: read oid 6 snap -1 2024-09-10T18:00:21.723 INFO:tasks.rados.rados.0.smithi012.stdout:1091: expect (ObjNum 298 snap 99 seq_num 298) 2024-09-10T18:00:21.723 INFO:tasks.rados.rados.0.smithi012.stdout:1092: setattr oid 21 current snap is 109 2024-09-10T18:00:21.723 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 109 2024-09-10T18:00:21.723 INFO:tasks.rados.rados.0.smithi012.stdout:1093: seq_num 342 ranges {2301952=532480,2834432=401408} 2024-09-10T18:00:21.739 INFO:tasks.rados.rados.0.smithi012.stdout:1093: writing smithi01278544-37 from 2301952 to 2834432 tid 1 2024-09-10T18:00:21.742 INFO:tasks.rados.rados.0.smithi012.stdout:1093: writing smithi01278544-37 from 2834432 to 3235840 tid 2 2024-09-10T18:00:21.742 INFO:tasks.rados.rados.0.smithi012.stdout:1094: snap_create 2024-09-10T18:00:21.742 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 485 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:00:21.742 INFO:tasks.rados.rados.0.smithi012.stdout:1091: expect (ObjNum 298 snap 99 seq_num 298) 2024-09-10T18:00:21.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:21 smithi012 ceph-mon[89611]: osdmap e296: 8 total, 7 up, 8 in 2024-09-10T18:00:21.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:21.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:21.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:21.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:21 smithi012 ceph-mon[92029]: osdmap e296: 8 total, 7 up, 8 in 2024-09-10T18:00:21.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:21.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:21.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:21.977 INFO:tasks.rados.rados.0.smithi012.stdout:1093: finishing write tid 1 to smithi01278544-37 2024-09-10T18:00:21.978 INFO:tasks.rados.rados.0.smithi012.stdout:1093: finishing write tid 2 to smithi01278544-37 2024-09-10T18:00:21.978 INFO:tasks.rados.rados.0.smithi012.stdout:1093: finishing write tid 3 to smithi01278544-37 2024-09-10T18:00:21.978 INFO:tasks.rados.rados.0.smithi012.stdout:1093: finishing write tid 4 to smithi01278544-37 2024-09-10T18:00:21.978 INFO:tasks.rados.rados.0.smithi012.stdout:1093: oid 37 updating version 0 to 443 2024-09-10T18:00:21.978 INFO:tasks.rados.rados.0.smithi012.stdout:1093: oid 37 version 443 is already newer than 442 2024-09-10T18:00:21.978 INFO:tasks.rados.rados.0.smithi012.stdout:1093: oid 37 version 443 is already newer than 441 2024-09-10T18:00:21.978 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 443 (ObjNum 342 snap 109 seq_num 342) dirty exists 2024-09-10T18:00:21.978 INFO:tasks.rados.rados.0.smithi012.stdout:1093: left oid 37 (ObjNum 342 snap 109 seq_num 342) 2024-09-10T18:00:22.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:21 smithi089 ceph-mon[84132]: osdmap e296: 8 total, 7 up, 8 in 2024-09-10T18:00:22.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:22.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:22.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:22.663 INFO:tasks.rados.rados.0.smithi012.stdout:1091: done (3 left) 2024-09-10T18:00:22.663 INFO:tasks.rados.rados.0.smithi012.stdout:1092: done (2 left) 2024-09-10T18:00:22.663 INFO:tasks.rados.rados.0.smithi012.stdout:1093: done (1 left) 2024-09-10T18:00:22.663 INFO:tasks.rados.rados.0.smithi012.stdout:1094: done (0 left) 2024-09-10T18:00:22.664 INFO:tasks.rados.rados.0.smithi012.stdout:1095: copy_from oid 6 from oid 49 current snap is 110 2024-09-10T18:00:22.664 INFO:tasks.rados.rados.0.smithi012.stdout:1096: rollback oid 33 current snap is 110 2024-09-10T18:00:22.664 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 33 to 108 2024-09-10T18:00:22.664 INFO:tasks.rados.rados.0.smithi012.stdout:1097: copy_from oid 38 from oid 1 current snap is 110 2024-09-10T18:00:22.664 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 110 2024-09-10T18:00:22.664 INFO:tasks.rados.rados.0.smithi012.stdout:1098: seq_num 343 ranges {2801664=548864,3350528=401408} 2024-09-10T18:00:22.682 INFO:tasks.rados.rados.0.smithi012.stdout:1098: writing smithi01278544-16 from 2801664 to 3350528 tid 1 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:1098: writing smithi01278544-16 from 3350528 to 3751936 tid 2 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:1099: snap_create 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:1096: finishing rollback tid 0 to smithi01278544-33 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:1096: finishing rollback tid 1 to smithi01278544-33 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:1096: finishing rollback tid 2 to smithi01278544-33 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 798 (ObjNum 333 snap 105 seq_num 333) dirty exists 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:1095: finishing copy_from racing read to smithi01278544-6 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:1095: finishing copy_from to smithi01278544-6 2024-09-10T18:00:22.685 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 472 (ObjNum 322 snap 103 seq_num 322) dirty exists 2024-09-10T18:00:22.686 INFO:tasks.rados.rados.0.smithi012.stdout:1098: finishing write tid 1 to smithi01278544-16 2024-09-10T18:00:22.688 INFO:tasks.rados.rados.0.smithi012.stdout:1098: finishing write tid 2 to smithi01278544-16 2024-09-10T18:00:22.688 INFO:tasks.rados.rados.0.smithi012.stdout:1098: finishing write tid 3 to smithi01278544-16 2024-09-10T18:00:22.689 INFO:tasks.rados.rados.0.smithi012.stdout:1098: finishing write tid 4 to smithi01278544-16 2024-09-10T18:00:22.689 INFO:tasks.rados.rados.0.smithi012.stdout:1098: oid 16 updating version 0 to 603 2024-09-10T18:00:22.689 INFO:tasks.rados.rados.0.smithi012.stdout:1098: oid 16 updating version 603 to 605 2024-09-10T18:00:22.690 INFO:tasks.rados.rados.0.smithi012.stdout:1098: oid 16 version 605 is already newer than 604 2024-09-10T18:00:22.690 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 605 (ObjNum 343 snap 110 seq_num 343) dirty exists 2024-09-10T18:00:22.690 INFO:tasks.rados.rados.0.smithi012.stdout:1098: left oid 16 (ObjNum 343 snap 110 seq_num 343) 2024-09-10T18:00:22.696 INFO:tasks.rados.rados.0.smithi012.stdout:1097: finishing copy_from racing read to smithi01278544-38 2024-09-10T18:00:22.699 INFO:tasks.rados.rados.0.smithi012.stdout:1097: finishing copy_from to smithi01278544-38 2024-09-10T18:00:22.699 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 551 (ObjNum 281 snap 89 seq_num 281) dirty exists 2024-09-10T18:00:23.034 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[97326]: 2024-09-10T18:00:22.788+0000 7f85592ec640 -1 osd.0 286 log_to_monitors true 2024-09-10T18:00:23.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-mon[92029]: pgmap v114: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 54/339 objects degraded (15.929%) 2024-09-10T18:00:23.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-mon[92029]: osdmap e297: 8 total, 7 up, 8 in 2024-09-10T18:00:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-mon[92029]: osdmap e298: 8 total, 7 up, 8 in 2024-09-10T18:00:23.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-mon[89611]: pgmap v114: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 54/339 objects degraded (15.929%) 2024-09-10T18:00:23.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:23.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-mon[89611]: osdmap e297: 8 total, 7 up, 8 in 2024-09-10T18:00:23.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:22 smithi012 ceph-mon[89611]: osdmap e298: 8 total, 7 up, 8 in 2024-09-10T18:00:23.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:22 smithi089 ceph-mon[84132]: pgmap v114: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 148 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 54/339 objects degraded (15.929%) 2024-09-10T18:00:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:22 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:22 smithi089 ceph-mon[84132]: osdmap e297: 8 total, 7 up, 8 in 2024-09-10T18:00:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:22 smithi089 ceph-mon[84132]: osdmap e298: 8 total, 7 up, 8 in 2024-09-10T18:00:23.666 INFO:tasks.rados.rados.0.smithi012.stdout:1095: done (4 left) 2024-09-10T18:00:23.666 INFO:tasks.rados.rados.0.smithi012.stdout:1096: done (3 left) 2024-09-10T18:00:23.666 INFO:tasks.rados.rados.0.smithi012.stdout:1097: done (2 left) 2024-09-10T18:00:23.666 INFO:tasks.rados.rados.0.smithi012.stdout:1098: done (1 left) 2024-09-10T18:00:23.666 INFO:tasks.rados.rados.0.smithi012.stdout:1099: done (0 left) 2024-09-10T18:00:23.666 INFO:tasks.rados.rados.0.smithi012.stdout:1100: copy_from oid 31 from oid 47 current snap is 111 2024-09-10T18:00:23.666 INFO:tasks.rados.rados.0.smithi012.stdout:1101: read oid 12 snap 108 2024-09-10T18:00:23.667 INFO:tasks.rados.rados.0.smithi012.stdout:1101: expect (ObjNum 327 snap 104 seq_num 327) 2024-09-10T18:00:23.667 INFO:tasks.rados.rados.0.smithi012.stdout:1102: delete oid 32 current snap is 111 2024-09-10T18:00:23.668 INFO:tasks.rados.rados.0.smithi012.stdout:1102: done (2 left) 2024-09-10T18:00:23.668 INFO:tasks.rados.rados.0.smithi012.stdout:1103: snap_create 2024-09-10T18:00:23.682 INFO:tasks.rados.rados.0.smithi012.stdout:1101: expect (ObjNum 327 snap 104 seq_num 327) 2024-09-10T18:00:23.793 INFO:tasks.rados.rados.0.smithi012.stdout:1100: finishing copy_from racing read to smithi01278544-31 2024-09-10T18:00:23.793 INFO:tasks.rados.rados.0.smithi012.stdout:1100: finishing copy_from to smithi01278544-31 2024-09-10T18:00:23.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 794 (ObjNum 340 snap 108 seq_num 340) dirty exists 2024-09-10T18:00:23.984 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[97326]: 2024-09-10T18:00:23.695+0000 7f854d08e640 -1 osd.0 286 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T18:00:23.984 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-mon[89611]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T18:00:23.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-mon[89611]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T18:00:23.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-mon[89611]: osdmap e299: 8 total, 7 up, 8 in 2024-09-10T18:00:23.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-mon[89611]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:23.985 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-mon[92029]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T18:00:23.985 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-mon[92029]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T18:00:23.985 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-mon[92029]: osdmap e299: 8 total, 7 up, 8 in 2024-09-10T18:00:23.985 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-mon[92029]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:23 smithi089 ceph-mon[84132]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T18:00:24.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:23 smithi089 ceph-mon[84132]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T18:00:24.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:23 smithi089 ceph-mon[84132]: osdmap e299: 8 total, 7 up, 8 in 2024-09-10T18:00:24.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:23 smithi089 ceph-mon[84132]: from='osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:24.279 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:00:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:00:23] "GET /metrics HTTP/1.1" 200 36216 "" "Prometheus/2.43.0" 2024-09-10T18:00:24.668 INFO:tasks.rados.rados.0.smithi012.stdout:1100: done (2 left) 2024-09-10T18:00:24.669 INFO:tasks.rados.rados.0.smithi012.stdout:1101: done (1 left) 2024-09-10T18:00:24.669 INFO:tasks.rados.rados.0.smithi012.stdout:1103: done (0 left) 2024-09-10T18:00:24.669 INFO:tasks.rados.rados.0.smithi012.stdout:1104: copy_from oid 38 from oid 8 current snap is 112 2024-09-10T18:00:24.669 INFO:tasks.rados.rados.0.smithi012.stdout:1105: delete oid 42 current snap is 112 2024-09-10T18:00:24.681 INFO:tasks.rados.rados.0.smithi012.stdout:1105: done (1 left) 2024-09-10T18:00:24.681 INFO:tasks.rados.rados.0.smithi012.stdout:1106: delete oid 29 current snap is 112 2024-09-10T18:00:24.683 INFO:tasks.rados.rados.0.smithi012.stdout:1106: done (1 left) 2024-09-10T18:00:24.684 INFO:tasks.rados.rados.0.smithi012.stdout:1107: rollback oid 27 current snap is 112 2024-09-10T18:00:24.684 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 97 2024-09-10T18:00:24.684 INFO:tasks.rados.rados.0.smithi012.stdout:1108: snap_remove snap 111 2024-09-10T18:00:24.913 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[89611]: pgmap v117: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 159 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 11 op/s; 55/351 objects degraded (15.670%) 2024-09-10T18:00:24.913 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 55/351 objects degraded (15.670%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:24.913 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[89611]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:00:24.913 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[89611]: osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593] boot 2024-09-10T18:00:24.913 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[89611]: osdmap e300: 8 total, 8 up, 8 in 2024-09-10T18:00:24.913 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T18:00:24.914 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[92029]: pgmap v117: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 159 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 11 op/s; 55/351 objects degraded (15.670%) 2024-09-10T18:00:24.914 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 55/351 objects degraded (15.670%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:24.914 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[92029]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:00:24.914 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[92029]: osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593] boot 2024-09-10T18:00:24.914 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[92029]: osdmap e300: 8 total, 8 up, 8 in 2024-09-10T18:00:24.914 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:24 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T18:00:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:24 smithi089 ceph-mon[84132]: pgmap v117: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 159 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 11 op/s; 55/351 objects degraded (15.670%) 2024-09-10T18:00:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:24 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 55/351 objects degraded (15.670%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:24 smithi089 ceph-mon[84132]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:00:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:24 smithi089 ceph-mon[84132]: osd.0 [v2:172.21.15.12:6802/1262065593,v1:172.21.15.12:6803/1262065593] boot 2024-09-10T18:00:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:24 smithi089 ceph-mon[84132]: osdmap e300: 8 total, 8 up, 8 in 2024-09-10T18:00:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:24 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T18:00:25.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:00:25.075+0000 7f7a9b686640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T18:00:25.678 INFO:tasks.rados.rados.0.smithi012.stdout:1108: done (2 left) 2024-09-10T18:00:25.679 INFO:tasks.rados.rados.0.smithi012.stdout:1109: snap_remove snap 109 2024-09-10T18:00:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: pgmap v120: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 159 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 11 op/s; 55/351 objects degraded (15.670%) 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[92029]: osdmap e301: 8 total, 8 up, 8 in 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: pgmap v120: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 159 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 11 op/s; 55/351 objects degraded (15.670%) 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T18:00:26.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:25 smithi012 ceph-mon[89611]: osdmap e301: 8 total, 8 up, 8 in 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: pgmap v120: 121 pgs: 40 active+undersized, 14 active+undersized+degraded, 67 active+clean; 159 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 11 op/s; 55/351 objects degraded (15.670%) 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-10T18:00:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T18:00:26.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T18:00:26.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:25 smithi089 ceph-mon[84132]: osdmap e301: 8 total, 8 up, 8 in 2024-09-10T18:00:26.671 INFO:tasks.rados.rados.0.smithi012.stdout:1109: done (2 left) 2024-09-10T18:00:26.671 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 112 2024-09-10T18:00:26.672 INFO:tasks.rados.rados.0.smithi012.stdout:1107: finishing rollback tid 0 to smithi01278544-27 2024-09-10T18:00:26.672 INFO:tasks.rados.rados.0.smithi012.stdout:1110: seq_num 347 ranges {4202496=614400,4816896=401408} 2024-09-10T18:00:26.698 INFO:tasks.rados.rados.0.smithi012.stdout:1110: writing smithi01278544-44 from 4202496 to 4816896 tid 1 2024-09-10T18:00:26.700 INFO:tasks.rados.rados.0.smithi012.stdout:1110: writing smithi01278544-44 from 4816896 to 5218304 tid 2 2024-09-10T18:00:26.700 INFO:tasks.rados.rados.0.smithi012.stdout:1111: rollback oid 13 current snap is 112 2024-09-10T18:00:26.700 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 13 to 103 2024-09-10T18:00:26.701 INFO:tasks.rados.rados.0.smithi012.stdout:1107: finishing rollback tid 1 to smithi01278544-27 2024-09-10T18:00:26.701 INFO:tasks.rados.rados.0.smithi012.stdout:1107: finishing rollback tid 2 to smithi01278544-27 2024-09-10T18:00:26.701 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 612 (ObjNum 195 snap 50 seq_num 195) dirty exists 2024-09-10T18:00:26.701 INFO:tasks.rados.rados.0.smithi012.stdout:1107: done (3 left) 2024-09-10T18:00:26.701 INFO:tasks.rados.rados.0.smithi012.stdout:1112: snap_remove snap 97 2024-09-10T18:00:27.678 INFO:tasks.rados.rados.0.smithi012.stdout:1112: done (3 left) 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1113: copy_from oid 2 from oid 11 current snap is 112 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1104: finishing copy_from to smithi01278544-38 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1104: got expected ENOENT (src dne) 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1104: finishing copy_from racing read to smithi01278544-38 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1110: finishing write tid 1 to smithi01278544-44 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1110: finishing write tid 2 to smithi01278544-44 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1110: finishing write tid 3 to smithi01278544-44 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1111: finishing rollback tid 1 to smithi01278544-13 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1110: finishing write tid 4 to smithi01278544-44 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1110: oid 44 updating version 0 to 614 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1110: oid 44 updating version 614 to 615 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:1110: oid 44 version 615 is already newer than 613 2024-09-10T18:00:27.679 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 615 (ObjNum 347 snap 112 seq_num 347) dirty exists 2024-09-10T18:00:27.680 INFO:tasks.rados.rados.0.smithi012.stdout:1110: left oid 44 (ObjNum 347 snap 112 seq_num 347) 2024-09-10T18:00:27.680 INFO:tasks.rados.rados.0.smithi012.stdout:1104: done (3 left) 2024-09-10T18:00:27.680 INFO:tasks.rados.rados.0.smithi012.stdout:1110: done (2 left) 2024-09-10T18:00:27.680 INFO:tasks.rados.rados.0.smithi012.stdout:1111: done (1 left) 2024-09-10T18:00:27.680 INFO:tasks.rados.rados.0.smithi012.stdout:1114: snap_create 2024-09-10T18:00:27.686 INFO:tasks.rados.rados.0.smithi012.stdout:1113: finishing copy_from to smithi01278544-2 2024-09-10T18:00:27.686 INFO:tasks.rados.rados.0.smithi012.stdout:1113: got expected ENOENT (src dne) 2024-09-10T18:00:27.687 INFO:tasks.rados.rados.0.smithi012.stdout:1113: finishing copy_from racing read to smithi01278544-2 2024-09-10T18:00:28.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:27 smithi012 ceph-mon[89611]: osdmap e302: 8 total, 8 up, 8 in 2024-09-10T18:00:28.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:27 smithi012 ceph-mon[92029]: osdmap e302: 8 total, 8 up, 8 in 2024-09-10T18:00:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:27 smithi089 ceph-mon[84132]: osdmap e302: 8 total, 8 up, 8 in 2024-09-10T18:00:28.683 INFO:tasks.rados.rados.0.smithi012.stdout:1113: done (1 left) 2024-09-10T18:00:28.683 INFO:tasks.rados.rados.0.smithi012.stdout:1114: done (0 left) 2024-09-10T18:00:28.683 INFO:tasks.rados.rados.0.smithi012.stdout:1115: copy_from oid 35 from oid 22 current snap is 113 2024-09-10T18:00:28.684 INFO:tasks.rados.rados.0.smithi012.stdout:1116: rollback oid 20 current snap is 113 2024-09-10T18:00:28.684 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 112 2024-09-10T18:00:28.684 INFO:tasks.rados.rados.0.smithi012.stdout:1117: delete oid 27 current snap is 113 2024-09-10T18:00:28.689 INFO:tasks.rados.rados.0.smithi012.stdout:1116: finishing rollback tid 0 to smithi01278544-20 2024-09-10T18:00:28.690 INFO:tasks.rados.rados.0.smithi012.stdout:1117: done (2 left) 2024-09-10T18:00:28.690 INFO:tasks.rados.rados.0.smithi012.stdout:1118: rollback oid 36 current snap is 113 2024-09-10T18:00:28.690 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 107 2024-09-10T18:00:28.690 INFO:tasks.rados.rados.0.smithi012.stdout:1119: delete oid 7 current snap is 113 2024-09-10T18:00:28.690 INFO:tasks.rados.rados.0.smithi012.stdout:1116: finishing rollback tid 1 to smithi01278544-20 2024-09-10T18:00:28.690 INFO:tasks.rados.rados.0.smithi012.stdout:1116: finishing rollback tid 2 to smithi01278544-20 2024-09-10T18:00:28.690 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 745 (ObjNum 288 snap 94 seq_num 288) dirty exists 2024-09-10T18:00:28.693 INFO:tasks.rados.rados.0.smithi012.stdout:1116: done (3 left) 2024-09-10T18:00:28.693 INFO:tasks.rados.rados.0.smithi012.stdout:1119: done (2 left) 2024-09-10T18:00:28.693 INFO:tasks.rados.rados.0.smithi012.stdout:1120: copy_from oid 20 from oid 34 current snap is 113 2024-09-10T18:00:28.693 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 113 2024-09-10T18:00:28.693 INFO:tasks.rados.rados.0.smithi012.stdout:1121: seq_num 350 ranges {0=671744,671744=401408} 2024-09-10T18:00:28.697 INFO:tasks.rados.rados.0.smithi012.stdout:1121: writing smithi01278544-7 from 0 to 671744 tid 1 2024-09-10T18:00:28.700 INFO:tasks.rados.rados.0.smithi012.stdout:1121: writing smithi01278544-7 from 671744 to 1073152 tid 2 2024-09-10T18:00:28.700 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 113 2024-09-10T18:00:28.700 INFO:tasks.rados.rados.0.smithi012.stdout:1118: finishing rollback tid 0 to smithi01278544-36 2024-09-10T18:00:28.700 INFO:tasks.rados.rados.0.smithi012.stdout:1118: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:00:28.700 INFO:tasks.rados.rados.0.smithi012.stdout:1122: seq_num 351 ranges {0=688128,688128=401408} 2024-09-10T18:00:28.704 INFO:tasks.rados.rados.0.smithi012.stdout:1122: writing smithi01278544-3 from 0 to 688128 tid 1 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1122: writing smithi01278544-3 from 688128 to 1089536 tid 2 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1123: rollback oid 6 current snap is 113 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 6 to 108 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1118: finishing rollback tid 2 to smithi01278544-36 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 716 (ObjNum 307 snap 102 seq_num 307) dirty exists 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1121: finishing write tid 1 to smithi01278544-7 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1121: finishing write tid 2 to smithi01278544-7 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1121: finishing write tid 3 to smithi01278544-7 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1121: finishing write tid 4 to smithi01278544-7 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1121: oid 7 updating version 0 to 52 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1121: oid 7 version 52 is already newer than 51 2024-09-10T18:00:28.708 INFO:tasks.rados.rados.0.smithi012.stdout:1121: oid 7 updating version 52 to 53 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 53 (ObjNum 350 snap 113 seq_num 350) dirty exists 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1121: left oid 7 (ObjNum 350 snap 113 seq_num 350) 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1120: finishing copy_from racing read to smithi01278544-20 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1120: finishing copy_from to smithi01278544-20 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 484 (ObjNum 336 snap 106 seq_num 336) dirty exists 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1118: done (5 left) 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1120: done (4 left) 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1121: done (3 left) 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1124: read oid 14 snap -1 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1124: expect (ObjNum 152 snap 38 seq_num 152) 2024-09-10T18:00:28.709 INFO:tasks.rados.rados.0.smithi012.stdout:1125: snap_remove snap 110 2024-09-10T18:00:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:28 smithi012 ceph-mon[89611]: pgmap v123: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 106 active+clean; 159 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 5 op/s; 11/366 objects degraded (3.005%); 18 MiB/s, 5 objects/s recovering 2024-09-10T18:00:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:28 smithi012 ceph-mon[89611]: osdmap e303: 8 total, 8 up, 8 in 2024-09-10T18:00:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:28 smithi012 ceph-mon[92029]: pgmap v123: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 106 active+clean; 159 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 5 op/s; 11/366 objects degraded (3.005%); 18 MiB/s, 5 objects/s recovering 2024-09-10T18:00:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:28 smithi012 ceph-mon[92029]: osdmap e303: 8 total, 8 up, 8 in 2024-09-10T18:00:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:28 smithi089 ceph-mon[84132]: pgmap v123: 121 pgs: 11 active+undersized, 4 active+undersized+degraded, 106 active+clean; 159 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 5 op/s; 11/366 objects degraded (3.005%); 18 MiB/s, 5 objects/s recovering 2024-09-10T18:00:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:28 smithi089 ceph-mon[84132]: osdmap e303: 8 total, 8 up, 8 in 2024-09-10T18:00:29.688 INFO:tasks.rados.rados.0.smithi012.stdout:1125: done (4 left) 2024-09-10T18:00:29.689 INFO:tasks.rados.rados.0.smithi012.stdout:1126: delete oid 1 current snap is 113 2024-09-10T18:00:29.689 INFO:tasks.rados.rados.0.smithi012.stdout:1115: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:00:29.689 INFO:tasks.rados.rados.0.smithi012.stdout:1123: finishing rollback tid 0 to smithi01278544-6 2024-09-10T18:00:29.689 INFO:tasks.rados.rados.0.smithi012.stdout:1123: finishing rollback tid 1 to smithi01278544-6 2024-09-10T18:00:29.689 INFO:tasks.rados.rados.0.smithi012.stdout:1124: expect (ObjNum 152 snap 38 seq_num 152) 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1123: finishing rollback tid 2 to smithi01278544-6 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 608 (ObjNum 298 snap 99 seq_num 298) dirty exists 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1115: finishing copy_from to smithi01278544-35 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 716 (ObjNum 320 snap 103 seq_num 320) dirty exists 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1122: finishing write tid 1 to smithi01278544-3 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1122: finishing write tid 2 to smithi01278544-3 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1122: finishing write tid 3 to smithi01278544-3 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1122: finishing write tid 4 to smithi01278544-3 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1122: oid 3 updating version 0 to 619 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1122: oid 3 version 619 is already newer than 617 2024-09-10T18:00:29.704 INFO:tasks.rados.rados.0.smithi012.stdout:1122: oid 3 version 619 is already newer than 618 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 619 (ObjNum 351 snap 113 seq_num 351) dirty exists 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:1122: left oid 3 (ObjNum 351 snap 113 seq_num 351) 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:1115: done (4 left) 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:1122: done (3 left) 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:1123: done (2 left) 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:1124: done (1 left) 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:1126: done (0 left) 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 113 2024-09-10T18:00:29.705 INFO:tasks.rados.rados.0.smithi012.stdout:1127: seq_num 353 ranges {0=720896,720896=401408} 2024-09-10T18:00:29.707 INFO:tasks.rados.rados.0.smithi012.stdout:1127: writing smithi01278544-19 from 0 to 720896 tid 1 2024-09-10T18:00:29.710 INFO:tasks.rados.rados.0.smithi012.stdout:1127: writing smithi01278544-19 from 720896 to 1122304 tid 2 2024-09-10T18:00:29.710 INFO:tasks.rados.rados.0.smithi012.stdout:1128: snap_create 2024-09-10T18:00:29.714 INFO:tasks.rados.rados.0.smithi012.stdout:1127: finishing write tid 1 to smithi01278544-19 2024-09-10T18:00:29.715 INFO:tasks.rados.rados.0.smithi012.stdout:1127: finishing write tid 2 to smithi01278544-19 2024-09-10T18:00:29.715 INFO:tasks.rados.rados.0.smithi012.stdout:1127: finishing write tid 3 to smithi01278544-19 2024-09-10T18:00:29.717 INFO:tasks.rados.rados.0.smithi012.stdout:1127: finishing write tid 4 to smithi01278544-19 2024-09-10T18:00:29.717 INFO:tasks.rados.rados.0.smithi012.stdout:1127: oid 19 updating version 0 to 498 2024-09-10T18:00:29.717 INFO:tasks.rados.rados.0.smithi012.stdout:1127: oid 19 updating version 498 to 499 2024-09-10T18:00:29.717 INFO:tasks.rados.rados.0.smithi012.stdout:1127: oid 19 updating version 499 to 500 2024-09-10T18:00:29.717 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 500 (ObjNum 353 snap 113 seq_num 353) dirty exists 2024-09-10T18:00:29.718 INFO:tasks.rados.rados.0.smithi012.stdout:1127: left oid 19 (ObjNum 353 snap 113 seq_num 353) 2024-09-10T18:00:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:29 smithi012 ceph-mon[89611]: osdmap e304: 8 total, 8 up, 8 in 2024-09-10T18:00:30.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:29 smithi012 ceph-mon[92029]: osdmap e304: 8 total, 8 up, 8 in 2024-09-10T18:00:30.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:29 smithi089 ceph-mon[84132]: osdmap e304: 8 total, 8 up, 8 in 2024-09-10T18:00:30.698 INFO:tasks.rados.rados.0.smithi012.stdout:1127: done (1 left) 2024-09-10T18:00:30.698 INFO:tasks.rados.rados.0.smithi012.stdout:1128: done (0 left) 2024-09-10T18:00:30.698 INFO:tasks.rados.rados.0.smithi012.stdout:1129: snap_create 2024-09-10T18:00:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:30 smithi012 ceph-mon[89611]: pgmap v126: 121 pgs: 121 active+clean; 161 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 6 op/s; 21 MiB/s, 5 objects/s recovering 2024-09-10T18:00:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:30 smithi012 ceph-mon[89611]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/366 objects degraded (3.005%), 4 pgs degraded) 2024-09-10T18:00:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:30 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:00:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:30 smithi012 ceph-mon[89611]: osdmap e305: 8 total, 8 up, 8 in 2024-09-10T18:00:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:30 smithi012 ceph-mon[92029]: pgmap v126: 121 pgs: 121 active+clean; 161 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 6 op/s; 21 MiB/s, 5 objects/s recovering 2024-09-10T18:00:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:30 smithi012 ceph-mon[92029]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/366 objects degraded (3.005%), 4 pgs degraded) 2024-09-10T18:00:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:30 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:00:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:30 smithi012 ceph-mon[92029]: osdmap e305: 8 total, 8 up, 8 in 2024-09-10T18:00:31.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:30 smithi089 ceph-mon[84132]: pgmap v126: 121 pgs: 121 active+clean; 161 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 6 op/s; 21 MiB/s, 5 objects/s recovering 2024-09-10T18:00:31.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:30 smithi089 ceph-mon[84132]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/366 objects degraded (3.005%), 4 pgs degraded) 2024-09-10T18:00:31.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:30 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:00:31.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:30 smithi089 ceph-mon[84132]: osdmap e305: 8 total, 8 up, 8 in 2024-09-10T18:00:31.710 INFO:tasks.rados.rados.0.smithi012.stdout:1129: done (0 left) 2024-09-10T18:00:31.710 INFO:tasks.rados.rados.0.smithi012.stdout:1130: rollback oid 44 current snap is 115 2024-09-10T18:00:31.710 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 44 to 112 2024-09-10T18:00:31.710 INFO:tasks.rados.rados.0.smithi012.stdout:1131: read oid 36 snap -1 2024-09-10T18:00:31.710 INFO:tasks.rados.rados.0.smithi012.stdout:1131: expect (ObjNum 307 snap 102 seq_num 307) 2024-09-10T18:00:31.710 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 115 2024-09-10T18:00:31.710 INFO:tasks.rados.rados.0.smithi012.stdout:1132: seq_num 354 ranges {3751936=737280,4489216=401408} 2024-09-10T18:00:31.735 INFO:tasks.rados.rados.0.smithi012.stdout:1132: writing smithi01278544-16 from 3751936 to 4489216 tid 1 2024-09-10T18:00:31.737 INFO:tasks.rados.rados.0.smithi012.stdout:1132: writing smithi01278544-16 from 4489216 to 4890624 tid 2 2024-09-10T18:00:31.737 INFO:tasks.rados.rados.0.smithi012.stdout:1133: delete oid 6 current snap is 115 2024-09-10T18:00:31.738 INFO:tasks.rados.rados.0.smithi012.stdout:1130: finishing rollback tid 0 to smithi01278544-44 2024-09-10T18:00:31.738 INFO:tasks.rados.rados.0.smithi012.stdout:1130: finishing rollback tid 1 to smithi01278544-44 2024-09-10T18:00:31.738 INFO:tasks.rados.rados.0.smithi012.stdout:1130: finishing rollback tid 2 to smithi01278544-44 2024-09-10T18:00:31.738 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 622 (ObjNum 347 snap 112 seq_num 347) dirty exists 2024-09-10T18:00:31.738 INFO:tasks.rados.rados.0.smithi012.stdout:1131: expect (ObjNum 307 snap 102 seq_num 307) 2024-09-10T18:00:31.973 INFO:tasks.rados.rados.0.smithi012.stdout:1132: finishing write tid 1 to smithi01278544-16 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1132: finishing write tid 2 to smithi01278544-16 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1132: finishing write tid 3 to smithi01278544-16 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1132: finishing write tid 4 to smithi01278544-16 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1132: oid 16 updating version 0 to 609 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1132: oid 16 updating version 609 to 611 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1132: oid 16 version 611 is already newer than 610 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 611 (ObjNum 354 snap 115 seq_num 354) dirty exists 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1132: left oid 16 (ObjNum 354 snap 115 seq_num 354) 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1130: done (3 left) 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1131: done (2 left) 2024-09-10T18:00:31.974 INFO:tasks.rados.rados.0.smithi012.stdout:1132: done (1 left) 2024-09-10T18:00:31.975 INFO:tasks.rados.rados.0.smithi012.stdout:1133: done (0 left) 2024-09-10T18:00:31.975 INFO:tasks.rados.rados.0.smithi012.stdout:1134: snap_create 2024-09-10T18:00:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:31 smithi012 ceph-mon[89611]: osdmap e306: 8 total, 8 up, 8 in 2024-09-10T18:00:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:31 smithi012 ceph-mon[92029]: osdmap e306: 8 total, 8 up, 8 in 2024-09-10T18:00:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:32.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:31 smithi089 ceph-mon[84132]: osdmap e306: 8 total, 8 up, 8 in 2024-09-10T18:00:32.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:32.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:32.667 INFO:tasks.rados.rados.0.smithi012.stdout:1134: done (0 left) 2024-09-10T18:00:32.667 INFO:tasks.rados.rados.0.smithi012.stdout:1135: delete oid 25 current snap is 116 2024-09-10T18:00:32.672 INFO:tasks.rados.rados.0.smithi012.stdout:1135: done (0 left) 2024-09-10T18:00:32.673 INFO:tasks.rados.rados.0.smithi012.stdout:1136: snap_create 2024-09-10T18:00:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:32 smithi012 ceph-mon[89611]: pgmap v129: 121 pgs: 121 active+clean; 161 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 0 op/s; 3.0 MiB/s, 0 objects/s recovering 2024-09-10T18:00:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:32 smithi012 ceph-mon[89611]: osdmap e307: 8 total, 8 up, 8 in 2024-09-10T18:00:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:32 smithi012 ceph-mon[89611]: osdmap e308: 8 total, 8 up, 8 in 2024-09-10T18:00:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:32 smithi012 ceph-mon[92029]: pgmap v129: 121 pgs: 121 active+clean; 161 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 0 op/s; 3.0 MiB/s, 0 objects/s recovering 2024-09-10T18:00:33.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:32 smithi012 ceph-mon[92029]: osdmap e307: 8 total, 8 up, 8 in 2024-09-10T18:00:33.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:32 smithi012 ceph-mon[92029]: osdmap e308: 8 total, 8 up, 8 in 2024-09-10T18:00:33.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:32 smithi089 ceph-mon[84132]: pgmap v129: 121 pgs: 121 active+clean; 161 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 0 op/s; 3.0 MiB/s, 0 objects/s recovering 2024-09-10T18:00:33.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:32 smithi089 ceph-mon[84132]: osdmap e307: 8 total, 8 up, 8 in 2024-09-10T18:00:33.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:32 smithi089 ceph-mon[84132]: osdmap e308: 8 total, 8 up, 8 in 2024-09-10T18:00:33.670 INFO:tasks.rados.rados.0.smithi012.stdout:1136: done (0 left) 2024-09-10T18:00:33.670 INFO:tasks.rados.rados.0.smithi012.stdout:1137: read oid 10 snap -1 2024-09-10T18:00:33.670 INFO:tasks.rados.rados.0.smithi012.stdout:1137: expect (ObjNum 338 snap 108 seq_num 338) 2024-09-10T18:00:33.670 INFO:tasks.rados.rados.0.smithi012.stdout:1138: delete oid 19 current snap is 117 2024-09-10T18:00:33.674 INFO:tasks.rados.rados.0.smithi012.stdout:1138: done (1 left) 2024-09-10T18:00:33.674 INFO:tasks.rados.rados.0.smithi012.stdout:1139: delete oid 5 current snap is 117 2024-09-10T18:00:33.677 INFO:tasks.rados.rados.0.smithi012.stdout:1137: expect (ObjNum 338 snap 108 seq_num 338) 2024-09-10T18:00:33.705 INFO:tasks.rados.rados.0.smithi012.stdout:1137: done (1 left) 2024-09-10T18:00:33.705 INFO:tasks.rados.rados.0.smithi012.stdout:1139: done (0 left) 2024-09-10T18:00:33.705 INFO:tasks.rados.rados.0.smithi012.stdout:1140: read oid 3 snap -1 2024-09-10T18:00:33.705 INFO:tasks.rados.rados.0.smithi012.stdout:1140: expect (ObjNum 351 snap 113 seq_num 351) 2024-09-10T18:00:33.705 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 117 2024-09-10T18:00:33.705 INFO:tasks.rados.rados.0.smithi012.stdout:1141: seq_num 359 ranges {0=417792,417792=417792,835584=385024} 2024-09-10T18:00:33.707 INFO:tasks.rados.rados.0.smithi012.stdout:1141: writing smithi01278544-23 from 0 to 417792 tid 1 2024-09-10T18:00:33.710 INFO:tasks.rados.rados.0.smithi012.stdout:1141: writing smithi01278544-23 from 417792 to 835584 tid 2 2024-09-10T18:00:33.713 INFO:tasks.rados.rados.0.smithi012.stdout:1141: writing smithi01278544-23 from 835584 to 1220608 tid 3 2024-09-10T18:00:33.713 INFO:tasks.rados.rados.0.smithi012.stdout:1142: rmattr oid 20 current snap is 117 2024-09-10T18:00:33.714 INFO:tasks.rados.rados.0.smithi012.stdout:1142: done (2 left) 2024-09-10T18:00:33.714 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 117 2024-09-10T18:00:33.714 INFO:tasks.rados.rados.0.smithi012.stdout:1143: seq_num 360 ranges {5177344=434176,5611520=704512,6316032=98304} 2024-09-10T18:00:33.745 INFO:tasks.rados.rados.0.smithi012.stdout:1143: writing smithi01278544-41 from 5177344 to 5611520 tid 1 2024-09-10T18:00:33.749 INFO:tasks.rados.rados.0.smithi012.stdout:1143: writing smithi01278544-41 from 5611520 to 6316032 tid 2 2024-09-10T18:00:33.749 INFO:tasks.rados.rados.0.smithi012.stdout:1143: writing smithi01278544-41 from 6316032 to 6414336 tid 3 2024-09-10T18:00:33.749 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 117 2024-09-10T18:00:33.750 INFO:tasks.rados.rados.0.smithi012.stdout:1144: seq_num 361 ranges {0=450560,450560=581632,1032192=221184} 2024-09-10T18:00:33.752 INFO:tasks.rados.rados.0.smithi012.stdout:1144: writing smithi01278544-11 from 0 to 450560 tid 1 2024-09-10T18:00:33.756 INFO:tasks.rados.rados.0.smithi012.stdout:1144: writing smithi01278544-11 from 450560 to 1032192 tid 2 2024-09-10T18:00:33.757 INFO:tasks.rados.rados.0.smithi012.stdout:1144: writing smithi01278544-11 from 1032192 to 1253376 tid 3 2024-09-10T18:00:33.757 INFO:tasks.rados.rados.0.smithi012.stdout:1145: snap_remove snap 114 2024-09-10T18:00:34.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:00:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:00:33] "GET /metrics HTTP/1.1" 200 36226 "" "Prometheus/2.43.0" 2024-09-10T18:00:34.712 INFO:tasks.rados.rados.0.smithi012.stdout:1145: done (4 left) 2024-09-10T18:00:34.712 INFO:tasks.rados.rados.0.smithi012.stdout:1146: snap_remove snap 116 2024-09-10T18:00:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:34 smithi012 ceph-mon[89611]: pgmap v132: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-09-10T18:00:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:34 smithi012 ceph-mon[89611]: osdmap e309: 8 total, 8 up, 8 in 2024-09-10T18:00:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:34 smithi012 ceph-mon[89611]: mgrmap e43: y(active, since 92s), standbys: x 2024-09-10T18:00:35.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:34 smithi012 ceph-mon[92029]: pgmap v132: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-09-10T18:00:35.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:34 smithi012 ceph-mon[92029]: osdmap e309: 8 total, 8 up, 8 in 2024-09-10T18:00:35.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:34 smithi012 ceph-mon[92029]: mgrmap e43: y(active, since 92s), standbys: x 2024-09-10T18:00:35.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:34 smithi089 ceph-mon[84132]: pgmap v132: 121 pgs: 121 active+clean; 139 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-09-10T18:00:35.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:34 smithi089 ceph-mon[84132]: osdmap e309: 8 total, 8 up, 8 in 2024-09-10T18:00:35.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:34 smithi089 ceph-mon[84132]: mgrmap e43: y(active, since 92s), standbys: x 2024-09-10T18:00:35.718 INFO:tasks.rados.rados.0.smithi012.stdout:1146: done (4 left) 2024-09-10T18:00:35.718 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 117 2024-09-10T18:00:35.718 INFO:tasks.rados.rados.0.smithi012.stdout:1141: finishing write tid 1 to smithi01278544-23 2024-09-10T18:00:35.718 INFO:tasks.rados.rados.0.smithi012.stdout:1147: seq_num 362 ranges {335872=466944,802816=466944,1269760=335872} 2024-09-10T18:00:35.723 INFO:tasks.rados.rados.0.smithi012.stdout:1147: writing smithi01278544-17 from 335872 to 802816 tid 1 2024-09-10T18:00:35.726 INFO:tasks.rados.rados.0.smithi012.stdout:1147: writing smithi01278544-17 from 802816 to 1269760 tid 2 2024-09-10T18:00:35.728 INFO:tasks.rados.rados.0.smithi012.stdout:1147: writing smithi01278544-17 from 1269760 to 1605632 tid 3 2024-09-10T18:00:35.728 INFO:tasks.rados.rados.0.smithi012.stdout:1148: read oid 31 snap 108 2024-09-10T18:00:35.728 INFO:tasks.rados.rados.0.smithi012.stdout:1148: expect deleted 2024-09-10T18:00:35.728 INFO:tasks.rados.rados.0.smithi012.stdout:1149: rmattr oid 43 current snap is 117 2024-09-10T18:00:35.729 INFO:tasks.rados.rados.0.smithi012.stdout:1149: done (6 left) 2024-09-10T18:00:35.729 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 117 2024-09-10T18:00:35.729 INFO:tasks.rados.rados.0.smithi012.stdout:1141: finishing write tid 2 to smithi01278544-23 2024-09-10T18:00:35.729 INFO:tasks.rados.rados.0.smithi012.stdout:1141: finishing write tid 3 to smithi01278544-23 2024-09-10T18:00:35.729 INFO:tasks.rados.rados.0.smithi012.stdout:1140: expect (ObjNum 351 snap 113 seq_num 351) 2024-09-10T18:00:35.758 INFO:tasks.rados.rados.0.smithi012.stdout:1141: finishing write tid 4 to smithi01278544-23 2024-09-10T18:00:35.758 INFO:tasks.rados.rados.0.smithi012.stdout:1141: finishing write tid 5 to smithi01278544-23 2024-09-10T18:00:35.759 INFO:tasks.rados.rados.0.smithi012.stdout:1141: oid 23 updating version 0 to 506 2024-09-10T18:00:35.759 INFO:tasks.rados.rados.0.smithi012.stdout:1141: oid 23 version 506 is already newer than 503 2024-09-10T18:00:35.759 INFO:tasks.rados.rados.0.smithi012.stdout:1141: oid 23 version 506 is already newer than 505 2024-09-10T18:00:35.759 INFO:tasks.rados.rados.0.smithi012.stdout:1141: oid 23 version 506 is already newer than 504 2024-09-10T18:00:35.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 506 (ObjNum 359 snap 117 seq_num 359) dirty exists 2024-09-10T18:00:35.759 INFO:tasks.rados.rados.0.smithi012.stdout:1141: left oid 23 (ObjNum 359 snap 117 seq_num 359) 2024-09-10T18:00:35.759 INFO:tasks.rados.rados.0.smithi012.stdout:1143: finishing write tid 1 to smithi01278544-41 2024-09-10T18:00:35.759 INFO:tasks.rados.rados.0.smithi012.stdout:1150: seq_num 363 ranges {368640=483328,851968=753664,1605632=49152} 2024-09-10T18:00:35.763 INFO:tasks.rados.rados.0.smithi012.stdout:1150: writing smithi01278544-14 from 368640 to 851968 tid 1 2024-09-10T18:00:35.768 INFO:tasks.rados.rados.0.smithi012.stdout:1150: writing smithi01278544-14 from 851968 to 1605632 tid 2 2024-09-10T18:00:35.769 INFO:tasks.rados.rados.0.smithi012.stdout:1150: writing smithi01278544-14 from 1605632 to 1654784 tid 3 2024-09-10T18:00:35.769 INFO:tasks.rados.rados.0.smithi012.stdout:1140: done (6 left) 2024-09-10T18:00:35.769 INFO:tasks.rados.rados.0.smithi012.stdout:1141: done (5 left) 2024-09-10T18:00:35.769 INFO:tasks.rados.rados.0.smithi012.stdout:1151: read oid 27 snap -1 2024-09-10T18:00:35.769 INFO:tasks.rados.rados.0.smithi012.stdout:1151: expect deleted 2024-09-10T18:00:35.769 INFO:tasks.rados.rados.0.smithi012.stdout:1152: delete oid 26 current snap is 117 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: finishing write tid 2 to smithi01278544-41 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: finishing write tid 3 to smithi01278544-41 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: finishing write tid 4 to smithi01278544-41 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1144: finishing write tid 1 to smithi01278544-11 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: finishing write tid 5 to smithi01278544-41 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: oid 41 updating version 0 to 796 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: oid 41 updating version 796 to 798 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: oid 41 version 798 is already newer than 797 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: oid 41 version 798 is already newer than 795 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 798 (ObjNum 360 snap 117 seq_num 360) dirty exists 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1143: left oid 41 (ObjNum 360 snap 117 seq_num 360) 2024-09-10T18:00:35.770 INFO:tasks.rados.rados.0.smithi012.stdout:1144: finishing write tid 2 to smithi01278544-11 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1144: finishing write tid 3 to smithi01278544-11 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1144: finishing write tid 4 to smithi01278544-11 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1144: finishing write tid 5 to smithi01278544-11 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1144: oid 11 updating version 0 to 752 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1144: oid 11 updating version 752 to 753 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1144: oid 11 version 753 is already newer than 751 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1144: oid 11 updating version 753 to 754 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 754 (ObjNum 361 snap 117 seq_num 361) dirty exists 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1144: left oid 11 (ObjNum 361 snap 117 seq_num 361) 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1147: finishing write tid 1 to smithi01278544-17 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1147: finishing write tid 2 to smithi01278544-17 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1147: finishing write tid 3 to smithi01278544-17 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1147: finishing write tid 4 to smithi01278544-17 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1147: finishing write tid 5 to smithi01278544-17 2024-09-10T18:00:35.771 INFO:tasks.rados.rados.0.smithi012.stdout:1147: oid 17 updating version 0 to 372 2024-09-10T18:00:35.772 INFO:tasks.rados.rados.0.smithi012.stdout:1147: oid 17 version 372 is already newer than 371 2024-09-10T18:00:35.772 INFO:tasks.rados.rados.0.smithi012.stdout:1147: oid 17 version 372 is already newer than 370 2024-09-10T18:00:35.772 INFO:tasks.rados.rados.0.smithi012.stdout:1147: oid 17 updating version 372 to 373 2024-09-10T18:00:35.772 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 373 (ObjNum 362 snap 117 seq_num 362) dirty exists 2024-09-10T18:00:35.772 INFO:tasks.rados.rados.0.smithi012.stdout:1147: left oid 17 (ObjNum 362 snap 117 seq_num 362) 2024-09-10T18:00:35.772 INFO:tasks.rados.rados.0.smithi012.stdout:1150: finishing write tid 1 to smithi01278544-14 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:1143: done (6 left) 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:1144: done (5 left) 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:1147: done (4 left) 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:1148: done (3 left) 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:1152: done (2 left) 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:1153: rollback oid 47 current snap is 117 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 112 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 117 2024-09-10T18:00:35.773 INFO:tasks.rados.rados.0.smithi012.stdout:1154: seq_num 365 ranges {1089536=516096,1605632=573440,2179072=229376} 2024-09-10T18:00:35.780 INFO:tasks.rados.rados.0.smithi012.stdout:1154: writing smithi01278544-3 from 1089536 to 1605632 tid 1 2024-09-10T18:00:35.783 INFO:tasks.rados.rados.0.smithi012.stdout:1154: writing smithi01278544-3 from 1605632 to 2179072 tid 2 2024-09-10T18:00:35.785 INFO:tasks.rados.rados.0.smithi012.stdout:1154: writing smithi01278544-3 from 2179072 to 2408448 tid 3 2024-09-10T18:00:35.785 INFO:tasks.rados.rados.0.smithi012.stdout:1155: read oid 32 snap -1 2024-09-10T18:00:35.785 INFO:tasks.rados.rados.0.smithi012.stdout:1155: expect deleted 2024-09-10T18:00:35.785 INFO:tasks.rados.rados.0.smithi012.stdout:1156: read oid 16 snap 115 2024-09-10T18:00:35.785 INFO:tasks.rados.rados.0.smithi012.stdout:1156: expect (ObjNum 354 snap 115 seq_num 354) 2024-09-10T18:00:35.785 INFO:tasks.rados.rados.0.smithi012.stdout:1157: snap_remove snap 108 2024-09-10T18:00:36.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:35 smithi012 ceph-mon[89611]: osdmap e310: 8 total, 8 up, 8 in 2024-09-10T18:00:36.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:35 smithi012 ceph-mon[92029]: osdmap e310: 8 total, 8 up, 8 in 2024-09-10T18:00:36.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:35 smithi089 ceph-mon[84132]: osdmap e310: 8 total, 8 up, 8 in 2024-09-10T18:00:36.729 INFO:tasks.rados.rados.0.smithi012.stdout:1157: done (6 left) 2024-09-10T18:00:36.730 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 117 2024-09-10T18:00:36.730 INFO:tasks.rados.rados.0.smithi012.stdout:1158: seq_num 366 ranges {0=532480,532480=458752,991232=344064} 2024-09-10T18:00:36.732 INFO:tasks.rados.rados.0.smithi012.stdout:1158: writing smithi01278544-39 from 0 to 532480 tid 1 2024-09-10T18:00:36.735 INFO:tasks.rados.rados.0.smithi012.stdout:1158: writing smithi01278544-39 from 532480 to 991232 tid 2 2024-09-10T18:00:36.738 INFO:tasks.rados.rados.0.smithi012.stdout:1158: writing smithi01278544-39 from 991232 to 1335296 tid 3 2024-09-10T18:00:36.739 INFO:tasks.rados.rados.0.smithi012.stdout:1159: snap_create 2024-09-10T18:00:36.739 INFO:tasks.rados.rados.0.smithi012.stdout:1150: finishing write tid 2 to smithi01278544-14 2024-09-10T18:00:36.739 INFO:tasks.rados.rados.0.smithi012.stdout:1150: finishing write tid 3 to smithi01278544-14 2024-09-10T18:00:36.739 INFO:tasks.rados.rados.0.smithi012.stdout:1150: finishing write tid 4 to smithi01278544-14 2024-09-10T18:00:36.739 INFO:tasks.rados.rados.0.smithi012.stdout:1153: finishing rollback tid 0 to smithi01278544-47 2024-09-10T18:00:36.739 INFO:tasks.rados.rados.0.smithi012.stdout:1150: finishing write tid 5 to smithi01278544-14 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1150: oid 14 updating version 0 to 818 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1150: oid 14 updating version 818 to 819 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1150: oid 14 updating version 819 to 820 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1150: oid 14 updating version 820 to 821 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 821 (ObjNum 363 snap 117 seq_num 363) dirty exists 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1150: left oid 14 (ObjNum 363 snap 117 seq_num 363) 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1153: finishing rollback tid 1 to smithi01278544-47 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1153: finishing rollback tid 2 to smithi01278544-47 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 825 (ObjNum 340 snap 108 seq_num 340) dirty exists 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1154: finishing write tid 1 to smithi01278544-3 2024-09-10T18:00:36.740 INFO:tasks.rados.rados.0.smithi012.stdout:1154: finishing write tid 2 to smithi01278544-3 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1154: finishing write tid 3 to smithi01278544-3 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1154: finishing write tid 4 to smithi01278544-3 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1154: finishing write tid 5 to smithi01278544-3 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1154: oid 3 updating version 0 to 626 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1154: oid 3 version 626 is already newer than 623 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1154: oid 3 version 626 is already newer than 625 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1154: oid 3 version 626 is already newer than 624 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 626 (ObjNum 365 snap 117 seq_num 365) dirty exists 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1154: left oid 3 (ObjNum 365 snap 117 seq_num 365) 2024-09-10T18:00:36.741 INFO:tasks.rados.rados.0.smithi012.stdout:1156: expect (ObjNum 354 snap 115 seq_num 354) 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: finishing write tid 1 to smithi01278544-39 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: finishing write tid 2 to smithi01278544-39 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: finishing write tid 3 to smithi01278544-39 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: finishing write tid 4 to smithi01278544-39 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: finishing write tid 5 to smithi01278544-39 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: oid 39 updating version 0 to 763 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: oid 39 version 763 is already newer than 762 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: oid 39 updating version 763 to 764 2024-09-10T18:00:37.016 INFO:tasks.rados.rados.0.smithi012.stdout:1158: oid 39 version 764 is already newer than 757 2024-09-10T18:00:37.017 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 764 (ObjNum 366 snap 117 seq_num 366) dirty exists 2024-09-10T18:00:37.017 INFO:tasks.rados.rados.0.smithi012.stdout:1158: left oid 39 (ObjNum 366 snap 117 seq_num 366) 2024-09-10T18:00:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:36 smithi012 ceph-mon[89611]: pgmap v135: 121 pgs: 121 active+clean; 139 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-10T18:00:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:36 smithi012 ceph-mon[89611]: osdmap e311: 8 total, 8 up, 8 in 2024-09-10T18:00:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:37.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:36 smithi012 ceph-mon[92029]: pgmap v135: 121 pgs: 121 active+clean; 139 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-10T18:00:37.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:36 smithi012 ceph-mon[92029]: osdmap e311: 8 total, 8 up, 8 in 2024-09-10T18:00:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:37.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:36 smithi089 ceph-mon[84132]: pgmap v135: 121 pgs: 121 active+clean; 139 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-10T18:00:37.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:36 smithi089 ceph-mon[84132]: osdmap e311: 8 total, 8 up, 8 in 2024-09-10T18:00:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1150: done (7 left) 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1151: done (6 left) 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1153: done (5 left) 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1154: done (4 left) 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1155: done (3 left) 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1156: done (2 left) 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1158: done (1 left) 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1159: done (0 left) 2024-09-10T18:00:37.670 INFO:tasks.rados.rados.0.smithi012.stdout:1160: snap_create 2024-09-10T18:00:38.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:37 smithi089 ceph-mon[84132]: osdmap e312: 8 total, 8 up, 8 in 2024-09-10T18:00:38.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:37 smithi089 ceph-mon[84132]: osdmap e313: 8 total, 8 up, 8 in 2024-09-10T18:00:38.038 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:37 smithi012 ceph-mon[89611]: osdmap e312: 8 total, 8 up, 8 in 2024-09-10T18:00:38.038 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:37 smithi012 ceph-mon[89611]: osdmap e313: 8 total, 8 up, 8 in 2024-09-10T18:00:38.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:37 smithi012 ceph-mon[92029]: osdmap e312: 8 total, 8 up, 8 in 2024-09-10T18:00:38.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:37 smithi012 ceph-mon[92029]: osdmap e313: 8 total, 8 up, 8 in 2024-09-10T18:00:38.671 INFO:tasks.rados.rados.0.smithi012.stdout:1160: done (0 left) 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:1161: read oid 17 snap 118 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:1161: expect (ObjNum 362 snap 117 seq_num 362) 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:1162: rollback oid 11 current snap is 119 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 117 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:1163: rollback oid 26 current snap is 119 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 26 to 112 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:1164: rmattr oid 46 current snap is 119 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:1165: rmattr oid 19 current snap is 119 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:1165: done (4 left) 2024-09-10T18:00:38.672 INFO:tasks.rados.rados.0.smithi012.stdout:1166: delete oid 13 current snap is 119 2024-09-10T18:00:38.673 INFO:tasks.rados.rados.0.smithi012.stdout:1163: finishing rollback tid 1 to smithi01278544-26 2024-09-10T18:00:38.673 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 713 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-09-10T18:00:38.678 INFO:tasks.rados.rados.0.smithi012.stdout:1162: finishing rollback tid 0 to smithi01278544-11 2024-09-10T18:00:38.678 INFO:tasks.rados.rados.0.smithi012.stdout:1162: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:00:38.678 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 627 (ObjNum 275 snap 88 seq_num 275) dirty exists 2024-09-10T18:00:38.679 INFO:tasks.rados.rados.0.smithi012.stdout:1163: done (4 left) 2024-09-10T18:00:38.679 INFO:tasks.rados.rados.0.smithi012.stdout:1164: done (3 left) 2024-09-10T18:00:38.679 INFO:tasks.rados.rados.0.smithi012.stdout:1166: done (2 left) 2024-09-10T18:00:38.679 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 119 2024-09-10T18:00:38.679 INFO:tasks.rados.rados.0.smithi012.stdout:1162: finishing rollback tid 2 to smithi01278544-11 2024-09-10T18:00:38.679 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 768 (ObjNum 361 snap 117 seq_num 361) dirty exists 2024-09-10T18:00:38.679 INFO:tasks.rados.rados.0.smithi012.stdout:1167: seq_num 368 ranges {5251072=573440,5824512=622592,6447104=180224} 2024-09-10T18:00:38.711 INFO:tasks.rados.rados.0.smithi012.stdout:1167: writing smithi01278544-47 from 5251072 to 5824512 tid 1 2024-09-10T18:00:38.714 INFO:tasks.rados.rados.0.smithi012.stdout:1167: writing smithi01278544-47 from 5824512 to 6447104 tid 2 2024-09-10T18:00:38.715 INFO:tasks.rados.rados.0.smithi012.stdout:1167: writing smithi01278544-47 from 6447104 to 6627328 tid 3 2024-09-10T18:00:38.715 INFO:tasks.rados.rados.0.smithi012.stdout:1162: done (2 left) 2024-09-10T18:00:38.715 INFO:tasks.rados.rados.0.smithi012.stdout:1168: snap_remove snap 115 2024-09-10T18:00:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:38 smithi012 ceph-mon[89611]: pgmap v138: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2024-09-10T18:00:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:38 smithi012 ceph-mon[89611]: osdmap e314: 8 total, 8 up, 8 in 2024-09-10T18:00:39.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:38 smithi012 ceph-mon[92029]: pgmap v138: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2024-09-10T18:00:39.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:38 smithi012 ceph-mon[92029]: osdmap e314: 8 total, 8 up, 8 in 2024-09-10T18:00:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:38 smithi089 ceph-mon[84132]: pgmap v138: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2024-09-10T18:00:39.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:38 smithi089 ceph-mon[84132]: osdmap e314: 8 total, 8 up, 8 in 2024-09-10T18:00:39.674 INFO:tasks.rados.rados.0.smithi012.stdout:1168: done (2 left) 2024-09-10T18:00:39.675 INFO:tasks.rados.rados.0.smithi012.stdout:1169: read oid 39 snap -1 2024-09-10T18:00:39.675 INFO:tasks.rados.rados.0.smithi012.stdout:1169: expect (ObjNum 366 snap 117 seq_num 366) 2024-09-10T18:00:39.675 INFO:tasks.rados.rados.0.smithi012.stdout:1170: copy_from oid 13 from oid 43 current snap is 119 2024-09-10T18:00:39.675 INFO:tasks.rados.rados.0.smithi012.stdout:1161: expect (ObjNum 362 snap 117 seq_num 362) 2024-09-10T18:00:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:1167: finishing write tid 1 to smithi01278544-47 2024-09-10T18:00:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:1167: finishing write tid 2 to smithi01278544-47 2024-09-10T18:00:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:1161: done (3 left) 2024-09-10T18:00:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:1171: delete oid 31 current snap is 119 2024-09-10T18:00:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:1167: finishing write tid 3 to smithi01278544-47 2024-09-10T18:00:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:1167: finishing write tid 4 to smithi01278544-47 2024-09-10T18:00:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:1167: finishing write tid 5 to smithi01278544-47 2024-09-10T18:00:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:1167: oid 47 updating version 0 to 836 2024-09-10T18:00:39.732 INFO:tasks.rados.rados.0.smithi012.stdout:1167: oid 47 version 836 is already newer than 835 2024-09-10T18:00:39.732 INFO:tasks.rados.rados.0.smithi012.stdout:1167: oid 47 updating version 836 to 837 2024-09-10T18:00:39.732 INFO:tasks.rados.rados.0.smithi012.stdout:1167: oid 47 updating version 837 to 838 2024-09-10T18:00:39.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 838 (ObjNum 368 snap 119 seq_num 368) dirty exists 2024-09-10T18:00:39.732 INFO:tasks.rados.rados.0.smithi012.stdout:1167: left oid 47 (ObjNum 368 snap 119 seq_num 368) 2024-09-10T18:00:39.732 INFO:tasks.rados.rados.0.smithi012.stdout:1169: expect (ObjNum 366 snap 117 seq_num 366) 2024-09-10T18:00:39.767 INFO:tasks.rados.rados.0.smithi012.stdout:1170: finishing copy_from racing read to smithi01278544-13 2024-09-10T18:00:39.767 INFO:tasks.rados.rados.0.smithi012.stdout:1170: finishing copy_from to smithi01278544-13 2024-09-10T18:00:39.767 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 380 (ObjNum 267 snap 86 seq_num 267) dirty exists 2024-09-10T18:00:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:1167: done (3 left) 2024-09-10T18:00:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:1169: done (2 left) 2024-09-10T18:00:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:1170: done (1 left) 2024-09-10T18:00:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:1171: done (0 left) 2024-09-10T18:00:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:1172: copy_from oid 37 from oid 30 current snap is 119 2024-09-10T18:00:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 119 2024-09-10T18:00:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:1173: seq_num 370 ranges {5218304=606208,5824512=794624,6619136=8192} 2024-09-10T18:00:39.799 INFO:tasks.rados.rados.0.smithi012.stdout:1173: writing smithi01278544-44 from 5218304 to 5824512 tid 1 2024-09-10T18:00:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1173: writing smithi01278544-44 from 5824512 to 6619136 tid 2 2024-09-10T18:00:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1173: writing smithi01278544-44 from 6619136 to 6627328 tid 3 2024-09-10T18:00:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 119 2024-09-10T18:00:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1172: finishing copy_from to smithi01278544-37 2024-09-10T18:00:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1172: got expected ENOENT (src dne) 2024-09-10T18:00:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1172: finishing copy_from racing read to smithi01278544-37 2024-09-10T18:00:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1174: seq_num 371 ranges {868352=622592,1490944=679936,2170880=122880} 2024-09-10T18:00:39.811 INFO:tasks.rados.rados.0.smithi012.stdout:1174: writing smithi01278544-10 from 868352 to 1490944 tid 1 2024-09-10T18:00:39.816 INFO:tasks.rados.rados.0.smithi012.stdout:1174: writing smithi01278544-10 from 1490944 to 2170880 tid 2 2024-09-10T18:00:39.816 INFO:tasks.rados.rados.0.smithi012.stdout:1174: writing smithi01278544-10 from 2170880 to 2293760 tid 3 2024-09-10T18:00:39.817 INFO:tasks.rados.rados.0.smithi012.stdout:1172: done (2 left) 2024-09-10T18:00:39.817 INFO:tasks.rados.rados.0.smithi012.stdout:1173: finishing write tid 1 to smithi01278544-44 2024-09-10T18:00:39.817 INFO:tasks.rados.rados.0.smithi012.stdout:1175: read oid 20 snap -1 2024-09-10T18:00:39.817 INFO:tasks.rados.rados.0.smithi012.stdout:1175: expect (ObjNum 336 snap 106 seq_num 336) 2024-09-10T18:00:39.817 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 119 2024-09-10T18:00:39.817 INFO:tasks.rados.rados.0.smithi012.stdout:1176: seq_num 372 ranges {0=638976,638976=565248,1204224=237568} 2024-09-10T18:00:39.819 INFO:tasks.rados.rados.0.smithi012.stdout:1176: writing smithi01278544-25 from 0 to 638976 tid 1 2024-09-10T18:00:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:1176: writing smithi01278544-25 from 638976 to 1204224 tid 2 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:1176: writing smithi01278544-25 from 1204224 to 1441792 tid 3 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:1177: rollback oid 23 current snap is 119 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 23 to 117 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:1173: finishing write tid 2 to smithi01278544-44 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:1173: finishing write tid 3 to smithi01278544-44 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:1173: finishing write tid 4 to smithi01278544-44 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:1178: copy_from oid 1 from oid 29 current snap is 119 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:1173: finishing write tid 5 to smithi01278544-44 2024-09-10T18:00:39.825 INFO:tasks.rados.rados.0.smithi012.stdout:1173: oid 44 updating version 0 to 629 2024-09-10T18:00:39.826 INFO:tasks.rados.rados.0.smithi012.stdout:1173: oid 44 updating version 629 to 630 2024-09-10T18:00:39.826 INFO:tasks.rados.rados.0.smithi012.stdout:1173: oid 44 version 630 is already newer than 628 2024-09-10T18:00:39.826 INFO:tasks.rados.rados.0.smithi012.stdout:1173: oid 44 updating version 630 to 631 2024-09-10T18:00:39.826 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 631 (ObjNum 370 snap 119 seq_num 370) dirty exists 2024-09-10T18:00:39.826 INFO:tasks.rados.rados.0.smithi012.stdout:1173: left oid 44 (ObjNum 370 snap 119 seq_num 370) 2024-09-10T18:00:39.826 INFO:tasks.rados.rados.0.smithi012.stdout:1174: finishing write tid 1 to smithi01278544-10 2024-09-10T18:00:39.826 INFO:tasks.rados.rados.0.smithi012.stdout:1173: done (5 left) 2024-09-10T18:00:39.826 INFO:tasks.rados.rados.0.smithi012.stdout:1179: snap_remove snap 112 2024-09-10T18:00:40.738 INFO:tasks.rados.rados.0.smithi012.stdout:1179: done (5 left) 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1180: copy_from oid 13 from oid 31 current snap is 119 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: finishing write tid 2 to smithi01278544-10 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: finishing write tid 3 to smithi01278544-10 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: finishing write tid 4 to smithi01278544-10 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: finishing write tid 5 to smithi01278544-10 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: oid 10 updating version 0 to 775 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: oid 10 version 775 is already newer than 773 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: oid 10 version 775 is already newer than 774 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: oid 10 version 775 is already newer than 772 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 775 (ObjNum 371 snap 119 seq_num 371) dirty exists 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1174: left oid 10 (ObjNum 371 snap 119 seq_num 371) 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1178: finishing copy_from to smithi01278544-1 2024-09-10T18:00:40.739 INFO:tasks.rados.rados.0.smithi012.stdout:1178: got expected ENOENT (src dne) 2024-09-10T18:00:40.740 INFO:tasks.rados.rados.0.smithi012.stdout:1178: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:00:40.740 INFO:tasks.rados.rados.0.smithi012.stdout:1177: finishing rollback tid 0 to smithi01278544-23 2024-09-10T18:00:40.740 INFO:tasks.rados.rados.0.smithi012.stdout:1177: finishing rollback tid 1 to smithi01278544-23 2024-09-10T18:00:40.740 INFO:tasks.rados.rados.0.smithi012.stdout:1177: finishing rollback tid 2 to smithi01278544-23 2024-09-10T18:00:40.740 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 516 (ObjNum 359 snap 117 seq_num 359) dirty exists 2024-09-10T18:00:40.740 INFO:tasks.rados.rados.0.smithi012.stdout:1176: finishing write tid 1 to smithi01278544-25 2024-09-10T18:00:40.740 INFO:tasks.rados.rados.0.smithi012.stdout:1175: expect (ObjNum 336 snap 106 seq_num 336) 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: finishing write tid 2 to smithi01278544-25 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: finishing write tid 3 to smithi01278544-25 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: finishing write tid 4 to smithi01278544-25 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: finishing write tid 5 to smithi01278544-25 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: oid 25 updating version 0 to 778 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: oid 25 version 778 is already newer than 777 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: oid 25 version 778 is already newer than 776 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: oid 25 updating version 778 to 779 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 779 (ObjNum 372 snap 119 seq_num 372) dirty exists 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1176: left oid 25 (ObjNum 372 snap 119 seq_num 372) 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1180: finishing copy_from to smithi01278544-13 2024-09-10T18:00:40.766 INFO:tasks.rados.rados.0.smithi012.stdout:1180: got expected ENOENT (src dne) 2024-09-10T18:00:40.767 INFO:tasks.rados.rados.0.smithi012.stdout:1180: finishing copy_from racing read to smithi01278544-13 2024-09-10T18:00:40.767 INFO:tasks.rados.rados.0.smithi012.stdout:1174: done (5 left) 2024-09-10T18:00:40.767 INFO:tasks.rados.rados.0.smithi012.stdout:1175: done (4 left) 2024-09-10T18:00:40.767 INFO:tasks.rados.rados.0.smithi012.stdout:1176: done (3 left) 2024-09-10T18:00:40.767 INFO:tasks.rados.rados.0.smithi012.stdout:1177: done (2 left) 2024-09-10T18:00:40.767 INFO:tasks.rados.rados.0.smithi012.stdout:1178: done (1 left) 2024-09-10T18:00:40.767 INFO:tasks.rados.rados.0.smithi012.stdout:1180: done (0 left) 2024-09-10T18:00:40.767 INFO:tasks.rados.rados.0.smithi012.stdout:1181: snap_create 2024-09-10T18:00:40.773 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:40 smithi012 ceph-mon[89611]: pgmap v141: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2024-09-10T18:00:40.773 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:40 smithi012 ceph-mon[89611]: osdmap e315: 8 total, 8 up, 8 in 2024-09-10T18:00:40.773 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-10T18:00:40.774 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:40 smithi012 ceph-mon[92029]: pgmap v141: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2024-09-10T18:00:40.774 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:40 smithi012 ceph-mon[92029]: osdmap e315: 8 total, 8 up, 8 in 2024-09-10T18:00:40.774 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-10T18:00:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:40 smithi089 ceph-mon[84132]: pgmap v141: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2024-09-10T18:00:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:40 smithi089 ceph-mon[84132]: osdmap e315: 8 total, 8 up, 8 in 2024-09-10T18:00:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-10T18:00:41.750 INFO:tasks.rados.rados.0.smithi012.stdout:1181: done (0 left) 2024-09-10T18:00:41.751 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 120 2024-09-10T18:00:41.751 INFO:tasks.rados.rados.0.smithi012.stdout:1182: seq_num 373 ranges {1253376=655360,1908736=499712,2408448=303104} 2024-09-10T18:00:41.761 INFO:tasks.rados.rados.0.smithi012.stdout:1182: writing smithi01278544-11 from 1253376 to 1908736 tid 1 2024-09-10T18:00:41.763 INFO:tasks.rados.rados.0.smithi012.stdout:1182: writing smithi01278544-11 from 1908736 to 2408448 tid 2 2024-09-10T18:00:41.765 INFO:tasks.rados.rados.0.smithi012.stdout:1182: writing smithi01278544-11 from 2408448 to 2711552 tid 3 2024-09-10T18:00:41.765 INFO:tasks.rados.rados.0.smithi012.stdout:1183: rmattr oid 30 current snap is 120 2024-09-10T18:00:41.765 INFO:tasks.rados.rados.0.smithi012.stdout:1183: done (1 left) 2024-09-10T18:00:41.765 INFO:tasks.rados.rados.0.smithi012.stdout:1184: delete oid 19 current snap is 120 2024-09-10T18:00:41.766 INFO:tasks.rados.rados.0.smithi012.stdout:1182: finishing write tid 1 to smithi01278544-11 2024-09-10T18:00:41.768 INFO:tasks.rados.rados.0.smithi012.stdout:1182: finishing write tid 2 to smithi01278544-11 2024-09-10T18:00:41.768 INFO:tasks.rados.rados.0.smithi012.stdout:1182: finishing write tid 3 to smithi01278544-11 2024-09-10T18:00:41.769 INFO:tasks.rados.rados.0.smithi012.stdout:1182: finishing write tid 4 to smithi01278544-11 2024-09-10T18:00:41.769 INFO:tasks.rados.rados.0.smithi012.stdout:1184: done (1 left) 2024-09-10T18:00:41.769 INFO:tasks.rados.rados.0.smithi012.stdout:1185: rollback oid 30 current snap is 120 2024-09-10T18:00:41.769 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 118 2024-09-10T18:00:41.770 INFO:tasks.rados.rados.0.smithi012.stdout:1186: copy_from oid 23 from oid 17 current snap is 120 2024-09-10T18:00:41.770 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 120 2024-09-10T18:00:41.770 INFO:tasks.rados.rados.0.smithi012.stdout:1187: seq_num 375 ranges {7372800=688128,8060928=663552,8724480=139264} 2024-09-10T18:00:41.813 INFO:tasks.rados.rados.0.smithi012.stdout:1187: writing smithi01278544-24 from 7372800 to 8060928 tid 1 2024-09-10T18:00:41.817 INFO:tasks.rados.rados.0.smithi012.stdout:1187: writing smithi01278544-24 from 8060928 to 8724480 tid 2 2024-09-10T18:00:41.819 INFO:tasks.rados.rados.0.smithi012.stdout:1187: writing smithi01278544-24 from 8724480 to 8863744 tid 3 2024-09-10T18:00:41.819 INFO:tasks.rados.rados.0.smithi012.stdout:1188: read oid 34 snap 119 2024-09-10T18:00:41.819 INFO:tasks.rados.rados.0.smithi012.stdout:1188: expect (ObjNum 336 snap 106 seq_num 336) 2024-09-10T18:00:41.819 INFO:tasks.rados.rados.0.smithi012.stdout:1189: snap_create 2024-09-10T18:00:41.819 INFO:tasks.rados.rados.0.smithi012.stdout:1182: finishing write tid 5 to smithi01278544-11 2024-09-10T18:00:41.819 INFO:tasks.rados.rados.0.smithi012.stdout:1182: oid 11 updating version 0 to 787 2024-09-10T18:00:41.819 INFO:tasks.rados.rados.0.smithi012.stdout:1182: oid 11 updating version 787 to 788 2024-09-10T18:00:41.819 INFO:tasks.rados.rados.0.smithi012.stdout:1182: oid 11 updating version 788 to 790 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:1182: oid 11 version 790 is already newer than 789 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 790 (ObjNum 373 snap 120 seq_num 373) dirty exists 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:1182: left oid 11 (ObjNum 373 snap 120 seq_num 373) 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:1185: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:1186: finishing copy_from racing read to smithi01278544-23 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:1186: finishing copy_from to smithi01278544-23 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 373 (ObjNum 362 snap 117 seq_num 362) dirty exists 2024-09-10T18:00:41.820 INFO:tasks.rados.rados.0.smithi012.stdout:1187: finishing write tid 1 to smithi01278544-24 2024-09-10T18:00:41.821 INFO:tasks.rados.rados.0.smithi012.stdout:1188: expect (ObjNum 336 snap 106 seq_num 336) 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: finishing write tid 2 to smithi01278544-24 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: finishing write tid 3 to smithi01278544-24 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: finishing write tid 4 to smithi01278544-24 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: finishing write tid 5 to smithi01278544-24 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: oid 24 updating version 0 to 718 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: oid 24 updating version 718 to 719 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: oid 24 updating version 719 to 720 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: oid 24 version 720 is already newer than 717 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 720 (ObjNum 375 snap 120 seq_num 375) dirty exists 2024-09-10T18:00:41.844 INFO:tasks.rados.rados.0.smithi012.stdout:1187: left oid 24 (ObjNum 375 snap 120 seq_num 375) 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[89611]: Upgrade: osd.1 is safe to restart 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[89611]: osdmap e316: 8 total, 8 up, 8 in 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[92029]: Upgrade: osd.1 is safe to restart 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[92029]: osdmap e316: 8 total, 8 up, 8 in 2024-09-10T18:00:42.023 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:42.024 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T18:00:42.024 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:41 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:41 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T18:00:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:41 smithi089 ceph-mon[84132]: Upgrade: osd.1 is safe to restart 2024-09-10T18:00:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:41 smithi089 ceph-mon[84132]: osdmap e316: 8 total, 8 up, 8 in 2024-09-10T18:00:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:41 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:41 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T18:00:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:41 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:42.671 INFO:tasks.rados.rados.0.smithi012.stdout:1182: done (5 left) 2024-09-10T18:00:42.671 INFO:tasks.rados.rados.0.smithi012.stdout:1185: done (4 left) 2024-09-10T18:00:42.671 INFO:tasks.rados.rados.0.smithi012.stdout:1186: done (3 left) 2024-09-10T18:00:42.671 INFO:tasks.rados.rados.0.smithi012.stdout:1187: done (2 left) 2024-09-10T18:00:42.671 INFO:tasks.rados.rados.0.smithi012.stdout:1188: done (1 left) 2024-09-10T18:00:42.671 INFO:tasks.rados.rados.0.smithi012.stdout:1189: done (0 left) 2024-09-10T18:00:42.671 INFO:tasks.rados.rados.0.smithi012.stdout:1190: delete oid 26 current snap is 121 2024-09-10T18:00:42.672 INFO:tasks.rados.rados.0.smithi012.stdout:1190: done (0 left) 2024-09-10T18:00:42.672 INFO:tasks.rados.rados.0.smithi012.stdout:1191: delete oid 5 current snap is 121 2024-09-10T18:00:42.675 INFO:tasks.rados.rados.0.smithi012.stdout:1191: done (0 left) 2024-09-10T18:00:42.675 INFO:tasks.rados.rados.0.smithi012.stdout:1192: copy_from oid 21 from oid 29 current snap is 121 2024-09-10T18:00:42.675 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 121 2024-09-10T18:00:42.675 INFO:tasks.rados.rados.0.smithi012.stdout:1193: seq_num 378 ranges {2408448=737280,3145728=720896,3866624=81920} 2024-09-10T18:00:42.691 INFO:tasks.rados.rados.0.smithi012.stdout:1193: writing smithi01278544-3 from 2408448 to 3145728 tid 1 2024-09-10T18:00:42.695 INFO:tasks.rados.rados.0.smithi012.stdout:1193: writing smithi01278544-3 from 3145728 to 3866624 tid 2 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1193: writing smithi01278544-3 from 3866624 to 3948544 tid 3 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1194: copy_from oid 35 from oid 34 current snap is 121 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1192: finishing copy_from to smithi01278544-21 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1192: got expected ENOENT (src dne) 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1192: finishing copy_from racing read to smithi01278544-21 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1192: done (2 left) 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1195: read oid 38 snap -1 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1195: expect (ObjNum 281 snap 89 seq_num 281) 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 121 2024-09-10T18:00:42.697 INFO:tasks.rados.rados.0.smithi012.stdout:1196: seq_num 379 ranges {0=753664,753664=606208,1359872=196608} 2024-09-10T18:00:42.701 INFO:tasks.rados.rados.0.smithi012.stdout:1196: writing smithi01278544-26 from 0 to 753664 tid 1 2024-09-10T18:00:42.705 INFO:tasks.rados.rados.0.smithi012.stdout:1196: writing smithi01278544-26 from 753664 to 1359872 tid 2 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:1196: writing smithi01278544-26 from 1359872 to 1556480 tid 3 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:1197: copy_from oid 30 from oid 31 current snap is 121 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 121 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:1193: finishing write tid 1 to smithi01278544-3 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:1193: finishing write tid 2 to smithi01278544-3 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:1193: finishing write tid 3 to smithi01278544-3 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:1193: finishing write tid 4 to smithi01278544-3 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:1193: finishing write tid 5 to smithi01278544-3 2024-09-10T18:00:42.707 INFO:tasks.rados.rados.0.smithi012.stdout:1193: oid 3 updating version 0 to 634 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:1193: oid 3 version 634 is already newer than 633 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:1193: oid 3 updating version 634 to 635 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:1193: oid 3 version 635 is already newer than 632 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 635 (ObjNum 378 snap 121 seq_num 378) dirty exists 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:1193: left oid 3 (ObjNum 378 snap 121 seq_num 378) 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:1194: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:1194: finishing copy_from to smithi01278544-35 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 484 (ObjNum 336 snap 106 seq_num 336) dirty exists 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:1196: finishing write tid 1 to smithi01278544-26 2024-09-10T18:00:42.708 INFO:tasks.rados.rados.0.smithi012.stdout:1198: seq_num 380 ranges {1605632=770048,2375680=483328,2859008=319488} 2024-09-10T18:00:42.720 INFO:tasks.rados.rados.0.smithi012.stdout:1198: writing smithi01278544-23 from 1605632 to 2375680 tid 1 2024-09-10T18:00:42.723 INFO:tasks.rados.rados.0.smithi012.stdout:1198: writing smithi01278544-23 from 2375680 to 2859008 tid 2 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:1198: writing smithi01278544-23 from 2859008 to 3178496 tid 3 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:1193: done (5 left) 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:1194: done (4 left) 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 121 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:1196: finishing write tid 2 to smithi01278544-26 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:1197: finishing copy_from to smithi01278544-30 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:1197: got expected ENOENT (src dne) 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:1197: finishing copy_from racing read to smithi01278544-30 2024-09-10T18:00:42.726 INFO:tasks.rados.rados.0.smithi012.stdout:1196: finishing write tid 3 to smithi01278544-26 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:1196: finishing write tid 4 to smithi01278544-26 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:1196: finishing write tid 5 to smithi01278544-26 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:1196: oid 26 updating version 0 to 721 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:1196: oid 26 updating version 721 to 723 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:1196: oid 26 updating version 723 to 724 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:1196: oid 26 version 724 is already newer than 722 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 724 (ObjNum 379 snap 121 seq_num 379) dirty exists 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:1196: left oid 26 (ObjNum 379 snap 121 seq_num 379) 2024-09-10T18:00:42.727 INFO:tasks.rados.rados.0.smithi012.stdout:1199: seq_num 381 ranges {0=786432,786432=417792,1204224=385024} 2024-09-10T18:00:42.733 INFO:tasks.rados.rados.0.smithi012.stdout:1199: writing smithi01278544-40 from 0 to 786432 tid 1 2024-09-10T18:00:42.734 INFO:tasks.rados.rados.0.smithi012.stdout:1199: writing smithi01278544-40 from 786432 to 1204224 tid 2 2024-09-10T18:00:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:1199: writing smithi01278544-40 from 1204224 to 1589248 tid 3 2024-09-10T18:00:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:1196: done (4 left) 2024-09-10T18:00:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:1197: done (3 left) 2024-09-10T18:00:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:1200: read oid 22 snap -1 2024-09-10T18:00:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:1200: expect (ObjNum 320 snap 103 seq_num 320) 2024-09-10T18:00:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 121 2024-09-10T18:00:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:1201: seq_num 382 ranges {1441792=802816,2244608=704512,2949120=98304} 2024-09-10T18:00:42.752 INFO:tasks.rados.rados.0.smithi012.stdout:1201: writing smithi01278544-25 from 1441792 to 2244608 tid 1 2024-09-10T18:00:42.757 INFO:tasks.rados.rados.0.smithi012.stdout:1201: writing smithi01278544-25 from 2244608 to 2949120 tid 2 2024-09-10T18:00:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:1201: writing smithi01278544-25 from 2949120 to 3047424 tid 3 2024-09-10T18:00:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:1202: copy_from oid 32 from oid 43 current snap is 121 2024-09-10T18:00:42.759 INFO:tasks.rados.rados.0.smithi012.stdout:1195: expect (ObjNum 281 snap 89 seq_num 281) 2024-09-10T18:00:42.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[89611]: pgmap v144: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:42.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[89611]: Upgrade: Updating osd.1 2024-09-10T18:00:42.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[89611]: Deploying daemon osd.1 on smithi012 2024-09-10T18:00:42.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[89611]: osdmap e317: 8 total, 8 up, 8 in 2024-09-10T18:00:42.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[89611]: osdmap e318: 8 total, 8 up, 8 in 2024-09-10T18:00:42.884 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[92029]: pgmap v144: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:42.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[92029]: Upgrade: Updating osd.1 2024-09-10T18:00:42.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[92029]: Deploying daemon osd.1 on smithi012 2024-09-10T18:00:42.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[92029]: osdmap e317: 8 total, 8 up, 8 in 2024-09-10T18:00:42.885 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:42 smithi012 ceph-mon[92029]: osdmap e318: 8 total, 8 up, 8 in 2024-09-10T18:00:42.966 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:00:43.008 INFO:tasks.rados.rados.0.smithi012.stdout:1198: finishing write tid 1 to smithi01278544-23 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: finishing write tid 2 to smithi01278544-23 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: finishing write tid 3 to smithi01278544-23 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: finishing write tid 4 to smithi01278544-23 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: finishing write tid 5 to smithi01278544-23 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: oid 23 updating version 0 to 521 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: oid 23 updating version 521 to 523 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: oid 23 version 523 is already newer than 522 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: oid 23 updating version 523 to 524 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 524 (ObjNum 380 snap 121 seq_num 380) dirty exists 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1198: left oid 23 (ObjNum 380 snap 121 seq_num 380) 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1199: finishing write tid 1 to smithi01278544-40 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1199: finishing write tid 2 to smithi01278544-40 2024-09-10T18:00:43.009 INFO:tasks.rados.rados.0.smithi012.stdout:1199: finishing write tid 3 to smithi01278544-40 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1199: finishing write tid 4 to smithi01278544-40 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1199: finishing write tid 5 to smithi01278544-40 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1199: oid 40 updating version 0 to 850 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1199: oid 40 version 850 is already newer than 849 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1199: oid 40 version 850 is already newer than 847 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1199: oid 40 version 850 is already newer than 848 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 850 (ObjNum 381 snap 121 seq_num 381) dirty exists 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1199: left oid 40 (ObjNum 381 snap 121 seq_num 381) 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1195: done (5 left) 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1198: done (4 left) 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1199: done (3 left) 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1203: rmattr oid 10 current snap is 121 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1203: done (3 left) 2024-09-10T18:00:43.010 INFO:tasks.rados.rados.0.smithi012.stdout:1204: snap_remove snap 119 2024-09-10T18:00:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:42 smithi089 ceph-mon[84132]: pgmap v144: 121 pgs: 121 active+clean; 147 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail 2024-09-10T18:00:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:42 smithi089 ceph-mon[84132]: Upgrade: Updating osd.1 2024-09-10T18:00:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:42 smithi089 ceph-mon[84132]: Deploying daemon osd.1 on smithi012 2024-09-10T18:00:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:42 smithi089 ceph-mon[84132]: osdmap e317: 8 total, 8 up, 8 in 2024-09-10T18:00:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:42 smithi089 ceph-mon[84132]: osdmap e318: 8 total, 8 up, 8 in 2024-09-10T18:00:43.594 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:00:43.594 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (5m) 22s ago 6m 27.4M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (6m) 64s ago 6m 87.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (8m) 22s ago 8m 18.6M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (8m) 64s ago 8m 19.6M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (2m) 64s ago 11m 452M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (2m) 22s ago 13m 522M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (111s) 22s ago 13m 47.5M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (69s) 64s ago 12m 27.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (87s) 22s ago 11m 40.1M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (6m) 22s ago 6m 15.7M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (6m) 64s ago 6m 16.9M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (26s) 22s ago 11m 14.3M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (11m) 22s ago 11m 143M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 323d09f44711 2024-09-10T18:00:43.595 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (10m) 22s ago 10m 185M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T18:00:43.596 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (10m) 22s ago 10m 168M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T18:00:43.596 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (9m) 64s ago 9m 186M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T18:00:43.596 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (9m) 64s ago 9m 136M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T18:00:43.596 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (9m) 64s ago 9m 141M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T18:00:43.596 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (8m) 64s ago 8m 98.9M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T18:00:43.596 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (2m) 64s ago 7m 50.4M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:00:43.753 INFO:tasks.rados.rados.0.smithi012.stdout:1204: done (3 left) 2024-09-10T18:00:43.753 INFO:tasks.rados.rados.0.smithi012.stdout:1205: copy_from oid 37 from oid 9 current snap is 121 2024-09-10T18:00:43.753 INFO:tasks.rados.rados.0.smithi012.stdout:1200: expect (ObjNum 320 snap 103 seq_num 320) 2024-09-10T18:00:43.954 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:00:43.954 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 7, 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 1 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:00:43.955 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 9, 2024-09-10T18:00:43.956 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 6 2024-09-10T18:00:43.956 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:00:43.956 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: finishing write tid 1 to smithi01278544-25 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: finishing write tid 2 to smithi01278544-25 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: finishing write tid 3 to smithi01278544-25 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: finishing write tid 4 to smithi01278544-25 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: finishing write tid 5 to smithi01278544-25 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: oid 25 updating version 0 to 794 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: oid 25 updating version 794 to 795 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: oid 25 version 795 is already newer than 793 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: oid 25 version 795 is already newer than 792 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 795 (ObjNum 382 snap 121 seq_num 382) dirty exists 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1201: left oid 25 (ObjNum 382 snap 121 seq_num 382) 2024-09-10T18:00:44.003 INFO:tasks.rados.rados.0.smithi012.stdout:1202: finishing copy_from racing read to smithi01278544-32 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1202: finishing copy_from to smithi01278544-32 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 380 (ObjNum 267 snap 86 seq_num 267) dirty exists 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1205: finishing copy_from to smithi01278544-37 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1205: got expected ENOENT (src dne) 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1205: finishing copy_from racing read to smithi01278544-37 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1200: done (3 left) 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1201: done (2 left) 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1202: done (1 left) 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1205: done (0 left) 2024-09-10T18:00:44.004 INFO:tasks.rados.rados.0.smithi012.stdout:1206: snap_create 2024-09-10T18:00:44.216 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:00:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:00:43] "GET /metrics HTTP/1.1" 200 36226 "" "Prometheus/2.43.0" 2024-09-10T18:00:44.268 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "6/20 daemons upgraded", 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:00:44.269 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:00:44.534 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:44 smithi012 systemd[1]: Stopping Ceph osd.1 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:00:44.755 INFO:tasks.rados.rados.0.smithi012.stdout:1206: done (0 left) 2024-09-10T18:00:44.755 INFO:tasks.rados.rados.0.smithi012.stdout:1207: read oid 31 snap 113 2024-09-10T18:00:44.755 INFO:tasks.rados.rados.0.smithi012.stdout:1207: expect (ObjNum 340 snap 108 seq_num 340) 2024-09-10T18:00:44.755 INFO:tasks.rados.rados.0.smithi012.stdout:1208: delete oid 44 current snap is 122 2024-09-10T18:00:44.767 INFO:tasks.rados.rados.0.smithi012.stdout:1208: done (1 left) 2024-09-10T18:00:44.767 INFO:tasks.rados.rados.0.smithi012.stdout:1209: snap_create 2024-09-10T18:00:45.034 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[47365]: 2024-09-10T18:00:44.662+0000 7f16de035640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:00:45.034 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[47365]: 2024-09-10T18:00:44.662+0000 7f16de035640 -1 osd.1 319 *** Got signal Terminated *** 2024-09-10T18:00:45.034 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[47365]: 2024-09-10T18:00:44.662+0000 7f16de035640 -1 osd.1 319 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[89611]: from='client.54148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[89611]: pgmap v147: 121 pgs: 121 active+clean; 158 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[89611]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[89611]: from='client.34269 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[89611]: osdmap e319: 8 total, 8 up, 8 in 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/821695826' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[89611]: osd.1 marked itself down and dead 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[92029]: from='client.54148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[92029]: pgmap v147: 121 pgs: 121 active+clean; 158 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2024-09-10T18:00:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[92029]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[92029]: from='client.34269 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[92029]: osdmap e319: 8 total, 8 up, 8 in 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/821695826' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:44 smithi012 ceph-mon[92029]: osd.1 marked itself down and dead 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:44 smithi089 ceph-mon[84132]: from='client.54148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:44 smithi089 ceph-mon[84132]: pgmap v147: 121 pgs: 121 active+clean; 158 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:44 smithi089 ceph-mon[84132]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:44 smithi089 ceph-mon[84132]: from='client.34269 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:44 smithi089 ceph-mon[84132]: osdmap e319: 8 total, 8 up, 8 in 2024-09-10T18:00:45.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:44 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/821695826' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:45.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:44 smithi089 ceph-mon[84132]: osd.1 marked itself down and dead 2024-09-10T18:00:45.688 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:45 smithi012 podman[101625]: 2024-09-10 18:00:45.303932248 +0000 UTC m=+0.746238731 container died 323d09f44711d6a68e7754b9bc9174ffef87c046bc818f7a1fee9a11477f525a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-7a853b1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T18:00:45.761 INFO:tasks.rados.rados.0.smithi012.stdout:1209: done (1 left) 2024-09-10T18:00:45.761 INFO:tasks.rados.rados.0.smithi012.stdout:1210: snap_create 2024-09-10T18:00:45.794 INFO:tasks.rados.rados.0.smithi012.stdout:1207: expect (ObjNum 340 snap 108 seq_num 340) 2024-09-10T18:00:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:45 smithi012 ceph-mon[89611]: from='client.44195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:45 smithi012 ceph-mon[89611]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:00:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:45 smithi012 ceph-mon[89611]: osdmap e320: 8 total, 7 up, 8 in 2024-09-10T18:00:46.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:45 smithi012 ceph-mon[92029]: from='client.44195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:46.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:45 smithi012 ceph-mon[92029]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:00:46.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:45 smithi012 ceph-mon[92029]: osdmap e320: 8 total, 7 up, 8 in 2024-09-10T18:00:46.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:45 smithi012 podman[101625]: 2024-09-10 18:00:45.854167127 +0000 UTC m=+1.296473603 container cleanup 323d09f44711d6a68e7754b9bc9174ffef87c046bc818f7a1fee9a11477f525a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=reef-7a853b1, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T18:00:46.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:45 smithi012 bash[101625]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1 2024-09-10T18:00:46.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:45 smithi089 ceph-mon[84132]: from='client.44195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:00:46.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:45 smithi089 ceph-mon[84132]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:00:46.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:45 smithi089 ceph-mon[84132]: osdmap e320: 8 total, 7 up, 8 in 2024-09-10T18:00:46.466 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:46 smithi012 podman[101650]: 2024-09-10 18:00:46.130584315 +0000 UTC m=+0.822180489 container remove 323d09f44711d6a68e7754b9bc9174ffef87c046bc818f7a1fee9a11477f525a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, RELEASE=reef-7a853b1, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T18:00:46.749 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:46 smithi012 podman[101745]: 2024-09-10 18:00:46.368333868 +0000 UTC m=+0.016269986 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:00:46.749 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:46 smithi012 podman[101745]: 2024-09-10 18:00:46.473100607 +0000 UTC m=+0.121036708 container create 001a143cdf2019ad4fcea4895caca849a049c4a758cd9febb3c287d5edd1237d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True) 2024-09-10T18:00:46.749 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:46 smithi012 podman[101745]: 2024-09-10 18:00:46.702875419 +0000 UTC m=+0.350811533 container init 001a143cdf2019ad4fcea4895caca849a049c4a758cd9febb3c287d5edd1237d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:00:46.749 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:46 smithi012 podman[101745]: 2024-09-10 18:00:46.706493693 +0000 UTC m=+0.354429803 container start 001a143cdf2019ad4fcea4895caca849a049c4a758cd9febb3c287d5edd1237d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1207: done (1 left) 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1210: done (0 left) 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1211: rollback oid 2 current snap is 124 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 2 to 117 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1212: read oid 21 snap -1 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1212: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1213: rollback oid 16 current snap is 124 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 122 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1214: read oid 19 snap -1 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1214: expect deleted 2024-09-10T18:00:46.764 INFO:tasks.rados.rados.0.smithi012.stdout:1215: delete oid 38 current snap is 124 2024-09-10T18:00:46.766 INFO:tasks.rados.rados.0.smithi012.stdout:1211: finishing rollback tid 1 to smithi01278544-2 2024-09-10T18:00:46.767 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 0 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-09-10T18:00:46.767 INFO:tasks.rados.rados.0.smithi012.stdout:1212: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:00:46.769 INFO:tasks.rados.rados.0.smithi012.stdout:1213: finishing rollback tid 0 to smithi01278544-16 2024-09-10T18:00:46.769 INFO:tasks.rados.rados.0.smithi012.stdout:1213: finishing rollback tid 1 to smithi01278544-16 2024-09-10T18:00:46.771 INFO:tasks.rados.rados.0.smithi012.stdout:1211: done (4 left) 2024-09-10T18:00:46.771 INFO:tasks.rados.rados.0.smithi012.stdout:1212: done (3 left) 2024-09-10T18:00:46.771 INFO:tasks.rados.rados.0.smithi012.stdout:1214: done (2 left) 2024-09-10T18:00:46.772 INFO:tasks.rados.rados.0.smithi012.stdout:1215: done (1 left) 2024-09-10T18:00:46.772 INFO:tasks.rados.rados.0.smithi012.stdout:1216: rollback oid 30 current snap is 124 2024-09-10T18:00:46.772 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 117 2024-09-10T18:00:46.772 INFO:tasks.rados.rados.0.smithi012.stdout:1217: read oid 35 snap 118 2024-09-10T18:00:46.772 INFO:tasks.rados.rados.0.smithi012.stdout:1217: expect (ObjNum 320 snap 103 seq_num 320) 2024-09-10T18:00:46.772 INFO:tasks.rados.rados.0.smithi012.stdout:1218: read oid 8 snap 121 2024-09-10T18:00:46.772 INFO:tasks.rados.rados.0.smithi012.stdout:1218: expect deleted 2024-09-10T18:00:46.773 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 124 2024-09-10T18:00:46.773 INFO:tasks.rados.rados.0.smithi012.stdout:1219: seq_num 385 ranges {4538368=450560,4988928=761856,5750784=442368} 2024-09-10T18:00:46.798 INFO:tasks.rados.rados.0.smithi012.stdout:1219: writing smithi01278544-46 from 4538368 to 4988928 tid 1 2024-09-10T18:00:46.803 INFO:tasks.rados.rados.0.smithi012.stdout:1219: writing smithi01278544-46 from 4988928 to 5750784 tid 2 2024-09-10T18:00:46.806 INFO:tasks.rados.rados.0.smithi012.stdout:1219: writing smithi01278544-46 from 5750784 to 6193152 tid 3 2024-09-10T18:00:46.806 INFO:tasks.rados.rados.0.smithi012.stdout:1220: rollback oid 50 current snap is 124 2024-09-10T18:00:46.806 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 113 2024-09-10T18:00:46.806 INFO:tasks.rados.rados.0.smithi012.stdout:1213: finishing rollback tid 2 to smithi01278544-16 2024-09-10T18:00:46.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 615 (ObjNum 354 snap 115 seq_num 354) dirty exists 2024-09-10T18:00:46.806 INFO:tasks.rados.rados.0.smithi012.stdout:1216: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:00:46.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 0 (ObjNum 81 snap 0 seq_num 3013199012) dirty dne 2024-09-10T18:00:46.806 INFO:tasks.rados.rados.0.smithi012.stdout:1217: expect (ObjNum 320 snap 103 seq_num 320) 2024-09-10T18:00:47.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:46 smithi012 ceph-mon[92029]: pgmap v150: 121 pgs: 16 stale+active+clean, 105 active+clean; 158 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.9 MiB/s wr, 18 op/s 2024-09-10T18:00:47.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:46 smithi012 ceph-mon[92029]: osdmap e321: 8 total, 7 up, 8 in 2024-09-10T18:00:47.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:47.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:47.038 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:46 smithi012 ceph-mon[89611]: pgmap v150: 121 pgs: 16 stale+active+clean, 105 active+clean; 158 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.9 MiB/s wr, 18 op/s 2024-09-10T18:00:47.038 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:46 smithi012 ceph-mon[89611]: osdmap e321: 8 total, 7 up, 8 in 2024-09-10T18:00:47.038 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:47.038 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:47.038 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:46 smithi012 podman[101745]: 2024-09-10 18:00:46.811595949 +0000 UTC m=+0.459532064 container attach 001a143cdf2019ad4fcea4895caca849a049c4a758cd9febb3c287d5edd1237d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:00:47.038 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:46 smithi012 podman[101745]: 2024-09-10 18:00:46.915942226 +0000 UTC m=+0.563878336 container died 001a143cdf2019ad4fcea4895caca849a049c4a758cd9febb3c287d5edd1237d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T18:00:47.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:46 smithi089 ceph-mon[84132]: pgmap v150: 121 pgs: 16 stale+active+clean, 105 active+clean; 158 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.9 MiB/s wr, 18 op/s 2024-09-10T18:00:47.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:46 smithi089 ceph-mon[84132]: osdmap e321: 8 total, 7 up, 8 in 2024-09-10T18:00:47.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:47.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1219: finishing write tid 1 to smithi01278544-46 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1219: finishing write tid 2 to smithi01278544-46 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1220: finishing rollback tid 1 to smithi01278544-50 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 0 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1219: finishing write tid 3 to smithi01278544-46 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1219: finishing write tid 4 to smithi01278544-46 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1219: finishing write tid 5 to smithi01278544-46 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1219: oid 46 updating version 0 to 640 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1219: oid 46 version 640 is already newer than 639 2024-09-10T18:00:47.052 INFO:tasks.rados.rados.0.smithi012.stdout:1219: oid 46 version 640 is already newer than 638 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1219: oid 46 version 640 is already newer than 637 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 640 (ObjNum 385 snap 124 seq_num 385) dirty exists 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1219: left oid 46 (ObjNum 385 snap 124 seq_num 385) 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1213: done (5 left) 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1216: done (4 left) 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1217: done (3 left) 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1218: done (2 left) 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1219: done (1 left) 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1220: done (0 left) 2024-09-10T18:00:47.053 INFO:tasks.rados.rados.0.smithi012.stdout:1221: delete oid 12 current snap is 124 2024-09-10T18:00:47.054 INFO:tasks.rados.rados.0.smithi012.stdout:1221: done (0 left) 2024-09-10T18:00:47.054 INFO:tasks.rados.rados.0.smithi012.stdout:1222: snap_remove snap 113 2024-09-10T18:00:47.677 INFO:tasks.rados.rados.0.smithi012.stdout:1222: done (0 left) 2024-09-10T18:00:47.677 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 124 2024-09-10T18:00:47.677 INFO:tasks.rados.rados.0.smithi012.stdout:1223: seq_num 387 ranges {6627328=483328,7110656=524288,7634944=679936} 2024-09-10T18:00:47.715 INFO:tasks.rados.rados.0.smithi012.stdout:1223: writing smithi01278544-47 from 6627328 to 7110656 tid 1 2024-09-10T18:00:47.718 INFO:tasks.rados.rados.0.smithi012.stdout:1223: writing smithi01278544-47 from 7110656 to 7634944 tid 2 2024-09-10T18:00:47.723 INFO:tasks.rados.rados.0.smithi012.stdout:1223: writing smithi01278544-47 from 7634944 to 8314880 tid 3 2024-09-10T18:00:47.723 INFO:tasks.rados.rados.0.smithi012.stdout:1224: rmattr oid 13 current snap is 124 2024-09-10T18:00:47.723 INFO:tasks.rados.rados.0.smithi012.stdout:1224: done (1 left) 2024-09-10T18:00:47.723 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 124 2024-09-10T18:00:47.723 INFO:tasks.rados.rados.0.smithi012.stdout:1223: finishing write tid 1 to smithi01278544-47 2024-09-10T18:00:47.723 INFO:tasks.rados.rados.0.smithi012.stdout:1223: finishing write tid 2 to smithi01278544-47 2024-09-10T18:00:47.724 INFO:tasks.rados.rados.0.smithi012.stdout:1225: seq_num 388 ranges {835584=507904,1343488=458752,1802240=606208,2408448=139264} 2024-09-10T18:00:47.730 INFO:tasks.rados.rados.0.smithi012.stdout:1225: writing smithi01278544-20 from 835584 to 1343488 tid 1 2024-09-10T18:00:47.733 INFO:tasks.rados.rados.0.smithi012.stdout:1225: writing smithi01278544-20 from 1343488 to 1802240 tid 2 2024-09-10T18:00:47.736 INFO:tasks.rados.rados.0.smithi012.stdout:1225: writing smithi01278544-20 from 1802240 to 2408448 tid 3 2024-09-10T18:00:47.738 INFO:tasks.rados.rados.0.smithi012.stdout:1225: writing smithi01278544-20 from 2408448 to 2547712 tid 4 2024-09-10T18:00:47.738 INFO:tasks.rados.rados.0.smithi012.stdout:1226: copy_from oid 40 from oid 36 current snap is 124 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:1223: finishing write tid 3 to smithi01278544-47 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:1223: finishing write tid 4 to smithi01278544-47 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:1223: finishing write tid 5 to smithi01278544-47 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:1223: oid 47 updating version 0 to 858 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:1223: oid 47 updating version 858 to 859 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:1223: oid 47 version 859 is already newer than 856 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:1223: oid 47 version 859 is already newer than 857 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 859 (ObjNum 387 snap 124 seq_num 387) dirty exists 2024-09-10T18:00:47.739 INFO:tasks.rados.rados.0.smithi012.stdout:1223: left oid 47 (ObjNum 387 snap 124 seq_num 387) 2024-09-10T18:00:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:1225: finishing write tid 1 to smithi01278544-20 2024-09-10T18:00:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:1225: finishing write tid 2 to smithi01278544-20 2024-09-10T18:00:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:1223: done (2 left) 2024-09-10T18:00:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:1227: read oid 43 snap -1 2024-09-10T18:00:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:1227: expect (ObjNum 267 snap 86 seq_num 267) 2024-09-10T18:00:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 124 2024-09-10T18:00:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:1228: seq_num 389 ranges {0=524288,524288=745472,1269760=458752} 2024-09-10T18:00:47.741 INFO:tasks.rados.rados.0.smithi012.stdout:1228: writing smithi01278544-18 from 0 to 524288 tid 1 2024-09-10T18:00:47.745 INFO:tasks.rados.rados.0.smithi012.stdout:1228: writing smithi01278544-18 from 524288 to 1269760 tid 2 2024-09-10T18:00:47.748 INFO:tasks.rados.rados.0.smithi012.stdout:1228: writing smithi01278544-18 from 1269760 to 1728512 tid 3 2024-09-10T18:00:47.748 INFO:tasks.rados.rados.0.smithi012.stdout:1229: snap_create 2024-09-10T18:00:47.748 INFO:tasks.rados.rados.0.smithi012.stdout:1225: finishing write tid 3 to smithi01278544-20 2024-09-10T18:00:47.748 INFO:tasks.rados.rados.0.smithi012.stdout:1225: finishing write tid 4 to smithi01278544-20 2024-09-10T18:00:47.749 INFO:tasks.rados.rados.0.smithi012.stdout:1225: finishing write tid 5 to smithi01278544-20 2024-09-10T18:00:47.749 INFO:tasks.rados.rados.0.smithi012.stdout:1225: finishing write tid 6 to smithi01278544-20 2024-09-10T18:00:47.749 INFO:tasks.rados.rados.0.smithi012.stdout:1225: oid 20 updating version 0 to 809 2024-09-10T18:00:47.749 INFO:tasks.rados.rados.0.smithi012.stdout:1225: oid 20 updating version 809 to 813 2024-09-10T18:00:47.749 INFO:tasks.rados.rados.0.smithi012.stdout:1225: oid 20 version 813 is already newer than 812 2024-09-10T18:00:47.750 INFO:tasks.rados.rados.0.smithi012.stdout:1225: oid 20 version 813 is already newer than 810 2024-09-10T18:00:47.750 INFO:tasks.rados.rados.0.smithi012.stdout:1225: oid 20 version 813 is already newer than 811 2024-09-10T18:00:47.750 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 813 (ObjNum 388 snap 124 seq_num 388) dirty exists 2024-09-10T18:00:47.750 INFO:tasks.rados.rados.0.smithi012.stdout:1225: left oid 20 (ObjNum 388 snap 124 seq_num 388) 2024-09-10T18:00:47.750 INFO:tasks.rados.rados.0.smithi012.stdout:1227: expect (ObjNum 267 snap 86 seq_num 267) 2024-09-10T18:00:47.767 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:47 smithi012 podman[101768]: 2024-09-10 18:00:47.515252942 +0000 UTC m=+0.593317827 container remove 001a143cdf2019ad4fcea4895caca849a049c4a758cd9febb3c287d5edd1237d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T18:00:47.768 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:47 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-10T18:00:47.768 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:47 smithi012 systemd[1]: Stopped Ceph osd.1 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:00:47.768 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:47 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.1.service: Consumed 10.683s CPU time. 2024-09-10T18:00:47.768 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:47 smithi012 systemd[1]: Starting Ceph osd.1 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: finishing write tid 1 to smithi01278544-18 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: finishing write tid 2 to smithi01278544-18 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: finishing write tid 3 to smithi01278544-18 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: finishing write tid 4 to smithi01278544-18 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: finishing write tid 5 to smithi01278544-18 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: oid 18 updating version 0 to 512 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: oid 18 updating version 512 to 514 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: oid 18 updating version 514 to 515 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: oid 18 version 515 is already newer than 513 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 515 (ObjNum 389 snap 124 seq_num 389) dirty exists 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1228: left oid 18 (ObjNum 389 snap 124 seq_num 389) 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1226: finishing copy_from racing read to smithi01278544-40 2024-09-10T18:00:47.809 INFO:tasks.rados.rados.0.smithi012.stdout:1226: finishing copy_from to smithi01278544-40 2024-09-10T18:00:47.810 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 716 (ObjNum 307 snap 102 seq_num 307) dirty exists 2024-09-10T18:00:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:47 smithi012 ceph-mon[89611]: osdmap e322: 8 total, 7 up, 8 in 2024-09-10T18:00:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:47 smithi012 ceph-mon[89611]: pgmap v153: 121 pgs: 25 active+undersized, 2 stale+active+clean, 10 active+undersized+degraded, 84 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.0 MiB/s wr, 14 op/s; 32/372 objects degraded (8.602%) 2024-09-10T18:00:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:47 smithi012 ceph-mon[89611]: osdmap e323: 8 total, 7 up, 8 in 2024-09-10T18:00:48.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:47 smithi012 ceph-mon[92029]: osdmap e322: 8 total, 7 up, 8 in 2024-09-10T18:00:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:47 smithi012 ceph-mon[92029]: pgmap v153: 121 pgs: 25 active+undersized, 2 stale+active+clean, 10 active+undersized+degraded, 84 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.0 MiB/s wr, 14 op/s; 32/372 objects degraded (8.602%) 2024-09-10T18:00:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:47 smithi012 ceph-mon[92029]: osdmap e323: 8 total, 7 up, 8 in 2024-09-10T18:00:48.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:47 smithi012 podman[101868]: 2024-09-10 18:00:47.884603923 +0000 UTC m=+0.017002200 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:00:48.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:47 smithi012 podman[101868]: 2024-09-10 18:00:47.991160253 +0000 UTC m=+0.123558532 container create b4eb0139c573658b91164a4b5610cbd8c4d2a2cfba4dc3fa2421a9840af02688 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T18:00:48.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:47 smithi089 ceph-mon[84132]: osdmap e322: 8 total, 7 up, 8 in 2024-09-10T18:00:48.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:47 smithi089 ceph-mon[84132]: pgmap v153: 121 pgs: 25 active+undersized, 2 stale+active+clean, 10 active+undersized+degraded, 84 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.0 MiB/s wr, 14 op/s; 32/372 objects degraded (8.602%) 2024-09-10T18:00:48.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:47 smithi089 ceph-mon[84132]: osdmap e323: 8 total, 7 up, 8 in 2024-09-10T18:00:48.374 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 podman[101868]: 2024-09-10 18:00:48.235642742 +0000 UTC m=+0.368041030 container init b4eb0139c573658b91164a4b5610cbd8c4d2a2cfba4dc3fa2421a9840af02688 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T18:00:48.374 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 podman[101868]: 2024-09-10 18:00:48.239169811 +0000 UTC m=+0.371568088 container start b4eb0139c573658b91164a4b5610cbd8c4d2a2cfba4dc3fa2421a9840af02688 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T18:00:48.374 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 podman[101868]: 2024-09-10 18:00:48.318916368 +0000 UTC m=+0.451314654 container attach b4eb0139c573658b91164a4b5610cbd8c4d2a2cfba4dc3fa2421a9840af02688 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:1225: done (4 left) 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:1226: done (3 left) 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:1227: done (2 left) 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:1228: done (1 left) 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:1229: done (0 left) 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:1230: copy_from oid 49 from oid 24 current snap is 125 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:1231: rollback oid 15 current snap is 125 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 15 to 118 2024-09-10T18:00:48.674 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 125 2024-09-10T18:00:48.675 INFO:tasks.rados.rados.0.smithi012.stdout:1232: seq_num 390 ranges {835584=540672,1376256=630784,2007040=573440} 2024-09-10T18:00:48.680 INFO:tasks.rados.rados.0.smithi012.stdout:1232: writing smithi01278544-35 from 835584 to 1376256 tid 1 2024-09-10T18:00:48.683 INFO:tasks.rados.rados.0.smithi012.stdout:1232: writing smithi01278544-35 from 1376256 to 2007040 tid 2 2024-09-10T18:00:48.687 INFO:tasks.rados.rados.0.smithi012.stdout:1232: writing smithi01278544-35 from 2007040 to 2580480 tid 3 2024-09-10T18:00:48.687 INFO:tasks.rados.rados.0.smithi012.stdout:1233: snap_create 2024-09-10T18:00:48.687 INFO:tasks.rados.rados.0.smithi012.stdout:1231: finishing rollback tid 0 to smithi01278544-15 2024-09-10T18:00:48.687 INFO:tasks.rados.rados.0.smithi012.stdout:1231: finishing rollback tid 1 to smithi01278544-15 2024-09-10T18:00:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:1231: finishing rollback tid 2 to smithi01278544-15 2024-09-10T18:00:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 519 (ObjNum 331 snap 105 seq_num 331) dirty exists 2024-09-10T18:00:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:1232: finishing write tid 1 to smithi01278544-35 2024-09-10T18:00:48.690 INFO:tasks.rados.rados.0.smithi012.stdout:1232: finishing write tid 2 to smithi01278544-35 2024-09-10T18:00:48.694 INFO:tasks.rados.rados.0.smithi012.stdout:1232: finishing write tid 3 to smithi01278544-35 2024-09-10T18:00:48.694 INFO:tasks.rados.rados.0.smithi012.stdout:1232: finishing write tid 4 to smithi01278544-35 2024-09-10T18:00:48.696 INFO:tasks.rados.rados.0.smithi012.stdout:1232: finishing write tid 5 to smithi01278544-35 2024-09-10T18:00:48.697 INFO:tasks.rados.rados.0.smithi012.stdout:1232: oid 35 updating version 0 to 719 2024-09-10T18:00:48.697 INFO:tasks.rados.rados.0.smithi012.stdout:1232: oid 35 version 719 is already newer than 718 2024-09-10T18:00:48.697 INFO:tasks.rados.rados.0.smithi012.stdout:1232: oid 35 updating version 719 to 720 2024-09-10T18:00:48.697 INFO:tasks.rados.rados.0.smithi012.stdout:1232: oid 35 version 720 is already newer than 717 2024-09-10T18:00:48.697 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 720 (ObjNum 390 snap 125 seq_num 390) dirty exists 2024-09-10T18:00:48.697 INFO:tasks.rados.rados.0.smithi012.stdout:1232: left oid 35 (ObjNum 390 snap 125 seq_num 390) 2024-09-10T18:00:48.716 INFO:tasks.rados.rados.0.smithi012.stdout:1230: finishing copy_from racing read to smithi01278544-49 2024-09-10T18:00:48.716 INFO:tasks.rados.rados.0.smithi012.stdout:1230: finishing copy_from to smithi01278544-49 2024-09-10T18:00:48.716 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 720 (ObjNum 375 snap 120 seq_num 375) dirty exists 2024-09-10T18:00:48.769 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:00:48.769 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 bash[101868]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:00:48.769 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:00:48.769 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 bash[101868]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:00:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:48 smithi012 ceph-mon[89611]: Health check failed: Degraded data redundancy: 32/372 objects degraded (8.602%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:48 smithi012 ceph-mon[89611]: osdmap e324: 8 total, 7 up, 8 in 2024-09-10T18:00:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:48 smithi012 ceph-mon[92029]: Health check failed: Degraded data redundancy: 32/372 objects degraded (8.602%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:48 smithi012 ceph-mon[92029]: osdmap e324: 8 total, 7 up, 8 in 2024-09-10T18:00:49.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T18:00:49.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 bash[101868]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T18:00:49.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T18:00:49.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:48 smithi012 bash[101868]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T18:00:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:48 smithi089 ceph-mon[84132]: Health check failed: Degraded data redundancy: 32/372 objects degraded (8.602%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:48 smithi089 ceph-mon[84132]: osdmap e324: 8 total, 7 up, 8 in 2024-09-10T18:00:49.475 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T18:00:49.475 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 bash[101868]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T18:00:49.475 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T18:00:49.475 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 bash[101868]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T18:00:49.475 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-10T18:00:49.476 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 bash[101868]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-10T18:00:49.476 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T18:00:49.476 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 bash[101868]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T18:00:49.476 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate[101882]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-10T18:00:49.476 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 bash[101868]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-10T18:00:49.476 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 podman[101868]: 2024-09-10 18:00:49.168305338 +0000 UTC m=+1.300703615 container died b4eb0139c573658b91164a4b5610cbd8c4d2a2cfba4dc3fa2421a9840af02688 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:00:49.674 INFO:tasks.rados.rados.0.smithi012.stdout:1230: done (3 left) 2024-09-10T18:00:49.675 INFO:tasks.rados.rados.0.smithi012.stdout:1231: done (2 left) 2024-09-10T18:00:49.675 INFO:tasks.rados.rados.0.smithi012.stdout:1232: done (1 left) 2024-09-10T18:00:49.675 INFO:tasks.rados.rados.0.smithi012.stdout:1233: done (0 left) 2024-09-10T18:00:49.675 INFO:tasks.rados.rados.0.smithi012.stdout:1234: rollback oid 1 current snap is 126 2024-09-10T18:00:49.675 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 125 2024-09-10T18:00:49.675 INFO:tasks.rados.rados.0.smithi012.stdout:1235: rollback oid 36 current snap is 126 2024-09-10T18:00:49.675 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 122 2024-09-10T18:00:49.675 INFO:tasks.rados.rados.0.smithi012.stdout:1236: snap_remove snap 118 2024-09-10T18:00:50.034 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 podman[102023]: 2024-09-10 18:00:49.764449524 +0000 UTC m=+0.589817966 container remove b4eb0139c573658b91164a4b5610cbd8c4d2a2cfba4dc3fa2421a9840af02688 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True) 2024-09-10T18:00:50.034 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 podman[102084]: 2024-09-10 18:00:49.882355135 +0000 UTC m=+0.016833482 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:00:50.034 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:49 smithi012 podman[102084]: 2024-09-10 18:00:49.991290396 +0000 UTC m=+0.125768794 container create 320b64c712887c614ba1110f0b10a667231556ad15ea247af8e02901edf064d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T18:00:50.534 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:50 smithi012 podman[102084]: 2024-09-10 18:00:50.209347624 +0000 UTC m=+0.343825973 container init 320b64c712887c614ba1110f0b10a667231556ad15ea247af8e02901edf064d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS) 2024-09-10T18:00:50.535 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:50 smithi012 podman[102084]: 2024-09-10 18:00:50.212643599 +0000 UTC m=+0.347121945 container start 320b64c712887c614ba1110f0b10a667231556ad15ea247af8e02901edf064d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux ) 2024-09-10T18:00:50.535 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-osd[102102]: -- 172.21.15.12:0/282188718 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e70ec9fa40 con 0x55e70fa70400 2024-09-10T18:00:50.535 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:50 smithi012 bash[102084]: 320b64c712887c614ba1110f0b10a667231556ad15ea247af8e02901edf064d4 2024-09-10T18:00:50.535 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:50 smithi012 systemd[1]: Started Ceph osd.1 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:1236: done (2 left) 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 126 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:1234: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 552 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:1235: finishing rollback tid 0 to smithi01278544-36 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:1235: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:1235: finishing rollback tid 2 to smithi01278544-36 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 727 (ObjNum 307 snap 102 seq_num 307) dirty exists 2024-09-10T18:00:50.676 INFO:tasks.rados.rados.0.smithi012.stdout:1237: seq_num 391 ranges {0=557056,557056=516096,1073152=688128} 2024-09-10T18:00:50.681 INFO:tasks.rados.rados.0.smithi012.stdout:1237: writing smithi01278544-29 from 0 to 557056 tid 1 2024-09-10T18:00:50.683 INFO:tasks.rados.rados.0.smithi012.stdout:1237: writing smithi01278544-29 from 557056 to 1073152 tid 2 2024-09-10T18:00:50.689 INFO:tasks.rados.rados.0.smithi012.stdout:1237: writing smithi01278544-29 from 1073152 to 1761280 tid 3 2024-09-10T18:00:50.689 INFO:tasks.rados.rados.0.smithi012.stdout:1234: done (2 left) 2024-09-10T18:00:50.689 INFO:tasks.rados.rados.0.smithi012.stdout:1235: done (1 left) 2024-09-10T18:00:50.689 INFO:tasks.rados.rados.0.smithi012.stdout:1238: read oid 13 snap 103 2024-09-10T18:00:50.689 INFO:tasks.rados.rados.0.smithi012.stdout:1238: expect deleted 2024-09-10T18:00:50.689 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 126 2024-09-10T18:00:50.689 INFO:tasks.rados.rados.0.smithi012.stdout:1239: seq_num 392 ranges {2080768=573440,2654208=802816,3457024=401408} 2024-09-10T18:00:50.703 INFO:tasks.rados.rados.0.smithi012.stdout:1239: writing smithi01278544-43 from 2080768 to 2654208 tid 1 2024-09-10T18:00:50.708 INFO:tasks.rados.rados.0.smithi012.stdout:1239: writing smithi01278544-43 from 2654208 to 3457024 tid 2 2024-09-10T18:00:50.711 INFO:tasks.rados.rados.0.smithi012.stdout:1239: writing smithi01278544-43 from 3457024 to 3858432 tid 3 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: finishing write tid 1 to smithi01278544-29 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: finishing write tid 2 to smithi01278544-29 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: finishing write tid 3 to smithi01278544-29 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: finishing write tid 4 to smithi01278544-29 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: finishing write tid 5 to smithi01278544-29 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: oid 29 updating version 0 to 207 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: oid 29 version 207 is already newer than 205 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: oid 29 version 207 is already newer than 206 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:1237: oid 29 version 207 is already newer than 204 2024-09-10T18:00:50.712 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 207 (ObjNum 391 snap 126 seq_num 391) dirty exists 2024-09-10T18:00:50.713 INFO:tasks.rados.rados.0.smithi012.stdout:1237: left oid 29 (ObjNum 391 snap 126 seq_num 391) 2024-09-10T18:00:50.713 INFO:tasks.rados.rados.0.smithi012.stdout:1239: finishing write tid 1 to smithi01278544-43 2024-09-10T18:00:50.713 INFO:tasks.rados.rados.0.smithi012.stdout:1237: done (2 left) 2024-09-10T18:00:50.713 INFO:tasks.rados.rados.0.smithi012.stdout:1238: done (1 left) 2024-09-10T18:00:50.713 INFO:tasks.rados.rados.0.smithi012.stdout:1240: copy_from oid 17 from oid 37 current snap is 126 2024-09-10T18:00:50.713 INFO:tasks.rados.rados.0.smithi012.stdout:1241: snap_remove snap 107 2024-09-10T18:00:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[89611]: pgmap v156: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 13 op/s; 32/375 objects degraded (8.533%) 2024-09-10T18:00:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[89611]: osdmap e325: 8 total, 7 up, 8 in 2024-09-10T18:00:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[92029]: pgmap v156: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 13 op/s; 32/375 objects degraded (8.533%) 2024-09-10T18:00:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[92029]: osdmap e325: 8 total, 7 up, 8 in 2024-09-10T18:00:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:50 smithi089 ceph-mon[84132]: pgmap v156: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 13 op/s; 32/375 objects degraded (8.533%) 2024-09-10T18:00:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:50 smithi089 ceph-mon[84132]: osdmap e325: 8 total, 7 up, 8 in 2024-09-10T18:00:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:51.690 INFO:tasks.rados.rados.0.smithi012.stdout:1241: done (2 left) 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1242: snap_create 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: finishing write tid 2 to smithi01278544-43 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: finishing write tid 3 to smithi01278544-43 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: finishing write tid 4 to smithi01278544-43 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: finishing write tid 5 to smithi01278544-43 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: oid 43 updating version 0 to 866 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: oid 43 updating version 866 to 867 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: oid 43 updating version 867 to 868 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: oid 43 version 868 is already newer than 865 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 868 (ObjNum 392 snap 126 seq_num 392) dirty exists 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1239: left oid 43 (ObjNum 392 snap 126 seq_num 392) 2024-09-10T18:00:51.691 INFO:tasks.rados.rados.0.smithi012.stdout:1240: finishing copy_from racing read to smithi01278544-17 2024-09-10T18:00:51.692 INFO:tasks.rados.rados.0.smithi012.stdout:1240: finishing copy_from to smithi01278544-17 2024-09-10T18:00:51.692 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 443 (ObjNum 342 snap 109 seq_num 342) dirty exists 2024-09-10T18:00:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:51 smithi012 ceph-mon[92029]: osdmap e326: 8 total, 7 up, 8 in 2024-09-10T18:00:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:51 smithi012 ceph-mon[89611]: osdmap e326: 8 total, 7 up, 8 in 2024-09-10T18:00:52.035 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:51 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[102098]: 2024-09-10T18:00:51.854+0000 7f607959f640 -1 Falling back to public interface 2024-09-10T18:00:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:51 smithi089 ceph-mon[84132]: osdmap e326: 8 total, 7 up, 8 in 2024-09-10T18:00:52.673 INFO:tasks.rados.rados.0.smithi012.stdout:1239: done (2 left) 2024-09-10T18:00:52.673 INFO:tasks.rados.rados.0.smithi012.stdout:1240: done (1 left) 2024-09-10T18:00:52.674 INFO:tasks.rados.rados.0.smithi012.stdout:1242: done (0 left) 2024-09-10T18:00:52.674 INFO:tasks.rados.rados.0.smithi012.stdout:1243: read oid 47 snap -1 2024-09-10T18:00:52.674 INFO:tasks.rados.rados.0.smithi012.stdout:1243: expect (ObjNum 387 snap 124 seq_num 387) 2024-09-10T18:00:52.674 INFO:tasks.rados.rados.0.smithi012.stdout:1244: read oid 40 snap -1 2024-09-10T18:00:52.674 INFO:tasks.rados.rados.0.smithi012.stdout:1244: expect (ObjNum 307 snap 102 seq_num 307) 2024-09-10T18:00:52.674 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 127 2024-09-10T18:00:52.674 INFO:tasks.rados.rados.0.smithi012.stdout:1245: seq_num 393 ranges {0=589824,589824=679936,1269760=524288} 2024-09-10T18:00:52.676 INFO:tasks.rados.rados.0.smithi012.stdout:1245: writing smithi01278544-21 from 0 to 589824 tid 1 2024-09-10T18:00:52.680 INFO:tasks.rados.rados.0.smithi012.stdout:1245: writing smithi01278544-21 from 589824 to 1269760 tid 2 2024-09-10T18:00:52.685 INFO:tasks.rados.rados.0.smithi012.stdout:1245: writing smithi01278544-21 from 1269760 to 1794048 tid 3 2024-09-10T18:00:52.685 INFO:tasks.rados.rados.0.smithi012.stdout:1246: read oid 15 snap -1 2024-09-10T18:00:52.685 INFO:tasks.rados.rados.0.smithi012.stdout:1246: expect (ObjNum 331 snap 105 seq_num 331) 2024-09-10T18:00:52.685 INFO:tasks.rados.rados.0.smithi012.stdout:1247: rmattr oid 1 current snap is 127 2024-09-10T18:00:52.685 INFO:tasks.rados.rados.0.smithi012.stdout:1247: done (4 left) 2024-09-10T18:00:52.685 INFO:tasks.rados.rados.0.smithi012.stdout:1248: delete oid 3 current snap is 127 2024-09-10T18:00:52.690 INFO:tasks.rados.rados.0.smithi012.stdout:1245: finishing write tid 1 to smithi01278544-21 2024-09-10T18:00:52.693 INFO:tasks.rados.rados.0.smithi012.stdout:1248: done (4 left) 2024-09-10T18:00:52.694 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 127 2024-09-10T18:00:52.694 INFO:tasks.rados.rados.0.smithi012.stdout:1249: seq_num 395 ranges {4603904=622592,5226496=450560,5677056=753664} 2024-09-10T18:00:52.725 INFO:tasks.rados.rados.0.smithi012.stdout:1249: writing smithi01278544-22 from 4603904 to 5226496 tid 1 2024-09-10T18:00:52.728 INFO:tasks.rados.rados.0.smithi012.stdout:1249: writing smithi01278544-22 from 5226496 to 5677056 tid 2 2024-09-10T18:00:52.733 INFO:tasks.rados.rados.0.smithi012.stdout:1249: writing smithi01278544-22 from 5677056 to 6430720 tid 3 2024-09-10T18:00:52.734 INFO:tasks.rados.rados.0.smithi012.stdout:1250: delete oid 34 current snap is 127 2024-09-10T18:00:52.734 INFO:tasks.rados.rados.0.smithi012.stdout:1245: finishing write tid 2 to smithi01278544-21 2024-09-10T18:00:52.734 INFO:tasks.rados.rados.0.smithi012.stdout:1245: finishing write tid 3 to smithi01278544-21 2024-09-10T18:00:52.734 INFO:tasks.rados.rados.0.smithi012.stdout:1245: finishing write tid 4 to smithi01278544-21 2024-09-10T18:00:52.734 INFO:tasks.rados.rados.0.smithi012.stdout:1246: expect (ObjNum 331 snap 105 seq_num 331) 2024-09-10T18:00:52.771 INFO:tasks.rados.rados.0.smithi012.stdout:1245: finishing write tid 5 to smithi01278544-21 2024-09-10T18:00:52.771 INFO:tasks.rados.rados.0.smithi012.stdout:1245: oid 21 updating version 0 to 535 2024-09-10T18:00:52.772 INFO:tasks.rados.rados.0.smithi012.stdout:1245: oid 21 version 535 is already newer than 533 2024-09-10T18:00:52.772 INFO:tasks.rados.rados.0.smithi012.stdout:1245: oid 21 version 535 is already newer than 534 2024-09-10T18:00:52.772 INFO:tasks.rados.rados.0.smithi012.stdout:1245: oid 21 version 535 is already newer than 532 2024-09-10T18:00:52.772 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 535 (ObjNum 393 snap 127 seq_num 393) dirty exists 2024-09-10T18:00:52.772 INFO:tasks.rados.rados.0.smithi012.stdout:1245: left oid 21 (ObjNum 393 snap 127 seq_num 393) 2024-09-10T18:00:52.772 INFO:tasks.rados.rados.0.smithi012.stdout:1243: expect (ObjNum 387 snap 124 seq_num 387) 2024-09-10T18:00:53.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:52 smithi012 ceph-mon[89611]: pgmap v159: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 32/375 objects degraded (8.533%) 2024-09-10T18:00:53.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:52 smithi012 ceph-mon[89611]: osdmap e327: 8 total, 7 up, 8 in 2024-09-10T18:00:53.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:52 smithi012 ceph-mon[89611]: osdmap e328: 8 total, 7 up, 8 in 2024-09-10T18:00:53.020 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:52 smithi012 ceph-mon[92029]: pgmap v159: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 32/375 objects degraded (8.533%) 2024-09-10T18:00:53.020 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:52 smithi012 ceph-mon[92029]: osdmap e327: 8 total, 7 up, 8 in 2024-09-10T18:00:53.020 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:52 smithi012 ceph-mon[92029]: osdmap e328: 8 total, 7 up, 8 in 2024-09-10T18:00:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:52 smithi089 ceph-mon[84132]: pgmap v159: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 170 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s; 32/375 objects degraded (8.533%) 2024-09-10T18:00:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:52 smithi089 ceph-mon[84132]: osdmap e327: 8 total, 7 up, 8 in 2024-09-10T18:00:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:52 smithi089 ceph-mon[84132]: osdmap e328: 8 total, 7 up, 8 in 2024-09-10T18:00:53.378 INFO:tasks.rados.rados.0.smithi012.stdout:1244: expect (ObjNum 307 snap 102 seq_num 307) 2024-09-10T18:00:53.625 INFO:tasks.rados.rados.0.smithi012.stdout:1249: finishing write tid 1 to smithi01278544-22 2024-09-10T18:00:53.625 INFO:tasks.rados.rados.0.smithi012.stdout:1249: finishing write tid 2 to smithi01278544-22 2024-09-10T18:00:53.625 INFO:tasks.rados.rados.0.smithi012.stdout:1249: finishing write tid 3 to smithi01278544-22 2024-09-10T18:00:53.625 INFO:tasks.rados.rados.0.smithi012.stdout:1249: finishing write tid 4 to smithi01278544-22 2024-09-10T18:00:53.625 INFO:tasks.rados.rados.0.smithi012.stdout:1249: finishing write tid 5 to smithi01278544-22 2024-09-10T18:00:53.625 INFO:tasks.rados.rados.0.smithi012.stdout:1249: oid 22 updating version 0 to 832 2024-09-10T18:00:53.625 INFO:tasks.rados.rados.0.smithi012.stdout:1249: oid 22 version 832 is already newer than 829 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1249: oid 22 version 832 is already newer than 830 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1249: oid 22 version 832 is already newer than 831 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 832 (ObjNum 395 snap 127 seq_num 395) dirty exists 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1249: left oid 22 (ObjNum 395 snap 127 seq_num 395) 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1243: done (5 left) 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1244: done (4 left) 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1245: done (3 left) 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1246: done (2 left) 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1249: done (1 left) 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1250: done (0 left) 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1251: setattr oid 12 current snap is 127 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1252: read oid 1 snap -1 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1252: expect deleted 2024-09-10T18:00:53.626 INFO:tasks.rados.rados.0.smithi012.stdout:1253: snap_remove snap 117 2024-09-10T18:00:53.715 INFO:tasks.rados.rados.0.smithi012.stdout:1253: done (2 left) 2024-09-10T18:00:53.715 INFO:tasks.rados.rados.0.smithi012.stdout:1254: snap_remove snap 121 2024-09-10T18:00:54.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:00:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:00:53] "GET /metrics HTTP/1.1" 200 36214 "" "Prometheus/2.43.0" 2024-09-10T18:00:54.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:53 smithi012 ceph-mon[89611]: pgmap v162: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 189 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 6.4 MiB/s wr, 11 op/s; 35/375 objects degraded (9.333%) 2024-09-10T18:00:54.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:53 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 35/375 objects degraded (9.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:54.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:53 smithi012 ceph-mon[89611]: osdmap e329: 8 total, 7 up, 8 in 2024-09-10T18:00:54.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:53 smithi012 ceph-mon[92029]: pgmap v162: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 189 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 6.4 MiB/s wr, 11 op/s; 35/375 objects degraded (9.333%) 2024-09-10T18:00:54.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:53 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 35/375 objects degraded (9.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:54.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:53 smithi012 ceph-mon[92029]: osdmap e329: 8 total, 7 up, 8 in 2024-09-10T18:00:54.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:53 smithi089 ceph-mon[84132]: pgmap v162: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 189 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 6.4 MiB/s wr, 11 op/s; 35/375 objects degraded (9.333%) 2024-09-10T18:00:54.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:53 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 35/375 objects degraded (9.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:00:54.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:53 smithi089 ceph-mon[84132]: osdmap e329: 8 total, 7 up, 8 in 2024-09-10T18:00:54.712 INFO:tasks.rados.rados.0.smithi012.stdout:1254: done (2 left) 2024-09-10T18:00:54.712 INFO:tasks.rados.rados.0.smithi012.stdout:1255: snap_create 2024-09-10T18:00:54.712 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 833 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-09-10T18:00:55.475 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.475 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.475 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[89611]: osdmap e330: 8 total, 7 up, 8 in 2024-09-10T18:00:55.475 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.475 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.475 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.475 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.476 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[92029]: osdmap e330: 8 total, 7 up, 8 in 2024-09-10T18:00:55.476 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.476 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:55 smithi089 ceph-mon[84132]: osdmap e330: 8 total, 7 up, 8 in 2024-09-10T18:00:55.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:55.716 INFO:tasks.rados.rados.0.smithi012.stdout:1251: done (2 left) 2024-09-10T18:00:55.716 INFO:tasks.rados.rados.0.smithi012.stdout:1252: done (1 left) 2024-09-10T18:00:55.716 INFO:tasks.rados.rados.0.smithi012.stdout:1255: done (0 left) 2024-09-10T18:00:55.716 INFO:tasks.rados.rados.0.smithi012.stdout:1256: rollback oid 14 current snap is 128 2024-09-10T18:00:55.716 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 14 to 124 2024-09-10T18:00:55.716 INFO:tasks.rados.rados.0.smithi012.stdout:1257: snap_remove snap 123 2024-09-10T18:00:55.741 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[102098]: 2024-09-10T18:00:55.503+0000 7f607959f640 -1 osd.1 319 log_to_monitors true 2024-09-10T18:00:56.034 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:00:55 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[102098]: 2024-09-10T18:00:55.738+0000 7f6071349640 -1 osd.1 319 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T18:00:56.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[92029]: pgmap v165: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 189 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 6.4 MiB/s wr, 11 op/s; 35/375 objects degraded (9.333%) 2024-09-10T18:00:56.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[92029]: from='osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T18:00:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[92029]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T18:00:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[92029]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T18:00:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[92029]: osdmap e331: 8 total, 7 up, 8 in 2024-09-10T18:00:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[92029]: from='osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[92029]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:56.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[89611]: pgmap v165: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 189 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 6.4 MiB/s wr, 11 op/s; 35/375 objects degraded (9.333%) 2024-09-10T18:00:56.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[89611]: from='osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T18:00:56.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[89611]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T18:00:56.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[89611]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T18:00:56.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[89611]: osdmap e331: 8 total, 7 up, 8 in 2024-09-10T18:00:56.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[89611]: from='osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:56.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:56 smithi012 ceph-mon[89611]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:56.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:56 smithi089 ceph-mon[84132]: pgmap v165: 121 pgs: 33 active+undersized, 10 active+undersized+degraded, 78 active+clean; 189 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 6.4 MiB/s wr, 11 op/s; 35/375 objects degraded (9.333%) 2024-09-10T18:00:56.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:56 smithi089 ceph-mon[84132]: from='osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T18:00:56.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:56 smithi089 ceph-mon[84132]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T18:00:56.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:56 smithi089 ceph-mon[84132]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T18:00:56.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:56 smithi089 ceph-mon[84132]: osdmap e331: 8 total, 7 up, 8 in 2024-09-10T18:00:56.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:56 smithi089 ceph-mon[84132]: from='osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:56.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:56 smithi089 ceph-mon[84132]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:00:56.716 INFO:tasks.rados.rados.0.smithi012.stdout:1257: done (1 left) 2024-09-10T18:00:56.717 INFO:tasks.rados.rados.0.smithi012.stdout:1258: snap_remove snap 126 2024-09-10T18:00:57.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:57 smithi012 ceph-mon[89611]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:00:57.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:57 smithi012 ceph-mon[89611]: osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299] boot 2024-09-10T18:00:57.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:57 smithi012 ceph-mon[89611]: osdmap e332: 8 total, 8 up, 8 in 2024-09-10T18:00:57.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:57 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T18:00:57.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:57 smithi012 ceph-mon[92029]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:00:57.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:57 smithi012 ceph-mon[92029]: osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299] boot 2024-09-10T18:00:57.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:57 smithi012 ceph-mon[92029]: osdmap e332: 8 total, 8 up, 8 in 2024-09-10T18:00:57.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:57 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T18:00:57.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:57 smithi089 ceph-mon[84132]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:00:57.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:57 smithi089 ceph-mon[84132]: osd.1 [v2:172.21.15.12:6810/1400604299,v1:172.21.15.12:6811/1400604299] boot 2024-09-10T18:00:57.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:57 smithi089 ceph-mon[84132]: osdmap e332: 8 total, 8 up, 8 in 2024-09-10T18:00:57.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:57 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T18:00:57.731 INFO:tasks.rados.rados.0.smithi012.stdout:1258: done (1 left) 2024-09-10T18:00:57.731 INFO:tasks.rados.rados.0.smithi012.stdout:1259: rollback oid 38 current snap is 128 2024-09-10T18:00:57.731 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 38 to 127 2024-09-10T18:00:57.731 INFO:tasks.rados.rados.0.smithi012.stdout:1260: read oid 4 snap -1 2024-09-10T18:00:57.731 INFO:tasks.rados.rados.0.smithi012.stdout:1260: expect (ObjNum 329 snap 105 seq_num 329) 2024-09-10T18:00:57.731 INFO:tasks.rados.rados.0.smithi012.stdout:1261: snap_create 2024-09-10T18:00:57.731 INFO:tasks.rados.rados.0.smithi012.stdout:1256: finishing rollback tid 0 to smithi01278544-14 2024-09-10T18:00:57.731 INFO:tasks.rados.rados.0.smithi012.stdout:1256: finishing rollback tid 1 to smithi01278544-14 2024-09-10T18:00:57.732 INFO:tasks.rados.rados.0.smithi012.stdout:1256: finishing rollback tid 2 to smithi01278544-14 2024-09-10T18:00:57.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 892 (ObjNum 363 snap 117 seq_num 363) dirty exists 2024-09-10T18:00:57.738 INFO:tasks.rados.rados.0.smithi012.stdout:1259: finishing rollback tid 1 to smithi01278544-38 2024-09-10T18:00:57.738 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 553 (ObjNum 897 snap 0 seq_num 3496795104) dirty dne 2024-09-10T18:00:57.773 INFO:tasks.rados.rados.0.smithi012.stdout:1260: expect (ObjNum 329 snap 105 seq_num 329) 2024-09-10T18:00:58.723 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:00:58.461+0000 7f7a9b686640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-10T18:00:58.821 INFO:tasks.rados.rados.0.smithi012.stdout:1256: done (3 left) 2024-09-10T18:00:58.821 INFO:tasks.rados.rados.0.smithi012.stdout:1259: done (2 left) 2024-09-10T18:00:58.821 INFO:tasks.rados.rados.0.smithi012.stdout:1260: done (1 left) 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1261: done (0 left) 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 129 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1262: seq_num 397 ranges {0=655360,655360=671744,1327104=532480} 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1262: writing smithi01278544-44 from 0 to 655360 tid 1 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1262: writing smithi01278544-44 from 655360 to 1327104 tid 2 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1262: writing smithi01278544-44 from 1327104 to 1859584 tid 3 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1263: read oid 10 snap -1 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1263: expect (ObjNum 371 snap 119 seq_num 371) 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1264: read oid 1 snap -1 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1264: expect deleted 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 129 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1262: finishing write tid 1 to smithi01278544-44 2024-09-10T18:00:58.822 INFO:tasks.rados.rados.0.smithi012.stdout:1265: seq_num 398 ranges {0=671744,671744=557056,1228800=532480,1761280=114688} 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1265: writing smithi01278544-19 from 0 to 671744 tid 1 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1265: writing smithi01278544-19 from 671744 to 1228800 tid 2 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1265: writing smithi01278544-19 from 1228800 to 1761280 tid 3 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1265: writing smithi01278544-19 from 1761280 to 1875968 tid 4 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1266: copy_from oid 17 from oid 18 current snap is 129 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1262: finishing write tid 2 to smithi01278544-44 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1262: finishing write tid 3 to smithi01278544-44 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1264: done (4 left) 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1267: snap_create 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1262: finishing write tid 4 to smithi01278544-44 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1262: finishing write tid 5 to smithi01278544-44 2024-09-10T18:00:58.823 INFO:tasks.rados.rados.0.smithi012.stdout:1262: oid 44 updating version 0 to 643 2024-09-10T18:00:58.824 INFO:tasks.rados.rados.0.smithi012.stdout:1262: oid 44 version 643 is already newer than 642 2024-09-10T18:00:58.824 INFO:tasks.rados.rados.0.smithi012.stdout:1262: oid 44 updating version 643 to 645 2024-09-10T18:00:58.824 INFO:tasks.rados.rados.0.smithi012.stdout:1262: oid 44 version 645 is already newer than 644 2024-09-10T18:00:58.824 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 645 (ObjNum 397 snap 129 seq_num 397) dirty exists 2024-09-10T18:00:58.824 INFO:tasks.rados.rados.0.smithi012.stdout:1262: left oid 44 (ObjNum 397 snap 129 seq_num 397) 2024-09-10T18:00:58.824 INFO:tasks.rados.rados.0.smithi012.stdout:1265: finishing write tid 1 to smithi01278544-19 2024-09-10T18:00:58.824 INFO:tasks.rados.rados.0.smithi012.stdout:1265: finishing write tid 2 to smithi01278544-19 2024-09-10T18:00:58.824 INFO:tasks.rados.rados.0.smithi012.stdout:1263: expect (ObjNum 371 snap 119 seq_num 371) 2024-09-10T18:00:58.828 INFO:tasks.rados.rados.0.smithi012.stdout:1265: finishing write tid 3 to smithi01278544-19 2024-09-10T18:00:58.828 INFO:tasks.rados.rados.0.smithi012.stdout:1265: finishing write tid 4 to smithi01278544-19 2024-09-10T18:00:58.828 INFO:tasks.rados.rados.0.smithi012.stdout:1265: finishing write tid 5 to smithi01278544-19 2024-09-10T18:00:58.828 INFO:tasks.rados.rados.0.smithi012.stdout:1265: finishing write tid 6 to smithi01278544-19 2024-09-10T18:00:58.828 INFO:tasks.rados.rados.0.smithi012.stdout:1265: oid 19 updating version 0 to 557 2024-09-10T18:00:58.828 INFO:tasks.rados.rados.0.smithi012.stdout:1265: oid 19 version 557 is already newer than 556 2024-09-10T18:00:58.828 INFO:tasks.rados.rados.0.smithi012.stdout:1265: oid 19 updating version 557 to 558 2024-09-10T18:00:58.828 INFO:tasks.rados.rados.0.smithi012.stdout:1265: oid 19 updating version 558 to 560 2024-09-10T18:00:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:1265: oid 19 version 560 is already newer than 559 2024-09-10T18:00:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 560 (ObjNum 398 snap 129 seq_num 398) dirty exists 2024-09-10T18:00:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:1265: left oid 19 (ObjNum 398 snap 129 seq_num 398) 2024-09-10T18:00:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:1266: finishing copy_from racing read to smithi01278544-17 2024-09-10T18:00:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:1266: finishing copy_from to smithi01278544-17 2024-09-10T18:00:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 515 (ObjNum 389 snap 124 seq_num 389) dirty exists 2024-09-10T18:00:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: pgmap v168: 121 pgs: 21 peering, 17 active+undersized, 5 active+undersized+degraded, 78 active+clean; 191 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 884 KiB/s wr, 11 op/s; 15/369 objects degraded (4.065%) 2024-09-10T18:00:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: osdmap e333: 8 total, 8 up, 8 in 2024-09-10T18:00:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:00:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-10T18:00:59.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: pgmap v168: 121 pgs: 21 peering, 17 active+undersized, 5 active+undersized+degraded, 78 active+clean; 191 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 884 KiB/s wr, 11 op/s; 15/369 objects degraded (4.065%) 2024-09-10T18:00:59.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: osdmap e333: 8 total, 8 up, 8 in 2024-09-10T18:00:59.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: pgmap v168: 121 pgs: 21 peering, 17 active+undersized, 5 active+undersized+degraded, 78 active+clean; 191 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 884 KiB/s wr, 11 op/s; 15/369 objects degraded (4.065%) 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: osdmap e333: 8 total, 8 up, 8 in 2024-09-10T18:00:59.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:00:59.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-10T18:00:59.737 INFO:tasks.rados.rados.0.smithi012.stdout:1262: done (4 left) 2024-09-10T18:00:59.737 INFO:tasks.rados.rados.0.smithi012.stdout:1263: done (3 left) 2024-09-10T18:00:59.737 INFO:tasks.rados.rados.0.smithi012.stdout:1265: done (2 left) 2024-09-10T18:00:59.737 INFO:tasks.rados.rados.0.smithi012.stdout:1266: done (1 left) 2024-09-10T18:00:59.737 INFO:tasks.rados.rados.0.smithi012.stdout:1267: done (0 left) 2024-09-10T18:00:59.737 INFO:tasks.rados.rados.0.smithi012.stdout:1268: snap_create 2024-09-10T18:01:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:59 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T18:01:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:59 smithi012 ceph-mon[89611]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-10T18:01:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:00:59 smithi012 ceph-mon[89611]: osdmap e334: 8 total, 8 up, 8 in 2024-09-10T18:01:00.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:59 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T18:01:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:59 smithi012 ceph-mon[92029]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-10T18:01:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:00:59 smithi012 ceph-mon[92029]: osdmap e334: 8 total, 8 up, 8 in 2024-09-10T18:01:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:59 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T18:01:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:59 smithi089 ceph-mon[84132]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-10T18:01:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:00:59 smithi089 ceph-mon[84132]: osdmap e334: 8 total, 8 up, 8 in 2024-09-10T18:01:00.738 INFO:tasks.rados.rados.0.smithi012.stdout:1268: done (0 left) 2024-09-10T18:01:00.738 INFO:tasks.rados.rados.0.smithi012.stdout:1269: snap_remove snap 128 2024-09-10T18:01:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:00 smithi012 ceph-mon[89611]: pgmap v171: 121 pgs: 21 peering, 11 active+undersized, 5 active+undersized+degraded, 84 active+clean; 191 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 884 KiB/s wr, 11 op/s; 15/369 objects degraded (4.065%) 2024-09-10T18:01:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:00 smithi012 ceph-mon[89611]: osdmap e335: 8 total, 8 up, 8 in 2024-09-10T18:01:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:00 smithi012 ceph-mon[92029]: pgmap v171: 121 pgs: 21 peering, 11 active+undersized, 5 active+undersized+degraded, 84 active+clean; 191 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 884 KiB/s wr, 11 op/s; 15/369 objects degraded (4.065%) 2024-09-10T18:01:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:00 smithi012 ceph-mon[92029]: osdmap e335: 8 total, 8 up, 8 in 2024-09-10T18:01:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:00 smithi089 ceph-mon[84132]: pgmap v171: 121 pgs: 21 peering, 11 active+undersized, 5 active+undersized+degraded, 84 active+clean; 191 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 884 KiB/s wr, 11 op/s; 15/369 objects degraded (4.065%) 2024-09-10T18:01:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:00 smithi089 ceph-mon[84132]: osdmap e335: 8 total, 8 up, 8 in 2024-09-10T18:01:01.741 INFO:tasks.rados.rados.0.smithi012.stdout:1269: done (0 left) 2024-09-10T18:01:01.741 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 131 2024-09-10T18:01:01.741 INFO:tasks.rados.rados.0.smithi012.stdout:1270: seq_num 399 ranges {6594560=688128,7282688=434176,7716864=745472,8462336=24576} 2024-09-10T18:01:01.781 INFO:tasks.rados.rados.0.smithi012.stdout:1270: writing smithi01278544-33 from 6594560 to 7282688 tid 1 2024-09-10T18:01:01.784 INFO:tasks.rados.rados.0.smithi012.stdout:1270: writing smithi01278544-33 from 7282688 to 7716864 tid 2 2024-09-10T18:01:01.789 INFO:tasks.rados.rados.0.smithi012.stdout:1270: writing smithi01278544-33 from 7716864 to 8462336 tid 3 2024-09-10T18:01:01.789 INFO:tasks.rados.rados.0.smithi012.stdout:1270: writing smithi01278544-33 from 8462336 to 8486912 tid 4 2024-09-10T18:01:01.789 INFO:tasks.rados.rados.0.smithi012.stdout:1271: copy_from oid 22 from oid 50 current snap is 131 2024-09-10T18:01:01.790 INFO:tasks.rados.rados.0.smithi012.stdout:1270: finishing write tid 1 to smithi01278544-33 2024-09-10T18:01:01.790 INFO:tasks.rados.rados.0.smithi012.stdout:1270: finishing write tid 2 to smithi01278544-33 2024-09-10T18:01:01.790 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 131 2024-09-10T18:01:01.790 INFO:tasks.rados.rados.0.smithi012.stdout:1272: seq_num 400 ranges {0=704512,704512=720896,1425408=483328} 2024-09-10T18:01:01.793 INFO:tasks.rados.rados.0.smithi012.stdout:1272: writing smithi01278544-38 from 0 to 704512 tid 1 2024-09-10T18:01:01.798 INFO:tasks.rados.rados.0.smithi012.stdout:1272: writing smithi01278544-38 from 704512 to 1425408 tid 2 2024-09-10T18:01:01.801 INFO:tasks.rados.rados.0.smithi012.stdout:1272: writing smithi01278544-38 from 1425408 to 1908736 tid 3 2024-09-10T18:01:01.801 INFO:tasks.rados.rados.0.smithi012.stdout:1273: read oid 17 snap -1 2024-09-10T18:01:01.801 INFO:tasks.rados.rados.0.smithi012.stdout:1273: expect (ObjNum 389 snap 124 seq_num 389) 2024-09-10T18:01:01.801 INFO:tasks.rados.rados.0.smithi012.stdout:1274: read oid 43 snap -1 2024-09-10T18:01:01.802 INFO:tasks.rados.rados.0.smithi012.stdout:1274: expect (ObjNum 392 snap 126 seq_num 392) 2024-09-10T18:01:01.802 INFO:tasks.rados.rados.0.smithi012.stdout:1275: read oid 10 snap -1 2024-09-10T18:01:01.802 INFO:tasks.rados.rados.0.smithi012.stdout:1275: expect (ObjNum 371 snap 119 seq_num 371) 2024-09-10T18:01:01.802 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 131 2024-09-10T18:01:01.802 INFO:tasks.rados.rados.0.smithi012.stdout:1270: finishing write tid 3 to smithi01278544-33 2024-09-10T18:01:01.802 INFO:tasks.rados.rados.0.smithi012.stdout:1276: seq_num 401 ranges {1155072=720896,1875968=606208,2482176=598016} 2024-09-10T18:01:01.812 INFO:tasks.rados.rados.0.smithi012.stdout:1276: writing smithi01278544-15 from 1155072 to 1875968 tid 1 2024-09-10T18:01:01.816 INFO:tasks.rados.rados.0.smithi012.stdout:1276: writing smithi01278544-15 from 1875968 to 2482176 tid 2 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1276: writing smithi01278544-15 from 2482176 to 3080192 tid 3 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1277: rollback oid 39 current snap is 131 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 127 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1271: finishing copy_from to smithi01278544-22 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1271: got expected ENOENT (src dne) 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1271: finishing copy_from racing read to smithi01278544-22 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1270: finishing write tid 4 to smithi01278544-33 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1270: finishing write tid 5 to smithi01278544-33 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1271: done (7 left) 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1278: read oid 27 snap -1 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:1278: expect deleted 2024-09-10T18:01:01.820 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 131 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1270: finishing write tid 6 to smithi01278544-33 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1270: oid 33 updating version 0 to 905 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1270: oid 33 updating version 905 to 906 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1270: oid 33 updating version 906 to 908 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1270: oid 33 version 908 is already newer than 904 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1270: oid 33 version 908 is already newer than 907 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 908 (ObjNum 399 snap 131 seq_num 399) dirty exists 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1270: left oid 33 (ObjNum 399 snap 131 seq_num 399) 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1272: finishing write tid 1 to smithi01278544-38 2024-09-10T18:01:01.821 INFO:tasks.rados.rados.0.smithi012.stdout:1279: seq_num 402 ranges {2547712=737280,3284992=491520,3776512=516096,4292608=196608} 2024-09-10T18:01:01.837 INFO:tasks.rados.rados.0.smithi012.stdout:1279: writing smithi01278544-20 from 2547712 to 3284992 tid 1 2024-09-10T18:01:01.840 INFO:tasks.rados.rados.0.smithi012.stdout:1279: writing smithi01278544-20 from 3284992 to 3776512 tid 2 2024-09-10T18:01:01.843 INFO:tasks.rados.rados.0.smithi012.stdout:1279: writing smithi01278544-20 from 3776512 to 4292608 tid 3 2024-09-10T18:01:01.844 INFO:tasks.rados.rados.0.smithi012.stdout:1279: writing smithi01278544-20 from 4292608 to 4489216 tid 4 2024-09-10T18:01:01.844 INFO:tasks.rados.rados.0.smithi012.stdout:1270: done (8 left) 2024-09-10T18:01:01.844 INFO:tasks.rados.rados.0.smithi012.stdout:1280: snap_remove snap 129 2024-09-10T18:01:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:01 smithi012 ceph-mon[89611]: osdmap e336: 8 total, 8 up, 8 in 2024-09-10T18:01:02.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:02.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:02.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:01 smithi012 ceph-mon[89611]: osdmap e337: 8 total, 8 up, 8 in 2024-09-10T18:01:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:01 smithi012 ceph-mon[92029]: osdmap e336: 8 total, 8 up, 8 in 2024-09-10T18:01:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:01 smithi012 ceph-mon[92029]: osdmap e337: 8 total, 8 up, 8 in 2024-09-10T18:01:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:01 smithi089 ceph-mon[84132]: osdmap e336: 8 total, 8 up, 8 in 2024-09-10T18:01:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:01 smithi089 ceph-mon[84132]: osdmap e337: 8 total, 8 up, 8 in 2024-09-10T18:01:02.760 INFO:tasks.rados.rados.0.smithi012.stdout:1280: done (8 left) 2024-09-10T18:01:02.760 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 131 2024-09-10T18:01:02.760 INFO:tasks.rados.rados.0.smithi012.stdout:1272: finishing write tid 2 to smithi01278544-38 2024-09-10T18:01:02.760 INFO:tasks.rados.rados.0.smithi012.stdout:1281: seq_num 403 ranges {0=753664,753664=425984,1179648=720896,1900544=57344} 2024-09-10T18:01:02.763 INFO:tasks.rados.rados.0.smithi012.stdout:1281: writing smithi01278544-5 from 0 to 753664 tid 1 2024-09-10T18:01:02.766 INFO:tasks.rados.rados.0.smithi012.stdout:1281: writing smithi01278544-5 from 753664 to 1179648 tid 2 2024-09-10T18:01:02.770 INFO:tasks.rados.rados.0.smithi012.stdout:1281: writing smithi01278544-5 from 1179648 to 1900544 tid 3 2024-09-10T18:01:02.771 INFO:tasks.rados.rados.0.smithi012.stdout:1281: writing smithi01278544-5 from 1900544 to 1957888 tid 4 2024-09-10T18:01:02.771 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 131 2024-09-10T18:01:02.771 INFO:tasks.rados.rados.0.smithi012.stdout:1272: finishing write tid 3 to smithi01278544-38 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:1272: finishing write tid 4 to smithi01278544-38 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:1272: finishing write tid 5 to smithi01278544-38 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:1272: oid 38 updating version 0 to 556 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:1272: oid 38 version 556 is already newer than 554 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:1272: oid 38 version 556 is already newer than 555 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:1272: oid 38 updating version 556 to 557 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 557 (ObjNum 400 snap 131 seq_num 400) dirty exists 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:1272: left oid 38 (ObjNum 400 snap 131 seq_num 400) 2024-09-10T18:01:02.772 INFO:tasks.rados.rados.0.smithi012.stdout:1275: expect (ObjNum 371 snap 119 seq_num 371) 2024-09-10T18:01:02.848 INFO:tasks.rados.rados.0.smithi012.stdout:1274: expect (ObjNum 392 snap 126 seq_num 392) 2024-09-10T18:01:02.983 INFO:tasks.rados.rados.0.smithi012.stdout:1273: expect (ObjNum 389 snap 124 seq_num 389) 2024-09-10T18:01:03.028 INFO:tasks.rados.rados.0.smithi012.stdout:1276: finishing write tid 1 to smithi01278544-15 2024-09-10T18:01:03.028 INFO:tasks.rados.rados.0.smithi012.stdout:1276: finishing write tid 2 to smithi01278544-15 2024-09-10T18:01:03.028 INFO:tasks.rados.rados.0.smithi012.stdout:1277: finishing rollback tid 0 to smithi01278544-39 2024-09-10T18:01:03.028 INFO:tasks.rados.rados.0.smithi012.stdout:1276: finishing write tid 3 to smithi01278544-15 2024-09-10T18:01:03.029 INFO:tasks.rados.rados.0.smithi012.stdout:1282: seq_num 404 ranges {0=770048,770048=712704,1482752=491520} 2024-09-10T18:01:03.032 INFO:tasks.rados.rados.0.smithi012.stdout:1282: writing smithi01278544-42 from 0 to 770048 tid 1 2024-09-10T18:01:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:02 smithi012 ceph-mon[89611]: pgmap v174: 121 pgs: 21 peering, 100 active+clean; 186 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 0 op/s 2024-09-10T18:01:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:02 smithi012 ceph-mon[89611]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/369 objects degraded (4.065%), 5 pgs degraded) 2024-09-10T18:01:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:02 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:01:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:02 smithi012 ceph-mon[92029]: pgmap v174: 121 pgs: 21 peering, 100 active+clean; 186 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 0 op/s 2024-09-10T18:01:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:02 smithi012 ceph-mon[92029]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/369 objects degraded (4.065%), 5 pgs degraded) 2024-09-10T18:01:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:02 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:01:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:02 smithi089 ceph-mon[84132]: pgmap v174: 121 pgs: 21 peering, 100 active+clean; 186 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 0 op/s 2024-09-10T18:01:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:02 smithi089 ceph-mon[84132]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/369 objects degraded (4.065%), 5 pgs degraded) 2024-09-10T18:01:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:02 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:01:03.036 INFO:tasks.rados.rados.0.smithi012.stdout:1282: writing smithi01278544-42 from 770048 to 1482752 tid 2 2024-09-10T18:01:03.040 INFO:tasks.rados.rados.0.smithi012.stdout:1282: writing smithi01278544-42 from 1482752 to 1974272 tid 3 2024-09-10T18:01:03.040 INFO:tasks.rados.rados.0.smithi012.stdout:1272: done (9 left) 2024-09-10T18:01:03.040 INFO:tasks.rados.rados.0.smithi012.stdout:1273: done (8 left) 2024-09-10T18:01:03.040 INFO:tasks.rados.rados.0.smithi012.stdout:1274: done (7 left) 2024-09-10T18:01:03.040 INFO:tasks.rados.rados.0.smithi012.stdout:1275: done (6 left) 2024-09-10T18:01:03.040 INFO:tasks.rados.rados.0.smithi012.stdout:1278: done (5 left) 2024-09-10T18:01:03.040 INFO:tasks.rados.rados.0.smithi012.stdout:1283: copy_from oid 1 from oid 32 current snap is 131 2024-09-10T18:01:03.040 INFO:tasks.rados.rados.0.smithi012.stdout:1277: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1276: finishing write tid 4 to smithi01278544-15 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1277: finishing rollback tid 2 to smithi01278544-39 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 861 (ObjNum 366 snap 117 seq_num 366) dirty exists 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1276: finishing write tid 5 to smithi01278544-15 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1276: oid 15 updating version 0 to 723 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1276: oid 15 version 723 is already newer than 722 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1276: oid 15 version 723 is already newer than 721 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1276: oid 15 updating version 723 to 724 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 724 (ObjNum 401 snap 131 seq_num 401) dirty exists 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1276: left oid 15 (ObjNum 401 snap 131 seq_num 401) 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1279: finishing write tid 1 to smithi01278544-20 2024-09-10T18:01:03.041 INFO:tasks.rados.rados.0.smithi012.stdout:1279: finishing write tid 2 to smithi01278544-20 2024-09-10T18:01:03.042 INFO:tasks.rados.rados.0.smithi012.stdout:1279: finishing write tid 3 to smithi01278544-20 2024-09-10T18:01:03.042 INFO:tasks.rados.rados.0.smithi012.stdout:1276: done (5 left) 2024-09-10T18:01:03.042 INFO:tasks.rados.rados.0.smithi012.stdout:1277: done (4 left) 2024-09-10T18:01:03.042 INFO:tasks.rados.rados.0.smithi012.stdout:1284: read oid 18 snap 124 2024-09-10T18:01:03.042 INFO:tasks.rados.rados.0.smithi012.stdout:1284: expect (ObjNum 389 snap 124 seq_num 389) 2024-09-10T18:01:03.042 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 131 2024-09-10T18:01:03.042 INFO:tasks.rados.rados.0.smithi012.stdout:1279: finishing write tid 4 to smithi01278544-20 2024-09-10T18:01:03.042 INFO:tasks.rados.rados.0.smithi012.stdout:1285: seq_num 405 ranges {819200=786432,1605632=589824,2195456=614400} 2024-09-10T18:01:03.049 INFO:tasks.rados.rados.0.smithi012.stdout:1285: writing smithi01278544-28 from 819200 to 1605632 tid 1 2024-09-10T18:01:03.052 INFO:tasks.rados.rados.0.smithi012.stdout:1285: writing smithi01278544-28 from 1605632 to 2195456 tid 2 2024-09-10T18:01:03.057 INFO:tasks.rados.rados.0.smithi012.stdout:1285: writing smithi01278544-28 from 2195456 to 2809856 tid 3 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1286: setattr oid 11 current snap is 131 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1279: finishing write tid 5 to smithi01278544-20 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1279: finishing write tid 6 to smithi01278544-20 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1279: oid 20 updating version 0 to 865 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1279: oid 20 version 865 is already newer than 864 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1279: oid 20 version 865 is already newer than 863 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1279: oid 20 updating version 865 to 867 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1279: oid 20 version 867 is already newer than 866 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 867 (ObjNum 402 snap 131 seq_num 402) dirty exists 2024-09-10T18:01:03.058 INFO:tasks.rados.rados.0.smithi012.stdout:1279: left oid 20 (ObjNum 402 snap 131 seq_num 402) 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: finishing write tid 1 to smithi01278544-5 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: finishing write tid 2 to smithi01278544-5 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: finishing write tid 3 to smithi01278544-5 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: finishing write tid 4 to smithi01278544-5 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: finishing write tid 5 to smithi01278544-5 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: finishing write tid 6 to smithi01278544-5 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: oid 5 updating version 0 to 520 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: oid 5 version 520 is already newer than 518 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: oid 5 version 520 is already newer than 517 2024-09-10T18:01:03.059 INFO:tasks.rados.rados.0.smithi012.stdout:1281: oid 5 version 520 is already newer than 519 2024-09-10T18:01:03.060 INFO:tasks.rados.rados.0.smithi012.stdout:1281: oid 5 version 520 is already newer than 516 2024-09-10T18:01:03.060 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 520 (ObjNum 403 snap 131 seq_num 403) dirty exists 2024-09-10T18:01:03.060 INFO:tasks.rados.rados.0.smithi012.stdout:1281: left oid 5 (ObjNum 403 snap 131 seq_num 403) 2024-09-10T18:01:03.060 INFO:tasks.rados.rados.0.smithi012.stdout:1282: finishing write tid 1 to smithi01278544-42 2024-09-10T18:01:03.060 INFO:tasks.rados.rados.0.smithi012.stdout:1282: finishing write tid 2 to smithi01278544-42 2024-09-10T18:01:03.060 INFO:tasks.rados.rados.0.smithi012.stdout:1282: finishing write tid 3 to smithi01278544-42 2024-09-10T18:01:03.060 INFO:tasks.rados.rados.0.smithi012.stdout:1282: finishing write tid 4 to smithi01278544-42 2024-09-10T18:01:03.061 INFO:tasks.rados.rados.0.smithi012.stdout:1282: finishing write tid 5 to smithi01278544-42 2024-09-10T18:01:03.061 INFO:tasks.rados.rados.0.smithi012.stdout:1282: oid 42 updating version 0 to 912 2024-09-10T18:01:03.061 INFO:tasks.rados.rados.0.smithi012.stdout:1282: oid 42 updating version 912 to 913 2024-09-10T18:01:03.061 INFO:tasks.rados.rados.0.smithi012.stdout:1282: oid 42 updating version 913 to 914 2024-09-10T18:01:03.061 INFO:tasks.rados.rados.0.smithi012.stdout:1282: oid 42 version 914 is already newer than 911 2024-09-10T18:01:03.061 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 914 (ObjNum 404 snap 131 seq_num 404) dirty exists 2024-09-10T18:01:03.061 INFO:tasks.rados.rados.0.smithi012.stdout:1282: left oid 42 (ObjNum 404 snap 131 seq_num 404) 2024-09-10T18:01:03.061 INFO:tasks.rados.rados.0.smithi012.stdout:1284: expect (ObjNum 389 snap 124 seq_num 389) 2024-09-10T18:01:03.104 INFO:tasks.rados.rados.0.smithi012.stdout:1285: finishing write tid 1 to smithi01278544-28 2024-09-10T18:01:03.104 INFO:tasks.rados.rados.0.smithi012.stdout:1283: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:01:03.104 INFO:tasks.rados.rados.0.smithi012.stdout:1285: finishing write tid 2 to smithi01278544-28 2024-09-10T18:01:03.104 INFO:tasks.rados.rados.0.smithi012.stdout:1283: finishing copy_from to smithi01278544-1 2024-09-10T18:01:03.104 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 380 (ObjNum 267 snap 86 seq_num 267) dirty exists 2024-09-10T18:01:03.104 INFO:tasks.rados.rados.0.smithi012.stdout:1285: finishing write tid 3 to smithi01278544-28 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1285: finishing write tid 4 to smithi01278544-28 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1285: finishing write tid 5 to smithi01278544-28 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1285: oid 28 updating version 0 to 308 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1285: oid 28 version 308 is already newer than 305 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1285: oid 28 version 308 is already newer than 307 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1285: oid 28 version 308 is already newer than 306 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 308 (ObjNum 405 snap 131 seq_num 405) dirty exists 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1285: left oid 28 (ObjNum 405 snap 131 seq_num 405) 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1279: done (6 left) 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1281: done (5 left) 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1282: done (4 left) 2024-09-10T18:01:03.105 INFO:tasks.rados.rados.0.smithi012.stdout:1283: done (3 left) 2024-09-10T18:01:03.106 INFO:tasks.rados.rados.0.smithi012.stdout:1284: done (2 left) 2024-09-10T18:01:03.106 INFO:tasks.rados.rados.0.smithi012.stdout:1285: done (1 left) 2024-09-10T18:01:03.106 INFO:tasks.rados.rados.0.smithi012.stdout:1287: snap_create 2024-09-10T18:01:03.106 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 873 (ObjNum 373 snap 120 seq_num 373) dirty exists 2024-09-10T18:01:03.766 INFO:tasks.rados.rados.0.smithi012.stdout:1286: done (1 left) 2024-09-10T18:01:03.767 INFO:tasks.rados.rados.0.smithi012.stdout:1287: done (0 left) 2024-09-10T18:01:03.767 INFO:tasks.rados.rados.0.smithi012.stdout:1288: rmattr oid 41 current snap is 132 2024-09-10T18:01:03.767 INFO:tasks.rados.rados.0.smithi012.stdout:1288: done (0 left) 2024-09-10T18:01:03.767 INFO:tasks.rados.rados.0.smithi012.stdout:1289: snap_remove snap 124 2024-09-10T18:01:04.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:03 smithi012 ceph-mon[89611]: osdmap e338: 8 total, 8 up, 8 in 2024-09-10T18:01:04.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:03 smithi012 ceph-mon[89611]: pgmap v177: 121 pgs: 121 active+clean; 193 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 13 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-09-10T18:01:04.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:01:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:01:03] "GET /metrics HTTP/1.1" 200 36278 "" "Prometheus/2.43.0" 2024-09-10T18:01:04.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:03 smithi012 ceph-mon[92029]: osdmap e338: 8 total, 8 up, 8 in 2024-09-10T18:01:04.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:03 smithi012 ceph-mon[92029]: pgmap v177: 121 pgs: 121 active+clean; 193 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 13 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-09-10T18:01:04.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:03 smithi089 ceph-mon[84132]: osdmap e338: 8 total, 8 up, 8 in 2024-09-10T18:01:04.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:03 smithi089 ceph-mon[84132]: pgmap v177: 121 pgs: 121 active+clean; 193 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 13 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-09-10T18:01:04.768 INFO:tasks.rados.rados.0.smithi012.stdout:1289: done (0 left) 2024-09-10T18:01:04.769 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 132 2024-09-10T18:01:04.769 INFO:tasks.rados.rados.0.smithi012.stdout:1290: seq_num 406 ranges {2465792=802816,3268608=475136,3743744=499712,4243456=229376} 2024-09-10T18:01:04.787 INFO:tasks.rados.rados.0.smithi012.stdout:1290: writing smithi01278544-45 from 2465792 to 3268608 tid 1 2024-09-10T18:01:04.790 INFO:tasks.rados.rados.0.smithi012.stdout:1290: writing smithi01278544-45 from 3268608 to 3743744 tid 2 2024-09-10T18:01:04.793 INFO:tasks.rados.rados.0.smithi012.stdout:1290: writing smithi01278544-45 from 3743744 to 4243456 tid 3 2024-09-10T18:01:04.795 INFO:tasks.rados.rados.0.smithi012.stdout:1290: writing smithi01278544-45 from 4243456 to 4472832 tid 4 2024-09-10T18:01:04.795 INFO:tasks.rados.rados.0.smithi012.stdout:1291: delete oid 26 current snap is 132 2024-09-10T18:01:04.795 INFO:tasks.rados.rados.0.smithi012.stdout:1290: finishing write tid 1 to smithi01278544-45 2024-09-10T18:01:04.795 INFO:tasks.rados.rados.0.smithi012.stdout:1290: finishing write tid 2 to smithi01278544-45 2024-09-10T18:01:04.797 INFO:tasks.rados.rados.0.smithi012.stdout:1291: done (1 left) 2024-09-10T18:01:04.797 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 132 2024-09-10T18:01:04.797 INFO:tasks.rados.rados.0.smithi012.stdout:1292: seq_num 408 ranges {1728512=442368,2170880=647168,2818048=507904,3325952=450560} 2024-09-10T18:01:04.809 INFO:tasks.rados.rados.0.smithi012.stdout:1292: writing smithi01278544-18 from 1728512 to 2170880 tid 1 2024-09-10T18:01:04.813 INFO:tasks.rados.rados.0.smithi012.stdout:1292: writing smithi01278544-18 from 2170880 to 2818048 tid 2 2024-09-10T18:01:04.815 INFO:tasks.rados.rados.0.smithi012.stdout:1292: writing smithi01278544-18 from 2818048 to 3325952 tid 3 2024-09-10T18:01:04.818 INFO:tasks.rados.rados.0.smithi012.stdout:1292: writing smithi01278544-18 from 3325952 to 3776512 tid 4 2024-09-10T18:01:04.818 INFO:tasks.rados.rados.0.smithi012.stdout:1293: delete oid 1 current snap is 132 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: finishing write tid 3 to smithi01278544-45 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: finishing write tid 4 to smithi01278544-45 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: finishing write tid 5 to smithi01278544-45 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: finishing write tid 6 to smithi01278544-45 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: oid 45 updating version 0 to 926 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: oid 45 version 926 is already newer than 925 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: oid 45 version 926 is already newer than 922 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: oid 45 version 926 is already newer than 923 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: oid 45 version 926 is already newer than 924 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 926 (ObjNum 406 snap 132 seq_num 406) dirty exists 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1290: left oid 45 (ObjNum 406 snap 132 seq_num 406) 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1292: finishing write tid 1 to smithi01278544-18 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1292: finishing write tid 2 to smithi01278544-18 2024-09-10T18:01:04.819 INFO:tasks.rados.rados.0.smithi012.stdout:1292: finishing write tid 3 to smithi01278544-18 2024-09-10T18:01:04.820 INFO:tasks.rados.rados.0.smithi012.stdout:1290: done (2 left) 2024-09-10T18:01:04.820 INFO:tasks.rados.rados.0.smithi012.stdout:1293: done (1 left) 2024-09-10T18:01:04.821 INFO:tasks.rados.rados.0.smithi012.stdout:1294: copy_from oid 4 from oid 1 current snap is 132 2024-09-10T18:01:04.821 INFO:tasks.rados.rados.0.smithi012.stdout:1295: snap_create 2024-09-10T18:01:04.821 INFO:tasks.rados.rados.0.smithi012.stdout:1292: finishing write tid 4 to smithi01278544-18 2024-09-10T18:01:04.821 INFO:tasks.rados.rados.0.smithi012.stdout:1292: finishing write tid 5 to smithi01278544-18 2024-09-10T18:01:04.822 INFO:tasks.rados.rados.0.smithi012.stdout:1294: finishing copy_from to smithi01278544-4 2024-09-10T18:01:04.822 INFO:tasks.rados.rados.0.smithi012.stdout:1294: got expected ENOENT (src dne) 2024-09-10T18:01:04.822 INFO:tasks.rados.rados.0.smithi012.stdout:1292: finishing write tid 6 to smithi01278544-18 2024-09-10T18:01:04.822 INFO:tasks.rados.rados.0.smithi012.stdout:1292: oid 18 updating version 0 to 726 2024-09-10T18:01:04.822 INFO:tasks.rados.rados.0.smithi012.stdout:1292: oid 18 version 726 is already newer than 725 2024-09-10T18:01:04.822 INFO:tasks.rados.rados.0.smithi012.stdout:1292: oid 18 updating version 726 to 727 2024-09-10T18:01:04.822 INFO:tasks.rados.rados.0.smithi012.stdout:1292: oid 18 updating version 727 to 729 2024-09-10T18:01:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:1292: oid 18 version 729 is already newer than 728 2024-09-10T18:01:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 729 (ObjNum 408 snap 132 seq_num 408) dirty exists 2024-09-10T18:01:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:1292: left oid 18 (ObjNum 408 snap 132 seq_num 408) 2024-09-10T18:01:04.823 INFO:tasks.rados.rados.0.smithi012.stdout:1294: finishing copy_from racing read to smithi01278544-4 2024-09-10T18:01:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:04 smithi012 ceph-mon[89611]: osdmap e339: 8 total, 8 up, 8 in 2024-09-10T18:01:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:04 smithi012 ceph-mon[92029]: osdmap e339: 8 total, 8 up, 8 in 2024-09-10T18:01:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:04 smithi089 ceph-mon[84132]: osdmap e339: 8 total, 8 up, 8 in 2024-09-10T18:01:05.781 INFO:tasks.rados.rados.0.smithi012.stdout:1292: done (2 left) 2024-09-10T18:01:05.781 INFO:tasks.rados.rados.0.smithi012.stdout:1294: done (1 left) 2024-09-10T18:01:05.781 INFO:tasks.rados.rados.0.smithi012.stdout:1295: done (0 left) 2024-09-10T18:01:05.781 INFO:tasks.rados.rados.0.smithi012.stdout:1296: setattr oid 25 current snap is 133 2024-09-10T18:01:05.782 INFO:tasks.rados.rados.0.smithi012.stdout:1297: setattr oid 47 current snap is 133 2024-09-10T18:01:05.783 INFO:tasks.rados.rados.0.smithi012.stdout:1298: snap_create 2024-09-10T18:01:05.787 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 928 (ObjNum 387 snap 124 seq_num 387) dirty exists 2024-09-10T18:01:05.789 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 883 (ObjNum 382 snap 121 seq_num 382) dirty exists 2024-09-10T18:01:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:05 smithi012 ceph-mon[89611]: osdmap e340: 8 total, 8 up, 8 in 2024-09-10T18:01:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:05 smithi012 ceph-mon[89611]: pgmap v180: 121 pgs: 121 active+clean; 196 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 3.6 MiB/s wr, 13 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-09-10T18:01:06.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:05 smithi012 ceph-mon[92029]: osdmap e340: 8 total, 8 up, 8 in 2024-09-10T18:01:06.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:05 smithi012 ceph-mon[92029]: pgmap v180: 121 pgs: 121 active+clean; 196 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 3.6 MiB/s wr, 13 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-09-10T18:01:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:05 smithi089 ceph-mon[84132]: osdmap e340: 8 total, 8 up, 8 in 2024-09-10T18:01:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:05 smithi089 ceph-mon[84132]: pgmap v180: 121 pgs: 121 active+clean; 196 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.3 MiB/s rd, 3.6 MiB/s wr, 13 op/s; 5.5 MiB/s, 1 objects/s recovering 2024-09-10T18:01:06.785 INFO:tasks.rados.rados.0.smithi012.stdout:1296: done (2 left) 2024-09-10T18:01:06.785 INFO:tasks.rados.rados.0.smithi012.stdout:1297: done (1 left) 2024-09-10T18:01:06.785 INFO:tasks.rados.rados.0.smithi012.stdout:1298: done (0 left) 2024-09-10T18:01:06.785 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 134 2024-09-10T18:01:06.785 INFO:tasks.rados.rados.0.smithi012.stdout:1299: seq_num 410 ranges {1073152=475136,1548288=417792,1966080=475136,2441216=425984,2867200=286720} 2024-09-10T18:01:06.793 INFO:tasks.rados.rados.0.smithi012.stdout:1299: writing smithi01278544-7 from 1073152 to 1548288 tid 1 2024-09-10T18:01:06.795 INFO:tasks.rados.rados.0.smithi012.stdout:1299: writing smithi01278544-7 from 1548288 to 1966080 tid 2 2024-09-10T18:01:06.798 INFO:tasks.rados.rados.0.smithi012.stdout:1299: writing smithi01278544-7 from 1966080 to 2441216 tid 3 2024-09-10T18:01:06.801 INFO:tasks.rados.rados.0.smithi012.stdout:1299: writing smithi01278544-7 from 2441216 to 2867200 tid 4 2024-09-10T18:01:06.803 INFO:tasks.rados.rados.0.smithi012.stdout:1299: writing smithi01278544-7 from 2867200 to 3153920 tid 5 2024-09-10T18:01:06.803 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 134 2024-09-10T18:01:06.803 INFO:tasks.rados.rados.0.smithi012.stdout:1299: finishing write tid 1 to smithi01278544-7 2024-09-10T18:01:06.803 INFO:tasks.rados.rados.0.smithi012.stdout:1299: finishing write tid 2 to smithi01278544-7 2024-09-10T18:01:06.803 INFO:tasks.rados.rados.0.smithi012.stdout:1300: seq_num 411 ranges {2080768=491520,2572288=753664,3325952=688128,4014080=163840} 2024-09-10T18:01:06.817 INFO:tasks.rados.rados.0.smithi012.stdout:1300: writing smithi01278544-32 from 2080768 to 2572288 tid 1 2024-09-10T18:01:06.821 INFO:tasks.rados.rados.0.smithi012.stdout:1300: writing smithi01278544-32 from 2572288 to 3325952 tid 2 2024-09-10T18:01:06.825 INFO:tasks.rados.rados.0.smithi012.stdout:1300: writing smithi01278544-32 from 3325952 to 4014080 tid 3 2024-09-10T18:01:06.826 INFO:tasks.rados.rados.0.smithi012.stdout:1300: writing smithi01278544-32 from 4014080 to 4177920 tid 4 2024-09-10T18:01:06.826 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 134 2024-09-10T18:01:06.826 INFO:tasks.rados.rados.0.smithi012.stdout:1299: finishing write tid 3 to smithi01278544-7 2024-09-10T18:01:06.826 INFO:tasks.rados.rados.0.smithi012.stdout:1301: seq_num 412 ranges {0=507904,507904=630784,1138688=491520,1630208=483328} 2024-09-10T18:01:06.829 INFO:tasks.rados.rados.0.smithi012.stdout:1301: writing smithi01278544-34 from 0 to 507904 tid 1 2024-09-10T18:01:06.832 INFO:tasks.rados.rados.0.smithi012.stdout:1301: writing smithi01278544-34 from 507904 to 1138688 tid 2 2024-09-10T18:01:06.835 INFO:tasks.rados.rados.0.smithi012.stdout:1301: writing smithi01278544-34 from 1138688 to 1630208 tid 3 2024-09-10T18:01:06.839 INFO:tasks.rados.rados.0.smithi012.stdout:1301: writing smithi01278544-34 from 1630208 to 2113536 tid 4 2024-09-10T18:01:06.839 INFO:tasks.rados.rados.0.smithi012.stdout:1302: snap_create 2024-09-10T18:01:06.839 INFO:tasks.rados.rados.0.smithi012.stdout:1299: finishing write tid 4 to smithi01278544-7 2024-09-10T18:01:06.839 INFO:tasks.rados.rados.0.smithi012.stdout:1299: finishing write tid 5 to smithi01278544-7 2024-09-10T18:01:06.839 INFO:tasks.rados.rados.0.smithi012.stdout:1299: finishing write tid 6 to smithi01278544-7 2024-09-10T18:01:06.839 INFO:tasks.rados.rados.0.smithi012.stdout:1299: finishing write tid 7 to smithi01278544-7 2024-09-10T18:01:06.839 INFO:tasks.rados.rados.0.smithi012.stdout:1299: oid 7 updating version 0 to 60 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1299: oid 7 version 60 is already newer than 56 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1299: oid 7 version 60 is already newer than 55 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1299: oid 7 version 60 is already newer than 57 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1299: oid 7 version 60 is already newer than 58 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1299: oid 7 version 60 is already newer than 59 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 60 (ObjNum 410 snap 134 seq_num 410) dirty exists 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1299: left oid 7 (ObjNum 410 snap 134 seq_num 410) 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1300: finishing write tid 1 to smithi01278544-32 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1300: finishing write tid 2 to smithi01278544-32 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1300: finishing write tid 3 to smithi01278544-32 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1300: finishing write tid 4 to smithi01278544-32 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1300: finishing write tid 5 to smithi01278544-32 2024-09-10T18:01:06.840 INFO:tasks.rados.rados.0.smithi012.stdout:1300: finishing write tid 6 to smithi01278544-32 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1300: oid 32 updating version 0 to 722 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1300: oid 32 updating version 722 to 724 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1300: oid 32 updating version 724 to 725 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1300: oid 32 version 725 is already newer than 721 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1300: oid 32 version 725 is already newer than 723 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 725 (ObjNum 411 snap 134 seq_num 411) dirty exists 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1300: left oid 32 (ObjNum 411 snap 134 seq_num 411) 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1301: finishing write tid 1 to smithi01278544-34 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1301: finishing write tid 2 to smithi01278544-34 2024-09-10T18:01:06.841 INFO:tasks.rados.rados.0.smithi012.stdout:1301: finishing write tid 3 to smithi01278544-34 2024-09-10T18:01:06.842 INFO:tasks.rados.rados.0.smithi012.stdout:1301: finishing write tid 4 to smithi01278544-34 2024-09-10T18:01:06.842 INFO:tasks.rados.rados.0.smithi012.stdout:1301: finishing write tid 5 to smithi01278544-34 2024-09-10T18:01:06.843 INFO:tasks.rados.rados.0.smithi012.stdout:1301: finishing write tid 6 to smithi01278544-34 2024-09-10T18:01:06.843 INFO:tasks.rados.rados.0.smithi012.stdout:1301: oid 34 updating version 0 to 568 2024-09-10T18:01:06.843 INFO:tasks.rados.rados.0.smithi012.stdout:1301: oid 34 updating version 568 to 569 2024-09-10T18:01:06.843 INFO:tasks.rados.rados.0.smithi012.stdout:1301: oid 34 version 569 is already newer than 565 2024-09-10T18:01:06.844 INFO:tasks.rados.rados.0.smithi012.stdout:1301: oid 34 version 569 is already newer than 567 2024-09-10T18:01:06.844 INFO:tasks.rados.rados.0.smithi012.stdout:1301: oid 34 version 569 is already newer than 566 2024-09-10T18:01:06.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 569 (ObjNum 412 snap 134 seq_num 412) dirty exists 2024-09-10T18:01:06.844 INFO:tasks.rados.rados.0.smithi012.stdout:1301: left oid 34 (ObjNum 412 snap 134 seq_num 412) 2024-09-10T18:01:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:06 smithi012 ceph-mon[89611]: osdmap e341: 8 total, 8 up, 8 in 2024-09-10T18:01:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:06 smithi012 ceph-mon[92029]: osdmap e341: 8 total, 8 up, 8 in 2024-09-10T18:01:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:06 smithi089 ceph-mon[84132]: osdmap e341: 8 total, 8 up, 8 in 2024-09-10T18:01:07.683 INFO:tasks.rados.rados.0.smithi012.stdout:1299: done (3 left) 2024-09-10T18:01:07.683 INFO:tasks.rados.rados.0.smithi012.stdout:1300: done (2 left) 2024-09-10T18:01:07.683 INFO:tasks.rados.rados.0.smithi012.stdout:1301: done (1 left) 2024-09-10T18:01:07.683 INFO:tasks.rados.rados.0.smithi012.stdout:1302: done (0 left) 2024-09-10T18:01:07.683 INFO:tasks.rados.rados.0.smithi012.stdout:1303: delete oid 40 current snap is 135 2024-09-10T18:01:07.686 INFO:tasks.rados.rados.0.smithi012.stdout:1303: done (0 left) 2024-09-10T18:01:07.687 INFO:tasks.rados.rados.0.smithi012.stdout:1304: snap_remove snap 120 2024-09-10T18:01:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:07 smithi012 ceph-mon[89611]: osdmap e342: 8 total, 8 up, 8 in 2024-09-10T18:01:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:07 smithi012 ceph-mon[89611]: pgmap v183: 121 pgs: 121 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 4.8 MiB/s wr, 29 op/s 2024-09-10T18:01:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:07 smithi012 ceph-mon[89611]: osdmap e343: 8 total, 8 up, 8 in 2024-09-10T18:01:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:07 smithi012 ceph-mon[92029]: osdmap e342: 8 total, 8 up, 8 in 2024-09-10T18:01:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:07 smithi012 ceph-mon[92029]: pgmap v183: 121 pgs: 121 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 4.8 MiB/s wr, 29 op/s 2024-09-10T18:01:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:07 smithi012 ceph-mon[92029]: osdmap e343: 8 total, 8 up, 8 in 2024-09-10T18:01:08.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:07 smithi089 ceph-mon[84132]: osdmap e342: 8 total, 8 up, 8 in 2024-09-10T18:01:08.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:07 smithi089 ceph-mon[84132]: pgmap v183: 121 pgs: 121 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 4.8 MiB/s wr, 29 op/s 2024-09-10T18:01:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:07 smithi089 ceph-mon[84132]: osdmap e343: 8 total, 8 up, 8 in 2024-09-10T18:01:08.679 INFO:tasks.rados.rados.0.smithi012.stdout:1304: done (0 left) 2024-09-10T18:01:08.679 INFO:tasks.rados.rados.0.smithi012.stdout:1305: snap_remove snap 131 2024-09-10T18:01:09.694 INFO:tasks.rados.rados.0.smithi012.stdout:1305: done (0 left) 2024-09-10T18:01:09.694 INFO:tasks.rados.rados.0.smithi012.stdout:1306: snap_remove snap 130 2024-09-10T18:01:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:09 smithi012 ceph-mon[89611]: osdmap e344: 8 total, 8 up, 8 in 2024-09-10T18:01:10.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:09 smithi012 ceph-mon[92029]: osdmap e344: 8 total, 8 up, 8 in 2024-09-10T18:01:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:09 smithi089 ceph-mon[84132]: osdmap e344: 8 total, 8 up, 8 in 2024-09-10T18:01:10.694 INFO:tasks.rados.rados.0.smithi012.stdout:1306: done (0 left) 2024-09-10T18:01:10.694 INFO:tasks.rados.rados.0.smithi012.stdout:1307: delete oid 34 current snap is 135 2024-09-10T18:01:10.704 INFO:tasks.rados.rados.0.smithi012.stdout:1307: done (0 left) 2024-09-10T18:01:10.704 INFO:tasks.rados.rados.0.smithi012.stdout:1308: read oid 33 snap -1 2024-09-10T18:01:10.704 INFO:tasks.rados.rados.0.smithi012.stdout:1308: expect (ObjNum 399 snap 131 seq_num 399) 2024-09-10T18:01:10.704 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 135 2024-09-10T18:01:10.704 INFO:tasks.rados.rados.0.smithi012.stdout:1309: seq_num 415 ranges {0=557056,557056=688128,1245184=663552,1908736=253952} 2024-09-10T18:01:10.707 INFO:tasks.rados.rados.0.smithi012.stdout:1309: writing smithi01278544-48 from 0 to 557056 tid 1 2024-09-10T18:01:10.711 INFO:tasks.rados.rados.0.smithi012.stdout:1309: writing smithi01278544-48 from 557056 to 1245184 tid 2 2024-09-10T18:01:10.715 INFO:tasks.rados.rados.0.smithi012.stdout:1309: writing smithi01278544-48 from 1245184 to 1908736 tid 3 2024-09-10T18:01:10.717 INFO:tasks.rados.rados.0.smithi012.stdout:1309: writing smithi01278544-48 from 1908736 to 2162688 tid 4 2024-09-10T18:01:10.717 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 135 2024-09-10T18:01:10.717 INFO:tasks.rados.rados.0.smithi012.stdout:1309: finishing write tid 1 to smithi01278544-48 2024-09-10T18:01:10.718 INFO:tasks.rados.rados.0.smithi012.stdout:1309: finishing write tid 2 to smithi01278544-48 2024-09-10T18:01:10.718 INFO:tasks.rados.rados.0.smithi012.stdout:1310: seq_num 416 ranges {1957888=573440,2531328=573440,3104768=475136,3579904=557056} 2024-09-10T18:01:10.732 INFO:tasks.rados.rados.0.smithi012.stdout:1310: writing smithi01278544-5 from 1957888 to 2531328 tid 1 2024-09-10T18:01:10.735 INFO:tasks.rados.rados.0.smithi012.stdout:1310: writing smithi01278544-5 from 2531328 to 3104768 tid 2 2024-09-10T18:01:10.738 INFO:tasks.rados.rados.0.smithi012.stdout:1310: writing smithi01278544-5 from 3104768 to 3579904 tid 3 2024-09-10T18:01:10.742 INFO:tasks.rados.rados.0.smithi012.stdout:1310: writing smithi01278544-5 from 3579904 to 4136960 tid 4 2024-09-10T18:01:10.742 INFO:tasks.rados.rados.0.smithi012.stdout:1311: read oid 42 snap -1 2024-09-10T18:01:10.742 INFO:tasks.rados.rados.0.smithi012.stdout:1311: expect (ObjNum 404 snap 131 seq_num 404) 2024-09-10T18:01:10.742 INFO:tasks.rados.rados.0.smithi012.stdout:1312: delete oid 15 current snap is 135 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: finishing write tid 3 to smithi01278544-48 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: finishing write tid 4 to smithi01278544-48 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: finishing write tid 5 to smithi01278544-48 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: finishing write tid 6 to smithi01278544-48 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: oid 48 updating version 0 to 562 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: oid 48 version 562 is already newer than 560 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: oid 48 version 562 is already newer than 559 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: oid 48 updating version 562 to 563 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: oid 48 version 563 is already newer than 561 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 563 (ObjNum 415 snap 135 seq_num 415) dirty exists 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1309: left oid 48 (ObjNum 415 snap 135 seq_num 415) 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1310: finishing write tid 1 to smithi01278544-5 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1310: finishing write tid 2 to smithi01278544-5 2024-09-10T18:01:10.743 INFO:tasks.rados.rados.0.smithi012.stdout:1310: finishing write tid 3 to smithi01278544-5 2024-09-10T18:01:10.746 INFO:tasks.rados.rados.0.smithi012.stdout:1308: expect (ObjNum 399 snap 131 seq_num 399) 2024-09-10T18:01:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:10 smithi012 ceph-mon[89611]: pgmap v186: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 28 op/s 2024-09-10T18:01:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:10 smithi012 ceph-mon[89611]: osdmap e345: 8 total, 8 up, 8 in 2024-09-10T18:01:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:10 smithi012 ceph-mon[92029]: pgmap v186: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 28 op/s 2024-09-10T18:01:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:10 smithi012 ceph-mon[92029]: osdmap e345: 8 total, 8 up, 8 in 2024-09-10T18:01:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:10 smithi089 ceph-mon[84132]: pgmap v186: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 28 op/s 2024-09-10T18:01:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:10 smithi089 ceph-mon[84132]: osdmap e345: 8 total, 8 up, 8 in 2024-09-10T18:01:11.285 INFO:tasks.rados.rados.0.smithi012.stdout:1310: finishing write tid 4 to smithi01278544-5 2024-09-10T18:01:11.285 INFO:tasks.rados.rados.0.smithi012.stdout:1310: finishing write tid 5 to smithi01278544-5 2024-09-10T18:01:11.285 INFO:tasks.rados.rados.0.smithi012.stdout:1310: finishing write tid 6 to smithi01278544-5 2024-09-10T18:01:11.285 INFO:tasks.rados.rados.0.smithi012.stdout:1310: oid 5 updating version 0 to 521 2024-09-10T18:01:11.286 INFO:tasks.rados.rados.0.smithi012.stdout:1310: oid 5 updating version 521 to 523 2024-09-10T18:01:11.286 INFO:tasks.rados.rados.0.smithi012.stdout:1310: oid 5 version 523 is already newer than 522 2024-09-10T18:01:11.286 INFO:tasks.rados.rados.0.smithi012.stdout:1310: oid 5 updating version 523 to 524 2024-09-10T18:01:11.286 INFO:tasks.rados.rados.0.smithi012.stdout:1310: oid 5 updating version 524 to 525 2024-09-10T18:01:11.286 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 525 (ObjNum 416 snap 135 seq_num 416) dirty exists 2024-09-10T18:01:11.286 INFO:tasks.rados.rados.0.smithi012.stdout:1310: left oid 5 (ObjNum 416 snap 135 seq_num 416) 2024-09-10T18:01:11.286 INFO:tasks.rados.rados.0.smithi012.stdout:1311: expect (ObjNum 404 snap 131 seq_num 404) 2024-09-10T18:01:11.337 INFO:tasks.rados.rados.0.smithi012.stdout:1308: done (4 left) 2024-09-10T18:01:11.337 INFO:tasks.rados.rados.0.smithi012.stdout:1309: done (3 left) 2024-09-10T18:01:11.337 INFO:tasks.rados.rados.0.smithi012.stdout:1310: done (2 left) 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:1311: done (1 left) 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:1312: done (0 left) 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:1313: rollback oid 19 current snap is 135 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 19 to 125 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:1314: read oid 31 snap 103 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:1314: expect deleted 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:1315: rmattr oid 25 current snap is 135 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 8 current snap is 135 2024-09-10T18:01:11.338 INFO:tasks.rados.rados.0.smithi012.stdout:1316: seq_num 418 ranges {0=606208,606208=737280,1343488=434176,1777664=434176} 2024-09-10T18:01:11.340 INFO:tasks.rados.rados.0.smithi012.stdout:1316: writing smithi01278544-8 from 0 to 606208 tid 1 2024-09-10T18:01:11.345 INFO:tasks.rados.rados.0.smithi012.stdout:1316: writing smithi01278544-8 from 606208 to 1343488 tid 2 2024-09-10T18:01:11.347 INFO:tasks.rados.rados.0.smithi012.stdout:1316: writing smithi01278544-8 from 1343488 to 1777664 tid 3 2024-09-10T18:01:11.350 INFO:tasks.rados.rados.0.smithi012.stdout:1316: writing smithi01278544-8 from 1777664 to 2211840 tid 4 2024-09-10T18:01:11.350 INFO:tasks.rados.rados.0.smithi012.stdout:1317: snap_remove snap 133 2024-09-10T18:01:11.707 INFO:tasks.rados.rados.0.smithi012.stdout:1317: done (4 left) 2024-09-10T18:01:11.707 INFO:tasks.rados.rados.0.smithi012.stdout:1318: read oid 14 snap -1 2024-09-10T18:01:11.707 INFO:tasks.rados.rados.0.smithi012.stdout:1318: expect (ObjNum 363 snap 117 seq_num 363) 2024-09-10T18:01:11.707 INFO:tasks.rados.rados.0.smithi012.stdout:1319: snap_create 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1313: finishing rollback tid 0 to smithi01278544-19 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1313: finishing rollback tid 1 to smithi01278544-19 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 580 (ObjNum 449 snap 0 seq_num 3200229008) dirty dne 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 907 (ObjNum 382 snap 121 seq_num 382) dirty exists 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: finishing write tid 1 to smithi01278544-8 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: finishing write tid 2 to smithi01278544-8 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: finishing write tid 3 to smithi01278544-8 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: finishing write tid 4 to smithi01278544-8 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: finishing write tid 5 to smithi01278544-8 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: finishing write tid 6 to smithi01278544-8 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: oid 8 updating version 0 to 618 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: oid 8 updating version 618 to 620 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: oid 8 version 620 is already newer than 619 2024-09-10T18:01:11.708 INFO:tasks.rados.rados.0.smithi012.stdout:1316: oid 8 version 620 is already newer than 617 2024-09-10T18:01:11.709 INFO:tasks.rados.rados.0.smithi012.stdout:1316: oid 8 version 620 is already newer than 616 2024-09-10T18:01:11.709 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 620 (ObjNum 418 snap 135 seq_num 418) dirty exists 2024-09-10T18:01:11.709 INFO:tasks.rados.rados.0.smithi012.stdout:1316: left oid 8 (ObjNum 418 snap 135 seq_num 418) 2024-09-10T18:01:11.719 INFO:tasks.rados.rados.0.smithi012.stdout:1318: expect (ObjNum 363 snap 117 seq_num 363) 2024-09-10T18:01:12.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:11 smithi012 ceph-mon[89611]: osdmap e346: 8 total, 8 up, 8 in 2024-09-10T18:01:12.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:11 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:12.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:11 smithi012 ceph-mon[92029]: osdmap e346: 8 total, 8 up, 8 in 2024-09-10T18:01:12.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:11 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:12.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:11 smithi089 ceph-mon[84132]: osdmap e346: 8 total, 8 up, 8 in 2024-09-10T18:01:12.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:11 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:12.678 INFO:tasks.rados.rados.0.smithi012.stdout:1313: done (5 left) 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1314: done (4 left) 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1315: done (3 left) 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1316: done (2 left) 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1318: done (1 left) 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1319: done (0 left) 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1320: rollback oid 42 current snap is 136 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 42 to 122 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1321: read oid 22 snap -1 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1321: expect (ObjNum 395 snap 127 seq_num 395) 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 136 2024-09-10T18:01:12.679 INFO:tasks.rados.rados.0.smithi012.stdout:1322: seq_num 419 ranges {2293760=622592,2916352=671744,3588096=647168,4235264=286720} 2024-09-10T18:01:12.696 INFO:tasks.rados.rados.0.smithi012.stdout:1322: writing smithi01278544-10 from 2293760 to 2916352 tid 1 2024-09-10T18:01:12.700 INFO:tasks.rados.rados.0.smithi012.stdout:1322: writing smithi01278544-10 from 2916352 to 3588096 tid 2 2024-09-10T18:01:12.705 INFO:tasks.rados.rados.0.smithi012.stdout:1322: writing smithi01278544-10 from 3588096 to 4235264 tid 3 2024-09-10T18:01:12.707 INFO:tasks.rados.rados.0.smithi012.stdout:1322: writing smithi01278544-10 from 4235264 to 4521984 tid 4 2024-09-10T18:01:12.708 INFO:tasks.rados.rados.0.smithi012.stdout:1323: copy_from oid 25 from oid 6 current snap is 136 2024-09-10T18:01:12.708 INFO:tasks.rados.rados.0.smithi012.stdout:1320: finishing rollback tid 0 to smithi01278544-42 2024-09-10T18:01:12.708 INFO:tasks.rados.rados.0.smithi012.stdout:1320: finishing rollback tid 1 to smithi01278544-42 2024-09-10T18:01:12.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 959 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:01:12.708 INFO:tasks.rados.rados.0.smithi012.stdout:1320: done (3 left) 2024-09-10T18:01:12.708 INFO:tasks.rados.rados.0.smithi012.stdout:1324: read oid 28 snap -1 2024-09-10T18:01:12.708 INFO:tasks.rados.rados.0.smithi012.stdout:1324: expect (ObjNum 405 snap 131 seq_num 405) 2024-09-10T18:01:12.708 INFO:tasks.rados.rados.0.smithi012.stdout:1325: delete oid 33 current snap is 136 2024-09-10T18:01:12.709 INFO:tasks.rados.rados.0.smithi012.stdout:1321: expect (ObjNum 395 snap 127 seq_num 395) 2024-09-10T18:01:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:12 smithi012 ceph-mon[89611]: pgmap v189: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:01:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:12 smithi012 ceph-mon[89611]: osdmap e347: 8 total, 8 up, 8 in 2024-09-10T18:01:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:12 smithi012 ceph-mon[89611]: osdmap e348: 8 total, 8 up, 8 in 2024-09-10T18:01:13.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:12 smithi012 ceph-mon[92029]: pgmap v189: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:01:13.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:12 smithi012 ceph-mon[92029]: osdmap e347: 8 total, 8 up, 8 in 2024-09-10T18:01:13.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:12 smithi012 ceph-mon[92029]: osdmap e348: 8 total, 8 up, 8 in 2024-09-10T18:01:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:12 smithi089 ceph-mon[84132]: pgmap v189: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 212 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:01:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:12 smithi089 ceph-mon[84132]: osdmap e347: 8 total, 8 up, 8 in 2024-09-10T18:01:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:12 smithi089 ceph-mon[84132]: osdmap e348: 8 total, 8 up, 8 in 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1322: finishing write tid 1 to smithi01278544-10 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1322: finishing write tid 2 to smithi01278544-10 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1321: done (4 left) 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1325: done (3 left) 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1326: copy_from oid 19 from oid 35 current snap is 136 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1322: finishing write tid 3 to smithi01278544-10 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1322: finishing write tid 4 to smithi01278544-10 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1322: finishing write tid 5 to smithi01278544-10 2024-09-10T18:01:13.079 INFO:tasks.rados.rados.0.smithi012.stdout:1322: finishing write tid 6 to smithi01278544-10 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1322: oid 10 updating version 0 to 913 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1322: oid 10 updating version 913 to 915 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1322: oid 10 version 915 is already newer than 911 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1322: oid 10 version 915 is already newer than 914 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1322: oid 10 version 915 is already newer than 912 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 915 (ObjNum 419 snap 136 seq_num 419) dirty exists 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1322: left oid 10 (ObjNum 419 snap 136 seq_num 419) 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1323: finishing copy_from to smithi01278544-25 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1323: got expected ENOENT (src dne) 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1323: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:01:13.080 INFO:tasks.rados.rados.0.smithi012.stdout:1324: expect (ObjNum 405 snap 131 seq_num 405) 2024-09-10T18:01:13.167 INFO:tasks.rados.rados.0.smithi012.stdout:1326: finishing copy_from racing read to smithi01278544-19 2024-09-10T18:01:13.167 INFO:tasks.rados.rados.0.smithi012.stdout:1326: finishing copy_from to smithi01278544-19 2024-09-10T18:01:13.167 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 720 (ObjNum 390 snap 125 seq_num 390) dirty exists 2024-09-10T18:01:13.167 INFO:tasks.rados.rados.0.smithi012.stdout:1322: done (3 left) 2024-09-10T18:01:13.167 INFO:tasks.rados.rados.0.smithi012.stdout:1323: done (2 left) 2024-09-10T18:01:13.167 INFO:tasks.rados.rados.0.smithi012.stdout:1324: done (1 left) 2024-09-10T18:01:13.167 INFO:tasks.rados.rados.0.smithi012.stdout:1326: done (0 left) 2024-09-10T18:01:13.167 INFO:tasks.rados.rados.0.smithi012.stdout:1327: snap_create 2024-09-10T18:01:13.711 INFO:tasks.rados.rados.0.smithi012.stdout:1327: done (0 left) 2024-09-10T18:01:13.711 INFO:tasks.rados.rados.0.smithi012.stdout:1328: copy_from oid 10 from oid 6 current snap is 137 2024-09-10T18:01:13.711 INFO:tasks.rados.rados.0.smithi012.stdout:1329: read oid 35 snap -1 2024-09-10T18:01:13.711 INFO:tasks.rados.rados.0.smithi012.stdout:1329: expect (ObjNum 390 snap 125 seq_num 390) 2024-09-10T18:01:13.712 INFO:tasks.rados.rados.0.smithi012.stdout:1330: setattr oid 1 current snap is 137 2024-09-10T18:01:13.712 INFO:tasks.rados.rados.0.smithi012.stdout:1331: snap_create 2024-09-10T18:01:13.718 INFO:tasks.rados.rados.0.smithi012.stdout:1328: finishing copy_from to smithi01278544-10 2024-09-10T18:01:13.718 INFO:tasks.rados.rados.0.smithi012.stdout:1328: got expected ENOENT (src dne) 2024-09-10T18:01:13.718 INFO:tasks.rados.rados.0.smithi012.stdout:1328: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:01:13.718 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 564 (ObjNum 177 snap 0 seq_num 1) dirty exists 2024-09-10T18:01:13.725 INFO:tasks.rados.rados.0.smithi012.stdout:1329: expect (ObjNum 390 snap 125 seq_num 390) 2024-09-10T18:01:13.984 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:13 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-10T18:01:13.984 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:13 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-10T18:01:14.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:13 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-10T18:01:14.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:01:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:01:13] "GET /metrics HTTP/1.1" 200 36278 "" "Prometheus/2.43.0" 2024-09-10T18:01:14.591 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:01:14.716 INFO:tasks.rados.rados.0.smithi012.stdout:1328: done (3 left) 2024-09-10T18:01:14.716 INFO:tasks.rados.rados.0.smithi012.stdout:1329: done (2 left) 2024-09-10T18:01:14.717 INFO:tasks.rados.rados.0.smithi012.stdout:1330: done (1 left) 2024-09-10T18:01:14.717 INFO:tasks.rados.rados.0.smithi012.stdout:1331: done (0 left) 2024-09-10T18:01:14.717 INFO:tasks.rados.rados.0.smithi012.stdout:1332: snap_create 2024-09-10T18:01:15.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:14 smithi012 ceph-mon[92029]: pgmap v192: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 209 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2024-09-10T18:01:15.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:14 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T18:01:15.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:14 smithi012 ceph-mon[92029]: Upgrade: osd.2 is safe to restart 2024-09-10T18:01:15.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:14 smithi012 ceph-mon[92029]: osdmap e349: 8 total, 8 up, 8 in 2024-09-10T18:01:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:14 smithi012 ceph-mon[89611]: pgmap v192: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 209 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2024-09-10T18:01:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:14 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T18:01:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:14 smithi012 ceph-mon[89611]: Upgrade: osd.2 is safe to restart 2024-09-10T18:01:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:14 smithi012 ceph-mon[89611]: osdmap e349: 8 total, 8 up, 8 in 2024-09-10T18:01:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:14 smithi089 ceph-mon[84132]: pgmap v192: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 209 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2024-09-10T18:01:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:14 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T18:01:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:14 smithi089 ceph-mon[84132]: Upgrade: osd.2 is safe to restart 2024-09-10T18:01:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:14 smithi089 ceph-mon[84132]: osdmap e349: 8 total, 8 up, 8 in 2024-09-10T18:01:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:01:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (6m) 20s ago 7m 26.8M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:01:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (7m) 95s ago 7m 87.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:01:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (8m) 20s ago 8m 18.7M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:01:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (8m) 95s ago 8m 19.6M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:01:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (2m) 95s ago 12m 452M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:01:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (3m) 20s ago 13m 523M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:01:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (2m) 20s ago 14m 51.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:01:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (101s) 95s ago 12m 27.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:01:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (118s) 20s ago 12m 43.4M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:01:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (6m) 20s ago 6m 15.4M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:01:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (6m) 95s ago 6m 16.9M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:01:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (58s) 20s ago 11m 106M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:01:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (25s) 20s ago 11m 11.6M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:01:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (11m) 20s ago 11m 193M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 3fccc13bd31d 2024-09-10T18:01:15.184 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (10m) 20s ago 10m 179M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T18:01:15.184 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (10m) 95s ago 10m 186M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T18:01:15.184 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (9m) 95s ago 9m 136M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T18:01:15.184 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (9m) 95s ago 9m 141M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T18:01:15.184 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (9m) 95s ago 9m 98.9M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T18:01:15.185 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (2m) 95s ago 7m 50.4M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 6, 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:01:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:01:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:01:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:01:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:01:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:01:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 8, 2024-09-10T18:01:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 7 2024-09-10T18:01:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:01:15.560 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:01:15.718 INFO:tasks.rados.rados.0.smithi012.stdout:1332: done (0 left) 2024-09-10T18:01:15.718 INFO:tasks.rados.rados.0.smithi012.stdout:1333: rmattr oid 40 current snap is 139 2024-09-10T18:01:15.718 INFO:tasks.rados.rados.0.smithi012.stdout:1333: done (0 left) 2024-09-10T18:01:15.718 INFO:tasks.rados.rados.0.smithi012.stdout:1334: snap_create 2024-09-10T18:01:15.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[89611]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:15.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[89611]: osdmap e350: 8 total, 8 up, 8 in 2024-09-10T18:01:15.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:15.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T18:01:15.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:15.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/922656785' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:15.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[92029]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:15.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[92029]: osdmap e350: 8 total, 8 up, 8 in 2024-09-10T18:01:15.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:15.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T18:01:15.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:15.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:15 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/922656785' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:15.871 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "7/20 daemons upgraded", 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:01:15.872 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:01:16.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:15 smithi089 ceph-mon[84132]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:16.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:15 smithi089 ceph-mon[84132]: osdmap e350: 8 total, 8 up, 8 in 2024-09-10T18:01:16.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:15 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:16.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:15 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T18:01:16.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:15 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:16.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:15 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/922656785' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:16.718 INFO:tasks.rados.rados.0.smithi012.stdout:1334: done (0 left) 2024-09-10T18:01:16.718 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 140 2024-09-10T18:01:16.718 INFO:tasks.rados.rados.0.smithi012.stdout:1335: seq_num 421 ranges {2580480=655360,3235840=442368,3678208=663552,4341760=499712} 2024-09-10T18:01:16.736 INFO:tasks.rados.rados.0.smithi012.stdout:1335: writing smithi01278544-35 from 2580480 to 3235840 tid 1 2024-09-10T18:01:16.738 INFO:tasks.rados.rados.0.smithi012.stdout:1335: writing smithi01278544-35 from 3235840 to 3678208 tid 2 2024-09-10T18:01:16.742 INFO:tasks.rados.rados.0.smithi012.stdout:1335: writing smithi01278544-35 from 3678208 to 4341760 tid 3 2024-09-10T18:01:16.745 INFO:tasks.rados.rados.0.smithi012.stdout:1335: writing smithi01278544-35 from 4341760 to 4841472 tid 4 2024-09-10T18:01:16.745 INFO:tasks.rados.rados.0.smithi012.stdout:1336: delete oid 36 current snap is 140 2024-09-10T18:01:16.745 INFO:tasks.rados.rados.0.smithi012.stdout:1335: finishing write tid 1 to smithi01278544-35 2024-09-10T18:01:16.745 INFO:tasks.rados.rados.0.smithi012.stdout:1335: finishing write tid 2 to smithi01278544-35 2024-09-10T18:01:16.745 INFO:tasks.rados.rados.0.smithi012.stdout:1335: finishing write tid 3 to smithi01278544-35 2024-09-10T18:01:16.748 INFO:tasks.rados.rados.0.smithi012.stdout:1335: finishing write tid 4 to smithi01278544-35 2024-09-10T18:01:16.749 INFO:tasks.rados.rados.0.smithi012.stdout:1336: done (1 left) 2024-09-10T18:01:16.749 INFO:tasks.rados.rados.0.smithi012.stdout:1337: read oid 3 snap -1 2024-09-10T18:01:16.749 INFO:tasks.rados.rados.0.smithi012.stdout:1337: expect deleted 2024-09-10T18:01:16.750 INFO:tasks.rados.rados.0.smithi012.stdout:1338: delete oid 13 current snap is 140 2024-09-10T18:01:16.750 INFO:tasks.rados.rados.0.smithi012.stdout:1335: finishing write tid 5 to smithi01278544-35 2024-09-10T18:01:16.750 INFO:tasks.rados.rados.0.smithi012.stdout:1335: finishing write tid 6 to smithi01278544-35 2024-09-10T18:01:16.750 INFO:tasks.rados.rados.0.smithi012.stdout:1335: oid 35 updating version 0 to 726 2024-09-10T18:01:16.750 INFO:tasks.rados.rados.0.smithi012.stdout:1335: oid 35 updating version 726 to 728 2024-09-10T18:01:16.751 INFO:tasks.rados.rados.0.smithi012.stdout:1335: oid 35 updating version 728 to 729 2024-09-10T18:01:16.751 INFO:tasks.rados.rados.0.smithi012.stdout:1335: oid 35 version 729 is already newer than 727 2024-09-10T18:01:16.751 INFO:tasks.rados.rados.0.smithi012.stdout:1335: oid 35 updating version 729 to 730 2024-09-10T18:01:16.751 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 730 (ObjNum 421 snap 140 seq_num 421) dirty exists 2024-09-10T18:01:16.751 INFO:tasks.rados.rados.0.smithi012.stdout:1335: left oid 35 (ObjNum 421 snap 140 seq_num 421) 2024-09-10T18:01:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1335: done (2 left) 2024-09-10T18:01:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1337: done (1 left) 2024-09-10T18:01:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1338: done (0 left) 2024-09-10T18:01:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1339: snap_remove snap 138 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: pgmap v195: 121 pgs: 121 active+clean; 209 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: Upgrade: Updating osd.2 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: Deploying daemon osd.2 on smithi012 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: from='client.44219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: osdmap e351: 8 total, 8 up, 8 in 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:16.897 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[89611]: osdmap e352: 8 total, 8 up, 8 in 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: pgmap v195: 121 pgs: 121 active+clean; 209 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: Upgrade: Updating osd.2 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: Deploying daemon osd.2 on smithi012 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: from='client.44219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: osdmap e351: 8 total, 8 up, 8 in 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:16.898 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:16 smithi012 ceph-mon[92029]: osdmap e352: 8 total, 8 up, 8 in 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: pgmap v195: 121 pgs: 121 active+clean; 209 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: Upgrade: Updating osd.2 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: Deploying daemon osd.2 on smithi012 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: from='client.44219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: osdmap e351: 8 total, 8 up, 8 in 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:16 smithi089 ceph-mon[84132]: osdmap e352: 8 total, 8 up, 8 in 2024-09-10T18:01:17.680 INFO:tasks.rados.rados.0.smithi012.stdout:1339: done (0 left) 2024-09-10T18:01:17.681 INFO:tasks.rados.rados.0.smithi012.stdout:1340: read oid 37 snap -1 2024-09-10T18:01:17.681 INFO:tasks.rados.rados.0.smithi012.stdout:1340: expect (ObjNum 342 snap 109 seq_num 342) 2024-09-10T18:01:17.681 INFO:tasks.rados.rados.0.smithi012.stdout:1341: snap_create 2024-09-10T18:01:17.698 INFO:tasks.rados.rados.0.smithi012.stdout:1340: expect (ObjNum 342 snap 109 seq_num 342) 2024-09-10T18:01:18.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:17 smithi012 ceph-mon[89611]: from='client.34317 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:18.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:17 smithi012 ceph-mon[89611]: osdmap e353: 8 total, 8 up, 8 in 2024-09-10T18:01:18.006 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:17 smithi012 ceph-mon[92029]: from='client.34317 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:18.006 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:17 smithi012 ceph-mon[92029]: osdmap e353: 8 total, 8 up, 8 in 2024-09-10T18:01:18.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:17 smithi089 ceph-mon[84132]: from='client.34317 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:17 smithi089 ceph-mon[84132]: osdmap e353: 8 total, 8 up, 8 in 2024-09-10T18:01:18.284 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:18 smithi012 systemd[1]: Stopping Ceph osd.2 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:01:18.686 INFO:tasks.rados.rados.0.smithi012.stdout:1340: done (1 left) 2024-09-10T18:01:18.686 INFO:tasks.rados.rados.0.smithi012.stdout:1341: done (0 left) 2024-09-10T18:01:18.686 INFO:tasks.rados.rados.0.smithi012.stdout:1342: copy_from oid 45 from oid 50 current snap is 141 2024-09-10T18:01:18.687 INFO:tasks.rados.rados.0.smithi012.stdout:1343: copy_from oid 17 from oid 29 current snap is 141 2024-09-10T18:01:18.687 INFO:tasks.rados.rados.0.smithi012.stdout:1344: read oid 30 snap -1 2024-09-10T18:01:18.687 INFO:tasks.rados.rados.0.smithi012.stdout:1344: expect deleted 2024-09-10T18:01:18.687 INFO:tasks.rados.rados.0.smithi012.stdout:1345: read oid 41 snap -1 2024-09-10T18:01:18.687 INFO:tasks.rados.rados.0.smithi012.stdout:1345: expect (ObjNum 360 snap 117 seq_num 360) 2024-09-10T18:01:18.687 INFO:tasks.rados.rados.0.smithi012.stdout:1346: read oid 12 snap -1 2024-09-10T18:01:18.687 INFO:tasks.rados.rados.0.smithi012.stdout:1346: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:01:18.688 INFO:tasks.rados.rados.0.smithi012.stdout:1347: copy_from oid 14 from oid 3 current snap is 141 2024-09-10T18:01:18.688 INFO:tasks.rados.rados.0.smithi012.stdout:1348: setattr oid 19 current snap is 141 2024-09-10T18:01:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:1344: done (6 left) 2024-09-10T18:01:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:1349: read oid 26 snap -1 2024-09-10T18:01:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:1349: expect deleted 2024-09-10T18:01:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:1350: read oid 23 snap -1 2024-09-10T18:01:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:1350: expect (ObjNum 380 snap 121 seq_num 380) 2024-09-10T18:01:18.689 INFO:tasks.rados.rados.0.smithi012.stdout:1351: snap_create 2024-09-10T18:01:18.696 INFO:tasks.rados.rados.0.smithi012.stdout:1346: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:01:18.714 INFO:tasks.rados.rados.0.smithi012.stdout:1345: expect (ObjNum 360 snap 117 seq_num 360) 2024-09-10T18:01:18.730 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[52899]: 2024-09-10T18:01:18.451+0000 7f3e00fe0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:01:18.730 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[52899]: 2024-09-10T18:01:18.451+0000 7f3e00fe0640 -1 osd.2 353 *** Got signal Terminated *** 2024-09-10T18:01:18.730 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[52899]: 2024-09-10T18:01:18.451+0000 7f3e00fe0640 -1 osd.2 353 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:01:19.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-mon[92029]: pgmap v198: 121 pgs: 121 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-09-10T18:01:19.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-mon[92029]: osd.2 marked itself down and dead 2024-09-10T18:01:19.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-mon[92029]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:01:19.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-mon[92029]: osdmap e354: 8 total, 7 up, 8 in 2024-09-10T18:01:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-mon[89611]: pgmap v198: 121 pgs: 121 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-09-10T18:01:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-mon[89611]: osd.2 marked itself down and dead 2024-09-10T18:01:19.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-mon[89611]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:01:19.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:18 smithi012 ceph-mon[89611]: osdmap e354: 8 total, 7 up, 8 in 2024-09-10T18:01:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:18 smithi089 ceph-mon[84132]: pgmap v198: 121 pgs: 121 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-09-10T18:01:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:18 smithi089 ceph-mon[84132]: osd.2 marked itself down and dead 2024-09-10T18:01:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:18 smithi089 ceph-mon[84132]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:01:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:18 smithi089 ceph-mon[84132]: osdmap e354: 8 total, 7 up, 8 in 2024-09-10T18:01:19.487 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:19 smithi012 podman[106547]: 2024-09-10 18:01:19.236167511 +0000 UTC m=+0.885731270 container died 3fccc13bd31ded262fc092255635d3cabcc2cb8ef398c1edb15415f682ed8ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-7a853b1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:01:19.687 INFO:tasks.rados.rados.0.smithi012.stdout:1345: done (8 left) 2024-09-10T18:01:19.687 INFO:tasks.rados.rados.0.smithi012.stdout:1346: done (7 left) 2024-09-10T18:01:19.687 INFO:tasks.rados.rados.0.smithi012.stdout:1349: done (6 left) 2024-09-10T18:01:19.688 INFO:tasks.rados.rados.0.smithi012.stdout:1351: done (5 left) 2024-09-10T18:01:19.688 INFO:tasks.rados.rados.0.smithi012.stdout:1352: snap_remove snap 103 2024-09-10T18:01:19.784 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:19 smithi012 podman[106547]: 2024-09-10 18:01:19.576133962 +0000 UTC m=+1.225697674 container cleanup 3fccc13bd31ded262fc092255635d3cabcc2cb8ef398c1edb15415f682ed8ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-7a853b1, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T18:01:19.784 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:19 smithi012 bash[106547]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2 2024-09-10T18:01:20.284 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:19 smithi012 podman[106565]: 2024-09-10 18:01:19.960939552 +0000 UTC m=+0.718735454 container remove 3fccc13bd31ded262fc092255635d3cabcc2cb8ef398c1edb15415f682ed8ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:01:20.684 INFO:tasks.rados.rados.0.smithi012.stdout:1352: done (5 left) 2024-09-10T18:01:20.684 INFO:tasks.rados.rados.0.smithi012.stdout:1353: rollback oid 4 current snap is 142 2024-09-10T18:01:20.684 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 135 2024-09-10T18:01:20.684 INFO:tasks.rados.rados.0.smithi012.stdout:1347: finishing copy_from to smithi01278544-14 2024-09-10T18:01:20.684 INFO:tasks.rados.rados.0.smithi012.stdout:1347: got expected ENOENT (src dne) 2024-09-10T18:01:20.684 INFO:tasks.rados.rados.0.smithi012.stdout:1347: finishing copy_from racing read to smithi01278544-14 2024-09-10T18:01:20.684 INFO:tasks.rados.rados.0.smithi012.stdout:1342: finishing copy_from to smithi01278544-45 2024-09-10T18:01:20.684 INFO:tasks.rados.rados.0.smithi012.stdout:1342: got expected ENOENT (src dne) 2024-09-10T18:01:20.685 INFO:tasks.rados.rados.0.smithi012.stdout:1342: finishing copy_from racing read to smithi01278544-45 2024-09-10T18:01:20.685 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 721 (ObjNum 390 snap 125 seq_num 390) dirty exists 2024-09-10T18:01:20.685 INFO:tasks.rados.rados.0.smithi012.stdout:1343: finishing copy_from racing read to smithi01278544-17 2024-09-10T18:01:20.685 INFO:tasks.rados.rados.0.smithi012.stdout:1343: finishing copy_from to smithi01278544-17 2024-09-10T18:01:20.685 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 207 (ObjNum 391 snap 126 seq_num 391) dirty exists 2024-09-10T18:01:20.685 INFO:tasks.rados.rados.0.smithi012.stdout:1350: expect (ObjNum 380 snap 121 seq_num 380) 2024-09-10T18:01:20.715 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:20 smithi012 ceph-mon[89611]: pgmap v201: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2024-09-10T18:01:20.715 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:20 smithi012 ceph-mon[89611]: osdmap e355: 8 total, 7 up, 8 in 2024-09-10T18:01:20.715 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:20 smithi012 ceph-mon[92029]: pgmap v201: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2024-09-10T18:01:20.716 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:20 smithi012 ceph-mon[92029]: osdmap e355: 8 total, 7 up, 8 in 2024-09-10T18:01:20.716 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:20 smithi012 podman[106651]: 2024-09-10 18:01:20.361659929 +0000 UTC m=+0.017084699 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:01:20.716 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:20 smithi012 podman[106651]: 2024-09-10 18:01:20.470029032 +0000 UTC m=+0.125453832 container create b1a42ad41be92d28db9f529a7d67cc7c07eaa151aa3c6f58f2f3f951583af616 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T18:01:20.810 INFO:tasks.rados.rados.0.smithi012.stdout:1353: finishing rollback tid 0 to smithi01278544-4 2024-09-10T18:01:20.810 INFO:tasks.rados.rados.0.smithi012.stdout:1353: finishing rollback tid 1 to smithi01278544-4 2024-09-10T18:01:20.810 INFO:tasks.rados.rados.0.smithi012.stdout:1353: finishing rollback tid 2 to smithi01278544-4 2024-09-10T18:01:20.810 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 803 (ObjNum 329 snap 105 seq_num 329) dirty exists 2024-09-10T18:01:20.810 INFO:tasks.rados.rados.0.smithi012.stdout:1342: done (5 left) 2024-09-10T18:01:20.811 INFO:tasks.rados.rados.0.smithi012.stdout:1343: done (4 left) 2024-09-10T18:01:20.811 INFO:tasks.rados.rados.0.smithi012.stdout:1347: done (3 left) 2024-09-10T18:01:20.811 INFO:tasks.rados.rados.0.smithi012.stdout:1348: done (2 left) 2024-09-10T18:01:20.811 INFO:tasks.rados.rados.0.smithi012.stdout:1350: done (1 left) 2024-09-10T18:01:20.811 INFO:tasks.rados.rados.0.smithi012.stdout:1353: done (0 left) 2024-09-10T18:01:20.811 INFO:tasks.rados.rados.0.smithi012.stdout:1354: snap_remove snap 127 2024-09-10T18:01:21.035 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:20 smithi012 podman[106651]: 2024-09-10 18:01:20.714551377 +0000 UTC m=+0.369976135 container init b1a42ad41be92d28db9f529a7d67cc7c07eaa151aa3c6f58f2f3f951583af616 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T18:01:21.035 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:20 smithi012 podman[106651]: 2024-09-10 18:01:20.718315703 +0000 UTC m=+0.373740471 container start b1a42ad41be92d28db9f529a7d67cc7c07eaa151aa3c6f58f2f3f951583af616 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T18:01:21.035 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:20 smithi012 podman[106651]: 2024-09-10 18:01:20.822941299 +0000 UTC m=+0.478366074 container attach b1a42ad41be92d28db9f529a7d67cc7c07eaa151aa3c6f58f2f3f951583af616 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T18:01:21.035 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:20 smithi012 podman[106651]: 2024-09-10 18:01:20.912291189 +0000 UTC m=+0.567715957 container died b1a42ad41be92d28db9f529a7d67cc7c07eaa151aa3c6f58f2f3f951583af616 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T18:01:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:20 smithi089 ceph-mon[84132]: pgmap v201: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2024-09-10T18:01:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:20 smithi089 ceph-mon[84132]: osdmap e355: 8 total, 7 up, 8 in 2024-09-10T18:01:21.703 INFO:tasks.rados.rados.0.smithi012.stdout:1354: done (0 left) 2024-09-10T18:01:21.703 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 142 2024-09-10T18:01:21.703 INFO:tasks.rados.rados.0.smithi012.stdout:1355: seq_num 424 ranges {6414336=704512,7118848=491520,7610368=434176,8044544=679936} 2024-09-10T18:01:21.742 INFO:tasks.rados.rados.0.smithi012.stdout:1355: writing smithi01278544-41 from 6414336 to 7118848 tid 1 2024-09-10T18:01:21.745 INFO:tasks.rados.rados.0.smithi012.stdout:1355: writing smithi01278544-41 from 7118848 to 7610368 tid 2 2024-09-10T18:01:21.748 INFO:tasks.rados.rados.0.smithi012.stdout:1355: writing smithi01278544-41 from 7610368 to 8044544 tid 3 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1355: writing smithi01278544-41 from 8044544 to 8724480 tid 4 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1356: copy_from oid 10 from oid 5 current snap is 142 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1355: finishing write tid 1 to smithi01278544-41 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1355: finishing write tid 2 to smithi01278544-41 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1355: finishing write tid 3 to smithi01278544-41 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1357: rollback oid 2 current snap is 142 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 2 to 132 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 142 2024-09-10T18:01:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1358: seq_num 425 ranges {1335296=720896,2056192=778240,2834432=638976,3473408=188416} 2024-09-10T18:01:21.763 INFO:tasks.rados.rados.0.smithi012.stdout:1358: writing smithi01278544-39 from 1335296 to 2056192 tid 1 2024-09-10T18:01:21.767 INFO:tasks.rados.rados.0.smithi012.stdout:1358: writing smithi01278544-39 from 2056192 to 2834432 tid 2 2024-09-10T18:01:21.771 INFO:tasks.rados.rados.0.smithi012.stdout:1358: writing smithi01278544-39 from 2834432 to 3473408 tid 3 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1358: writing smithi01278544-39 from 3473408 to 3661824 tid 4 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 142 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1357: finishing rollback tid 1 to smithi01278544-2 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 0 (ObjNum 65 snap 0 seq_num 3491042128) dirty dne 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1355: finishing write tid 4 to smithi01278544-41 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1355: finishing write tid 5 to smithi01278544-41 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1355: finishing write tid 6 to smithi01278544-41 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1355: oid 41 updating version 0 to 804 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1355: oid 41 updating version 804 to 806 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1355: oid 41 updating version 806 to 808 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1355: oid 41 version 808 is already newer than 807 2024-09-10T18:01:21.773 INFO:tasks.rados.rados.0.smithi012.stdout:1355: oid 41 version 808 is already newer than 805 2024-09-10T18:01:21.774 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 808 (ObjNum 424 snap 142 seq_num 424) dirty exists 2024-09-10T18:01:21.774 INFO:tasks.rados.rados.0.smithi012.stdout:1355: left oid 41 (ObjNum 424 snap 142 seq_num 424) 2024-09-10T18:01:21.774 INFO:tasks.rados.rados.0.smithi012.stdout:1356: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:01:21.774 INFO:tasks.rados.rados.0.smithi012.stdout:1359: seq_num 426 ranges {2162688=737280,2899968=712704,3612672=802816,4415488=90112} 2024-09-10T18:01:21.788 INFO:tasks.rados.rados.0.smithi012.stdout:1359: writing smithi01278544-48 from 2162688 to 2899968 tid 1 2024-09-10T18:01:21.792 INFO:tasks.rados.rados.0.smithi012.stdout:1359: writing smithi01278544-48 from 2899968 to 3612672 tid 2 2024-09-10T18:01:21.797 INFO:tasks.rados.rados.0.smithi012.stdout:1359: writing smithi01278544-48 from 3612672 to 4415488 tid 3 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:1359: writing smithi01278544-48 from 4415488 to 4505600 tid 4 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:1355: done (4 left) 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:1357: done (3 left) 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:1360: setattr oid 36 current snap is 142 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:1356: finishing copy_from to smithi01278544-10 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 525 (ObjNum 416 snap 135 seq_num 416) dirty exists 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:1358: finishing write tid 1 to smithi01278544-39 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:1358: finishing write tid 2 to smithi01278544-39 2024-09-10T18:01:21.798 INFO:tasks.rados.rados.0.smithi012.stdout:1358: finishing write tid 3 to smithi01278544-39 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: finishing write tid 4 to smithi01278544-39 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: finishing write tid 5 to smithi01278544-39 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: finishing write tid 6 to smithi01278544-39 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: oid 39 updating version 0 to 940 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: oid 39 updating version 940 to 942 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: oid 39 updating version 942 to 943 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: oid 39 version 943 is already newer than 941 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: oid 39 version 943 is already newer than 939 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 943 (ObjNum 425 snap 142 seq_num 425) dirty exists 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1358: left oid 39 (ObjNum 425 snap 142 seq_num 425) 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1359: finishing write tid 1 to smithi01278544-48 2024-09-10T18:01:21.799 INFO:tasks.rados.rados.0.smithi012.stdout:1359: finishing write tid 2 to smithi01278544-48 2024-09-10T18:01:21.800 INFO:tasks.rados.rados.0.smithi012.stdout:1356: done (3 left) 2024-09-10T18:01:21.800 INFO:tasks.rados.rados.0.smithi012.stdout:1358: done (2 left) 2024-09-10T18:01:21.800 INFO:tasks.rados.rados.0.smithi012.stdout:1361: snap_remove snap 132 2024-09-10T18:01:21.869 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:21 smithi012 ceph-mon[89611]: osdmap e356: 8 total, 7 up, 8 in 2024-09-10T18:01:21.869 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:21 smithi012 ceph-mon[92029]: osdmap e356: 8 total, 7 up, 8 in 2024-09-10T18:01:21.869 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:21 smithi012 podman[106674]: 2024-09-10 18:01:21.61020967 +0000 UTC m=+0.691705757 container remove b1a42ad41be92d28db9f529a7d67cc7c07eaa151aa3c6f58f2f3f951583af616 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:01:21.870 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:21 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-10T18:01:21.870 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:21 smithi012 systemd[1]: Stopped Ceph osd.2 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:01:21.870 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:21 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.2.service: Consumed 13.337s CPU time. 2024-09-10T18:01:22.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:21 smithi089 ceph-mon[84132]: osdmap e356: 8 total, 7 up, 8 in 2024-09-10T18:01:22.226 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:21 smithi012 systemd[1]: Starting Ceph osd.2 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:01:22.226 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 podman[106770]: 2024-09-10 18:01:21.983723501 +0000 UTC m=+0.016771718 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:01:22.226 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 podman[106770]: 2024-09-10 18:01:22.103002671 +0000 UTC m=+0.136050953 container create 856fc225d1db0080bdb6703879eaefccacea21d1b52a2d1965db919b6dc1e4fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:01:22.478 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 podman[106770]: 2024-09-10 18:01:22.339273981 +0000 UTC m=+0.372322211 container init 856fc225d1db0080bdb6703879eaefccacea21d1b52a2d1965db919b6dc1e4fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:01:22.478 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 podman[106770]: 2024-09-10 18:01:22.342828177 +0000 UTC m=+0.375876394 container start 856fc225d1db0080bdb6703879eaefccacea21d1b52a2d1965db919b6dc1e4fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T18:01:22.478 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 podman[106770]: 2024-09-10 18:01:22.430862149 +0000 UTC m=+0.463910378 container attach 856fc225d1db0080bdb6703879eaefccacea21d1b52a2d1965db919b6dc1e4fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T18:01:22.686 INFO:tasks.rados.rados.0.smithi012.stdout:1361: done (2 left) 2024-09-10T18:01:22.686 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 142 2024-09-10T18:01:22.686 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 730 (ObjNum 65 snap 0 seq_num 3491042128) dirty exists 2024-09-10T18:01:22.686 INFO:tasks.rados.rados.0.smithi012.stdout:1362: seq_num 427 ranges {1908736=761856,2670592=598016,3268608=606208,3874816=401408} 2024-09-10T18:01:22.701 INFO:tasks.rados.rados.0.smithi012.stdout:1362: writing smithi01278544-38 from 1908736 to 2670592 tid 1 2024-09-10T18:01:22.704 INFO:tasks.rados.rados.0.smithi012.stdout:1362: writing smithi01278544-38 from 2670592 to 3268608 tid 2 2024-09-10T18:01:22.708 INFO:tasks.rados.rados.0.smithi012.stdout:1362: writing smithi01278544-38 from 3268608 to 3874816 tid 3 2024-09-10T18:01:22.711 INFO:tasks.rados.rados.0.smithi012.stdout:1362: writing smithi01278544-38 from 3874816 to 4276224 tid 4 2024-09-10T18:01:22.711 INFO:tasks.rados.rados.0.smithi012.stdout:1360: done (2 left) 2024-09-10T18:01:22.711 INFO:tasks.rados.rados.0.smithi012.stdout:1363: setattr oid 24 current snap is 142 2024-09-10T18:01:22.711 INFO:tasks.rados.rados.0.smithi012.stdout:1359: finishing write tid 3 to smithi01278544-48 2024-09-10T18:01:22.711 INFO:tasks.rados.rados.0.smithi012.stdout:1359: finishing write tid 4 to smithi01278544-48 2024-09-10T18:01:22.711 INFO:tasks.rados.rados.0.smithi012.stdout:1359: finishing write tid 5 to smithi01278544-48 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1359: finishing write tid 6 to smithi01278544-48 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1359: oid 48 updating version 0 to 568 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1359: oid 48 updating version 568 to 569 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1359: oid 48 version 569 is already newer than 565 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1359: oid 48 version 569 is already newer than 566 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1359: oid 48 version 569 is already newer than 567 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 569 (ObjNum 426 snap 142 seq_num 426) dirty exists 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1359: left oid 48 (ObjNum 426 snap 142 seq_num 426) 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1362: finishing write tid 1 to smithi01278544-38 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1362: finishing write tid 2 to smithi01278544-38 2024-09-10T18:01:22.712 INFO:tasks.rados.rados.0.smithi012.stdout:1362: finishing write tid 3 to smithi01278544-38 2024-09-10T18:01:22.713 INFO:tasks.rados.rados.0.smithi012.stdout:1359: done (2 left) 2024-09-10T18:01:22.713 INFO:tasks.rados.rados.0.smithi012.stdout:1364: snap_remove snap 139 2024-09-10T18:01:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-mon[89611]: pgmap v204: 121 pgs: 5 active+undersized, 13 stale+active+clean, 1 active+undersized+degraded, 102 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 0 B/s wr, 7 op/s; 4/417 objects degraded (0.959%) 2024-09-10T18:01:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-mon[89611]: Health check failed: Degraded data redundancy: 4/417 objects degraded (0.959%), 1 pg degraded (PG_DEGRADED) 2024-09-10T18:01:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-mon[89611]: osdmap e357: 8 total, 7 up, 8 in 2024-09-10T18:01:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-mon[89611]: osdmap e358: 8 total, 7 up, 8 in 2024-09-10T18:01:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-mon[92029]: pgmap v204: 121 pgs: 5 active+undersized, 13 stale+active+clean, 1 active+undersized+degraded, 102 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 0 B/s wr, 7 op/s; 4/417 objects degraded (0.959%) 2024-09-10T18:01:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-mon[92029]: Health check failed: Degraded data redundancy: 4/417 objects degraded (0.959%), 1 pg degraded (PG_DEGRADED) 2024-09-10T18:01:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-mon[92029]: osdmap e357: 8 total, 7 up, 8 in 2024-09-10T18:01:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-mon[92029]: osdmap e358: 8 total, 7 up, 8 in 2024-09-10T18:01:22.785 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:01:22.785 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 bash[106770]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:01:22.785 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:01:22.785 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 bash[106770]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:01:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:22 smithi089 ceph-mon[84132]: pgmap v204: 121 pgs: 5 active+undersized, 13 stale+active+clean, 1 active+undersized+degraded, 102 active+clean; 216 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 0 B/s wr, 7 op/s; 4/417 objects degraded (0.959%) 2024-09-10T18:01:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:22 smithi089 ceph-mon[84132]: Health check failed: Degraded data redundancy: 4/417 objects degraded (0.959%), 1 pg degraded (PG_DEGRADED) 2024-09-10T18:01:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:22 smithi089 ceph-mon[84132]: osdmap e357: 8 total, 7 up, 8 in 2024-09-10T18:01:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:22 smithi089 ceph-mon[84132]: osdmap e358: 8 total, 7 up, 8 in 2024-09-10T18:01:23.246 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T18:01:23.247 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 bash[106770]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T18:01:23.247 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T18:01:23.247 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:22 smithi012 bash[106770]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T18:01:23.247 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T18:01:23.534 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 bash[106770]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 bash[106770]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 bash[106770]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 bash[106770]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate[106785]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 bash[106770]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-10T18:01:23.535 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:23 smithi012 podman[106770]: 2024-09-10 18:01:23.276597858 +0000 UTC m=+1.309646076 container died 856fc225d1db0080bdb6703879eaefccacea21d1b52a2d1965db919b6dc1e4fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T18:01:23.710 INFO:tasks.rados.rados.0.smithi012.stdout:1364: done (2 left) 2024-09-10T18:01:23.710 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 142 2024-09-10T18:01:23.710 INFO:tasks.rados.rados.0.smithi012.stdout:1362: finishing write tid 4 to smithi01278544-38 2024-09-10T18:01:23.711 INFO:tasks.rados.rados.0.smithi012.stdout:1365: seq_num 428 ranges {0=778240,778240=483328,1261568=409600,1671168=417792,2088960=294912} 2024-09-10T18:01:23.715 INFO:tasks.rados.rados.0.smithi012.stdout:1365: writing smithi01278544-50 from 0 to 778240 tid 1 2024-09-10T18:01:23.718 INFO:tasks.rados.rados.0.smithi012.stdout:1365: writing smithi01278544-50 from 778240 to 1261568 tid 2 2024-09-10T18:01:23.720 INFO:tasks.rados.rados.0.smithi012.stdout:1365: writing smithi01278544-50 from 1261568 to 1671168 tid 3 2024-09-10T18:01:23.723 INFO:tasks.rados.rados.0.smithi012.stdout:1365: writing smithi01278544-50 from 1671168 to 2088960 tid 4 2024-09-10T18:01:23.725 INFO:tasks.rados.rados.0.smithi012.stdout:1365: writing smithi01278544-50 from 2088960 to 2383872 tid 5 2024-09-10T18:01:23.725 INFO:tasks.rados.rados.0.smithi012.stdout:1362: finishing write tid 5 to smithi01278544-38 2024-09-10T18:01:23.725 INFO:tasks.rados.rados.0.smithi012.stdout:1362: finishing write tid 6 to smithi01278544-38 2024-09-10T18:01:23.725 INFO:tasks.rados.rados.0.smithi012.stdout:1362: oid 38 updating version 0 to 573 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1362: oid 38 version 573 is already newer than 571 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1362: oid 38 version 573 is already newer than 570 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1362: oid 38 version 573 is already newer than 572 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1362: oid 38 updating version 573 to 574 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 574 (ObjNum 427 snap 142 seq_num 427) dirty exists 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1362: left oid 38 (ObjNum 427 snap 142 seq_num 427) 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 731 (ObjNum 375 snap 120 seq_num 375) dirty exists 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1365: finishing write tid 1 to smithi01278544-50 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1365: finishing write tid 2 to smithi01278544-50 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1365: finishing write tid 3 to smithi01278544-50 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1362: done (2 left) 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1363: done (1 left) 2024-09-10T18:01:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1366: copy_from oid 14 from oid 8 current snap is 142 2024-09-10T18:01:23.727 INFO:tasks.rados.rados.0.smithi012.stdout:1367: setattr oid 25 current snap is 142 2024-09-10T18:01:23.727 INFO:tasks.rados.rados.0.smithi012.stdout:1368: rollback oid 44 current snap is 142 2024-09-10T18:01:23.727 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 44 to 137 2024-09-10T18:01:23.727 INFO:tasks.rados.rados.0.smithi012.stdout:1369: rollback oid 5 current snap is 142 2024-09-10T18:01:23.728 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 5 to 137 2024-09-10T18:01:23.728 INFO:tasks.rados.rados.0.smithi012.stdout:1370: delete oid 6 current snap is 142 2024-09-10T18:01:23.728 INFO:tasks.rados.rados.0.smithi012.stdout:1365: finishing write tid 4 to smithi01278544-50 2024-09-10T18:01:23.728 INFO:tasks.rados.rados.0.smithi012.stdout:1365: finishing write tid 5 to smithi01278544-50 2024-09-10T18:01:23.728 INFO:tasks.rados.rados.0.smithi012.stdout:1365: finishing write tid 6 to smithi01278544-50 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1369: finishing rollback tid 0 to smithi01278544-5 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1369: finishing rollback tid 1 to smithi01278544-5 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1368: finishing rollback tid 0 to smithi01278544-44 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1365: finishing write tid 7 to smithi01278544-50 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1365: oid 50 updating version 0 to 128 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1365: oid 50 updating version 128 to 131 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1365: oid 50 version 131 is already newer than 129 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1365: oid 50 version 131 is already newer than 130 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1365: oid 50 version 131 is already newer than 127 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:1365: oid 50 version 131 is already newer than 126 2024-09-10T18:01:23.731 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 131 (ObjNum 428 snap 142 seq_num 428) dirty exists 2024-09-10T18:01:23.732 INFO:tasks.rados.rados.0.smithi012.stdout:1365: left oid 50 (ObjNum 428 snap 142 seq_num 428) 2024-09-10T18:01:23.732 INFO:tasks.rados.rados.0.smithi012.stdout:1368: finishing rollback tid 1 to smithi01278544-44 2024-09-10T18:01:23.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 955 (ObjNum 382 snap 121 seq_num 382) dirty exists 2024-09-10T18:01:23.732 INFO:tasks.rados.rados.0.smithi012.stdout:1369: finishing rollback tid 2 to smithi01278544-5 2024-09-10T18:01:23.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 528 (ObjNum 416 snap 135 seq_num 416) dirty exists 2024-09-10T18:01:23.732 INFO:tasks.rados.rados.0.smithi012.stdout:1368: finishing rollback tid 2 to smithi01278544-44 2024-09-10T18:01:23.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 648 (ObjNum 397 snap 129 seq_num 397) dirty exists 2024-09-10T18:01:23.733 INFO:tasks.rados.rados.0.smithi012.stdout:1365: done (5 left) 2024-09-10T18:01:23.733 INFO:tasks.rados.rados.0.smithi012.stdout:1367: done (4 left) 2024-09-10T18:01:23.733 INFO:tasks.rados.rados.0.smithi012.stdout:1368: done (3 left) 2024-09-10T18:01:23.733 INFO:tasks.rados.rados.0.smithi012.stdout:1369: done (2 left) 2024-09-10T18:01:23.733 INFO:tasks.rados.rados.0.smithi012.stdout:1370: done (1 left) 2024-09-10T18:01:23.733 INFO:tasks.rados.rados.0.smithi012.stdout:1371: read oid 47 snap -1 2024-09-10T18:01:23.733 INFO:tasks.rados.rados.0.smithi012.stdout:1371: expect (ObjNum 387 snap 124 seq_num 387) 2024-09-10T18:01:23.734 INFO:tasks.rados.rados.0.smithi012.stdout:1372: delete oid 39 current snap is 142 2024-09-10T18:01:23.735 INFO:tasks.rados.rados.0.smithi012.stdout:1372: done (2 left) 2024-09-10T18:01:23.735 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 142 2024-09-10T18:01:23.735 INFO:tasks.rados.rados.0.smithi012.stdout:1373: seq_num 431 ranges {1761280=24576} 2024-09-10T18:01:23.744 INFO:tasks.rados.rados.0.smithi012.stdout:1373: writing smithi01278544-17 from 1761280 to 1785856 tid 1 2024-09-10T18:01:23.745 INFO:tasks.rados.rados.0.smithi012.stdout:1374: snap_create 2024-09-10T18:01:23.747 INFO:tasks.rados.rados.0.smithi012.stdout:1366: finishing copy_from racing read to smithi01278544-14 2024-09-10T18:01:23.747 INFO:tasks.rados.rados.0.smithi012.stdout:1373: finishing write tid 1 to smithi01278544-17 2024-09-10T18:01:23.747 INFO:tasks.rados.rados.0.smithi012.stdout:1373: finishing write tid 2 to smithi01278544-17 2024-09-10T18:01:23.750 INFO:tasks.rados.rados.0.smithi012.stdout:1373: finishing write tid 3 to smithi01278544-17 2024-09-10T18:01:23.750 INFO:tasks.rados.rados.0.smithi012.stdout:1373: oid 17 updating version 0 to 530 2024-09-10T18:01:23.750 INFO:tasks.rados.rados.0.smithi012.stdout:1373: oid 17 version 530 is already newer than 529 2024-09-10T18:01:23.750 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 530 (ObjNum 431 snap 142 seq_num 431) dirty exists 2024-09-10T18:01:23.750 INFO:tasks.rados.rados.0.smithi012.stdout:1373: left oid 17 (ObjNum 431 snap 142 seq_num 431) 2024-09-10T18:01:23.763 INFO:tasks.rados.rados.0.smithi012.stdout:1366: finishing copy_from to smithi01278544-14 2024-09-10T18:01:23.763 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 620 (ObjNum 418 snap 135 seq_num 418) dirty exists 2024-09-10T18:01:23.778 INFO:tasks.rados.rados.0.smithi012.stdout:1371: expect (ObjNum 387 snap 124 seq_num 387) 2024-09-10T18:01:24.236 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:01:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:01:23] "GET /metrics HTTP/1.1" 200 36289 "" "Prometheus/2.43.0" 2024-09-10T18:01:24.237 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:24 smithi012 podman[106912]: 2024-09-10 18:01:24.018473211 +0000 UTC m=+0.731585217 container remove 856fc225d1db0080bdb6703879eaefccacea21d1b52a2d1965db919b6dc1e4fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T18:01:24.237 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:24 smithi012 podman[106972]: 2024-09-10 18:01:24.134228185 +0000 UTC m=+0.019704312 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:01:24.237 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:24 smithi012 podman[106972]: 2024-09-10 18:01:24.235985781 +0000 UTC m=+0.121461907 container create 0c6517cd615a1aa22e9c15d8d98ad245c8805fc4885339199ac51f5ef7c962ae (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:01:24.509 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:24 smithi012 podman[106972]: 2024-09-10 18:01:24.48027245 +0000 UTC m=+0.365748568 container init 0c6517cd615a1aa22e9c15d8d98ad245c8805fc4885339199ac51f5ef7c962ae (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:01:24.509 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:24 smithi012 podman[106972]: 2024-09-10 18:01:24.484220505 +0000 UTC m=+0.369696631 container start 0c6517cd615a1aa22e9c15d8d98ad245c8805fc4885339199ac51f5ef7c962ae (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-10T18:01:24.716 INFO:tasks.rados.rados.0.smithi012.stdout:1366: done (3 left) 2024-09-10T18:01:24.716 INFO:tasks.rados.rados.0.smithi012.stdout:1371: done (2 left) 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1373: done (1 left) 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1374: done (0 left) 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1375: rollback oid 29 current snap is 143 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 29 to 136 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1376: read oid 47 snap -1 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1376: expect (ObjNum 387 snap 124 seq_num 387) 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1377: read oid 43 snap -1 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1377: expect (ObjNum 392 snap 126 seq_num 392) 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1378: read oid 41 snap -1 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1378: expect (ObjNum 424 snap 142 seq_num 424) 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1379: rmattr oid 8 current snap is 143 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:1379: done (4 left) 2024-09-10T18:01:24.717 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 143 2024-09-10T18:01:24.718 INFO:tasks.rados.rados.0.smithi012.stdout:1380: seq_num 432 ranges {0=40960} 2024-09-10T18:01:24.718 INFO:tasks.rados.rados.0.smithi012.stdout:1380: writing smithi01278544-36 from 0 to 40960 tid 1 2024-09-10T18:01:24.718 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 143 2024-09-10T18:01:24.718 INFO:tasks.rados.rados.0.smithi012.stdout:1381: seq_num 433 ranges {4136960=57344} 2024-09-10T18:01:24.740 INFO:tasks.rados.rados.0.smithi012.stdout:1381: writing smithi01278544-10 from 4136960 to 4194304 tid 1 2024-09-10T18:01:24.740 INFO:tasks.rados.rados.0.smithi012.stdout:1382: snap_create 2024-09-10T18:01:24.741 INFO:tasks.rados.rados.0.smithi012.stdout:1375: finishing rollback tid 0 to smithi01278544-29 2024-09-10T18:01:24.741 INFO:tasks.rados.rados.0.smithi012.stdout:1375: finishing rollback tid 1 to smithi01278544-29 2024-09-10T18:01:24.741 INFO:tasks.rados.rados.0.smithi012.stdout:1375: finishing rollback tid 2 to smithi01278544-29 2024-09-10T18:01:24.741 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 210 (ObjNum 391 snap 126 seq_num 391) dirty exists 2024-09-10T18:01:24.741 INFO:tasks.rados.rados.0.smithi012.stdout:1380: finishing write tid 1 to smithi01278544-36 2024-09-10T18:01:24.741 INFO:tasks.rados.rados.0.smithi012.stdout:1380: finishing write tid 2 to smithi01278544-36 2024-09-10T18:01:24.745 INFO:tasks.rados.rados.0.smithi012.stdout:1381: finishing write tid 1 to smithi01278544-10 2024-09-10T18:01:24.745 INFO:tasks.rados.rados.0.smithi012.stdout:1381: finishing write tid 2 to smithi01278544-10 2024-09-10T18:01:24.746 INFO:tasks.rados.rados.0.smithi012.stdout:1381: finishing write tid 3 to smithi01278544-10 2024-09-10T18:01:24.746 INFO:tasks.rados.rados.0.smithi012.stdout:1381: oid 10 updating version 0 to 959 2024-09-10T18:01:24.747 INFO:tasks.rados.rados.0.smithi012.stdout:1381: oid 10 version 959 is already newer than 958 2024-09-10T18:01:24.747 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 959 (ObjNum 433 snap 143 seq_num 433) dirty exists 2024-09-10T18:01:24.747 INFO:tasks.rados.rados.0.smithi012.stdout:1381: left oid 10 (ObjNum 433 snap 143 seq_num 433) 2024-09-10T18:01:24.749 INFO:tasks.rados.rados.0.smithi012.stdout:1380: finishing write tid 3 to smithi01278544-36 2024-09-10T18:01:24.749 INFO:tasks.rados.rados.0.smithi012.stdout:1380: oid 36 updating version 0 to 733 2024-09-10T18:01:24.749 INFO:tasks.rados.rados.0.smithi012.stdout:1380: oid 36 version 733 is already newer than 732 2024-09-10T18:01:24.749 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 733 (ObjNum 432 snap 143 seq_num 432) dirty exists 2024-09-10T18:01:24.749 INFO:tasks.rados.rados.0.smithi012.stdout:1380: left oid 36 (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:01:24.753 INFO:tasks.rados.rados.0.smithi012.stdout:1378: expect (ObjNum 424 snap 142 seq_num 424) 2024-09-10T18:01:24.784 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-osd[106990]: -- 172.21.15.12:0/2567903021 <== mon.2 v2:172.21.15.12:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5647056aba40 con 0x564706478000 2024-09-10T18:01:24.784 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:24 smithi012 bash[106972]: 0c6517cd615a1aa22e9c15d8d98ad245c8805fc4885339199ac51f5ef7c962ae 2024-09-10T18:01:24.784 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:24 smithi012 systemd[1]: Started Ceph osd.2 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:01:24.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[89611]: pgmap v207: 121 pgs: 25 active+undersized, 2 stale+active+clean, 7 active+undersized+degraded, 87 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 2.0 MiB/s wr, 11 op/s; 37/387 objects degraded (9.561%) 2024-09-10T18:01:24.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[89611]: osdmap e359: 8 total, 7 up, 8 in 2024-09-10T18:01:24.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:24.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:24.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[92029]: pgmap v207: 121 pgs: 25 active+undersized, 2 stale+active+clean, 7 active+undersized+degraded, 87 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 2.0 MiB/s wr, 11 op/s; 37/387 objects degraded (9.561%) 2024-09-10T18:01:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[92029]: osdmap e359: 8 total, 7 up, 8 in 2024-09-10T18:01:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:24 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:24 smithi089 ceph-mon[84132]: pgmap v207: 121 pgs: 25 active+undersized, 2 stale+active+clean, 7 active+undersized+degraded, 87 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.9 MiB/s rd, 2.0 MiB/s wr, 11 op/s; 37/387 objects degraded (9.561%) 2024-09-10T18:01:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:24 smithi089 ceph-mon[84132]: osdmap e359: 8 total, 7 up, 8 in 2024-09-10T18:01:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:24 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:24 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:24 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:25.249 INFO:tasks.rados.rados.0.smithi012.stdout:1376: expect (ObjNum 387 snap 124 seq_num 387) 2024-09-10T18:01:25.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:25 smithi012 ceph-mon[89611]: osdmap e360: 8 total, 7 up, 8 in 2024-09-10T18:01:25.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:25 smithi012 ceph-mon[92029]: osdmap e360: 8 total, 7 up, 8 in 2024-09-10T18:01:25.855 INFO:tasks.rados.rados.0.smithi012.stdout:1377: expect (ObjNum 392 snap 126 seq_num 392) 2024-09-10T18:01:25.997 INFO:tasks.rados.rados.0.smithi012.stdout:1375: done (6 left) 2024-09-10T18:01:25.997 INFO:tasks.rados.rados.0.smithi012.stdout:1376: done (5 left) 2024-09-10T18:01:25.997 INFO:tasks.rados.rados.0.smithi012.stdout:1377: done (4 left) 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:1378: done (3 left) 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:1380: done (2 left) 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:1381: done (1 left) 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:1382: done (0 left) 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 144 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:1383: seq_num 434 ranges {0=73728} 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:1383: writing smithi01278544-9 from 0 to 73728 tid 1 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 144 2024-09-10T18:01:25.998 INFO:tasks.rados.rados.0.smithi012.stdout:1384: seq_num 435 ranges {4194304=90112} 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1384: writing smithi01278544-10 from 4194304 to 4284416 tid 1 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1385: copy_from oid 6 from oid 7 current snap is 144 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1383: finishing write tid 1 to smithi01278544-9 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1383: finishing write tid 2 to smithi01278544-9 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1386: rmattr oid 30 current snap is 144 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1386: done (3 left) 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 144 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1383: finishing write tid 3 to smithi01278544-9 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1383: oid 9 updating version 0 to 576 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1383: oid 9 version 576 is already newer than 575 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 576 (ObjNum 434 snap 144 seq_num 434) dirty exists 2024-09-10T18:01:26.022 INFO:tasks.rados.rados.0.smithi012.stdout:1383: left oid 9 (ObjNum 434 snap 144 seq_num 434) 2024-09-10T18:01:26.023 INFO:tasks.rados.rados.0.smithi012.stdout:1387: seq_num 436 ranges {6971392=106496} 2024-09-10T18:01:26.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:25 smithi089 ceph-mon[84132]: osdmap e360: 8 total, 7 up, 8 in 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1387: writing smithi01278544-4 from 6971392 to 7077888 tid 1 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1383: done (3 left) 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1388: delete oid 18 current snap is 144 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1384: finishing write tid 1 to smithi01278544-10 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1384: finishing write tid 2 to smithi01278544-10 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1384: finishing write tid 3 to smithi01278544-10 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1384: oid 10 updating version 0 to 962 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1384: oid 10 version 962 is already newer than 961 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 962 (ObjNum 435 snap 144 seq_num 435) dirty exists 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1384: left oid 10 (ObjNum 435 snap 144 seq_num 435) 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1385: finishing copy_from racing read to smithi01278544-6 2024-09-10T18:01:26.061 INFO:tasks.rados.rados.0.smithi012.stdout:1385: finishing copy_from to smithi01278544-6 2024-09-10T18:01:26.062 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 60 (ObjNum 410 snap 134 seq_num 410) dirty exists 2024-09-10T18:01:26.066 INFO:tasks.rados.rados.0.smithi012.stdout:1384: done (3 left) 2024-09-10T18:01:26.066 INFO:tasks.rados.rados.0.smithi012.stdout:1385: done (2 left) 2024-09-10T18:01:26.066 INFO:tasks.rados.rados.0.smithi012.stdout:1388: done (1 left) 2024-09-10T18:01:26.067 INFO:tasks.rados.rados.0.smithi012.stdout:1389: read oid 11 snap -1 2024-09-10T18:01:26.067 INFO:tasks.rados.rados.0.smithi012.stdout:1389: expect (ObjNum 373 snap 120 seq_num 373) 2024-09-10T18:01:26.067 INFO:tasks.rados.rados.0.smithi012.stdout:1390: snap_create 2024-09-10T18:01:26.067 INFO:tasks.rados.rados.0.smithi012.stdout:1387: finishing write tid 1 to smithi01278544-4 2024-09-10T18:01:26.068 INFO:tasks.rados.rados.0.smithi012.stdout:1387: finishing write tid 2 to smithi01278544-4 2024-09-10T18:01:26.070 INFO:tasks.rados.rados.0.smithi012.stdout:1387: finishing write tid 3 to smithi01278544-4 2024-09-10T18:01:26.070 INFO:tasks.rados.rados.0.smithi012.stdout:1387: oid 4 updating version 0 to 810 2024-09-10T18:01:26.070 INFO:tasks.rados.rados.0.smithi012.stdout:1387: oid 4 version 810 is already newer than 809 2024-09-10T18:01:26.070 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 810 (ObjNum 436 snap 144 seq_num 436) dirty exists 2024-09-10T18:01:26.070 INFO:tasks.rados.rados.0.smithi012.stdout:1387: left oid 4 (ObjNum 436 snap 144 seq_num 436) 2024-09-10T18:01:26.080 INFO:tasks.rados.rados.0.smithi012.stdout:1389: expect (ObjNum 373 snap 120 seq_num 373) 2024-09-10T18:01:26.720 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:26 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:01:26.387+0000 7f1cc161b640 -1 Falling back to public interface 2024-09-10T18:01:26.725 INFO:tasks.rados.rados.0.smithi012.stdout:1387: done (2 left) 2024-09-10T18:01:26.726 INFO:tasks.rados.rados.0.smithi012.stdout:1389: done (1 left) 2024-09-10T18:01:26.726 INFO:tasks.rados.rados.0.smithi012.stdout:1390: done (0 left) 2024-09-10T18:01:26.726 INFO:tasks.rados.rados.0.smithi012.stdout:1391: snap_remove snap 136 2024-09-10T18:01:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:26 smithi012 ceph-mon[89611]: pgmap v210: 121 pgs: 28 active+undersized, 9 active+undersized+degraded, 84 active+clean; 193 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 17 op/s; 53/390 objects degraded (13.590%) 2024-09-10T18:01:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:26 smithi012 ceph-mon[89611]: osdmap e361: 8 total, 7 up, 8 in 2024-09-10T18:01:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:26 smithi012 ceph-mon[92029]: pgmap v210: 121 pgs: 28 active+undersized, 9 active+undersized+degraded, 84 active+clean; 193 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 17 op/s; 53/390 objects degraded (13.590%) 2024-09-10T18:01:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:26 smithi012 ceph-mon[92029]: osdmap e361: 8 total, 7 up, 8 in 2024-09-10T18:01:27.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:26 smithi089 ceph-mon[84132]: pgmap v210: 121 pgs: 28 active+undersized, 9 active+undersized+degraded, 84 active+clean; 193 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 17 op/s; 53/390 objects degraded (13.590%) 2024-09-10T18:01:27.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:26 smithi089 ceph-mon[84132]: osdmap e361: 8 total, 7 up, 8 in 2024-09-10T18:01:27.682 INFO:tasks.rados.rados.0.smithi012.stdout:1391: done (0 left) 2024-09-10T18:01:27.682 INFO:tasks.rados.rados.0.smithi012.stdout:1392: snap_create 2024-09-10T18:01:28.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:27 smithi012 ceph-mon[89611]: osdmap e362: 8 total, 7 up, 8 in 2024-09-10T18:01:28.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:27 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 53/390 objects degraded (13.590%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:28.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:27 smithi012 ceph-mon[89611]: osdmap e363: 8 total, 7 up, 8 in 2024-09-10T18:01:28.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:27 smithi012 ceph-mon[92029]: osdmap e362: 8 total, 7 up, 8 in 2024-09-10T18:01:28.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:27 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 53/390 objects degraded (13.590%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:28.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:27 smithi012 ceph-mon[92029]: osdmap e363: 8 total, 7 up, 8 in 2024-09-10T18:01:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:27 smithi089 ceph-mon[84132]: osdmap e362: 8 total, 7 up, 8 in 2024-09-10T18:01:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:27 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 53/390 objects degraded (13.590%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:27 smithi089 ceph-mon[84132]: osdmap e363: 8 total, 7 up, 8 in 2024-09-10T18:01:28.685 INFO:tasks.rados.rados.0.smithi012.stdout:1392: done (0 left) 2024-09-10T18:01:28.685 INFO:tasks.rados.rados.0.smithi012.stdout:1393: read oid 28 snap -1 2024-09-10T18:01:28.685 INFO:tasks.rados.rados.0.smithi012.stdout:1393: expect (ObjNum 405 snap 131 seq_num 405) 2024-09-10T18:01:28.685 INFO:tasks.rados.rados.0.smithi012.stdout:1394: read oid 11 snap -1 2024-09-10T18:01:28.685 INFO:tasks.rados.rados.0.smithi012.stdout:1394: expect (ObjNum 373 snap 120 seq_num 373) 2024-09-10T18:01:28.685 INFO:tasks.rados.rados.0.smithi012.stdout:1395: read oid 22 snap -1 2024-09-10T18:01:28.686 INFO:tasks.rados.rados.0.smithi012.stdout:1395: expect (ObjNum 395 snap 127 seq_num 395) 2024-09-10T18:01:28.686 INFO:tasks.rados.rados.0.smithi012.stdout:1396: copy_from oid 16 from oid 12 current snap is 146 2024-09-10T18:01:28.686 INFO:tasks.rados.rados.0.smithi012.stdout:1397: copy_from oid 1 from oid 32 current snap is 146 2024-09-10T18:01:28.686 INFO:tasks.rados.rados.0.smithi012.stdout:1398: delete oid 25 current snap is 146 2024-09-10T18:01:28.697 INFO:tasks.rados.rados.0.smithi012.stdout:1393: expect (ObjNum 405 snap 131 seq_num 405) 2024-09-10T18:01:28.798 INFO:tasks.rados.rados.0.smithi012.stdout:1394: expect (ObjNum 373 snap 120 seq_num 373) 2024-09-10T18:01:28.893 INFO:tasks.rados.rados.0.smithi012.stdout:1397: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:01:28.894 INFO:tasks.rados.rados.0.smithi012.stdout:1397: finishing copy_from to smithi01278544-1 2024-09-10T18:01:28.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 725 (ObjNum 411 snap 134 seq_num 411) dirty exists 2024-09-10T18:01:28.894 INFO:tasks.rados.rados.0.smithi012.stdout:1396: finishing copy_from racing read to smithi01278544-16 2024-09-10T18:01:28.894 INFO:tasks.rados.rados.0.smithi012.stdout:1396: finishing copy_from to smithi01278544-16 2024-09-10T18:01:28.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 833 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-09-10T18:01:28.894 INFO:tasks.rados.rados.0.smithi012.stdout:1395: expect (ObjNum 395 snap 127 seq_num 395) 2024-09-10T18:01:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:28 smithi012 ceph-mon[89611]: pgmap v213: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 198 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 2.8 MiB/s wr, 32 op/s; 58/429 objects degraded (13.520%) 2024-09-10T18:01:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:28 smithi012 ceph-mon[89611]: osdmap e364: 8 total, 7 up, 8 in 2024-09-10T18:01:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:28 smithi012 ceph-mon[92029]: pgmap v213: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 198 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 2.8 MiB/s wr, 32 op/s; 58/429 objects degraded (13.520%) 2024-09-10T18:01:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:28 smithi012 ceph-mon[92029]: osdmap e364: 8 total, 7 up, 8 in 2024-09-10T18:01:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:28 smithi089 ceph-mon[84132]: pgmap v213: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 198 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 2.8 MiB/s wr, 32 op/s; 58/429 objects degraded (13.520%) 2024-09-10T18:01:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:28 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:28 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:29.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:28 smithi089 ceph-mon[84132]: osdmap e364: 8 total, 7 up, 8 in 2024-09-10T18:01:29.266 INFO:tasks.rados.rados.0.smithi012.stdout:1393: done (5 left) 2024-09-10T18:01:29.266 INFO:tasks.rados.rados.0.smithi012.stdout:1394: done (4 left) 2024-09-10T18:01:29.266 INFO:tasks.rados.rados.0.smithi012.stdout:1395: done (3 left) 2024-09-10T18:01:29.266 INFO:tasks.rados.rados.0.smithi012.stdout:1396: done (2 left) 2024-09-10T18:01:29.267 INFO:tasks.rados.rados.0.smithi012.stdout:1397: done (1 left) 2024-09-10T18:01:29.267 INFO:tasks.rados.rados.0.smithi012.stdout:1398: done (0 left) 2024-09-10T18:01:29.267 INFO:tasks.rados.rados.0.smithi012.stdout:1399: read oid 13 snap -1 2024-09-10T18:01:29.267 INFO:tasks.rados.rados.0.smithi012.stdout:1399: expect deleted 2024-09-10T18:01:29.267 INFO:tasks.rados.rados.0.smithi012.stdout:1400: setattr oid 33 current snap is 146 2024-09-10T18:01:29.267 INFO:tasks.rados.rados.0.smithi012.stdout:1399: done (1 left) 2024-09-10T18:01:29.267 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 146 2024-09-10T18:01:29.268 INFO:tasks.rados.rados.0.smithi012.stdout:1401: seq_num 439 ranges {0=155648} 2024-09-10T18:01:29.268 INFO:tasks.rados.rados.0.smithi012.stdout:1401: writing smithi01278544-18 from 0 to 155648 tid 1 2024-09-10T18:01:29.268 INFO:tasks.rados.rados.0.smithi012.stdout:1402: copy_from oid 20 from oid 36 current snap is 146 2024-09-10T18:01:29.268 INFO:tasks.rados.rados.0.smithi012.stdout:1403: read oid 7 snap 134 2024-09-10T18:01:29.269 INFO:tasks.rados.rados.0.smithi012.stdout:1403: expect (ObjNum 410 snap 134 seq_num 410) 2024-09-10T18:01:29.269 INFO:tasks.rados.rados.0.smithi012.stdout:1404: rmattr oid 14 current snap is 146 2024-09-10T18:01:29.269 INFO:tasks.rados.rados.0.smithi012.stdout:1404: done (4 left) 2024-09-10T18:01:29.269 INFO:tasks.rados.rados.0.smithi012.stdout:1405: snap_remove snap 125 2024-09-10T18:01:29.994 INFO:tasks.rados.rados.0.smithi012.stdout:1405: done (4 left) 2024-09-10T18:01:29.994 INFO:tasks.rados.rados.0.smithi012.stdout:1406: snap_create 2024-09-10T18:01:29.994 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 964 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:01:29.994 INFO:tasks.rados.rados.0.smithi012.stdout:1401: finishing write tid 1 to smithi01278544-18 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:1401: finishing write tid 2 to smithi01278544-18 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:1402: finishing copy_from racing read to smithi01278544-20 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:1401: finishing write tid 3 to smithi01278544-18 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:1401: oid 18 updating version 0 to 732 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:1401: oid 18 updating version 732 to 733 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 733 (ObjNum 439 snap 146 seq_num 439) dirty exists 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:1401: left oid 18 (ObjNum 439 snap 146 seq_num 439) 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:1402: finishing copy_from to smithi01278544-20 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 733 (ObjNum 432 snap 143 seq_num 432) dirty exists 2024-09-10T18:01:29.995 INFO:tasks.rados.rados.0.smithi012.stdout:1403: expect (ObjNum 410 snap 134 seq_num 410) 2024-09-10T18:01:30.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:30.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:30.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:29 smithi012 ceph-mon[89611]: pgmap v216: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.5 MiB/s wr, 25 op/s; 58/432 objects degraded (13.426%) 2024-09-10T18:01:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:29 smithi012 ceph-mon[92029]: pgmap v216: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.5 MiB/s wr, 25 op/s; 58/432 objects degraded (13.426%) 2024-09-10T18:01:30.286 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:01:30.083+0000 7f1cc161b640 -1 osd.2 353 log_to_monitors true 2024-09-10T18:01:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:29 smithi089 ceph-mon[84132]: pgmap v216: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.5 MiB/s wr, 25 op/s; 58/432 objects degraded (13.426%) 2024-09-10T18:01:30.998 INFO:tasks.rados.rados.0.smithi012.stdout:1400: done (4 left) 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1401: done (3 left) 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1402: done (2 left) 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1403: done (1 left) 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1406: done (0 left) 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1407: read oid 36 snap -1 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1407: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1408: rmattr oid 28 current snap is 147 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1408: done (1 left) 2024-09-10T18:01:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:1409: snap_create 2024-09-10T18:01:31.002 INFO:tasks.rados.rados.0.smithi012.stdout:1407: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:01:31.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:30 smithi012 ceph-mon[89611]: osdmap e365: 8 total, 7 up, 8 in 2024-09-10T18:01:31.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:30 smithi012 ceph-mon[89611]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T18:01:31.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:30 smithi012 ceph-mon[92029]: osdmap e365: 8 total, 7 up, 8 in 2024-09-10T18:01:31.109 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:30 smithi012 ceph-mon[92029]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T18:01:31.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:30 smithi089 ceph-mon[84132]: osdmap e365: 8 total, 7 up, 8 in 2024-09-10T18:01:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:30 smithi089 ceph-mon[84132]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T18:01:31.771 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:31 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:01:31.483+0000 7f1cb53bd640 -1 osd.2 353 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T18:01:32.014 INFO:tasks.rados.rados.0.smithi012.stdout:1407: done (1 left) 2024-09-10T18:01:32.014 INFO:tasks.rados.rados.0.smithi012.stdout:1409: done (0 left) 2024-09-10T18:01:32.014 INFO:tasks.rados.rados.0.smithi012.stdout:1410: rmattr oid 1 current snap is 148 2024-09-10T18:01:32.014 INFO:tasks.rados.rados.0.smithi012.stdout:1410: done (0 left) 2024-09-10T18:01:32.014 INFO:tasks.rados.rados.0.smithi012.stdout:1411: copy_from oid 37 from oid 15 current snap is 148 2024-09-10T18:01:32.014 INFO:tasks.rados.rados.0.smithi012.stdout:1412: rollback oid 30 current snap is 148 2024-09-10T18:01:32.014 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 142 2024-09-10T18:01:32.014 INFO:tasks.rados.rados.0.smithi012.stdout:1413: snap_create 2024-09-10T18:01:32.021 INFO:tasks.rados.rados.0.smithi012.stdout:1412: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:01:32.021 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 0 (ObjNum 177 snap 0 seq_num 3012793030) dirty dne 2024-09-10T18:01:32.021 INFO:tasks.rados.rados.0.smithi012.stdout:1411: finishing copy_from to smithi01278544-37 2024-09-10T18:01:32.021 INFO:tasks.rados.rados.0.smithi012.stdout:1411: got expected ENOENT (src dne) 2024-09-10T18:01:32.021 INFO:tasks.rados.rados.0.smithi012.stdout:1411: finishing copy_from racing read to smithi01278544-37 2024-09-10T18:01:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[89611]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T18:01:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[89611]: osdmap e366: 8 total, 7 up, 8 in 2024-09-10T18:01:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[89611]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:01:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[89611]: pgmap v219: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 814 KiB/s wr, 1 op/s; 58/435 objects degraded (13.333%) 2024-09-10T18:01:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[89611]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' 2024-09-10T18:01:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[92029]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T18:01:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[92029]: osdmap e366: 8 total, 7 up, 8 in 2024-09-10T18:01:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[92029]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:01:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[92029]: pgmap v219: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 814 KiB/s wr, 1 op/s; 58/435 objects degraded (13.333%) 2024-09-10T18:01:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-mon[92029]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' 2024-09-10T18:01:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:32 smithi089 ceph-mon[84132]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T18:01:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:32 smithi089 ceph-mon[84132]: osdmap e366: 8 total, 7 up, 8 in 2024-09-10T18:01:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:32 smithi089 ceph-mon[84132]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:01:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:32 smithi089 ceph-mon[84132]: pgmap v219: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 814 KiB/s wr, 1 op/s; 58/435 objects degraded (13.333%) 2024-09-10T18:01:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:32 smithi089 ceph-mon[84132]: from='osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130]' entity='osd.2' 2024-09-10T18:01:32.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:01:32 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:01:32.659+0000 7f7a9b686640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-10T18:01:33.018 INFO:tasks.rados.rados.0.smithi012.stdout:1411: done (2 left) 2024-09-10T18:01:33.018 INFO:tasks.rados.rados.0.smithi012.stdout:1412: done (1 left) 2024-09-10T18:01:33.018 INFO:tasks.rados.rados.0.smithi012.stdout:1413: done (0 left) 2024-09-10T18:01:33.018 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 149 2024-09-10T18:01:33.019 INFO:tasks.rados.rados.0.smithi012.stdout:1414: seq_num 440 ranges {0=172032} 2024-09-10T18:01:33.019 INFO:tasks.rados.rados.0.smithi012.stdout:1414: writing smithi01278544-25 from 0 to 172032 tid 1 2024-09-10T18:01:33.019 INFO:tasks.rados.rados.0.smithi012.stdout:1415: delete oid 33 current snap is 149 2024-09-10T18:01:33.029 INFO:tasks.rados.rados.0.smithi012.stdout:1414: finishing write tid 1 to smithi01278544-25 2024-09-10T18:01:33.029 INFO:tasks.rados.rados.0.smithi012.stdout:1414: finishing write tid 2 to smithi01278544-25 2024-09-10T18:01:33.031 INFO:tasks.rados.rados.0.smithi012.stdout:1414: finishing write tid 3 to smithi01278544-25 2024-09-10T18:01:33.031 INFO:tasks.rados.rados.0.smithi012.stdout:1414: oid 25 updating version 0 to 985 2024-09-10T18:01:33.031 INFO:tasks.rados.rados.0.smithi012.stdout:1414: oid 25 updating version 985 to 986 2024-09-10T18:01:33.031 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 986 (ObjNum 440 snap 149 seq_num 440) dirty exists 2024-09-10T18:01:33.031 INFO:tasks.rados.rados.0.smithi012.stdout:1414: left oid 25 (ObjNum 440 snap 149 seq_num 440) 2024-09-10T18:01:33.043 INFO:tasks.rados.rados.0.smithi012.stdout:1414: done (1 left) 2024-09-10T18:01:33.044 INFO:tasks.rados.rados.0.smithi012.stdout:1415: done (0 left) 2024-09-10T18:01:33.044 INFO:tasks.rados.rados.0.smithi012.stdout:1416: snap_create 2024-09-10T18:01:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:01:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130] boot 2024-09-10T18:01:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: osdmap e367: 8 total, 8 up, 8 in 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-10T18:01:33.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 58/435 objects degraded (13.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130] boot 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: osdmap e367: 8 total, 8 up, 8 in 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:01:33.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 58/435 objects degraded (13.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:33.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: osd.2 [v2:172.21.15.12:6818/1808679130,v1:172.21.15.12:6819/1808679130] boot 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: osdmap e367: 8 total, 8 up, 8 in 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:33.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-10T18:01:33.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T18:01:33.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-10T18:01:33.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:33 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 58/435 objects degraded (13.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:34.025 INFO:tasks.rados.rados.0.smithi012.stdout:1416: done (0 left) 2024-09-10T18:01:34.025 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 150 2024-09-10T18:01:34.026 INFO:tasks.rados.rados.0.smithi012.stdout:1417: seq_num 442 ranges {4136960=204800} 2024-09-10T18:01:34.049 INFO:tasks.rados.rados.0.smithi012.stdout:1417: writing smithi01278544-5 from 4136960 to 4341760 tid 1 2024-09-10T18:01:34.049 INFO:tasks.rados.rados.0.smithi012.stdout:1418: rollback oid 11 current snap is 150 2024-09-10T18:01:34.049 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 142 2024-09-10T18:01:34.049 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 150 2024-09-10T18:01:34.049 INFO:tasks.rados.rados.0.smithi012.stdout:1419: seq_num 443 ranges {7077888=221184} 2024-09-10T18:01:34.089 INFO:tasks.rados.rados.0.smithi012.stdout:1419: writing smithi01278544-4 from 7077888 to 7299072 tid 1 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1420: delete oid 30 current snap is 150 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1417: finishing write tid 1 to smithi01278544-5 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1417: finishing write tid 2 to smithi01278544-5 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1418: finishing rollback tid 0 to smithi01278544-11 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1418: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1417: finishing write tid 3 to smithi01278544-5 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1417: oid 5 updating version 0 to 532 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1417: oid 5 version 532 is already newer than 531 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 532 (ObjNum 442 snap 150 seq_num 442) dirty exists 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1417: left oid 5 (ObjNum 442 snap 150 seq_num 442) 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:1418: finishing rollback tid 2 to smithi01278544-11 2024-09-10T18:01:34.090 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 990 (ObjNum 373 snap 120 seq_num 373) dirty exists 2024-09-10T18:01:34.091 INFO:tasks.rados.rados.0.smithi012.stdout:1417: done (3 left) 2024-09-10T18:01:34.091 INFO:tasks.rados.rados.0.smithi012.stdout:1418: done (2 left) 2024-09-10T18:01:34.091 INFO:tasks.rados.rados.0.smithi012.stdout:1420: done (1 left) 2024-09-10T18:01:34.091 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 150 2024-09-10T18:01:34.092 INFO:tasks.rados.rados.0.smithi012.stdout:1421: seq_num 445 ranges {0=253952} 2024-09-10T18:01:34.093 INFO:tasks.rados.rados.0.smithi012.stdout:1421: writing smithi01278544-15 from 0 to 253952 tid 1 2024-09-10T18:01:34.093 INFO:tasks.rados.rados.0.smithi012.stdout:1422: delete oid 34 current snap is 150 2024-09-10T18:01:34.095 INFO:tasks.rados.rados.0.smithi012.stdout:1422: done (2 left) 2024-09-10T18:01:34.095 INFO:tasks.rados.rados.0.smithi012.stdout:1423: rollback oid 27 current snap is 150 2024-09-10T18:01:34.095 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 147 2024-09-10T18:01:34.095 INFO:tasks.rados.rados.0.smithi012.stdout:1424: snap_create 2024-09-10T18:01:34.095 INFO:tasks.rados.rados.0.smithi012.stdout:1423: finishing rollback tid 1 to smithi01278544-27 2024-09-10T18:01:34.095 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 0 (ObjNum 65 snap 0 seq_num 0) dirty dne 2024-09-10T18:01:34.098 INFO:tasks.rados.rados.0.smithi012.stdout:1421: finishing write tid 1 to smithi01278544-15 2024-09-10T18:01:34.098 INFO:tasks.rados.rados.0.smithi012.stdout:1421: finishing write tid 2 to smithi01278544-15 2024-09-10T18:01:34.098 INFO:tasks.rados.rados.0.smithi012.stdout:1419: finishing write tid 1 to smithi01278544-4 2024-09-10T18:01:34.098 INFO:tasks.rados.rados.0.smithi012.stdout:1419: finishing write tid 2 to smithi01278544-4 2024-09-10T18:01:34.099 INFO:tasks.rados.rados.0.smithi012.stdout:1421: finishing write tid 3 to smithi01278544-15 2024-09-10T18:01:34.099 INFO:tasks.rados.rados.0.smithi012.stdout:1421: oid 15 updating version 0 to 734 2024-09-10T18:01:34.099 INFO:tasks.rados.rados.0.smithi012.stdout:1421: oid 15 updating version 734 to 735 2024-09-10T18:01:34.099 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 735 (ObjNum 445 snap 150 seq_num 445) dirty exists 2024-09-10T18:01:34.099 INFO:tasks.rados.rados.0.smithi012.stdout:1421: left oid 15 (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:01:34.099 INFO:tasks.rados.rados.0.smithi012.stdout:1419: finishing write tid 3 to smithi01278544-4 2024-09-10T18:01:34.100 INFO:tasks.rados.rados.0.smithi012.stdout:1419: oid 4 updating version 0 to 811 2024-09-10T18:01:34.100 INFO:tasks.rados.rados.0.smithi012.stdout:1419: oid 4 updating version 811 to 812 2024-09-10T18:01:34.100 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 812 (ObjNum 443 snap 150 seq_num 443) dirty exists 2024-09-10T18:01:34.100 INFO:tasks.rados.rados.0.smithi012.stdout:1419: left oid 4 (ObjNum 443 snap 150 seq_num 443) 2024-09-10T18:01:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:34 smithi012 ceph-mon[89611]: pgmap v221: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 796 KiB/s wr, 12 op/s; 58/432 objects degraded (13.426%) 2024-09-10T18:01:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:34 smithi012 ceph-mon[89611]: osdmap e368: 8 total, 8 up, 8 in 2024-09-10T18:01:34.285 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:01:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:01:33] "GET /metrics HTTP/1.1" 200 36142 "" "Prometheus/2.43.0" 2024-09-10T18:01:34.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:34 smithi012 ceph-mon[92029]: pgmap v221: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 796 KiB/s wr, 12 op/s; 58/432 objects degraded (13.426%) 2024-09-10T18:01:34.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:34 smithi012 ceph-mon[92029]: osdmap e368: 8 total, 8 up, 8 in 2024-09-10T18:01:34.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:34 smithi089 ceph-mon[84132]: pgmap v221: 121 pgs: 27 active+undersized, 10 active+undersized+degraded, 84 active+clean; 201 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 796 KiB/s wr, 12 op/s; 58/432 objects degraded (13.426%) 2024-09-10T18:01:34.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:34 smithi089 ceph-mon[84132]: osdmap e368: 8 total, 8 up, 8 in 2024-09-10T18:01:35.030 INFO:tasks.rados.rados.0.smithi012.stdout:1419: done (3 left) 2024-09-10T18:01:35.030 INFO:tasks.rados.rados.0.smithi012.stdout:1421: done (2 left) 2024-09-10T18:01:35.031 INFO:tasks.rados.rados.0.smithi012.stdout:1423: done (1 left) 2024-09-10T18:01:35.031 INFO:tasks.rados.rados.0.smithi012.stdout:1424: done (0 left) 2024-09-10T18:01:35.031 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 151 2024-09-10T18:01:35.031 INFO:tasks.rados.rados.0.smithi012.stdout:1425: seq_num 447 ranges {4276224=294912} 2024-09-10T18:01:35.055 INFO:tasks.rados.rados.0.smithi012.stdout:1425: writing smithi01278544-38 from 4276224 to 4571136 tid 1 2024-09-10T18:01:35.055 INFO:tasks.rados.rados.0.smithi012.stdout:1426: rollback oid 50 current snap is 151 2024-09-10T18:01:35.055 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 140 2024-09-10T18:01:35.056 INFO:tasks.rados.rados.0.smithi012.stdout:1427: setattr oid 41 current snap is 151 2024-09-10T18:01:35.057 INFO:tasks.rados.rados.0.smithi012.stdout:1428: rollback oid 7 current snap is 151 2024-09-10T18:01:35.057 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 7 to 142 2024-09-10T18:01:35.057 INFO:tasks.rados.rados.0.smithi012.stdout:1429: snap_remove snap 135 2024-09-10T18:01:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:35 smithi012 ceph-mon[89611]: osdmap e369: 8 total, 8 up, 8 in 2024-09-10T18:01:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:35 smithi012 ceph-mon[92029]: osdmap e369: 8 total, 8 up, 8 in 2024-09-10T18:01:35.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:35 smithi089 ceph-mon[84132]: osdmap e369: 8 total, 8 up, 8 in 2024-09-10T18:01:36.033 INFO:tasks.rados.rados.0.smithi012.stdout:1429: done (4 left) 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1430: rollback oid 14 current snap is 151 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 14 to 140 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1428: finishing rollback tid 0 to smithi01278544-7 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1426: finishing rollback tid 0 to smithi01278544-50 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1428: finishing rollback tid 1 to smithi01278544-7 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1425: finishing write tid 1 to smithi01278544-38 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1428: finishing rollback tid 2 to smithi01278544-7 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 78 (ObjNum 410 snap 134 seq_num 410) dirty exists 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 813 (ObjNum 424 snap 142 seq_num 424) dirty exists 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1427: done (4 left) 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1428: done (3 left) 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1431: delete oid 3 current snap is 151 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:1426: finishing rollback tid 1 to smithi01278544-50 2024-09-10T18:01:36.034 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 134 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:01:36.035 INFO:tasks.rados.rados.0.smithi012.stdout:1425: finishing write tid 2 to smithi01278544-38 2024-09-10T18:01:36.035 INFO:tasks.rados.rados.0.smithi012.stdout:1425: finishing write tid 3 to smithi01278544-38 2024-09-10T18:01:36.035 INFO:tasks.rados.rados.0.smithi012.stdout:1425: oid 38 updating version 0 to 727 2024-09-10T18:01:36.035 INFO:tasks.rados.rados.0.smithi012.stdout:1425: oid 38 version 727 is already newer than 726 2024-09-10T18:01:36.035 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 727 (ObjNum 447 snap 151 seq_num 447) dirty exists 2024-09-10T18:01:36.035 INFO:tasks.rados.rados.0.smithi012.stdout:1425: left oid 38 (ObjNum 447 snap 151 seq_num 447) 2024-09-10T18:01:36.038 INFO:tasks.rados.rados.0.smithi012.stdout:1425: done (3 left) 2024-09-10T18:01:36.038 INFO:tasks.rados.rados.0.smithi012.stdout:1426: done (2 left) 2024-09-10T18:01:36.038 INFO:tasks.rados.rados.0.smithi012.stdout:1431: done (1 left) 2024-09-10T18:01:36.038 INFO:tasks.rados.rados.0.smithi012.stdout:1432: snap_remove snap 149 2024-09-10T18:01:36.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:36 smithi012 ceph-mon[89611]: pgmap v224: 121 pgs: 24 active+undersized, 10 active+undersized+degraded, 87 active+clean; 205 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 12 op/s; 58/435 objects degraded (13.333%) 2024-09-10T18:01:36.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:36 smithi012 ceph-mon[89611]: osdmap e370: 8 total, 8 up, 8 in 2024-09-10T18:01:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:36 smithi012 ceph-mon[92029]: pgmap v224: 121 pgs: 24 active+undersized, 10 active+undersized+degraded, 87 active+clean; 205 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 12 op/s; 58/435 objects degraded (13.333%) 2024-09-10T18:01:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:36 smithi012 ceph-mon[92029]: osdmap e370: 8 total, 8 up, 8 in 2024-09-10T18:01:36.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:36 smithi089 ceph-mon[84132]: pgmap v224: 121 pgs: 24 active+undersized, 10 active+undersized+degraded, 87 active+clean; 205 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.0 MiB/s wr, 12 op/s; 58/435 objects degraded (13.333%) 2024-09-10T18:01:36.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:36 smithi089 ceph-mon[84132]: osdmap e370: 8 total, 8 up, 8 in 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1430: finishing rollback tid 0 to smithi01278544-14 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1430: finishing rollback tid 1 to smithi01278544-14 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1430: finishing rollback tid 2 to smithi01278544-14 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 994 (ObjNum 363 snap 117 seq_num 363) dirty exists 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1430: done (1 left) 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1432: done (0 left) 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1433: read oid 12 snap 147 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1433: expect (ObjNum -798462864 snap 22079 seq_num 3496776928) 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1434: read oid 21 snap -1 2024-09-10T18:01:37.050 INFO:tasks.rados.rados.0.smithi012.stdout:1434: expect (ObjNum 393 snap 127 seq_num 393) 2024-09-10T18:01:37.051 INFO:tasks.rados.rados.0.smithi012.stdout:1435: copy_from oid 29 from oid 33 current snap is 151 2024-09-10T18:01:37.051 INFO:tasks.rados.rados.0.smithi012.stdout:1436: snap_create 2024-09-10T18:01:37.052 INFO:tasks.rados.rados.0.smithi012.stdout:1433: expect (ObjNum -798462864 snap 22079 seq_num 3496776928) 2024-09-10T18:01:37.055 INFO:tasks.rados.rados.0.smithi012.stdout:1435: finishing copy_from to smithi01278544-29 2024-09-10T18:01:37.055 INFO:tasks.rados.rados.0.smithi012.stdout:1435: got expected ENOENT (src dne) 2024-09-10T18:01:37.055 INFO:tasks.rados.rados.0.smithi012.stdout:1435: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:01:37.062 INFO:tasks.rados.rados.0.smithi012.stdout:1434: expect (ObjNum 393 snap 127 seq_num 393) 2024-09-10T18:01:37.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:37 smithi012 ceph-mon[89611]: osdmap e371: 8 total, 8 up, 8 in 2024-09-10T18:01:37.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:37 smithi012 ceph-mon[92029]: osdmap e371: 8 total, 8 up, 8 in 2024-09-10T18:01:37.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:37 smithi089 ceph-mon[84132]: osdmap e371: 8 total, 8 up, 8 in 2024-09-10T18:01:37.688 INFO:tasks.rados.rados.0.smithi012.stdout:1433: done (3 left) 2024-09-10T18:01:37.688 INFO:tasks.rados.rados.0.smithi012.stdout:1434: done (2 left) 2024-09-10T18:01:37.688 INFO:tasks.rados.rados.0.smithi012.stdout:1435: done (1 left) 2024-09-10T18:01:37.688 INFO:tasks.rados.rados.0.smithi012.stdout:1436: done (0 left) 2024-09-10T18:01:37.689 INFO:tasks.rados.rados.0.smithi012.stdout:1437: snap_remove snap 145 2024-09-10T18:01:38.339 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[89611]: pgmap v227: 121 pgs: 121 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.2 MiB/s wr, 11 op/s; 8.7 MiB/s, 3 objects/s recovering 2024-09-10T18:01:38.339 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[89611]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/435 objects degraded (13.333%), 10 pgs degraded) 2024-09-10T18:01:38.339 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:01:38.339 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[89611]: osdmap e372: 8 total, 8 up, 8 in 2024-09-10T18:01:38.339 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[89611]: osdmap e373: 8 total, 8 up, 8 in 2024-09-10T18:01:38.340 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[92029]: pgmap v227: 121 pgs: 121 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.2 MiB/s wr, 11 op/s; 8.7 MiB/s, 3 objects/s recovering 2024-09-10T18:01:38.340 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[92029]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/435 objects degraded (13.333%), 10 pgs degraded) 2024-09-10T18:01:38.340 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:01:38.340 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[92029]: osdmap e372: 8 total, 8 up, 8 in 2024-09-10T18:01:38.340 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:38 smithi012 ceph-mon[92029]: osdmap e373: 8 total, 8 up, 8 in 2024-09-10T18:01:38.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:38 smithi089 ceph-mon[84132]: pgmap v227: 121 pgs: 121 active+clean; 194 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.2 MiB/s wr, 11 op/s; 8.7 MiB/s, 3 objects/s recovering 2024-09-10T18:01:38.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:38 smithi089 ceph-mon[84132]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/435 objects degraded (13.333%), 10 pgs degraded) 2024-09-10T18:01:38.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:38 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:01:38.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:38 smithi089 ceph-mon[84132]: osdmap e372: 8 total, 8 up, 8 in 2024-09-10T18:01:38.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:38 smithi089 ceph-mon[84132]: osdmap e373: 8 total, 8 up, 8 in 2024-09-10T18:01:38.688 INFO:tasks.rados.rados.0.smithi012.stdout:1437: done (0 left) 2024-09-10T18:01:38.688 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 152 2024-09-10T18:01:38.688 INFO:tasks.rados.rados.0.smithi012.stdout:1438: seq_num 449 ranges {0=327680} 2024-09-10T18:01:38.690 INFO:tasks.rados.rados.0.smithi012.stdout:1438: writing smithi01278544-2 from 0 to 327680 tid 1 2024-09-10T18:01:38.690 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 152 2024-09-10T18:01:38.690 INFO:tasks.rados.rados.0.smithi012.stdout:1439: seq_num 450 ranges {4505600=344064} 2024-09-10T18:01:38.717 INFO:tasks.rados.rados.0.smithi012.stdout:1439: writing smithi01278544-48 from 4505600 to 4849664 tid 1 2024-09-10T18:01:38.717 INFO:tasks.rados.rados.0.smithi012.stdout:1440: rmattr oid 21 current snap is 152 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:1438: finishing write tid 1 to smithi01278544-2 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:1438: finishing write tid 2 to smithi01278544-2 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 152 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:1438: finishing write tid 3 to smithi01278544-2 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:1438: oid 2 updating version 0 to 737 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:1438: oid 2 version 737 is already newer than 736 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 737 (ObjNum 449 snap 152 seq_num 449) dirty exists 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:1438: left oid 2 (ObjNum 449 snap 152 seq_num 449) 2024-09-10T18:01:38.718 INFO:tasks.rados.rados.0.smithi012.stdout:1441: seq_num 451 ranges {3153920=360448} 2024-09-10T18:01:38.737 INFO:tasks.rados.rados.0.smithi012.stdout:1441: writing smithi01278544-6 from 3153920 to 3514368 tid 1 2024-09-10T18:01:38.737 INFO:tasks.rados.rados.0.smithi012.stdout:1438: done (3 left) 2024-09-10T18:01:38.737 INFO:tasks.rados.rados.0.smithi012.stdout:1442: delete oid 23 current snap is 152 2024-09-10T18:01:38.737 INFO:tasks.rados.rados.0.smithi012.stdout:1439: finishing write tid 1 to smithi01278544-48 2024-09-10T18:01:38.737 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 722 (ObjNum 393 snap 127 seq_num 393) dirty exists 2024-09-10T18:01:38.737 INFO:tasks.rados.rados.0.smithi012.stdout:1439: finishing write tid 2 to smithi01278544-48 2024-09-10T18:01:38.737 INFO:tasks.rados.rados.0.smithi012.stdout:1439: finishing write tid 3 to smithi01278544-48 2024-09-10T18:01:38.737 INFO:tasks.rados.rados.0.smithi012.stdout:1439: oid 48 updating version 0 to 729 2024-09-10T18:01:38.738 INFO:tasks.rados.rados.0.smithi012.stdout:1439: oid 48 version 729 is already newer than 728 2024-09-10T18:01:38.738 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 729 (ObjNum 450 snap 152 seq_num 450) dirty exists 2024-09-10T18:01:38.738 INFO:tasks.rados.rados.0.smithi012.stdout:1439: left oid 48 (ObjNum 450 snap 152 seq_num 450) 2024-09-10T18:01:38.740 INFO:tasks.rados.rados.0.smithi012.stdout:1439: done (3 left) 2024-09-10T18:01:38.740 INFO:tasks.rados.rados.0.smithi012.stdout:1440: done (2 left) 2024-09-10T18:01:38.740 INFO:tasks.rados.rados.0.smithi012.stdout:1442: done (1 left) 2024-09-10T18:01:38.740 INFO:tasks.rados.rados.0.smithi012.stdout:1443: snap_remove snap 134 2024-09-10T18:01:39.697 INFO:tasks.rados.rados.0.smithi012.stdout:1441: finishing write tid 1 to smithi01278544-6 2024-09-10T18:01:39.697 INFO:tasks.rados.rados.0.smithi012.stdout:1441: finishing write tid 2 to smithi01278544-6 2024-09-10T18:01:39.697 INFO:tasks.rados.rados.0.smithi012.stdout:1441: finishing write tid 3 to smithi01278544-6 2024-09-10T18:01:39.697 INFO:tasks.rados.rados.0.smithi012.stdout:1441: oid 6 updating version 0 to 835 2024-09-10T18:01:39.698 INFO:tasks.rados.rados.0.smithi012.stdout:1441: oid 6 version 835 is already newer than 834 2024-09-10T18:01:39.698 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 835 (ObjNum 451 snap 152 seq_num 451) dirty exists 2024-09-10T18:01:39.698 INFO:tasks.rados.rados.0.smithi012.stdout:1441: left oid 6 (ObjNum 451 snap 152 seq_num 451) 2024-09-10T18:01:39.698 INFO:tasks.rados.rados.0.smithi012.stdout:1441: done (1 left) 2024-09-10T18:01:39.698 INFO:tasks.rados.rados.0.smithi012.stdout:1443: done (0 left) 2024-09-10T18:01:39.698 INFO:tasks.rados.rados.0.smithi012.stdout:1444: setattr oid 23 current snap is 152 2024-09-10T18:01:39.699 INFO:tasks.rados.rados.0.smithi012.stdout:1445: copy_from oid 42 from oid 28 current snap is 152 2024-09-10T18:01:39.699 INFO:tasks.rados.rados.0.smithi012.stdout:1446: read oid 26 snap -1 2024-09-10T18:01:39.699 INFO:tasks.rados.rados.0.smithi012.stdout:1446: expect deleted 2024-09-10T18:01:39.699 INFO:tasks.rados.rados.0.smithi012.stdout:1447: read oid 35 snap -1 2024-09-10T18:01:39.699 INFO:tasks.rados.rados.0.smithi012.stdout:1447: expect (ObjNum 421 snap 140 seq_num 421) 2024-09-10T18:01:39.700 INFO:tasks.rados.rados.0.smithi012.stdout:1448: rollback oid 3 current snap is 152 2024-09-10T18:01:39.700 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 142 2024-09-10T18:01:39.700 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 152 2024-09-10T18:01:39.700 INFO:tasks.rados.rados.0.smithi012.stdout:1449: seq_num 453 ranges {4177920=393216} 2024-09-10T18:01:39.728 INFO:tasks.rados.rados.0.smithi012.stdout:1449: writing smithi01278544-1 from 4177920 to 4571136 tid 1 2024-09-10T18:01:39.728 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 152 2024-09-10T18:01:39.728 INFO:tasks.rados.rados.0.smithi012.stdout:1450: seq_num 454 ranges {2711552=409600} 2024-09-10T18:01:39.745 INFO:tasks.rados.rados.0.smithi012.stdout:1450: writing smithi01278544-11 from 2711552 to 3121152 tid 1 2024-09-10T18:01:39.745 INFO:tasks.rados.rados.0.smithi012.stdout:1451: copy_from oid 19 from oid 21 current snap is 152 2024-09-10T18:01:39.746 INFO:tasks.rados.rados.0.smithi012.stdout:1448: finishing rollback tid 1 to smithi01278544-3 2024-09-10T18:01:39.746 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 641 (ObjNum 609 snap 0 seq_num 3496671960) dirty dne 2024-09-10T18:01:39.746 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 724 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:01:39.746 INFO:tasks.rados.rados.0.smithi012.stdout:1444: done (7 left) 2024-09-10T18:01:39.746 INFO:tasks.rados.rados.0.smithi012.stdout:1446: done (6 left) 2024-09-10T18:01:39.746 INFO:tasks.rados.rados.0.smithi012.stdout:1448: done (5 left) 2024-09-10T18:01:39.746 INFO:tasks.rados.rados.0.smithi012.stdout:1452: snap_remove snap 122 2024-09-10T18:01:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:39 smithi012 ceph-mon[89611]: osdmap e374: 8 total, 8 up, 8 in 2024-09-10T18:01:40.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:39 smithi012 ceph-mon[92029]: osdmap e374: 8 total, 8 up, 8 in 2024-09-10T18:01:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:39 smithi089 ceph-mon[84132]: osdmap e374: 8 total, 8 up, 8 in 2024-09-10T18:01:40.701 INFO:tasks.rados.rados.0.smithi012.stdout:1452: done (5 left) 2024-09-10T18:01:40.702 INFO:tasks.rados.rados.0.smithi012.stdout:1453: snap_create 2024-09-10T18:01:40.702 INFO:tasks.rados.rados.0.smithi012.stdout:1445: finishing copy_from racing read to smithi01278544-42 2024-09-10T18:01:40.702 INFO:tasks.rados.rados.0.smithi012.stdout:1445: finishing copy_from to smithi01278544-42 2024-09-10T18:01:40.702 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 308 (ObjNum 405 snap 131 seq_num 405) dirty exists 2024-09-10T18:01:40.702 INFO:tasks.rados.rados.0.smithi012.stdout:1447: expect (ObjNum 421 snap 140 seq_num 421) 2024-09-10T18:01:40.891 INFO:tasks.rados.rados.0.smithi012.stdout:1449: finishing write tid 1 to smithi01278544-1 2024-09-10T18:01:40.891 INFO:tasks.rados.rados.0.smithi012.stdout:1449: finishing write tid 2 to smithi01278544-1 2024-09-10T18:01:40.891 INFO:tasks.rados.rados.0.smithi012.stdout:1449: finishing write tid 3 to smithi01278544-1 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1449: oid 1 updating version 0 to 731 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1449: oid 1 version 731 is already newer than 730 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 731 (ObjNum 453 snap 152 seq_num 453) dirty exists 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1449: left oid 1 (ObjNum 453 snap 152 seq_num 453) 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1450: finishing write tid 1 to smithi01278544-11 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1450: finishing write tid 2 to smithi01278544-11 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1450: finishing write tid 3 to smithi01278544-11 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1450: oid 11 updating version 0 to 1021 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1450: oid 11 version 1021 is already newer than 1020 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1021 (ObjNum 454 snap 152 seq_num 454) dirty exists 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1450: left oid 11 (ObjNum 454 snap 152 seq_num 454) 2024-09-10T18:01:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1451: finishing copy_from racing read to smithi01278544-19 2024-09-10T18:01:40.893 INFO:tasks.rados.rados.0.smithi012.stdout:1451: finishing copy_from to smithi01278544-19 2024-09-10T18:01:40.893 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 722 (ObjNum 393 snap 127 seq_num 393) dirty exists 2024-09-10T18:01:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:40 smithi012 ceph-mon[89611]: pgmap v231: 121 pgs: 121 active+clean; 195 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 281 KiB/s wr, 11 op/s; 8.7 MiB/s, 4 objects/s recovering 2024-09-10T18:01:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:40 smithi012 ceph-mon[89611]: osdmap e375: 8 total, 8 up, 8 in 2024-09-10T18:01:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:40 smithi012 ceph-mon[92029]: pgmap v231: 121 pgs: 121 active+clean; 195 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 281 KiB/s wr, 11 op/s; 8.7 MiB/s, 4 objects/s recovering 2024-09-10T18:01:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:40 smithi012 ceph-mon[92029]: osdmap e375: 8 total, 8 up, 8 in 2024-09-10T18:01:41.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:40 smithi089 ceph-mon[84132]: pgmap v231: 121 pgs: 121 active+clean; 195 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 281 KiB/s wr, 11 op/s; 8.7 MiB/s, 4 objects/s recovering 2024-09-10T18:01:41.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:40 smithi089 ceph-mon[84132]: osdmap e375: 8 total, 8 up, 8 in 2024-09-10T18:01:41.706 INFO:tasks.rados.rados.0.smithi012.stdout:1445: done (5 left) 2024-09-10T18:01:41.707 INFO:tasks.rados.rados.0.smithi012.stdout:1447: done (4 left) 2024-09-10T18:01:41.707 INFO:tasks.rados.rados.0.smithi012.stdout:1449: done (3 left) 2024-09-10T18:01:41.707 INFO:tasks.rados.rados.0.smithi012.stdout:1450: done (2 left) 2024-09-10T18:01:41.707 INFO:tasks.rados.rados.0.smithi012.stdout:1451: done (1 left) 2024-09-10T18:01:41.707 INFO:tasks.rados.rados.0.smithi012.stdout:1453: done (0 left) 2024-09-10T18:01:41.707 INFO:tasks.rados.rados.0.smithi012.stdout:1454: delete oid 39 current snap is 153 2024-09-10T18:01:41.709 INFO:tasks.rados.rados.0.smithi012.stdout:1454: done (0 left) 2024-09-10T18:01:41.709 INFO:tasks.rados.rados.0.smithi012.stdout:1455: snap_remove snap 144 2024-09-10T18:01:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:41 smithi012 ceph-mon[89611]: osdmap e376: 8 total, 8 up, 8 in 2024-09-10T18:01:42.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:41 smithi012 ceph-mon[92029]: osdmap e376: 8 total, 8 up, 8 in 2024-09-10T18:01:42.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:41 smithi089 ceph-mon[84132]: osdmap e376: 8 total, 8 up, 8 in 2024-09-10T18:01:42.686 INFO:tasks.rados.rados.0.smithi012.stdout:1455: done (0 left) 2024-09-10T18:01:42.686 INFO:tasks.rados.rados.0.smithi012.stdout:1456: snap_remove snap 143 2024-09-10T18:01:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:42 smithi012 ceph-mon[89611]: pgmap v234: 121 pgs: 121 active+clean; 195 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 257 B/s rd, 73 KiB/s wr, 0 op/s 2024-09-10T18:01:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:42 smithi012 ceph-mon[89611]: osdmap e377: 8 total, 8 up, 8 in 2024-09-10T18:01:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:42 smithi012 ceph-mon[89611]: osdmap e378: 8 total, 8 up, 8 in 2024-09-10T18:01:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:42 smithi012 ceph-mon[92029]: pgmap v234: 121 pgs: 121 active+clean; 195 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 257 B/s rd, 73 KiB/s wr, 0 op/s 2024-09-10T18:01:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:42 smithi012 ceph-mon[92029]: osdmap e377: 8 total, 8 up, 8 in 2024-09-10T18:01:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:42 smithi012 ceph-mon[92029]: osdmap e378: 8 total, 8 up, 8 in 2024-09-10T18:01:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:42 smithi089 ceph-mon[84132]: pgmap v234: 121 pgs: 121 active+clean; 195 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 257 B/s rd, 73 KiB/s wr, 0 op/s 2024-09-10T18:01:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:42 smithi089 ceph-mon[84132]: osdmap e377: 8 total, 8 up, 8 in 2024-09-10T18:01:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:42 smithi089 ceph-mon[84132]: osdmap e378: 8 total, 8 up, 8 in 2024-09-10T18:01:43.689 INFO:tasks.rados.rados.0.smithi012.stdout:1456: done (0 left) 2024-09-10T18:01:43.689 INFO:tasks.rados.rados.0.smithi012.stdout:1457: rollback oid 19 current snap is 153 2024-09-10T18:01:43.690 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 19 to 150 2024-09-10T18:01:43.690 INFO:tasks.rados.rados.0.smithi012.stdout:1458: rmattr oid 33 current snap is 153 2024-09-10T18:01:43.690 INFO:tasks.rados.rados.0.smithi012.stdout:1458: done (1 left) 2024-09-10T18:01:43.690 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 153 2024-09-10T18:01:43.690 INFO:tasks.rados.rados.0.smithi012.stdout:1459: seq_num 456 ranges {0=442368} 2024-09-10T18:01:43.692 INFO:tasks.rados.rados.0.smithi012.stdout:1459: writing smithi01278544-23 from 0 to 442368 tid 1 2024-09-10T18:01:43.693 INFO:tasks.rados.rados.0.smithi012.stdout:1460: rmattr oid 37 current snap is 153 2024-09-10T18:01:43.693 INFO:tasks.rados.rados.0.smithi012.stdout:1460: done (2 left) 2024-09-10T18:01:43.693 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 153 2024-09-10T18:01:43.693 INFO:tasks.rados.rados.0.smithi012.stdout:1461: seq_num 457 ranges {3514368=458752} 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:1461: writing smithi01278544-6 from 3514368 to 3973120 tid 1 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 153 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:1457: finishing rollback tid 0 to smithi01278544-19 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:1457: finishing rollback tid 1 to smithi01278544-19 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:1457: finishing rollback tid 2 to smithi01278544-19 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 727 (ObjNum 390 snap 125 seq_num 390) dirty exists 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:1459: finishing write tid 1 to smithi01278544-23 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:1459: finishing write tid 2 to smithi01278544-23 2024-09-10T18:01:43.716 INFO:tasks.rados.rados.0.smithi012.stdout:1462: seq_num 458 ranges {155648=475136} 2024-09-10T18:01:43.720 INFO:tasks.rados.rados.0.smithi012.stdout:1462: writing smithi01278544-18 from 155648 to 630784 tid 1 2024-09-10T18:01:43.720 INFO:tasks.rados.rados.0.smithi012.stdout:1457: done (3 left) 2024-09-10T18:01:43.720 INFO:tasks.rados.rados.0.smithi012.stdout:1463: read oid 33 snap -1 2024-09-10T18:01:43.720 INFO:tasks.rados.rados.0.smithi012.stdout:1463: expect deleted 2024-09-10T18:01:43.720 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 153 2024-09-10T18:01:43.720 INFO:tasks.rados.rados.0.smithi012.stdout:1459: finishing write tid 3 to smithi01278544-23 2024-09-10T18:01:43.720 INFO:tasks.rados.rados.0.smithi012.stdout:1459: oid 23 updating version 0 to 729 2024-09-10T18:01:43.720 INFO:tasks.rados.rados.0.smithi012.stdout:1459: oid 23 version 729 is already newer than 728 2024-09-10T18:01:43.721 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 729 (ObjNum 456 snap 153 seq_num 456) dirty exists 2024-09-10T18:01:43.721 INFO:tasks.rados.rados.0.smithi012.stdout:1459: left oid 23 (ObjNum 456 snap 153 seq_num 456) 2024-09-10T18:01:43.721 INFO:tasks.rados.rados.0.smithi012.stdout:1461: finishing write tid 1 to smithi01278544-6 2024-09-10T18:01:43.721 INFO:tasks.rados.rados.0.smithi012.stdout:1461: finishing write tid 2 to smithi01278544-6 2024-09-10T18:01:43.721 INFO:tasks.rados.rados.0.smithi012.stdout:1464: seq_num 459 ranges {3153920=491520} 2024-09-10T18:01:43.739 INFO:tasks.rados.rados.0.smithi012.stdout:1464: writing smithi01278544-7 from 3153920 to 3645440 tid 1 2024-09-10T18:01:43.740 INFO:tasks.rados.rados.0.smithi012.stdout:1459: done (4 left) 2024-09-10T18:01:43.740 INFO:tasks.rados.rados.0.smithi012.stdout:1465: snap_remove snap 148 2024-09-10T18:01:43.984 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:01:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:01:43.708+0000 7f1c9e375640 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap d3 after trimming was started 2024-09-10T18:01:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:01:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:01:43] "GET /metrics HTTP/1.1" 200 36142 "" "Prometheus/2.43.0" 2024-09-10T18:01:44.710 INFO:tasks.rados.rados.0.smithi012.stdout:1465: done (4 left) 2024-09-10T18:01:44.710 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 153 2024-09-10T18:01:44.711 INFO:tasks.rados.rados.0.smithi012.stdout:1466: seq_num 460 ranges {1785856=507904} 2024-09-10T18:01:44.724 INFO:tasks.rados.rados.0.smithi012.stdout:1466: writing smithi01278544-17 from 1785856 to 2293760 tid 1 2024-09-10T18:01:44.724 INFO:tasks.rados.rados.0.smithi012.stdout:1467: snap_create 2024-09-10T18:01:44.725 INFO:tasks.rados.rados.0.smithi012.stdout:1461: finishing write tid 3 to smithi01278544-6 2024-09-10T18:01:44.725 INFO:tasks.rados.rados.0.smithi012.stdout:1461: oid 6 updating version 0 to 837 2024-09-10T18:01:44.725 INFO:tasks.rados.rados.0.smithi012.stdout:1461: oid 6 version 837 is already newer than 836 2024-09-10T18:01:44.725 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 837 (ObjNum 457 snap 153 seq_num 457) dirty exists 2024-09-10T18:01:44.725 INFO:tasks.rados.rados.0.smithi012.stdout:1461: left oid 6 (ObjNum 457 snap 153 seq_num 457) 2024-09-10T18:01:44.725 INFO:tasks.rados.rados.0.smithi012.stdout:1462: finishing write tid 1 to smithi01278544-18 2024-09-10T18:01:44.725 INFO:tasks.rados.rados.0.smithi012.stdout:1462: finishing write tid 2 to smithi01278544-18 2024-09-10T18:01:44.726 INFO:tasks.rados.rados.0.smithi012.stdout:1462: finishing write tid 3 to smithi01278544-18 2024-09-10T18:01:44.726 INFO:tasks.rados.rados.0.smithi012.stdout:1462: oid 18 updating version 0 to 738 2024-09-10T18:01:44.726 INFO:tasks.rados.rados.0.smithi012.stdout:1462: oid 18 updating version 738 to 739 2024-09-10T18:01:44.726 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 739 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:01:44.726 INFO:tasks.rados.rados.0.smithi012.stdout:1462: left oid 18 (ObjNum 458 snap 153 seq_num 458) 2024-09-10T18:01:44.726 INFO:tasks.rados.rados.0.smithi012.stdout:1464: finishing write tid 1 to smithi01278544-7 2024-09-10T18:01:44.727 INFO:tasks.rados.rados.0.smithi012.stdout:1464: finishing write tid 2 to smithi01278544-7 2024-09-10T18:01:44.727 INFO:tasks.rados.rados.0.smithi012.stdout:1464: finishing write tid 3 to smithi01278544-7 2024-09-10T18:01:44.727 INFO:tasks.rados.rados.0.smithi012.stdout:1464: oid 7 updating version 0 to 95 2024-09-10T18:01:44.727 INFO:tasks.rados.rados.0.smithi012.stdout:1464: oid 7 version 95 is already newer than 94 2024-09-10T18:01:44.727 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 95 (ObjNum 459 snap 153 seq_num 459) dirty exists 2024-09-10T18:01:44.727 INFO:tasks.rados.rados.0.smithi012.stdout:1464: left oid 7 (ObjNum 459 snap 153 seq_num 459) 2024-09-10T18:01:44.732 INFO:tasks.rados.rados.0.smithi012.stdout:1466: finishing write tid 1 to smithi01278544-17 2024-09-10T18:01:44.734 INFO:tasks.rados.rados.0.smithi012.stdout:1466: finishing write tid 2 to smithi01278544-17 2024-09-10T18:01:44.737 INFO:tasks.rados.rados.0.smithi012.stdout:1466: finishing write tid 3 to smithi01278544-17 2024-09-10T18:01:44.737 INFO:tasks.rados.rados.0.smithi012.stdout:1466: oid 17 updating version 0 to 533 2024-09-10T18:01:44.737 INFO:tasks.rados.rados.0.smithi012.stdout:1466: oid 17 updating version 533 to 534 2024-09-10T18:01:44.737 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 534 (ObjNum 460 snap 153 seq_num 460) dirty exists 2024-09-10T18:01:44.737 INFO:tasks.rados.rados.0.smithi012.stdout:1466: left oid 17 (ObjNum 460 snap 153 seq_num 460) 2024-09-10T18:01:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:44 smithi012 ceph-mon[89611]: pgmap v237: 121 pgs: 121 active+clean; 167 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-09-10T18:01:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:44 smithi012 ceph-mon[89611]: osdmap e379: 8 total, 8 up, 8 in 2024-09-10T18:01:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:44 smithi012 ceph-mon[92029]: pgmap v237: 121 pgs: 121 active+clean; 167 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-09-10T18:01:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:44 smithi012 ceph-mon[92029]: osdmap e379: 8 total, 8 up, 8 in 2024-09-10T18:01:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:44 smithi089 ceph-mon[84132]: pgmap v237: 121 pgs: 121 active+clean; 167 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-09-10T18:01:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:44 smithi089 ceph-mon[84132]: osdmap e379: 8 total, 8 up, 8 in 2024-09-10T18:01:45.716 INFO:tasks.rados.rados.0.smithi012.stdout:1461: done (5 left) 2024-09-10T18:01:45.717 INFO:tasks.rados.rados.0.smithi012.stdout:1462: done (4 left) 2024-09-10T18:01:45.717 INFO:tasks.rados.rados.0.smithi012.stdout:1463: done (3 left) 2024-09-10T18:01:45.717 INFO:tasks.rados.rados.0.smithi012.stdout:1464: done (2 left) 2024-09-10T18:01:45.717 INFO:tasks.rados.rados.0.smithi012.stdout:1466: done (1 left) 2024-09-10T18:01:45.717 INFO:tasks.rados.rados.0.smithi012.stdout:1467: done (0 left) 2024-09-10T18:01:45.717 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 154 2024-09-10T18:01:45.717 INFO:tasks.rados.rados.0.smithi012.stdout:1468: seq_num 461 ranges {1859584=524288} 2024-09-10T18:01:45.729 INFO:tasks.rados.rados.0.smithi012.stdout:1468: writing smithi01278544-44 from 1859584 to 2383872 tid 1 2024-09-10T18:01:45.730 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 154 2024-09-10T18:01:45.730 INFO:tasks.rados.rados.0.smithi012.stdout:1469: seq_num 462 ranges {4849664=540672} 2024-09-10T18:01:45.760 INFO:tasks.rados.rados.0.smithi012.stdout:1469: writing smithi01278544-48 from 4849664 to 5390336 tid 1 2024-09-10T18:01:45.760 INFO:tasks.rados.rados.0.smithi012.stdout:1470: delete oid 25 current snap is 154 2024-09-10T18:01:45.760 INFO:tasks.rados.rados.0.smithi012.stdout:1468: finishing write tid 1 to smithi01278544-44 2024-09-10T18:01:45.760 INFO:tasks.rados.rados.0.smithi012.stdout:1468: finishing write tid 2 to smithi01278544-44 2024-09-10T18:01:45.760 INFO:tasks.rados.rados.0.smithi012.stdout:1468: finishing write tid 3 to smithi01278544-44 2024-09-10T18:01:45.760 INFO:tasks.rados.rados.0.smithi012.stdout:1468: oid 44 updating version 0 to 649 2024-09-10T18:01:45.760 INFO:tasks.rados.rados.0.smithi012.stdout:1468: oid 44 updating version 649 to 650 2024-09-10T18:01:45.761 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 650 (ObjNum 461 snap 154 seq_num 461) dirty exists 2024-09-10T18:01:45.761 INFO:tasks.rados.rados.0.smithi012.stdout:1468: left oid 44 (ObjNum 461 snap 154 seq_num 461) 2024-09-10T18:01:45.763 INFO:tasks.rados.rados.0.smithi012.stdout:1468: done (2 left) 2024-09-10T18:01:45.763 INFO:tasks.rados.rados.0.smithi012.stdout:1470: done (1 left) 2024-09-10T18:01:45.763 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 154 2024-09-10T18:01:45.763 INFO:tasks.rados.rados.0.smithi012.stdout:1471: seq_num 464 ranges {6430720=573440} 2024-09-10T18:01:45.801 INFO:tasks.rados.rados.0.smithi012.stdout:1471: writing smithi01278544-22 from 6430720 to 7004160 tid 1 2024-09-10T18:01:45.802 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 154 2024-09-10T18:01:45.802 INFO:tasks.rados.rados.0.smithi012.stdout:1472: seq_num 465 ranges {8863744=598016} 2024-09-10T18:01:45.854 INFO:tasks.rados.rados.0.smithi012.stdout:1472: writing smithi01278544-49 from 8863744 to 9461760 tid 1 2024-09-10T18:01:45.854 INFO:tasks.rados.rados.0.smithi012.stdout:1473: read oid 44 snap 152 2024-09-10T18:01:45.854 INFO:tasks.rados.rados.0.smithi012.stdout:1473: expect (ObjNum 397 snap 129 seq_num 397) 2024-09-10T18:01:45.854 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 154 2024-09-10T18:01:45.854 INFO:tasks.rados.rados.0.smithi012.stdout:1469: finishing write tid 1 to smithi01278544-48 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1469: finishing write tid 2 to smithi01278544-48 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1469: finishing write tid 3 to smithi01278544-48 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1469: oid 48 updating version 0 to 733 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1469: oid 48 version 733 is already newer than 732 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 733 (ObjNum 462 snap 154 seq_num 462) dirty exists 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1469: left oid 48 (ObjNum 462 snap 154 seq_num 462) 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1471: finishing write tid 1 to smithi01278544-22 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1471: finishing write tid 2 to smithi01278544-22 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1471: finishing write tid 3 to smithi01278544-22 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1471: oid 22 updating version 0 to 1056 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1471: oid 22 updating version 1056 to 1057 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1057 (ObjNum 464 snap 154 seq_num 464) dirty exists 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1471: left oid 22 (ObjNum 464 snap 154 seq_num 464) 2024-09-10T18:01:45.855 INFO:tasks.rados.rados.0.smithi012.stdout:1474: seq_num 466 ranges {6193152=614400} 2024-09-10T18:01:45.891 INFO:tasks.rados.rados.0.smithi012.stdout:1474: writing smithi01278544-46 from 6193152 to 6807552 tid 1 2024-09-10T18:01:45.891 INFO:tasks.rados.rados.0.smithi012.stdout:1469: done (4 left) 2024-09-10T18:01:45.891 INFO:tasks.rados.rados.0.smithi012.stdout:1471: done (3 left) 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:1475: delete oid 3 current snap is 154 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:1472: finishing write tid 1 to smithi01278544-49 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:1472: finishing write tid 2 to smithi01278544-49 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:1472: finishing write tid 3 to smithi01278544-49 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:1472: oid 49 updating version 0 to 741 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:1472: oid 49 version 741 is already newer than 740 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 741 (ObjNum 465 snap 154 seq_num 465) dirty exists 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:1472: left oid 49 (ObjNum 465 snap 154 seq_num 465) 2024-09-10T18:01:45.892 INFO:tasks.rados.rados.0.smithi012.stdout:1473: expect (ObjNum 397 snap 129 seq_num 397) 2024-09-10T18:01:45.940 INFO:tasks.rados.rados.0.smithi012.stdout:1474: finishing write tid 1 to smithi01278544-46 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1474: finishing write tid 2 to smithi01278544-46 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1472: done (3 left) 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1473: done (2 left) 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1475: done (1 left) 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1476: setattr oid 13 current snap is 154 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1474: finishing write tid 3 to smithi01278544-46 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1474: oid 46 updating version 0 to 651 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1474: oid 46 updating version 651 to 652 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 652 (ObjNum 466 snap 154 seq_num 466) dirty exists 2024-09-10T18:01:45.941 INFO:tasks.rados.rados.0.smithi012.stdout:1474: left oid 46 (ObjNum 466 snap 154 seq_num 466) 2024-09-10T18:01:45.942 INFO:tasks.rados.rados.0.smithi012.stdout:1474: done (1 left) 2024-09-10T18:01:45.942 INFO:tasks.rados.rados.0.smithi012.stdout:1477: snap_remove snap 142 2024-09-10T18:01:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:45 smithi012 ceph-mon[89611]: osdmap e380: 8 total, 8 up, 8 in 2024-09-10T18:01:46.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:45 smithi012 ceph-mon[92029]: osdmap e380: 8 total, 8 up, 8 in 2024-09-10T18:01:46.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:45 smithi089 ceph-mon[84132]: osdmap e380: 8 total, 8 up, 8 in 2024-09-10T18:01:46.187 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:01:46.721 INFO:tasks.rados.rados.0.smithi012.stdout:1477: done (1 left) 2024-09-10T18:01:46.721 INFO:tasks.rados.rados.0.smithi012.stdout:1478: setattr oid 50 current snap is 154 2024-09-10T18:01:46.721 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 814 (ObjNum 721 snap 0 seq_num 3012619917) dirty exists 2024-09-10T18:01:46.723 INFO:tasks.rados.rados.0.smithi012.stdout:1476: done (1 left) 2024-09-10T18:01:46.723 INFO:tasks.rados.rados.0.smithi012.stdout:1479: rollback oid 32 current snap is 154 2024-09-10T18:01:46.723 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 32 to 152 2024-09-10T18:01:46.723 INFO:tasks.rados.rados.0.smithi012.stdout:1480: copy_from oid 19 from oid 46 current snap is 154 2024-09-10T18:01:46.723 INFO:tasks.rados.rados.0.smithi012.stdout:1481: delete oid 44 current snap is 154 2024-09-10T18:01:46.729 INFO:tasks.rados.rados.0.smithi012.stdout:1481: done (3 left) 2024-09-10T18:01:46.729 INFO:tasks.rados.rados.0.smithi012.stdout:1482: read oid 12 snap -1 2024-09-10T18:01:46.729 INFO:tasks.rados.rados.0.smithi012.stdout:1482: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:01:46.729 INFO:tasks.rados.rados.0.smithi012.stdout:1483: snap_remove snap 140 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (6m) 18s ago 7m 26.8M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (7m) 2m ago 7m 87.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (9m) 18s ago 9m 18.9M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (9m) 2m ago 9m 19.6M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (3m) 2m ago 12m 452M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (3m) 18s ago 14m 525M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (2m) 18s ago 14m 52.1M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:01:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (2m) 2m ago 13m 27.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (2m) 18s ago 13m 43.8M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (7m) 18s ago 7m 15.2M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (7m) 2m ago 7m 16.9M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (89s) 18s ago 12m 126M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (56s) 18s ago 12m 90.4M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (22s) 18s ago 11m 11.6M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (11m) 18s ago 11m 190M 2481M 18.2.4-837-g7a853b17 f21ba1eea74e 93499379a31f 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (10m) 2m ago 10m 186M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (10m) 2m ago 10m 136M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (10m) 2m ago 10m 141M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (9m) 2m ago 9m 98.9M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T18:01:46.790 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (3m) 2m ago 8m 50.4M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:01:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[89611]: pgmap v240: 121 pgs: 121 active+clean; 162 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-09-10T18:01:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[89611]: osdmap e381: 8 total, 8 up, 8 in 2024-09-10T18:01:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[92029]: pgmap v240: 121 pgs: 121 active+clean; 162 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-09-10T18:01:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[92029]: osdmap e381: 8 total, 8 up, 8 in 2024-09-10T18:01:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:47.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:46 smithi089 ceph-mon[84132]: pgmap v240: 121 pgs: 121 active+clean; 162 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-09-10T18:01:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:46 smithi089 ceph-mon[84132]: osdmap e381: 8 total, 8 up, 8 in 2024-09-10T18:01:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:01:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 5, 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:01:47.142 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:01:47.143 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:01:47.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:01:47.143 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:01:47.143 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 7, 2024-09-10T18:01:47.143 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 8 2024-09-10T18:01:47.143 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:01:47.143 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:01:47.444 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:01:47.444 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:01:47.444 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:01:47.444 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:01:47.445 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:01:47.445 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:01:47.445 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T18:01:47.445 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:01:47.445 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "8/20 daemons upgraded", 2024-09-10T18:01:47.445 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T18:01:47.445 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:01:47.445 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:01:47.688 INFO:tasks.rados.rados.0.smithi012.stdout:1483: done (4 left) 2024-09-10T18:01:47.688 INFO:tasks.rados.rados.0.smithi012.stdout:1484: copy_from oid 7 from oid 17 current snap is 154 2024-09-10T18:01:47.688 INFO:tasks.rados.rados.0.smithi012.stdout:1479: finishing rollback tid 0 to smithi01278544-32 2024-09-10T18:01:47.688 INFO:tasks.rados.rados.0.smithi012.stdout:1479: finishing rollback tid 1 to smithi01278544-32 2024-09-10T18:01:47.689 INFO:tasks.rados.rados.0.smithi012.stdout:1479: finishing rollback tid 2 to smithi01278544-32 2024-09-10T18:01:47.689 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 733 (ObjNum 411 snap 134 seq_num 411) dirty exists 2024-09-10T18:01:47.689 INFO:tasks.rados.rados.0.smithi012.stdout:1482: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 145 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:1480: finishing copy_from racing read to smithi01278544-19 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:1480: finishing copy_from to smithi01278544-19 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 652 (ObjNum 466 snap 154 seq_num 466) dirty exists 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:1478: done (4 left) 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:1479: done (3 left) 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:1480: done (2 left) 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:1482: done (1 left) 2024-09-10T18:01:47.691 INFO:tasks.rados.rados.0.smithi012.stdout:1485: snap_remove snap 153 2024-09-10T18:01:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[89611]: from='client.44243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[89611]: from='client.44249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[89611]: osdmap e382: 8 total, 8 up, 8 in 2024-09-10T18:01:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/578877305' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:48.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-10T18:01:48.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[89611]: osdmap e383: 8 total, 8 up, 8 in 2024-09-10T18:01:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[92029]: from='client.44243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[92029]: from='client.44249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[92029]: osdmap e382: 8 total, 8 up, 8 in 2024-09-10T18:01:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/578877305' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-10T18:01:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:47 smithi012 ceph-mon[92029]: osdmap e383: 8 total, 8 up, 8 in 2024-09-10T18:01:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:47 smithi089 ceph-mon[84132]: from='client.44243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:47 smithi089 ceph-mon[84132]: from='client.44249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:47 smithi089 ceph-mon[84132]: osdmap e382: 8 total, 8 up, 8 in 2024-09-10T18:01:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:47 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/578877305' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:01:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:47 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-10T18:01:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:47 smithi089 ceph-mon[84132]: osdmap e383: 8 total, 8 up, 8 in 2024-09-10T18:01:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:1485: done (1 left) 2024-09-10T18:01:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:1486: read oid 32 snap 150 2024-09-10T18:01:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:1486: expect (ObjNum 411 snap 134 seq_num 411) 2024-09-10T18:01:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 154 2024-09-10T18:01:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:1484: finishing copy_from racing read to smithi01278544-7 2024-09-10T18:01:48.688 INFO:tasks.rados.rados.0.smithi012.stdout:1487: seq_num 469 ranges {0=663552} 2024-09-10T18:01:48.692 INFO:tasks.rados.rados.0.smithi012.stdout:1487: writing smithi01278544-3 from 0 to 663552 tid 1 2024-09-10T18:01:48.692 INFO:tasks.rados.rados.0.smithi012.stdout:1488: read oid 20 snap -1 2024-09-10T18:01:48.692 INFO:tasks.rados.rados.0.smithi012.stdout:1488: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:01:48.692 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 154 2024-09-10T18:01:48.692 INFO:tasks.rados.rados.0.smithi012.stdout:1489: seq_num 470 ranges {1794048=679936} 2024-09-10T18:01:48.706 INFO:tasks.rados.rados.0.smithi012.stdout:1489: writing smithi01278544-21 from 1794048 to 2473984 tid 1 2024-09-10T18:01:48.706 INFO:tasks.rados.rados.0.smithi012.stdout:1490: snap_remove snap 141 2024-09-10T18:01:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[89611]: from='client.34341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[89611]: pgmap v243: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T18:01:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[89611]: from='client.34353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T18:01:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[89611]: Upgrade: osd.3 is safe to restart 2024-09-10T18:01:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[89611]: osdmap e384: 8 total, 8 up, 8 in 2024-09-10T18:01:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[92029]: from='client.34341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[92029]: pgmap v243: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T18:01:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[92029]: from='client.34353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T18:01:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[92029]: Upgrade: osd.3 is safe to restart 2024-09-10T18:01:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:48 smithi012 ceph-mon[92029]: osdmap e384: 8 total, 8 up, 8 in 2024-09-10T18:01:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:48 smithi089 ceph-mon[84132]: from='client.34341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:48 smithi089 ceph-mon[84132]: pgmap v243: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T18:01:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:48 smithi089 ceph-mon[84132]: from='client.34353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:01:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:48 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T18:01:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:48 smithi089 ceph-mon[84132]: Upgrade: osd.3 is safe to restart 2024-09-10T18:01:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:48 smithi089 ceph-mon[84132]: osdmap e384: 8 total, 8 up, 8 in 2024-09-10T18:01:49.694 INFO:tasks.rados.rados.0.smithi012.stdout:1490: done (5 left) 2024-09-10T18:01:49.694 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 154 2024-09-10T18:01:49.694 INFO:tasks.rados.rados.0.smithi012.stdout:1484: finishing copy_from to smithi01278544-7 2024-09-10T18:01:49.694 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 534 (ObjNum 460 snap 153 seq_num 460) dirty exists 2024-09-10T18:01:49.694 INFO:tasks.rados.rados.0.smithi012.stdout:1487: finishing write tid 1 to smithi01278544-3 2024-09-10T18:01:49.694 INFO:tasks.rados.rados.0.smithi012.stdout:1487: finishing write tid 2 to smithi01278544-3 2024-09-10T18:01:49.694 INFO:tasks.rados.rados.0.smithi012.stdout:1491: seq_num 471 ranges {9461760=696320} 2024-09-10T18:01:49.746 INFO:tasks.rados.rados.0.smithi012.stdout:1491: writing smithi01278544-49 from 9461760 to 10158080 tid 1 2024-09-10T18:01:49.746 INFO:tasks.rados.rados.0.smithi012.stdout:1484: done (5 left) 2024-09-10T18:01:49.747 INFO:tasks.rados.rados.0.smithi012.stdout:1492: copy_from oid 29 from oid 19 current snap is 154 2024-09-10T18:01:49.747 INFO:tasks.rados.rados.0.smithi012.stdout:1488: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:01:49.749 INFO:tasks.rados.rados.0.smithi012.stdout:1487: finishing write tid 3 to smithi01278544-3 2024-09-10T18:01:49.749 INFO:tasks.rados.rados.0.smithi012.stdout:1487: oid 3 updating version 0 to 654 2024-09-10T18:01:49.749 INFO:tasks.rados.rados.0.smithi012.stdout:1487: oid 3 updating version 654 to 655 2024-09-10T18:01:49.750 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 655 (ObjNum 469 snap 154 seq_num 469) dirty exists 2024-09-10T18:01:49.750 INFO:tasks.rados.rados.0.smithi012.stdout:1487: left oid 3 (ObjNum 469 snap 154 seq_num 469) 2024-09-10T18:01:49.750 INFO:tasks.rados.rados.0.smithi012.stdout:1489: finishing write tid 1 to smithi01278544-21 2024-09-10T18:01:49.750 INFO:tasks.rados.rados.0.smithi012.stdout:1489: finishing write tid 2 to smithi01278544-21 2024-09-10T18:01:49.750 INFO:tasks.rados.rados.0.smithi012.stdout:1486: expect (ObjNum 411 snap 134 seq_num 411) 2024-09-10T18:01:49.898 INFO:tasks.rados.rados.0.smithi012.stdout:1489: finishing write tid 3 to smithi01278544-21 2024-09-10T18:01:49.898 INFO:tasks.rados.rados.0.smithi012.stdout:1489: oid 21 updating version 0 to 730 2024-09-10T18:01:49.898 INFO:tasks.rados.rados.0.smithi012.stdout:1489: oid 21 updating version 730 to 731 2024-09-10T18:01:49.898 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 731 (ObjNum 470 snap 154 seq_num 470) dirty exists 2024-09-10T18:01:49.898 INFO:tasks.rados.rados.0.smithi012.stdout:1489: left oid 21 (ObjNum 470 snap 154 seq_num 470) 2024-09-10T18:01:49.899 INFO:tasks.rados.rados.0.smithi012.stdout:1491: finishing write tid 1 to smithi01278544-49 2024-09-10T18:01:49.899 INFO:tasks.rados.rados.0.smithi012.stdout:1491: finishing write tid 2 to smithi01278544-49 2024-09-10T18:01:49.899 INFO:tasks.rados.rados.0.smithi012.stdout:1486: done (5 left) 2024-09-10T18:01:49.899 INFO:tasks.rados.rados.0.smithi012.stdout:1487: done (4 left) 2024-09-10T18:01:49.899 INFO:tasks.rados.rados.0.smithi012.stdout:1488: done (3 left) 2024-09-10T18:01:49.899 INFO:tasks.rados.rados.0.smithi012.stdout:1489: done (2 left) 2024-09-10T18:01:49.899 INFO:tasks.rados.rados.0.smithi012.stdout:1493: rollback oid 32 current snap is 154 2024-09-10T18:01:49.900 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 32 to 151 2024-09-10T18:01:49.900 INFO:tasks.rados.rados.0.smithi012.stdout:1491: finishing write tid 3 to smithi01278544-49 2024-09-10T18:01:49.900 INFO:tasks.rados.rados.0.smithi012.stdout:1491: oid 49 updating version 0 to 742 2024-09-10T18:01:49.900 INFO:tasks.rados.rados.0.smithi012.stdout:1491: oid 49 updating version 742 to 743 2024-09-10T18:01:49.900 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 743 (ObjNum 471 snap 154 seq_num 471) dirty exists 2024-09-10T18:01:49.901 INFO:tasks.rados.rados.0.smithi012.stdout:1491: left oid 49 (ObjNum 471 snap 154 seq_num 471) 2024-09-10T18:01:49.901 INFO:tasks.rados.rados.0.smithi012.stdout:1492: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:01:49.901 INFO:tasks.rados.rados.0.smithi012.stdout:1492: finishing copy_from to smithi01278544-29 2024-09-10T18:01:49.901 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 652 (ObjNum 466 snap 154 seq_num 466) dirty exists 2024-09-10T18:01:49.902 INFO:tasks.rados.rados.0.smithi012.stdout:1491: done (2 left) 2024-09-10T18:01:49.902 INFO:tasks.rados.rados.0.smithi012.stdout:1492: done (1 left) 2024-09-10T18:01:49.902 INFO:tasks.rados.rados.0.smithi012.stdout:1494: rollback oid 7 current snap is 154 2024-09-10T18:01:49.902 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 7 to 151 2024-09-10T18:01:49.902 INFO:tasks.rados.rados.0.smithi012.stdout:1495: snap_remove snap 150 2024-09-10T18:01:50.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[89611]: pgmap v246: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-09-10T18:01:50.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[89611]: Upgrade: Updating osd.3 2024-09-10T18:01:50.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:50.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T18:01:50.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:50.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[89611]: Deploying daemon osd.3 on smithi012 2024-09-10T18:01:50.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[89611]: osdmap e385: 8 total, 8 up, 8 in 2024-09-10T18:01:50.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[92029]: pgmap v246: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-09-10T18:01:50.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[92029]: Upgrade: Updating osd.3 2024-09-10T18:01:50.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:50.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T18:01:50.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:50.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[92029]: Deploying daemon osd.3 on smithi012 2024-09-10T18:01:50.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:50 smithi012 ceph-mon[92029]: osdmap e385: 8 total, 8 up, 8 in 2024-09-10T18:01:50.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:50 smithi089 ceph-mon[84132]: pgmap v246: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-09-10T18:01:50.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:50 smithi089 ceph-mon[84132]: Upgrade: Updating osd.3 2024-09-10T18:01:50.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:50.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T18:01:50.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:50 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:01:50.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:50 smithi089 ceph-mon[84132]: Deploying daemon osd.3 on smithi012 2024-09-10T18:01:50.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:50 smithi089 ceph-mon[84132]: osdmap e385: 8 total, 8 up, 8 in 2024-09-10T18:01:50.731 INFO:tasks.rados.rados.0.smithi012.stdout:1495: done (2 left) 2024-09-10T18:01:50.731 INFO:tasks.rados.rados.0.smithi012.stdout:1496: snap_remove snap 137 2024-09-10T18:01:51.739 INFO:tasks.rados.rados.0.smithi012.stdout:1496: done (2 left) 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 154 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:1494: finishing rollback tid 0 to smithi01278544-7 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:1494: finishing rollback tid 1 to smithi01278544-7 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:1493: finishing rollback tid 0 to smithi01278544-32 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:1493: finishing rollback tid 1 to smithi01278544-32 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:1494: finishing rollback tid 2 to smithi01278544-7 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 537 (ObjNum 410 snap 134 seq_num 410) dirty exists 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:1493: finishing rollback tid 2 to smithi01278544-32 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 736 (ObjNum 411 snap 134 seq_num 411) dirty exists 2024-09-10T18:01:51.740 INFO:tasks.rados.rados.0.smithi012.stdout:1497: seq_num 472 ranges {8314880=712704} 2024-09-10T18:01:51.790 INFO:tasks.rados.rados.0.smithi012.stdout:1497: writing smithi01278544-47 from 8314880 to 9027584 tid 1 2024-09-10T18:01:51.790 INFO:tasks.rados.rados.0.smithi012.stdout:1493: done (2 left) 2024-09-10T18:01:51.790 INFO:tasks.rados.rados.0.smithi012.stdout:1494: done (1 left) 2024-09-10T18:01:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1498: read oid 5 snap -1 2024-09-10T18:01:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1498: expect (ObjNum 442 snap 150 seq_num 442) 2024-09-10T18:01:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1499: read oid 32 snap 151 2024-09-10T18:01:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1499: expect (ObjNum 411 snap 134 seq_num 411) 2024-09-10T18:01:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 154 2024-09-10T18:01:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1500: seq_num 473 ranges {10158080=729088} 2024-09-10T18:01:51.850 INFO:tasks.rados.rados.0.smithi012.stdout:1500: writing smithi01278544-49 from 10158080 to 10887168 tid 1 2024-09-10T18:01:51.850 INFO:tasks.rados.rados.0.smithi012.stdout:1501: delete oid 19 current snap is 154 2024-09-10T18:01:51.850 INFO:tasks.rados.rados.0.smithi012.stdout:1497: finishing write tid 1 to smithi01278544-47 2024-09-10T18:01:51.850 INFO:tasks.rados.rados.0.smithi012.stdout:1497: finishing write tid 2 to smithi01278544-47 2024-09-10T18:01:51.850 INFO:tasks.rados.rados.0.smithi012.stdout:1497: finishing write tid 3 to smithi01278544-47 2024-09-10T18:01:51.851 INFO:tasks.rados.rados.0.smithi012.stdout:1497: oid 47 updating version 0 to 1045 2024-09-10T18:01:51.851 INFO:tasks.rados.rados.0.smithi012.stdout:1497: oid 47 updating version 1045 to 1046 2024-09-10T18:01:51.851 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1046 (ObjNum 472 snap 154 seq_num 472) dirty exists 2024-09-10T18:01:51.851 INFO:tasks.rados.rados.0.smithi012.stdout:1497: left oid 47 (ObjNum 472 snap 154 seq_num 472) 2024-09-10T18:01:51.851 INFO:tasks.rados.rados.0.smithi012.stdout:1499: expect (ObjNum 411 snap 134 seq_num 411) 2024-09-10T18:01:52.010 INFO:tasks.rados.rados.0.smithi012.stdout:1498: expect (ObjNum 442 snap 150 seq_num 442) 2024-09-10T18:01:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:51 smithi012 ceph-mon[89611]: osdmap e386: 8 total, 8 up, 8 in 2024-09-10T18:01:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:51 smithi012 ceph-mon[92029]: osdmap e386: 8 total, 8 up, 8 in 2024-09-10T18:01:52.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:51 smithi089 ceph-mon[84132]: osdmap e386: 8 total, 8 up, 8 in 2024-09-10T18:01:52.252 INFO:tasks.rados.rados.0.smithi012.stdout:1500: finishing write tid 1 to smithi01278544-49 2024-09-10T18:01:52.252 INFO:tasks.rados.rados.0.smithi012.stdout:1500: finishing write tid 2 to smithi01278544-49 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:1500: finishing write tid 3 to smithi01278544-49 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:1500: oid 49 updating version 0 to 745 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:1500: oid 49 version 745 is already newer than 744 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 745 (ObjNum 473 snap 154 seq_num 473) dirty exists 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:1500: left oid 49 (ObjNum 473 snap 154 seq_num 473) 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:1497: done (4 left) 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:1498: done (3 left) 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:1499: done (2 left) 2024-09-10T18:01:52.253 INFO:tasks.rados.rados.0.smithi012.stdout:1500: done (1 left) 2024-09-10T18:01:52.254 INFO:tasks.rados.rados.0.smithi012.stdout:1501: done (0 left) 2024-09-10T18:01:52.254 INFO:tasks.rados.rados.0.smithi012.stdout:1502: snap_remove snap 146 2024-09-10T18:01:52.494 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:52 smithi012 systemd[1]: Stopping Ceph osd.3 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:01:52.689 INFO:tasks.rados.rados.0.smithi012.stdout:1502: done (0 left) 2024-09-10T18:01:52.689 INFO:tasks.rados.rados.0.smithi012.stdout:1503: read oid 18 snap -1 2024-09-10T18:01:52.689 INFO:tasks.rados.rados.0.smithi012.stdout:1503: expect (ObjNum 458 snap 153 seq_num 458) 2024-09-10T18:01:52.689 INFO:tasks.rados.rados.0.smithi012.stdout:1504: setattr oid 31 current snap is 154 2024-09-10T18:01:52.690 INFO:tasks.rados.rados.0.smithi012.stdout:1505: snap_create 2024-09-10T18:01:52.705 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 815 (ObjNum 129 snap 0 seq_num 3012897570) dirty exists 2024-09-10T18:01:52.711 INFO:tasks.rados.rados.0.smithi012.stdout:1503: expect (ObjNum 458 snap 153 seq_num 458) 2024-09-10T18:01:52.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[89611]: pgmap v249: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 132 KiB/s wr, 5 op/s 2024-09-10T18:01:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[89611]: osdmap e387: 8 total, 8 up, 8 in 2024-09-10T18:01:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[89611]: osd.3 marked itself down and dead 2024-09-10T18:01:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[89611]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:01:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[89611]: osdmap e388: 8 total, 7 up, 8 in 2024-09-10T18:01:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[92029]: pgmap v249: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 132 KiB/s wr, 5 op/s 2024-09-10T18:01:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[92029]: osdmap e387: 8 total, 8 up, 8 in 2024-09-10T18:01:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[92029]: osd.3 marked itself down and dead 2024-09-10T18:01:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[92029]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:01:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-mon[92029]: osdmap e388: 8 total, 7 up, 8 in 2024-09-10T18:01:52.787 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[58943]: 2024-09-10T18:01:52.596+0000 7fc2ca3bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:01:52.787 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[58943]: 2024-09-10T18:01:52.596+0000 7fc2ca3bf640 -1 osd.3 387 *** Got signal Terminated *** 2024-09-10T18:01:52.787 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[58943]: 2024-09-10T18:01:52.596+0000 7fc2ca3bf640 -1 osd.3 387 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:01:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:52 smithi089 ceph-mon[84132]: pgmap v249: 121 pgs: 121 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 132 KiB/s wr, 5 op/s 2024-09-10T18:01:53.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:52 smithi089 ceph-mon[84132]: osdmap e387: 8 total, 8 up, 8 in 2024-09-10T18:01:53.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:52 smithi089 ceph-mon[84132]: osd.3 marked itself down and dead 2024-09-10T18:01:53.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:52 smithi089 ceph-mon[84132]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:01:53.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:52 smithi089 ceph-mon[84132]: osdmap e388: 8 total, 7 up, 8 in 2024-09-10T18:01:53.531 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:53 smithi012 podman[111389]: 2024-09-10 18:01:53.2401204 +0000 UTC m=+0.754137821 container died 93499379a31fca652080dc7a4b040a96717d1cdcf3d73bc6c5926301dd6b8a1c (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T18:01:53.690 INFO:tasks.rados.rados.0.smithi012.stdout:1503: done (2 left) 2024-09-10T18:01:53.690 INFO:tasks.rados.rados.0.smithi012.stdout:1504: done (1 left) 2024-09-10T18:01:53.690 INFO:tasks.rados.rados.0.smithi012.stdout:1505: done (0 left) 2024-09-10T18:01:53.690 INFO:tasks.rados.rados.0.smithi012.stdout:1506: snap_remove snap 151 2024-09-10T18:01:53.784 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:53 smithi012 podman[111389]: 2024-09-10 18:01:53.629320827 +0000 UTC m=+1.143338247 container cleanup 93499379a31fca652080dc7a4b040a96717d1cdcf3d73bc6c5926301dd6b8a1c (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=reef-7a853b1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:01:53.784 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:53 smithi012 bash[111389]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3 2024-09-10T18:01:54.269 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:01:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:01:53] "GET /metrics HTTP/1.1" 200 36286 "" "Prometheus/2.43.0" 2024-09-10T18:01:54.269 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:53 smithi012 podman[111407]: 2024-09-10 18:01:53.905833958 +0000 UTC m=+0.663229279 container remove 93499379a31fca652080dc7a4b040a96717d1cdcf3d73bc6c5926301dd6b8a1c (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=reef-7a853b1, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T18:01:54.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:54 smithi012 podman[111492]: 2024-09-10 18:01:54.171089276 +0000 UTC m=+0.016331504 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:01:54.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:54 smithi012 podman[111492]: 2024-09-10 18:01:54.298428284 +0000 UTC m=+0.143670554 container create 11005e048502dae54744898e14e6c286f41f7b36e48d18f9970ea4f3a2e00eac (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T18:01:54.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:54 smithi012 podman[111492]: 2024-09-10 18:01:54.492629222 +0000 UTC m=+0.337871450 container init 11005e048502dae54744898e14e6c286f41f7b36e48d18f9970ea4f3a2e00eac (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2) 2024-09-10T18:01:54.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:54 smithi012 podman[111492]: 2024-09-10 18:01:54.496339256 +0000 UTC m=+0.341581484 container start 11005e048502dae54744898e14e6c286f41f7b36e48d18f9970ea4f3a2e00eac (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:01:54.694 INFO:tasks.rados.rados.0.smithi012.stdout:1506: done (0 left) 2024-09-10T18:01:54.694 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 155 2024-09-10T18:01:54.694 INFO:tasks.rados.rados.0.smithi012.stdout:1507: seq_num 475 ranges {442368=761856} 2024-09-10T18:01:54.702 INFO:tasks.rados.rados.0.smithi012.stdout:1507: writing smithi01278544-23 from 442368 to 1204224 tid 1 2024-09-10T18:01:54.702 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 155 2024-09-10T18:01:54.702 INFO:tasks.rados.rados.0.smithi012.stdout:1508: seq_num 476 ranges {4571136=778240} 2024-09-10T18:01:54.732 INFO:tasks.rados.rados.0.smithi012.stdout:1508: writing smithi01278544-1 from 4571136 to 5349376 tid 1 2024-09-10T18:01:54.732 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 155 2024-09-10T18:01:54.732 INFO:tasks.rados.rados.0.smithi012.stdout:1509: seq_num 477 ranges {4177920=794624} 2024-09-10T18:01:54.759 INFO:tasks.rados.rados.0.smithi012.stdout:1509: writing smithi01278544-32 from 4177920 to 4972544 tid 1 2024-09-10T18:01:54.759 INFO:tasks.rados.rados.0.smithi012.stdout:1510: rollback oid 41 current snap is 155 2024-09-10T18:01:54.759 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 154 2024-09-10T18:01:54.759 INFO:tasks.rados.rados.0.smithi012.stdout:1507: finishing write tid 1 to smithi01278544-23 2024-09-10T18:01:54.759 INFO:tasks.rados.rados.0.smithi012.stdout:1507: finishing write tid 2 to smithi01278544-23 2024-09-10T18:01:54.760 INFO:tasks.rados.rados.0.smithi012.stdout:1511: snap_remove snap 147 2024-09-10T18:01:54.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:54 smithi012 ceph-mon[89611]: pgmap v252: 121 pgs: 16 stale+active+clean, 105 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 4.5 MiB/s wr, 19 op/s 2024-09-10T18:01:54.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:54 smithi012 ceph-mon[89611]: osdmap e389: 8 total, 7 up, 8 in 2024-09-10T18:01:54.999 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:54 smithi012 ceph-mon[92029]: pgmap v252: 121 pgs: 16 stale+active+clean, 105 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 4.5 MiB/s wr, 19 op/s 2024-09-10T18:01:54.999 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:54 smithi012 ceph-mon[92029]: osdmap e389: 8 total, 7 up, 8 in 2024-09-10T18:01:54.999 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:54 smithi012 podman[111492]: 2024-09-10 18:01:54.60116914 +0000 UTC m=+0.446411377 container attach 11005e048502dae54744898e14e6c286f41f7b36e48d18f9970ea4f3a2e00eac (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:01:54.999 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:54 smithi012 podman[111492]: 2024-09-10 18:01:54.695405635 +0000 UTC m=+0.540647876 container died 11005e048502dae54744898e14e6c286f41f7b36e48d18f9970ea4f3a2e00eac (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T18:01:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:54 smithi089 ceph-mon[84132]: pgmap v252: 121 pgs: 16 stale+active+clean, 105 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 4.5 MiB/s wr, 19 op/s 2024-09-10T18:01:55.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:54 smithi089 ceph-mon[84132]: osdmap e389: 8 total, 7 up, 8 in 2024-09-10T18:01:55.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:55 smithi012 podman[111515]: 2024-09-10 18:01:55.271355315 +0000 UTC m=+0.567394717 container remove 11005e048502dae54744898e14e6c286f41f7b36e48d18f9970ea4f3a2e00eac (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T18:01:55.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:55 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-10T18:01:55.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:55 smithi012 systemd[1]: Stopped Ceph osd.3 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:01:55.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:55 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.3.service: Consumed 10.381s CPU time. 2024-09-10T18:01:55.709 INFO:tasks.rados.rados.0.smithi012.stdout:1511: done (4 left) 2024-09-10T18:01:55.709 INFO:tasks.rados.rados.0.smithi012.stdout:1512: snap_remove snap 152 2024-09-10T18:01:55.914 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:55 smithi012 ceph-mon[89611]: osdmap e390: 8 total, 7 up, 8 in 2024-09-10T18:01:55.914 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:55 smithi012 ceph-mon[92029]: osdmap e390: 8 total, 7 up, 8 in 2024-09-10T18:01:55.914 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:55 smithi012 systemd[1]: Starting Ceph osd.3 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:01:55.914 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:55 smithi012 podman[111614]: 2024-09-10 18:01:55.682696267 +0000 UTC m=+0.016455679 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:01:55.914 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:55 smithi012 podman[111614]: 2024-09-10 18:01:55.798050645 +0000 UTC m=+0.131810044 container create 34afa523c64825474a0b1feda32ac56e761605b671f8b892e7d71148ac9baae1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:01:56.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:55 smithi089 ceph-mon[84132]: osdmap e390: 8 total, 7 up, 8 in 2024-09-10T18:01:56.167 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 podman[111614]: 2024-09-10 18:01:56.025247667 +0000 UTC m=+0.359007069 container init 34afa523c64825474a0b1feda32ac56e761605b671f8b892e7d71148ac9baae1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:01:56.167 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 podman[111614]: 2024-09-10 18:01:56.02857238 +0000 UTC m=+0.362331780 container start 34afa523c64825474a0b1feda32ac56e761605b671f8b892e7d71148ac9baae1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T18:01:56.168 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 podman[111614]: 2024-09-10 18:01:56.108774475 +0000 UTC m=+0.442533902 container attach 34afa523c64825474a0b1feda32ac56e761605b671f8b892e7d71148ac9baae1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T18:01:56.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:01:56.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:01:56.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:01:56.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:01:56.707 INFO:tasks.rados.rados.0.smithi012.stdout:1512: done (4 left) 2024-09-10T18:01:56.707 INFO:tasks.rados.rados.0.smithi012.stdout:1513: read oid 30 snap 154 2024-09-10T18:01:56.707 INFO:tasks.rados.rados.0.smithi012.stdout:1513: expect deleted 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 155 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1507: finishing write tid 3 to smithi01278544-23 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1507: oid 23 updating version 0 to 733 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1507: oid 23 updating version 733 to 734 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 734 (ObjNum 475 snap 155 seq_num 475) dirty exists 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1507: left oid 23 (ObjNum 475 snap 155 seq_num 475) 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1508: finishing write tid 1 to smithi01278544-1 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1508: finishing write tid 2 to smithi01278544-1 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1508: finishing write tid 3 to smithi01278544-1 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1508: oid 1 updating version 0 to 735 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1508: oid 1 version 735 is already newer than 734 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 735 (ObjNum 476 snap 155 seq_num 476) dirty exists 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1508: left oid 1 (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1510: finishing rollback tid 0 to smithi01278544-41 2024-09-10T18:01:56.708 INFO:tasks.rados.rados.0.smithi012.stdout:1510: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:01:56.709 INFO:tasks.rados.rados.0.smithi012.stdout:1510: finishing rollback tid 2 to smithi01278544-41 2024-09-10T18:01:56.709 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 818 (ObjNum 424 snap 142 seq_num 424) dirty exists 2024-09-10T18:01:56.709 INFO:tasks.rados.rados.0.smithi012.stdout:1509: finishing write tid 1 to smithi01278544-32 2024-09-10T18:01:56.709 INFO:tasks.rados.rados.0.smithi012.stdout:1514: seq_num 478 ranges {0=409600,409600=401408} 2024-09-10T18:01:56.710 INFO:tasks.rados.rados.0.smithi012.stdout:1514: writing smithi01278544-50 from 0 to 409600 tid 1 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1514: writing smithi01278544-50 from 409600 to 811008 tid 2 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1507: done (5 left) 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1508: done (4 left) 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1510: done (3 left) 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1515: delete oid 24 current snap is 155 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1509: finishing write tid 2 to smithi01278544-32 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1509: finishing write tid 3 to smithi01278544-32 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1509: oid 32 updating version 0 to 737 2024-09-10T18:01:56.713 INFO:tasks.rados.rados.0.smithi012.stdout:1509: oid 32 updating version 737 to 738 2024-09-10T18:01:56.714 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 738 (ObjNum 477 snap 155 seq_num 477) dirty exists 2024-09-10T18:01:56.714 INFO:tasks.rados.rados.0.smithi012.stdout:1509: left oid 32 (ObjNum 477 snap 155 seq_num 477) 2024-09-10T18:01:56.720 INFO:tasks.rados.rados.0.smithi012.stdout:1509: done (3 left) 2024-09-10T18:01:56.720 INFO:tasks.rados.rados.0.smithi012.stdout:1513: done (2 left) 2024-09-10T18:01:56.720 INFO:tasks.rados.rados.0.smithi012.stdout:1515: done (1 left) 2024-09-10T18:01:56.720 INFO:tasks.rados.rados.0.smithi012.stdout:1516: read oid 15 snap -1 2024-09-10T18:01:56.720 INFO:tasks.rados.rados.0.smithi012.stdout:1516: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:01:56.720 INFO:tasks.rados.rados.0.smithi012.stdout:1517: copy_from oid 9 from oid 19 current snap is 155 2024-09-10T18:01:56.720 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 155 2024-09-10T18:01:56.720 INFO:tasks.rados.rados.0.smithi012.stdout:1518: seq_num 480 ranges {3235840=442368,3678208=401408} 2024-09-10T18:01:56.740 INFO:tasks.rados.rados.0.smithi012.stdout:1518: writing smithi01278544-37 from 3235840 to 3678208 tid 1 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1518: writing smithi01278544-37 from 3678208 to 4079616 tid 2 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1519: copy_from oid 47 from oid 49 current snap is 155 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1514: finishing write tid 1 to smithi01278544-50 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1514: finishing write tid 2 to smithi01278544-50 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1514: finishing write tid 3 to smithi01278544-50 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1517: finishing copy_from to smithi01278544-9 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1517: got expected ENOENT (src dne) 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1514: finishing write tid 4 to smithi01278544-50 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1514: oid 50 updating version 0 to 156 2024-09-10T18:01:56.743 INFO:tasks.rados.rados.0.smithi012.stdout:1514: oid 50 version 156 is already newer than 155 2024-09-10T18:01:56.744 INFO:tasks.rados.rados.0.smithi012.stdout:1514: oid 50 updating version 156 to 157 2024-09-10T18:01:56.744 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 157 (ObjNum 478 snap 155 seq_num 478) dirty exists 2024-09-10T18:01:56.744 INFO:tasks.rados.rados.0.smithi012.stdout:1514: left oid 50 (ObjNum 478 snap 155 seq_num 478) 2024-09-10T18:01:56.744 INFO:tasks.rados.rados.0.smithi012.stdout:1517: finishing copy_from racing read to smithi01278544-9 2024-09-10T18:01:56.744 INFO:tasks.rados.rados.0.smithi012.stdout:1516: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1518: finishing write tid 1 to smithi01278544-37 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1518: finishing write tid 2 to smithi01278544-37 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1518: finishing write tid 3 to smithi01278544-37 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1518: finishing write tid 4 to smithi01278544-37 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1518: oid 37 updating version 0 to 820 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1518: oid 37 version 820 is already newer than 819 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1518: oid 37 updating version 820 to 821 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 821 (ObjNum 480 snap 155 seq_num 480) dirty exists 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1518: left oid 37 (ObjNum 480 snap 155 seq_num 480) 2024-09-10T18:01:56.751 INFO:tasks.rados.rados.0.smithi012.stdout:1514: done (4 left) 2024-09-10T18:01:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:1516: done (3 left) 2024-09-10T18:01:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:1517: done (2 left) 2024-09-10T18:01:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:1518: done (1 left) 2024-09-10T18:01:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:1520: read oid 34 snap -1 2024-09-10T18:01:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:1520: expect deleted 2024-09-10T18:01:56.752 INFO:tasks.rados.rados.0.smithi012.stdout:1521: snap_remove snap 154 2024-09-10T18:01:56.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-mon[89611]: pgmap v255: 121 pgs: 7 active+undersized, 13 stale+active+clean, 2 active+undersized+degraded, 99 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 4.5 MiB/s wr, 14 op/s; 10/321 objects degraded (3.115%) 2024-09-10T18:01:56.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-mon[89611]: Health check failed: Degraded data redundancy: 10/321 objects degraded (3.115%), 2 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:56.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-mon[89611]: osdmap e391: 8 total, 7 up, 8 in 2024-09-10T18:01:56.948 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-mon[92029]: pgmap v255: 121 pgs: 7 active+undersized, 13 stale+active+clean, 2 active+undersized+degraded, 99 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 4.5 MiB/s wr, 14 op/s; 10/321 objects degraded (3.115%) 2024-09-10T18:01:56.949 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-mon[92029]: Health check failed: Degraded data redundancy: 10/321 objects degraded (3.115%), 2 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:56.949 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-mon[92029]: osdmap e391: 8 total, 7 up, 8 in 2024-09-10T18:01:56.949 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T18:01:56.949 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T18:01:56.949 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-10T18:01:56.949 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-10T18:01:56.949 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-10T18:01:56.949 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-10T18:01:57.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:56 smithi089 ceph-mon[84132]: pgmap v255: 121 pgs: 7 active+undersized, 13 stale+active+clean, 2 active+undersized+degraded, 99 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 4.5 MiB/s wr, 14 op/s; 10/321 objects degraded (3.115%) 2024-09-10T18:01:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:56 smithi089 ceph-mon[84132]: Health check failed: Degraded data redundancy: 10/321 objects degraded (3.115%), 2 pgs degraded (PG_DEGRADED) 2024-09-10T18:01:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:56 smithi089 ceph-mon[84132]: osdmap e391: 8 total, 7 up, 8 in 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate[111629]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 bash[111614]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-10T18:01:57.272 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:56 smithi012 podman[111614]: 2024-09-10 18:01:56.976515038 +0000 UTC m=+1.310274447 container died 34afa523c64825474a0b1feda32ac56e761605b671f8b892e7d71148ac9baae1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True) 2024-09-10T18:01:57.691 INFO:tasks.rados.rados.0.smithi012.stdout:1521: done (2 left) 2024-09-10T18:01:57.692 INFO:tasks.rados.rados.0.smithi012.stdout:1522: snap_create 2024-09-10T18:01:57.692 INFO:tasks.rados.rados.0.smithi012.stdout:1519: finishing copy_from racing read to smithi01278544-47 2024-09-10T18:01:57.692 INFO:tasks.rados.rados.0.smithi012.stdout:1519: finishing copy_from to smithi01278544-47 2024-09-10T18:01:57.692 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 745 (ObjNum 473 snap 154 seq_num 473) dirty exists 2024-09-10T18:01:57.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:57 smithi012 ceph-mon[89611]: osdmap e392: 8 total, 7 up, 8 in 2024-09-10T18:01:57.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:57 smithi012 ceph-mon[89611]: osdmap e393: 8 total, 7 up, 8 in 2024-09-10T18:01:57.962 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:57 smithi012 ceph-mon[92029]: osdmap e392: 8 total, 7 up, 8 in 2024-09-10T18:01:57.962 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:57 smithi012 ceph-mon[92029]: osdmap e393: 8 total, 7 up, 8 in 2024-09-10T18:01:57.962 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:57 smithi012 podman[111765]: 2024-09-10 18:01:57.629655468 +0000 UTC m=+0.642556089 container remove 34afa523c64825474a0b1feda32ac56e761605b671f8b892e7d71148ac9baae1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T18:01:57.962 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:57 smithi012 podman[111826]: 2024-09-10 18:01:57.847066577 +0000 UTC m=+0.111075708 container create 6e4dd760071cb54faa2529a6a6391b55db79d49ae1fdd90a7e5752365f3a82a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T18:01:57.962 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:57 smithi012 podman[111826]: 2024-09-10 18:01:57.752777347 +0000 UTC m=+0.016786490 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:01:58.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:57 smithi089 ceph-mon[84132]: osdmap e392: 8 total, 7 up, 8 in 2024-09-10T18:01:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:57 smithi089 ceph-mon[84132]: osdmap e393: 8 total, 7 up, 8 in 2024-09-10T18:01:58.284 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:58 smithi012 podman[111826]: 2024-09-10 18:01:58.074347234 +0000 UTC m=+0.338356366 container init 6e4dd760071cb54faa2529a6a6391b55db79d49ae1fdd90a7e5752365f3a82a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T18:01:58.284 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:58 smithi012 podman[111826]: 2024-09-10 18:01:58.077596209 +0000 UTC m=+0.341605340 container start 6e4dd760071cb54faa2529a6a6391b55db79d49ae1fdd90a7e5752365f3a82a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T18:01:58.284 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-osd[111844]: -- 172.21.15.12:0/1797323856 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dd3d7e7a40 con 0x55dd3e5b6000 2024-09-10T18:01:58.285 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:58 smithi012 bash[111826]: 6e4dd760071cb54faa2529a6a6391b55db79d49ae1fdd90a7e5752365f3a82a4 2024-09-10T18:01:58.285 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:58 smithi012 systemd[1]: Started Ceph osd.3 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:01:58.697 INFO:tasks.rados.rados.0.smithi012.stdout:1519: done (2 left) 2024-09-10T18:01:58.697 INFO:tasks.rados.rados.0.smithi012.stdout:1520: done (1 left) 2024-09-10T18:01:58.697 INFO:tasks.rados.rados.0.smithi012.stdout:1522: done (0 left) 2024-09-10T18:01:58.697 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 156 2024-09-10T18:01:58.697 INFO:tasks.rados.rados.0.smithi012.stdout:1523: seq_num 481 ranges {6807552=458752,7266304=401408} 2024-09-10T18:01:58.736 INFO:tasks.rados.rados.0.smithi012.stdout:1523: writing smithi01278544-29 from 6807552 to 7266304 tid 1 2024-09-10T18:01:58.739 INFO:tasks.rados.rados.0.smithi012.stdout:1523: writing smithi01278544-29 from 7266304 to 7667712 tid 2 2024-09-10T18:01:58.739 INFO:tasks.rados.rados.0.smithi012.stdout:1524: snap_remove snap 155 2024-09-10T18:01:58.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[89611]: pgmap v258: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 145 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 649 KiB/s rd, 554 KiB/s wr, 9 op/s; 29/267 objects degraded (10.861%) 2024-09-10T18:01:58.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:58.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:58.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:58.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[89611]: osdmap e394: 8 total, 7 up, 8 in 2024-09-10T18:01:58.989 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[92029]: pgmap v258: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 145 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 649 KiB/s rd, 554 KiB/s wr, 9 op/s; 29/267 objects degraded (10.861%) 2024-09-10T18:01:58.989 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:58.989 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:58.989 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:58.989 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:01:58 smithi012 ceph-mon[92029]: osdmap e394: 8 total, 7 up, 8 in 2024-09-10T18:01:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:58 smithi089 ceph-mon[84132]: pgmap v258: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 145 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 649 KiB/s rd, 554 KiB/s wr, 9 op/s; 29/267 objects degraded (10.861%) 2024-09-10T18:01:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:01:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:58 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:01:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:01:58 smithi089 ceph-mon[84132]: osdmap e394: 8 total, 7 up, 8 in 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1524: done (1 left) 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1525: rmattr oid 40 current snap is 156 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1525: done (1 left) 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1526: delete oid 21 current snap is 156 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1523: finishing write tid 1 to smithi01278544-29 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1523: finishing write tid 2 to smithi01278544-29 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1523: finishing write tid 3 to smithi01278544-29 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1523: finishing write tid 4 to smithi01278544-29 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1523: oid 29 updating version 0 to 654 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1523: oid 29 version 654 is already newer than 653 2024-09-10T18:01:59.733 INFO:tasks.rados.rados.0.smithi012.stdout:1523: oid 29 updating version 654 to 655 2024-09-10T18:01:59.734 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 655 (ObjNum 481 snap 156 seq_num 481) dirty exists 2024-09-10T18:01:59.734 INFO:tasks.rados.rados.0.smithi012.stdout:1523: left oid 29 (ObjNum 481 snap 156 seq_num 481) 2024-09-10T18:01:59.737 INFO:tasks.rados.rados.0.smithi012.stdout:1523: done (1 left) 2024-09-10T18:01:59.738 INFO:tasks.rados.rados.0.smithi012.stdout:1526: done (0 left) 2024-09-10T18:01:59.738 INFO:tasks.rados.rados.0.smithi012.stdout:1527: read oid 10 snap -1 2024-09-10T18:01:59.738 INFO:tasks.rados.rados.0.smithi012.stdout:1527: expect (ObjNum 435 snap 144 seq_num 435) 2024-09-10T18:01:59.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 156 2024-09-10T18:01:59.738 INFO:tasks.rados.rados.0.smithi012.stdout:1528: seq_num 483 ranges {0=491520,491520=401408} 2024-09-10T18:01:59.741 INFO:tasks.rados.rados.0.smithi012.stdout:1528: writing smithi01278544-24 from 0 to 491520 tid 1 2024-09-10T18:01:59.743 INFO:tasks.rados.rados.0.smithi012.stdout:1528: writing smithi01278544-24 from 491520 to 892928 tid 2 2024-09-10T18:01:59.743 INFO:tasks.rados.rados.0.smithi012.stdout:1529: copy_from oid 50 from oid 18 current snap is 156 2024-09-10T18:01:59.743 INFO:tasks.rados.rados.0.smithi012.stdout:1530: rollback oid 27 current snap is 156 2024-09-10T18:01:59.743 INFO:tasks.rados.rados.0.smithi012.stdout:1530: done (3 left) 2024-09-10T18:01:59.743 INFO:tasks.rados.rados.0.smithi012.stdout:1531: snap_create 2024-09-10T18:01:59.746 INFO:tasks.rados.rados.0.smithi012.stdout:1528: finishing write tid 1 to smithi01278544-24 2024-09-10T18:01:59.747 INFO:tasks.rados.rados.0.smithi012.stdout:1528: finishing write tid 2 to smithi01278544-24 2024-09-10T18:01:59.747 INFO:tasks.rados.rados.0.smithi012.stdout:1528: finishing write tid 3 to smithi01278544-24 2024-09-10T18:01:59.747 INFO:tasks.rados.rados.0.smithi012.stdout:1529: finishing copy_from racing read to smithi01278544-50 2024-09-10T18:01:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1528: finishing write tid 4 to smithi01278544-24 2024-09-10T18:01:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1528: oid 24 updating version 0 to 735 2024-09-10T18:01:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1528: oid 24 updating version 735 to 737 2024-09-10T18:01:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1528: oid 24 version 737 is already newer than 736 2024-09-10T18:01:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 737 (ObjNum 483 snap 156 seq_num 483) dirty exists 2024-09-10T18:01:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1528: left oid 24 (ObjNum 483 snap 156 seq_num 483) 2024-09-10T18:01:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1529: finishing copy_from to smithi01278544-50 2024-09-10T18:01:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 739 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:01:59.761 INFO:tasks.rados.rados.0.smithi012.stdout:1527: expect (ObjNum 435 snap 144 seq_num 435) 2024-09-10T18:02:00.284 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:01:59 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:01:59.974+0000 7f86978f6640 -1 Falling back to public interface 2024-09-10T18:02:00.732 INFO:tasks.rados.rados.0.smithi012.stdout:1527: done (3 left) 2024-09-10T18:02:00.732 INFO:tasks.rados.rados.0.smithi012.stdout:1528: done (2 left) 2024-09-10T18:02:00.732 INFO:tasks.rados.rados.0.smithi012.stdout:1529: done (1 left) 2024-09-10T18:02:00.732 INFO:tasks.rados.rados.0.smithi012.stdout:1531: done (0 left) 2024-09-10T18:02:00.732 INFO:tasks.rados.rados.0.smithi012.stdout:1532: rollback oid 1 current snap is 157 2024-09-10T18:02:00.732 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 156 2024-09-10T18:02:00.733 INFO:tasks.rados.rados.0.smithi012.stdout:1533: read oid 32 snap -1 2024-09-10T18:02:00.733 INFO:tasks.rados.rados.0.smithi012.stdout:1533: expect (ObjNum 477 snap 155 seq_num 477) 2024-09-10T18:02:00.733 INFO:tasks.rados.rados.0.smithi012.stdout:1534: snap_create 2024-09-10T18:02:00.738 INFO:tasks.rados.rados.0.smithi012.stdout:1532: finishing rollback tid 0 to smithi01278544-1 2024-09-10T18:02:00.738 INFO:tasks.rados.rados.0.smithi012.stdout:1532: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:02:00.738 INFO:tasks.rados.rados.0.smithi012.stdout:1532: finishing rollback tid 2 to smithi01278544-1 2024-09-10T18:02:00.738 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 738 (ObjNum 476 snap 155 seq_num 476) dirty exists 2024-09-10T18:02:00.755 INFO:tasks.rados.rados.0.smithi012.stdout:1533: expect (ObjNum 477 snap 155 seq_num 477) 2024-09-10T18:02:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:00 smithi012 ceph-mon[89611]: pgmap v261: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 649 KiB/s rd, 744 KiB/s wr, 10 op/s; 30/270 objects degraded (11.111%) 2024-09-10T18:02:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:00 smithi012 ceph-mon[89611]: osdmap e395: 8 total, 7 up, 8 in 2024-09-10T18:02:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:00 smithi012 ceph-mon[92029]: pgmap v261: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 649 KiB/s rd, 744 KiB/s wr, 10 op/s; 30/270 objects degraded (11.111%) 2024-09-10T18:02:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:00 smithi012 ceph-mon[92029]: osdmap e395: 8 total, 7 up, 8 in 2024-09-10T18:02:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:00 smithi089 ceph-mon[84132]: pgmap v261: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 649 KiB/s rd, 744 KiB/s wr, 10 op/s; 30/270 objects degraded (11.111%) 2024-09-10T18:02:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:00 smithi089 ceph-mon[84132]: osdmap e395: 8 total, 7 up, 8 in 2024-09-10T18:02:01.733 INFO:tasks.rados.rados.0.smithi012.stdout:1532: done (2 left) 2024-09-10T18:02:01.733 INFO:tasks.rados.rados.0.smithi012.stdout:1533: done (1 left) 2024-09-10T18:02:01.733 INFO:tasks.rados.rados.0.smithi012.stdout:1534: done (0 left) 2024-09-10T18:02:01.733 INFO:tasks.rados.rados.0.smithi012.stdout:1535: snap_create 2024-09-10T18:02:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[89611]: osdmap e396: 8 total, 7 up, 8 in 2024-09-10T18:02:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[89611]: osdmap e397: 8 total, 7 up, 8 in 2024-09-10T18:02:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[92029]: osdmap e396: 8 total, 7 up, 8 in 2024-09-10T18:02:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:01 smithi012 ceph-mon[92029]: osdmap e397: 8 total, 7 up, 8 in 2024-09-10T18:02:02.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:01 smithi089 ceph-mon[84132]: osdmap e396: 8 total, 7 up, 8 in 2024-09-10T18:02:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:01 smithi089 ceph-mon[84132]: osdmap e397: 8 total, 7 up, 8 in 2024-09-10T18:02:02.694 INFO:tasks.rados.rados.0.smithi012.stdout:1535: done (0 left) 2024-09-10T18:02:02.694 INFO:tasks.rados.rados.0.smithi012.stdout:1536: copy_from oid 10 from oid 15 current snap is 159 2024-09-10T18:02:02.694 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 159 2024-09-10T18:02:02.694 INFO:tasks.rados.rados.0.smithi012.stdout:1537: seq_num 484 ranges {4841472=507904,5349376=401408} 2024-09-10T18:02:02.723 INFO:tasks.rados.rados.0.smithi012.stdout:1537: writing smithi01278544-35 from 4841472 to 5349376 tid 1 2024-09-10T18:02:02.725 INFO:tasks.rados.rados.0.smithi012.stdout:1537: writing smithi01278544-35 from 5349376 to 5750784 tid 2 2024-09-10T18:02:02.725 INFO:tasks.rados.rados.0.smithi012.stdout:1538: copy_from oid 6 from oid 14 current snap is 159 2024-09-10T18:02:02.725 INFO:tasks.rados.rados.0.smithi012.stdout:1536: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:02:02.725 INFO:tasks.rados.rados.0.smithi012.stdout:1536: finishing copy_from to smithi01278544-10 2024-09-10T18:02:02.726 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 735 (ObjNum 445 snap 150 seq_num 445) dirty exists 2024-09-10T18:02:02.726 INFO:tasks.rados.rados.0.smithi012.stdout:1536: done (2 left) 2024-09-10T18:02:02.726 INFO:tasks.rados.rados.0.smithi012.stdout:1539: snap_create 2024-09-10T18:02:02.728 INFO:tasks.rados.rados.0.smithi012.stdout:1537: finishing write tid 1 to smithi01278544-35 2024-09-10T18:02:02.728 INFO:tasks.rados.rados.0.smithi012.stdout:1537: finishing write tid 2 to smithi01278544-35 2024-09-10T18:02:02.728 INFO:tasks.rados.rados.0.smithi012.stdout:1537: finishing write tid 3 to smithi01278544-35 2024-09-10T18:02:02.729 INFO:tasks.rados.rados.0.smithi012.stdout:1537: finishing write tid 4 to smithi01278544-35 2024-09-10T18:02:02.729 INFO:tasks.rados.rados.0.smithi012.stdout:1537: oid 35 updating version 0 to 740 2024-09-10T18:02:02.729 INFO:tasks.rados.rados.0.smithi012.stdout:1537: oid 35 version 740 is already newer than 739 2024-09-10T18:02:02.730 INFO:tasks.rados.rados.0.smithi012.stdout:1537: oid 35 updating version 740 to 741 2024-09-10T18:02:02.730 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 741 (ObjNum 484 snap 159 seq_num 484) dirty exists 2024-09-10T18:02:02.730 INFO:tasks.rados.rados.0.smithi012.stdout:1537: left oid 35 (ObjNum 484 snap 159 seq_num 484) 2024-09-10T18:02:02.732 INFO:tasks.rados.rados.0.smithi012.stdout:1538: finishing copy_from racing read to smithi01278544-6 2024-09-10T18:02:02.733 INFO:tasks.rados.rados.0.smithi012.stdout:1538: finishing copy_from to smithi01278544-6 2024-09-10T18:02:02.733 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 994 (ObjNum 363 snap 117 seq_num 363) dirty exists 2024-09-10T18:02:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[89611]: pgmap v264: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 147 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 396 KiB/s wr, 1 op/s; 30/267 objects degraded (11.236%) 2024-09-10T18:02:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 30/267 objects degraded (11.236%), 8 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[89611]: osdmap e398: 8 total, 7 up, 8 in 2024-09-10T18:02:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[92029]: pgmap v264: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 147 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 396 KiB/s wr, 1 op/s; 30/267 objects degraded (11.236%) 2024-09-10T18:02:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 30/267 objects degraded (11.236%), 8 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:02 smithi012 ceph-mon[92029]: osdmap e398: 8 total, 7 up, 8 in 2024-09-10T18:02:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:02 smithi089 ceph-mon[84132]: pgmap v264: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 147 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 396 KiB/s wr, 1 op/s; 30/267 objects degraded (11.236%) 2024-09-10T18:02:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:02 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 30/267 objects degraded (11.236%), 8 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:02 smithi089 ceph-mon[84132]: osdmap e398: 8 total, 7 up, 8 in 2024-09-10T18:02:03.697 INFO:tasks.rados.rados.0.smithi012.stdout:1537: done (2 left) 2024-09-10T18:02:03.697 INFO:tasks.rados.rados.0.smithi012.stdout:1538: done (1 left) 2024-09-10T18:02:03.697 INFO:tasks.rados.rados.0.smithi012.stdout:1539: done (0 left) 2024-09-10T18:02:03.697 INFO:tasks.rados.rados.0.smithi012.stdout:1540: delete oid 36 current snap is 160 2024-09-10T18:02:03.702 INFO:tasks.rados.rados.0.smithi012.stdout:1540: done (0 left) 2024-09-10T18:02:03.702 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 160 2024-09-10T18:02:03.702 INFO:tasks.rados.rados.0.smithi012.stdout:1541: seq_num 486 ranges {7299072=548864,7847936=401408} 2024-09-10T18:02:03.727 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:02:03.464+0000 7f86978f6640 -1 osd.3 387 log_to_monitors true 2024-09-10T18:02:03.728 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:02:03.726+0000 7f868f6a0640 -1 osd.3 387 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T18:02:03.745 INFO:tasks.rados.rados.0.smithi012.stdout:1541: writing smithi01278544-4 from 7299072 to 7847936 tid 1 2024-09-10T18:02:03.748 INFO:tasks.rados.rados.0.smithi012.stdout:1541: writing smithi01278544-4 from 7847936 to 8249344 tid 2 2024-09-10T18:02:03.748 INFO:tasks.rados.rados.0.smithi012.stdout:1542: rollback oid 39 current snap is 160 2024-09-10T18:02:03.748 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 159 2024-09-10T18:02:03.748 INFO:tasks.rados.rados.0.smithi012.stdout:1543: read oid 48 snap 156 2024-09-10T18:02:03.749 INFO:tasks.rados.rados.0.smithi012.stdout:1543: expect (ObjNum 462 snap 154 seq_num 462) 2024-09-10T18:02:03.749 INFO:tasks.rados.rados.0.smithi012.stdout:1544: rollback oid 36 current snap is 160 2024-09-10T18:02:03.749 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 159 2024-09-10T18:02:03.749 INFO:tasks.rados.rados.0.smithi012.stdout:1545: rmattr oid 5 current snap is 160 2024-09-10T18:02:03.749 INFO:tasks.rados.rados.0.smithi012.stdout:1545: done (4 left) 2024-09-10T18:02:03.749 INFO:tasks.rados.rados.0.smithi012.stdout:1546: setattr oid 8 current snap is 160 2024-09-10T18:02:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:1547: read oid 14 snap 156 2024-09-10T18:02:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:1547: expect (ObjNum 363 snap 117 seq_num 363) 2024-09-10T18:02:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:1548: setattr oid 50 current snap is 160 2024-09-10T18:02:03.752 INFO:tasks.rados.rados.0.smithi012.stdout:1542: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:02:03.752 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 0 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-09-10T18:02:03.752 INFO:tasks.rados.rados.0.smithi012.stdout:1544: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:02:03.754 INFO:tasks.rados.rados.0.smithi012.stdout:1544: finishing rollback tid 2 to smithi01278544-36 2024-09-10T18:02:03.754 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 740 (ObjNum 432 snap 143 seq_num 432) dirty exists 2024-09-10T18:02:03.754 INFO:tasks.rados.rados.0.smithi012.stdout:1542: done (6 left) 2024-09-10T18:02:03.754 INFO:tasks.rados.rados.0.smithi012.stdout:1544: done (5 left) 2024-09-10T18:02:03.755 INFO:tasks.rados.rados.0.smithi012.stdout:1549: snap_remove snap 159 2024-09-10T18:02:03.982 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-mon[89611]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T18:02:03.983 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-mon[89611]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T18:02:03.983 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-mon[89611]: osdmap e399: 8 total, 7 up, 8 in 2024-09-10T18:02:03.983 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-mon[89611]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:02:03.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-mon[92029]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T18:02:03.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-mon[92029]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T18:02:03.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-mon[92029]: osdmap e399: 8 total, 7 up, 8 in 2024-09-10T18:02:03.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-mon[92029]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:02:04.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:03 smithi089 ceph-mon[84132]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T18:02:04.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:03 smithi089 ceph-mon[84132]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T18:02:04.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:03 smithi089 ceph-mon[84132]: osdmap e399: 8 total, 7 up, 8 in 2024-09-10T18:02:04.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:03 smithi089 ceph-mon[84132]: from='osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]} : dispatch 2024-09-10T18:02:04.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:02:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:02:03] "GET /metrics HTTP/1.1" 200 36291 "" "Prometheus/2.43.0" 2024-09-10T18:02:04.700 INFO:tasks.rados.rados.0.smithi012.stdout:1549: done (5 left) 2024-09-10T18:02:04.700 INFO:tasks.rados.rados.0.smithi012.stdout:1550: rmattr oid 5 current snap is 160 2024-09-10T18:02:04.700 INFO:tasks.rados.rados.0.smithi012.stdout:1550: done (5 left) 2024-09-10T18:02:04.700 INFO:tasks.rados.rados.0.smithi012.stdout:1551: rollback oid 22 current snap is 160 2024-09-10T18:02:04.700 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 22 to 156 2024-09-10T18:02:04.700 INFO:tasks.rados.rados.0.smithi012.stdout:1552: rollback oid 12 current snap is 160 2024-09-10T18:02:04.700 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 12 to 158 2024-09-10T18:02:04.701 INFO:tasks.rados.rados.0.smithi012.stdout:1553: read oid 9 snap -1 2024-09-10T18:02:04.701 INFO:tasks.rados.rados.0.smithi012.stdout:1553: expect (ObjNum 434 snap 144 seq_num 434) 2024-09-10T18:02:04.701 INFO:tasks.rados.rados.0.smithi012.stdout:1554: read oid 38 snap -1 2024-09-10T18:02:04.701 INFO:tasks.rados.rados.0.smithi012.stdout:1554: expect (ObjNum 447 snap 151 seq_num 447) 2024-09-10T18:02:04.701 INFO:tasks.rados.rados.0.smithi012.stdout:1555: setattr oid 3 current snap is 160 2024-09-10T18:02:04.701 INFO:tasks.rados.rados.0.smithi012.stdout:1556: snap_remove snap 157 2024-09-10T18:02:05.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[89611]: pgmap v267: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.6 MiB/s wr, 7 op/s; 31/228 objects degraded (13.596%) 2024-09-10T18:02:05.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[89611]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:02:05.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[89611]: osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827] boot 2024-09-10T18:02:05.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[89611]: osdmap e400: 8 total, 8 up, 8 in 2024-09-10T18:02:05.009 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T18:02:05.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[92029]: pgmap v267: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.6 MiB/s wr, 7 op/s; 31/228 objects degraded (13.596%) 2024-09-10T18:02:05.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[92029]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:02:05.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[92029]: osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827] boot 2024-09-10T18:02:05.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[92029]: osdmap e400: 8 total, 8 up, 8 in 2024-09-10T18:02:05.010 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:04 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T18:02:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:04 smithi089 ceph-mon[84132]: pgmap v267: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.6 MiB/s wr, 7 op/s; 31/228 objects degraded (13.596%) 2024-09-10T18:02:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:04 smithi089 ceph-mon[84132]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:02:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:04 smithi089 ceph-mon[84132]: osd.3 [v2:172.21.15.12:6826/74911827,v1:172.21.15.12:6827/74911827] boot 2024-09-10T18:02:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:04 smithi089 ceph-mon[84132]: osdmap e400: 8 total, 8 up, 8 in 2024-09-10T18:02:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:04 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T18:02:05.700 INFO:tasks.rados.rados.0.smithi012.stdout:1556: done (10 left) 2024-09-10T18:02:05.700 INFO:tasks.rados.rados.0.smithi012.stdout:1557: snap_create 2024-09-10T18:02:05.700 INFO:tasks.rados.rados.0.smithi012.stdout:1541: finishing write tid 1 to smithi01278544-4 2024-09-10T18:02:05.700 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 995 (ObjNum 418 snap 135 seq_num 418) dirty exists 2024-09-10T18:02:05.700 INFO:tasks.rados.rados.0.smithi012.stdout:1547: expect (ObjNum 363 snap 117 seq_num 363) 2024-09-10T18:02:05.773 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 740 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:02:05.773 INFO:tasks.rados.rados.0.smithi012.stdout:1541: finishing write tid 2 to smithi01278544-4 2024-09-10T18:02:05.773 INFO:tasks.rados.rados.0.smithi012.stdout:1541: finishing write tid 3 to smithi01278544-4 2024-09-10T18:02:05.773 INFO:tasks.rados.rados.0.smithi012.stdout:1541: finishing write tid 4 to smithi01278544-4 2024-09-10T18:02:05.773 INFO:tasks.rados.rados.0.smithi012.stdout:1541: oid 4 updating version 0 to 823 2024-09-10T18:02:05.773 INFO:tasks.rados.rados.0.smithi012.stdout:1541: oid 4 version 823 is already newer than 822 2024-09-10T18:02:05.773 INFO:tasks.rados.rados.0.smithi012.stdout:1541: oid 4 updating version 823 to 824 2024-09-10T18:02:05.773 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 824 (ObjNum 486 snap 160 seq_num 486) dirty exists 2024-09-10T18:02:05.774 INFO:tasks.rados.rados.0.smithi012.stdout:1541: left oid 4 (ObjNum 486 snap 160 seq_num 486) 2024-09-10T18:02:05.774 INFO:tasks.rados.rados.0.smithi012.stdout:1543: expect (ObjNum 462 snap 154 seq_num 462) 2024-09-10T18:02:06.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:02:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:02:05.949+0000 7f7a9b686640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-09-10T18:02:06.137 INFO:tasks.rados.rados.0.smithi012.stdout:1551: finishing rollback tid 0 to smithi01278544-22 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:1551: finishing rollback tid 1 to smithi01278544-22 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:1551: finishing rollback tid 2 to smithi01278544-22 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1137 (ObjNum 464 snap 154 seq_num 464) dirty exists 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:1552: finishing rollback tid 0 to smithi01278544-12 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:1552: finishing rollback tid 1 to smithi01278544-12 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:1552: finishing rollback tid 2 to smithi01278544-12 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1141 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 656 (ObjNum 469 snap 154 seq_num 469) dirty exists 2024-09-10T18:02:06.138 INFO:tasks.rados.rados.0.smithi012.stdout:1553: expect (ObjNum 434 snap 144 seq_num 434) 2024-09-10T18:02:06.139 INFO:tasks.rados.rados.0.smithi012.stdout:1554: expect (ObjNum 447 snap 151 seq_num 447) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1541: done (10 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1543: done (9 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1546: done (8 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1547: done (7 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1548: done (6 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1551: done (5 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1552: done (4 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1553: done (3 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1554: done (2 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1555: done (1 left) 2024-09-10T18:02:06.704 INFO:tasks.rados.rados.0.smithi012.stdout:1557: done (0 left) 2024-09-10T18:02:06.705 INFO:tasks.rados.rados.0.smithi012.stdout:1558: read oid 27 snap -1 2024-09-10T18:02:06.705 INFO:tasks.rados.rados.0.smithi012.stdout:1558: expect deleted 2024-09-10T18:02:06.705 INFO:tasks.rados.rados.0.smithi012.stdout:1559: rmattr oid 22 current snap is 161 2024-09-10T18:02:06.705 INFO:tasks.rados.rados.0.smithi012.stdout:1560: read oid 43 snap 160 2024-09-10T18:02:06.705 INFO:tasks.rados.rados.0.smithi012.stdout:1560: expect (ObjNum 392 snap 126 seq_num 392) 2024-09-10T18:02:06.705 INFO:tasks.rados.rados.0.smithi012.stdout:1561: snap_create 2024-09-10T18:02:06.708 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1149 (ObjNum 464 snap 154 seq_num 464) dirty exists 2024-09-10T18:02:06.719 INFO:tasks.rados.rados.0.smithi012.stdout:1560: expect (ObjNum 392 snap 126 seq_num 392) 2024-09-10T18:02:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: pgmap v270: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.4 MiB/s wr, 6 op/s; 32/231 objects degraded (13.853%) 2024-09-10T18:02:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: osdmap e401: 8 total, 8 up, 8 in 2024-09-10T18:02:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-10T18:02:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: pgmap v270: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.4 MiB/s wr, 6 op/s; 32/231 objects degraded (13.853%) 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: osdmap e401: 8 total, 8 up, 8 in 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:06 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: pgmap v270: 121 pgs: 33 active+undersized, 8 active+undersized+degraded, 80 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 3.4 MiB/s wr, 6 op/s; 32/231 objects degraded (13.853%) 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: osdmap e401: 8 total, 8 up, 8 in 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:07.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:06 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-10T18:02:07.712 INFO:tasks.rados.rados.0.smithi012.stdout:1558: done (3 left) 2024-09-10T18:02:07.712 INFO:tasks.rados.rados.0.smithi012.stdout:1559: done (2 left) 2024-09-10T18:02:07.712 INFO:tasks.rados.rados.0.smithi012.stdout:1560: done (1 left) 2024-09-10T18:02:07.712 INFO:tasks.rados.rados.0.smithi012.stdout:1561: done (0 left) 2024-09-10T18:02:07.713 INFO:tasks.rados.rados.0.smithi012.stdout:1562: setattr oid 18 current snap is 162 2024-09-10T18:02:07.714 INFO:tasks.rados.rados.0.smithi012.stdout:1563: setattr oid 47 current snap is 162 2024-09-10T18:02:07.716 INFO:tasks.rados.rados.0.smithi012.stdout:1564: delete oid 41 current snap is 162 2024-09-10T18:02:07.721 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 746 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:02:07.725 INFO:tasks.rados.rados.0.smithi012.stdout:1562: done (2 left) 2024-09-10T18:02:07.725 INFO:tasks.rados.rados.0.smithi012.stdout:1564: done (1 left) 2024-09-10T18:02:07.725 INFO:tasks.rados.rados.0.smithi012.stdout:1565: snap_create 2024-09-10T18:02:07.725 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1058 (ObjNum 473 snap 154 seq_num 473) dirty exists 2024-09-10T18:02:08.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:07 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T18:02:08.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:07 smithi012 ceph-mon[89611]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-09-10T18:02:08.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:07 smithi012 ceph-mon[89611]: osdmap e402: 8 total, 8 up, 8 in 2024-09-10T18:02:08.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:07 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 32/231 objects degraded (13.853%), 8 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:08.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:07 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T18:02:08.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:07 smithi012 ceph-mon[92029]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-09-10T18:02:08.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:07 smithi012 ceph-mon[92029]: osdmap e402: 8 total, 8 up, 8 in 2024-09-10T18:02:08.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:07 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 32/231 objects degraded (13.853%), 8 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:07 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T18:02:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:07 smithi089 ceph-mon[84132]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-09-10T18:02:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:07 smithi089 ceph-mon[84132]: osdmap e402: 8 total, 8 up, 8 in 2024-09-10T18:02:08.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:07 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 32/231 objects degraded (13.853%), 8 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:08.713 INFO:tasks.rados.rados.0.smithi012.stdout:1563: done (1 left) 2024-09-10T18:02:08.713 INFO:tasks.rados.rados.0.smithi012.stdout:1565: done (0 left) 2024-09-10T18:02:08.713 INFO:tasks.rados.rados.0.smithi012.stdout:1566: copy_from oid 49 from oid 48 current snap is 163 2024-09-10T18:02:08.713 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 163 2024-09-10T18:02:08.713 INFO:tasks.rados.rados.0.smithi012.stdout:1567: seq_num 488 ranges {253952=581632,835584=401408} 2024-09-10T18:02:08.718 INFO:tasks.rados.rados.0.smithi012.stdout:1567: writing smithi01278544-15 from 253952 to 835584 tid 1 2024-09-10T18:02:08.721 INFO:tasks.rados.rados.0.smithi012.stdout:1567: writing smithi01278544-15 from 835584 to 1236992 tid 2 2024-09-10T18:02:08.721 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 163 2024-09-10T18:02:08.721 INFO:tasks.rados.rados.0.smithi012.stdout:1568: seq_num 489 ranges {2293760=598016,2891776=401408} 2024-09-10T18:02:08.737 INFO:tasks.rados.rados.0.smithi012.stdout:1568: writing smithi01278544-17 from 2293760 to 2891776 tid 1 2024-09-10T18:02:08.740 INFO:tasks.rados.rados.0.smithi012.stdout:1568: writing smithi01278544-17 from 2891776 to 3293184 tid 2 2024-09-10T18:02:08.740 INFO:tasks.rados.rados.0.smithi012.stdout:1569: rollback oid 28 current snap is 163 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 28 to 158 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: finishing write tid 1 to smithi01278544-15 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: finishing write tid 2 to smithi01278544-15 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: finishing write tid 3 to smithi01278544-15 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: finishing write tid 4 to smithi01278544-15 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: oid 15 updating version 0 to 747 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: oid 15 updating version 747 to 749 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: oid 15 version 749 is already newer than 748 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 749 (ObjNum 488 snap 163 seq_num 488) dirty exists 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: left oid 15 (ObjNum 488 snap 163 seq_num 488) 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1567: done (3 left) 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 163 2024-09-10T18:02:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1570: seq_num 490 ranges {4079616=614400,4694016=401408} 2024-09-10T18:02:08.766 INFO:tasks.rados.rados.0.smithi012.stdout:1570: writing smithi01278544-37 from 4079616 to 4694016 tid 1 2024-09-10T18:02:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:1570: writing smithi01278544-37 from 4694016 to 5095424 tid 2 2024-09-10T18:02:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:1571: delete oid 50 current snap is 163 2024-09-10T18:02:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:1568: finishing write tid 1 to smithi01278544-17 2024-09-10T18:02:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:1568: finishing write tid 2 to smithi01278544-17 2024-09-10T18:02:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:1568: finishing write tid 3 to smithi01278544-17 2024-09-10T18:02:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:1569: finishing rollback tid 0 to smithi01278544-28 2024-09-10T18:02:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:1569: finishing rollback tid 1 to smithi01278544-28 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:1569: finishing rollback tid 2 to smithi01278544-28 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 311 (ObjNum 405 snap 131 seq_num 405) dirty exists 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:1568: finishing write tid 4 to smithi01278544-17 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:1568: oid 17 updating version 0 to 536 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:1568: oid 17 updating version 536 to 537 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:1568: oid 17 version 537 is already newer than 535 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 537 (ObjNum 489 snap 163 seq_num 489) dirty exists 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:1568: left oid 17 (ObjNum 489 snap 163 seq_num 489) 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:1566: finishing copy_from racing read to smithi01278544-49 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:1566: finishing copy_from to smithi01278544-49 2024-09-10T18:02:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 733 (ObjNum 462 snap 154 seq_num 462) dirty exists 2024-09-10T18:02:08.771 INFO:tasks.rados.rados.0.smithi012.stdout:1566: done (4 left) 2024-09-10T18:02:08.771 INFO:tasks.rados.rados.0.smithi012.stdout:1568: done (3 left) 2024-09-10T18:02:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1569: done (2 left) 2024-09-10T18:02:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1571: done (1 left) 2024-09-10T18:02:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 163 2024-09-10T18:02:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1570: finishing write tid 1 to smithi01278544-37 2024-09-10T18:02:08.772 INFO:tasks.rados.rados.0.smithi012.stdout:1572: seq_num 492 ranges {0=647168,647168=401408} 2024-09-10T18:02:08.775 INFO:tasks.rados.rados.0.smithi012.stdout:1572: writing smithi01278544-44 from 0 to 647168 tid 1 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1572: writing smithi01278544-44 from 647168 to 1048576 tid 2 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1570: finishing write tid 2 to smithi01278544-37 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1570: finishing write tid 3 to smithi01278544-37 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1570: finishing write tid 4 to smithi01278544-37 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1570: oid 37 updating version 0 to 828 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1570: oid 37 version 828 is already newer than 826 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1570: oid 37 version 828 is already newer than 827 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 828 (ObjNum 490 snap 163 seq_num 490) dirty exists 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1570: left oid 37 (ObjNum 490 snap 163 seq_num 490) 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1573: read oid 2 snap -1 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1573: expect (ObjNum 449 snap 152 seq_num 449) 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1570: done (2 left) 2024-09-10T18:02:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:1574: snap_create 2024-09-10T18:02:08.780 INFO:tasks.rados.rados.0.smithi012.stdout:1572: finishing write tid 1 to smithi01278544-44 2024-09-10T18:02:08.780 INFO:tasks.rados.rados.0.smithi012.stdout:1572: finishing write tid 2 to smithi01278544-44 2024-09-10T18:02:08.780 INFO:tasks.rados.rados.0.smithi012.stdout:1572: finishing write tid 3 to smithi01278544-44 2024-09-10T18:02:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:1573: expect (ObjNum 449 snap 152 seq_num 449) 2024-09-10T18:02:08.790 INFO:tasks.rados.rados.0.smithi012.stdout:1572: finishing write tid 4 to smithi01278544-44 2024-09-10T18:02:08.790 INFO:tasks.rados.rados.0.smithi012.stdout:1572: oid 44 updating version 0 to 658 2024-09-10T18:02:08.790 INFO:tasks.rados.rados.0.smithi012.stdout:1572: oid 44 updating version 658 to 659 2024-09-10T18:02:08.790 INFO:tasks.rados.rados.0.smithi012.stdout:1572: oid 44 version 659 is already newer than 657 2024-09-10T18:02:08.790 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 659 (ObjNum 492 snap 163 seq_num 492) dirty exists 2024-09-10T18:02:08.790 INFO:tasks.rados.rados.0.smithi012.stdout:1572: left oid 44 (ObjNum 492 snap 163 seq_num 492) 2024-09-10T18:02:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:08 smithi012 ceph-mon[89611]: pgmap v273: 121 pgs: 19 active+undersized, 3 active+undersized+degraded, 99 active+clean; 130 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 920 KiB/s wr, 21 op/s; 13/246 objects degraded (5.285%); 7.1 MiB/s, 1 objects/s recovering 2024-09-10T18:02:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:08 smithi012 ceph-mon[89611]: osdmap e403: 8 total, 8 up, 8 in 2024-09-10T18:02:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:08 smithi012 ceph-mon[92029]: pgmap v273: 121 pgs: 19 active+undersized, 3 active+undersized+degraded, 99 active+clean; 130 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 920 KiB/s wr, 21 op/s; 13/246 objects degraded (5.285%); 7.1 MiB/s, 1 objects/s recovering 2024-09-10T18:02:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:08 smithi012 ceph-mon[92029]: osdmap e403: 8 total, 8 up, 8 in 2024-09-10T18:02:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:08 smithi089 ceph-mon[84132]: pgmap v273: 121 pgs: 19 active+undersized, 3 active+undersized+degraded, 99 active+clean; 130 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 920 KiB/s wr, 21 op/s; 13/246 objects degraded (5.285%); 7.1 MiB/s, 1 objects/s recovering 2024-09-10T18:02:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:08 smithi089 ceph-mon[84132]: osdmap e403: 8 total, 8 up, 8 in 2024-09-10T18:02:09.726 INFO:tasks.rados.rados.0.smithi012.stdout:1572: done (2 left) 2024-09-10T18:02:09.726 INFO:tasks.rados.rados.0.smithi012.stdout:1573: done (1 left) 2024-09-10T18:02:09.726 INFO:tasks.rados.rados.0.smithi012.stdout:1574: done (0 left) 2024-09-10T18:02:09.726 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 164 2024-09-10T18:02:09.726 INFO:tasks.rados.rados.0.smithi012.stdout:1575: seq_num 493 ranges {0=663552,663552=401408} 2024-09-10T18:02:09.729 INFO:tasks.rados.rados.0.smithi012.stdout:1575: writing smithi01278544-27 from 0 to 663552 tid 1 2024-09-10T18:02:09.732 INFO:tasks.rados.rados.0.smithi012.stdout:1575: writing smithi01278544-27 from 663552 to 1064960 tid 2 2024-09-10T18:02:09.732 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 164 2024-09-10T18:02:09.732 INFO:tasks.rados.rados.0.smithi012.stdout:1576: seq_num 494 ranges {1236992=679936,1916928=401408} 2024-09-10T18:02:09.742 INFO:tasks.rados.rados.0.smithi012.stdout:1576: writing smithi01278544-15 from 1236992 to 1916928 tid 1 2024-09-10T18:02:09.745 INFO:tasks.rados.rados.0.smithi012.stdout:1576: writing smithi01278544-15 from 1916928 to 2318336 tid 2 2024-09-10T18:02:09.745 INFO:tasks.rados.rados.0.smithi012.stdout:1577: read oid 29 snap -1 2024-09-10T18:02:09.745 INFO:tasks.rados.rados.0.smithi012.stdout:1577: expect (ObjNum 481 snap 156 seq_num 481) 2024-09-10T18:02:09.745 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 164 2024-09-10T18:02:09.745 INFO:tasks.rados.rados.0.smithi012.stdout:1575: finishing write tid 1 to smithi01278544-27 2024-09-10T18:02:09.746 INFO:tasks.rados.rados.0.smithi012.stdout:1575: finishing write tid 2 to smithi01278544-27 2024-09-10T18:02:09.746 INFO:tasks.rados.rados.0.smithi012.stdout:1578: seq_num 495 ranges {0=696320,696320=401408} 2024-09-10T18:02:09.750 INFO:tasks.rados.rados.0.smithi012.stdout:1578: writing smithi01278544-31 from 0 to 696320 tid 1 2024-09-10T18:02:09.753 INFO:tasks.rados.rados.0.smithi012.stdout:1578: writing smithi01278544-31 from 696320 to 1097728 tid 2 2024-09-10T18:02:09.753 INFO:tasks.rados.rados.0.smithi012.stdout:1579: read oid 35 snap -1 2024-09-10T18:02:09.753 INFO:tasks.rados.rados.0.smithi012.stdout:1579: expect (ObjNum 484 snap 159 seq_num 484) 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1580: delete oid 23 current snap is 164 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1575: finishing write tid 3 to smithi01278544-27 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1575: finishing write tid 4 to smithi01278544-27 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1575: oid 27 updating version 0 to 662 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1575: oid 27 version 662 is already newer than 661 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1575: oid 27 version 662 is already newer than 660 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 662 (ObjNum 493 snap 164 seq_num 493) dirty exists 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1575: left oid 27 (ObjNum 493 snap 164 seq_num 493) 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1576: finishing write tid 1 to smithi01278544-15 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1576: finishing write tid 2 to smithi01278544-15 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1576: finishing write tid 3 to smithi01278544-15 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1576: finishing write tid 4 to smithi01278544-15 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1576: oid 15 updating version 0 to 751 2024-09-10T18:02:09.754 INFO:tasks.rados.rados.0.smithi012.stdout:1576: oid 15 updating version 751 to 752 2024-09-10T18:02:09.755 INFO:tasks.rados.rados.0.smithi012.stdout:1576: oid 15 version 752 is already newer than 750 2024-09-10T18:02:09.755 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 752 (ObjNum 494 snap 164 seq_num 494) dirty exists 2024-09-10T18:02:09.755 INFO:tasks.rados.rados.0.smithi012.stdout:1576: left oid 15 (ObjNum 494 snap 164 seq_num 494) 2024-09-10T18:02:09.757 INFO:tasks.rados.rados.0.smithi012.stdout:1578: finishing write tid 1 to smithi01278544-31 2024-09-10T18:02:09.757 INFO:tasks.rados.rados.0.smithi012.stdout:1578: finishing write tid 2 to smithi01278544-31 2024-09-10T18:02:09.758 INFO:tasks.rados.rados.0.smithi012.stdout:1578: finishing write tid 3 to smithi01278544-31 2024-09-10T18:02:09.759 INFO:tasks.rados.rados.0.smithi012.stdout:1575: done (5 left) 2024-09-10T18:02:09.759 INFO:tasks.rados.rados.0.smithi012.stdout:1576: done (4 left) 2024-09-10T18:02:09.759 INFO:tasks.rados.rados.0.smithi012.stdout:1580: done (3 left) 2024-09-10T18:02:09.759 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 164 2024-09-10T18:02:09.759 INFO:tasks.rados.rados.0.smithi012.stdout:1581: seq_num 497 ranges {327680=729088,1056768=401408} 2024-09-10T18:02:09.765 INFO:tasks.rados.rados.0.smithi012.stdout:1581: writing smithi01278544-2 from 327680 to 1056768 tid 1 2024-09-10T18:02:09.768 INFO:tasks.rados.rados.0.smithi012.stdout:1581: writing smithi01278544-2 from 1056768 to 1458176 tid 2 2024-09-10T18:02:09.768 INFO:tasks.rados.rados.0.smithi012.stdout:1582: snap_remove snap 161 2024-09-10T18:02:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:09 smithi012 ceph-mon[89611]: osdmap e404: 8 total, 8 up, 8 in 2024-09-10T18:02:10.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:09 smithi012 ceph-mon[92029]: osdmap e404: 8 total, 8 up, 8 in 2024-09-10T18:02:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:09 smithi089 ceph-mon[84132]: osdmap e404: 8 total, 8 up, 8 in 2024-09-10T18:02:10.741 INFO:tasks.rados.rados.0.smithi012.stdout:1582: done (4 left) 2024-09-10T18:02:10.744 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 164 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1578: finishing write tid 4 to smithi01278544-31 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1578: oid 31 updating version 0 to 831 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1578: oid 31 version 831 is already newer than 830 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1578: oid 31 version 831 is already newer than 829 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 831 (ObjNum 495 snap 164 seq_num 495) dirty exists 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1578: left oid 31 (ObjNum 495 snap 164 seq_num 495) 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1581: finishing write tid 1 to smithi01278544-2 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1581: finishing write tid 2 to smithi01278544-2 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1581: finishing write tid 3 to smithi01278544-2 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1581: finishing write tid 4 to smithi01278544-2 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1581: oid 2 updating version 0 to 754 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1581: oid 2 updating version 754 to 755 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:1581: oid 2 version 755 is already newer than 753 2024-09-10T18:02:10.745 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 755 (ObjNum 497 snap 164 seq_num 497) dirty exists 2024-09-10T18:02:10.746 INFO:tasks.rados.rados.0.smithi012.stdout:1581: left oid 2 (ObjNum 497 snap 164 seq_num 497) 2024-09-10T18:02:10.746 INFO:tasks.rados.rados.0.smithi012.stdout:1577: expect (ObjNum 481 snap 156 seq_num 481) 2024-09-10T18:02:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:10 smithi012 ceph-mon[89611]: pgmap v276: 121 pgs: 121 active+clean; 130 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 920 KiB/s wr, 22 op/s; 11 MiB/s, 2 objects/s recovering 2024-09-10T18:02:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:10 smithi012 ceph-mon[89611]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/246 objects degraded (5.285%), 3 pgs degraded) 2024-09-10T18:02:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:10 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:02:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:10 smithi012 ceph-mon[89611]: osdmap e405: 8 total, 8 up, 8 in 2024-09-10T18:02:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:10 smithi012 ceph-mon[92029]: pgmap v276: 121 pgs: 121 active+clean; 130 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 920 KiB/s wr, 22 op/s; 11 MiB/s, 2 objects/s recovering 2024-09-10T18:02:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:10 smithi012 ceph-mon[92029]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/246 objects degraded (5.285%), 3 pgs degraded) 2024-09-10T18:02:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:10 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:02:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:10 smithi012 ceph-mon[92029]: osdmap e405: 8 total, 8 up, 8 in 2024-09-10T18:02:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:10 smithi089 ceph-mon[84132]: pgmap v276: 121 pgs: 121 active+clean; 130 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 920 KiB/s wr, 22 op/s; 11 MiB/s, 2 objects/s recovering 2024-09-10T18:02:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:10 smithi089 ceph-mon[84132]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/246 objects degraded (5.285%), 3 pgs degraded) 2024-09-10T18:02:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:10 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:02:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:10 smithi089 ceph-mon[84132]: osdmap e405: 8 total, 8 up, 8 in 2024-09-10T18:02:11.287 INFO:tasks.rados.rados.0.smithi012.stdout:1579: expect (ObjNum 484 snap 159 seq_num 484) 2024-09-10T18:02:11.572 INFO:tasks.rados.rados.0.smithi012.stdout:1583: seq_num 498 ranges {0=745472,745472=401408} 2024-09-10T18:02:11.575 INFO:tasks.rados.rados.0.smithi012.stdout:1583: writing smithi01278544-26 from 0 to 745472 tid 1 2024-09-10T18:02:11.578 INFO:tasks.rados.rados.0.smithi012.stdout:1583: writing smithi01278544-26 from 745472 to 1146880 tid 2 2024-09-10T18:02:11.578 INFO:tasks.rados.rados.0.smithi012.stdout:1577: done (4 left) 2024-09-10T18:02:11.578 INFO:tasks.rados.rados.0.smithi012.stdout:1578: done (3 left) 2024-09-10T18:02:11.578 INFO:tasks.rados.rados.0.smithi012.stdout:1579: done (2 left) 2024-09-10T18:02:11.578 INFO:tasks.rados.rados.0.smithi012.stdout:1581: done (1 left) 2024-09-10T18:02:11.578 INFO:tasks.rados.rados.0.smithi012.stdout:1584: snap_create 2024-09-10T18:02:11.581 INFO:tasks.rados.rados.0.smithi012.stdout:1583: finishing write tid 1 to smithi01278544-26 2024-09-10T18:02:11.581 INFO:tasks.rados.rados.0.smithi012.stdout:1583: finishing write tid 2 to smithi01278544-26 2024-09-10T18:02:11.581 INFO:tasks.rados.rados.0.smithi012.stdout:1583: finishing write tid 3 to smithi01278544-26 2024-09-10T18:02:11.582 INFO:tasks.rados.rados.0.smithi012.stdout:1583: finishing write tid 4 to smithi01278544-26 2024-09-10T18:02:11.582 INFO:tasks.rados.rados.0.smithi012.stdout:1583: oid 26 updating version 0 to 743 2024-09-10T18:02:11.582 INFO:tasks.rados.rados.0.smithi012.stdout:1583: oid 26 version 743 is already newer than 742 2024-09-10T18:02:11.582 INFO:tasks.rados.rados.0.smithi012.stdout:1583: oid 26 version 743 is already newer than 741 2024-09-10T18:02:11.582 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 743 (ObjNum 498 snap 164 seq_num 498) dirty exists 2024-09-10T18:02:11.583 INFO:tasks.rados.rados.0.smithi012.stdout:1583: left oid 26 (ObjNum 498 snap 164 seq_num 498) 2024-09-10T18:02:11.740 INFO:tasks.rados.rados.0.smithi012.stdout:1583: done (1 left) 2024-09-10T18:02:11.740 INFO:tasks.rados.rados.0.smithi012.stdout:1584: done (0 left) 2024-09-10T18:02:11.740 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 165 2024-09-10T18:02:11.740 INFO:tasks.rados.rados.0.smithi012.stdout:1585: seq_num 499 ranges {663552=761856,1425408=401408} 2024-09-10T18:02:11.747 INFO:tasks.rados.rados.0.smithi012.stdout:1585: writing smithi01278544-3 from 663552 to 1425408 tid 1 2024-09-10T18:02:11.750 INFO:tasks.rados.rados.0.smithi012.stdout:1585: writing smithi01278544-3 from 1425408 to 1826816 tid 2 2024-09-10T18:02:11.750 INFO:tasks.rados.rados.0.smithi012.stdout:1586: read oid 23 snap -1 2024-09-10T18:02:11.750 INFO:tasks.rados.rados.0.smithi012.stdout:1586: expect deleted 2024-09-10T18:02:11.750 INFO:tasks.rados.rados.0.smithi012.stdout:1587: read oid 30 snap 158 2024-09-10T18:02:11.751 INFO:tasks.rados.rados.0.smithi012.stdout:1587: expect deleted 2024-09-10T18:02:11.751 INFO:tasks.rados.rados.0.smithi012.stdout:1588: rmattr oid 13 current snap is 165 2024-09-10T18:02:11.751 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 165 2024-09-10T18:02:11.751 INFO:tasks.rados.rados.0.smithi012.stdout:1589: seq_num 500 ranges {0=778240,778240=401408} 2024-09-10T18:02:11.755 INFO:tasks.rados.rados.0.smithi012.stdout:1589: writing smithi01278544-40 from 0 to 778240 tid 1 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1589: writing smithi01278544-40 from 778240 to 1179648 tid 2 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1590: read oid 50 snap -1 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1590: expect deleted 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1591: rollback oid 31 current snap is 165 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 164 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 832 (ObjNum 145 snap 0 seq_num 3496394096) dirty exists 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1585: finishing write tid 1 to smithi01278544-3 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1585: finishing write tid 2 to smithi01278544-3 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1585: finishing write tid 3 to smithi01278544-3 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1585: finishing write tid 4 to smithi01278544-3 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1585: oid 3 updating version 0 to 663 2024-09-10T18:02:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1585: oid 3 updating version 663 to 665 2024-09-10T18:02:11.760 INFO:tasks.rados.rados.0.smithi012.stdout:1585: oid 3 version 665 is already newer than 664 2024-09-10T18:02:11.760 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 665 (ObjNum 499 snap 165 seq_num 499) dirty exists 2024-09-10T18:02:11.760 INFO:tasks.rados.rados.0.smithi012.stdout:1585: left oid 3 (ObjNum 499 snap 165 seq_num 499) 2024-09-10T18:02:11.760 INFO:tasks.rados.rados.0.smithi012.stdout:1585: done (6 left) 2024-09-10T18:02:11.760 INFO:tasks.rados.rados.0.smithi012.stdout:1586: done (5 left) 2024-09-10T18:02:11.760 INFO:tasks.rados.rados.0.smithi012.stdout:1587: done (4 left) 2024-09-10T18:02:11.760 INFO:tasks.rados.rados.0.smithi012.stdout:1588: done (3 left) 2024-09-10T18:02:11.760 INFO:tasks.rados.rados.0.smithi012.stdout:1592: delete oid 33 current snap is 165 2024-09-10T18:02:11.761 INFO:tasks.rados.rados.0.smithi012.stdout:1589: finishing write tid 1 to smithi01278544-40 2024-09-10T18:02:11.761 INFO:tasks.rados.rados.0.smithi012.stdout:1589: finishing write tid 2 to smithi01278544-40 2024-09-10T18:02:11.762 INFO:tasks.rados.rados.0.smithi012.stdout:1589: finishing write tid 3 to smithi01278544-40 2024-09-10T18:02:11.762 INFO:tasks.rados.rados.0.smithi012.stdout:1591: finishing rollback tid 0 to smithi01278544-31 2024-09-10T18:02:11.764 INFO:tasks.rados.rados.0.smithi012.stdout:1591: finishing rollback tid 1 to smithi01278544-31 2024-09-10T18:02:11.764 INFO:tasks.rados.rados.0.smithi012.stdout:1591: finishing rollback tid 2 to smithi01278544-31 2024-09-10T18:02:11.764 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 835 (ObjNum 495 snap 164 seq_num 495) dirty exists 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:1589: finishing write tid 4 to smithi01278544-40 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:1589: oid 40 updating version 0 to 1061 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:1589: oid 40 updating version 1061 to 1062 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:1589: oid 40 updating version 1062 to 1063 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1063 (ObjNum 500 snap 165 seq_num 500) dirty exists 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:1589: left oid 40 (ObjNum 500 snap 165 seq_num 500) 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:1589: done (3 left) 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:1590: done (2 left) 2024-09-10T18:02:11.765 INFO:tasks.rados.rados.0.smithi012.stdout:1591: done (1 left) 2024-09-10T18:02:11.766 INFO:tasks.rados.rados.0.smithi012.stdout:1592: done (0 left) 2024-09-10T18:02:11.766 INFO:tasks.rados.rados.0.smithi012.stdout:1593: read oid 14 snap 163 2024-09-10T18:02:11.766 INFO:tasks.rados.rados.0.smithi012.stdout:1593: expect (ObjNum 363 snap 117 seq_num 363) 2024-09-10T18:02:11.766 INFO:tasks.rados.rados.0.smithi012.stdout:1594: read oid 45 snap -1 2024-09-10T18:02:11.766 INFO:tasks.rados.rados.0.smithi012.stdout:1594: expect (ObjNum 406 snap 132 seq_num 406) 2024-09-10T18:02:11.766 INFO:tasks.rados.rados.0.smithi012.stdout:1595: snap_remove snap 162 2024-09-10T18:02:12.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:11 smithi012 ceph-mon[89611]: osdmap e406: 8 total, 8 up, 8 in 2024-09-10T18:02:12.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:11 smithi012 ceph-mon[92029]: osdmap e406: 8 total, 8 up, 8 in 2024-09-10T18:02:12.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:11 smithi089 ceph-mon[84132]: osdmap e406: 8 total, 8 up, 8 in 2024-09-10T18:02:12.697 INFO:tasks.rados.rados.0.smithi012.stdout:1595: done (2 left) 2024-09-10T18:02:12.697 INFO:tasks.rados.rados.0.smithi012.stdout:1596: snap_create 2024-09-10T18:02:12.697 INFO:tasks.rados.rados.0.smithi012.stdout:1593: expect (ObjNum 363 snap 117 seq_num 363) 2024-09-10T18:02:12.756 INFO:tasks.rados.rados.0.smithi012.stdout:1594: expect (ObjNum 406 snap 132 seq_num 406) 2024-09-10T18:02:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:12 smithi012 ceph-mon[89611]: pgmap v279: 121 pgs: 121 active+clean; 132 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 516 KiB/s wr, 4 op/s; 3.6 MiB/s, 0 objects/s recovering 2024-09-10T18:02:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:12 smithi012 ceph-mon[89611]: osdmap e407: 8 total, 8 up, 8 in 2024-09-10T18:02:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:12 smithi012 ceph-mon[89611]: osdmap e408: 8 total, 8 up, 8 in 2024-09-10T18:02:13.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:12 smithi012 ceph-mon[92029]: pgmap v279: 121 pgs: 121 active+clean; 132 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 516 KiB/s wr, 4 op/s; 3.6 MiB/s, 0 objects/s recovering 2024-09-10T18:02:13.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:12 smithi012 ceph-mon[92029]: osdmap e407: 8 total, 8 up, 8 in 2024-09-10T18:02:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:12 smithi012 ceph-mon[92029]: osdmap e408: 8 total, 8 up, 8 in 2024-09-10T18:02:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:12 smithi089 ceph-mon[84132]: pgmap v279: 121 pgs: 121 active+clean; 132 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 516 KiB/s wr, 4 op/s; 3.6 MiB/s, 0 objects/s recovering 2024-09-10T18:02:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:12 smithi089 ceph-mon[84132]: osdmap e407: 8 total, 8 up, 8 in 2024-09-10T18:02:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:12 smithi089 ceph-mon[84132]: osdmap e408: 8 total, 8 up, 8 in 2024-09-10T18:02:13.697 INFO:tasks.rados.rados.0.smithi012.stdout:1593: done (2 left) 2024-09-10T18:02:13.697 INFO:tasks.rados.rados.0.smithi012.stdout:1594: done (1 left) 2024-09-10T18:02:13.697 INFO:tasks.rados.rados.0.smithi012.stdout:1596: done (0 left) 2024-09-10T18:02:13.697 INFO:tasks.rados.rados.0.smithi012.stdout:1597: snap_create 2024-09-10T18:02:14.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:02:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:02:13] "GET /metrics HTTP/1.1" 200 36291 "" "Prometheus/2.43.0" 2024-09-10T18:02:14.700 INFO:tasks.rados.rados.0.smithi012.stdout:1597: done (0 left) 2024-09-10T18:02:14.700 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 167 2024-09-10T18:02:14.700 INFO:tasks.rados.rados.0.smithi012.stdout:1598: seq_num 502 ranges {1179648=409600,1589248=417792,2007040=385024} 2024-09-10T18:02:14.708 INFO:tasks.rados.rados.0.smithi012.stdout:1598: writing smithi01278544-40 from 1179648 to 1589248 tid 1 2024-09-10T18:02:14.711 INFO:tasks.rados.rados.0.smithi012.stdout:1598: writing smithi01278544-40 from 1589248 to 2007040 tid 2 2024-09-10T18:02:14.714 INFO:tasks.rados.rados.0.smithi012.stdout:1598: writing smithi01278544-40 from 2007040 to 2392064 tid 3 2024-09-10T18:02:14.714 INFO:tasks.rados.rados.0.smithi012.stdout:1599: snap_create 2024-09-10T18:02:14.717 INFO:tasks.rados.rados.0.smithi012.stdout:1598: finishing write tid 1 to smithi01278544-40 2024-09-10T18:02:14.717 INFO:tasks.rados.rados.0.smithi012.stdout:1598: finishing write tid 2 to smithi01278544-40 2024-09-10T18:02:14.717 INFO:tasks.rados.rados.0.smithi012.stdout:1598: finishing write tid 3 to smithi01278544-40 2024-09-10T18:02:14.717 INFO:tasks.rados.rados.0.smithi012.stdout:1598: finishing write tid 4 to smithi01278544-40 2024-09-10T18:02:14.718 INFO:tasks.rados.rados.0.smithi012.stdout:1598: finishing write tid 5 to smithi01278544-40 2024-09-10T18:02:14.718 INFO:tasks.rados.rados.0.smithi012.stdout:1598: oid 40 updating version 0 to 1068 2024-09-10T18:02:14.719 INFO:tasks.rados.rados.0.smithi012.stdout:1598: oid 40 version 1068 is already newer than 1067 2024-09-10T18:02:14.719 INFO:tasks.rados.rados.0.smithi012.stdout:1598: oid 40 updating version 1068 to 1069 2024-09-10T18:02:14.719 INFO:tasks.rados.rados.0.smithi012.stdout:1598: oid 40 version 1069 is already newer than 1066 2024-09-10T18:02:14.719 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1069 (ObjNum 502 snap 167 seq_num 502) dirty exists 2024-09-10T18:02:14.719 INFO:tasks.rados.rados.0.smithi012.stdout:1598: left oid 40 (ObjNum 502 snap 167 seq_num 502) 2024-09-10T18:02:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:14 smithi089 ceph-mon[84132]: pgmap v282: 121 pgs: 121 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.8 MiB/s wr, 25 op/s 2024-09-10T18:02:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:14 smithi089 ceph-mon[84132]: osdmap e409: 8 total, 8 up, 8 in 2024-09-10T18:02:15.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:14 smithi012 ceph-mon[89611]: pgmap v282: 121 pgs: 121 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.8 MiB/s wr, 25 op/s 2024-09-10T18:02:15.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:14 smithi012 ceph-mon[89611]: osdmap e409: 8 total, 8 up, 8 in 2024-09-10T18:02:15.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:14 smithi012 ceph-mon[92029]: pgmap v282: 121 pgs: 121 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.8 MiB/s wr, 25 op/s 2024-09-10T18:02:15.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:14 smithi012 ceph-mon[92029]: osdmap e409: 8 total, 8 up, 8 in 2024-09-10T18:02:15.716 INFO:tasks.rados.rados.0.smithi012.stdout:1598: done (1 left) 2024-09-10T18:02:15.716 INFO:tasks.rados.rados.0.smithi012.stdout:1599: done (0 left) 2024-09-10T18:02:15.716 INFO:tasks.rados.rados.0.smithi012.stdout:1600: copy_from oid 50 from oid 10 current snap is 168 2024-09-10T18:02:15.716 INFO:tasks.rados.rados.0.smithi012.stdout:1601: snap_remove snap 156 2024-09-10T18:02:16.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:15 smithi012 ceph-mon[89611]: osdmap e410: 8 total, 8 up, 8 in 2024-09-10T18:02:16.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:15 smithi012 ceph-mon[92029]: osdmap e410: 8 total, 8 up, 8 in 2024-09-10T18:02:16.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:15 smithi089 ceph-mon[84132]: osdmap e410: 8 total, 8 up, 8 in 2024-09-10T18:02:16.727 INFO:tasks.rados.rados.0.smithi012.stdout:1601: done (1 left) 2024-09-10T18:02:16.727 INFO:tasks.rados.rados.0.smithi012.stdout:1602: copy_from oid 5 from oid 2 current snap is 168 2024-09-10T18:02:16.727 INFO:tasks.rados.rados.0.smithi012.stdout:1600: finishing copy_from racing read to smithi01278544-50 2024-09-10T18:02:16.727 INFO:tasks.rados.rados.0.smithi012.stdout:1600: finishing copy_from to smithi01278544-50 2024-09-10T18:02:16.727 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 735 (ObjNum 445 snap 150 seq_num 445) dirty exists 2024-09-10T18:02:16.727 INFO:tasks.rados.rados.0.smithi012.stdout:1600: done (1 left) 2024-09-10T18:02:16.727 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 168 2024-09-10T18:02:16.727 INFO:tasks.rados.rados.0.smithi012.stdout:1603: seq_num 503 ranges {3153920=425984,3579904=704512,4284416=98304} 2024-09-10T18:02:16.747 INFO:tasks.rados.rados.0.smithi012.stdout:1603: writing smithi01278544-7 from 3153920 to 3579904 tid 1 2024-09-10T18:02:16.752 INFO:tasks.rados.rados.0.smithi012.stdout:1603: writing smithi01278544-7 from 3579904 to 4284416 tid 2 2024-09-10T18:02:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1603: writing smithi01278544-7 from 4284416 to 4382720 tid 3 2024-09-10T18:02:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1604: snap_create 2024-09-10T18:02:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1602: finishing copy_from racing read to smithi01278544-5 2024-09-10T18:02:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1602: finishing copy_from to smithi01278544-5 2024-09-10T18:02:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 755 (ObjNum 497 snap 164 seq_num 497) dirty exists 2024-09-10T18:02:16.753 INFO:tasks.rados.rados.0.smithi012.stdout:1603: finishing write tid 1 to smithi01278544-7 2024-09-10T18:02:16.756 INFO:tasks.rados.rados.0.smithi012.stdout:1603: finishing write tid 2 to smithi01278544-7 2024-09-10T18:02:16.756 INFO:tasks.rados.rados.0.smithi012.stdout:1603: finishing write tid 3 to smithi01278544-7 2024-09-10T18:02:16.756 INFO:tasks.rados.rados.0.smithi012.stdout:1603: finishing write tid 4 to smithi01278544-7 2024-09-10T18:02:16.758 INFO:tasks.rados.rados.0.smithi012.stdout:1603: finishing write tid 5 to smithi01278544-7 2024-09-10T18:02:16.758 INFO:tasks.rados.rados.0.smithi012.stdout:1603: oid 7 updating version 0 to 539 2024-09-10T18:02:16.758 INFO:tasks.rados.rados.0.smithi012.stdout:1603: oid 7 updating version 539 to 541 2024-09-10T18:02:16.758 INFO:tasks.rados.rados.0.smithi012.stdout:1603: oid 7 version 541 is already newer than 540 2024-09-10T18:02:16.758 INFO:tasks.rados.rados.0.smithi012.stdout:1603: oid 7 version 541 is already newer than 538 2024-09-10T18:02:16.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 541 (ObjNum 503 snap 168 seq_num 503) dirty exists 2024-09-10T18:02:16.759 INFO:tasks.rados.rados.0.smithi012.stdout:1603: left oid 7 (ObjNum 503 snap 168 seq_num 503) 2024-09-10T18:02:17.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[92029]: pgmap v285: 121 pgs: 121 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.3 MiB/s wr, 23 op/s 2024-09-10T18:02:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[92029]: osdmap e411: 8 total, 8 up, 8 in 2024-09-10T18:02:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:17.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[89611]: pgmap v285: 121 pgs: 121 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.3 MiB/s wr, 23 op/s 2024-09-10T18:02:17.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[89611]: osdmap e411: 8 total, 8 up, 8 in 2024-09-10T18:02:17.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:17.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:17.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:17.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:16 smithi089 ceph-mon[84132]: pgmap v285: 121 pgs: 121 active+clean; 146 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.3 MiB/s wr, 23 op/s 2024-09-10T18:02:17.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:16 smithi089 ceph-mon[84132]: osdmap e411: 8 total, 8 up, 8 in 2024-09-10T18:02:17.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:17.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:17.737 INFO:tasks.rados.rados.0.smithi012.stdout:1602: done (2 left) 2024-09-10T18:02:17.737 INFO:tasks.rados.rados.0.smithi012.stdout:1603: done (1 left) 2024-09-10T18:02:17.737 INFO:tasks.rados.rados.0.smithi012.stdout:1604: done (0 left) 2024-09-10T18:02:17.737 INFO:tasks.rados.rados.0.smithi012.stdout:1605: read oid 9 snap -1 2024-09-10T18:02:17.737 INFO:tasks.rados.rados.0.smithi012.stdout:1605: expect (ObjNum 434 snap 144 seq_num 434) 2024-09-10T18:02:17.737 INFO:tasks.rados.rados.0.smithi012.stdout:1606: read oid 50 snap -1 2024-09-10T18:02:17.737 INFO:tasks.rados.rados.0.smithi012.stdout:1606: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:17.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 169 2024-09-10T18:02:17.738 INFO:tasks.rados.rados.0.smithi012.stdout:1607: seq_num 504 ranges {3293184=450560,3743744=589824,4333568=212992} 2024-09-10T18:02:17.757 INFO:tasks.rados.rados.0.smithi012.stdout:1607: writing smithi01278544-17 from 3293184 to 3743744 tid 1 2024-09-10T18:02:17.760 INFO:tasks.rados.rados.0.smithi012.stdout:1607: writing smithi01278544-17 from 3743744 to 4333568 tid 2 2024-09-10T18:02:17.762 INFO:tasks.rados.rados.0.smithi012.stdout:1607: writing smithi01278544-17 from 4333568 to 4546560 tid 3 2024-09-10T18:02:17.762 INFO:tasks.rados.rados.0.smithi012.stdout:1608: rmattr oid 44 current snap is 169 2024-09-10T18:02:17.762 INFO:tasks.rados.rados.0.smithi012.stdout:1608: done (3 left) 2024-09-10T18:02:17.762 INFO:tasks.rados.rados.0.smithi012.stdout:1609: rollback oid 38 current snap is 169 2024-09-10T18:02:17.762 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 38 to 166 2024-09-10T18:02:17.762 INFO:tasks.rados.rados.0.smithi012.stdout:1605: expect (ObjNum 434 snap 144 seq_num 434) 2024-09-10T18:02:17.765 INFO:tasks.rados.rados.0.smithi012.stdout:1606: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:17.773 INFO:tasks.rados.rados.0.smithi012.stdout:1609: finishing rollback tid 0 to smithi01278544-38 2024-09-10T18:02:17.773 INFO:tasks.rados.rados.0.smithi012.stdout:1609: finishing rollback tid 1 to smithi01278544-38 2024-09-10T18:02:17.773 INFO:tasks.rados.rados.0.smithi012.stdout:1605: done (3 left) 2024-09-10T18:02:17.773 INFO:tasks.rados.rados.0.smithi012.stdout:1606: done (2 left) 2024-09-10T18:02:17.773 INFO:tasks.rados.rados.0.smithi012.stdout:1610: read oid 25 snap 160 2024-09-10T18:02:17.773 INFO:tasks.rados.rados.0.smithi012.stdout:1610: expect deleted 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1611: copy_from oid 6 from oid 39 current snap is 169 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: finishing write tid 1 to smithi01278544-17 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1609: finishing rollback tid 2 to smithi01278544-38 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 741 (ObjNum 447 snap 151 seq_num 447) dirty exists 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: finishing write tid 2 to smithi01278544-17 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: finishing write tid 3 to smithi01278544-17 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: finishing write tid 4 to smithi01278544-17 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: finishing write tid 5 to smithi01278544-17 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: oid 17 updating version 0 to 759 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: oid 17 version 759 is already newer than 758 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: oid 17 version 759 is already newer than 756 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:1607: oid 17 version 759 is already newer than 757 2024-09-10T18:02:17.774 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 759 (ObjNum 504 snap 169 seq_num 504) dirty exists 2024-09-10T18:02:17.775 INFO:tasks.rados.rados.0.smithi012.stdout:1607: left oid 17 (ObjNum 504 snap 169 seq_num 504) 2024-09-10T18:02:17.775 INFO:tasks.rados.rados.0.smithi012.stdout:1607: done (3 left) 2024-09-10T18:02:17.775 INFO:tasks.rados.rados.0.smithi012.stdout:1609: done (2 left) 2024-09-10T18:02:17.775 INFO:tasks.rados.rados.0.smithi012.stdout:1612: snap_create 2024-09-10T18:02:17.775 INFO:tasks.rados.rados.0.smithi012.stdout:1611: finishing copy_from to smithi01278544-6 2024-09-10T18:02:17.775 INFO:tasks.rados.rados.0.smithi012.stdout:1611: got expected ENOENT (src dne) 2024-09-10T18:02:17.775 INFO:tasks.rados.rados.0.smithi012.stdout:1611: finishing copy_from racing read to smithi01278544-6 2024-09-10T18:02:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:02:18.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:17 smithi012 ceph-mon[89611]: osdmap e412: 8 total, 8 up, 8 in 2024-09-10T18:02:18.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:17 smithi012 ceph-mon[92029]: osdmap e412: 8 total, 8 up, 8 in 2024-09-10T18:02:18.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:17 smithi089 ceph-mon[84132]: osdmap e412: 8 total, 8 up, 8 in 2024-09-10T18:02:18.364 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:02:18.364 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (7m) 16s ago 8m 26.8M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:02:18.364 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (8m) 2m ago 8m 87.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:02:18.364 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (9m) 16s ago 9m 19.0M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:02:18.364 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (9m) 2m ago 9m 19.6M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:02:18.364 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (3m) 2m ago 13m 452M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (4m) 16s ago 14m 526M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (3m) 16s ago 15m 55.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (2m) 2m ago 13m 27.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (3m) 16s ago 13m 46.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (7m) 16s ago 7m 15.5M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (7m) 2m ago 7m 16.9M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (2m) 16s ago 12m 166M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (88s) 16s ago 12m 109M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (54s) 16s ago 12m 98.7M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (20s) 16s ago 11m 14.4M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (11m) 2m ago 11m 186M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 8252b9207995 2024-09-10T18:02:18.365 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (11m) 2m ago 11m 136M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T18:02:18.366 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (10m) 2m ago 10m 141M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T18:02:18.366 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (10m) 2m ago 10m 98.9M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T18:02:18.366 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (3m) 2m ago 8m 50.4M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:02:18.720 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:02:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 4, 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 4 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:02:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:02:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 6, 2024-09-10T18:02:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 9 2024-09-10T18:02:18.723 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:02:18.723 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:02:18.738 INFO:tasks.rados.rados.0.smithi012.stdout:1610: done (2 left) 2024-09-10T18:02:18.738 INFO:tasks.rados.rados.0.smithi012.stdout:1611: done (1 left) 2024-09-10T18:02:18.739 INFO:tasks.rados.rados.0.smithi012.stdout:1612: done (0 left) 2024-09-10T18:02:18.739 INFO:tasks.rados.rados.0.smithi012.stdout:1613: read oid 34 snap -1 2024-09-10T18:02:18.739 INFO:tasks.rados.rados.0.smithi012.stdout:1613: expect deleted 2024-09-10T18:02:18.739 INFO:tasks.rados.rados.0.smithi012.stdout:1614: setattr oid 5 current snap is 170 2024-09-10T18:02:18.740 INFO:tasks.rados.rados.0.smithi012.stdout:1615: snap_create 2024-09-10T18:02:18.744 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 760 (ObjNum 497 snap 164 seq_num 497) dirty exists 2024-09-10T18:02:19.018 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:02:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:02:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:02:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:02:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:02:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:02:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T18:02:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:02:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "9/20 daemons upgraded", 2024-09-10T18:02:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T18:02:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:02:19.019 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:02:19.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:18 smithi012 ceph-mon[89611]: pgmap v288: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-10T18:02:19.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:18 smithi012 ceph-mon[89611]: osdmap e413: 8 total, 8 up, 8 in 2024-09-10T18:02:19.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:18 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/417998681' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:19.019 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:18 smithi012 ceph-mon[92029]: pgmap v288: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-10T18:02:19.020 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:18 smithi012 ceph-mon[92029]: osdmap e413: 8 total, 8 up, 8 in 2024-09-10T18:02:19.020 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:18 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/417998681' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:18 smithi089 ceph-mon[84132]: pgmap v288: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-10T18:02:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:18 smithi089 ceph-mon[84132]: osdmap e413: 8 total, 8 up, 8 in 2024-09-10T18:02:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:18 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/417998681' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:19.752 INFO:tasks.rados.rados.0.smithi012.stdout:1613: done (2 left) 2024-09-10T18:02:19.753 INFO:tasks.rados.rados.0.smithi012.stdout:1614: done (1 left) 2024-09-10T18:02:19.753 INFO:tasks.rados.rados.0.smithi012.stdout:1615: done (0 left) 2024-09-10T18:02:19.753 INFO:tasks.rados.rados.0.smithi012.stdout:1616: delete oid 6 current snap is 171 2024-09-10T18:02:19.759 INFO:tasks.rados.rados.0.smithi012.stdout:1616: done (0 left) 2024-09-10T18:02:19.759 INFO:tasks.rados.rados.0.smithi012.stdout:1617: snap_create 2024-09-10T18:02:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:19 smithi012 ceph-mon[89611]: from='client.44279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:19 smithi012 ceph-mon[89611]: from='client.34371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:19 smithi012 ceph-mon[89611]: from='client.44291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:19 smithi012 ceph-mon[89611]: osdmap e414: 8 total, 8 up, 8 in 2024-09-10T18:02:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:19 smithi012 ceph-mon[92029]: from='client.44279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:19 smithi012 ceph-mon[92029]: from='client.34371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:19 smithi012 ceph-mon[92029]: from='client.44291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:19 smithi012 ceph-mon[92029]: osdmap e414: 8 total, 8 up, 8 in 2024-09-10T18:02:20.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:19 smithi089 ceph-mon[84132]: from='client.44279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:19 smithi089 ceph-mon[84132]: from='client.34371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:19 smithi089 ceph-mon[84132]: from='client.44291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:19 smithi089 ceph-mon[84132]: osdmap e414: 8 total, 8 up, 8 in 2024-09-10T18:02:20.752 INFO:tasks.rados.rados.0.smithi012.stdout:1617: done (0 left) 2024-09-10T18:02:20.752 INFO:tasks.rados.rados.0.smithi012.stdout:1618: snap_remove snap 166 2024-09-10T18:02:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:20 smithi012 ceph-mon[89611]: from='client.34389 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:20 smithi012 ceph-mon[89611]: pgmap v291: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-10T18:02:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:20 smithi012 ceph-mon[89611]: osdmap e415: 8 total, 8 up, 8 in 2024-09-10T18:02:21.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:20 smithi012 ceph-mon[92029]: from='client.34389 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:21.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:20 smithi012 ceph-mon[92029]: pgmap v291: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-10T18:02:21.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:20 smithi012 ceph-mon[92029]: osdmap e415: 8 total, 8 up, 8 in 2024-09-10T18:02:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:20 smithi089 ceph-mon[84132]: from='client.34389 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:20 smithi089 ceph-mon[84132]: pgmap v291: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-10T18:02:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:20 smithi089 ceph-mon[84132]: osdmap e415: 8 total, 8 up, 8 in 2024-09-10T18:02:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1618: done (0 left) 2024-09-10T18:02:21.753 INFO:tasks.rados.rados.0.smithi012.stdout:1619: delete oid 32 current snap is 172 2024-09-10T18:02:21.755 INFO:tasks.rados.rados.0.smithi012.stdout:1619: done (0 left) 2024-09-10T18:02:21.755 INFO:tasks.rados.rados.0.smithi012.stdout:1620: delete oid 21 current snap is 172 2024-09-10T18:02:21.765 INFO:tasks.rados.rados.0.smithi012.stdout:1620: done (0 left) 2024-09-10T18:02:21.765 INFO:tasks.rados.rados.0.smithi012.stdout:1621: snap_remove snap 165 2024-09-10T18:02:22.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:21 smithi012 ceph-mon[89611]: osdmap e416: 8 total, 8 up, 8 in 2024-09-10T18:02:22.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-10T18:02:22.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:21 smithi012 ceph-mon[89611]: osdmap e417: 8 total, 8 up, 8 in 2024-09-10T18:02:22.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:21 smithi012 ceph-mon[92029]: osdmap e416: 8 total, 8 up, 8 in 2024-09-10T18:02:22.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-10T18:02:22.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:21 smithi012 ceph-mon[92029]: osdmap e417: 8 total, 8 up, 8 in 2024-09-10T18:02:22.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:21 smithi089 ceph-mon[84132]: osdmap e416: 8 total, 8 up, 8 in 2024-09-10T18:02:22.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-10T18:02:22.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:21 smithi089 ceph-mon[84132]: osdmap e417: 8 total, 8 up, 8 in 2024-09-10T18:02:22.699 INFO:tasks.rados.rados.0.smithi012.stdout:1621: done (0 left) 2024-09-10T18:02:22.700 INFO:tasks.rados.rados.0.smithi012.stdout:1622: snap_remove snap 168 2024-09-10T18:02:23.032 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:22 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T18:02:23.032 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:22 smithi089 ceph-mon[84132]: Upgrade: osd.4 is safe to restart 2024-09-10T18:02:23.032 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:22 smithi089 ceph-mon[84132]: pgmap v294: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-10T18:02:23.032 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:22 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:23.033 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:22 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T18:02:23.033 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:22 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:23.033 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:22 smithi089 ceph-mon[84132]: osdmap e418: 8 total, 8 up, 8 in 2024-09-10T18:02:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T18:02:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[89611]: Upgrade: osd.4 is safe to restart 2024-09-10T18:02:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[89611]: pgmap v294: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-10T18:02:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T18:02:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[89611]: osdmap e418: 8 total, 8 up, 8 in 2024-09-10T18:02:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T18:02:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[92029]: Upgrade: osd.4 is safe to restart 2024-09-10T18:02:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[92029]: pgmap v294: 121 pgs: 121 active+clean; 151 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-10T18:02:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T18:02:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:22 smithi012 ceph-mon[92029]: osdmap e418: 8 total, 8 up, 8 in 2024-09-10T18:02:23.700 INFO:tasks.rados.rados.0.smithi012.stdout:1622: done (0 left) 2024-09-10T18:02:23.700 INFO:tasks.rados.rados.0.smithi012.stdout:1623: copy_from oid 11 from oid 16 current snap is 172 2024-09-10T18:02:23.700 INFO:tasks.rados.rados.0.smithi012.stdout:1624: rollback oid 40 current snap is 172 2024-09-10T18:02:23.700 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 40 to 163 2024-09-10T18:02:23.700 INFO:tasks.rados.rados.0.smithi012.stdout:1625: read oid 17 snap -1 2024-09-10T18:02:23.701 INFO:tasks.rados.rados.0.smithi012.stdout:1625: expect (ObjNum 504 snap 169 seq_num 504) 2024-09-10T18:02:23.701 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 172 2024-09-10T18:02:23.701 INFO:tasks.rados.rados.0.smithi012.stdout:1626: seq_num 508 ranges {1826816=516096,2342912=524288,2867200=278528} 2024-09-10T18:02:23.713 INFO:tasks.rados.rados.0.smithi012.stdout:1626: writing smithi01278544-3 from 1826816 to 2342912 tid 1 2024-09-10T18:02:23.716 INFO:tasks.rados.rados.0.smithi012.stdout:1626: writing smithi01278544-3 from 2342912 to 2867200 tid 2 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:1626: writing smithi01278544-3 from 2867200 to 3145728 tid 3 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:1627: copy_from oid 41 from oid 24 current snap is 172 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:1624: finishing rollback tid 0 to smithi01278544-40 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:1624: finishing rollback tid 1 to smithi01278544-40 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1078 (ObjNum 161 snap 0 seq_num 3496813984) dirty dne 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:1623: finishing copy_from racing read to smithi01278544-11 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:1623: finishing copy_from to smithi01278544-11 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 833 (ObjNum 81 snap 0 seq_num 1667461991) dirty exists 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:1623: done (4 left) 2024-09-10T18:02:23.719 INFO:tasks.rados.rados.0.smithi012.stdout:1624: done (3 left) 2024-09-10T18:02:23.720 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 172 2024-09-10T18:02:23.720 INFO:tasks.rados.rados.0.smithi012.stdout:1628: seq_num 509 ranges {6807552=532480,7340032=409600,7749632=393216} 2024-09-10T18:02:23.759 INFO:tasks.rados.rados.0.smithi012.stdout:1628: writing smithi01278544-46 from 6807552 to 7340032 tid 1 2024-09-10T18:02:23.761 INFO:tasks.rados.rados.0.smithi012.stdout:1628: writing smithi01278544-46 from 7340032 to 7749632 tid 2 2024-09-10T18:02:23.764 INFO:tasks.rados.rados.0.smithi012.stdout:1628: writing smithi01278544-46 from 7749632 to 8142848 tid 3 2024-09-10T18:02:23.764 INFO:tasks.rados.rados.0.smithi012.stdout:1629: copy_from oid 2 from oid 16 current snap is 172 2024-09-10T18:02:23.764 INFO:tasks.rados.rados.0.smithi012.stdout:1626: finishing write tid 1 to smithi01278544-3 2024-09-10T18:02:23.764 INFO:tasks.rados.rados.0.smithi012.stdout:1626: finishing write tid 2 to smithi01278544-3 2024-09-10T18:02:23.764 INFO:tasks.rados.rados.0.smithi012.stdout:1626: finishing write tid 3 to smithi01278544-3 2024-09-10T18:02:23.764 INFO:tasks.rados.rados.0.smithi012.stdout:1626: finishing write tid 4 to smithi01278544-3 2024-09-10T18:02:23.765 INFO:tasks.rados.rados.0.smithi012.stdout:1626: finishing write tid 5 to smithi01278544-3 2024-09-10T18:02:23.765 INFO:tasks.rados.rados.0.smithi012.stdout:1626: oid 3 updating version 0 to 666 2024-09-10T18:02:23.765 INFO:tasks.rados.rados.0.smithi012.stdout:1626: oid 3 updating version 666 to 668 2024-09-10T18:02:23.765 INFO:tasks.rados.rados.0.smithi012.stdout:1626: oid 3 version 668 is already newer than 667 2024-09-10T18:02:23.765 INFO:tasks.rados.rados.0.smithi012.stdout:1626: oid 3 updating version 668 to 669 2024-09-10T18:02:23.765 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 669 (ObjNum 508 snap 172 seq_num 508) dirty exists 2024-09-10T18:02:23.765 INFO:tasks.rados.rados.0.smithi012.stdout:1626: left oid 3 (ObjNum 508 snap 172 seq_num 508) 2024-09-10T18:02:23.765 INFO:tasks.rados.rados.0.smithi012.stdout:1625: expect (ObjNum 504 snap 169 seq_num 504) 2024-09-10T18:02:24.033 INFO:tasks.rados.rados.0.smithi012.stdout:1627: finishing copy_from racing read to smithi01278544-41 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1627: finishing copy_from to smithi01278544-41 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 737 (ObjNum 483 snap 156 seq_num 483) dirty exists 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1628: finishing write tid 1 to smithi01278544-46 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1625: done (4 left) 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1626: done (3 left) 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1627: done (2 left) 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1630: delete oid 45 current snap is 172 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1628: finishing write tid 2 to smithi01278544-46 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1628: finishing write tid 3 to smithi01278544-46 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1628: finishing write tid 4 to smithi01278544-46 2024-09-10T18:02:24.034 INFO:tasks.rados.rados.0.smithi012.stdout:1629: finishing copy_from racing read to smithi01278544-2 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:1629: finishing copy_from to smithi01278544-2 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 833 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:1628: finishing write tid 5 to smithi01278544-46 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:1628: oid 46 updating version 0 to 671 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:1628: oid 46 version 671 is already newer than 670 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:1628: oid 46 updating version 671 to 672 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:1628: oid 46 updating version 672 to 673 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 673 (ObjNum 509 snap 172 seq_num 509) dirty exists 2024-09-10T18:02:24.035 INFO:tasks.rados.rados.0.smithi012.stdout:1628: left oid 46 (ObjNum 509 snap 172 seq_num 509) 2024-09-10T18:02:24.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:02:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:02:23] "GET /metrics HTTP/1.1" 200 36285 "" "Prometheus/2.43.0" 2024-09-10T18:02:24.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:23 smithi012 ceph-mon[89611]: Upgrade: Updating osd.4 2024-09-10T18:02:24.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:23 smithi012 ceph-mon[89611]: Deploying daemon osd.4 on smithi089 2024-09-10T18:02:24.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:23 smithi012 ceph-mon[89611]: osdmap e419: 8 total, 8 up, 8 in 2024-09-10T18:02:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:23 smithi012 ceph-mon[92029]: Upgrade: Updating osd.4 2024-09-10T18:02:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:23 smithi012 ceph-mon[92029]: Deploying daemon osd.4 on smithi089 2024-09-10T18:02:24.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:23 smithi012 ceph-mon[92029]: osdmap e419: 8 total, 8 up, 8 in 2024-09-10T18:02:24.037 INFO:tasks.rados.rados.0.smithi012.stdout:1628: done (2 left) 2024-09-10T18:02:24.037 INFO:tasks.rados.rados.0.smithi012.stdout:1629: done (1 left) 2024-09-10T18:02:24.037 INFO:tasks.rados.rados.0.smithi012.stdout:1630: done (0 left) 2024-09-10T18:02:24.037 INFO:tasks.rados.rados.0.smithi012.stdout:1631: snap_remove snap 163 2024-09-10T18:02:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:23 smithi089 ceph-mon[84132]: Upgrade: Updating osd.4 2024-09-10T18:02:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:23 smithi089 ceph-mon[84132]: Deploying daemon osd.4 on smithi089 2024-09-10T18:02:24.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:23 smithi089 ceph-mon[84132]: osdmap e419: 8 total, 8 up, 8 in 2024-09-10T18:02:24.786 INFO:tasks.rados.rados.0.smithi012.stdout:1631: done (0 left) 2024-09-10T18:02:24.786 INFO:tasks.rados.rados.0.smithi012.stdout:1632: read oid 3 snap 158 2024-09-10T18:02:24.786 INFO:tasks.rados.rados.0.smithi012.stdout:1632: expect (ObjNum 469 snap 154 seq_num 469) 2024-09-10T18:02:24.786 INFO:tasks.rados.rados.0.smithi012.stdout:1633: rmattr oid 18 current snap is 172 2024-09-10T18:02:24.786 INFO:tasks.rados.rados.0.smithi012.stdout:1634: read oid 12 snap -1 2024-09-10T18:02:24.786 INFO:tasks.rados.rados.0.smithi012.stdout:1634: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:24.786 INFO:tasks.rados.rados.0.smithi012.stdout:1635: delete oid 11 current snap is 172 2024-09-10T18:02:24.787 INFO:tasks.rados.rados.0.smithi012.stdout:1634: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:24.792 INFO:tasks.rados.rados.0.smithi012.stdout:1634: done (3 left) 2024-09-10T18:02:24.792 INFO:tasks.rados.rados.0.smithi012.stdout:1635: done (2 left) 2024-09-10T18:02:24.792 INFO:tasks.rados.rados.0.smithi012.stdout:1636: delete oid 9 current snap is 172 2024-09-10T18:02:24.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 834 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:02:24.796 INFO:tasks.rados.rados.0.smithi012.stdout:1632: expect (ObjNum 469 snap 154 seq_num 469) 2024-09-10T18:02:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:1632: done (2 left) 2024-09-10T18:02:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:1633: done (1 left) 2024-09-10T18:02:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:1636: done (0 left) 2024-09-10T18:02:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:1637: snap_create 2024-09-10T18:02:24.958 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:24 smithi089 ceph-mon[84132]: pgmap v297: 121 pgs: 121 active+clean; 152 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 186 KiB/s rd, 306 KiB/s wr, 8 op/s 2024-09-10T18:02:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:24 smithi012 ceph-mon[89611]: pgmap v297: 121 pgs: 121 active+clean; 152 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 186 KiB/s rd, 306 KiB/s wr, 8 op/s 2024-09-10T18:02:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:24 smithi012 ceph-mon[92029]: pgmap v297: 121 pgs: 121 active+clean; 152 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 186 KiB/s rd, 306 KiB/s wr, 8 op/s 2024-09-10T18:02:25.589 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:25 smithi089 systemd[1]: Stopping Ceph osd.4 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:02:25.789 INFO:tasks.rados.rados.0.smithi012.stdout:1637: done (0 left) 2024-09-10T18:02:25.789 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 173 2024-09-10T18:02:25.789 INFO:tasks.rados.rados.0.smithi012.stdout:1638: seq_num 513 ranges {5390336=598016,5988352=794624,6782976=8192} 2024-09-10T18:02:25.822 INFO:tasks.rados.rados.0.smithi012.stdout:1638: writing smithi01278544-49 from 5390336 to 5988352 tid 1 2024-09-10T18:02:25.827 INFO:tasks.rados.rados.0.smithi012.stdout:1638: writing smithi01278544-49 from 5988352 to 6782976 tid 2 2024-09-10T18:02:25.827 INFO:tasks.rados.rados.0.smithi012.stdout:1638: writing smithi01278544-49 from 6782976 to 6791168 tid 3 2024-09-10T18:02:25.827 INFO:tasks.rados.rados.0.smithi012.stdout:1639: setattr oid 31 current snap is 173 2024-09-10T18:02:25.827 INFO:tasks.rados.rados.0.smithi012.stdout:1638: finishing write tid 1 to smithi01278544-49 2024-09-10T18:02:25.828 INFO:tasks.rados.rados.0.smithi012.stdout:1640: read oid 35 snap -1 2024-09-10T18:02:25.828 INFO:tasks.rados.rados.0.smithi012.stdout:1640: expect (ObjNum 484 snap 159 seq_num 484) 2024-09-10T18:02:25.828 INFO:tasks.rados.rados.0.smithi012.stdout:1641: snap_remove snap 172 2024-09-10T18:02:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:25 smithi012 ceph-mon[89611]: osdmap e420: 8 total, 8 up, 8 in 2024-09-10T18:02:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:25 smithi012 ceph-mon[89611]: pgmap v300: 121 pgs: 121 active+clean; 152 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 186 KiB/s rd, 306 KiB/s wr, 8 op/s 2024-09-10T18:02:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:25 smithi012 ceph-mon[89611]: osd.4 marked itself down and dead 2024-09-10T18:02:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:25 smithi012 ceph-mon[92029]: osdmap e420: 8 total, 8 up, 8 in 2024-09-10T18:02:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:25 smithi012 ceph-mon[92029]: pgmap v300: 121 pgs: 121 active+clean; 152 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 186 KiB/s rd, 306 KiB/s wr, 8 op/s 2024-09-10T18:02:26.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:25 smithi012 ceph-mon[92029]: osd.4 marked itself down and dead 2024-09-10T18:02:26.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:25 smithi089 ceph-mon[84132]: osdmap e420: 8 total, 8 up, 8 in 2024-09-10T18:02:26.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:25 smithi089 ceph-mon[84132]: pgmap v300: 121 pgs: 121 active+clean; 152 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 186 KiB/s rd, 306 KiB/s wr, 8 op/s 2024-09-10T18:02:26.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:25 smithi089 ceph-mon[84132]: osd.4 marked itself down and dead 2024-09-10T18:02:26.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[36145]: 2024-09-10T18:02:25.594+0000 7fdfd2ac2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:02:26.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[36145]: 2024-09-10T18:02:25.594+0000 7fdfd2ac2640 -1 osd.4 420 *** Got signal Terminated *** 2024-09-10T18:02:26.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[36145]: 2024-09-10T18:02:25.594+0000 7fdfd2ac2640 -1 osd.4 420 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:02:26.639 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:26 smithi089 podman[89425]: 2024-09-10 18:02:26.351004197 +0000 UTC m=+0.870951355 container died 8252b9207995853255748ff3a663dba7e2a2737b665060be0145b081e6f6ec41 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T18:02:26.792 INFO:tasks.rados.rados.0.smithi012.stdout:1638: finishing write tid 2 to smithi01278544-49 2024-09-10T18:02:26.792 INFO:tasks.rados.rados.0.smithi012.stdout:1638: finishing write tid 3 to smithi01278544-49 2024-09-10T18:02:26.792 INFO:tasks.rados.rados.0.smithi012.stdout:1638: finishing write tid 4 to smithi01278544-49 2024-09-10T18:02:26.792 INFO:tasks.rados.rados.0.smithi012.stdout:1638: finishing write tid 5 to smithi01278544-49 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:1638: oid 49 updating version 0 to 836 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:1638: oid 49 updating version 836 to 838 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:1638: oid 49 version 838 is already newer than 837 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:1638: oid 49 version 838 is already newer than 835 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 838 (ObjNum 513 snap 173 seq_num 513) dirty exists 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:1638: left oid 49 (ObjNum 513 snap 173 seq_num 513) 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:1638: done (3 left) 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:1641: done (2 left) 2024-09-10T18:02:26.793 INFO:tasks.rados.rados.0.smithi012.stdout:1642: setattr oid 46 current snap is 173 2024-09-10T18:02:26.794 INFO:tasks.rados.rados.0.smithi012.stdout:1643: snap_create 2024-09-10T18:02:26.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 674 (ObjNum 509 snap 172 seq_num 509) dirty exists 2024-09-10T18:02:26.809 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 836 (ObjNum 495 snap 164 seq_num 495) dirty exists 2024-09-10T18:02:26.835 INFO:tasks.rados.rados.0.smithi012.stdout:1640: expect (ObjNum 484 snap 159 seq_num 484) 2024-09-10T18:02:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:26 smithi089 ceph-mon[84132]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:02:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:26 smithi089 ceph-mon[84132]: osdmap e421: 8 total, 7 up, 8 in 2024-09-10T18:02:27.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:26 smithi089 podman[89425]: 2024-09-10 18:02:26.847054068 +0000 UTC m=+1.367001265 container cleanup 8252b9207995853255748ff3a663dba7e2a2737b665060be0145b081e6f6ec41 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=reef-7a853b1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:02:27.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:26 smithi089 bash[89425]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4 2024-09-10T18:02:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:26 smithi012 ceph-mon[89611]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:02:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:26 smithi012 ceph-mon[89611]: osdmap e421: 8 total, 7 up, 8 in 2024-09-10T18:02:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:26 smithi012 ceph-mon[92029]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:02:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:26 smithi012 ceph-mon[92029]: osdmap e421: 8 total, 7 up, 8 in 2024-09-10T18:02:27.502 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:27 smithi089 podman[89442]: 2024-09-10 18:02:27.151139998 +0000 UTC m=+0.800838384 container remove 8252b9207995853255748ff3a663dba7e2a2737b665060be0145b081e6f6ec41 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-7a853b1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T18:02:27.700 INFO:tasks.rados.rados.0.smithi012.stdout:1639: done (3 left) 2024-09-10T18:02:27.700 INFO:tasks.rados.rados.0.smithi012.stdout:1640: done (2 left) 2024-09-10T18:02:27.700 INFO:tasks.rados.rados.0.smithi012.stdout:1642: done (1 left) 2024-09-10T18:02:27.700 INFO:tasks.rados.rados.0.smithi012.stdout:1643: done (0 left) 2024-09-10T18:02:27.700 INFO:tasks.rados.rados.0.smithi012.stdout:1644: snap_create 2024-09-10T18:02:27.753 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:27 smithi089 podman[89532]: 2024-09-10 18:02:27.502051537 +0000 UTC m=+0.102065371 container create 17114c5f9a400ac8bd0b70c509745c93b4cbc6370dca114587ca4d37b9597db6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T18:02:27.753 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:27 smithi089 podman[89532]: 2024-09-10 18:02:27.416034611 +0000 UTC m=+0.016048442 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:02:27.753 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:27 smithi089 podman[89532]: 2024-09-10 18:02:27.749235038 +0000 UTC m=+0.349248863 container init 17114c5f9a400ac8bd0b70c509745c93b4cbc6370dca114587ca4d37b9597db6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T18:02:27.754 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:27 smithi089 podman[89532]: 2024-09-10 18:02:27.752642498 +0000 UTC m=+0.352656330 container start 17114c5f9a400ac8bd0b70c509745c93b4cbc6370dca114587ca4d37b9597db6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T18:02:28.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:27 smithi089 ceph-mon[84132]: osdmap e422: 8 total, 7 up, 8 in 2024-09-10T18:02:28.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:27 smithi089 ceph-mon[84132]: pgmap v303: 121 pgs: 18 active+undersized, 4 peering, 4 stale+active+clean, 3 active+undersized+degraded, 92 active+clean; 157 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 16 op/s; 15/330 objects degraded (4.545%) 2024-09-10T18:02:28.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:27 smithi089 ceph-mon[84132]: osdmap e423: 8 total, 7 up, 8 in 2024-09-10T18:02:28.037 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:27 smithi089 podman[89532]: 2024-09-10 18:02:27.849243504 +0000 UTC m=+0.449257348 container attach 17114c5f9a400ac8bd0b70c509745c93b4cbc6370dca114587ca4d37b9597db6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:02:28.037 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:27 smithi089 podman[89532]: 2024-09-10 18:02:27.947477591 +0000 UTC m=+0.547491418 container died 17114c5f9a400ac8bd0b70c509745c93b4cbc6370dca114587ca4d37b9597db6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:02:28.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:27 smithi012 ceph-mon[92029]: osdmap e422: 8 total, 7 up, 8 in 2024-09-10T18:02:28.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:27 smithi012 ceph-mon[92029]: pgmap v303: 121 pgs: 18 active+undersized, 4 peering, 4 stale+active+clean, 3 active+undersized+degraded, 92 active+clean; 157 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 16 op/s; 15/330 objects degraded (4.545%) 2024-09-10T18:02:28.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:27 smithi012 ceph-mon[92029]: osdmap e423: 8 total, 7 up, 8 in 2024-09-10T18:02:28.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:27 smithi012 ceph-mon[89611]: osdmap e422: 8 total, 7 up, 8 in 2024-09-10T18:02:28.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:27 smithi012 ceph-mon[89611]: pgmap v303: 121 pgs: 18 active+undersized, 4 peering, 4 stale+active+clean, 3 active+undersized+degraded, 92 active+clean; 157 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 16 op/s; 15/330 objects degraded (4.545%) 2024-09-10T18:02:28.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:27 smithi012 ceph-mon[89611]: osdmap e423: 8 total, 7 up, 8 in 2024-09-10T18:02:28.700 INFO:tasks.rados.rados.0.smithi012.stdout:1644: done (0 left) 2024-09-10T18:02:28.700 INFO:tasks.rados.rados.0.smithi012.stdout:1645: snap_remove snap 160 2024-09-10T18:02:29.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:28 smithi089 ceph-mon[84132]: Health check failed: Degraded data redundancy: 15/330 objects degraded (4.545%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:29.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:28 smithi089 ceph-mon[84132]: osdmap e424: 8 total, 7 up, 8 in 2024-09-10T18:02:29.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:28 smithi089 podman[89555]: 2024-09-10 18:02:28.664934182 +0000 UTC m=+0.710786826 container remove 17114c5f9a400ac8bd0b70c509745c93b4cbc6370dca114587ca4d37b9597db6 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T18:02:29.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:28 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-10T18:02:29.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:28 smithi089 systemd[1]: Stopped Ceph osd.4 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:02:29.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:28 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.4.service: Consumed 13.760s CPU time. 2024-09-10T18:02:29.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:28 smithi089 systemd[1]: Starting Ceph osd.4 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:02:29.205 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:28 smithi012 ceph-mon[89611]: Health check failed: Degraded data redundancy: 15/330 objects degraded (4.545%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:29.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:28 smithi012 ceph-mon[89611]: osdmap e424: 8 total, 7 up, 8 in 2024-09-10T18:02:29.206 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:28 smithi012 ceph-mon[92029]: Health check failed: Degraded data redundancy: 15/330 objects degraded (4.545%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:29.206 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:28 smithi012 ceph-mon[92029]: osdmap e424: 8 total, 7 up, 8 in 2024-09-10T18:02:29.353 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 podman[89653]: 2024-09-10 18:02:28.998213872 +0000 UTC m=+0.015812072 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:02:29.353 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 podman[89653]: 2024-09-10 18:02:29.116485804 +0000 UTC m=+0.134083990 container create 97fd9a088168413050f20ae923a5c6bf6b5544492b041dda5824ffd24312eedd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=) 2024-09-10T18:02:29.703 INFO:tasks.rados.rados.0.smithi012.stdout:1645: done (0 left) 2024-09-10T18:02:29.703 INFO:tasks.rados.rados.0.smithi012.stdout:1646: rollback oid 7 current snap is 175 2024-09-10T18:02:29.703 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 7 to 158 2024-09-10T18:02:29.703 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 175 2024-09-10T18:02:29.703 INFO:tasks.rados.rados.0.smithi012.stdout:1647: seq_num 514 ranges {1097728=614400,1712128=679936,2392064=122880} 2024-09-10T18:02:29.713 INFO:tasks.rados.rados.0.smithi012.stdout:1647: writing smithi01278544-31 from 1097728 to 1712128 tid 1 2024-09-10T18:02:29.718 INFO:tasks.rados.rados.0.smithi012.stdout:1647: writing smithi01278544-31 from 1712128 to 2392064 tid 2 2024-09-10T18:02:29.719 INFO:tasks.rados.rados.0.smithi012.stdout:1647: writing smithi01278544-31 from 2392064 to 2514944 tid 3 2024-09-10T18:02:29.720 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 175 2024-09-10T18:02:29.720 INFO:tasks.rados.rados.0.smithi012.stdout:1646: finishing rollback tid 0 to smithi01278544-7 2024-09-10T18:02:29.720 INFO:tasks.rados.rados.0.smithi012.stdout:1646: finishing rollback tid 1 to smithi01278544-7 2024-09-10T18:02:29.720 INFO:tasks.rados.rados.0.smithi012.stdout:1646: finishing rollback tid 2 to smithi01278544-7 2024-09-10T18:02:29.720 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 544 (ObjNum 410 snap 134 seq_num 410) dirty exists 2024-09-10T18:02:29.720 INFO:tasks.rados.rados.0.smithi012.stdout:1647: finishing write tid 1 to smithi01278544-31 2024-09-10T18:02:29.720 INFO:tasks.rados.rados.0.smithi012.stdout:1648: seq_num 515 ranges {253952=630784,884736=565248,1449984=237568} 2024-09-10T18:02:29.725 INFO:tasks.rados.rados.0.smithi012.stdout:1648: writing smithi01278544-50 from 253952 to 884736 tid 1 2024-09-10T18:02:29.729 INFO:tasks.rados.rados.0.smithi012.stdout:1648: writing smithi01278544-50 from 884736 to 1449984 tid 2 2024-09-10T18:02:29.731 INFO:tasks.rados.rados.0.smithi012.stdout:1648: writing smithi01278544-50 from 1449984 to 1687552 tid 3 2024-09-10T18:02:29.731 INFO:tasks.rados.rados.0.smithi012.stdout:1646: done (2 left) 2024-09-10T18:02:29.731 INFO:tasks.rados.rados.0.smithi012.stdout:1649: read oid 2 snap -1 2024-09-10T18:02:29.731 INFO:tasks.rados.rados.0.smithi012.stdout:1649: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 175 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: finishing write tid 2 to smithi01278544-31 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: finishing write tid 3 to smithi01278544-31 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: finishing write tid 4 to smithi01278544-31 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: finishing write tid 5 to smithi01278544-31 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: oid 31 updating version 0 to 837 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: oid 31 updating version 837 to 839 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: oid 31 version 839 is already newer than 838 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: oid 31 updating version 839 to 840 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 840 (ObjNum 514 snap 175 seq_num 514) dirty exists 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1647: left oid 31 (ObjNum 514 snap 175 seq_num 514) 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1648: finishing write tid 1 to smithi01278544-50 2024-09-10T18:02:29.732 INFO:tasks.rados.rados.0.smithi012.stdout:1650: seq_num 516 ranges {2809856=647168,3457024=450560,3907584=352256} 2024-09-10T18:02:29.750 INFO:tasks.rados.rados.0.smithi012.stdout:1650: writing smithi01278544-28 from 2809856 to 3457024 tid 1 2024-09-10T18:02:29.752 INFO:tasks.rados.rados.0.smithi012.stdout:1650: writing smithi01278544-28 from 3457024 to 3907584 tid 2 2024-09-10T18:02:29.754 INFO:tasks.rados.rados.0.smithi012.stdout:1650: writing smithi01278544-28 from 3907584 to 4259840 tid 3 2024-09-10T18:02:29.754 INFO:tasks.rados.rados.0.smithi012.stdout:1647: done (3 left) 2024-09-10T18:02:29.755 INFO:tasks.rados.rados.0.smithi012.stdout:1651: snap_remove snap 164 2024-09-10T18:02:29.786 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 podman[89653]: 2024-09-10 18:02:29.352290392 +0000 UTC m=+0.369888581 container init 97fd9a088168413050f20ae923a5c6bf6b5544492b041dda5824ffd24312eedd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T18:02:29.786 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 podman[89653]: 2024-09-10 18:02:29.356037618 +0000 UTC m=+0.373635804 container start 97fd9a088168413050f20ae923a5c6bf6b5544492b041dda5824ffd24312eedd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T18:02:29.786 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 podman[89653]: 2024-09-10 18:02:29.427259531 +0000 UTC m=+0.444857714 container attach 97fd9a088168413050f20ae923a5c6bf6b5544492b041dda5824ffd24312eedd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T18:02:29.786 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:02:29.786 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 bash[89653]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:02:29.786 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:02:29.787 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 bash[89653]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:02:30.255 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T18:02:30.255 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 bash[89653]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T18:02:30.256 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T18:02:30.256 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:29 smithi089 bash[89653]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T18:02:30.256 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T18:02:30.256 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 bash[89653]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T18:02:30.536 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T18:02:30.536 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 bash[89653]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T18:02:30.536 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-10T18:02:30.536 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 bash[89653]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-10T18:02:30.536 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T18:02:30.536 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 bash[89653]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T18:02:30.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate[89668]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-10T18:02:30.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 bash[89653]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-10T18:02:30.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 podman[89653]: 2024-09-10 18:02:30.282357876 +0000 UTC m=+1.299956069 container died 97fd9a088168413050f20ae923a5c6bf6b5544492b041dda5824ffd24312eedd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:02:30.707 INFO:tasks.rados.rados.0.smithi012.stdout:1649: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:30.710 INFO:tasks.rados.rados.0.smithi012.stdout:1648: finishing write tid 2 to smithi01278544-50 2024-09-10T18:02:30.710 INFO:tasks.rados.rados.0.smithi012.stdout:1648: finishing write tid 3 to smithi01278544-50 2024-09-10T18:02:30.710 INFO:tasks.rados.rados.0.smithi012.stdout:1648: finishing write tid 4 to smithi01278544-50 2024-09-10T18:02:30.710 INFO:tasks.rados.rados.0.smithi012.stdout:1648: finishing write tid 5 to smithi01278544-50 2024-09-10T18:02:30.710 INFO:tasks.rados.rados.0.smithi012.stdout:1648: oid 50 updating version 0 to 743 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1648: oid 50 updating version 743 to 744 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1648: oid 50 updating version 744 to 745 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1648: oid 50 version 745 is already newer than 742 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 745 (ObjNum 515 snap 175 seq_num 515) dirty exists 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1648: left oid 50 (ObjNum 515 snap 175 seq_num 515) 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1650: finishing write tid 1 to smithi01278544-28 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1650: finishing write tid 2 to smithi01278544-28 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1650: finishing write tid 3 to smithi01278544-28 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1650: finishing write tid 4 to smithi01278544-28 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1650: finishing write tid 5 to smithi01278544-28 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1650: oid 28 updating version 0 to 315 2024-09-10T18:02:30.711 INFO:tasks.rados.rados.0.smithi012.stdout:1650: oid 28 version 315 is already newer than 313 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:1650: oid 28 version 315 is already newer than 314 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:1650: oid 28 version 315 is already newer than 312 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 315 (ObjNum 516 snap 175 seq_num 516) dirty exists 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:1650: left oid 28 (ObjNum 516 snap 175 seq_num 516) 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:1648: done (3 left) 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:1649: done (2 left) 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:1650: done (1 left) 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:1651: done (0 left) 2024-09-10T18:02:30.712 INFO:tasks.rados.rados.0.smithi012.stdout:1652: snap_create 2024-09-10T18:02:30.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:30 smithi012 ceph-mon[89611]: pgmap v306: 121 pgs: 27 active+undersized, 4 peering, 1 stale+active+clean, 8 active+undersized+degraded, 81 active+clean; 157 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 16 op/s; 26/333 objects degraded (7.808%) 2024-09-10T18:02:30.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:30 smithi012 ceph-mon[89611]: osdmap e425: 8 total, 7 up, 8 in 2024-09-10T18:02:30.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:30 smithi012 ceph-mon[92029]: pgmap v306: 121 pgs: 27 active+undersized, 4 peering, 1 stale+active+clean, 8 active+undersized+degraded, 81 active+clean; 157 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 16 op/s; 26/333 objects degraded (7.808%) 2024-09-10T18:02:30.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:30 smithi012 ceph-mon[92029]: osdmap e425: 8 total, 7 up, 8 in 2024-09-10T18:02:30.950 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:30 smithi089 ceph-mon[84132]: pgmap v306: 121 pgs: 27 active+undersized, 4 peering, 1 stale+active+clean, 8 active+undersized+degraded, 81 active+clean; 157 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 16 op/s; 26/333 objects degraded (7.808%) 2024-09-10T18:02:30.951 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:30 smithi089 ceph-mon[84132]: osdmap e425: 8 total, 7 up, 8 in 2024-09-10T18:02:31.276 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:30 smithi089 podman[89808]: 2024-09-10 18:02:30.949661566 +0000 UTC m=+0.661360390 container remove 97fd9a088168413050f20ae923a5c6bf6b5544492b041dda5824ffd24312eedd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T18:02:31.277 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:31 smithi089 podman[89867]: 2024-09-10 18:02:31.06255348 +0000 UTC m=+0.016252478 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:02:31.277 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:31 smithi089 podman[89867]: 2024-09-10 18:02:31.183985197 +0000 UTC m=+0.137684190 container create 75e9a99555f39973b4abc86ee4a179496d74ea910aef637cddab47285b7e1fd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:02:31.713 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:31 smithi089 podman[89867]: 2024-09-10 18:02:31.386474568 +0000 UTC m=+0.340173562 container init 75e9a99555f39973b4abc86ee4a179496d74ea910aef637cddab47285b7e1fd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T18:02:31.713 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:31 smithi089 podman[89867]: 2024-09-10 18:02:31.389715951 +0000 UTC m=+0.343414946 container start 75e9a99555f39973b4abc86ee4a179496d74ea910aef637cddab47285b7e1fd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T18:02:31.714 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:31 smithi089 ceph-osd[89886]: -- 172.21.15.89:0/3657306412 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587f967fa40 con 0x5587f965dc00 2024-09-10T18:02:31.714 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:31 smithi089 bash[89867]: 75e9a99555f39973b4abc86ee4a179496d74ea910aef637cddab47285b7e1fd1 2024-09-10T18:02:31.714 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:31 smithi089 systemd[1]: Started Ceph osd.4 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:02:31.716 INFO:tasks.rados.rados.0.smithi012.stdout:1652: done (0 left) 2024-09-10T18:02:31.716 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 176 2024-09-10T18:02:31.716 INFO:tasks.rados.rados.0.smithi012.stdout:1653: seq_num 517 ranges {2809856=663552,3473408=786432,4259840=16384} 2024-09-10T18:02:31.735 INFO:tasks.rados.rados.0.smithi012.stdout:1653: writing smithi01278544-42 from 2809856 to 3473408 tid 1 2024-09-10T18:02:31.740 INFO:tasks.rados.rados.0.smithi012.stdout:1653: writing smithi01278544-42 from 3473408 to 4259840 tid 2 2024-09-10T18:02:31.740 INFO:tasks.rados.rados.0.smithi012.stdout:1653: writing smithi01278544-42 from 4259840 to 4276224 tid 3 2024-09-10T18:02:31.740 INFO:tasks.rados.rados.0.smithi012.stdout:1654: copy_from oid 22 from oid 18 current snap is 176 2024-09-10T18:02:31.740 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 176 2024-09-10T18:02:31.741 INFO:tasks.rados.rados.0.smithi012.stdout:1655: seq_num 518 ranges {0=679936,679936=671744,1351680=131072} 2024-09-10T18:02:31.745 INFO:tasks.rados.rados.0.smithi012.stdout:1655: writing smithi01278544-21 from 0 to 679936 tid 1 2024-09-10T18:02:31.749 INFO:tasks.rados.rados.0.smithi012.stdout:1655: writing smithi01278544-21 from 679936 to 1351680 tid 2 2024-09-10T18:02:31.750 INFO:tasks.rados.rados.0.smithi012.stdout:1655: writing smithi01278544-21 from 1351680 to 1482752 tid 3 2024-09-10T18:02:31.750 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 176 2024-09-10T18:02:31.750 INFO:tasks.rados.rados.0.smithi012.stdout:1653: finishing write tid 1 to smithi01278544-42 2024-09-10T18:02:31.751 INFO:tasks.rados.rados.0.smithi012.stdout:1653: finishing write tid 2 to smithi01278544-42 2024-09-10T18:02:31.751 INFO:tasks.rados.rados.0.smithi012.stdout:1653: finishing write tid 3 to smithi01278544-42 2024-09-10T18:02:31.751 INFO:tasks.rados.rados.0.smithi012.stdout:1656: seq_num 519 ranges {2318336=696320,3014656=548864,3563520=253952} 2024-09-10T18:02:31.767 INFO:tasks.rados.rados.0.smithi012.stdout:1656: writing smithi01278544-15 from 2318336 to 3014656 tid 1 2024-09-10T18:02:31.770 INFO:tasks.rados.rados.0.smithi012.stdout:1656: writing smithi01278544-15 from 3014656 to 3563520 tid 2 2024-09-10T18:02:31.772 INFO:tasks.rados.rados.0.smithi012.stdout:1656: writing smithi01278544-15 from 3563520 to 3817472 tid 3 2024-09-10T18:02:31.772 INFO:tasks.rados.rados.0.smithi012.stdout:1657: read oid 38 snap -1 2024-09-10T18:02:31.772 INFO:tasks.rados.rados.0.smithi012.stdout:1657: expect (ObjNum 447 snap 151 seq_num 447) 2024-09-10T18:02:31.772 INFO:tasks.rados.rados.0.smithi012.stdout:1658: snap_remove snap 174 2024-09-10T18:02:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[89611]: osdmap e426: 8 total, 7 up, 8 in 2024-09-10T18:02:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[92029]: osdmap e426: 8 total, 7 up, 8 in 2024-09-10T18:02:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:31 smithi089 ceph-mon[84132]: osdmap e426: 8 total, 7 up, 8 in 2024-09-10T18:02:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:32.701 INFO:tasks.rados.rados.0.smithi012.stdout:1653: finishing write tid 4 to smithi01278544-42 2024-09-10T18:02:32.701 INFO:tasks.rados.rados.0.smithi012.stdout:1653: finishing write tid 5 to smithi01278544-42 2024-09-10T18:02:32.701 INFO:tasks.rados.rados.0.smithi012.stdout:1653: oid 42 updating version 0 to 1086 2024-09-10T18:02:32.701 INFO:tasks.rados.rados.0.smithi012.stdout:1653: oid 42 version 1086 is already newer than 1085 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1653: oid 42 updating version 1086 to 1087 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1653: oid 42 version 1087 is already newer than 1084 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1087 (ObjNum 517 snap 176 seq_num 517) dirty exists 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1653: left oid 42 (ObjNum 517 snap 176 seq_num 517) 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1654: finishing copy_from racing read to smithi01278544-22 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1654: finishing copy_from to smithi01278544-22 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 834 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1655: finishing write tid 1 to smithi01278544-21 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1655: finishing write tid 2 to smithi01278544-21 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1655: finishing write tid 3 to smithi01278544-21 2024-09-10T18:02:32.702 INFO:tasks.rados.rados.0.smithi012.stdout:1655: finishing write tid 4 to smithi01278544-21 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1655: finishing write tid 5 to smithi01278544-21 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1655: oid 21 updating version 0 to 737 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1655: oid 21 updating version 737 to 739 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1655: oid 21 updating version 739 to 740 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1655: oid 21 version 740 is already newer than 738 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 740 (ObjNum 518 snap 176 seq_num 518) dirty exists 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1655: left oid 21 (ObjNum 518 snap 176 seq_num 518) 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1656: finishing write tid 1 to smithi01278544-15 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1656: finishing write tid 2 to smithi01278544-15 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1656: finishing write tid 3 to smithi01278544-15 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1656: finishing write tid 4 to smithi01278544-15 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1656: finishing write tid 5 to smithi01278544-15 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1656: oid 15 updating version 0 to 842 2024-09-10T18:02:32.703 INFO:tasks.rados.rados.0.smithi012.stdout:1656: oid 15 version 842 is already newer than 839 2024-09-10T18:02:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:1656: oid 15 version 842 is already newer than 840 2024-09-10T18:02:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:1656: oid 15 version 842 is already newer than 841 2024-09-10T18:02:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 842 (ObjNum 519 snap 176 seq_num 519) dirty exists 2024-09-10T18:02:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:1656: left oid 15 (ObjNum 519 snap 176 seq_num 519) 2024-09-10T18:02:32.704 INFO:tasks.rados.rados.0.smithi012.stdout:1657: expect (ObjNum 447 snap 151 seq_num 447) 2024-09-10T18:02:32.925 INFO:tasks.rados.rados.0.smithi012.stdout:1653: done (5 left) 2024-09-10T18:02:32.925 INFO:tasks.rados.rados.0.smithi012.stdout:1654: done (4 left) 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1655: done (3 left) 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1656: done (2 left) 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1657: done (1 left) 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1658: done (0 left) 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1659: rmattr oid 46 current snap is 176 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1660: rollback oid 50 current snap is 176 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 167 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1661: read oid 25 snap -1 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1661: expect deleted 2024-09-10T18:02:32.926 INFO:tasks.rados.rados.0.smithi012.stdout:1662: snap_create 2024-09-10T18:02:32.927 INFO:tasks.rados.rados.0.smithi012.stdout:1660: finishing rollback tid 0 to smithi01278544-50 2024-09-10T18:02:32.927 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 675 (ObjNum 509 snap 172 seq_num 509) dirty exists 2024-09-10T18:02:32.928 INFO:tasks.rados.rados.0.smithi012.stdout:1660: finishing rollback tid 1 to smithi01278544-50 2024-09-10T18:02:32.928 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 747 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:02:32.971 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:32 smithi089 ceph-mon[84132]: pgmap v309: 121 pgs: 30 active+undersized, 4 peering, 12 active+undersized+degraded, 75 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 346 KiB/s wr, 6 op/s; 42/339 objects degraded (12.389%) 2024-09-10T18:02:32.971 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:32 smithi089 ceph-mon[84132]: osdmap e427: 8 total, 7 up, 8 in 2024-09-10T18:02:32.971 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:32 smithi089 ceph-mon[84132]: osdmap e428: 8 total, 7 up, 8 in 2024-09-10T18:02:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:32 smithi012 ceph-mon[89611]: pgmap v309: 121 pgs: 30 active+undersized, 4 peering, 12 active+undersized+degraded, 75 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 346 KiB/s wr, 6 op/s; 42/339 objects degraded (12.389%) 2024-09-10T18:02:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:32 smithi012 ceph-mon[89611]: osdmap e427: 8 total, 7 up, 8 in 2024-09-10T18:02:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:32 smithi012 ceph-mon[89611]: osdmap e428: 8 total, 7 up, 8 in 2024-09-10T18:02:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:32 smithi012 ceph-mon[92029]: pgmap v309: 121 pgs: 30 active+undersized, 4 peering, 12 active+undersized+degraded, 75 active+clean; 158 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 346 KiB/s wr, 6 op/s; 42/339 objects degraded (12.389%) 2024-09-10T18:02:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:32 smithi012 ceph-mon[92029]: osdmap e427: 8 total, 7 up, 8 in 2024-09-10T18:02:33.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:32 smithi012 ceph-mon[92029]: osdmap e428: 8 total, 7 up, 8 in 2024-09-10T18:02:33.535 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:02:33.262+0000 7f6ef8069640 -1 Falling back to public interface 2024-09-10T18:02:33.723 INFO:tasks.rados.rados.0.smithi012.stdout:1659: done (3 left) 2024-09-10T18:02:33.723 INFO:tasks.rados.rados.0.smithi012.stdout:1660: done (2 left) 2024-09-10T18:02:33.723 INFO:tasks.rados.rados.0.smithi012.stdout:1661: done (1 left) 2024-09-10T18:02:33.723 INFO:tasks.rados.rados.0.smithi012.stdout:1662: done (0 left) 2024-09-10T18:02:33.723 INFO:tasks.rados.rados.0.smithi012.stdout:1663: read oid 1 snap -1 2024-09-10T18:02:33.723 INFO:tasks.rados.rados.0.smithi012.stdout:1663: expect (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:02:33.723 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 177 2024-09-10T18:02:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:1664: seq_num 520 ranges {1654784=712704,2367488=434176,2801664=368640} 2024-09-10T18:02:33.737 INFO:tasks.rados.rados.0.smithi012.stdout:1664: writing smithi01278544-14 from 1654784 to 2367488 tid 1 2024-09-10T18:02:33.739 INFO:tasks.rados.rados.0.smithi012.stdout:1664: writing smithi01278544-14 from 2367488 to 2801664 tid 2 2024-09-10T18:02:33.742 INFO:tasks.rados.rados.0.smithi012.stdout:1664: writing smithi01278544-14 from 2801664 to 3170304 tid 3 2024-09-10T18:02:33.743 INFO:tasks.rados.rados.0.smithi012.stdout:1665: snap_remove snap 176 2024-09-10T18:02:34.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:33 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 52/345 objects degraded (15.072%), 13 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:34.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:33 smithi012 ceph-mon[89611]: osdmap e429: 8 total, 7 up, 8 in 2024-09-10T18:02:34.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:02:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:02:33] "GET /metrics HTTP/1.1" 200 36282 "" "Prometheus/2.43.0" 2024-09-10T18:02:34.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:33 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 52/345 objects degraded (15.072%), 13 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:34.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:33 smithi012 ceph-mon[92029]: osdmap e429: 8 total, 7 up, 8 in 2024-09-10T18:02:34.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:33 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 52/345 objects degraded (15.072%), 13 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:34.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:33 smithi089 ceph-mon[84132]: osdmap e429: 8 total, 7 up, 8 in 2024-09-10T18:02:34.727 INFO:tasks.rados.rados.0.smithi012.stdout:1665: done (2 left) 2024-09-10T18:02:34.727 INFO:tasks.rados.rados.0.smithi012.stdout:1666: rollback oid 30 current snap is 177 2024-09-10T18:02:34.727 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 167 2024-09-10T18:02:34.727 INFO:tasks.rados.rados.0.smithi012.stdout:1663: expect (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:02:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:34 smithi012 ceph-mon[89611]: pgmap v312: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 161 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 1.2 MiB/s wr, 10 op/s; 52/345 objects degraded (15.072%) 2024-09-10T18:02:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:34 smithi012 ceph-mon[89611]: osdmap e430: 8 total, 7 up, 8 in 2024-09-10T18:02:35.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:34 smithi012 ceph-mon[92029]: pgmap v312: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 161 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 1.2 MiB/s wr, 10 op/s; 52/345 objects degraded (15.072%) 2024-09-10T18:02:35.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:34 smithi012 ceph-mon[92029]: osdmap e430: 8 total, 7 up, 8 in 2024-09-10T18:02:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:34 smithi089 ceph-mon[84132]: pgmap v312: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 161 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 1.2 MiB/s wr, 10 op/s; 52/345 objects degraded (15.072%) 2024-09-10T18:02:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:34 smithi089 ceph-mon[84132]: osdmap e430: 8 total, 7 up, 8 in 2024-09-10T18:02:35.048 INFO:tasks.rados.rados.0.smithi012.stdout:1664: finishing write tid 1 to smithi01278544-14 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: finishing write tid 2 to smithi01278544-14 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: finishing write tid 3 to smithi01278544-14 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: finishing write tid 4 to smithi01278544-14 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: finishing write tid 5 to smithi01278544-14 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: oid 14 updating version 0 to 1092 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: oid 14 version 1092 is already newer than 1089 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: oid 14 version 1092 is already newer than 1091 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: oid 14 version 1092 is already newer than 1090 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1092 (ObjNum 520 snap 177 seq_num 520) dirty exists 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: left oid 14 (ObjNum 520 snap 177 seq_num 520) 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1663: done (2 left) 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1664: done (1 left) 2024-09-10T18:02:35.049 INFO:tasks.rados.rados.0.smithi012.stdout:1667: copy_from oid 9 from oid 25 current snap is 177 2024-09-10T18:02:35.050 INFO:tasks.rados.rados.0.smithi012.stdout:1666: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:02:35.050 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 0 (ObjNum 33 snap 0 seq_num 1701344078) dirty dne 2024-09-10T18:02:35.050 INFO:tasks.rados.rados.0.smithi012.stdout:1666: done (1 left) 2024-09-10T18:02:35.050 INFO:tasks.rados.rados.0.smithi012.stdout:1668: setattr oid 11 current snap is 177 2024-09-10T18:02:35.051 INFO:tasks.rados.rados.0.smithi012.stdout:1667: finishing copy_from to smithi01278544-9 2024-09-10T18:02:35.051 INFO:tasks.rados.rados.0.smithi012.stdout:1667: got expected ENOENT (src dne) 2024-09-10T18:02:35.051 INFO:tasks.rados.rados.0.smithi012.stdout:1667: finishing copy_from racing read to smithi01278544-9 2024-09-10T18:02:35.051 INFO:tasks.rados.rados.0.smithi012.stdout:1667: done (1 left) 2024-09-10T18:02:35.051 INFO:tasks.rados.rados.0.smithi012.stdout:1669: copy_from oid 16 from oid 33 current snap is 177 2024-09-10T18:02:35.051 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 177 2024-09-10T18:02:35.051 INFO:tasks.rados.rados.0.smithi012.stdout:1670: seq_num 521 ranges {0=729088,729088=720896,1449984=81920} 2024-09-10T18:02:35.053 INFO:tasks.rados.rados.0.smithi012.stdout:1670: writing smithi01278544-25 from 0 to 729088 tid 1 2024-09-10T18:02:35.057 INFO:tasks.rados.rados.0.smithi012.stdout:1670: writing smithi01278544-25 from 729088 to 1449984 tid 2 2024-09-10T18:02:35.058 INFO:tasks.rados.rados.0.smithi012.stdout:1670: writing smithi01278544-25 from 1449984 to 1531904 tid 3 2024-09-10T18:02:35.058 INFO:tasks.rados.rados.0.smithi012.stdout:1671: snap_remove snap 170 2024-09-10T18:02:35.775 INFO:tasks.rados.rados.0.smithi012.stdout:1671: done (3 left) 2024-09-10T18:02:35.775 INFO:tasks.rados.rados.0.smithi012.stdout:1672: copy_from oid 27 from oid 19 current snap is 177 2024-09-10T18:02:35.775 INFO:tasks.rados.rados.0.smithi012.stdout:1669: finishing copy_from to smithi01278544-16 2024-09-10T18:02:35.775 INFO:tasks.rados.rados.0.smithi012.stdout:1669: got expected ENOENT (src dne) 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1669: finishing copy_from racing read to smithi01278544-16 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1163 (ObjNum 33 snap 0 seq_num 3491047216) dirty exists 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: finishing write tid 1 to smithi01278544-25 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: finishing write tid 2 to smithi01278544-25 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: finishing write tid 3 to smithi01278544-25 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: finishing write tid 4 to smithi01278544-25 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: finishing write tid 5 to smithi01278544-25 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: oid 25 updating version 0 to 1167 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: oid 25 version 1167 is already newer than 1165 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: oid 25 version 1167 is already newer than 1166 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:1670: oid 25 version 1167 is already newer than 1164 2024-09-10T18:02:35.776 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1167 (ObjNum 521 snap 177 seq_num 521) dirty exists 2024-09-10T18:02:35.777 INFO:tasks.rados.rados.0.smithi012.stdout:1670: left oid 25 (ObjNum 521 snap 177 seq_num 521) 2024-09-10T18:02:35.777 INFO:tasks.rados.rados.0.smithi012.stdout:1668: done (3 left) 2024-09-10T18:02:35.777 INFO:tasks.rados.rados.0.smithi012.stdout:1669: done (2 left) 2024-09-10T18:02:35.777 INFO:tasks.rados.rados.0.smithi012.stdout:1670: done (1 left) 2024-09-10T18:02:35.777 INFO:tasks.rados.rados.0.smithi012.stdout:1673: snap_create 2024-09-10T18:02:35.781 INFO:tasks.rados.rados.0.smithi012.stdout:1672: finishing copy_from to smithi01278544-27 2024-09-10T18:02:35.781 INFO:tasks.rados.rados.0.smithi012.stdout:1672: got expected ENOENT (src dne) 2024-09-10T18:02:35.782 INFO:tasks.rados.rados.0.smithi012.stdout:1672: finishing copy_from racing read to smithi01278544-27 2024-09-10T18:02:36.777 INFO:tasks.rados.rados.0.smithi012.stdout:1672: done (1 left) 2024-09-10T18:02:36.777 INFO:tasks.rados.rados.0.smithi012.stdout:1673: done (0 left) 2024-09-10T18:02:36.777 INFO:tasks.rados.rados.0.smithi012.stdout:1674: delete oid 30 current snap is 178 2024-09-10T18:02:36.779 INFO:tasks.rados.rados.0.smithi012.stdout:1674: done (0 left) 2024-09-10T18:02:36.779 INFO:tasks.rados.rados.0.smithi012.stdout:1675: rollback oid 41 current snap is 178 2024-09-10T18:02:36.779 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 173 2024-09-10T18:02:36.779 INFO:tasks.rados.rados.0.smithi012.stdout:1676: read oid 42 snap -1 2024-09-10T18:02:36.779 INFO:tasks.rados.rados.0.smithi012.stdout:1676: expect (ObjNum 517 snap 176 seq_num 517) 2024-09-10T18:02:36.779 INFO:tasks.rados.rados.0.smithi012.stdout:1677: copy_from oid 31 from oid 50 current snap is 178 2024-09-10T18:02:36.779 INFO:tasks.rados.rados.0.smithi012.stdout:1678: snap_create 2024-09-10T18:02:36.787 INFO:tasks.rados.rados.0.smithi012.stdout:1675: finishing rollback tid 0 to smithi01278544-41 2024-09-10T18:02:36.788 INFO:tasks.rados.rados.0.smithi012.stdout:1675: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:02:36.788 INFO:tasks.rados.rados.0.smithi012.stdout:1675: finishing rollback tid 2 to smithi01278544-41 2024-09-10T18:02:36.788 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 843 (ObjNum 483 snap 156 seq_num 483) dirty exists 2024-09-10T18:02:36.792 INFO:tasks.rados.rados.0.smithi012.stdout:1677: finishing copy_from to smithi01278544-31 2024-09-10T18:02:36.792 INFO:tasks.rados.rados.0.smithi012.stdout:1677: got expected ENOENT (src dne) 2024-09-10T18:02:36.792 INFO:tasks.rados.rados.0.smithi012.stdout:1677: finishing copy_from racing read to smithi01278544-31 2024-09-10T18:02:36.799 INFO:tasks.rados.rados.0.smithi012.stdout:1676: expect (ObjNum 517 snap 176 seq_num 517) 2024-09-10T18:02:36.882 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:36 smithi089 ceph-mon[84132]: pgmap v315: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 6 op/s; 53/348 objects degraded (15.230%) 2024-09-10T18:02:36.882 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:36.883 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:36.883 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:36 smithi089 ceph-mon[84132]: osdmap e431: 8 total, 7 up, 8 in 2024-09-10T18:02:36.883 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:36.883 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[89611]: pgmap v315: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 6 op/s; 53/348 objects degraded (15.230%) 2024-09-10T18:02:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[89611]: osdmap e431: 8 total, 7 up, 8 in 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[92029]: pgmap v315: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 163 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 6 op/s; 53/348 objects degraded (15.230%) 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[92029]: osdmap e431: 8 total, 7 up, 8 in 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:37.636 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:02:37.341+0000 7f6ef8069640 -1 osd.4 420 log_to_monitors true 2024-09-10T18:02:37.785 INFO:tasks.rados.rados.0.smithi012.stdout:1675: done (3 left) 2024-09-10T18:02:37.785 INFO:tasks.rados.rados.0.smithi012.stdout:1676: done (2 left) 2024-09-10T18:02:37.785 INFO:tasks.rados.rados.0.smithi012.stdout:1677: done (1 left) 2024-09-10T18:02:37.785 INFO:tasks.rados.rados.0.smithi012.stdout:1678: done (0 left) 2024-09-10T18:02:37.785 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 179 2024-09-10T18:02:37.785 INFO:tasks.rados.rados.0.smithi012.stdout:1679: seq_num 523 ranges {10887168=770048,11657216=491520,12148736=311296} 2024-09-10T18:02:37.848 INFO:tasks.rados.rados.0.smithi012.stdout:1679: writing smithi01278544-47 from 10887168 to 11657216 tid 1 2024-09-10T18:02:37.851 INFO:tasks.rados.rados.0.smithi012.stdout:1679: writing smithi01278544-47 from 11657216 to 12148736 tid 2 2024-09-10T18:02:37.854 INFO:tasks.rados.rados.0.smithi012.stdout:1679: writing smithi01278544-47 from 12148736 to 12460032 tid 3 2024-09-10T18:02:37.854 INFO:tasks.rados.rados.0.smithi012.stdout:1680: read oid 37 snap -1 2024-09-10T18:02:37.854 INFO:tasks.rados.rados.0.smithi012.stdout:1680: expect (ObjNum 490 snap 163 seq_num 490) 2024-09-10T18:02:37.854 INFO:tasks.rados.rados.0.smithi012.stdout:1681: snap_create 2024-09-10T18:02:37.855 INFO:tasks.rados.rados.0.smithi012.stdout:1679: finishing write tid 1 to smithi01278544-47 2024-09-10T18:02:37.859 INFO:tasks.rados.rados.0.smithi012.stdout:1679: finishing write tid 2 to smithi01278544-47 2024-09-10T18:02:37.859 INFO:tasks.rados.rados.0.smithi012.stdout:1679: finishing write tid 3 to smithi01278544-47 2024-09-10T18:02:37.860 INFO:tasks.rados.rados.0.smithi012.stdout:1679: finishing write tid 4 to smithi01278544-47 2024-09-10T18:02:37.862 INFO:tasks.rados.rados.0.smithi012.stdout:1679: finishing write tid 5 to smithi01278544-47 2024-09-10T18:02:37.862 INFO:tasks.rados.rados.0.smithi012.stdout:1679: oid 47 updating version 0 to 1094 2024-09-10T18:02:37.862 INFO:tasks.rados.rados.0.smithi012.stdout:1679: oid 47 updating version 1094 to 1097 2024-09-10T18:02:37.862 INFO:tasks.rados.rados.0.smithi012.stdout:1679: oid 47 version 1097 is already newer than 1096 2024-09-10T18:02:37.862 INFO:tasks.rados.rados.0.smithi012.stdout:1679: oid 47 version 1097 is already newer than 1095 2024-09-10T18:02:37.862 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1097 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:02:37.863 INFO:tasks.rados.rados.0.smithi012.stdout:1679: left oid 47 (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:02:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:1680: expect (ObjNum 490 snap 163 seq_num 490) 2024-09-10T18:02:37.943 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:37 smithi089 ceph-mon[84132]: osdmap e432: 8 total, 7 up, 8 in 2024-09-10T18:02:37.944 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:37 smithi089 ceph-mon[84132]: pgmap v318: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.8 MiB/s wr, 14 op/s; 56/366 objects degraded (15.301%) 2024-09-10T18:02:37.944 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:37 smithi089 ceph-mon[84132]: from='osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T18:02:37.944 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:37 smithi089 ceph-mon[84132]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T18:02:37.944 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:02:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:02:37.806+0000 7f6eefe13640 -1 osd.4 420 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T18:02:38.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:37 smithi012 ceph-mon[89611]: osdmap e432: 8 total, 7 up, 8 in 2024-09-10T18:02:38.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:37 smithi012 ceph-mon[89611]: pgmap v318: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.8 MiB/s wr, 14 op/s; 56/366 objects degraded (15.301%) 2024-09-10T18:02:38.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:37 smithi012 ceph-mon[89611]: from='osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T18:02:38.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:37 smithi012 ceph-mon[89611]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T18:02:38.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:37 smithi012 ceph-mon[92029]: osdmap e432: 8 total, 7 up, 8 in 2024-09-10T18:02:38.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:37 smithi012 ceph-mon[92029]: pgmap v318: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 169 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.8 MiB/s wr, 14 op/s; 56/366 objects degraded (15.301%) 2024-09-10T18:02:38.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:37 smithi012 ceph-mon[92029]: from='osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T18:02:38.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:37 smithi012 ceph-mon[92029]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T18:02:38.789 INFO:tasks.rados.rados.0.smithi012.stdout:1679: done (2 left) 2024-09-10T18:02:38.789 INFO:tasks.rados.rados.0.smithi012.stdout:1680: done (1 left) 2024-09-10T18:02:38.789 INFO:tasks.rados.rados.0.smithi012.stdout:1681: done (0 left) 2024-09-10T18:02:38.789 INFO:tasks.rados.rados.0.smithi012.stdout:1682: snap_create 2024-09-10T18:02:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:38 smithi089 ceph-mon[84132]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T18:02:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:38 smithi089 ceph-mon[84132]: from='osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:02:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:38 smithi089 ceph-mon[84132]: osdmap e433: 8 total, 7 up, 8 in 2024-09-10T18:02:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:38 smithi089 ceph-mon[84132]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:02:39.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:38 smithi012 ceph-mon[89611]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T18:02:39.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:38 smithi012 ceph-mon[89611]: from='osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:02:39.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:38 smithi012 ceph-mon[89611]: osdmap e433: 8 total, 7 up, 8 in 2024-09-10T18:02:39.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:38 smithi012 ceph-mon[89611]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:02:39.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:38 smithi012 ceph-mon[92029]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T18:02:39.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:38 smithi012 ceph-mon[92029]: from='osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:02:39.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:38 smithi012 ceph-mon[92029]: osdmap e433: 8 total, 7 up, 8 in 2024-09-10T18:02:39.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:38 smithi012 ceph-mon[92029]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:02:39.787 INFO:tasks.rados.rados.0.smithi012.stdout:1682: done (0 left) 2024-09-10T18:02:39.787 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 181 2024-09-10T18:02:39.787 INFO:tasks.rados.rados.0.smithi012.stdout:1683: seq_num 524 ranges {1064960=786432,1851392=778240,2629632=24576} 2024-09-10T18:02:39.798 INFO:tasks.rados.rados.0.smithi012.stdout:1683: writing smithi01278544-27 from 1064960 to 1851392 tid 1 2024-09-10T18:02:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1683: writing smithi01278544-27 from 1851392 to 2629632 tid 2 2024-09-10T18:02:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1683: writing smithi01278544-27 from 2629632 to 2654208 tid 3 2024-09-10T18:02:39.804 INFO:tasks.rados.rados.0.smithi012.stdout:1684: setattr oid 26 current snap is 181 2024-09-10T18:02:39.807 INFO:tasks.rados.rados.0.smithi012.stdout:1685: read oid 1 snap -1 2024-09-10T18:02:39.807 INFO:tasks.rados.rados.0.smithi012.stdout:1685: expect (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:02:39.807 INFO:tasks.rados.rados.0.smithi012.stdout:1686: rollback oid 7 current snap is 181 2024-09-10T18:02:39.807 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 7 to 179 2024-09-10T18:02:39.807 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 181 2024-09-10T18:02:39.807 INFO:tasks.rados.rados.0.smithi012.stdout:1687: seq_num 525 ranges {630784=802816,1433600=712704,2146304=90112} 2024-09-10T18:02:39.816 INFO:tasks.rados.rados.0.smithi012.stdout:1687: writing smithi01278544-22 from 630784 to 1433600 tid 1 2024-09-10T18:02:39.821 INFO:tasks.rados.rados.0.smithi012.stdout:1687: writing smithi01278544-22 from 1433600 to 2146304 tid 2 2024-09-10T18:02:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:1687: writing smithi01278544-22 from 2146304 to 2236416 tid 3 2024-09-10T18:02:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 181 2024-09-10T18:02:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:1686: finishing rollback tid 0 to smithi01278544-7 2024-09-10T18:02:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:1683: finishing write tid 1 to smithi01278544-27 2024-09-10T18:02:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 744 (ObjNum 498 snap 164 seq_num 498) dirty exists 2024-09-10T18:02:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:1683: finishing write tid 2 to smithi01278544-27 2024-09-10T18:02:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:1683: finishing write tid 3 to smithi01278544-27 2024-09-10T18:02:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:1683: finishing write tid 4 to smithi01278544-27 2024-09-10T18:02:39.823 INFO:tasks.rados.rados.0.smithi012.stdout:1686: finishing rollback tid 1 to smithi01278544-7 2024-09-10T18:02:39.823 INFO:tasks.rados.rados.0.smithi012.stdout:1686: finishing rollback tid 2 to smithi01278544-7 2024-09-10T18:02:39.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 547 (ObjNum 410 snap 134 seq_num 410) dirty exists 2024-09-10T18:02:39.823 INFO:tasks.rados.rados.0.smithi012.stdout:1688: seq_num 526 ranges {4546560=417792,4964352=589824,5554176=614400} 2024-09-10T18:02:39.849 INFO:tasks.rados.rados.0.smithi012.stdout:1688: writing smithi01278544-17 from 4546560 to 4964352 tid 1 2024-09-10T18:02:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:1688: writing smithi01278544-17 from 4964352 to 5554176 tid 2 2024-09-10T18:02:39.856 INFO:tasks.rados.rados.0.smithi012.stdout:1688: writing smithi01278544-17 from 5554176 to 6168576 tid 3 2024-09-10T18:02:39.856 INFO:tasks.rados.rados.0.smithi012.stdout:1684: done (5 left) 2024-09-10T18:02:39.856 INFO:tasks.rados.rados.0.smithi012.stdout:1686: done (4 left) 2024-09-10T18:02:39.856 INFO:tasks.rados.rados.0.smithi012.stdout:1689: delete oid 48 current snap is 181 2024-09-10T18:02:39.856 INFO:tasks.rados.rados.0.smithi012.stdout:1683: finishing write tid 5 to smithi01278544-27 2024-09-10T18:02:39.856 INFO:tasks.rados.rados.0.smithi012.stdout:1683: oid 27 updating version 0 to 678 2024-09-10T18:02:39.856 INFO:tasks.rados.rados.0.smithi012.stdout:1683: oid 27 version 678 is already newer than 677 2024-09-10T18:02:39.857 INFO:tasks.rados.rados.0.smithi012.stdout:1683: oid 27 updating version 678 to 679 2024-09-10T18:02:39.857 INFO:tasks.rados.rados.0.smithi012.stdout:1683: oid 27 version 679 is already newer than 676 2024-09-10T18:02:39.857 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 679 (ObjNum 524 snap 181 seq_num 524) dirty exists 2024-09-10T18:02:39.857 INFO:tasks.rados.rados.0.smithi012.stdout:1683: left oid 27 (ObjNum 524 snap 181 seq_num 524) 2024-09-10T18:02:39.857 INFO:tasks.rados.rados.0.smithi012.stdout:1687: finishing write tid 1 to smithi01278544-22 2024-09-10T18:02:39.857 INFO:tasks.rados.rados.0.smithi012.stdout:1687: finishing write tid 2 to smithi01278544-22 2024-09-10T18:02:39.857 INFO:tasks.rados.rados.0.smithi012.stdout:1685: expect (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:02:39.980 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:02:39.571+0000 7f7a9b686640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-10T18:02:39.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:02:39.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246] boot 2024-09-10T18:02:39.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: osdmap e434: 8 total, 8 up, 8 in 2024-09-10T18:02:39.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: pgmap v321: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 169 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s; 56/366 objects degraded (15.301%) 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-10T18:02:39.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[89611]: osdmap e435: 8 total, 8 up, 8 in 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246] boot 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: osdmap e434: 8 total, 8 up, 8 in 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: pgmap v321: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 169 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s; 56/366 objects degraded (15.301%) 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:39.982 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:39.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:39.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:39.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:39.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-10T18:02:39.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T18:02:39.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-10T18:02:39.983 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:39 smithi012 ceph-mon[92029]: osdmap e435: 8 total, 8 up, 8 in 2024-09-10T18:02:40.189 INFO:tasks.rados.rados.0.smithi012.stdout:1687: finishing write tid 3 to smithi01278544-22 2024-09-10T18:02:40.189 INFO:tasks.rados.rados.0.smithi012.stdout:1687: finishing write tid 4 to smithi01278544-22 2024-09-10T18:02:40.189 INFO:tasks.rados.rados.0.smithi012.stdout:1687: finishing write tid 5 to smithi01278544-22 2024-09-10T18:02:40.189 INFO:tasks.rados.rados.0.smithi012.stdout:1687: oid 22 updating version 0 to 1171 2024-09-10T18:02:40.189 INFO:tasks.rados.rados.0.smithi012.stdout:1687: oid 22 version 1171 is already newer than 1169 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1687: oid 22 version 1171 is already newer than 1170 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1687: oid 22 updating version 1171 to 1172 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1172 (ObjNum 525 snap 181 seq_num 525) dirty exists 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1687: left oid 22 (ObjNum 525 snap 181 seq_num 525) 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1688: finishing write tid 1 to smithi01278544-17 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1683: done (4 left) 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1685: done (3 left) 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1687: done (2 left) 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1689: done (1 left) 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1690: delete oid 15 current snap is 181 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1688: finishing write tid 2 to smithi01278544-17 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1688: finishing write tid 3 to smithi01278544-17 2024-09-10T18:02:40.190 INFO:tasks.rados.rados.0.smithi012.stdout:1688: finishing write tid 4 to smithi01278544-17 2024-09-10T18:02:40.191 INFO:tasks.rados.rados.0.smithi012.stdout:1688: finishing write tid 5 to smithi01278544-17 2024-09-10T18:02:40.191 INFO:tasks.rados.rados.0.smithi012.stdout:1688: oid 17 updating version 0 to 762 2024-09-10T18:02:40.191 INFO:tasks.rados.rados.0.smithi012.stdout:1688: oid 17 updating version 762 to 764 2024-09-10T18:02:40.191 INFO:tasks.rados.rados.0.smithi012.stdout:1688: oid 17 version 764 is already newer than 763 2024-09-10T18:02:40.191 INFO:tasks.rados.rados.0.smithi012.stdout:1688: oid 17 version 764 is already newer than 761 2024-09-10T18:02:40.191 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 764 (ObjNum 526 snap 181 seq_num 526) dirty exists 2024-09-10T18:02:40.191 INFO:tasks.rados.rados.0.smithi012.stdout:1688: left oid 17 (ObjNum 526 snap 181 seq_num 526) 2024-09-10T18:02:40.192 INFO:tasks.rados.rados.0.smithi012.stdout:1688: done (1 left) 2024-09-10T18:02:40.192 INFO:tasks.rados.rados.0.smithi012.stdout:1690: done (0 left) 2024-09-10T18:02:40.192 INFO:tasks.rados.rados.0.smithi012.stdout:1691: copy_from oid 27 from oid 15 current snap is 181 2024-09-10T18:02:40.192 INFO:tasks.rados.rados.0.smithi012.stdout:1692: read oid 30 snap 178 2024-09-10T18:02:40.192 INFO:tasks.rados.rados.0.smithi012.stdout:1692: expect deleted 2024-09-10T18:02:40.192 INFO:tasks.rados.rados.0.smithi012.stdout:1693: snap_remove snap 175 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: osd.4 [v2:172.21.15.89:6800/2682567246,v1:172.21.15.89:6801/2682567246] boot 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: osdmap e434: 8 total, 8 up, 8 in 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: pgmap v321: 121 pgs: 33 active+undersized, 13 active+undersized+degraded, 75 active+clean; 169 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s; 56/366 objects degraded (15.301%) 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:02:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:40.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:02:40.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:40.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:40.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:40.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-10T18:02:40.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T18:02:40.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-10T18:02:40.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:39 smithi089 ceph-mon[84132]: osdmap e435: 8 total, 8 up, 8 in 2024-09-10T18:02:40.815 INFO:tasks.rados.rados.0.smithi012.stdout:1693: done (2 left) 2024-09-10T18:02:40.816 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 181 2024-09-10T18:02:40.816 INFO:tasks.rados.rados.0.smithi012.stdout:1694: seq_num 529 ranges {3153920=466944,3620864=647168,4268032=532480,4800512=24576} 2024-09-10T18:02:40.836 INFO:tasks.rados.rados.0.smithi012.stdout:1694: writing smithi01278544-7 from 3153920 to 3620864 tid 1 2024-09-10T18:02:40.839 INFO:tasks.rados.rados.0.smithi012.stdout:1694: writing smithi01278544-7 from 3620864 to 4268032 tid 2 2024-09-10T18:02:40.842 INFO:tasks.rados.rados.0.smithi012.stdout:1694: writing smithi01278544-7 from 4268032 to 4800512 tid 3 2024-09-10T18:02:40.843 INFO:tasks.rados.rados.0.smithi012.stdout:1694: writing smithi01278544-7 from 4800512 to 4825088 tid 4 2024-09-10T18:02:40.843 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 181 2024-09-10T18:02:40.843 INFO:tasks.rados.rados.0.smithi012.stdout:1695: seq_num 530 ranges {0=483328,483328=532480,1015808=671744} 2024-09-10T18:02:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:1695: writing smithi01278544-40 from 0 to 483328 tid 1 2024-09-10T18:02:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:1695: writing smithi01278544-40 from 483328 to 1015808 tid 2 2024-09-10T18:02:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:1695: writing smithi01278544-40 from 1015808 to 1687552 tid 3 2024-09-10T18:02:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:1696: read oid 47 snap -1 2024-09-10T18:02:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:1696: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:02:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:1697: rmattr oid 29 current snap is 181 2024-09-10T18:02:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:1697: done (5 left) 2024-09-10T18:02:40.854 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 181 2024-09-10T18:02:40.854 INFO:tasks.rados.rados.0.smithi012.stdout:1691: finishing copy_from to smithi01278544-27 2024-09-10T18:02:40.854 INFO:tasks.rados.rados.0.smithi012.stdout:1691: got expected ENOENT (src dne) 2024-09-10T18:02:40.854 INFO:tasks.rados.rados.0.smithi012.stdout:1691: finishing copy_from racing read to smithi01278544-27 2024-09-10T18:02:40.854 INFO:tasks.rados.rados.0.smithi012.stdout:1698: seq_num 531 ranges {0=499712,499712=417792,917504=548864,1466368=237568} 2024-09-10T18:02:40.856 INFO:tasks.rados.rados.0.smithi012.stdout:1698: writing smithi01278544-48 from 0 to 499712 tid 1 2024-09-10T18:02:40.858 INFO:tasks.rados.rados.0.smithi012.stdout:1698: writing smithi01278544-48 from 499712 to 917504 tid 2 2024-09-10T18:02:40.861 INFO:tasks.rados.rados.0.smithi012.stdout:1698: writing smithi01278544-48 from 917504 to 1466368 tid 3 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1698: writing smithi01278544-48 from 1466368 to 1703936 tid 4 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1691: done (5 left) 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1692: done (4 left) 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1699: delete oid 24 current snap is 181 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1694: finishing write tid 1 to smithi01278544-7 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1694: finishing write tid 2 to smithi01278544-7 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1694: finishing write tid 3 to smithi01278544-7 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1694: finishing write tid 4 to smithi01278544-7 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1694: finishing write tid 5 to smithi01278544-7 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1694: finishing write tid 6 to smithi01278544-7 2024-09-10T18:02:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:1694: oid 7 updating version 0 to 552 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1694: oid 7 version 552 is already newer than 548 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1694: oid 7 version 552 is already newer than 550 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1694: oid 7 version 552 is already newer than 551 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1694: oid 7 version 552 is already newer than 549 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 552 (ObjNum 529 snap 181 seq_num 529) dirty exists 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1694: left oid 7 (ObjNum 529 snap 181 seq_num 529) 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1695: finishing write tid 1 to smithi01278544-40 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1695: finishing write tid 2 to smithi01278544-40 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1695: finishing write tid 3 to smithi01278544-40 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1695: finishing write tid 4 to smithi01278544-40 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1698: finishing write tid 1 to smithi01278544-48 2024-09-10T18:02:40.865 INFO:tasks.rados.rados.0.smithi012.stdout:1698: finishing write tid 2 to smithi01278544-48 2024-09-10T18:02:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:1694: done (4 left) 2024-09-10T18:02:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:1699: done (3 left) 2024-09-10T18:02:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 181 2024-09-10T18:02:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:1698: finishing write tid 3 to smithi01278544-48 2024-09-10T18:02:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:1700: seq_num 533 ranges {2514944=532480,3047424=630784,3678208=516096,4194304=57344} 2024-09-10T18:02:40.883 INFO:tasks.rados.rados.0.smithi012.stdout:1700: writing smithi01278544-31 from 2514944 to 3047424 tid 1 2024-09-10T18:02:40.887 INFO:tasks.rados.rados.0.smithi012.stdout:1700: writing smithi01278544-31 from 3047424 to 3678208 tid 2 2024-09-10T18:02:40.890 INFO:tasks.rados.rados.0.smithi012.stdout:1700: writing smithi01278544-31 from 3678208 to 4194304 tid 3 2024-09-10T18:02:40.891 INFO:tasks.rados.rados.0.smithi012.stdout:1700: writing smithi01278544-31 from 4194304 to 4251648 tid 4 2024-09-10T18:02:40.891 INFO:tasks.rados.rados.0.smithi012.stdout:1701: snap_create 2024-09-10T18:02:40.891 INFO:tasks.rados.rados.0.smithi012.stdout:1698: finishing write tid 4 to smithi01278544-48 2024-09-10T18:02:40.891 INFO:tasks.rados.rados.0.smithi012.stdout:1698: finishing write tid 5 to smithi01278544-48 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1698: finishing write tid 6 to smithi01278544-48 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1698: oid 48 updating version 0 to 747 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1698: oid 48 version 747 is already newer than 745 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1698: oid 48 version 747 is already newer than 744 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1698: oid 48 updating version 747 to 748 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1698: oid 48 version 748 is already newer than 746 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 748 (ObjNum 531 snap 181 seq_num 531) dirty exists 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1698: left oid 48 (ObjNum 531 snap 181 seq_num 531) 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1700: finishing write tid 1 to smithi01278544-31 2024-09-10T18:02:40.892 INFO:tasks.rados.rados.0.smithi012.stdout:1700: finishing write tid 2 to smithi01278544-31 2024-09-10T18:02:40.896 INFO:tasks.rados.rados.0.smithi012.stdout:1700: finishing write tid 3 to smithi01278544-31 2024-09-10T18:02:40.896 INFO:tasks.rados.rados.0.smithi012.stdout:1695: finishing write tid 5 to smithi01278544-40 2024-09-10T18:02:40.896 INFO:tasks.rados.rados.0.smithi012.stdout:1695: oid 40 updating version 0 to 1115 2024-09-10T18:02:40.896 INFO:tasks.rados.rados.0.smithi012.stdout:1695: oid 40 updating version 1115 to 1116 2024-09-10T18:02:40.896 INFO:tasks.rados.rados.0.smithi012.stdout:1695: oid 40 updating version 1116 to 1117 2024-09-10T18:02:40.896 INFO:tasks.rados.rados.0.smithi012.stdout:1695: oid 40 version 1117 is already newer than 1114 2024-09-10T18:02:40.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1117 (ObjNum 530 snap 181 seq_num 530) dirty exists 2024-09-10T18:02:40.896 INFO:tasks.rados.rados.0.smithi012.stdout:1695: left oid 40 (ObjNum 530 snap 181 seq_num 530) 2024-09-10T18:02:40.897 INFO:tasks.rados.rados.0.smithi012.stdout:1700: finishing write tid 4 to smithi01278544-31 2024-09-10T18:02:40.897 INFO:tasks.rados.rados.0.smithi012.stdout:1700: finishing write tid 5 to smithi01278544-31 2024-09-10T18:02:40.899 INFO:tasks.rados.rados.0.smithi012.stdout:1700: finishing write tid 6 to smithi01278544-31 2024-09-10T18:02:40.899 INFO:tasks.rados.rados.0.smithi012.stdout:1700: oid 31 updating version 0 to 844 2024-09-10T18:02:40.899 INFO:tasks.rados.rados.0.smithi012.stdout:1700: oid 31 updating version 844 to 847 2024-09-10T18:02:40.899 INFO:tasks.rados.rados.0.smithi012.stdout:1700: oid 31 version 847 is already newer than 846 2024-09-10T18:02:40.899 INFO:tasks.rados.rados.0.smithi012.stdout:1700: oid 31 updating version 847 to 848 2024-09-10T18:02:40.899 INFO:tasks.rados.rados.0.smithi012.stdout:1700: oid 31 version 848 is already newer than 845 2024-09-10T18:02:40.899 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 848 (ObjNum 533 snap 181 seq_num 533) dirty exists 2024-09-10T18:02:40.899 INFO:tasks.rados.rados.0.smithi012.stdout:1700: left oid 31 (ObjNum 533 snap 181 seq_num 533) 2024-09-10T18:02:40.904 INFO:tasks.rados.rados.0.smithi012.stdout:1696: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:02:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:41 smithi012 ceph-mon[89611]: osdmap e436: 8 total, 8 up, 8 in 2024-09-10T18:02:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:41 smithi012 ceph-mon[89611]: pgmap v324: 121 pgs: 31 active+undersized, 9 active+undersized+degraded, 81 active+clean; 169 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.8 MiB/s rd, 0 B/s wr, 1 op/s; 40/366 objects degraded (10.929%); 1.5 MiB/s, 1 objects/s recovering 2024-09-10T18:02:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:41 smithi012 ceph-mon[92029]: osdmap e436: 8 total, 8 up, 8 in 2024-09-10T18:02:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:41 smithi012 ceph-mon[92029]: pgmap v324: 121 pgs: 31 active+undersized, 9 active+undersized+degraded, 81 active+clean; 169 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.8 MiB/s rd, 0 B/s wr, 1 op/s; 40/366 objects degraded (10.929%); 1.5 MiB/s, 1 objects/s recovering 2024-09-10T18:02:42.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:41 smithi089 ceph-mon[84132]: osdmap e436: 8 total, 8 up, 8 in 2024-09-10T18:02:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:41 smithi089 ceph-mon[84132]: pgmap v324: 121 pgs: 31 active+undersized, 9 active+undersized+degraded, 81 active+clean; 169 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.8 MiB/s rd, 0 B/s wr, 1 op/s; 40/366 objects degraded (10.929%); 1.5 MiB/s, 1 objects/s recovering 2024-09-10T18:02:42.302 INFO:tasks.rados.rados.0.smithi012.stdout:1695: done (4 left) 2024-09-10T18:02:42.302 INFO:tasks.rados.rados.0.smithi012.stdout:1696: done (3 left) 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1698: done (2 left) 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1700: done (1 left) 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1701: done (0 left) 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1702: rollback oid 21 current snap is 182 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 167 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1703: read oid 13 snap 171 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1703: expect (ObjNum -798053920 snap 22079 seq_num 3496231840) 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1704: read oid 1 snap -1 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1704: expect (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:1705: rollback oid 12 current snap is 182 2024-09-10T18:02:42.304 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 12 to 179 2024-09-10T18:02:42.305 INFO:tasks.rados.rados.0.smithi012.stdout:1706: read oid 24 snap -1 2024-09-10T18:02:42.305 INFO:tasks.rados.rados.0.smithi012.stdout:1706: expect deleted 2024-09-10T18:02:42.305 INFO:tasks.rados.rados.0.smithi012.stdout:1707: rollback oid 32 current snap is 182 2024-09-10T18:02:42.305 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 32 to 158 2024-09-10T18:02:42.305 INFO:tasks.rados.rados.0.smithi012.stdout:1708: rollback oid 10 current snap is 182 2024-09-10T18:02:42.305 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 173 2024-09-10T18:02:42.305 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 182 2024-09-10T18:02:42.305 INFO:tasks.rados.rados.0.smithi012.stdout:1709: seq_num 534 ranges {4825088=548864,5373952=516096,5890048=688128} 2024-09-10T18:02:42.333 INFO:tasks.rados.rados.0.smithi012.stdout:1709: writing smithi01278544-7 from 4825088 to 5373952 tid 1 2024-09-10T18:02:42.336 INFO:tasks.rados.rados.0.smithi012.stdout:1709: writing smithi01278544-7 from 5373952 to 5890048 tid 2 2024-09-10T18:02:42.340 INFO:tasks.rados.rados.0.smithi012.stdout:1709: writing smithi01278544-7 from 5890048 to 6578176 tid 3 2024-09-10T18:02:42.340 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 182 2024-09-10T18:02:42.340 INFO:tasks.rados.rados.0.smithi012.stdout:1710: seq_num 535 ranges {3170304=565248,3735552=802816,4538368=401408} 2024-09-10T18:02:42.360 INFO:tasks.rados.rados.0.smithi012.stdout:1710: writing smithi01278544-14 from 3170304 to 3735552 tid 1 2024-09-10T18:02:42.365 INFO:tasks.rados.rados.0.smithi012.stdout:1710: writing smithi01278544-14 from 3735552 to 4538368 tid 2 2024-09-10T18:02:42.367 INFO:tasks.rados.rados.0.smithi012.stdout:1710: writing smithi01278544-14 from 4538368 to 4939776 tid 3 2024-09-10T18:02:42.368 INFO:tasks.rados.rados.0.smithi012.stdout:1711: copy_from oid 45 from oid 16 current snap is 182 2024-09-10T18:02:42.368 INFO:tasks.rados.rados.0.smithi012.stdout:1703: expect (ObjNum -798053920 snap 22079 seq_num 3496231840) 2024-09-10T18:02:42.370 INFO:tasks.rados.rados.0.smithi012.stdout:1707: finishing rollback tid 1 to smithi01278544-32 2024-09-10T18:02:42.370 INFO:tasks.rados.rados.0.smithi012.stdout:1702: finishing rollback tid 0 to smithi01278544-21 2024-09-10T18:02:42.370 INFO:tasks.rados.rados.0.smithi012.stdout:1703: done (9 left) 2024-09-10T18:02:42.370 INFO:tasks.rados.rados.0.smithi012.stdout:1706: done (8 left) 2024-09-10T18:02:42.370 INFO:tasks.rados.rados.0.smithi012.stdout:1712: snap_remove snap 169 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1712: done (8 left) 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1713: read oid 9 snap -1 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1713: expect deleted 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1714: read oid 47 snap 167 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1714: expect (ObjNum 473 snap 154 seq_num 473) 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1715: delete oid 41 current snap is 182 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1707: finishing rollback tid 2 to smithi01278544-32 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 744 (ObjNum 477 snap 155 seq_num 477) dirty exists 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1702: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 742 (ObjNum 129 snap 0 seq_num 3012565660) dirty dne 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1705: finishing rollback tid 0 to smithi01278544-12 2024-09-10T18:02:42.832 INFO:tasks.rados.rados.0.smithi012.stdout:1705: finishing rollback tid 1 to smithi01278544-12 2024-09-10T18:02:42.833 INFO:tasks.rados.rados.0.smithi012.stdout:1705: finishing rollback tid 2 to smithi01278544-12 2024-09-10T18:02:42.833 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1184 (ObjNum 81 snap 0 seq_num 3013064685) dirty exists 2024-09-10T18:02:42.833 INFO:tasks.rados.rados.0.smithi012.stdout:1708: finishing rollback tid 0 to smithi01278544-10 2024-09-10T18:02:42.833 INFO:tasks.rados.rados.0.smithi012.stdout:1708: finishing rollback tid 1 to smithi01278544-10 2024-09-10T18:02:42.833 INFO:tasks.rados.rados.0.smithi012.stdout:1708: finishing rollback tid 2 to smithi01278544-10 2024-09-10T18:02:42.833 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1188 (ObjNum 445 snap 150 seq_num 445) dirty exists 2024-09-10T18:02:42.833 INFO:tasks.rados.rados.0.smithi012.stdout:1704: expect (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:02:43.163 INFO:tasks.rados.rados.0.smithi012.stdout:1709: finishing write tid 1 to smithi01278544-7 2024-09-10T18:02:43.163 INFO:tasks.rados.rados.0.smithi012.stdout:1709: finishing write tid 2 to smithi01278544-7 2024-09-10T18:02:43.163 INFO:tasks.rados.rados.0.smithi012.stdout:1709: finishing write tid 3 to smithi01278544-7 2024-09-10T18:02:43.163 INFO:tasks.rados.rados.0.smithi012.stdout:1709: finishing write tid 4 to smithi01278544-7 2024-09-10T18:02:43.163 INFO:tasks.rados.rados.0.smithi012.stdout:1709: finishing write tid 5 to smithi01278544-7 2024-09-10T18:02:43.163 INFO:tasks.rados.rados.0.smithi012.stdout:1709: oid 7 updating version 0 to 556 2024-09-10T18:02:43.163 INFO:tasks.rados.rados.0.smithi012.stdout:1709: oid 7 version 556 is already newer than 553 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1709: oid 7 version 556 is already newer than 554 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1709: oid 7 version 556 is already newer than 555 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 556 (ObjNum 534 snap 182 seq_num 534) dirty exists 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1709: left oid 7 (ObjNum 534 snap 182 seq_num 534) 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1710: finishing write tid 1 to smithi01278544-14 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1702: done (10 left) 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1704: done (9 left) 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1705: done (8 left) 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1707: done (7 left) 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1708: done (6 left) 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1709: done (5 left) 2024-09-10T18:02:43.164 INFO:tasks.rados.rados.0.smithi012.stdout:1715: done (4 left) 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1716: delete oid 26 current snap is 182 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: finishing write tid 2 to smithi01278544-14 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: finishing write tid 3 to smithi01278544-14 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: finishing write tid 4 to smithi01278544-14 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1711: finishing copy_from racing read to smithi01278544-45 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: finishing write tid 5 to smithi01278544-14 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: oid 14 updating version 0 to 1122 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: oid 14 version 1122 is already newer than 1120 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: oid 14 version 1122 is already newer than 1121 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: oid 14 version 1122 is already newer than 1119 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1122 (ObjNum 535 snap 182 seq_num 535) dirty exists 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1710: left oid 14 (ObjNum 535 snap 182 seq_num 535) 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1711: finishing copy_from to smithi01278544-45 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 833 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:02:43.165 INFO:tasks.rados.rados.0.smithi012.stdout:1714: expect (ObjNum 473 snap 154 seq_num 473) 2024-09-10T18:02:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:42 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 40/366 objects degraded (10.929%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:42 smithi012 ceph-mon[89611]: osdmap e437: 8 total, 8 up, 8 in 2024-09-10T18:02:43.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:42 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 40/366 objects degraded (10.929%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:43.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:42 smithi012 ceph-mon[92029]: osdmap e437: 8 total, 8 up, 8 in 2024-09-10T18:02:43.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:42 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 40/366 objects degraded (10.929%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:02:43.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:42 smithi089 ceph-mon[84132]: osdmap e437: 8 total, 8 up, 8 in 2024-09-10T18:02:44.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:43 smithi012 ceph-mon[89611]: osdmap e438: 8 total, 8 up, 8 in 2024-09-10T18:02:44.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:43 smithi012 ceph-mon[89611]: pgmap v327: 121 pgs: 8 active+undersized, 3 active+undersized+degraded, 110 active+clean; 181 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 17 op/s; 7/384 objects degraded (1.823%); 12 MiB/s, 3 objects/s recovering 2024-09-10T18:02:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:02:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:02:43] "GET /metrics HTTP/1.1" 200 36282 "" "Prometheus/2.43.0" 2024-09-10T18:02:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:43 smithi012 ceph-mon[92029]: osdmap e438: 8 total, 8 up, 8 in 2024-09-10T18:02:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:43 smithi012 ceph-mon[92029]: pgmap v327: 121 pgs: 8 active+undersized, 3 active+undersized+degraded, 110 active+clean; 181 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 17 op/s; 7/384 objects degraded (1.823%); 12 MiB/s, 3 objects/s recovering 2024-09-10T18:02:44.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:43 smithi089 ceph-mon[84132]: osdmap e438: 8 total, 8 up, 8 in 2024-09-10T18:02:44.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:43 smithi089 ceph-mon[84132]: pgmap v327: 121 pgs: 8 active+undersized, 3 active+undersized+degraded, 110 active+clean; 181 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 17 op/s; 7/384 objects degraded (1.823%); 12 MiB/s, 3 objects/s recovering 2024-09-10T18:02:44.341 INFO:tasks.rados.rados.0.smithi012.stdout:1710: done (4 left) 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1711: done (3 left) 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1713: done (2 left) 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1714: done (1 left) 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1716: done (0 left) 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1717: read oid 29 snap -1 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1717: expect (ObjNum 481 snap 156 seq_num 481) 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1718: rollback oid 6 current snap is 182 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 6 to 158 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1719: read oid 9 snap -1 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:1719: expect deleted 2024-09-10T18:02:44.342 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 182 2024-09-10T18:02:44.343 INFO:tasks.rados.rados.0.smithi012.stdout:1720: seq_num 538 ranges {0=614400,614400=450560,1064960=704512,1769472=49152} 2024-09-10T18:02:44.344 INFO:tasks.rados.rados.0.smithi012.stdout:1720: writing smithi01278544-26 from 0 to 614400 tid 1 2024-09-10T18:02:44.347 INFO:tasks.rados.rados.0.smithi012.stdout:1720: writing smithi01278544-26 from 614400 to 1064960 tid 2 2024-09-10T18:02:44.351 INFO:tasks.rados.rados.0.smithi012.stdout:1720: writing smithi01278544-26 from 1064960 to 1769472 tid 3 2024-09-10T18:02:44.351 INFO:tasks.rados.rados.0.smithi012.stdout:1720: writing smithi01278544-26 from 1769472 to 1818624 tid 4 2024-09-10T18:02:44.351 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 182 2024-09-10T18:02:44.351 INFO:tasks.rados.rados.0.smithi012.stdout:1721: seq_num 539 ranges {5750784=630784,6381568=737280,7118848=466944} 2024-09-10T18:02:44.386 INFO:tasks.rados.rados.0.smithi012.stdout:1721: writing smithi01278544-35 from 5750784 to 6381568 tid 1 2024-09-10T18:02:44.390 INFO:tasks.rados.rados.0.smithi012.stdout:1721: writing smithi01278544-35 from 6381568 to 7118848 tid 2 2024-09-10T18:02:44.393 INFO:tasks.rados.rados.0.smithi012.stdout:1721: writing smithi01278544-35 from 7118848 to 7585792 tid 3 2024-09-10T18:02:44.394 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 182 2024-09-10T18:02:44.394 INFO:tasks.rados.rados.0.smithi012.stdout:1722: seq_num 540 ranges {5095424=647168,5742592=671744,6414336=532480} 2024-09-10T18:02:44.425 INFO:tasks.rados.rados.0.smithi012.stdout:1722: writing smithi01278544-37 from 5095424 to 5742592 tid 1 2024-09-10T18:02:44.428 INFO:tasks.rados.rados.0.smithi012.stdout:1722: writing smithi01278544-37 from 5742592 to 6414336 tid 2 2024-09-10T18:02:44.432 INFO:tasks.rados.rados.0.smithi012.stdout:1722: writing smithi01278544-37 from 6414336 to 6946816 tid 3 2024-09-10T18:02:44.432 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 182 2024-09-10T18:02:44.432 INFO:tasks.rados.rados.0.smithi012.stdout:1718: finishing rollback tid 1 to smithi01278544-6 2024-09-10T18:02:44.432 INFO:tasks.rados.rados.0.smithi012.stdout:1718: finishing rollback tid 2 to smithi01278544-6 2024-09-10T18:02:44.432 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 998 (ObjNum 457 snap 153 seq_num 457) dirty exists 2024-09-10T18:02:44.432 INFO:tasks.rados.rados.0.smithi012.stdout:1720: finishing write tid 1 to smithi01278544-26 2024-09-10T18:02:44.432 INFO:tasks.rados.rados.0.smithi012.stdout:1723: seq_num 541 ranges {1531904=663552,2195456=557056,2752512=475136,3227648=172032} 2024-09-10T18:02:44.444 INFO:tasks.rados.rados.0.smithi012.stdout:1723: writing smithi01278544-25 from 1531904 to 2195456 tid 1 2024-09-10T18:02:44.447 INFO:tasks.rados.rados.0.smithi012.stdout:1723: writing smithi01278544-25 from 2195456 to 2752512 tid 2 2024-09-10T18:02:44.449 INFO:tasks.rados.rados.0.smithi012.stdout:1723: writing smithi01278544-25 from 2752512 to 3227648 tid 3 2024-09-10T18:02:44.450 INFO:tasks.rados.rados.0.smithi012.stdout:1723: writing smithi01278544-25 from 3227648 to 3399680 tid 4 2024-09-10T18:02:44.450 INFO:tasks.rados.rados.0.smithi012.stdout:1718: done (6 left) 2024-09-10T18:02:44.450 INFO:tasks.rados.rados.0.smithi012.stdout:1719: done (5 left) 2024-09-10T18:02:44.451 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 182 2024-09-10T18:02:44.451 INFO:tasks.rados.rados.0.smithi012.stdout:1724: seq_num 542 ranges {0=679936,679936=442368,1122304=679936,1802240=81920} 2024-09-10T18:02:44.454 INFO:tasks.rados.rados.0.smithi012.stdout:1724: writing smithi01278544-21 from 0 to 679936 tid 1 2024-09-10T18:02:44.457 INFO:tasks.rados.rados.0.smithi012.stdout:1724: writing smithi01278544-21 from 679936 to 1122304 tid 2 2024-09-10T18:02:44.461 INFO:tasks.rados.rados.0.smithi012.stdout:1724: writing smithi01278544-21 from 1122304 to 1802240 tid 3 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1724: writing smithi01278544-21 from 1802240 to 1884160 tid 4 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1725: delete oid 50 current snap is 182 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: finishing write tid 2 to smithi01278544-26 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: finishing write tid 3 to smithi01278544-26 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: finishing write tid 4 to smithi01278544-26 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: finishing write tid 5 to smithi01278544-26 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: finishing write tid 6 to smithi01278544-26 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: oid 26 updating version 0 to 748 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: oid 26 updating version 748 to 749 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: oid 26 updating version 749 to 750 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: oid 26 updating version 750 to 751 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:1720: oid 26 version 751 is already newer than 747 2024-09-10T18:02:44.462 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 751 (ObjNum 538 snap 182 seq_num 538) dirty exists 2024-09-10T18:02:44.463 INFO:tasks.rados.rados.0.smithi012.stdout:1720: left oid 26 (ObjNum 538 snap 182 seq_num 538) 2024-09-10T18:02:44.463 INFO:tasks.rados.rados.0.smithi012.stdout:1717: expect (ObjNum 481 snap 156 seq_num 481) 2024-09-10T18:02:45.002 INFO:tasks.rados.rados.0.smithi012.stdout:1721: finishing write tid 1 to smithi01278544-35 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: finishing write tid 2 to smithi01278544-35 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: finishing write tid 3 to smithi01278544-35 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: finishing write tid 4 to smithi01278544-35 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: finishing write tid 5 to smithi01278544-35 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: oid 35 updating version 0 to 746 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: oid 35 updating version 746 to 747 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: oid 35 version 747 is already newer than 745 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: oid 35 updating version 747 to 748 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 748 (ObjNum 539 snap 182 seq_num 539) dirty exists 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1721: left oid 35 (ObjNum 539 snap 182 seq_num 539) 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1722: finishing write tid 1 to smithi01278544-37 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1722: finishing write tid 2 to smithi01278544-37 2024-09-10T18:02:45.003 INFO:tasks.rados.rados.0.smithi012.stdout:1722: finishing write tid 3 to smithi01278544-37 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1722: finishing write tid 4 to smithi01278544-37 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1722: finishing write tid 5 to smithi01278544-37 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1722: oid 37 updating version 0 to 851 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1722: oid 37 version 851 is already newer than 850 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1722: oid 37 updating version 851 to 852 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1722: oid 37 updating version 852 to 853 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 853 (ObjNum 540 snap 182 seq_num 540) dirty exists 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1722: left oid 37 (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1723: finishing write tid 1 to smithi01278544-25 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1723: finishing write tid 2 to smithi01278544-25 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1723: finishing write tid 3 to smithi01278544-25 2024-09-10T18:02:45.004 INFO:tasks.rados.rados.0.smithi012.stdout:1723: finishing write tid 4 to smithi01278544-25 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1723: finishing write tid 5 to smithi01278544-25 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1723: finishing write tid 6 to smithi01278544-25 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1723: oid 25 updating version 0 to 1202 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1723: oid 25 version 1202 is already newer than 1198 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1723: oid 25 version 1202 is already newer than 1199 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1723: oid 25 version 1202 is already newer than 1201 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1723: oid 25 version 1202 is already newer than 1200 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1202 (ObjNum 541 snap 182 seq_num 541) dirty exists 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1723: left oid 25 (ObjNum 541 snap 182 seq_num 541) 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1724: finishing write tid 1 to smithi01278544-21 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1724: finishing write tid 2 to smithi01278544-21 2024-09-10T18:02:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:1717: done (6 left) 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1720: done (5 left) 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1721: done (4 left) 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1722: done (3 left) 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1723: done (2 left) 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1725: done (1 left) 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1726: rollback oid 49 current snap is 182 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 49 to 181 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1724: finishing write tid 3 to smithi01278544-21 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1724: finishing write tid 4 to smithi01278544-21 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1724: finishing write tid 5 to smithi01278544-21 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1724: finishing write tid 6 to smithi01278544-21 2024-09-10T18:02:45.006 INFO:tasks.rados.rados.0.smithi012.stdout:1724: oid 21 updating version 0 to 744 2024-09-10T18:02:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:1724: oid 21 updating version 744 to 746 2024-09-10T18:02:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:1724: oid 21 updating version 746 to 747 2024-09-10T18:02:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:1724: oid 21 version 747 is already newer than 745 2024-09-10T18:02:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:1724: oid 21 version 747 is already newer than 743 2024-09-10T18:02:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 747 (ObjNum 542 snap 182 seq_num 542) dirty exists 2024-09-10T18:02:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:1724: left oid 21 (ObjNum 542 snap 182 seq_num 542) 2024-09-10T18:02:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:1724: done (1 left) 2024-09-10T18:02:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:1727: snap_remove snap 171 2024-09-10T18:02:45.060 INFO:tasks.rados.rados.0.smithi012.stdout:1727: done (1 left) 2024-09-10T18:02:45.060 INFO:tasks.rados.rados.0.smithi012.stdout:1728: rmattr oid 4 current snap is 182 2024-09-10T18:02:45.061 INFO:tasks.rados.rados.0.smithi012.stdout:1726: finishing rollback tid 0 to smithi01278544-49 2024-09-10T18:02:45.061 INFO:tasks.rados.rados.0.smithi012.stdout:1726: finishing rollback tid 1 to smithi01278544-49 2024-09-10T18:02:45.061 INFO:tasks.rados.rados.0.smithi012.stdout:1726: finishing rollback tid 2 to smithi01278544-49 2024-09-10T18:02:45.061 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 846 (ObjNum 513 snap 173 seq_num 513) dirty exists 2024-09-10T18:02:45.061 INFO:tasks.rados.rados.0.smithi012.stdout:1726: done (1 left) 2024-09-10T18:02:45.061 INFO:tasks.rados.rados.0.smithi012.stdout:1729: snap_create 2024-09-10T18:02:45.076 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 854 (ObjNum 486 snap 160 seq_num 486) dirty exists 2024-09-10T18:02:46.065 INFO:tasks.rados.rados.0.smithi012.stdout:1728: done (1 left) 2024-09-10T18:02:46.065 INFO:tasks.rados.rados.0.smithi012.stdout:1729: done (0 left) 2024-09-10T18:02:46.065 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 183 2024-09-10T18:02:46.065 INFO:tasks.rados.rados.0.smithi012.stdout:1730: seq_num 544 ranges {4972544=720896,5693440=614400,6307840=589824} 2024-09-10T18:02:46.096 INFO:tasks.rados.rados.0.smithi012.stdout:1730: writing smithi01278544-32 from 4972544 to 5693440 tid 1 2024-09-10T18:02:46.099 INFO:tasks.rados.rados.0.smithi012.stdout:1730: writing smithi01278544-32 from 5693440 to 6307840 tid 2 2024-09-10T18:02:46.103 INFO:tasks.rados.rados.0.smithi012.stdout:1730: writing smithi01278544-32 from 6307840 to 6897664 tid 3 2024-09-10T18:02:46.103 INFO:tasks.rados.rados.0.smithi012.stdout:1731: rollback oid 4 current snap is 183 2024-09-10T18:02:46.103 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 178 2024-09-10T18:02:46.103 INFO:tasks.rados.rados.0.smithi012.stdout:1730: finishing write tid 1 to smithi01278544-32 2024-09-10T18:02:46.103 INFO:tasks.rados.rados.0.smithi012.stdout:1730: finishing write tid 2 to smithi01278544-32 2024-09-10T18:02:46.104 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 183 2024-09-10T18:02:46.104 INFO:tasks.rados.rados.0.smithi012.stdout:1732: seq_num 545 ranges {6168576=737280,6905856=491520,7397376=450560,7847936=262144} 2024-09-10T18:02:46.141 INFO:tasks.rados.rados.0.smithi012.stdout:1732: writing smithi01278544-17 from 6168576 to 6905856 tid 1 2024-09-10T18:02:46.143 INFO:tasks.rados.rados.0.smithi012.stdout:1732: writing smithi01278544-17 from 6905856 to 7397376 tid 2 2024-09-10T18:02:46.146 INFO:tasks.rados.rados.0.smithi012.stdout:1732: writing smithi01278544-17 from 7397376 to 7847936 tid 3 2024-09-10T18:02:46.148 INFO:tasks.rados.rados.0.smithi012.stdout:1732: writing smithi01278544-17 from 7847936 to 8110080 tid 4 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1733: rollback oid 34 current snap is 183 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 34 to 178 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1730: finishing write tid 3 to smithi01278544-32 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1730: finishing write tid 4 to smithi01278544-32 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1730: finishing write tid 5 to smithi01278544-32 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1730: oid 32 updating version 0 to 751 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1730: oid 32 version 751 is already newer than 750 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1730: oid 32 updating version 751 to 752 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1730: oid 32 version 752 is already newer than 749 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 752 (ObjNum 544 snap 183 seq_num 544) dirty exists 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1730: left oid 32 (ObjNum 544 snap 183 seq_num 544) 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1731: finishing rollback tid 0 to smithi01278544-4 2024-09-10T18:02:46.149 INFO:tasks.rados.rados.0.smithi012.stdout:1731: finishing rollback tid 1 to smithi01278544-4 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:1731: finishing rollback tid 2 to smithi01278544-4 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 857 (ObjNum 486 snap 160 seq_num 486) dirty exists 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:1730: done (3 left) 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:1731: done (2 left) 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:1734: setattr oid 16 current snap is 183 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:1733: finishing rollback tid 1 to smithi01278544-34 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:1732: finishing write tid 1 to smithi01278544-17 2024-09-10T18:02:46.150 INFO:tasks.rados.rados.0.smithi012.stdout:1732: finishing write tid 2 to smithi01278544-17 2024-09-10T18:02:46.151 INFO:tasks.rados.rados.0.smithi012.stdout:1733: done (2 left) 2024-09-10T18:02:46.151 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 183 2024-09-10T18:02:46.151 INFO:tasks.rados.rados.0.smithi012.stdout:1735: seq_num 546 ranges {0=753664,753664=778240,1531904=425984} 2024-09-10T18:02:46.153 INFO:tasks.rados.rados.0.smithi012.stdout:1735: writing smithi01278544-15 from 0 to 753664 tid 1 2024-09-10T18:02:46.158 INFO:tasks.rados.rados.0.smithi012.stdout:1735: writing smithi01278544-15 from 753664 to 1531904 tid 2 2024-09-10T18:02:46.160 INFO:tasks.rados.rados.0.smithi012.stdout:1735: writing smithi01278544-15 from 1531904 to 1957888 tid 3 2024-09-10T18:02:46.160 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 183 2024-09-10T18:02:46.160 INFO:tasks.rados.rados.0.smithi012.stdout:1732: finishing write tid 3 to smithi01278544-17 2024-09-10T18:02:46.161 INFO:tasks.rados.rados.0.smithi012.stdout:1736: seq_num 547 ranges {4276224=770048,5046272=663552,5709824=466944,6176768=73728} 2024-09-10T18:02:46.187 INFO:tasks.rados.rados.0.smithi012.stdout:1736: writing smithi01278544-42 from 4276224 to 5046272 tid 1 2024-09-10T18:02:46.192 INFO:tasks.rados.rados.0.smithi012.stdout:1736: writing smithi01278544-42 from 5046272 to 5709824 tid 2 2024-09-10T18:02:46.195 INFO:tasks.rados.rados.0.smithi012.stdout:1736: writing smithi01278544-42 from 5709824 to 6176768 tid 3 2024-09-10T18:02:46.196 INFO:tasks.rados.rados.0.smithi012.stdout:1736: writing smithi01278544-42 from 6176768 to 6250496 tid 4 2024-09-10T18:02:46.196 INFO:tasks.rados.rados.0.smithi012.stdout:1737: read oid 12 snap -1 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1737: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1738: copy_from oid 25 from oid 31 current snap is 183 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: finishing write tid 4 to smithi01278544-17 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: finishing write tid 5 to smithi01278544-17 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 999 (ObjNum 892876594 snap 825046068 seq_num 304) dirty exists 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: finishing write tid 6 to smithi01278544-17 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: oid 17 updating version 0 to 767 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: oid 17 version 767 is already newer than 766 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: oid 17 version 767 is already newer than 765 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: oid 17 updating version 767 to 769 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: oid 17 version 769 is already newer than 768 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 769 (ObjNum 545 snap 183 seq_num 545) dirty exists 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1732: left oid 17 (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:02:46.197 INFO:tasks.rados.rados.0.smithi012.stdout:1735: finishing write tid 1 to smithi01278544-15 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1732: done (5 left) 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1734: done (4 left) 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1739: rollback oid 11 current snap is 183 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 181 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: finishing write tid 2 to smithi01278544-15 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: finishing write tid 3 to smithi01278544-15 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: finishing write tid 4 to smithi01278544-15 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: finishing write tid 5 to smithi01278544-15 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: oid 15 updating version 0 to 849 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: oid 15 version 849 is already newer than 848 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: oid 15 updating version 849 to 850 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: oid 15 version 850 is already newer than 847 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 850 (ObjNum 546 snap 183 seq_num 546) dirty exists 2024-09-10T18:02:46.198 INFO:tasks.rados.rados.0.smithi012.stdout:1735: left oid 15 (ObjNum 546 snap 183 seq_num 546) 2024-09-10T18:02:46.199 INFO:tasks.rados.rados.0.smithi012.stdout:1735: done (4 left) 2024-09-10T18:02:46.199 INFO:tasks.rados.rados.0.smithi012.stdout:1740: copy_from oid 29 from oid 32 current snap is 183 2024-09-10T18:02:46.199 INFO:tasks.rados.rados.0.smithi012.stdout:1736: finishing write tid 1 to smithi01278544-42 2024-09-10T18:02:46.199 INFO:tasks.rados.rados.0.smithi012.stdout:1736: finishing write tid 2 to smithi01278544-42 2024-09-10T18:02:46.199 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 183 2024-09-10T18:02:46.199 INFO:tasks.rados.rados.0.smithi012.stdout:1741: seq_num 548 ranges {1818624=786432,2605056=598016,3203072=606208} 2024-09-10T18:02:46.210 INFO:tasks.rados.rados.0.smithi012.stdout:1741: writing smithi01278544-26 from 1818624 to 2605056 tid 1 2024-09-10T18:02:46.213 INFO:tasks.rados.rados.0.smithi012.stdout:1741: writing smithi01278544-26 from 2605056 to 3203072 tid 2 2024-09-10T18:02:46.217 INFO:tasks.rados.rados.0.smithi012.stdout:1741: writing smithi01278544-26 from 3203072 to 3809280 tid 3 2024-09-10T18:02:46.217 INFO:tasks.rados.rados.0.smithi012.stdout:1742: delete oid 44 current snap is 183 2024-09-10T18:02:46.217 INFO:tasks.rados.rados.0.smithi012.stdout:1737: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:46.220 INFO:tasks.rados.rados.0.smithi012.stdout:1736: finishing write tid 3 to smithi01278544-42 2024-09-10T18:02:46.220 INFO:tasks.rados.rados.0.smithi012.stdout:1736: finishing write tid 4 to smithi01278544-42 2024-09-10T18:02:46.220 INFO:tasks.rados.rados.0.smithi012.stdout:1739: finishing rollback tid 0 to smithi01278544-11 2024-09-10T18:02:46.220 INFO:tasks.rados.rados.0.smithi012.stdout:1736: finishing write tid 5 to smithi01278544-42 2024-09-10T18:02:46.220 INFO:tasks.rados.rados.0.smithi012.stdout:1739: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:02:46.220 INFO:tasks.rados.rados.0.smithi012.stdout:1739: finishing rollback tid 2 to smithi01278544-11 2024-09-10T18:02:46.220 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1214 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1736: finishing write tid 6 to smithi01278544-42 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1736: oid 42 updating version 0 to 1145 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1736: oid 42 updating version 1145 to 1147 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1736: oid 42 updating version 1147 to 1148 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1736: oid 42 version 1148 is already newer than 1146 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1736: oid 42 updating version 1148 to 1149 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1149 (ObjNum 547 snap 183 seq_num 547) dirty exists 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1736: left oid 42 (ObjNum 547 snap 183 seq_num 547) 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1741: finishing write tid 1 to smithi01278544-26 2024-09-10T18:02:46.221 INFO:tasks.rados.rados.0.smithi012.stdout:1741: finishing write tid 2 to smithi01278544-26 2024-09-10T18:02:46.222 INFO:tasks.rados.rados.0.smithi012.stdout:1741: finishing write tid 3 to smithi01278544-26 2024-09-10T18:02:46.222 INFO:tasks.rados.rados.0.smithi012.stdout:1736: done (6 left) 2024-09-10T18:02:46.222 INFO:tasks.rados.rados.0.smithi012.stdout:1737: done (5 left) 2024-09-10T18:02:46.222 INFO:tasks.rados.rados.0.smithi012.stdout:1739: done (4 left) 2024-09-10T18:02:46.222 INFO:tasks.rados.rados.0.smithi012.stdout:1742: done (3 left) 2024-09-10T18:02:46.222 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 183 2024-09-10T18:02:46.222 INFO:tasks.rados.rados.0.smithi012.stdout:1743: seq_num 550 ranges {1957888=417792,2375680=770048,3145728=638976,3784704=196608} 2024-09-10T18:02:46.234 INFO:tasks.rados.rados.0.smithi012.stdout:1743: writing smithi01278544-15 from 1957888 to 2375680 tid 1 2024-09-10T18:02:46.239 INFO:tasks.rados.rados.0.smithi012.stdout:1743: writing smithi01278544-15 from 2375680 to 3145728 tid 2 2024-09-10T18:02:46.242 INFO:tasks.rados.rados.0.smithi012.stdout:1743: writing smithi01278544-15 from 3145728 to 3784704 tid 3 2024-09-10T18:02:46.244 INFO:tasks.rados.rados.0.smithi012.stdout:1743: writing smithi01278544-15 from 3784704 to 3981312 tid 4 2024-09-10T18:02:46.244 INFO:tasks.rados.rados.0.smithi012.stdout:1744: rollback oid 45 current snap is 183 2024-09-10T18:02:46.244 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 45 to 180 2024-09-10T18:02:46.244 INFO:tasks.rados.rados.0.smithi012.stdout:1741: finishing write tid 4 to smithi01278544-26 2024-09-10T18:02:46.244 INFO:tasks.rados.rados.0.smithi012.stdout:1741: finishing write tid 5 to smithi01278544-26 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1741: oid 26 updating version 0 to 754 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1741: oid 26 version 754 is already newer than 753 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1741: oid 26 version 754 is already newer than 752 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1741: oid 26 updating version 754 to 755 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 755 (ObjNum 548 snap 183 seq_num 548) dirty exists 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1741: left oid 26 (ObjNum 548 snap 183 seq_num 548) 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1738: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1740: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1738: finishing copy_from to smithi01278544-25 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 848 (ObjNum 533 snap 181 seq_num 533) dirty exists 2024-09-10T18:02:46.245 INFO:tasks.rados.rados.0.smithi012.stdout:1740: finishing copy_from to smithi01278544-29 2024-09-10T18:02:46.246 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 752 (ObjNum 544 snap 183 seq_num 544) dirty exists 2024-09-10T18:02:46.246 INFO:tasks.rados.rados.0.smithi012.stdout:1743: finishing write tid 1 to smithi01278544-15 2024-09-10T18:02:46.246 INFO:tasks.rados.rados.0.smithi012.stdout:1738: done (4 left) 2024-09-10T18:02:46.246 INFO:tasks.rados.rados.0.smithi012.stdout:1740: done (3 left) 2024-09-10T18:02:46.246 INFO:tasks.rados.rados.0.smithi012.stdout:1741: done (2 left) 2024-09-10T18:02:46.246 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 183 2024-09-10T18:02:46.246 INFO:tasks.rados.rados.0.smithi012.stdout:1743: finishing write tid 2 to smithi01278544-15 2024-09-10T18:02:46.246 INFO:tasks.rados.rados.0.smithi012.stdout:1745: seq_num 551 ranges {8142848=434176,8577024=647168,9224192=450560,9674752=507904} 2024-09-10T18:02:46.290 INFO:tasks.rados.rados.0.smithi012.stdout:1745: writing smithi01278544-46 from 8142848 to 8577024 tid 1 2024-09-10T18:02:46.294 INFO:tasks.rados.rados.0.smithi012.stdout:1745: writing smithi01278544-46 from 8577024 to 9224192 tid 2 2024-09-10T18:02:46.296 INFO:tasks.rados.rados.0.smithi012.stdout:1745: writing smithi01278544-46 from 9224192 to 9674752 tid 3 2024-09-10T18:02:46.299 INFO:tasks.rados.rados.0.smithi012.stdout:1745: writing smithi01278544-46 from 9674752 to 10182656 tid 4 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1746: setattr oid 13 current snap is 183 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1744: finishing rollback tid 0 to smithi01278544-45 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1743: finishing write tid 3 to smithi01278544-15 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1743: finishing write tid 4 to smithi01278544-15 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1744: finishing rollback tid 1 to smithi01278544-45 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1152 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1743: finishing write tid 5 to smithi01278544-15 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1743: finishing write tid 6 to smithi01278544-15 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1743: oid 15 updating version 0 to 853 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1743: oid 15 version 853 is already newer than 852 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1743: oid 15 version 853 is already newer than 851 2024-09-10T18:02:46.300 INFO:tasks.rados.rados.0.smithi012.stdout:1743: oid 15 updating version 853 to 854 2024-09-10T18:02:46.301 INFO:tasks.rados.rados.0.smithi012.stdout:1743: oid 15 updating version 854 to 855 2024-09-10T18:02:46.301 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 855 (ObjNum 550 snap 183 seq_num 550) dirty exists 2024-09-10T18:02:46.301 INFO:tasks.rados.rados.0.smithi012.stdout:1743: left oid 15 (ObjNum 550 snap 183 seq_num 550) 2024-09-10T18:02:46.301 INFO:tasks.rados.rados.0.smithi012.stdout:1745: finishing write tid 1 to smithi01278544-46 2024-09-10T18:02:46.301 INFO:tasks.rados.rados.0.smithi012.stdout:1745: finishing write tid 2 to smithi01278544-46 2024-09-10T18:02:46.301 INFO:tasks.rados.rados.0.smithi012.stdout:1745: finishing write tid 3 to smithi01278544-46 2024-09-10T18:02:46.302 INFO:tasks.rados.rados.0.smithi012.stdout:1745: finishing write tid 4 to smithi01278544-46 2024-09-10T18:02:46.302 INFO:tasks.rados.rados.0.smithi012.stdout:1745: finishing write tid 5 to smithi01278544-46 2024-09-10T18:02:46.302 INFO:tasks.rados.rados.0.smithi012.stdout:1743: done (3 left) 2024-09-10T18:02:46.302 INFO:tasks.rados.rados.0.smithi012.stdout:1744: done (2 left) 2024-09-10T18:02:46.302 INFO:tasks.rados.rados.0.smithi012.stdout:1747: setattr oid 17 current snap is 183 2024-09-10T18:02:46.305 INFO:tasks.rados.rados.0.smithi012.stdout:1745: finishing write tid 6 to smithi01278544-46 2024-09-10T18:02:46.305 INFO:tasks.rados.rados.0.smithi012.stdout:1745: oid 46 updating version 0 to 694 2024-09-10T18:02:46.305 INFO:tasks.rados.rados.0.smithi012.stdout:1745: oid 46 version 694 is already newer than 693 2024-09-10T18:02:46.305 INFO:tasks.rados.rados.0.smithi012.stdout:1745: oid 46 updating version 694 to 697 2024-09-10T18:02:46.305 INFO:tasks.rados.rados.0.smithi012.stdout:1745: oid 46 version 697 is already newer than 695 2024-09-10T18:02:46.305 INFO:tasks.rados.rados.0.smithi012.stdout:1745: oid 46 version 697 is already newer than 696 2024-09-10T18:02:46.305 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 697 (ObjNum 551 snap 183 seq_num 551) dirty exists 2024-09-10T18:02:46.305 INFO:tasks.rados.rados.0.smithi012.stdout:1745: left oid 46 (ObjNum 551 snap 183 seq_num 551) 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 858 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1745: done (2 left) 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1746: done (1 left) 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1748: copy_from oid 43 from oid 26 current snap is 183 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1749: read oid 28 snap -1 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1749: expect (ObjNum 516 snap 175 seq_num 516) 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1750: rollback oid 32 current snap is 183 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 32 to 167 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1751: copy_from oid 9 from oid 37 current snap is 183 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1752: rollback oid 16 current snap is 183 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 177 2024-09-10T18:02:46.307 INFO:tasks.rados.rados.0.smithi012.stdout:1753: snap_create 2024-09-10T18:02:46.311 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 770 (ObjNum 545 snap 183 seq_num 545) dirty exists 2024-09-10T18:02:46.312 INFO:tasks.rados.rados.0.smithi012.stdout:1750: finishing rollback tid 0 to smithi01278544-32 2024-09-10T18:02:46.312 INFO:tasks.rados.rados.0.smithi012.stdout:1752: finishing rollback tid 0 to smithi01278544-16 2024-09-10T18:02:46.313 INFO:tasks.rados.rados.0.smithi012.stdout:1750: finishing rollback tid 1 to smithi01278544-32 2024-09-10T18:02:46.313 INFO:tasks.rados.rados.0.smithi012.stdout:1750: finishing rollback tid 2 to smithi01278544-32 2024-09-10T18:02:46.313 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 755 (ObjNum 477 snap 155 seq_num 477) dirty exists 2024-09-10T18:02:46.313 INFO:tasks.rados.rados.0.smithi012.stdout:1752: finishing rollback tid 1 to smithi01278544-16 2024-09-10T18:02:46.313 INFO:tasks.rados.rados.0.smithi012.stdout:1752: finishing rollback tid 2 to smithi01278544-16 2024-09-10T18:02:46.313 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 1002 (ObjNum 892876594 snap 825046068 seq_num 304) dirty exists 2024-09-10T18:02:46.323 INFO:tasks.rados.rados.0.smithi012.stdout:1749: expect (ObjNum 516 snap 175 seq_num 516) 2024-09-10T18:02:46.398 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:46 smithi089 ceph-mon[84132]: pgmap v328: 121 pgs: 121 active+clean; 183 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 11 MiB/s, 3 objects/s recovering 2024-09-10T18:02:46.398 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:46 smithi089 ceph-mon[84132]: osdmap e439: 8 total, 8 up, 8 in 2024-09-10T18:02:46.398 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:46 smithi089 ceph-mon[84132]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/384 objects degraded (1.823%), 3 pgs degraded) 2024-09-10T18:02:46.398 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:46 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:02:46.496 INFO:tasks.rados.rados.0.smithi012.stdout:1748: finishing copy_from racing read to smithi01278544-43 2024-09-10T18:02:46.496 INFO:tasks.rados.rados.0.smithi012.stdout:1748: finishing copy_from to smithi01278544-43 2024-09-10T18:02:46.497 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 755 (ObjNum 548 snap 183 seq_num 548) dirty exists 2024-09-10T18:02:46.497 INFO:tasks.rados.rados.0.smithi012.stdout:1751: finishing copy_from racing read to smithi01278544-9 2024-09-10T18:02:46.497 INFO:tasks.rados.rados.0.smithi012.stdout:1751: finishing copy_from to smithi01278544-9 2024-09-10T18:02:46.497 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 853 (ObjNum 540 snap 182 seq_num 540) dirty exists 2024-09-10T18:02:46.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:46 smithi012 ceph-mon[89611]: pgmap v328: 121 pgs: 121 active+clean; 183 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 11 MiB/s, 3 objects/s recovering 2024-09-10T18:02:46.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:46 smithi012 ceph-mon[89611]: osdmap e439: 8 total, 8 up, 8 in 2024-09-10T18:02:46.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:46 smithi012 ceph-mon[89611]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/384 objects degraded (1.823%), 3 pgs degraded) 2024-09-10T18:02:46.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:46 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:02:46.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:46 smithi012 ceph-mon[92029]: pgmap v328: 121 pgs: 121 active+clean; 183 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 11 MiB/s, 3 objects/s recovering 2024-09-10T18:02:46.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:46 smithi012 ceph-mon[92029]: osdmap e439: 8 total, 8 up, 8 in 2024-09-10T18:02:46.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:46 smithi012 ceph-mon[92029]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/384 objects degraded (1.823%), 3 pgs degraded) 2024-09-10T18:02:46.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:46 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:02:47.066 INFO:tasks.rados.rados.0.smithi012.stdout:1747: done (6 left) 2024-09-10T18:02:47.066 INFO:tasks.rados.rados.0.smithi012.stdout:1748: done (5 left) 2024-09-10T18:02:47.066 INFO:tasks.rados.rados.0.smithi012.stdout:1749: done (4 left) 2024-09-10T18:02:47.066 INFO:tasks.rados.rados.0.smithi012.stdout:1750: done (3 left) 2024-09-10T18:02:47.066 INFO:tasks.rados.rados.0.smithi012.stdout:1751: done (2 left) 2024-09-10T18:02:47.066 INFO:tasks.rados.rados.0.smithi012.stdout:1752: done (1 left) 2024-09-10T18:02:47.066 INFO:tasks.rados.rados.0.smithi012.stdout:1753: done (0 left) 2024-09-10T18:02:47.066 INFO:tasks.rados.rados.0.smithi012.stdout:1754: snap_create 2024-09-10T18:02:47.352 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:47 smithi089 ceph-mon[84132]: osdmap e440: 8 total, 8 up, 8 in 2024-09-10T18:02:47.352 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:47 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:47.352 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:47 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:47.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:47 smithi012 ceph-mon[89611]: osdmap e440: 8 total, 8 up, 8 in 2024-09-10T18:02:47.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:47 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:47.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:47 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:47.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:47 smithi012 ceph-mon[92029]: osdmap e440: 8 total, 8 up, 8 in 2024-09-10T18:02:47.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:47 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:47.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:47 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:02:47.704 INFO:tasks.rados.rados.0.smithi012.stdout:1754: done (0 left) 2024-09-10T18:02:47.705 INFO:tasks.rados.rados.0.smithi012.stdout:1755: read oid 37 snap -1 2024-09-10T18:02:47.705 INFO:tasks.rados.rados.0.smithi012.stdout:1755: expect (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:02:47.705 INFO:tasks.rados.rados.0.smithi012.stdout:1756: read oid 17 snap -1 2024-09-10T18:02:47.705 INFO:tasks.rados.rados.0.smithi012.stdout:1756: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:02:47.705 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 185 2024-09-10T18:02:47.705 INFO:tasks.rados.rados.0.smithi012.stdout:1757: seq_num 552 ranges {0=450560,450560=532480,983040=655360,1638400=417792} 2024-09-10T18:02:47.707 INFO:tasks.rados.rados.0.smithi012.stdout:1757: writing smithi01278544-39 from 0 to 450560 tid 1 2024-09-10T18:02:47.711 INFO:tasks.rados.rados.0.smithi012.stdout:1757: writing smithi01278544-39 from 450560 to 983040 tid 2 2024-09-10T18:02:47.715 INFO:tasks.rados.rados.0.smithi012.stdout:1757: writing smithi01278544-39 from 983040 to 1638400 tid 3 2024-09-10T18:02:47.717 INFO:tasks.rados.rados.0.smithi012.stdout:1757: writing smithi01278544-39 from 1638400 to 2056192 tid 4 2024-09-10T18:02:47.718 INFO:tasks.rados.rados.0.smithi012.stdout:1758: copy_from oid 29 from oid 44 current snap is 185 2024-09-10T18:02:47.718 INFO:tasks.rados.rados.0.smithi012.stdout:1757: finishing write tid 1 to smithi01278544-39 2024-09-10T18:02:47.718 INFO:tasks.rados.rados.0.smithi012.stdout:1757: finishing write tid 2 to smithi01278544-39 2024-09-10T18:02:47.718 INFO:tasks.rados.rados.0.smithi012.stdout:1759: delete oid 22 current snap is 185 2024-09-10T18:02:47.719 INFO:tasks.rados.rados.0.smithi012.stdout:1758: finishing copy_from to smithi01278544-29 2024-09-10T18:02:47.719 INFO:tasks.rados.rados.0.smithi012.stdout:1758: got expected ENOENT (src dne) 2024-09-10T18:02:47.719 INFO:tasks.rados.rados.0.smithi012.stdout:1758: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:02:47.722 INFO:tasks.rados.rados.0.smithi012.stdout:1757: finishing write tid 3 to smithi01278544-39 2024-09-10T18:02:47.722 INFO:tasks.rados.rados.0.smithi012.stdout:1757: finishing write tid 4 to smithi01278544-39 2024-09-10T18:02:47.722 INFO:tasks.rados.rados.0.smithi012.stdout:1757: finishing write tid 5 to smithi01278544-39 2024-09-10T18:02:47.726 INFO:tasks.rados.rados.0.smithi012.stdout:1757: finishing write tid 6 to smithi01278544-39 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1757: oid 39 updating version 0 to 1219 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1757: oid 39 version 1219 is already newer than 1218 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1757: oid 39 updating version 1219 to 1221 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1757: oid 39 version 1221 is already newer than 1217 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1757: oid 39 version 1221 is already newer than 1220 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1221 (ObjNum 552 snap 185 seq_num 552) dirty exists 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1757: left oid 39 (ObjNum 552 snap 185 seq_num 552) 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1757: done (4 left) 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1758: done (3 left) 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1759: done (2 left) 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:1760: rollback oid 49 current snap is 185 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 49 to 178 2024-09-10T18:02:47.727 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 185 2024-09-10T18:02:47.728 INFO:tasks.rados.rados.0.smithi012.stdout:1761: seq_num 554 ranges {6946816=483328,7430144=704512,8134656=622592,8757248=278528} 2024-09-10T18:02:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:1761: writing smithi01278544-9 from 6946816 to 7430144 tid 1 2024-09-10T18:02:47.772 INFO:tasks.rados.rados.0.smithi012.stdout:1761: writing smithi01278544-9 from 7430144 to 8134656 tid 2 2024-09-10T18:02:47.775 INFO:tasks.rados.rados.0.smithi012.stdout:1761: writing smithi01278544-9 from 8134656 to 8757248 tid 3 2024-09-10T18:02:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:1761: writing smithi01278544-9 from 8757248 to 9035776 tid 4 2024-09-10T18:02:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:1762: snap_create 2024-09-10T18:02:47.777 INFO:tasks.rados.rados.0.smithi012.stdout:1755: expect (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:02:48.232 INFO:tasks.rados.rados.0.smithi012.stdout:1760: finishing rollback tid 0 to smithi01278544-49 2024-09-10T18:02:48.233 INFO:tasks.rados.rados.0.smithi012.stdout:1760: finishing rollback tid 1 to smithi01278544-49 2024-09-10T18:02:48.233 INFO:tasks.rados.rados.0.smithi012.stdout:1756: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:02:48.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:48 smithi012 ceph-mon[89611]: pgmap v331: 121 pgs: 121 active+clean; 209 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 5.7 MiB/s wr, 38 op/s; 3.0 MiB/s, 1 objects/s recovering 2024-09-10T18:02:48.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:48 smithi012 ceph-mon[89611]: osdmap e441: 8 total, 8 up, 8 in 2024-09-10T18:02:48.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:48 smithi012 ceph-mon[89611]: osdmap e442: 8 total, 8 up, 8 in 2024-09-10T18:02:48.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:48 smithi012 ceph-mon[92029]: pgmap v331: 121 pgs: 121 active+clean; 209 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 5.7 MiB/s wr, 38 op/s; 3.0 MiB/s, 1 objects/s recovering 2024-09-10T18:02:48.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:48 smithi012 ceph-mon[92029]: osdmap e441: 8 total, 8 up, 8 in 2024-09-10T18:02:48.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:48 smithi012 ceph-mon[92029]: osdmap e442: 8 total, 8 up, 8 in 2024-09-10T18:02:48.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:48 smithi089 ceph-mon[84132]: pgmap v331: 121 pgs: 121 active+clean; 209 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 5.7 MiB/s wr, 38 op/s; 3.0 MiB/s, 1 objects/s recovering 2024-09-10T18:02:48.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:48 smithi089 ceph-mon[84132]: osdmap e441: 8 total, 8 up, 8 in 2024-09-10T18:02:48.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:48 smithi089 ceph-mon[84132]: osdmap e442: 8 total, 8 up, 8 in 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:1760: finishing rollback tid 2 to smithi01278544-49 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 858 (ObjNum 513 snap 173 seq_num 513) dirty exists 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:1761: finishing write tid 1 to smithi01278544-9 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:1761: finishing write tid 2 to smithi01278544-9 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:1761: finishing write tid 3 to smithi01278544-9 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:1761: finishing write tid 4 to smithi01278544-9 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:1755: done (4 left) 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:1756: done (3 left) 2024-09-10T18:02:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:1760: done (2 left) 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1762: done (1 left) 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1763: read oid 10 snap -1 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1763: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 186 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1761: finishing write tid 5 to smithi01278544-9 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1761: finishing write tid 6 to smithi01278544-9 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1761: oid 9 updating version 0 to 854 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1761: oid 9 updating version 854 to 857 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1761: oid 9 version 857 is already newer than 855 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1761: oid 9 version 857 is already newer than 856 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1761: oid 9 updating version 857 to 858 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 858 (ObjNum 554 snap 185 seq_num 554) dirty exists 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1761: left oid 9 (ObjNum 554 snap 185 seq_num 554) 2024-09-10T18:02:48.778 INFO:tasks.rados.rados.0.smithi012.stdout:1764: seq_num 555 ranges {1458176=499712,1957888=638976,2596864=425984,3022848=540672} 2024-09-10T18:02:48.787 INFO:tasks.rados.rados.0.smithi012.stdout:1764: writing smithi01278544-5 from 1458176 to 1957888 tid 1 2024-09-10T18:02:48.790 INFO:tasks.rados.rados.0.smithi012.stdout:1764: writing smithi01278544-5 from 1957888 to 2596864 tid 2 2024-09-10T18:02:48.793 INFO:tasks.rados.rados.0.smithi012.stdout:1764: writing smithi01278544-5 from 2596864 to 3022848 tid 3 2024-09-10T18:02:48.796 INFO:tasks.rados.rados.0.smithi012.stdout:1764: writing smithi01278544-5 from 3022848 to 3563520 tid 4 2024-09-10T18:02:48.796 INFO:tasks.rados.rados.0.smithi012.stdout:1761: done (2 left) 2024-09-10T18:02:48.796 INFO:tasks.rados.rados.0.smithi012.stdout:1765: rmattr oid 3 current snap is 186 2024-09-10T18:02:48.796 INFO:tasks.rados.rados.0.smithi012.stdout:1763: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:48.805 INFO:tasks.rados.rados.0.smithi012.stdout:1764: finishing write tid 1 to smithi01278544-5 2024-09-10T18:02:48.805 INFO:tasks.rados.rados.0.smithi012.stdout:1764: finishing write tid 2 to smithi01278544-5 2024-09-10T18:02:48.805 INFO:tasks.rados.rados.0.smithi012.stdout:1764: finishing write tid 3 to smithi01278544-5 2024-09-10T18:02:48.805 INFO:tasks.rados.rados.0.smithi012.stdout:1764: finishing write tid 4 to smithi01278544-5 2024-09-10T18:02:48.805 INFO:tasks.rados.rados.0.smithi012.stdout:1764: finishing write tid 5 to smithi01278544-5 2024-09-10T18:02:48.805 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 699 (ObjNum 508 snap 172 seq_num 508) dirty exists 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1764: finishing write tid 6 to smithi01278544-5 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1764: oid 5 updating version 0 to 771 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1764: oid 5 updating version 771 to 774 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1764: oid 5 updating version 774 to 775 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1764: oid 5 version 775 is already newer than 773 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1764: oid 5 version 775 is already newer than 772 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 775 (ObjNum 555 snap 186 seq_num 555) dirty exists 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1764: left oid 5 (ObjNum 555 snap 186 seq_num 555) 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1763: done (2 left) 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1764: done (1 left) 2024-09-10T18:02:48.806 INFO:tasks.rados.rados.0.smithi012.stdout:1765: done (0 left) 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:1766: rollback oid 45 current snap is 186 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 45 to 177 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:1767: read oid 10 snap -1 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:1767: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:1768: copy_from oid 48 from oid 3 current snap is 186 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:1769: copy_from oid 8 from oid 4 current snap is 186 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:1770: read oid 15 snap 173 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:1770: expect (ObjNum 494 snap 164 seq_num 494) 2024-09-10T18:02:48.807 INFO:tasks.rados.rados.0.smithi012.stdout:1771: delete oid 38 current snap is 186 2024-09-10T18:02:48.808 INFO:tasks.rados.rados.0.smithi012.stdout:1766: finishing rollback tid 1 to smithi01278544-45 2024-09-10T18:02:48.808 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1152 (ObjNum -799730576 snap 22079 seq_num 304) dirty dne 2024-09-10T18:02:48.808 INFO:tasks.rados.rados.0.smithi012.stdout:1766: done (5 left) 2024-09-10T18:02:48.809 INFO:tasks.rados.rados.0.smithi012.stdout:1771: done (4 left) 2024-09-10T18:02:48.809 INFO:tasks.rados.rados.0.smithi012.stdout:1772: read oid 11 snap -1 2024-09-10T18:02:48.809 INFO:tasks.rados.rados.0.smithi012.stdout:1772: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:48.809 INFO:tasks.rados.rados.0.smithi012.stdout:1773: delete oid 33 current snap is 186 2024-09-10T18:02:48.809 INFO:tasks.rados.rados.0.smithi012.stdout:1767: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:48.815 INFO:tasks.rados.rados.0.smithi012.stdout:1772: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:48.819 INFO:tasks.rados.rados.0.smithi012.stdout:1767: done (5 left) 2024-09-10T18:02:48.819 INFO:tasks.rados.rados.0.smithi012.stdout:1772: done (4 left) 2024-09-10T18:02:48.819 INFO:tasks.rados.rados.0.smithi012.stdout:1773: done (3 left) 2024-09-10T18:02:48.819 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 186 2024-09-10T18:02:48.819 INFO:tasks.rados.rados.0.smithi012.stdout:1774: seq_num 558 ranges {0=548864,548864=688128,1236992=606208,1843200=311296} 2024-09-10T18:02:48.822 INFO:tasks.rados.rados.0.smithi012.stdout:1774: writing smithi01278544-41 from 0 to 548864 tid 1 2024-09-10T18:02:48.826 INFO:tasks.rados.rados.0.smithi012.stdout:1774: writing smithi01278544-41 from 548864 to 1236992 tid 2 2024-09-10T18:02:48.830 INFO:tasks.rados.rados.0.smithi012.stdout:1774: writing smithi01278544-41 from 1236992 to 1843200 tid 3 2024-09-10T18:02:48.833 INFO:tasks.rados.rados.0.smithi012.stdout:1774: writing smithi01278544-41 from 1843200 to 2154496 tid 4 2024-09-10T18:02:48.833 INFO:tasks.rados.rados.0.smithi012.stdout:1775: rollback oid 18 current snap is 186 2024-09-10T18:02:48.833 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 178 2024-09-10T18:02:48.833 INFO:tasks.rados.rados.0.smithi012.stdout:1770: expect (ObjNum 494 snap 164 seq_num 494) 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:1774: finishing write tid 1 to smithi01278544-41 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:1768: finishing copy_from racing read to smithi01278544-48 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:1768: finishing copy_from to smithi01278544-48 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 699 (ObjNum 508 snap 172 seq_num 508) dirty exists 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:1774: finishing write tid 2 to smithi01278544-41 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:1774: finishing write tid 3 to smithi01278544-41 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:1768: done (4 left) 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:1770: done (3 left) 2024-09-10T18:02:48.922 INFO:tasks.rados.rados.0.smithi012.stdout:1776: read oid 26 snap -1 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1776: expect (ObjNum 548 snap 183 seq_num 548) 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1777: read oid 46 snap -1 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1777: expect (ObjNum 551 snap 183 seq_num 551) 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1778: setattr oid 40 current snap is 186 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1774: finishing write tid 4 to smithi01278544-41 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1775: finishing rollback tid 0 to smithi01278544-18 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1774: finishing write tid 5 to smithi01278544-41 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1775: finishing rollback tid 1 to smithi01278544-18 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1775: finishing rollback tid 2 to smithi01278544-18 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 861 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1774: finishing write tid 6 to smithi01278544-41 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1774: oid 41 updating version 0 to 860 2024-09-10T18:02:48.923 INFO:tasks.rados.rados.0.smithi012.stdout:1774: oid 41 updating version 860 to 862 2024-09-10T18:02:48.924 INFO:tasks.rados.rados.0.smithi012.stdout:1774: oid 41 updating version 862 to 863 2024-09-10T18:02:48.924 INFO:tasks.rados.rados.0.smithi012.stdout:1774: oid 41 version 863 is already newer than 861 2024-09-10T18:02:48.924 INFO:tasks.rados.rados.0.smithi012.stdout:1774: oid 41 version 863 is already newer than 859 2024-09-10T18:02:48.924 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 863 (ObjNum 558 snap 186 seq_num 558) dirty exists 2024-09-10T18:02:48.924 INFO:tasks.rados.rados.0.smithi012.stdout:1774: left oid 41 (ObjNum 558 snap 186 seq_num 558) 2024-09-10T18:02:48.924 INFO:tasks.rados.rados.0.smithi012.stdout:1769: finishing copy_from racing read to smithi01278544-8 2024-09-10T18:02:48.924 INFO:tasks.rados.rados.0.smithi012.stdout:1769: finishing copy_from to smithi01278544-8 2024-09-10T18:02:48.924 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 857 (ObjNum 486 snap 160 seq_num 486) dirty exists 2024-09-10T18:02:48.925 INFO:tasks.rados.rados.0.smithi012.stdout:1769: done (5 left) 2024-09-10T18:02:48.925 INFO:tasks.rados.rados.0.smithi012.stdout:1774: done (4 left) 2024-09-10T18:02:48.925 INFO:tasks.rados.rados.0.smithi012.stdout:1775: done (3 left) 2024-09-10T18:02:48.925 INFO:tasks.rados.rados.0.smithi012.stdout:1779: read oid 23 snap -1 2024-09-10T18:02:48.925 INFO:tasks.rados.rados.0.smithi012.stdout:1779: expect deleted 2024-09-10T18:02:48.925 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 186 2024-09-10T18:02:48.925 INFO:tasks.rados.rados.0.smithi012.stdout:1780: seq_num 559 ranges {2654208=565248,3219456=573440,3792896=409600,4202496=622592} 2024-09-10T18:02:48.941 INFO:tasks.rados.rados.0.smithi012.stdout:1780: writing smithi01278544-27 from 2654208 to 3219456 tid 1 2024-09-10T18:02:48.944 INFO:tasks.rados.rados.0.smithi012.stdout:1780: writing smithi01278544-27 from 3219456 to 3792896 tid 2 2024-09-10T18:02:48.946 INFO:tasks.rados.rados.0.smithi012.stdout:1780: writing smithi01278544-27 from 3792896 to 4202496 tid 3 2024-09-10T18:02:48.950 INFO:tasks.rados.rados.0.smithi012.stdout:1780: writing smithi01278544-27 from 4202496 to 4825088 tid 4 2024-09-10T18:02:48.950 INFO:tasks.rados.rados.0.smithi012.stdout:1781: setattr oid 2 current snap is 186 2024-09-10T18:02:48.950 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1158 (ObjNum 530 snap 181 seq_num 530) dirty exists 2024-09-10T18:02:48.950 INFO:tasks.rados.rados.0.smithi012.stdout:1776: expect (ObjNum 548 snap 183 seq_num 548) 2024-09-10T18:02:49.081 INFO:tasks.rados.rados.0.smithi012.stdout:1777: expect (ObjNum 551 snap 183 seq_num 551) 2024-09-10T18:02:49.333 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:02:49.827 INFO:tasks.rados.rados.0.smithi012.stdout:1780: finishing write tid 1 to smithi01278544-27 2024-09-10T18:02:49.827 INFO:tasks.rados.rados.0.smithi012.stdout:1780: finishing write tid 2 to smithi01278544-27 2024-09-10T18:02:49.827 INFO:tasks.rados.rados.0.smithi012.stdout:1780: finishing write tid 3 to smithi01278544-27 2024-09-10T18:02:49.827 INFO:tasks.rados.rados.0.smithi012.stdout:1780: finishing write tid 4 to smithi01278544-27 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1780: finishing write tid 5 to smithi01278544-27 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1780: finishing write tid 6 to smithi01278544-27 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1780: oid 27 updating version 0 to 702 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1780: oid 27 updating version 702 to 704 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1780: oid 27 version 704 is already newer than 701 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1780: oid 27 updating version 704 to 705 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1780: oid 27 version 705 is already newer than 703 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 705 (ObjNum 559 snap 186 seq_num 559) dirty exists 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1780: left oid 27 (ObjNum 559 snap 186 seq_num 559) 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1776: done (5 left) 2024-09-10T18:02:49.828 INFO:tasks.rados.rados.0.smithi012.stdout:1777: done (4 left) 2024-09-10T18:02:49.829 INFO:tasks.rados.rados.0.smithi012.stdout:1778: done (3 left) 2024-09-10T18:02:49.829 INFO:tasks.rados.rados.0.smithi012.stdout:1779: done (2 left) 2024-09-10T18:02:49.829 INFO:tasks.rados.rados.0.smithi012.stdout:1780: done (1 left) 2024-09-10T18:02:49.829 INFO:tasks.rados.rados.0.smithi012.stdout:1782: read oid 29 snap -1 2024-09-10T18:02:49.829 INFO:tasks.rados.rados.0.smithi012.stdout:1782: expect (ObjNum 544 snap 183 seq_num 544) 2024-09-10T18:02:49.829 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 186 2024-09-10T18:02:49.829 INFO:tasks.rados.rados.0.smithi012.stdout:1783: seq_num 560 ranges {4939776=581632,5521408=458752,5980160=614400,6594560=532480} 2024-09-10T18:02:49.857 INFO:tasks.rados.rados.0.smithi012.stdout:1783: writing smithi01278544-14 from 4939776 to 5521408 tid 1 2024-09-10T18:02:49.860 INFO:tasks.rados.rados.0.smithi012.stdout:1783: writing smithi01278544-14 from 5521408 to 5980160 tid 2 2024-09-10T18:02:49.864 INFO:tasks.rados.rados.0.smithi012.stdout:1783: writing smithi01278544-14 from 5980160 to 6594560 tid 3 2024-09-10T18:02:49.869 INFO:tasks.rados.rados.0.smithi012.stdout:1783: writing smithi01278544-14 from 6594560 to 7127040 tid 4 2024-09-10T18:02:49.869 INFO:tasks.rados.rados.0.smithi012.stdout:1784: copy_from oid 1 from oid 47 current snap is 186 2024-09-10T18:02:49.869 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 862 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:02:49.869 INFO:tasks.rados.rados.0.smithi012.stdout:1781: done (3 left) 2024-09-10T18:02:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:1785: rollback oid 2 current snap is 186 2024-09-10T18:02:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 2 to 180 2024-09-10T18:02:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:1782: expect (ObjNum 544 snap 183 seq_num 544) 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (7m) 48s ago 8m 26.8M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (8m) 14s ago 8m 90.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (10m) 48s ago 10m 19.0M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (10m) 14s ago 10m 21.5M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (4m) 14s ago 13m 455M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (4m) 48s ago 15m 526M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (3m) 48s ago 15m 55.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:02:49.944 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (3m) 14s ago 14m 50.2M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (3m) 48s ago 14m 46.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (8m) 48s ago 8m 15.5M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (8m) 14s ago 8m 17.0M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (2m) 48s ago 13m 166M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (2m) 48s ago 13m 109M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (85s) 48s ago 12m 98.7M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (52s) 48s ago 12m 14.4M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (18s) 14s ago 11m 11.8M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 75e9a99555f3 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (11m) 14s ago 11m 221M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 1b1f7c5b12a5 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (11m) 14s ago 11m 213M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (10m) 14s ago 10m 163M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T18:02:49.945 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (4m) 14s ago 9m 65.5M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:02:50.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:49 smithi012 ceph-mon[89611]: osdmap e443: 8 total, 8 up, 8 in 2024-09-10T18:02:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:49 smithi012 ceph-mon[92029]: osdmap e443: 8 total, 8 up, 8 in 2024-09-10T18:02:50.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:49 smithi089 ceph-mon[84132]: osdmap e443: 8 total, 8 up, 8 in 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1783: finishing write tid 1 to smithi01278544-14 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1783: finishing write tid 2 to smithi01278544-14 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1783: finishing write tid 3 to smithi01278544-14 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1783: finishing write tid 4 to smithi01278544-14 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1783: finishing write tid 5 to smithi01278544-14 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1785: finishing rollback tid 0 to smithi01278544-2 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1785: finishing rollback tid 1 to smithi01278544-2 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1785: finishing rollback tid 2 to smithi01278544-2 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 865 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:02:50.242 INFO:tasks.rados.rados.0.smithi012.stdout:1783: finishing write tid 6 to smithi01278544-14 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1783: oid 14 updating version 0 to 1164 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1783: oid 14 version 1164 is already newer than 1163 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1783: oid 14 version 1164 is already newer than 1161 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1783: oid 14 version 1164 is already newer than 1160 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1783: oid 14 version 1164 is already newer than 1162 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1164 (ObjNum 560 snap 186 seq_num 560) dirty exists 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1783: left oid 14 (ObjNum 560 snap 186 seq_num 560) 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1784: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1782: done (3 left) 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1783: done (2 left) 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1785: done (1 left) 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1786: copy_from oid 49 from oid 34 current snap is 186 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1784: finishing copy_from to smithi01278544-1 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1097 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1784: done (1 left) 2024-09-10T18:02:50.243 INFO:tasks.rados.rados.0.smithi012.stdout:1787: read oid 46 snap 173 2024-09-10T18:02:50.244 INFO:tasks.rados.rados.0.smithi012.stdout:1787: expect (ObjNum 509 snap 172 seq_num 509) 2024-09-10T18:02:50.244 INFO:tasks.rados.rados.0.smithi012.stdout:1788: read oid 30 snap -1 2024-09-10T18:02:50.244 INFO:tasks.rados.rados.0.smithi012.stdout:1788: expect deleted 2024-09-10T18:02:50.244 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 186 2024-09-10T18:02:50.244 INFO:tasks.rados.rados.0.smithi012.stdout:1789: seq_num 561 ranges {3145728=598016,3743744=745472,4489216=778240,5267456=81920} 2024-09-10T18:02:50.261 INFO:tasks.rados.rados.0.smithi012.stdout:1789: writing smithi01278544-3 from 3145728 to 3743744 tid 1 2024-09-10T18:02:50.265 INFO:tasks.rados.rados.0.smithi012.stdout:1789: writing smithi01278544-3 from 3743744 to 4489216 tid 2 2024-09-10T18:02:50.270 INFO:tasks.rados.rados.0.smithi012.stdout:1789: writing smithi01278544-3 from 4489216 to 5267456 tid 3 2024-09-10T18:02:50.271 INFO:tasks.rados.rados.0.smithi012.stdout:1789: writing smithi01278544-3 from 5267456 to 5349376 tid 4 2024-09-10T18:02:50.271 INFO:tasks.rados.rados.0.smithi012.stdout:1790: delete oid 23 current snap is 186 2024-09-10T18:02:50.271 INFO:tasks.rados.rados.0.smithi012.stdout:1786: finishing copy_from to smithi01278544-49 2024-09-10T18:02:50.271 INFO:tasks.rados.rados.0.smithi012.stdout:1786: got expected ENOENT (src dne) 2024-09-10T18:02:50.271 INFO:tasks.rados.rados.0.smithi012.stdout:1786: finishing copy_from racing read to smithi01278544-49 2024-09-10T18:02:50.273 INFO:tasks.rados.rados.0.smithi012.stdout:1786: done (4 left) 2024-09-10T18:02:50.273 INFO:tasks.rados.rados.0.smithi012.stdout:1788: done (3 left) 2024-09-10T18:02:50.273 INFO:tasks.rados.rados.0.smithi012.stdout:1790: done (2 left) 2024-09-10T18:02:50.273 INFO:tasks.rados.rados.0.smithi012.stdout:1791: rollback oid 4 current snap is 186 2024-09-10T18:02:50.273 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 180 2024-09-10T18:02:50.273 INFO:tasks.rados.rados.0.smithi012.stdout:1792: snap_remove snap 178 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3, 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 5 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:02:50.306 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:02:50.307 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:02:50.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:02:50.307 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:02:50.307 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 5, 2024-09-10T18:02:50.307 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 10 2024-09-10T18:02:50.307 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:02:50.307 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:02:50.605 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:02:50.605 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:02:50.605 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:02:50.606 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:02:50.606 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:02:50.606 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:02:50.606 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T18:02:50.606 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:02:50.607 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "10/20 daemons upgraded", 2024-09-10T18:02:50.607 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T18:02:50.607 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:02:50.607 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:02:50.726 INFO:tasks.rados.rados.0.smithi012.stdout:1792: done (3 left) 2024-09-10T18:02:50.726 INFO:tasks.rados.rados.0.smithi012.stdout:1793: rollback oid 18 current snap is 186 2024-09-10T18:02:50.726 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 177 2024-09-10T18:02:50.726 INFO:tasks.rados.rados.0.smithi012.stdout:1791: finishing rollback tid 0 to smithi01278544-4 2024-09-10T18:02:50.726 INFO:tasks.rados.rados.0.smithi012.stdout:1787: expect (ObjNum 509 snap 172 seq_num 509) 2024-09-10T18:02:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:50 smithi012 ceph-mon[89611]: pgmap v335: 121 pgs: 121 active+clean; 227 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 9.5 MiB/s wr, 44 op/s 2024-09-10T18:02:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:50 smithi012 ceph-mon[89611]: from='client.44312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:50 smithi012 ceph-mon[89611]: from='client.34407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:50 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3600462938' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:51.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:50 smithi012 ceph-mon[92029]: pgmap v335: 121 pgs: 121 active+clean; 227 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 9.5 MiB/s wr, 44 op/s 2024-09-10T18:02:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:50 smithi012 ceph-mon[92029]: from='client.44312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:50 smithi012 ceph-mon[92029]: from='client.34407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:50 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3600462938' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:51.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:50 smithi089 ceph-mon[84132]: pgmap v335: 121 pgs: 121 active+clean; 227 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 9.5 MiB/s wr, 44 op/s 2024-09-10T18:02:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:50 smithi089 ceph-mon[84132]: from='client.44312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:50 smithi089 ceph-mon[84132]: from='client.34407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:50 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3600462938' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: finishing write tid 1 to smithi01278544-3 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: finishing write tid 2 to smithi01278544-3 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: finishing write tid 3 to smithi01278544-3 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: finishing write tid 4 to smithi01278544-3 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: finishing write tid 5 to smithi01278544-3 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: finishing write tid 6 to smithi01278544-3 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: oid 3 updating version 0 to 710 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: oid 3 version 710 is already newer than 706 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: oid 3 version 710 is already newer than 709 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: oid 3 version 710 is already newer than 708 2024-09-10T18:02:51.288 INFO:tasks.rados.rados.0.smithi012.stdout:1789: oid 3 version 710 is already newer than 707 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 710 (ObjNum 561 snap 186 seq_num 561) dirty exists 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1789: left oid 3 (ObjNum 561 snap 186 seq_num 561) 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1791: finishing rollback tid 1 to smithi01278544-4 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1791: finishing rollback tid 2 to smithi01278544-4 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 866 (ObjNum 486 snap 160 seq_num 486) dirty exists 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1793: finishing rollback tid 0 to smithi01278544-18 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1787: done (3 left) 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1789: done (2 left) 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1791: done (1 left) 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1794: snap_create 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1793: finishing rollback tid 1 to smithi01278544-18 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:1793: finishing rollback tid 2 to smithi01278544-18 2024-09-10T18:02:51.289 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 868 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:02:51.735 INFO:tasks.rados.rados.0.smithi012.stdout:1793: done (1 left) 2024-09-10T18:02:51.735 INFO:tasks.rados.rados.0.smithi012.stdout:1794: done (0 left) 2024-09-10T18:02:51.735 INFO:tasks.rados.rados.0.smithi012.stdout:1795: rmattr oid 18 current snap is 187 2024-09-10T18:02:51.735 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 187 2024-09-10T18:02:51.736 INFO:tasks.rados.rados.0.smithi012.stdout:1796: seq_num 563 ranges {7127040=638976,7766016=565248,8331264=794624,9125888=245760} 2024-09-10T18:02:51.777 INFO:tasks.rados.rados.0.smithi012.stdout:1796: writing smithi01278544-14 from 7127040 to 7766016 tid 1 2024-09-10T18:02:51.781 INFO:tasks.rados.rados.0.smithi012.stdout:1796: writing smithi01278544-14 from 7766016 to 8331264 tid 2 2024-09-10T18:02:51.786 INFO:tasks.rados.rados.0.smithi012.stdout:1796: writing smithi01278544-14 from 8331264 to 9125888 tid 3 2024-09-10T18:02:51.787 INFO:tasks.rados.rados.0.smithi012.stdout:1796: writing smithi01278544-14 from 9125888 to 9371648 tid 4 2024-09-10T18:02:51.787 INFO:tasks.rados.rados.0.smithi012.stdout:1797: snap_create 2024-09-10T18:02:51.787 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 869 (ObjNum 458 snap 153 seq_num 458) dirty exists 2024-09-10T18:02:51.788 INFO:tasks.rados.rados.0.smithi012.stdout:1796: finishing write tid 1 to smithi01278544-14 2024-09-10T18:02:51.788 INFO:tasks.rados.rados.0.smithi012.stdout:1796: finishing write tid 2 to smithi01278544-14 2024-09-10T18:02:51.789 INFO:tasks.rados.rados.0.smithi012.stdout:1796: finishing write tid 3 to smithi01278544-14 2024-09-10T18:02:51.789 INFO:tasks.rados.rados.0.smithi012.stdout:1796: finishing write tid 4 to smithi01278544-14 2024-09-10T18:02:51.790 INFO:tasks.rados.rados.0.smithi012.stdout:1796: finishing write tid 5 to smithi01278544-14 2024-09-10T18:02:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1796: finishing write tid 6 to smithi01278544-14 2024-09-10T18:02:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1796: oid 14 updating version 0 to 1176 2024-09-10T18:02:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1796: oid 14 version 1176 is already newer than 1174 2024-09-10T18:02:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1796: oid 14 version 1176 is already newer than 1175 2024-09-10T18:02:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1796: oid 14 updating version 1176 to 1177 2024-09-10T18:02:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1796: oid 14 updating version 1177 to 1178 2024-09-10T18:02:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1178 (ObjNum 563 snap 187 seq_num 563) dirty exists 2024-09-10T18:02:51.791 INFO:tasks.rados.rados.0.smithi012.stdout:1796: left oid 14 (ObjNum 563 snap 187 seq_num 563) 2024-09-10T18:02:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:51 smithi012 ceph-mon[89611]: from='client.44324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:51 smithi012 ceph-mon[89611]: from='client.44336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:51 smithi012 ceph-mon[89611]: osdmap e444: 8 total, 8 up, 8 in 2024-09-10T18:02:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:51 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:52.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:51 smithi012 ceph-mon[92029]: from='client.44324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:52.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:51 smithi012 ceph-mon[92029]: from='client.44336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:52.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:51 smithi012 ceph-mon[92029]: osdmap e444: 8 total, 8 up, 8 in 2024-09-10T18:02:52.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:51 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:51 smithi089 ceph-mon[84132]: from='client.44324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:51 smithi089 ceph-mon[84132]: from='client.44336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:02:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:51 smithi089 ceph-mon[84132]: osdmap e444: 8 total, 8 up, 8 in 2024-09-10T18:02:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:51 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:52.705 INFO:tasks.rados.rados.0.smithi012.stdout:1795: done (2 left) 2024-09-10T18:02:52.705 INFO:tasks.rados.rados.0.smithi012.stdout:1796: done (1 left) 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1797: done (0 left) 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1798: copy_from oid 34 from oid 41 current snap is 188 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1799: rollback oid 2 current snap is 188 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 2 to 158 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1800: rollback oid 26 current snap is 188 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 26 to 158 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1801: read oid 9 snap -1 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1801: expect (ObjNum 554 snap 185 seq_num 554) 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1802: read oid 16 snap -1 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1802: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:52.706 INFO:tasks.rados.rados.0.smithi012.stdout:1803: delete oid 4 current snap is 188 2024-09-10T18:02:52.709 INFO:tasks.rados.rados.0.smithi012.stdout:1802: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:52.713 INFO:tasks.rados.rados.0.smithi012.stdout:1800: finishing rollback tid 0 to smithi01278544-26 2024-09-10T18:02:52.713 INFO:tasks.rados.rados.0.smithi012.stdout:1800: finishing rollback tid 1 to smithi01278544-26 2024-09-10T18:02:52.713 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 757 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-09-10T18:02:52.715 INFO:tasks.rados.rados.0.smithi012.stdout:1799: finishing rollback tid 0 to smithi01278544-2 2024-09-10T18:02:52.721 INFO:tasks.rados.rados.0.smithi012.stdout:1799: finishing rollback tid 1 to smithi01278544-2 2024-09-10T18:02:52.722 INFO:tasks.rados.rados.0.smithi012.stdout:1799: finishing rollback tid 2 to smithi01278544-2 2024-09-10T18:02:52.722 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 872 (ObjNum 449 snap 152 seq_num 449) dirty exists 2024-09-10T18:02:52.722 INFO:tasks.rados.rados.0.smithi012.stdout:1799: done (5 left) 2024-09-10T18:02:52.722 INFO:tasks.rados.rados.0.smithi012.stdout:1800: done (4 left) 2024-09-10T18:02:52.722 INFO:tasks.rados.rados.0.smithi012.stdout:1802: done (3 left) 2024-09-10T18:02:52.722 INFO:tasks.rados.rados.0.smithi012.stdout:1803: done (2 left) 2024-09-10T18:02:52.722 INFO:tasks.rados.rados.0.smithi012.stdout:1804: snap_create 2024-09-10T18:02:52.729 INFO:tasks.rados.rados.0.smithi012.stdout:1798: finishing copy_from racing read to smithi01278544-34 2024-09-10T18:02:52.734 INFO:tasks.rados.rados.0.smithi012.stdout:1798: finishing copy_from to smithi01278544-34 2024-09-10T18:02:52.734 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 863 (ObjNum 558 snap 186 seq_num 558) dirty exists 2024-09-10T18:02:52.748 INFO:tasks.rados.rados.0.smithi012.stdout:1801: expect (ObjNum 554 snap 185 seq_num 554) 2024-09-10T18:02:53.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:52 smithi012 ceph-mon[89611]: pgmap v337: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 229 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-09-10T18:02:53.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:52 smithi012 ceph-mon[89611]: osdmap e445: 8 total, 8 up, 8 in 2024-09-10T18:02:53.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:52 smithi012 ceph-mon[89611]: osdmap e446: 8 total, 8 up, 8 in 2024-09-10T18:02:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:52 smithi012 ceph-mon[92029]: pgmap v337: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 229 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-09-10T18:02:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:52 smithi012 ceph-mon[92029]: osdmap e445: 8 total, 8 up, 8 in 2024-09-10T18:02:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:52 smithi012 ceph-mon[92029]: osdmap e446: 8 total, 8 up, 8 in 2024-09-10T18:02:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:52 smithi089 ceph-mon[84132]: pgmap v337: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 229 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-09-10T18:02:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:52 smithi089 ceph-mon[84132]: osdmap e445: 8 total, 8 up, 8 in 2024-09-10T18:02:53.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:52 smithi089 ceph-mon[84132]: osdmap e446: 8 total, 8 up, 8 in 2024-09-10T18:02:53.706 INFO:tasks.rados.rados.0.smithi012.stdout:1798: done (2 left) 2024-09-10T18:02:53.707 INFO:tasks.rados.rados.0.smithi012.stdout:1801: done (1 left) 2024-09-10T18:02:53.707 INFO:tasks.rados.rados.0.smithi012.stdout:1804: done (0 left) 2024-09-10T18:02:53.707 INFO:tasks.rados.rados.0.smithi012.stdout:1805: copy_from oid 2 from oid 47 current snap is 189 2024-09-10T18:02:53.707 INFO:tasks.rados.rados.0.smithi012.stdout:1806: snap_remove snap 180 2024-09-10T18:02:54.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:02:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:02:53] "GET /metrics HTTP/1.1" 200 36299 "" "Prometheus/2.43.0" 2024-09-10T18:02:54.712 INFO:tasks.rados.rados.0.smithi012.stdout:1806: done (1 left) 2024-09-10T18:02:54.712 INFO:tasks.rados.rados.0.smithi012.stdout:1807: rollback oid 25 current snap is 189 2024-09-10T18:02:54.712 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 25 to 184 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:1805: finishing copy_from racing read to smithi01278544-2 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:1805: finishing copy_from to smithi01278544-2 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1097 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:1805: done (1 left) 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:1808: rmattr oid 50 current snap is 189 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:1808: done (1 left) 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:1809: read oid 10 snap 177 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:1809: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:54.713 INFO:tasks.rados.rados.0.smithi012.stdout:1810: delete oid 38 current snap is 189 2024-09-10T18:02:54.724 INFO:tasks.rados.rados.0.smithi012.stdout:1810: done (2 left) 2024-09-10T18:02:54.725 INFO:tasks.rados.rados.0.smithi012.stdout:1811: read oid 42 snap -1 2024-09-10T18:02:54.725 INFO:tasks.rados.rados.0.smithi012.stdout:1811: expect (ObjNum 547 snap 183 seq_num 547) 2024-09-10T18:02:54.725 INFO:tasks.rados.rados.0.smithi012.stdout:1812: read oid 41 snap -1 2024-09-10T18:02:54.725 INFO:tasks.rados.rados.0.smithi012.stdout:1812: expect (ObjNum 558 snap 186 seq_num 558) 2024-09-10T18:02:54.725 INFO:tasks.rados.rados.0.smithi012.stdout:1813: snap_create 2024-09-10T18:02:54.728 INFO:tasks.rados.rados.0.smithi012.stdout:1807: finishing rollback tid 0 to smithi01278544-25 2024-09-10T18:02:54.736 INFO:tasks.rados.rados.0.smithi012.stdout:1809: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:54.745 INFO:tasks.rados.rados.0.smithi012.stdout:1807: finishing rollback tid 1 to smithi01278544-25 2024-09-10T18:02:54.745 INFO:tasks.rados.rados.0.smithi012.stdout:1807: finishing rollback tid 2 to smithi01278544-25 2024-09-10T18:02:54.746 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1237 (ObjNum 533 snap 181 seq_num 533) dirty exists 2024-09-10T18:02:54.746 INFO:tasks.rados.rados.0.smithi012.stdout:1812: expect (ObjNum 558 snap 186 seq_num 558) 2024-09-10T18:02:54.803 INFO:tasks.rados.rados.0.smithi012.stdout:1811: expect (ObjNum 547 snap 183 seq_num 547) 2024-09-10T18:02:54.998 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:54 smithi089 ceph-mon[84132]: pgmap v340: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 260 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 34 MiB/s rd, 9.4 MiB/s wr, 48 op/s 2024-09-10T18:02:54.998 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:54 smithi089 ceph-mon[84132]: osdmap e447: 8 total, 8 up, 8 in 2024-09-10T18:02:54.998 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:54 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-10T18:02:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:54 smithi012 ceph-mon[89611]: pgmap v340: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 260 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 34 MiB/s rd, 9.4 MiB/s wr, 48 op/s 2024-09-10T18:02:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:54 smithi012 ceph-mon[89611]: osdmap e447: 8 total, 8 up, 8 in 2024-09-10T18:02:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:54 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-10T18:02:55.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:54 smithi012 ceph-mon[92029]: pgmap v340: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 260 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 34 MiB/s rd, 9.4 MiB/s wr, 48 op/s 2024-09-10T18:02:55.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:54 smithi012 ceph-mon[92029]: osdmap e447: 8 total, 8 up, 8 in 2024-09-10T18:02:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:54 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-10T18:02:55.720 INFO:tasks.rados.rados.0.smithi012.stdout:1807: done (4 left) 2024-09-10T18:02:55.720 INFO:tasks.rados.rados.0.smithi012.stdout:1809: done (3 left) 2024-09-10T18:02:55.720 INFO:tasks.rados.rados.0.smithi012.stdout:1811: done (2 left) 2024-09-10T18:02:55.720 INFO:tasks.rados.rados.0.smithi012.stdout:1812: done (1 left) 2024-09-10T18:02:55.721 INFO:tasks.rados.rados.0.smithi012.stdout:1813: done (0 left) 2024-09-10T18:02:55.721 INFO:tasks.rados.rados.0.smithi012.stdout:1814: read oid 16 snap -1 2024-09-10T18:02:55.721 INFO:tasks.rados.rados.0.smithi012.stdout:1814: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:55.721 INFO:tasks.rados.rados.0.smithi012.stdout:1815: delete oid 12 current snap is 190 2024-09-10T18:02:55.721 INFO:tasks.rados.rados.0.smithi012.stdout:1814: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:02:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:1814: done (1 left) 2024-09-10T18:02:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:1815: done (0 left) 2024-09-10T18:02:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 190 2024-09-10T18:02:55.723 INFO:tasks.rados.rados.0.smithi012.stdout:1816: seq_num 567 ranges {0=704512,704512=499712,1204224=770048,1974272=335872} 2024-09-10T18:02:55.727 INFO:tasks.rados.rados.0.smithi012.stdout:1816: writing smithi01278544-38 from 0 to 704512 tid 1 2024-09-10T18:02:55.730 INFO:tasks.rados.rados.0.smithi012.stdout:1816: writing smithi01278544-38 from 704512 to 1204224 tid 2 2024-09-10T18:02:55.735 INFO:tasks.rados.rados.0.smithi012.stdout:1816: writing smithi01278544-38 from 1204224 to 1974272 tid 3 2024-09-10T18:02:55.737 INFO:tasks.rados.rados.0.smithi012.stdout:1816: writing smithi01278544-38 from 1974272 to 2310144 tid 4 2024-09-10T18:02:55.737 INFO:tasks.rados.rados.0.smithi012.stdout:1817: delete oid 32 current snap is 190 2024-09-10T18:02:55.738 INFO:tasks.rados.rados.0.smithi012.stdout:1816: finishing write tid 1 to smithi01278544-38 2024-09-10T18:02:55.738 INFO:tasks.rados.rados.0.smithi012.stdout:1816: finishing write tid 2 to smithi01278544-38 2024-09-10T18:02:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:1817: done (1 left) 2024-09-10T18:02:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 190 2024-09-10T18:02:55.740 INFO:tasks.rados.rados.0.smithi012.stdout:1818: seq_num 569 ranges {12460032=737280,13197312=671744,13869056=737280,14606336=196608} 2024-09-10T18:02:55.812 INFO:tasks.rados.rados.0.smithi012.stdout:1818: writing smithi01278544-47 from 12460032 to 13197312 tid 1 2024-09-10T18:02:55.816 INFO:tasks.rados.rados.0.smithi012.stdout:1818: writing smithi01278544-47 from 13197312 to 13869056 tid 2 2024-09-10T18:02:55.820 INFO:tasks.rados.rados.0.smithi012.stdout:1818: writing smithi01278544-47 from 13869056 to 14606336 tid 3 2024-09-10T18:02:55.822 INFO:tasks.rados.rados.0.smithi012.stdout:1818: writing smithi01278544-47 from 14606336 to 14802944 tid 4 2024-09-10T18:02:55.822 INFO:tasks.rados.rados.0.smithi012.stdout:1819: rmattr oid 23 current snap is 190 2024-09-10T18:02:55.822 INFO:tasks.rados.rados.0.smithi012.stdout:1819: done (2 left) 2024-09-10T18:02:55.822 INFO:tasks.rados.rados.0.smithi012.stdout:1820: copy_from oid 30 from oid 2 current snap is 190 2024-09-10T18:02:55.822 INFO:tasks.rados.rados.0.smithi012.stdout:1816: finishing write tid 3 to smithi01278544-38 2024-09-10T18:02:55.822 INFO:tasks.rados.rados.0.smithi012.stdout:1821: copy_from oid 7 from oid 46 current snap is 190 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: finishing write tid 4 to smithi01278544-38 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: finishing write tid 5 to smithi01278544-38 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: finishing write tid 6 to smithi01278544-38 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: oid 38 updating version 0 to 1101 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: oid 38 version 1101 is already newer than 1099 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: oid 38 updating version 1101 to 1102 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: oid 38 version 1102 is already newer than 1098 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: oid 38 version 1102 is already newer than 1100 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1102 (ObjNum 567 snap 190 seq_num 567) dirty exists 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: left oid 38 (ObjNum 567 snap 190 seq_num 567) 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1818: finishing write tid 1 to smithi01278544-47 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:1816: done (3 left) 2024-09-10T18:02:55.823 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 190 2024-09-10T18:02:55.824 INFO:tasks.rados.rados.0.smithi012.stdout:1818: finishing write tid 2 to smithi01278544-47 2024-09-10T18:02:55.824 INFO:tasks.rados.rados.0.smithi012.stdout:1822: seq_num 570 ranges {3973120=753664,4726784=548864,5275648=540672,5816320=516096} 2024-09-10T18:02:55.848 INFO:tasks.rados.rados.0.smithi012.stdout:1822: writing smithi01278544-6 from 3973120 to 4726784 tid 1 2024-09-10T18:02:55.851 INFO:tasks.rados.rados.0.smithi012.stdout:1822: writing smithi01278544-6 from 4726784 to 5275648 tid 2 2024-09-10T18:02:55.855 INFO:tasks.rados.rados.0.smithi012.stdout:1822: writing smithi01278544-6 from 5275648 to 5816320 tid 3 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1822: writing smithi01278544-6 from 5816320 to 6332416 tid 4 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1823: delete oid 44 current snap is 190 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1818: finishing write tid 3 to smithi01278544-47 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1818: finishing write tid 4 to smithi01278544-47 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1818: finishing write tid 5 to smithi01278544-47 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1818: finishing write tid 6 to smithi01278544-47 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1818: oid 47 updating version 0 to 1187 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1818: oid 47 version 1187 is already newer than 1186 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1818: oid 47 updating version 1187 to 1189 2024-09-10T18:02:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:1818: oid 47 updating version 1189 to 1190 2024-09-10T18:02:55.860 INFO:tasks.rados.rados.0.smithi012.stdout:1818: oid 47 version 1190 is already newer than 1188 2024-09-10T18:02:55.860 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1190 (ObjNum 569 snap 190 seq_num 569) dirty exists 2024-09-10T18:02:55.860 INFO:tasks.rados.rados.0.smithi012.stdout:1818: left oid 47 (ObjNum 569 snap 190 seq_num 569) 2024-09-10T18:02:55.860 INFO:tasks.rados.rados.0.smithi012.stdout:1822: finishing write tid 1 to smithi01278544-6 2024-09-10T18:02:55.860 INFO:tasks.rados.rados.0.smithi012.stdout:1822: finishing write tid 2 to smithi01278544-6 2024-09-10T18:02:55.860 INFO:tasks.rados.rados.0.smithi012.stdout:1822: finishing write tid 3 to smithi01278544-6 2024-09-10T18:02:55.862 INFO:tasks.rados.rados.0.smithi012.stdout:1822: finishing write tid 4 to smithi01278544-6 2024-09-10T18:02:55.864 INFO:tasks.rados.rados.0.smithi012.stdout:1822: finishing write tid 5 to smithi01278544-6 2024-09-10T18:02:55.865 INFO:tasks.rados.rados.0.smithi012.stdout:1818: done (4 left) 2024-09-10T18:02:55.865 INFO:tasks.rados.rados.0.smithi012.stdout:1823: done (3 left) 2024-09-10T18:02:55.865 INFO:tasks.rados.rados.0.smithi012.stdout:1824: read oid 36 snap -1 2024-09-10T18:02:55.865 INFO:tasks.rados.rados.0.smithi012.stdout:1824: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:02:55.865 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 190 2024-09-10T18:02:55.865 INFO:tasks.rados.rados.0.smithi012.stdout:1825: seq_num 572 ranges {40960=786432,827392=770048,1597440=557056,2154496=278528} 2024-09-10T18:02:55.870 INFO:tasks.rados.rados.0.smithi012.stdout:1825: writing smithi01278544-20 from 40960 to 827392 tid 1 2024-09-10T18:02:55.874 INFO:tasks.rados.rados.0.smithi012.stdout:1825: writing smithi01278544-20 from 827392 to 1597440 tid 2 2024-09-10T18:02:55.878 INFO:tasks.rados.rados.0.smithi012.stdout:1825: writing smithi01278544-20 from 1597440 to 2154496 tid 3 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1825: writing smithi01278544-20 from 2154496 to 2433024 tid 4 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1826: snap_create 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1822: finishing write tid 6 to smithi01278544-6 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1822: oid 6 updating version 0 to 1004 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1822: oid 6 version 1004 is already newer than 1003 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1822: oid 6 updating version 1004 to 1007 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1822: oid 6 version 1007 is already newer than 1006 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1822: oid 6 version 1007 is already newer than 1005 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 1007 (ObjNum 570 snap 190 seq_num 570) dirty exists 2024-09-10T18:02:55.880 INFO:tasks.rados.rados.0.smithi012.stdout:1822: left oid 6 (ObjNum 570 snap 190 seq_num 570) 2024-09-10T18:02:55.881 INFO:tasks.rados.rados.0.smithi012.stdout:1821: finishing copy_from racing read to smithi01278544-7 2024-09-10T18:02:55.881 INFO:tasks.rados.rados.0.smithi012.stdout:1824: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:02:55.882 INFO:tasks.rados.rados.0.smithi012.stdout:1820: finishing copy_from racing read to smithi01278544-30 2024-09-10T18:02:55.882 INFO:tasks.rados.rados.0.smithi012.stdout:1825: finishing write tid 1 to smithi01278544-20 2024-09-10T18:02:55.883 INFO:tasks.rados.rados.0.smithi012.stdout:1821: finishing copy_from to smithi01278544-7 2024-09-10T18:02:55.883 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 697 (ObjNum 551 snap 183 seq_num 551) dirty exists 2024-09-10T18:02:55.883 INFO:tasks.rados.rados.0.smithi012.stdout:1820: finishing copy_from to smithi01278544-30 2024-09-10T18:02:55.883 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1097 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:02:55.883 INFO:tasks.rados.rados.0.smithi012.stdout:1825: finishing write tid 2 to smithi01278544-20 2024-09-10T18:02:55.883 INFO:tasks.rados.rados.0.smithi012.stdout:1825: finishing write tid 3 to smithi01278544-20 2024-09-10T18:02:55.883 INFO:tasks.rados.rados.0.smithi012.stdout:1825: finishing write tid 4 to smithi01278544-20 2024-09-10T18:02:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:1825: finishing write tid 5 to smithi01278544-20 2024-09-10T18:02:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:1825: finishing write tid 6 to smithi01278544-20 2024-09-10T18:02:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:1825: oid 20 updating version 0 to 1252 2024-09-10T18:02:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:1825: oid 20 updating version 1252 to 1253 2024-09-10T18:02:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:1825: oid 20 updating version 1253 to 1255 2024-09-10T18:02:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:1825: oid 20 version 1255 is already newer than 1251 2024-09-10T18:02:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:1825: oid 20 version 1255 is already newer than 1254 2024-09-10T18:02:55.885 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1255 (ObjNum 572 snap 190 seq_num 572) dirty exists 2024-09-10T18:02:55.885 INFO:tasks.rados.rados.0.smithi012.stdout:1825: left oid 20 (ObjNum 572 snap 190 seq_num 572) 2024-09-10T18:02:56.006 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:55 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T18:02:56.006 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:55 smithi089 ceph-mon[84132]: Upgrade: osd.5 is safe to restart 2024-09-10T18:02:56.006 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:55 smithi089 ceph-mon[84132]: osdmap e448: 8 total, 8 up, 8 in 2024-09-10T18:02:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:55 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T18:02:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:55 smithi012 ceph-mon[89611]: Upgrade: osd.5 is safe to restart 2024-09-10T18:02:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:55 smithi012 ceph-mon[89611]: osdmap e448: 8 total, 8 up, 8 in 2024-09-10T18:02:56.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:55 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T18:02:56.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:55 smithi012 ceph-mon[92029]: Upgrade: osd.5 is safe to restart 2024-09-10T18:02:56.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:55 smithi012 ceph-mon[92029]: osdmap e448: 8 total, 8 up, 8 in 2024-09-10T18:02:56.733 INFO:tasks.rados.rados.0.smithi012.stdout:1820: done (5 left) 2024-09-10T18:02:56.733 INFO:tasks.rados.rados.0.smithi012.stdout:1821: done (4 left) 2024-09-10T18:02:56.733 INFO:tasks.rados.rados.0.smithi012.stdout:1822: done (3 left) 2024-09-10T18:02:56.734 INFO:tasks.rados.rados.0.smithi012.stdout:1824: done (2 left) 2024-09-10T18:02:56.734 INFO:tasks.rados.rados.0.smithi012.stdout:1825: done (1 left) 2024-09-10T18:02:56.734 INFO:tasks.rados.rados.0.smithi012.stdout:1826: done (0 left) 2024-09-10T18:02:56.734 INFO:tasks.rados.rados.0.smithi012.stdout:1827: rollback oid 36 current snap is 191 2024-09-10T18:02:56.734 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 184 2024-09-10T18:02:56.734 INFO:tasks.rados.rados.0.smithi012.stdout:1828: snap_create 2024-09-10T18:02:56.737 INFO:tasks.rados.rados.0.smithi012.stdout:1827: finishing rollback tid 0 to smithi01278544-36 2024-09-10T18:02:56.737 INFO:tasks.rados.rados.0.smithi012.stdout:1827: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:02:56.737 INFO:tasks.rados.rados.0.smithi012.stdout:1827: finishing rollback tid 2 to smithi01278544-36 2024-09-10T18:02:56.738 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 760 (ObjNum 432 snap 143 seq_num 432) dirty exists 2024-09-10T18:02:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[89611]: pgmap v343: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 274 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 35 MiB/s rd, 11 MiB/s wr, 43 op/s 2024-09-10T18:02:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[89611]: osdmap e449: 8 total, 8 up, 8 in 2024-09-10T18:02:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T18:02:57.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[92029]: pgmap v343: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 274 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 35 MiB/s rd, 11 MiB/s wr, 43 op/s 2024-09-10T18:02:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[92029]: osdmap e449: 8 total, 8 up, 8 in 2024-09-10T18:02:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T18:02:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:56 smithi089 ceph-mon[84132]: pgmap v343: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 274 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 35 MiB/s rd, 11 MiB/s wr, 43 op/s 2024-09-10T18:02:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:56 smithi089 ceph-mon[84132]: osdmap e449: 8 total, 8 up, 8 in 2024-09-10T18:02:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:02:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T18:02:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:02:57.738 INFO:tasks.rados.rados.0.smithi012.stdout:1827: done (1 left) 2024-09-10T18:02:57.738 INFO:tasks.rados.rados.0.smithi012.stdout:1828: done (0 left) 2024-09-10T18:02:57.738 INFO:tasks.rados.rados.0.smithi012.stdout:1829: read oid 4 snap 182 2024-09-10T18:02:57.738 INFO:tasks.rados.rados.0.smithi012.stdout:1829: expect (ObjNum 486 snap 160 seq_num 486) 2024-09-10T18:02:57.738 INFO:tasks.rados.rados.0.smithi012.stdout:1830: snap_remove snap 183 2024-09-10T18:02:58.001 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:57 smithi089 ceph-mon[84132]: Upgrade: Updating osd.5 2024-09-10T18:02:58.001 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:57 smithi089 ceph-mon[84132]: Deploying daemon osd.5 on smithi089 2024-09-10T18:02:58.001 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:57 smithi089 ceph-mon[84132]: osdmap e450: 8 total, 8 up, 8 in 2024-09-10T18:02:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:57 smithi012 ceph-mon[89611]: Upgrade: Updating osd.5 2024-09-10T18:02:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:57 smithi012 ceph-mon[89611]: Deploying daemon osd.5 on smithi089 2024-09-10T18:02:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:57 smithi012 ceph-mon[89611]: osdmap e450: 8 total, 8 up, 8 in 2024-09-10T18:02:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:57 smithi012 ceph-mon[92029]: Upgrade: Updating osd.5 2024-09-10T18:02:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:57 smithi012 ceph-mon[92029]: Deploying daemon osd.5 on smithi089 2024-09-10T18:02:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:57 smithi012 ceph-mon[92029]: osdmap e450: 8 total, 8 up, 8 in 2024-09-10T18:02:58.738 INFO:tasks.rados.rados.0.smithi012.stdout:1830: done (1 left) 2024-09-10T18:02:58.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 192 2024-09-10T18:02:58.738 INFO:tasks.rados.rados.0.smithi012.stdout:1831: seq_num 573 ranges {1884160=802816,2686976=655360,3342336=720896,4063232=229376} 2024-09-10T18:02:58.754 INFO:tasks.rados.rados.0.smithi012.stdout:1831: writing smithi01278544-21 from 1884160 to 2686976 tid 1 2024-09-10T18:02:58.759 INFO:tasks.rados.rados.0.smithi012.stdout:1831: writing smithi01278544-21 from 2686976 to 3342336 tid 2 2024-09-10T18:02:58.763 INFO:tasks.rados.rados.0.smithi012.stdout:1831: writing smithi01278544-21 from 3342336 to 4063232 tid 3 2024-09-10T18:02:58.764 INFO:tasks.rados.rados.0.smithi012.stdout:1831: writing smithi01278544-21 from 4063232 to 4292608 tid 4 2024-09-10T18:02:58.765 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 192 2024-09-10T18:02:58.765 INFO:tasks.rados.rados.0.smithi012.stdout:1832: seq_num 574 ranges {2056192=16384} 2024-09-10T18:02:58.776 INFO:tasks.rados.rados.0.smithi012.stdout:1832: writing smithi01278544-39 from 2056192 to 2072576 tid 1 2024-09-10T18:02:58.776 INFO:tasks.rados.rados.0.smithi012.stdout:1833: read oid 50 snap 188 2024-09-10T18:02:58.776 INFO:tasks.rados.rados.0.smithi012.stdout:1833: expect deleted 2024-09-10T18:02:58.776 INFO:tasks.rados.rados.0.smithi012.stdout:1834: read oid 10 snap -1 2024-09-10T18:02:58.776 INFO:tasks.rados.rados.0.smithi012.stdout:1834: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:58.777 INFO:tasks.rados.rados.0.smithi012.stdout:1835: rmattr oid 2 current snap is 192 2024-09-10T18:02:58.777 INFO:tasks.rados.rados.0.smithi012.stdout:1829: expect (ObjNum 486 snap 160 seq_num 486) 2024-09-10T18:02:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:58 smithi012 ceph-mon[89611]: pgmap v346: 121 pgs: 121 active+clean; 307 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-10T18:02:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:58 smithi012 ceph-mon[89611]: osdmap e451: 8 total, 8 up, 8 in 2024-09-10T18:02:59.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:58 smithi012 ceph-mon[92029]: pgmap v346: 121 pgs: 121 active+clean; 307 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-10T18:02:59.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:58 smithi012 ceph-mon[92029]: osdmap e451: 8 total, 8 up, 8 in 2024-09-10T18:02:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:58 smithi089 ceph-mon[84132]: pgmap v346: 121 pgs: 121 active+clean; 307 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-10T18:02:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:58 smithi089 ceph-mon[84132]: osdmap e451: 8 total, 8 up, 8 in 2024-09-10T18:02:59.436 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:02:59 smithi089 systemd[1]: Stopping Ceph osd.5 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:02:59.715 INFO:tasks.rados.rados.0.smithi012.stdout:1831: finishing write tid 1 to smithi01278544-21 2024-09-10T18:02:59.715 INFO:tasks.rados.rados.0.smithi012.stdout:1831: finishing write tid 2 to smithi01278544-21 2024-09-10T18:02:59.715 INFO:tasks.rados.rados.0.smithi012.stdout:1829: done (5 left) 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1836: rollback oid 44 current snap is 192 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 44 to 181 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: finishing write tid 3 to smithi01278544-21 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: finishing write tid 4 to smithi01278544-21 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: finishing write tid 5 to smithi01278544-21 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: finishing write tid 6 to smithi01278544-21 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: oid 21 updating version 0 to 867 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: oid 21 version 867 is already newer than 865 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: oid 21 updating version 867 to 868 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: oid 21 version 868 is already newer than 864 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: oid 21 version 868 is already newer than 866 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 868 (ObjNum 573 snap 192 seq_num 573) dirty exists 2024-09-10T18:02:59.716 INFO:tasks.rados.rados.0.smithi012.stdout:1831: left oid 21 (ObjNum 573 snap 192 seq_num 573) 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:1832: finishing write tid 1 to smithi01278544-39 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1098 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:1832: finishing write tid 2 to smithi01278544-39 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:1832: finishing write tid 3 to smithi01278544-39 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:1832: oid 39 updating version 0 to 1266 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:1832: oid 39 version 1266 is already newer than 1265 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1266 (ObjNum 574 snap 192 seq_num 574) dirty exists 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:1832: left oid 39 (ObjNum 574 snap 192 seq_num 574) 2024-09-10T18:02:59.717 INFO:tasks.rados.rados.0.smithi012.stdout:1834: expect (ObjNum 445 snap 150 seq_num 445) 2024-09-10T18:02:59.722 INFO:tasks.rados.rados.0.smithi012.stdout:1836: finishing rollback tid 1 to smithi01278544-44 2024-09-10T18:02:59.722 INFO:tasks.rados.rados.0.smithi012.stdout:1836: finishing rollback tid 2 to smithi01278544-44 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 733 (ObjNum 492 snap 163 seq_num 492) dirty exists 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1831: done (5 left) 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1832: done (4 left) 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1833: done (3 left) 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1834: done (2 left) 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1835: done (1 left) 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1836: done (0 left) 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 192 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1837: seq_num 575 ranges {0=32768} 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1837: writing smithi01278544-26 from 0 to 32768 tid 1 2024-09-10T18:02:59.723 INFO:tasks.rados.rados.0.smithi012.stdout:1838: snap_create 2024-09-10T18:02:59.725 INFO:tasks.rados.rados.0.smithi012.stdout:1837: finishing write tid 1 to smithi01278544-26 2024-09-10T18:02:59.725 INFO:tasks.rados.rados.0.smithi012.stdout:1837: finishing write tid 2 to smithi01278544-26 2024-09-10T18:02:59.728 INFO:tasks.rados.rados.0.smithi012.stdout:1837: finishing write tid 3 to smithi01278544-26 2024-09-10T18:02:59.728 INFO:tasks.rados.rados.0.smithi012.stdout:1837: oid 26 updating version 0 to 761 2024-09-10T18:02:59.729 INFO:tasks.rados.rados.0.smithi012.stdout:1837: oid 26 updating version 761 to 762 2024-09-10T18:02:59.729 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 762 (ObjNum 575 snap 192 seq_num 575) dirty exists 2024-09-10T18:02:59.729 INFO:tasks.rados.rados.0.smithi012.stdout:1837: left oid 26 (ObjNum 575 snap 192 seq_num 575) 2024-09-10T18:02:59.744 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:02:59 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[41951]: 2024-09-10T18:02:59.433+0000 7f4bb698a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:02:59.745 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:02:59 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[41951]: 2024-09-10T18:02:59.433+0000 7f4bb698a640 -1 osd.5 452 *** Got signal Terminated *** 2024-09-10T18:02:59.745 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:02:59 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[41951]: 2024-09-10T18:02:59.433+0000 7f4bb698a640 -1 osd.5 452 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:02:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1837: done (1 left) 2024-09-10T18:02:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1838: done (0 left) 2024-09-10T18:02:59.749 INFO:tasks.rados.rados.0.smithi012.stdout:1839: delete oid 40 current snap is 193 2024-09-10T18:02:59.760 INFO:tasks.rados.rados.0.smithi012.stdout:1839: done (0 left) 2024-09-10T18:02:59.760 INFO:tasks.rados.rados.0.smithi012.stdout:1840: read oid 17 snap 184 2024-09-10T18:02:59.760 INFO:tasks.rados.rados.0.smithi012.stdout:1840: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:02:59.760 INFO:tasks.rados.rados.0.smithi012.stdout:1841: rollback oid 10 current snap is 193 2024-09-10T18:02:59.760 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 185 2024-09-10T18:02:59.761 INFO:tasks.rados.rados.0.smithi012.stdout:1842: rollback oid 16 current snap is 193 2024-09-10T18:02:59.761 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 181 2024-09-10T18:02:59.761 INFO:tasks.rados.rados.0.smithi012.stdout:1843: snap_create 2024-09-10T18:02:59.763 INFO:tasks.rados.rados.0.smithi012.stdout:1842: finishing rollback tid 0 to smithi01278544-16 2024-09-10T18:02:59.763 INFO:tasks.rados.rados.0.smithi012.stdout:1842: finishing rollback tid 1 to smithi01278544-16 2024-09-10T18:02:59.763 INFO:tasks.rados.rados.0.smithi012.stdout:1842: finishing rollback tid 2 to smithi01278544-16 2024-09-10T18:02:59.763 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 1010 (ObjNum -1094738720 snap 32708 seq_num 304) dirty exists 2024-09-10T18:03:00.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:59 smithi012 ceph-mon[92029]: osdmap e452: 8 total, 8 up, 8 in 2024-09-10T18:03:00.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:02:59 smithi012 ceph-mon[92029]: osd.5 marked itself down and dead 2024-09-10T18:03:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:59 smithi012 ceph-mon[89611]: osdmap e452: 8 total, 8 up, 8 in 2024-09-10T18:03:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:02:59 smithi012 ceph-mon[89611]: osd.5 marked itself down and dead 2024-09-10T18:03:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:59 smithi089 ceph-mon[84132]: osdmap e452: 8 total, 8 up, 8 in 2024-09-10T18:03:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:02:59 smithi089 ceph-mon[84132]: osd.5 marked itself down and dead 2024-09-10T18:03:00.595 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:00 smithi089 podman[94062]: 2024-09-10 18:03:00.303887047 +0000 UTC m=+0.983511533 container died 1b1f7c5b12a528650c5bf7d0ff30312af2bb5fd8c860357fd76687beb9908891 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-7a853b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T18:03:00.758 INFO:tasks.rados.rados.0.smithi012.stdout:1842: done (3 left) 2024-09-10T18:03:00.758 INFO:tasks.rados.rados.0.smithi012.stdout:1843: done (2 left) 2024-09-10T18:03:00.758 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 194 2024-09-10T18:03:00.758 INFO:tasks.rados.rados.0.smithi012.stdout:1844: seq_num 577 ranges {0=65536} 2024-09-10T18:03:00.758 INFO:tasks.rados.rados.0.smithi012.stdout:1844: writing smithi01278544-13 from 0 to 65536 tid 1 2024-09-10T18:03:00.759 INFO:tasks.rados.rados.0.smithi012.stdout:1845: snap_create 2024-09-10T18:03:00.767 INFO:tasks.rados.rados.0.smithi012.stdout:1841: finishing rollback tid 0 to smithi01278544-10 2024-09-10T18:03:00.768 INFO:tasks.rados.rados.0.smithi012.stdout:1841: finishing rollback tid 1 to smithi01278544-10 2024-09-10T18:03:00.768 INFO:tasks.rados.rados.0.smithi012.stdout:1841: finishing rollback tid 2 to smithi01278544-10 2024-09-10T18:03:00.768 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1270 (ObjNum 445 snap 150 seq_num 445) dirty exists 2024-09-10T18:03:00.779 INFO:tasks.rados.rados.0.smithi012.stdout:1844: finishing write tid 1 to smithi01278544-13 2024-09-10T18:03:00.779 INFO:tasks.rados.rados.0.smithi012.stdout:1844: finishing write tid 2 to smithi01278544-13 2024-09-10T18:03:00.779 INFO:tasks.rados.rados.0.smithi012.stdout:1844: finishing write tid 3 to smithi01278544-13 2024-09-10T18:03:00.779 INFO:tasks.rados.rados.0.smithi012.stdout:1844: oid 13 updating version 0 to 868 2024-09-10T18:03:00.779 INFO:tasks.rados.rados.0.smithi012.stdout:1844: oid 13 updating version 868 to 869 2024-09-10T18:03:00.779 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 869 (ObjNum 577 snap 194 seq_num 577) dirty exists 2024-09-10T18:03:00.779 INFO:tasks.rados.rados.0.smithi012.stdout:1844: left oid 13 (ObjNum 577 snap 194 seq_num 577) 2024-09-10T18:03:00.806 INFO:tasks.rados.rados.0.smithi012.stdout:1840: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:03:01.021 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:00 smithi089 ceph-mon[84132]: pgmap v349: 121 pgs: 121 active+clean; 321 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 17 op/s 2024-09-10T18:03:01.021 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:00 smithi089 ceph-mon[84132]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:03:01.021 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:00 smithi089 ceph-mon[84132]: osdmap e453: 8 total, 7 up, 8 in 2024-09-10T18:03:01.021 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:00 smithi089 podman[94062]: 2024-09-10 18:03:00.768650363 +0000 UTC m=+1.448274848 container cleanup 1b1f7c5b12a528650c5bf7d0ff30312af2bb5fd8c860357fd76687beb9908891 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=reef-7a853b1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T18:03:01.021 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:00 smithi089 bash[94062]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5 2024-09-10T18:03:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:00 smithi012 ceph-mon[89611]: pgmap v349: 121 pgs: 121 active+clean; 321 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 17 op/s 2024-09-10T18:03:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:00 smithi012 ceph-mon[89611]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:03:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:00 smithi012 ceph-mon[89611]: osdmap e453: 8 total, 7 up, 8 in 2024-09-10T18:03:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:00 smithi012 ceph-mon[92029]: pgmap v349: 121 pgs: 121 active+clean; 321 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 17 op/s 2024-09-10T18:03:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:00 smithi012 ceph-mon[92029]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:03:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:00 smithi012 ceph-mon[92029]: osdmap e453: 8 total, 7 up, 8 in 2024-09-10T18:03:01.285 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:01 smithi089 podman[94078]: 2024-09-10 18:03:01.019950528 +0000 UTC m=+0.713970122 container remove 1b1f7c5b12a528650c5bf7d0ff30312af2bb5fd8c860357fd76687beb9908891 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-7a853b1) 2024-09-10T18:03:01.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:01 smithi089 podman[94169]: 2024-09-10 18:03:01.379515852 +0000 UTC m=+0.110830521 container create be8bf70e39915059b4f30b8cf8811bb5650944b2e25cdb034a5db95e47f41844 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T18:03:01.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:01 smithi089 podman[94169]: 2024-09-10 18:03:01.285148147 +0000 UTC m=+0.016462816 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:03:01.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:01 smithi089 podman[94169]: 2024-09-10 18:03:01.624489628 +0000 UTC m=+0.355804312 container init be8bf70e39915059b4f30b8cf8811bb5650944b2e25cdb034a5db95e47f41844 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T18:03:01.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:01 smithi089 podman[94169]: 2024-09-10 18:03:01.62807122 +0000 UTC m=+0.359385887 container start be8bf70e39915059b4f30b8cf8811bb5650944b2e25cdb034a5db95e47f41844 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T18:03:01.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:01 smithi089 podman[94169]: 2024-09-10 18:03:01.723861565 +0000 UTC m=+0.455176232 container attach be8bf70e39915059b4f30b8cf8811bb5650944b2e25cdb034a5db95e47f41844 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T18:03:01.767 INFO:tasks.rados.rados.0.smithi012.stdout:1840: done (3 left) 2024-09-10T18:03:01.767 INFO:tasks.rados.rados.0.smithi012.stdout:1841: done (2 left) 2024-09-10T18:03:01.767 INFO:tasks.rados.rados.0.smithi012.stdout:1844: done (1 left) 2024-09-10T18:03:01.767 INFO:tasks.rados.rados.0.smithi012.stdout:1845: done (0 left) 2024-09-10T18:03:01.767 INFO:tasks.rados.rados.0.smithi012.stdout:1846: setattr oid 29 current snap is 195 2024-09-10T18:03:01.768 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 195 2024-09-10T18:03:01.768 INFO:tasks.rados.rados.0.smithi012.stdout:1847: seq_num 578 ranges {4251648=81920} 2024-09-10T18:03:01.791 INFO:tasks.rados.rados.0.smithi012.stdout:1847: writing smithi01278544-31 from 4251648 to 4333568 tid 1 2024-09-10T18:03:01.792 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 195 2024-09-10T18:03:01.792 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 753 (ObjNum 544 snap 183 seq_num 544) dirty exists 2024-09-10T18:03:01.792 INFO:tasks.rados.rados.0.smithi012.stdout:1848: seq_num 579 ranges {10182656=98304} 2024-09-10T18:03:01.848 INFO:tasks.rados.rados.0.smithi012.stdout:1848: writing smithi01278544-46 from 10182656 to 10280960 tid 1 2024-09-10T18:03:01.848 INFO:tasks.rados.rados.0.smithi012.stdout:1846: done (2 left) 2024-09-10T18:03:01.848 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 195 2024-09-10T18:03:01.849 INFO:tasks.rados.rados.0.smithi012.stdout:1847: finishing write tid 1 to smithi01278544-31 2024-09-10T18:03:01.849 INFO:tasks.rados.rados.0.smithi012.stdout:1847: finishing write tid 2 to smithi01278544-31 2024-09-10T18:03:01.849 INFO:tasks.rados.rados.0.smithi012.stdout:1847: finishing write tid 3 to smithi01278544-31 2024-09-10T18:03:01.849 INFO:tasks.rados.rados.0.smithi012.stdout:1847: oid 31 updating version 0 to 870 2024-09-10T18:03:01.849 INFO:tasks.rados.rados.0.smithi012.stdout:1847: oid 31 updating version 870 to 871 2024-09-10T18:03:01.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 871 (ObjNum 578 snap 195 seq_num 578) dirty exists 2024-09-10T18:03:01.849 INFO:tasks.rados.rados.0.smithi012.stdout:1847: left oid 31 (ObjNum 578 snap 195 seq_num 578) 2024-09-10T18:03:01.849 INFO:tasks.rados.rados.0.smithi012.stdout:1849: seq_num 580 ranges {4251648=114688} 2024-09-10T18:03:01.872 INFO:tasks.rados.rados.0.smithi012.stdout:1849: writing smithi01278544-25 from 4251648 to 4366336 tid 1 2024-09-10T18:03:01.872 INFO:tasks.rados.rados.0.smithi012.stdout:1847: done (2 left) 2024-09-10T18:03:01.872 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 195 2024-09-10T18:03:01.872 INFO:tasks.rados.rados.0.smithi012.stdout:1848: finishing write tid 1 to smithi01278544-46 2024-09-10T18:03:01.873 INFO:tasks.rados.rados.0.smithi012.stdout:1848: finishing write tid 2 to smithi01278544-46 2024-09-10T18:03:01.873 INFO:tasks.rados.rados.0.smithi012.stdout:1848: finishing write tid 3 to smithi01278544-46 2024-09-10T18:03:01.873 INFO:tasks.rados.rados.0.smithi012.stdout:1848: oid 46 updating version 0 to 735 2024-09-10T18:03:01.873 INFO:tasks.rados.rados.0.smithi012.stdout:1848: oid 46 updating version 735 to 736 2024-09-10T18:03:01.873 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 736 (ObjNum 579 snap 195 seq_num 579) dirty exists 2024-09-10T18:03:01.873 INFO:tasks.rados.rados.0.smithi012.stdout:1848: left oid 46 (ObjNum 579 snap 195 seq_num 579) 2024-09-10T18:03:01.873 INFO:tasks.rados.rados.0.smithi012.stdout:1850: seq_num 581 ranges {6250496=139264} 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1850: writing smithi01278544-42 from 6250496 to 6389760 tid 1 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1848: done (2 left) 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1851: rmattr oid 43 current snap is 195 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1851: done (2 left) 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1852: setattr oid 39 current snap is 195 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1849: finishing write tid 1 to smithi01278544-25 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1849: finishing write tid 2 to smithi01278544-25 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1849: finishing write tid 3 to smithi01278544-25 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1849: oid 25 updating version 0 to 1272 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:1849: oid 25 updating version 1272 to 1273 2024-09-10T18:03:01.907 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1273 (ObjNum 580 snap 195 seq_num 580) dirty exists 2024-09-10T18:03:01.908 INFO:tasks.rados.rados.0.smithi012.stdout:1849: left oid 25 (ObjNum 580 snap 195 seq_num 580) 2024-09-10T18:03:01.909 INFO:tasks.rados.rados.0.smithi012.stdout:1849: done (2 left) 2024-09-10T18:03:01.909 INFO:tasks.rados.rados.0.smithi012.stdout:1853: rollback oid 23 current snap is 195 2024-09-10T18:03:01.909 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 23 to 188 2024-09-10T18:03:01.909 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 195 2024-09-10T18:03:01.909 INFO:tasks.rados.rados.0.smithi012.stdout:1854: seq_num 582 ranges {0=155648} 2024-09-10T18:03:01.909 INFO:tasks.rados.rados.0.smithi012.stdout:1854: writing smithi01278544-40 from 0 to 155648 tid 1 2024-09-10T18:03:01.909 INFO:tasks.rados.rados.0.smithi012.stdout:1855: rollback oid 43 current snap is 195 2024-09-10T18:03:01.910 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 43 to 185 2024-09-10T18:03:01.910 INFO:tasks.rados.rados.0.smithi012.stdout:1856: copy_from oid 5 from oid 31 current snap is 195 2024-09-10T18:03:01.910 INFO:tasks.rados.rados.0.smithi012.stdout:1857: delete oid 9 current snap is 195 2024-09-10T18:03:01.910 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1275 (ObjNum 574 snap 192 seq_num 574) dirty exists 2024-09-10T18:03:01.911 INFO:tasks.rados.rados.0.smithi012.stdout:1853: finishing rollback tid 1 to smithi01278544-23 2024-09-10T18:03:01.911 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 736 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:03:01.912 INFO:tasks.rados.rados.0.smithi012.stdout:1852: done (6 left) 2024-09-10T18:03:01.912 INFO:tasks.rados.rados.0.smithi012.stdout:1853: done (5 left) 2024-09-10T18:03:01.912 INFO:tasks.rados.rados.0.smithi012.stdout:1857: done (4 left) 2024-09-10T18:03:01.912 INFO:tasks.rados.rados.0.smithi012.stdout:1858: rmattr oid 37 current snap is 195 2024-09-10T18:03:01.912 INFO:tasks.rados.rados.0.smithi012.stdout:1858: done (4 left) 2024-09-10T18:03:01.912 INFO:tasks.rados.rados.0.smithi012.stdout:1859: copy_from oid 17 from oid 9 current snap is 195 2024-09-10T18:03:01.912 INFO:tasks.rados.rados.0.smithi012.stdout:1860: setattr oid 28 current snap is 195 2024-09-10T18:03:01.913 INFO:tasks.rados.rados.0.smithi012.stdout:1859: finishing copy_from to smithi01278544-17 2024-09-10T18:03:01.913 INFO:tasks.rados.rados.0.smithi012.stdout:1859: got expected ENOENT (src dne) 2024-09-10T18:03:01.913 INFO:tasks.rados.rados.0.smithi012.stdout:1850: finishing write tid 1 to smithi01278544-42 2024-09-10T18:03:01.913 INFO:tasks.rados.rados.0.smithi012.stdout:1859: finishing copy_from racing read to smithi01278544-17 2024-09-10T18:03:01.913 INFO:tasks.rados.rados.0.smithi012.stdout:1850: finishing write tid 2 to smithi01278544-42 2024-09-10T18:03:01.914 INFO:tasks.rados.rados.0.smithi012.stdout:1854: finishing write tid 1 to smithi01278544-40 2024-09-10T18:03:01.914 INFO:tasks.rados.rados.0.smithi012.stdout:1854: finishing write tid 2 to smithi01278544-40 2024-09-10T18:03:01.914 INFO:tasks.rados.rados.0.smithi012.stdout:1859: done (5 left) 2024-09-10T18:03:01.914 INFO:tasks.rados.rados.0.smithi012.stdout:1861: snap_create 2024-09-10T18:03:01.916 INFO:tasks.rados.rados.0.smithi012.stdout:1850: finishing write tid 3 to smithi01278544-42 2024-09-10T18:03:01.916 INFO:tasks.rados.rados.0.smithi012.stdout:1850: oid 42 updating version 0 to 1200 2024-09-10T18:03:01.916 INFO:tasks.rados.rados.0.smithi012.stdout:1850: oid 42 updating version 1200 to 1201 2024-09-10T18:03:01.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1201 (ObjNum 581 snap 195 seq_num 581) dirty exists 2024-09-10T18:03:01.916 INFO:tasks.rados.rados.0.smithi012.stdout:1850: left oid 42 (ObjNum 581 snap 195 seq_num 581) 2024-09-10T18:03:01.917 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 316 (ObjNum 516 snap 175 seq_num 516) dirty exists 2024-09-10T18:03:01.918 INFO:tasks.rados.rados.0.smithi012.stdout:1855: finishing rollback tid 0 to smithi01278544-43 2024-09-10T18:03:01.919 INFO:tasks.rados.rados.0.smithi012.stdout:1854: finishing write tid 3 to smithi01278544-40 2024-09-10T18:03:01.919 INFO:tasks.rados.rados.0.smithi012.stdout:1854: oid 40 updating version 0 to 1203 2024-09-10T18:03:01.919 INFO:tasks.rados.rados.0.smithi012.stdout:1854: oid 40 version 1203 is already newer than 1202 2024-09-10T18:03:01.919 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1203 (ObjNum 582 snap 195 seq_num 582) dirty exists 2024-09-10T18:03:01.919 INFO:tasks.rados.rados.0.smithi012.stdout:1854: left oid 40 (ObjNum 582 snap 195 seq_num 582) 2024-09-10T18:03:01.919 INFO:tasks.rados.rados.0.smithi012.stdout:1855: finishing rollback tid 1 to smithi01278544-43 2024-09-10T18:03:01.919 INFO:tasks.rados.rados.0.smithi012.stdout:1855: finishing rollback tid 2 to smithi01278544-43 2024-09-10T18:03:01.919 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 1207 (ObjNum 548 snap 183 seq_num 548) dirty exists 2024-09-10T18:03:01.930 INFO:tasks.rados.rados.0.smithi012.stdout:1856: finishing copy_from racing read to smithi01278544-5 2024-09-10T18:03:01.933 INFO:tasks.rados.rados.0.smithi012.stdout:1856: finishing copy_from to smithi01278544-5 2024-09-10T18:03:01.933 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 871 (ObjNum 578 snap 195 seq_num 578) dirty exists 2024-09-10T18:03:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:01 smithi012 ceph-mon[89611]: osdmap e454: 8 total, 7 up, 8 in 2024-09-10T18:03:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:01 smithi012 ceph-mon[92029]: osdmap e454: 8 total, 7 up, 8 in 2024-09-10T18:03:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:01 smithi089 ceph-mon[84132]: osdmap e454: 8 total, 7 up, 8 in 2024-09-10T18:03:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:02.036 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:01 smithi089 podman[94169]: 2024-09-10 18:03:01.819940231 +0000 UTC m=+0.551254898 container died be8bf70e39915059b4f30b8cf8811bb5650944b2e25cdb034a5db95e47f41844 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T18:03:02.707 INFO:tasks.rados.rados.0.smithi012.stdout:1850: done (5 left) 2024-09-10T18:03:02.707 INFO:tasks.rados.rados.0.smithi012.stdout:1854: done (4 left) 2024-09-10T18:03:02.708 INFO:tasks.rados.rados.0.smithi012.stdout:1855: done (3 left) 2024-09-10T18:03:02.708 INFO:tasks.rados.rados.0.smithi012.stdout:1856: done (2 left) 2024-09-10T18:03:02.708 INFO:tasks.rados.rados.0.smithi012.stdout:1860: done (1 left) 2024-09-10T18:03:02.708 INFO:tasks.rados.rados.0.smithi012.stdout:1861: done (0 left) 2024-09-10T18:03:02.708 INFO:tasks.rados.rados.0.smithi012.stdout:1862: delete oid 24 current snap is 196 2024-09-10T18:03:02.710 INFO:tasks.rados.rados.0.smithi012.stdout:1862: done (0 left) 2024-09-10T18:03:02.710 INFO:tasks.rados.rados.0.smithi012.stdout:1863: rmattr oid 14 current snap is 196 2024-09-10T18:03:02.710 INFO:tasks.rados.rados.0.smithi012.stdout:1863: done (0 left) 2024-09-10T18:03:02.710 INFO:tasks.rados.rados.0.smithi012.stdout:1864: delete oid 15 current snap is 196 2024-09-10T18:03:02.713 INFO:tasks.rados.rados.0.smithi012.stdout:1864: done (0 left) 2024-09-10T18:03:02.713 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 196 2024-09-10T18:03:02.713 INFO:tasks.rados.rados.0.smithi012.stdout:1865: seq_num 586 ranges {0=221184} 2024-09-10T18:03:02.714 INFO:tasks.rados.rados.0.smithi012.stdout:1865: writing smithi01278544-4 from 0 to 221184 tid 1 2024-09-10T18:03:02.714 INFO:tasks.rados.rados.0.smithi012.stdout:1866: snap_create 2024-09-10T18:03:02.717 INFO:tasks.rados.rados.0.smithi012.stdout:1865: finishing write tid 1 to smithi01278544-4 2024-09-10T18:03:02.718 INFO:tasks.rados.rados.0.smithi012.stdout:1865: finishing write tid 2 to smithi01278544-4 2024-09-10T18:03:02.719 INFO:tasks.rados.rados.0.smithi012.stdout:1865: finishing write tid 3 to smithi01278544-4 2024-09-10T18:03:02.719 INFO:tasks.rados.rados.0.smithi012.stdout:1865: oid 4 updating version 0 to 872 2024-09-10T18:03:02.719 INFO:tasks.rados.rados.0.smithi012.stdout:1865: oid 4 updating version 872 to 873 2024-09-10T18:03:02.720 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 873 (ObjNum 586 snap 196 seq_num 586) dirty exists 2024-09-10T18:03:02.720 INFO:tasks.rados.rados.0.smithi012.stdout:1865: left oid 4 (ObjNum 586 snap 196 seq_num 586) 2024-09-10T18:03:02.990 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:02 smithi089 ceph-mon[84132]: pgmap v352: 121 pgs: 7 peering, 17 stale+active+clean, 97 active+clean; 321 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.0 MiB/s rd, 3.5 MiB/s wr, 4 op/s 2024-09-10T18:03:02.990 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:02 smithi089 ceph-mon[84132]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T18:03:02.990 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:02 smithi089 ceph-mon[84132]: osdmap e455: 8 total, 7 up, 8 in 2024-09-10T18:03:02.990 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:02 smithi089 ceph-mon[84132]: osdmap e456: 8 total, 7 up, 8 in 2024-09-10T18:03:02.991 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:02 smithi089 podman[94192]: 2024-09-10 18:03:02.53702974 +0000 UTC m=+0.711281092 container remove be8bf70e39915059b4f30b8cf8811bb5650944b2e25cdb034a5db95e47f41844 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:03:02.991 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:02 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-10T18:03:02.991 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:02 smithi089 systemd[1]: Stopped Ceph osd.5 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:03:02.991 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:02 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.5.service: Consumed 15.385s CPU time. 2024-09-10T18:03:02.991 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:02 smithi089 systemd[1]: Starting Ceph osd.5 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:03:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:02 smithi012 ceph-mon[92029]: pgmap v352: 121 pgs: 7 peering, 17 stale+active+clean, 97 active+clean; 321 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.0 MiB/s rd, 3.5 MiB/s wr, 4 op/s 2024-09-10T18:03:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:02 smithi012 ceph-mon[92029]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T18:03:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:02 smithi012 ceph-mon[92029]: osdmap e455: 8 total, 7 up, 8 in 2024-09-10T18:03:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:02 smithi012 ceph-mon[92029]: osdmap e456: 8 total, 7 up, 8 in 2024-09-10T18:03:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:02 smithi012 ceph-mon[89611]: pgmap v352: 121 pgs: 7 peering, 17 stale+active+clean, 97 active+clean; 321 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.0 MiB/s rd, 3.5 MiB/s wr, 4 op/s 2024-09-10T18:03:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:02 smithi012 ceph-mon[89611]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T18:03:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:02 smithi012 ceph-mon[89611]: osdmap e455: 8 total, 7 up, 8 in 2024-09-10T18:03:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:02 smithi012 ceph-mon[89611]: osdmap e456: 8 total, 7 up, 8 in 2024-09-10T18:03:03.242 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:02 smithi089 podman[94291]: 2024-09-10 18:03:02.988301747 +0000 UTC m=+0.112236722 container create 2bf74ae8a5f5fe0e0887038e46f603a93a77435aaee1e8f5115e196eadafe303 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T18:03:03.242 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:02 smithi089 podman[94291]: 2024-09-10 18:03:02.891591704 +0000 UTC m=+0.015526634 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:03:03.536 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 podman[94291]: 2024-09-10 18:03:03.241199583 +0000 UTC m=+0.365134513 container init 2bf74ae8a5f5fe0e0887038e46f603a93a77435aaee1e8f5115e196eadafe303 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T18:03:03.536 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 podman[94291]: 2024-09-10 18:03:03.244492902 +0000 UTC m=+0.368427832 container start 2bf74ae8a5f5fe0e0887038e46f603a93a77435aaee1e8f5115e196eadafe303 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T18:03:03.536 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 podman[94291]: 2024-09-10 18:03:03.32425794 +0000 UTC m=+0.448192880 container attach 2bf74ae8a5f5fe0e0887038e46f603a93a77435aaee1e8f5115e196eadafe303 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T18:03:03.537 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:03:03.537 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 bash[94291]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:03:03.537 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:03:03.537 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 bash[94291]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:03:03.708 INFO:tasks.rados.rados.0.smithi012.stdout:1865: done (1 left) 2024-09-10T18:03:03.709 INFO:tasks.rados.rados.0.smithi012.stdout:1866: done (0 left) 2024-09-10T18:03:03.709 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 197 2024-09-10T18:03:03.709 INFO:tasks.rados.rados.0.smithi012.stdout:1867: seq_num 587 ranges {0=237568} 2024-09-10T18:03:03.709 INFO:tasks.rados.rados.0.smithi012.stdout:1867: writing smithi01278544-45 from 0 to 237568 tid 1 2024-09-10T18:03:03.710 INFO:tasks.rados.rados.0.smithi012.stdout:1868: snap_remove snap 194 2024-09-10T18:03:04.142 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T18:03:04.143 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 bash[94291]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T18:03:04.143 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T18:03:04.143 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:03 smithi089 bash[94291]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T18:03:04.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:03:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:03:03] "GET /metrics HTTP/1.1" 200 36282 "" "Prometheus/2.43.0" 2024-09-10T18:03:04.487 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T18:03:04.487 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 bash[94291]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T18:03:04.487 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T18:03:04.487 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 bash[94291]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T18:03:04.487 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-10T18:03:04.487 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 bash[94291]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-10T18:03:04.487 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T18:03:04.488 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 bash[94291]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T18:03:04.488 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate[94306]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-10T18:03:04.488 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 bash[94291]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-10T18:03:04.488 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 podman[94291]: 2024-09-10 18:03:04.170549899 +0000 UTC m=+1.294484829 container died 2bf74ae8a5f5fe0e0887038e46f603a93a77435aaee1e8f5115e196eadafe303 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T18:03:04.710 INFO:tasks.rados.rados.0.smithi012.stdout:1868: done (1 left) 2024-09-10T18:03:04.710 INFO:tasks.rados.rados.0.smithi012.stdout:1869: copy_from oid 25 from oid 40 current snap is 197 2024-09-10T18:03:04.710 INFO:tasks.rados.rados.0.smithi012.stdout:1867: finishing write tid 1 to smithi01278544-45 2024-09-10T18:03:04.710 INFO:tasks.rados.rados.0.smithi012.stdout:1867: finishing write tid 2 to smithi01278544-45 2024-09-10T18:03:04.710 INFO:tasks.rados.rados.0.smithi012.stdout:1867: finishing write tid 3 to smithi01278544-45 2024-09-10T18:03:04.711 INFO:tasks.rados.rados.0.smithi012.stdout:1867: oid 45 updating version 0 to 1208 2024-09-10T18:03:04.711 INFO:tasks.rados.rados.0.smithi012.stdout:1867: oid 45 updating version 1208 to 1209 2024-09-10T18:03:04.711 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1209 (ObjNum 587 snap 197 seq_num 587) dirty exists 2024-09-10T18:03:04.711 INFO:tasks.rados.rados.0.smithi012.stdout:1867: left oid 45 (ObjNum 587 snap 197 seq_num 587) 2024-09-10T18:03:04.711 INFO:tasks.rados.rados.0.smithi012.stdout:1867: done (1 left) 2024-09-10T18:03:04.711 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 197 2024-09-10T18:03:04.711 INFO:tasks.rados.rados.0.smithi012.stdout:1870: seq_num 588 ranges {0=253952} 2024-09-10T18:03:04.711 INFO:tasks.rados.rados.0.smithi012.stdout:1870: writing smithi01278544-32 from 0 to 253952 tid 1 2024-09-10T18:03:04.712 INFO:tasks.rados.rados.0.smithi012.stdout:1871: snap_remove snap 195 2024-09-10T18:03:04.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:04 smithi089 ceph-mon[84132]: pgmap v355: 121 pgs: 18 active+undersized, 7 peering, 8 stale+active+clean, 10 active+undersized+degraded, 78 active+clean; 329 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 18 op/s; 74/591 objects degraded (12.521%) 2024-09-10T18:03:04.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:04 smithi089 ceph-mon[84132]: osdmap e457: 8 total, 7 up, 8 in 2024-09-10T18:03:04.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:04 smithi089 ceph-mon[84132]: Health check failed: Degraded data redundancy: 74/591 objects degraded (12.521%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:04 smithi012 ceph-mon[89611]: pgmap v355: 121 pgs: 18 active+undersized, 7 peering, 8 stale+active+clean, 10 active+undersized+degraded, 78 active+clean; 329 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 18 op/s; 74/591 objects degraded (12.521%) 2024-09-10T18:03:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:04 smithi012 ceph-mon[89611]: osdmap e457: 8 total, 7 up, 8 in 2024-09-10T18:03:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:04 smithi012 ceph-mon[89611]: Health check failed: Degraded data redundancy: 74/591 objects degraded (12.521%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:04 smithi012 ceph-mon[92029]: pgmap v355: 121 pgs: 18 active+undersized, 7 peering, 8 stale+active+clean, 10 active+undersized+degraded, 78 active+clean; 329 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 18 op/s; 74/591 objects degraded (12.521%) 2024-09-10T18:03:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:04 smithi012 ceph-mon[92029]: osdmap e457: 8 total, 7 up, 8 in 2024-09-10T18:03:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:04 smithi012 ceph-mon[92029]: Health check failed: Degraded data redundancy: 74/591 objects degraded (12.521%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:05.217 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:04 smithi089 podman[94446]: 2024-09-10 18:03:04.879179163 +0000 UTC m=+0.698216584 container remove 2bf74ae8a5f5fe0e0887038e46f603a93a77435aaee1e8f5115e196eadafe303 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:03:05.218 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:05 smithi089 podman[94504]: 2024-09-10 18:03:04.987802037 +0000 UTC m=+0.015905733 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:03:05.218 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:05 smithi089 podman[94504]: 2024-09-10 18:03:05.096760249 +0000 UTC m=+0.124863946 container create 28c479f4ad600b95f2a5e0d8ced6872d2cdb19ad9df3dc64b0abd2811dc04906 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T18:03:05.712 INFO:tasks.rados.rados.0.smithi012.stdout:1871: done (2 left) 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1872: delete oid 19 current snap is 197 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1870: finishing write tid 1 to smithi01278544-32 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1870: finishing write tid 2 to smithi01278544-32 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1870: finishing write tid 3 to smithi01278544-32 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1870: oid 32 updating version 0 to 1098 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1870: oid 32 updating version 1098 to 1099 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1099 (ObjNum 588 snap 197 seq_num 588) dirty exists 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1870: left oid 32 (ObjNum 588 snap 197 seq_num 588) 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1869: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:1869: finishing copy_from to smithi01278544-25 2024-09-10T18:03:05.713 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1203 (ObjNum 582 snap 195 seq_num 582) dirty exists 2024-09-10T18:03:05.716 INFO:tasks.rados.rados.0.smithi012.stdout:1869: done (2 left) 2024-09-10T18:03:05.717 INFO:tasks.rados.rados.0.smithi012.stdout:1870: done (1 left) 2024-09-10T18:03:05.717 INFO:tasks.rados.rados.0.smithi012.stdout:1872: done (0 left) 2024-09-10T18:03:05.717 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 197 2024-09-10T18:03:05.717 INFO:tasks.rados.rados.0.smithi012.stdout:1873: seq_num 590 ranges {0=286720} 2024-09-10T18:03:05.718 INFO:tasks.rados.rados.0.smithi012.stdout:1873: writing smithi01278544-23 from 0 to 286720 tid 1 2024-09-10T18:03:05.719 INFO:tasks.rados.rados.0.smithi012.stdout:1874: snap_create 2024-09-10T18:03:05.721 INFO:tasks.rados.rados.0.smithi012.stdout:1873: finishing write tid 1 to smithi01278544-23 2024-09-10T18:03:05.722 INFO:tasks.rados.rados.0.smithi012.stdout:1873: finishing write tid 2 to smithi01278544-23 2024-09-10T18:03:05.724 INFO:tasks.rados.rados.0.smithi012.stdout:1873: finishing write tid 3 to smithi01278544-23 2024-09-10T18:03:05.724 INFO:tasks.rados.rados.0.smithi012.stdout:1873: oid 23 updating version 0 to 869 2024-09-10T18:03:05.724 INFO:tasks.rados.rados.0.smithi012.stdout:1873: oid 23 updating version 869 to 870 2024-09-10T18:03:05.724 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 870 (ObjNum 590 snap 197 seq_num 590) dirty exists 2024-09-10T18:03:05.724 INFO:tasks.rados.rados.0.smithi012.stdout:1873: left oid 23 (ObjNum 590 snap 197 seq_num 590) 2024-09-10T18:03:05.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:05 smithi089 podman[94504]: 2024-09-10 18:03:05.324102375 +0000 UTC m=+0.352206072 container init 28c479f4ad600b95f2a5e0d8ced6872d2cdb19ad9df3dc64b0abd2811dc04906 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-10T18:03:05.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:05 smithi089 podman[94504]: 2024-09-10 18:03:05.327564657 +0000 UTC m=+0.355668353 container start 28c479f4ad600b95f2a5e0d8ced6872d2cdb19ad9df3dc64b0abd2811dc04906 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T18:03:05.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:05 smithi089 ceph-osd[94523]: -- 172.21.15.89:0/1132998048 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555be6af9a40 con 0x555be78c8400 2024-09-10T18:03:05.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:05 smithi089 bash[94504]: 28c479f4ad600b95f2a5e0d8ced6872d2cdb19ad9df3dc64b0abd2811dc04906 2024-09-10T18:03:05.725 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:05 smithi089 systemd[1]: Started Ceph osd.5 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:03:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[89611]: osdmap e458: 8 total, 7 up, 8 in 2024-09-10T18:03:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[89611]: osdmap e459: 8 total, 7 up, 8 in 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[92029]: osdmap e458: 8 total, 7 up, 8 in 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:05 smithi012 ceph-mon[92029]: osdmap e459: 8 total, 7 up, 8 in 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:05 smithi089 ceph-mon[84132]: osdmap e458: 8 total, 7 up, 8 in 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:05 smithi089 ceph-mon[84132]: osdmap e459: 8 total, 7 up, 8 in 2024-09-10T18:03:06.725 INFO:tasks.rados.rados.0.smithi012.stdout:1873: done (1 left) 2024-09-10T18:03:06.725 INFO:tasks.rados.rados.0.smithi012.stdout:1874: done (0 left) 2024-09-10T18:03:06.725 INFO:tasks.rados.rados.0.smithi012.stdout:1875: read oid 33 snap -1 2024-09-10T18:03:06.725 INFO:tasks.rados.rados.0.smithi012.stdout:1875: expect deleted 2024-09-10T18:03:06.725 INFO:tasks.rados.rados.0.smithi012.stdout:1876: read oid 6 snap -1 2024-09-10T18:03:06.725 INFO:tasks.rados.rados.0.smithi012.stdout:1876: expect (ObjNum 570 snap 190 seq_num 570) 2024-09-10T18:03:06.726 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 198 2024-09-10T18:03:06.726 INFO:tasks.rados.rados.0.smithi012.stdout:1877: seq_num 591 ranges {12460032=303104} 2024-09-10T18:03:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:1877: writing smithi01278544-2 from 12460032 to 12763136 tid 1 2024-09-10T18:03:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:1878: delete oid 8 current snap is 198 2024-09-10T18:03:06.796 INFO:tasks.rados.rados.0.smithi012.stdout:1876: expect (ObjNum 570 snap 190 seq_num 570) 2024-09-10T18:03:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:06 smithi012 ceph-mon[89611]: pgmap v358: 121 pgs: 32 active+undersized, 7 peering, 11 active+undersized+degraded, 71 active+clean; 329 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.7 MiB/s wr, 23 op/s; 75/597 objects degraded (12.563%) 2024-09-10T18:03:07.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:06 smithi012 ceph-mon[92029]: pgmap v358: 121 pgs: 32 active+undersized, 7 peering, 11 active+undersized+degraded, 71 active+clean; 329 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.7 MiB/s wr, 23 op/s; 75/597 objects degraded (12.563%) 2024-09-10T18:03:07.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:06 smithi089 ceph-mon[84132]: pgmap v358: 121 pgs: 32 active+undersized, 7 peering, 11 active+undersized+degraded, 71 active+clean; 329 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.7 MiB/s wr, 23 op/s; 75/597 objects degraded (12.563%) 2024-09-10T18:03:07.035 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:06 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:03:06.734+0000 7fca47a0e640 -1 Falling back to public interface 2024-09-10T18:03:07.157 INFO:tasks.rados.rados.0.smithi012.stdout:1877: finishing write tid 1 to smithi01278544-2 2024-09-10T18:03:07.157 INFO:tasks.rados.rados.0.smithi012.stdout:1877: finishing write tid 2 to smithi01278544-2 2024-09-10T18:03:07.157 INFO:tasks.rados.rados.0.smithi012.stdout:1877: finishing write tid 3 to smithi01278544-2 2024-09-10T18:03:07.157 INFO:tasks.rados.rados.0.smithi012.stdout:1877: oid 2 updating version 0 to 1100 2024-09-10T18:03:07.157 INFO:tasks.rados.rados.0.smithi012.stdout:1877: oid 2 updating version 1100 to 1101 2024-09-10T18:03:07.157 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1101 (ObjNum 591 snap 198 seq_num 591) dirty exists 2024-09-10T18:03:07.157 INFO:tasks.rados.rados.0.smithi012.stdout:1877: left oid 2 (ObjNum 591 snap 198 seq_num 591) 2024-09-10T18:03:07.158 INFO:tasks.rados.rados.0.smithi012.stdout:1875: done (3 left) 2024-09-10T18:03:07.158 INFO:tasks.rados.rados.0.smithi012.stdout:1876: done (2 left) 2024-09-10T18:03:07.158 INFO:tasks.rados.rados.0.smithi012.stdout:1877: done (1 left) 2024-09-10T18:03:07.158 INFO:tasks.rados.rados.0.smithi012.stdout:1878: done (0 left) 2024-09-10T18:03:07.158 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 198 2024-09-10T18:03:07.158 INFO:tasks.rados.rados.0.smithi012.stdout:1879: seq_num 593 ranges {6389760=335872} 2024-09-10T18:03:07.193 INFO:tasks.rados.rados.0.smithi012.stdout:1879: writing smithi01278544-42 from 6389760 to 6725632 tid 1 2024-09-10T18:03:07.193 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 198 2024-09-10T18:03:07.193 INFO:tasks.rados.rados.0.smithi012.stdout:1880: seq_num 594 ranges {2072576=352256} 2024-09-10T18:03:07.206 INFO:tasks.rados.rados.0.smithi012.stdout:1880: writing smithi01278544-39 from 2072576 to 2424832 tid 1 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 198 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:1879: finishing write tid 1 to smithi01278544-42 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:1879: finishing write tid 2 to smithi01278544-42 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:1879: finishing write tid 3 to smithi01278544-42 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:1879: oid 42 updating version 0 to 1216 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:1879: oid 42 version 1216 is already newer than 1215 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1216 (ObjNum 593 snap 198 seq_num 593) dirty exists 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:1879: left oid 42 (ObjNum 593 snap 198 seq_num 593) 2024-09-10T18:03:07.207 INFO:tasks.rados.rados.0.smithi012.stdout:1881: seq_num 595 ranges {286720=368640} 2024-09-10T18:03:07.210 INFO:tasks.rados.rados.0.smithi012.stdout:1881: writing smithi01278544-23 from 286720 to 655360 tid 1 2024-09-10T18:03:07.210 INFO:tasks.rados.rados.0.smithi012.stdout:1879: done (2 left) 2024-09-10T18:03:07.210 INFO:tasks.rados.rados.0.smithi012.stdout:1882: delete oid 1 current snap is 198 2024-09-10T18:03:07.210 INFO:tasks.rados.rados.0.smithi012.stdout:1880: finishing write tid 1 to smithi01278544-39 2024-09-10T18:03:07.210 INFO:tasks.rados.rados.0.smithi012.stdout:1880: finishing write tid 2 to smithi01278544-39 2024-09-10T18:03:07.211 INFO:tasks.rados.rados.0.smithi012.stdout:1880: finishing write tid 3 to smithi01278544-39 2024-09-10T18:03:07.211 INFO:tasks.rados.rados.0.smithi012.stdout:1880: oid 39 updating version 0 to 1280 2024-09-10T18:03:07.211 INFO:tasks.rados.rados.0.smithi012.stdout:1880: oid 39 version 1280 is already newer than 1279 2024-09-10T18:03:07.211 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1280 (ObjNum 594 snap 198 seq_num 594) dirty exists 2024-09-10T18:03:07.211 INFO:tasks.rados.rados.0.smithi012.stdout:1880: left oid 39 (ObjNum 594 snap 198 seq_num 594) 2024-09-10T18:03:07.212 INFO:tasks.rados.rados.0.smithi012.stdout:1881: finishing write tid 1 to smithi01278544-23 2024-09-10T18:03:07.214 INFO:tasks.rados.rados.0.smithi012.stdout:1881: finishing write tid 2 to smithi01278544-23 2024-09-10T18:03:07.214 INFO:tasks.rados.rados.0.smithi012.stdout:1880: done (2 left) 2024-09-10T18:03:07.214 INFO:tasks.rados.rados.0.smithi012.stdout:1882: done (1 left) 2024-09-10T18:03:07.214 INFO:tasks.rados.rados.0.smithi012.stdout:1883: rmattr oid 7 current snap is 198 2024-09-10T18:03:07.214 INFO:tasks.rados.rados.0.smithi012.stdout:1884: read oid 30 snap -1 2024-09-10T18:03:07.215 INFO:tasks.rados.rados.0.smithi012.stdout:1884: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:07.215 INFO:tasks.rados.rados.0.smithi012.stdout:1885: delete oid 27 current snap is 198 2024-09-10T18:03:07.215 INFO:tasks.rados.rados.0.smithi012.stdout:1881: finishing write tid 3 to smithi01278544-23 2024-09-10T18:03:07.215 INFO:tasks.rados.rados.0.smithi012.stdout:1881: oid 23 updating version 0 to 871 2024-09-10T18:03:07.215 INFO:tasks.rados.rados.0.smithi012.stdout:1881: oid 23 updating version 871 to 872 2024-09-10T18:03:07.215 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 872 (ObjNum 595 snap 198 seq_num 595) dirty exists 2024-09-10T18:03:07.215 INFO:tasks.rados.rados.0.smithi012.stdout:1881: left oid 23 (ObjNum 595 snap 198 seq_num 595) 2024-09-10T18:03:07.218 INFO:tasks.rados.rados.0.smithi012.stdout:1881: done (3 left) 2024-09-10T18:03:07.218 INFO:tasks.rados.rados.0.smithi012.stdout:1885: done (2 left) 2024-09-10T18:03:07.218 INFO:tasks.rados.rados.0.smithi012.stdout:1886: setattr oid 35 current snap is 198 2024-09-10T18:03:07.218 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 698 (ObjNum 551 snap 183 seq_num 551) dirty exists 2024-09-10T18:03:07.219 INFO:tasks.rados.rados.0.smithi012.stdout:1883: done (2 left) 2024-09-10T18:03:07.220 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 198 2024-09-10T18:03:07.220 INFO:tasks.rados.rados.0.smithi012.stdout:1887: seq_num 598 ranges {0=417792} 2024-09-10T18:03:07.222 INFO:tasks.rados.rados.0.smithi012.stdout:1887: writing smithi01278544-1 from 0 to 417792 tid 1 2024-09-10T18:03:07.222 INFO:tasks.rados.rados.0.smithi012.stdout:1888: snap_create 2024-09-10T18:03:07.226 INFO:tasks.rados.rados.0.smithi012.stdout:1887: finishing write tid 1 to smithi01278544-1 2024-09-10T18:03:07.226 INFO:tasks.rados.rados.0.smithi012.stdout:1887: finishing write tid 2 to smithi01278544-1 2024-09-10T18:03:07.227 INFO:tasks.rados.rados.0.smithi012.stdout:1887: finishing write tid 3 to smithi01278544-1 2024-09-10T18:03:07.227 INFO:tasks.rados.rados.0.smithi012.stdout:1887: oid 1 updating version 0 to 1106 2024-09-10T18:03:07.227 INFO:tasks.rados.rados.0.smithi012.stdout:1887: oid 1 version 1106 is already newer than 1105 2024-09-10T18:03:07.228 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1106 (ObjNum 598 snap 198 seq_num 598) dirty exists 2024-09-10T18:03:07.228 INFO:tasks.rados.rados.0.smithi012.stdout:1887: left oid 1 (ObjNum 598 snap 198 seq_num 598) 2024-09-10T18:03:07.252 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1100 (ObjNum 539 snap 182 seq_num 539) dirty exists 2024-09-10T18:03:07.274 INFO:tasks.rados.rados.0.smithi012.stdout:1884: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:08.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:07 smithi012 ceph-mon[89611]: osdmap e460: 8 total, 7 up, 8 in 2024-09-10T18:03:08.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:07 smithi012 ceph-mon[89611]: osdmap e461: 8 total, 7 up, 8 in 2024-09-10T18:03:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:07 smithi012 ceph-mon[92029]: osdmap e460: 8 total, 7 up, 8 in 2024-09-10T18:03:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:07 smithi012 ceph-mon[92029]: osdmap e461: 8 total, 7 up, 8 in 2024-09-10T18:03:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:07 smithi089 ceph-mon[84132]: osdmap e460: 8 total, 7 up, 8 in 2024-09-10T18:03:08.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:07 smithi089 ceph-mon[84132]: osdmap e461: 8 total, 7 up, 8 in 2024-09-10T18:03:08.673 INFO:tasks.rados.rados.0.smithi012.stdout:1884: done (3 left) 2024-09-10T18:03:08.673 INFO:tasks.rados.rados.0.smithi012.stdout:1886: done (2 left) 2024-09-10T18:03:08.673 INFO:tasks.rados.rados.0.smithi012.stdout:1887: done (1 left) 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1888: done (0 left) 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1889: read oid 17 snap -1 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1889: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1890: copy_from oid 25 from oid 30 current snap is 199 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1891: read oid 8 snap -1 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1891: expect deleted 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1892: read oid 38 snap -1 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1892: expect (ObjNum 567 snap 190 seq_num 567) 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1893: copy_from oid 34 from oid 26 current snap is 199 2024-09-10T18:03:08.674 INFO:tasks.rados.rados.0.smithi012.stdout:1894: delete oid 21 current snap is 199 2024-09-10T18:03:08.678 INFO:tasks.rados.rados.0.smithi012.stdout:1893: finishing copy_from racing read to smithi01278544-34 2024-09-10T18:03:08.680 INFO:tasks.rados.rados.0.smithi012.stdout:1891: done (5 left) 2024-09-10T18:03:08.680 INFO:tasks.rados.rados.0.smithi012.stdout:1894: done (4 left) 2024-09-10T18:03:08.680 INFO:tasks.rados.rados.0.smithi012.stdout:1895: snap_remove snap 193 2024-09-10T18:03:08.740 INFO:tasks.rados.rados.0.smithi012.stdout:1895: done (4 left) 2024-09-10T18:03:08.740 INFO:tasks.rados.rados.0.smithi012.stdout:1896: read oid 4 snap -1 2024-09-10T18:03:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1896: expect (ObjNum 586 snap 196 seq_num 586) 2024-09-10T18:03:08.741 INFO:tasks.rados.rados.0.smithi012.stdout:1897: snap_remove snap 188 2024-09-10T18:03:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:08 smithi012 ceph-mon[89611]: pgmap v361: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 331 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 364 KiB/s wr, 17 op/s; 85/618 objects degraded (13.754%) 2024-09-10T18:03:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:08 smithi012 ceph-mon[89611]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T18:03:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:08 smithi012 ceph-mon[92029]: pgmap v361: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 331 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 364 KiB/s wr, 17 op/s; 85/618 objects degraded (13.754%) 2024-09-10T18:03:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:08 smithi012 ceph-mon[92029]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T18:03:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:08 smithi089 ceph-mon[84132]: pgmap v361: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 331 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 364 KiB/s wr, 17 op/s; 85/618 objects degraded (13.754%) 2024-09-10T18:03:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:08 smithi089 ceph-mon[84132]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T18:03:09.750 INFO:tasks.rados.rados.0.smithi012.stdout:1897: done (5 left) 2024-09-10T18:03:09.750 INFO:tasks.rados.rados.0.smithi012.stdout:1898: rollback oid 35 current snap is 199 2024-09-10T18:03:09.750 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 35 to 185 2024-09-10T18:03:09.750 INFO:tasks.rados.rados.0.smithi012.stdout:1899: read oid 43 snap -1 2024-09-10T18:03:09.750 INFO:tasks.rados.rados.0.smithi012.stdout:1899: expect (ObjNum 548 snap 183 seq_num 548) 2024-09-10T18:03:09.750 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 199 2024-09-10T18:03:09.751 INFO:tasks.rados.rados.0.smithi012.stdout:1900: seq_num 600 ranges {253952=450560} 2024-09-10T18:03:09.752 INFO:tasks.rados.rados.0.smithi012.stdout:1900: writing smithi01278544-32 from 253952 to 704512 tid 1 2024-09-10T18:03:09.753 INFO:tasks.rados.rados.0.smithi012.stdout:1901: rollback oid 19 current snap is 199 2024-09-10T18:03:09.753 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 19 to 190 2024-09-10T18:03:09.753 INFO:tasks.rados.rados.0.smithi012.stdout:1902: snap_remove snap 186 2024-09-10T18:03:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:09 smithi012 ceph-mon[89611]: osdmap e462: 8 total, 7 up, 8 in 2024-09-10T18:03:10.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:09 smithi012 ceph-mon[92029]: osdmap e462: 8 total, 7 up, 8 in 2024-09-10T18:03:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:09 smithi089 ceph-mon[84132]: osdmap e462: 8 total, 7 up, 8 in 2024-09-10T18:03:10.753 INFO:tasks.rados.rados.0.smithi012.stdout:1902: done (9 left) 2024-09-10T18:03:10.753 INFO:tasks.rados.rados.0.smithi012.stdout:1903: rollback oid 31 current snap is 199 2024-09-10T18:03:10.753 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 187 2024-09-10T18:03:10.753 INFO:tasks.rados.rados.0.smithi012.stdout:1893: finishing copy_from to smithi01278544-34 2024-09-10T18:03:10.753 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 762 (ObjNum 575 snap 192 seq_num 575) dirty exists 2024-09-10T18:03:10.754 INFO:tasks.rados.rados.0.smithi012.stdout:1893: done (9 left) 2024-09-10T18:03:10.754 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 199 2024-09-10T18:03:10.754 INFO:tasks.rados.rados.0.smithi012.stdout:1904: seq_num 601 ranges {237568=475136} 2024-09-10T18:03:10.758 INFO:tasks.rados.rados.0.smithi012.stdout:1904: writing smithi01278544-45 from 237568 to 712704 tid 1 2024-09-10T18:03:10.758 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 199 2024-09-10T18:03:10.758 INFO:tasks.rados.rados.0.smithi012.stdout:1905: seq_num 602 ranges {0=491520} 2024-09-10T18:03:10.761 INFO:tasks.rados.rados.0.smithi012.stdout:1905: writing smithi01278544-50 from 0 to 491520 tid 1 2024-09-10T18:03:10.761 INFO:tasks.rados.rados.0.smithi012.stdout:1906: snap_create 2024-09-10T18:03:10.761 INFO:tasks.rados.rados.0.smithi012.stdout:1892: expect (ObjNum 567 snap 190 seq_num 567) 2024-09-10T18:03:10.831 INFO:tasks.rados.rados.0.smithi012.stdout:1889: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:03:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[89611]: pgmap v364: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 652 KiB/s wr, 21 op/s; 88/630 objects degraded (13.968%) 2024-09-10T18:03:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 88/630 objects degraded (13.968%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[89611]: osdmap e463: 8 total, 7 up, 8 in 2024-09-10T18:03:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[92029]: pgmap v364: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 652 KiB/s wr, 21 op/s; 88/630 objects degraded (13.968%) 2024-09-10T18:03:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 88/630 objects degraded (13.968%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[92029]: osdmap e463: 8 total, 7 up, 8 in 2024-09-10T18:03:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:10 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.036 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:10 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:03:10.783+0000 7fca47a0e640 -1 osd.5 452 log_to_monitors true 2024-09-10T18:03:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:10 smithi089 ceph-mon[84132]: pgmap v364: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 652 KiB/s wr, 21 op/s; 88/630 objects degraded (13.968%) 2024-09-10T18:03:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:10 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 88/630 objects degraded (13.968%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:10 smithi089 ceph-mon[84132]: osdmap e463: 8 total, 7 up, 8 in 2024-09-10T18:03:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:10 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:10 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:10 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:10 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:11.374 INFO:tasks.rados.rados.0.smithi012.stdout:1890: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:03:11.374 INFO:tasks.rados.rados.0.smithi012.stdout:1890: finishing copy_from to smithi01278544-25 2024-09-10T18:03:11.374 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1097 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:03:11.375 INFO:tasks.rados.rados.0.smithi012.stdout:1896: expect (ObjNum 586 snap 196 seq_num 586) 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:1898: finishing rollback tid 0 to smithi01278544-35 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:1898: finishing rollback tid 1 to smithi01278544-35 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:1898: finishing rollback tid 2 to smithi01278544-35 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1103 (ObjNum 539 snap 182 seq_num 539) dirty exists 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:1900: finishing write tid 1 to smithi01278544-32 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:1900: finishing write tid 2 to smithi01278544-32 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:1900: finishing write tid 3 to smithi01278544-32 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:1900: oid 32 updating version 0 to 1105 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:1900: oid 32 version 1105 is already newer than 1104 2024-09-10T18:03:11.380 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1105 (ObjNum 600 snap 199 seq_num 600) dirty exists 2024-09-10T18:03:11.381 INFO:tasks.rados.rados.0.smithi012.stdout:1900: left oid 32 (ObjNum 600 snap 199 seq_num 600) 2024-09-10T18:03:11.381 INFO:tasks.rados.rados.0.smithi012.stdout:1901: finishing rollback tid 1 to smithi01278544-19 2024-09-10T18:03:11.381 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 0 (ObjNum 81 snap 0 seq_num 0) dirty dne 2024-09-10T18:03:11.381 INFO:tasks.rados.rados.0.smithi012.stdout:1899: expect (ObjNum 548 snap 183 seq_num 548) 2024-09-10T18:03:11.509 INFO:tasks.rados.rados.0.smithi012.stdout:1903: finishing rollback tid 0 to smithi01278544-31 2024-09-10T18:03:11.509 INFO:tasks.rados.rados.0.smithi012.stdout:1903: finishing rollback tid 1 to smithi01278544-31 2024-09-10T18:03:11.509 INFO:tasks.rados.rados.0.smithi012.stdout:1903: finishing rollback tid 2 to smithi01278544-31 2024-09-10T18:03:11.509 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 876 (ObjNum 533 snap 181 seq_num 533) dirty exists 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1905: finishing write tid 1 to smithi01278544-50 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1905: finishing write tid 2 to smithi01278544-50 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1905: finishing write tid 3 to smithi01278544-50 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1905: oid 50 updating version 0 to 748 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1905: oid 50 updating version 748 to 749 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 749 (ObjNum 602 snap 199 seq_num 602) dirty exists 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1905: left oid 50 (ObjNum 602 snap 199 seq_num 602) 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1904: finishing write tid 1 to smithi01278544-45 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1904: finishing write tid 2 to smithi01278544-45 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1904: finishing write tid 3 to smithi01278544-45 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1904: oid 45 updating version 0 to 1230 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:1904: oid 45 updating version 1230 to 1231 2024-09-10T18:03:11.510 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1231 (ObjNum 601 snap 199 seq_num 601) dirty exists 2024-09-10T18:03:11.511 INFO:tasks.rados.rados.0.smithi012.stdout:1904: left oid 45 (ObjNum 601 snap 199 seq_num 601) 2024-09-10T18:03:11.758 INFO:tasks.rados.rados.0.smithi012.stdout:1889: done (11 left) 2024-09-10T18:03:11.758 INFO:tasks.rados.rados.0.smithi012.stdout:1890: done (10 left) 2024-09-10T18:03:11.758 INFO:tasks.rados.rados.0.smithi012.stdout:1892: done (9 left) 2024-09-10T18:03:11.758 INFO:tasks.rados.rados.0.smithi012.stdout:1896: done (8 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1898: done (7 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1899: done (6 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1900: done (5 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1901: done (4 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1903: done (3 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1904: done (2 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1905: done (1 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1906: done (0 left) 2024-09-10T18:03:11.759 INFO:tasks.rados.rados.0.smithi012.stdout:1907: delete oid 50 current snap is 200 2024-09-10T18:03:11.762 INFO:tasks.rados.rados.0.smithi012.stdout:1907: done (0 left) 2024-09-10T18:03:11.762 INFO:tasks.rados.rados.0.smithi012.stdout:1908: rmattr oid 47 current snap is 200 2024-09-10T18:03:11.762 INFO:tasks.rados.rados.0.smithi012.stdout:1909: delete oid 15 current snap is 200 2024-09-10T18:03:11.766 INFO:tasks.rados.rados.0.smithi012.stdout:1909: done (1 left) 2024-09-10T18:03:11.766 INFO:tasks.rados.rados.0.smithi012.stdout:1910: snap_remove snap 187 2024-09-10T18:03:11.876 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:03:11 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:03:11.787+0000 7fca3b7b0640 -1 osd.5 452 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T18:03:11.877 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:11 smithi089 ceph-mon[84132]: osdmap e464: 8 total, 7 up, 8 in 2024-09-10T18:03:11.877 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:11 smithi089 ceph-mon[84132]: from='osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T18:03:11.877 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:11 smithi089 ceph-mon[84132]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T18:03:12.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:11 smithi012 ceph-mon[89611]: osdmap e464: 8 total, 7 up, 8 in 2024-09-10T18:03:12.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:11 smithi012 ceph-mon[89611]: from='osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T18:03:12.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:11 smithi012 ceph-mon[89611]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T18:03:12.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:11 smithi012 ceph-mon[92029]: osdmap e464: 8 total, 7 up, 8 in 2024-09-10T18:03:12.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:11 smithi012 ceph-mon[92029]: from='osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T18:03:12.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:11 smithi012 ceph-mon[92029]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T18:03:12.782 INFO:tasks.rados.rados.0.smithi012.stdout:1910: done (1 left) 2024-09-10T18:03:12.782 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 200 2024-09-10T18:03:12.782 INFO:tasks.rados.rados.0.smithi012.stdout:1911: seq_num 605 ranges {1048576=540672} 2024-09-10T18:03:12.789 INFO:tasks.rados.rados.0.smithi012.stdout:1911: writing smithi01278544-44 from 1048576 to 1589248 tid 1 2024-09-10T18:03:12.789 INFO:tasks.rados.rados.0.smithi012.stdout:1912: read oid 36 snap -1 2024-09-10T18:03:12.789 INFO:tasks.rados.rados.0.smithi012.stdout:1912: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:03:12.789 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 200 2024-09-10T18:03:12.789 INFO:tasks.rados.rados.0.smithi012.stdout:1913: seq_num 606 ranges {0=557056} 2024-09-10T18:03:12.793 INFO:tasks.rados.rados.0.smithi012.stdout:1913: writing smithi01278544-19 from 0 to 557056 tid 1 2024-09-10T18:03:12.793 INFO:tasks.rados.rados.0.smithi012.stdout:1914: rmattr oid 43 current snap is 200 2024-09-10T18:03:12.793 INFO:tasks.rados.rados.0.smithi012.stdout:1914: done (4 left) 2024-09-10T18:03:12.794 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 200 2024-09-10T18:03:12.794 INFO:tasks.rados.rados.0.smithi012.stdout:1915: seq_num 607 ranges {0=573440} 2024-09-10T18:03:12.797 INFO:tasks.rados.rados.0.smithi012.stdout:1915: writing smithi01278544-15 from 0 to 573440 tid 1 2024-09-10T18:03:12.798 INFO:tasks.rados.rados.0.smithi012.stdout:1916: copy_from oid 46 from oid 12 current snap is 200 2024-09-10T18:03:12.798 INFO:tasks.rados.rados.0.smithi012.stdout:1917: read oid 1 snap 192 2024-09-10T18:03:12.798 INFO:tasks.rados.rados.0.smithi012.stdout:1917: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:12.798 INFO:tasks.rados.rados.0.smithi012.stdout:1918: snap_create 2024-09-10T18:03:12.798 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1243 (ObjNum 569 snap 190 seq_num 569) dirty exists 2024-09-10T18:03:12.798 INFO:tasks.rados.rados.0.smithi012.stdout:1912: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:03:12.806 INFO:tasks.rados.rados.0.smithi012.stdout:1915: finishing write tid 1 to smithi01278544-15 2024-09-10T18:03:12.806 INFO:tasks.rados.rados.0.smithi012.stdout:1915: finishing write tid 2 to smithi01278544-15 2024-09-10T18:03:12.808 INFO:tasks.rados.rados.0.smithi012.stdout:1915: finishing write tid 3 to smithi01278544-15 2024-09-10T18:03:12.808 INFO:tasks.rados.rados.0.smithi012.stdout:1915: oid 15 updating version 0 to 1103 2024-09-10T18:03:12.808 INFO:tasks.rados.rados.0.smithi012.stdout:1915: oid 15 version 1103 is already newer than 1102 2024-09-10T18:03:12.808 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 1103 (ObjNum 607 snap 200 seq_num 607) dirty exists 2024-09-10T18:03:12.808 INFO:tasks.rados.rados.0.smithi012.stdout:1915: left oid 15 (ObjNum 607 snap 200 seq_num 607) 2024-09-10T18:03:12.842 INFO:tasks.rados.rados.0.smithi012.stdout:1917: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[89611]: pgmap v367: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 288 KiB/s wr, 12 op/s; 89/633 objects degraded (14.060%) 2024-09-10T18:03:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[89611]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T18:03:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[89611]: osdmap e465: 8 total, 7 up, 8 in 2024-09-10T18:03:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[89611]: from='osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[89611]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[92029]: pgmap v367: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 288 KiB/s wr, 12 op/s; 89/633 objects degraded (14.060%) 2024-09-10T18:03:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[92029]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T18:03:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[92029]: osdmap e465: 8 total, 7 up, 8 in 2024-09-10T18:03:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[92029]: from='osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:12 smithi012 ceph-mon[92029]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:12 smithi089 ceph-mon[84132]: pgmap v367: 121 pgs: 36 active+undersized, 14 active+undersized+degraded, 71 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 288 KiB/s wr, 12 op/s; 89/633 objects degraded (14.060%) 2024-09-10T18:03:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:12 smithi089 ceph-mon[84132]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T18:03:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:12 smithi089 ceph-mon[84132]: osdmap e465: 8 total, 7 up, 8 in 2024-09-10T18:03:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:12 smithi089 ceph-mon[84132]: from='osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:12 smithi089 ceph-mon[84132]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:14.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-mon[89611]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:03:14.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-mon[89611]: osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055] boot 2024-09-10T18:03:14.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-mon[89611]: osdmap e466: 8 total, 8 up, 8 in 2024-09-10T18:03:14.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T18:03:14.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:03:13.931+0000 7f7a9b686640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T18:03:14.035 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:03:13] "GET /metrics HTTP/1.1" 200 36282 "" "Prometheus/2.43.0" 2024-09-10T18:03:14.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-mon[92029]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:03:14.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-mon[92029]: osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055] boot 2024-09-10T18:03:14.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-mon[92029]: osdmap e466: 8 total, 8 up, 8 in 2024-09-10T18:03:14.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:13 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T18:03:14.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:13 smithi089 ceph-mon[84132]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:03:14.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:13 smithi089 ceph-mon[84132]: osd.5 [v2:172.21.15.89:6808/2898627055,v1:172.21.15.89:6809/2898627055] boot 2024-09-10T18:03:14.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:13 smithi089 ceph-mon[84132]: osdmap e466: 8 total, 8 up, 8 in 2024-09-10T18:03:14.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:13 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T18:03:14.265 INFO:tasks.rados.rados.0.smithi012.stdout:1913: finishing write tid 1 to smithi01278544-19 2024-09-10T18:03:14.265 INFO:tasks.rados.rados.0.smithi012.stdout:1913: finishing write tid 2 to smithi01278544-19 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1911: finishing write tid 1 to smithi01278544-44 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1911: finishing write tid 2 to smithi01278544-44 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1913: finishing write tid 3 to smithi01278544-19 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1913: oid 19 updating version 0 to 874 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1913: oid 19 updating version 874 to 875 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 875 (ObjNum 606 snap 200 seq_num 606) dirty exists 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1913: left oid 19 (ObjNum 606 snap 200 seq_num 606) 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1911: finishing write tid 3 to smithi01278544-44 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1911: oid 44 updating version 0 to 740 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:1911: oid 44 updating version 740 to 741 2024-09-10T18:03:14.266 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 741 (ObjNum 605 snap 200 seq_num 605) dirty exists 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1911: left oid 44 (ObjNum 605 snap 200 seq_num 605) 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1916: finishing copy_from to smithi01278544-46 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1916: got expected ENOENT (src dne) 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1916: finishing copy_from racing read to smithi01278544-46 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1908: done (7 left) 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1911: done (6 left) 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1912: done (5 left) 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1913: done (4 left) 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1915: done (3 left) 2024-09-10T18:03:14.267 INFO:tasks.rados.rados.0.smithi012.stdout:1916: done (2 left) 2024-09-10T18:03:14.268 INFO:tasks.rados.rados.0.smithi012.stdout:1917: done (1 left) 2024-09-10T18:03:14.268 INFO:tasks.rados.rados.0.smithi012.stdout:1918: done (0 left) 2024-09-10T18:03:14.268 INFO:tasks.rados.rados.0.smithi012.stdout:1919: snap_remove snap 191 2024-09-10T18:03:14.816 INFO:tasks.rados.rados.0.smithi012.stdout:1919: done (0 left) 2024-09-10T18:03:14.817 INFO:tasks.rados.rados.0.smithi012.stdout:1920: delete oid 16 current snap is 201 2024-09-10T18:03:14.829 INFO:tasks.rados.rados.0.smithi012.stdout:1920: done (0 left) 2024-09-10T18:03:14.829 INFO:tasks.rados.rados.0.smithi012.stdout:1921: copy_from oid 46 from oid 45 current snap is 201 2024-09-10T18:03:14.829 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 201 2024-09-10T18:03:14.829 INFO:tasks.rados.rados.0.smithi012.stdout:1922: seq_num 609 ranges {12460032=606208} 2024-09-10T18:03:14.901 INFO:tasks.rados.rados.0.smithi012.stdout:1922: writing smithi01278544-25 from 12460032 to 13066240 tid 1 2024-09-10T18:03:14.901 INFO:tasks.rados.rados.0.smithi012.stdout:1923: copy_from oid 39 from oid 34 current snap is 201 2024-09-10T18:03:14.901 INFO:tasks.rados.rados.0.smithi012.stdout:1921: finishing copy_from racing read to smithi01278544-46 2024-09-10T18:03:14.901 INFO:tasks.rados.rados.0.smithi012.stdout:1921: finishing copy_from to smithi01278544-46 2024-09-10T18:03:14.901 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1231 (ObjNum 601 snap 199 seq_num 601) dirty exists 2024-09-10T18:03:14.902 INFO:tasks.rados.rados.0.smithi012.stdout:1921: done (2 left) 2024-09-10T18:03:14.902 INFO:tasks.rados.rados.0.smithi012.stdout:1924: delete oid 50 current snap is 201 2024-09-10T18:03:14.902 INFO:tasks.rados.rados.0.smithi012.stdout:1924: done (2 left) 2024-09-10T18:03:14.902 INFO:tasks.rados.rados.0.smithi012.stdout:1925: read oid 30 snap -1 2024-09-10T18:03:14.903 INFO:tasks.rados.rados.0.smithi012.stdout:1925: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:14.903 INFO:tasks.rados.rados.0.smithi012.stdout:1926: read oid 41 snap -1 2024-09-10T18:03:14.903 INFO:tasks.rados.rados.0.smithi012.stdout:1926: expect (ObjNum 558 snap 186 seq_num 558) 2024-09-10T18:03:14.903 INFO:tasks.rados.rados.0.smithi012.stdout:1927: snap_remove snap 177 2024-09-10T18:03:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: pgmap v370: 121 pgs: 2 peering, 35 active+undersized, 13 active+undersized+degraded, 71 active+clean; 333 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 526 KiB/s wr, 12 op/s; 84/651 objects degraded (12.903%) 2024-09-10T18:03:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: osdmap e467: 8 total, 8 up, 8 in 2024-09-10T18:03:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: pgmap v370: 121 pgs: 2 peering, 35 active+undersized, 13 active+undersized+degraded, 71 active+clean; 333 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 526 KiB/s wr, 12 op/s; 84/651 objects degraded (12.903%) 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: osdmap e467: 8 total, 8 up, 8 in 2024-09-10T18:03:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: pgmap v370: 121 pgs: 2 peering, 35 active+undersized, 13 active+undersized+degraded, 71 active+clean; 333 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 526 KiB/s wr, 12 op/s; 84/651 objects degraded (12.903%) 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: osdmap e467: 8 total, 8 up, 8 in 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:15.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-10T18:03:15.822 INFO:tasks.rados.rados.0.smithi012.stdout:1926: expect (ObjNum 558 snap 186 seq_num 558) 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1923: finishing copy_from racing read to smithi01278544-39 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1922: finishing write tid 1 to smithi01278544-25 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1922: finishing write tid 2 to smithi01278544-25 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1923: finishing copy_from to smithi01278544-39 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 762 (ObjNum 575 snap 192 seq_num 575) dirty exists 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1922: finishing write tid 3 to smithi01278544-25 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1922: oid 25 updating version 0 to 1306 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1922: oid 25 updating version 1306 to 1307 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1307 (ObjNum 609 snap 201 seq_num 609) dirty exists 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1922: left oid 25 (ObjNum 609 snap 201 seq_num 609) 2024-09-10T18:03:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:1925: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:16.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:15 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-10T18:03:16.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:15 smithi012 ceph-mon[89611]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T18:03:16.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:15 smithi012 ceph-mon[89611]: osdmap e468: 8 total, 8 up, 8 in 2024-09-10T18:03:16.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:15 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-10T18:03:16.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:15 smithi012 ceph-mon[92029]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T18:03:16.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:15 smithi012 ceph-mon[92029]: osdmap e468: 8 total, 8 up, 8 in 2024-09-10T18:03:16.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:15 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-10T18:03:16.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:15 smithi089 ceph-mon[84132]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T18:03:16.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:15 smithi089 ceph-mon[84132]: osdmap e468: 8 total, 8 up, 8 in 2024-09-10T18:03:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[89611]: pgmap v373: 121 pgs: 9 peering, 29 active+undersized, 12 active+undersized+degraded, 71 active+clean; 333 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 526 KiB/s wr, 10 op/s; 83/651 objects degraded (12.750%) 2024-09-10T18:03:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 83/651 objects degraded (12.750%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[89611]: osdmap e469: 8 total, 8 up, 8 in 2024-09-10T18:03:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[92029]: pgmap v373: 121 pgs: 9 peering, 29 active+undersized, 12 active+undersized+degraded, 71 active+clean; 333 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 526 KiB/s wr, 10 op/s; 83/651 objects degraded (12.750%) 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 83/651 objects degraded (12.750%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[92029]: osdmap e469: 8 total, 8 up, 8 in 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:16 smithi089 ceph-mon[84132]: pgmap v373: 121 pgs: 9 peering, 29 active+undersized, 12 active+undersized+degraded, 71 active+clean; 333 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 526 KiB/s wr, 10 op/s; 83/651 objects degraded (12.750%) 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:16 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 83/651 objects degraded (12.750%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:16 smithi089 ceph-mon[84132]: osdmap e469: 8 total, 8 up, 8 in 2024-09-10T18:03:17.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:17.284 INFO:tasks.rados.rados.0.smithi012.stdout:1922: done (4 left) 2024-09-10T18:03:17.284 INFO:tasks.rados.rados.0.smithi012.stdout:1923: done (3 left) 2024-09-10T18:03:17.284 INFO:tasks.rados.rados.0.smithi012.stdout:1925: done (2 left) 2024-09-10T18:03:17.284 INFO:tasks.rados.rados.0.smithi012.stdout:1926: done (1 left) 2024-09-10T18:03:17.284 INFO:tasks.rados.rados.0.smithi012.stdout:1927: done (0 left) 2024-09-10T18:03:17.284 INFO:tasks.rados.rados.0.smithi012.stdout:1928: snap_create 2024-09-10T18:03:17.789 INFO:tasks.rados.rados.0.smithi012.stdout:1928: done (0 left) 2024-09-10T18:03:17.790 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 202 2024-09-10T18:03:17.790 INFO:tasks.rados.rados.0.smithi012.stdout:1929: seq_num 611 ranges {655360=638976} 2024-09-10T18:03:17.798 INFO:tasks.rados.rados.0.smithi012.stdout:1929: writing smithi01278544-23 from 655360 to 1294336 tid 1 2024-09-10T18:03:17.798 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 202 2024-09-10T18:03:17.798 INFO:tasks.rados.rados.0.smithi012.stdout:1930: seq_num 612 ranges {7585792=655360} 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:1930: writing smithi01278544-35 from 7585792 to 8241152 tid 1 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:1931: rollback oid 37 current snap is 202 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 37 to 184 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:1929: finishing write tid 1 to smithi01278544-23 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:1929: finishing write tid 2 to smithi01278544-23 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:1929: finishing write tid 3 to smithi01278544-23 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:1929: oid 23 updating version 0 to 876 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:1929: oid 23 updating version 876 to 877 2024-09-10T18:03:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 877 (ObjNum 611 snap 202 seq_num 611) dirty exists 2024-09-10T18:03:17.844 INFO:tasks.rados.rados.0.smithi012.stdout:1929: left oid 23 (ObjNum 611 snap 202 seq_num 611) 2024-09-10T18:03:17.844 INFO:tasks.rados.rados.0.smithi012.stdout:1929: done (2 left) 2024-09-10T18:03:17.844 INFO:tasks.rados.rados.0.smithi012.stdout:1932: setattr oid 26 current snap is 202 2024-09-10T18:03:17.844 INFO:tasks.rados.rados.0.smithi012.stdout:1933: read oid 24 snap -1 2024-09-10T18:03:17.844 INFO:tasks.rados.rados.0.smithi012.stdout:1933: expect deleted 2024-09-10T18:03:17.844 INFO:tasks.rados.rados.0.smithi012.stdout:1934: snap_remove snap 158 2024-09-10T18:03:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:1934: done (4 left) 2024-09-10T18:03:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:1935: delete oid 38 current snap is 202 2024-09-10T18:03:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:1931: finishing rollback tid 0 to smithi01278544-37 2024-09-10T18:03:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:1931: finishing rollback tid 1 to smithi01278544-37 2024-09-10T18:03:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 763 (ObjNum 575 snap 192 seq_num 575) dirty exists 2024-09-10T18:03:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:1931: finishing rollback tid 2 to smithi01278544-37 2024-09-10T18:03:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 879 (ObjNum 540 snap 182 seq_num 540) dirty exists 2024-09-10T18:03:18.792 INFO:tasks.rados.rados.0.smithi012.stdout:1930: finishing write tid 1 to smithi01278544-35 2024-09-10T18:03:18.793 INFO:tasks.rados.rados.0.smithi012.stdout:1930: finishing write tid 2 to smithi01278544-35 2024-09-10T18:03:18.793 INFO:tasks.rados.rados.0.smithi012.stdout:1930: finishing write tid 3 to smithi01278544-35 2024-09-10T18:03:18.793 INFO:tasks.rados.rados.0.smithi012.stdout:1930: oid 35 updating version 0 to 1106 2024-09-10T18:03:18.793 INFO:tasks.rados.rados.0.smithi012.stdout:1930: oid 35 updating version 1106 to 1107 2024-09-10T18:03:18.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1107 (ObjNum 612 snap 202 seq_num 612) dirty exists 2024-09-10T18:03:18.793 INFO:tasks.rados.rados.0.smithi012.stdout:1930: left oid 35 (ObjNum 612 snap 202 seq_num 612) 2024-09-10T18:03:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:1930: done (4 left) 2024-09-10T18:03:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:1931: done (3 left) 2024-09-10T18:03:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:1932: done (2 left) 2024-09-10T18:03:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:1933: done (1 left) 2024-09-10T18:03:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:1935: done (0 left) 2024-09-10T18:03:18.803 INFO:tasks.rados.rados.0.smithi012.stdout:1936: snap_create 2024-09-10T18:03:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:18 smithi012 ceph-mon[89611]: pgmap v375: 121 pgs: 9 peering, 112 active+clean; 348 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.6 MiB/s wr, 12 op/s; 23 MiB/s, 6 objects/s recovering 2024-09-10T18:03:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:18 smithi012 ceph-mon[89611]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 83/651 objects degraded (12.750%), 12 pgs degraded) 2024-09-10T18:03:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:18 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:03:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:18 smithi012 ceph-mon[89611]: osdmap e470: 8 total, 8 up, 8 in 2024-09-10T18:03:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:18 smithi012 ceph-mon[92029]: pgmap v375: 121 pgs: 9 peering, 112 active+clean; 348 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.6 MiB/s wr, 12 op/s; 23 MiB/s, 6 objects/s recovering 2024-09-10T18:03:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:18 smithi012 ceph-mon[92029]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 83/651 objects degraded (12.750%), 12 pgs degraded) 2024-09-10T18:03:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:18 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:03:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:18 smithi012 ceph-mon[92029]: osdmap e470: 8 total, 8 up, 8 in 2024-09-10T18:03:19.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:18 smithi089 ceph-mon[84132]: pgmap v375: 121 pgs: 9 peering, 112 active+clean; 348 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.6 MiB/s wr, 12 op/s; 23 MiB/s, 6 objects/s recovering 2024-09-10T18:03:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:18 smithi089 ceph-mon[84132]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 83/651 objects degraded (12.750%), 12 pgs degraded) 2024-09-10T18:03:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:18 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:03:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:18 smithi089 ceph-mon[84132]: osdmap e470: 8 total, 8 up, 8 in 2024-09-10T18:03:19.797 INFO:tasks.rados.rados.0.smithi012.stdout:1936: done (0 left) 2024-09-10T18:03:19.797 INFO:tasks.rados.rados.0.smithi012.stdout:1937: read oid 15 snap 200 2024-09-10T18:03:19.797 INFO:tasks.rados.rados.0.smithi012.stdout:1937: expect (ObjNum 607 snap 200 seq_num 607) 2024-09-10T18:03:19.797 INFO:tasks.rados.rados.0.smithi012.stdout:1938: setattr oid 3 current snap is 203 2024-09-10T18:03:19.798 INFO:tasks.rados.rados.0.smithi012.stdout:1939: snap_remove snap 181 2024-09-10T18:03:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:19 smithi012 ceph-mon[89611]: osdmap e471: 8 total, 8 up, 8 in 2024-09-10T18:03:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:19 smithi012 ceph-mon[89611]: pgmap v378: 121 pgs: 121 active+clean; 348 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 10 op/s; 29 MiB/s, 7 objects/s recovering 2024-09-10T18:03:20.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:19 smithi012 ceph-mon[92029]: osdmap e471: 8 total, 8 up, 8 in 2024-09-10T18:03:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:19 smithi012 ceph-mon[92029]: pgmap v378: 121 pgs: 121 active+clean; 348 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 10 op/s; 29 MiB/s, 7 objects/s recovering 2024-09-10T18:03:20.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:19 smithi089 ceph-mon[84132]: osdmap e471: 8 total, 8 up, 8 in 2024-09-10T18:03:20.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:19 smithi089 ceph-mon[84132]: pgmap v378: 121 pgs: 121 active+clean; 348 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 10 op/s; 29 MiB/s, 7 objects/s recovering 2024-09-10T18:03:20.800 INFO:tasks.rados.rados.0.smithi012.stdout:1939: done (2 left) 2024-09-10T18:03:20.801 INFO:tasks.rados.rados.0.smithi012.stdout:1940: read oid 42 snap 173 2024-09-10T18:03:20.801 INFO:tasks.rados.rados.0.smithi012.stdout:1940: expect (ObjNum 405 snap 131 seq_num 405) 2024-09-10T18:03:20.801 INFO:tasks.rados.rados.0.smithi012.stdout:1941: read oid 23 snap 192 2024-09-10T18:03:20.801 INFO:tasks.rados.rados.0.smithi012.stdout:1941: expect deleted 2024-09-10T18:03:20.801 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 203 2024-09-10T18:03:20.801 INFO:tasks.rados.rados.0.smithi012.stdout:1942: seq_num 614 ranges {32768=688128} 2024-09-10T18:03:20.805 INFO:tasks.rados.rados.0.smithi012.stdout:1942: writing smithi01278544-26 from 32768 to 720896 tid 1 2024-09-10T18:03:20.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1232 (ObjNum 561 snap 186 seq_num 561) dirty exists 2024-09-10T18:03:20.806 INFO:tasks.rados.rados.0.smithi012.stdout:1937: expect (ObjNum 607 snap 200 seq_num 607) 2024-09-10T18:03:20.831 INFO:tasks.rados.rados.0.smithi012.stdout:1942: finishing write tid 1 to smithi01278544-26 2024-09-10T18:03:20.831 INFO:tasks.rados.rados.0.smithi012.stdout:1942: finishing write tid 2 to smithi01278544-26 2024-09-10T18:03:20.831 INFO:tasks.rados.rados.0.smithi012.stdout:1942: finishing write tid 3 to smithi01278544-26 2024-09-10T18:03:20.831 INFO:tasks.rados.rados.0.smithi012.stdout:1942: oid 26 updating version 0 to 764 2024-09-10T18:03:20.831 INFO:tasks.rados.rados.0.smithi012.stdout:1942: oid 26 updating version 764 to 765 2024-09-10T18:03:20.831 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 765 (ObjNum 614 snap 203 seq_num 614) dirty exists 2024-09-10T18:03:20.831 INFO:tasks.rados.rados.0.smithi012.stdout:1942: left oid 26 (ObjNum 614 snap 203 seq_num 614) 2024-09-10T18:03:20.831 INFO:tasks.rados.rados.0.smithi012.stdout:1937: done (4 left) 2024-09-10T18:03:20.832 INFO:tasks.rados.rados.0.smithi012.stdout:1938: done (3 left) 2024-09-10T18:03:20.832 INFO:tasks.rados.rados.0.smithi012.stdout:1941: done (2 left) 2024-09-10T18:03:20.832 INFO:tasks.rados.rados.0.smithi012.stdout:1942: done (1 left) 2024-09-10T18:03:20.832 INFO:tasks.rados.rados.0.smithi012.stdout:1943: delete oid 18 current snap is 203 2024-09-10T18:03:20.832 INFO:tasks.rados.rados.0.smithi012.stdout:1940: expect (ObjNum 405 snap 131 seq_num 405) 2024-09-10T18:03:20.934 INFO:tasks.rados.rados.0.smithi012.stdout:1940: done (1 left) 2024-09-10T18:03:20.935 INFO:tasks.rados.rados.0.smithi012.stdout:1943: done (0 left) 2024-09-10T18:03:20.935 INFO:tasks.rados.rados.0.smithi012.stdout:1944: setattr oid 45 current snap is 203 2024-09-10T18:03:20.937 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 203 2024-09-10T18:03:20.937 INFO:tasks.rados.rados.0.smithi012.stdout:1945: seq_num 616 ranges {221184=720896} 2024-09-10T18:03:20.943 INFO:tasks.rados.rados.0.smithi012.stdout:1945: writing smithi01278544-4 from 221184 to 942080 tid 1 2024-09-10T18:03:20.943 INFO:tasks.rados.rados.0.smithi012.stdout:1946: rollback oid 26 current snap is 203 2024-09-10T18:03:20.943 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 26 to 197 2024-09-10T18:03:20.943 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1289 (ObjNum 601 snap 199 seq_num 601) dirty exists 2024-09-10T18:03:20.943 INFO:tasks.rados.rados.0.smithi012.stdout:1944: done (2 left) 2024-09-10T18:03:20.943 INFO:tasks.rados.rados.0.smithi012.stdout:1947: copy_from oid 14 from oid 24 current snap is 203 2024-09-10T18:03:20.943 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 203 2024-09-10T18:03:20.944 INFO:tasks.rados.rados.0.smithi012.stdout:1948: seq_num 617 ranges {6725632=737280} 2024-09-10T18:03:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:03:20.985 INFO:tasks.rados.rados.0.smithi012.stdout:1948: writing smithi01278544-42 from 6725632 to 7462912 tid 1 2024-09-10T18:03:20.985 INFO:tasks.rados.rados.0.smithi012.stdout:1949: delete oid 40 current snap is 203 2024-09-10T18:03:20.985 INFO:tasks.rados.rados.0.smithi012.stdout:1947: finishing copy_from to smithi01278544-14 2024-09-10T18:03:20.985 INFO:tasks.rados.rados.0.smithi012.stdout:1947: got expected ENOENT (src dne) 2024-09-10T18:03:20.985 INFO:tasks.rados.rados.0.smithi012.stdout:1947: finishing copy_from racing read to smithi01278544-14 2024-09-10T18:03:20.985 INFO:tasks.rados.rados.0.smithi012.stdout:1946: finishing rollback tid 0 to smithi01278544-26 2024-09-10T18:03:20.985 INFO:tasks.rados.rados.0.smithi012.stdout:1946: finishing rollback tid 1 to smithi01278544-26 2024-09-10T18:03:20.985 INFO:tasks.rados.rados.0.smithi012.stdout:1946: finishing rollback tid 2 to smithi01278544-26 2024-09-10T18:03:20.986 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 768 (ObjNum 575 snap 192 seq_num 575) dirty exists 2024-09-10T18:03:20.986 INFO:tasks.rados.rados.0.smithi012.stdout:1945: finishing write tid 1 to smithi01278544-4 2024-09-10T18:03:20.986 INFO:tasks.rados.rados.0.smithi012.stdout:1945: finishing write tid 2 to smithi01278544-4 2024-09-10T18:03:20.986 INFO:tasks.rados.rados.0.smithi012.stdout:1945: finishing write tid 3 to smithi01278544-4 2024-09-10T18:03:20.986 INFO:tasks.rados.rados.0.smithi012.stdout:1945: oid 4 updating version 0 to 881 2024-09-10T18:03:20.986 INFO:tasks.rados.rados.0.smithi012.stdout:1945: oid 4 version 881 is already newer than 880 2024-09-10T18:03:20.986 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 881 (ObjNum 616 snap 203 seq_num 616) dirty exists 2024-09-10T18:03:20.986 INFO:tasks.rados.rados.0.smithi012.stdout:1945: left oid 4 (ObjNum 616 snap 203 seq_num 616) 2024-09-10T18:03:20.988 INFO:tasks.rados.rados.0.smithi012.stdout:1948: finishing write tid 1 to smithi01278544-42 2024-09-10T18:03:20.988 INFO:tasks.rados.rados.0.smithi012.stdout:1948: finishing write tid 2 to smithi01278544-42 2024-09-10T18:03:20.991 INFO:tasks.rados.rados.0.smithi012.stdout:1948: finishing write tid 3 to smithi01278544-42 2024-09-10T18:03:20.991 INFO:tasks.rados.rados.0.smithi012.stdout:1948: oid 42 updating version 0 to 1291 2024-09-10T18:03:20.991 INFO:tasks.rados.rados.0.smithi012.stdout:1948: oid 42 updating version 1291 to 1292 2024-09-10T18:03:20.991 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1292 (ObjNum 617 snap 203 seq_num 617) dirty exists 2024-09-10T18:03:20.991 INFO:tasks.rados.rados.0.smithi012.stdout:1948: left oid 42 (ObjNum 617 snap 203 seq_num 617) 2024-09-10T18:03:20.991 INFO:tasks.rados.rados.0.smithi012.stdout:1945: done (4 left) 2024-09-10T18:03:20.991 INFO:tasks.rados.rados.0.smithi012.stdout:1946: done (3 left) 2024-09-10T18:03:20.992 INFO:tasks.rados.rados.0.smithi012.stdout:1947: done (2 left) 2024-09-10T18:03:20.992 INFO:tasks.rados.rados.0.smithi012.stdout:1948: done (1 left) 2024-09-10T18:03:20.992 INFO:tasks.rados.rados.0.smithi012.stdout:1949: done (0 left) 2024-09-10T18:03:20.992 INFO:tasks.rados.rados.0.smithi012.stdout:1950: read oid 33 snap -1 2024-09-10T18:03:20.992 INFO:tasks.rados.rados.0.smithi012.stdout:1950: expect deleted 2024-09-10T18:03:20.992 INFO:tasks.rados.rados.0.smithi012.stdout:1951: read oid 13 snap -1 2024-09-10T18:03:20.992 INFO:tasks.rados.rados.0.smithi012.stdout:1951: expect (ObjNum 577 snap 194 seq_num 577) 2024-09-10T18:03:20.992 INFO:tasks.rados.rados.0.smithi012.stdout:1952: delete oid 41 current snap is 203 2024-09-10T18:03:20.994 INFO:tasks.rados.rados.0.smithi012.stdout:1951: expect (ObjNum 577 snap 194 seq_num 577) 2024-09-10T18:03:21.009 INFO:tasks.rados.rados.0.smithi012.stdout:1950: done (2 left) 2024-09-10T18:03:21.009 INFO:tasks.rados.rados.0.smithi012.stdout:1951: done (1 left) 2024-09-10T18:03:21.009 INFO:tasks.rados.rados.0.smithi012.stdout:1952: done (0 left) 2024-09-10T18:03:21.009 INFO:tasks.rados.rados.0.smithi012.stdout:1953: copy_from oid 47 from oid 10 current snap is 203 2024-09-10T18:03:21.010 INFO:tasks.rados.rados.0.smithi012.stdout:1954: rmattr oid 4 current snap is 203 2024-09-10T18:03:21.010 INFO:tasks.rados.rados.0.smithi012.stdout:1954: done (1 left) 2024-09-10T18:03:21.010 INFO:tasks.rados.rados.0.smithi012.stdout:1955: rollback oid 50 current snap is 203 2024-09-10T18:03:21.010 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 201 2024-09-10T18:03:21.010 INFO:tasks.rados.rados.0.smithi012.stdout:1956: snap_create 2024-09-10T18:03:21.010 INFO:tasks.rados.rados.0.smithi012.stdout:1955: finishing rollback tid 1 to smithi01278544-50 2024-09-10T18:03:21.010 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 750 (ObjNum -797507136 snap 22079 seq_num 304) dirty dne 2024-09-10T18:03:21.014 INFO:tasks.rados.rados.0.smithi012.stdout:1953: finishing copy_from racing read to smithi01278544-47 2024-09-10T18:03:21.015 INFO:tasks.rados.rados.0.smithi012.stdout:1953: finishing copy_from to smithi01278544-47 2024-09-10T18:03:21.015 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1270 (ObjNum 445 snap 150 seq_num 445) dirty exists 2024-09-10T18:03:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:20 smithi012 ceph-mon[89611]: osdmap e472: 8 total, 8 up, 8 in 2024-09-10T18:03:21.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:20 smithi012 ceph-mon[92029]: osdmap e472: 8 total, 8 up, 8 in 2024-09-10T18:03:21.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:20 smithi089 ceph-mon[84132]: osdmap e472: 8 total, 8 up, 8 in 2024-09-10T18:03:21.561 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:03:21.561 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (8m) 79s ago 9m 26.8M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:03:21.561 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (9m) 11s ago 9m 89.7M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:03:21.561 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (10m) 79s ago 10m 19.0M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:03:21.561 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (10m) 11s ago 10m 21.8M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:03:21.561 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (4m) 11s ago 14m 455M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (5m) 79s ago 15m 526M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (4m) 79s ago 16m 55.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (3m) 11s ago 14m 46.7M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (4m) 79s ago 14m 46.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (8m) 79s ago 8m 15.5M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (8m) 11s ago 8m 16.6M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (3m) 79s ago 14m 166M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (2m) 79s ago 13m 109M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (117s) 79s ago 13m 98.7M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (83s) 79s ago 12m 14.4M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (50s) 11s ago 12m 141M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 75e9a99555f3 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (16s) 11s ago 12m 11.2M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 28c479f4ad60 2024-09-10T18:03:21.562 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (11m) 11s ago 11m 237M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 63c1a65123fc 2024-09-10T18:03:21.563 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (11m) 11s ago 11m 176M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T18:03:21.563 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (4m) 11s ago 9m 65.5M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:03:21.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[89611]: osdmap e473: 8 total, 8 up, 8 in 2024-09-10T18:03:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:1953: done (2 left) 2024-09-10T18:03:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:1955: done (1 left) 2024-09-10T18:03:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:1956: done (0 left) 2024-09-10T18:03:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 204 2024-09-10T18:03:21.815 INFO:tasks.rados.rados.0.smithi012.stdout:1957: seq_num 620 ranges {0=794624} 2024-09-10T18:03:21.819 INFO:tasks.rados.rados.0.smithi012.stdout:1957: writing smithi01278544-18 from 0 to 794624 tid 1 2024-09-10T18:03:21.819 INFO:tasks.rados.rados.0.smithi012.stdout:1958: snap_create 2024-09-10T18:03:21.825 INFO:tasks.rados.rados.0.smithi012.stdout:1957: finishing write tid 1 to smithi01278544-18 2024-09-10T18:03:21.825 INFO:tasks.rados.rados.0.smithi012.stdout:1957: finishing write tid 2 to smithi01278544-18 2024-09-10T18:03:21.827 INFO:tasks.rados.rados.0.smithi012.stdout:1957: finishing write tid 3 to smithi01278544-18 2024-09-10T18:03:21.827 INFO:tasks.rados.rados.0.smithi012.stdout:1957: oid 18 updating version 0 to 1105 2024-09-10T18:03:21.827 INFO:tasks.rados.rados.0.smithi012.stdout:1957: oid 18 updating version 1105 to 1106 2024-09-10T18:03:21.827 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 1106 (ObjNum 620 snap 204 seq_num 620) dirty exists 2024-09-10T18:03:21.827 INFO:tasks.rados.rados.0.smithi012.stdout:1957: left oid 18 (ObjNum 620 snap 204 seq_num 620) 2024-09-10T18:03:21.922 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:03:21.922 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2, 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 6 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:03:21.923 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 4, 2024-09-10T18:03:21.924 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 11 2024-09-10T18:03:21.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:03:21.924 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "11/20 daemons upgraded", 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:03:22.219 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:03:22.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[89611]: from='client.44345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[89611]: pgmap v381: 121 pgs: 121 active+clean; 340 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 0 B/s wr, 1 op/s; 5.7 MiB/s, 1 objects/s recovering 2024-09-10T18:03:22.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[89611]: from='client.44351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[89611]: from='client.34449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.220 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[92029]: osdmap e473: 8 total, 8 up, 8 in 2024-09-10T18:03:22.221 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[92029]: from='client.44345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.221 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[92029]: pgmap v381: 121 pgs: 121 active+clean; 340 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 0 B/s wr, 1 op/s; 5.7 MiB/s, 1 objects/s recovering 2024-09-10T18:03:22.221 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[92029]: from='client.44351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.221 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:21 smithi012 ceph-mon[92029]: from='client.34449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:21 smithi089 ceph-mon[84132]: osdmap e473: 8 total, 8 up, 8 in 2024-09-10T18:03:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:21 smithi089 ceph-mon[84132]: from='client.44345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:21 smithi089 ceph-mon[84132]: pgmap v381: 121 pgs: 121 active+clean; 340 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 0 B/s wr, 1 op/s; 5.7 MiB/s, 1 objects/s recovering 2024-09-10T18:03:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:21 smithi089 ceph-mon[84132]: from='client.44351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:21 smithi089 ceph-mon[84132]: from='client.34449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:22.714 INFO:tasks.rados.rados.0.smithi012.stdout:1957: done (1 left) 2024-09-10T18:03:22.714 INFO:tasks.rados.rados.0.smithi012.stdout:1958: done (0 left) 2024-09-10T18:03:22.714 INFO:tasks.rados.rados.0.smithi012.stdout:1959: setattr oid 44 current snap is 205 2024-09-10T18:03:22.715 INFO:tasks.rados.rados.0.smithi012.stdout:1960: rollback oid 20 current snap is 205 2024-09-10T18:03:22.715 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 200 2024-09-10T18:03:22.715 INFO:tasks.rados.rados.0.smithi012.stdout:1961: snap_remove snap 202 2024-09-10T18:03:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:22 smithi012 ceph-mon[89611]: osdmap e474: 8 total, 8 up, 8 in 2024-09-10T18:03:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:22 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1149093769' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:22 smithi012 ceph-mon[89611]: from='client.44369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:22 smithi012 ceph-mon[89611]: osdmap e475: 8 total, 8 up, 8 in 2024-09-10T18:03:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:22 smithi012 ceph-mon[92029]: osdmap e474: 8 total, 8 up, 8 in 2024-09-10T18:03:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:22 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1149093769' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:22 smithi012 ceph-mon[92029]: from='client.44369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:22 smithi012 ceph-mon[92029]: osdmap e475: 8 total, 8 up, 8 in 2024-09-10T18:03:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:22 smithi089 ceph-mon[84132]: osdmap e474: 8 total, 8 up, 8 in 2024-09-10T18:03:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:22 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1149093769' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:22 smithi089 ceph-mon[84132]: from='client.44369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:22 smithi089 ceph-mon[84132]: osdmap e475: 8 total, 8 up, 8 in 2024-09-10T18:03:23.717 INFO:tasks.rados.rados.0.smithi012.stdout:1961: done (2 left) 2024-09-10T18:03:23.717 INFO:tasks.rados.rados.0.smithi012.stdout:1962: copy_from oid 39 from oid 18 current snap is 205 2024-09-10T18:03:23.717 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1233 (ObjNum 605 snap 200 seq_num 605) dirty exists 2024-09-10T18:03:23.717 INFO:tasks.rados.rados.0.smithi012.stdout:1960: finishing rollback tid 0 to smithi01278544-20 2024-09-10T18:03:23.717 INFO:tasks.rados.rados.0.smithi012.stdout:1960: finishing rollback tid 1 to smithi01278544-20 2024-09-10T18:03:23.717 INFO:tasks.rados.rados.0.smithi012.stdout:1960: finishing rollback tid 2 to smithi01278544-20 2024-09-10T18:03:23.718 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1347 (ObjNum 572 snap 190 seq_num 572) dirty exists 2024-09-10T18:03:23.718 INFO:tasks.rados.rados.0.smithi012.stdout:1959: done (2 left) 2024-09-10T18:03:23.718 INFO:tasks.rados.rados.0.smithi012.stdout:1960: done (1 left) 2024-09-10T18:03:23.718 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 205 2024-09-10T18:03:23.718 INFO:tasks.rados.rados.0.smithi012.stdout:1963: seq_num 621 ranges {1294336=409600,1703936=401408} 2024-09-10T18:03:23.726 INFO:tasks.rados.rados.0.smithi012.stdout:1963: writing smithi01278544-23 from 1294336 to 1703936 tid 1 2024-09-10T18:03:23.729 INFO:tasks.rados.rados.0.smithi012.stdout:1963: writing smithi01278544-23 from 1703936 to 2105344 tid 2 2024-09-10T18:03:23.729 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 30 current snap is 205 2024-09-10T18:03:23.729 INFO:tasks.rados.rados.0.smithi012.stdout:1964: seq_num 622 ranges {12460032=425984,12886016=401408} 2024-09-10T18:03:23.800 INFO:tasks.rados.rados.0.smithi012.stdout:1964: writing smithi01278544-30 from 12460032 to 12886016 tid 1 2024-09-10T18:03:23.802 INFO:tasks.rados.rados.0.smithi012.stdout:1964: writing smithi01278544-30 from 12886016 to 13287424 tid 2 2024-09-10T18:03:23.802 INFO:tasks.rados.rados.0.smithi012.stdout:1965: read oid 19 snap -1 2024-09-10T18:03:23.802 INFO:tasks.rados.rados.0.smithi012.stdout:1965: expect (ObjNum 606 snap 200 seq_num 606) 2024-09-10T18:03:23.802 INFO:tasks.rados.rados.0.smithi012.stdout:1966: read oid 1 snap -1 2024-09-10T18:03:23.802 INFO:tasks.rados.rados.0.smithi012.stdout:1966: expect (ObjNum 598 snap 198 seq_num 598) 2024-09-10T18:03:23.802 INFO:tasks.rados.rados.0.smithi012.stdout:1967: snap_remove snap 189 2024-09-10T18:03:24.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:03:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:03:23] "GET /metrics HTTP/1.1" 200 36141 "" "Prometheus/2.43.0" 2024-09-10T18:03:24.721 INFO:tasks.rados.rados.0.smithi012.stdout:1967: done (5 left) 2024-09-10T18:03:24.722 INFO:tasks.rados.rados.0.smithi012.stdout:1968: rollback oid 41 current snap is 205 2024-09-10T18:03:24.722 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 182 2024-09-10T18:03:24.722 INFO:tasks.rados.rados.0.smithi012.stdout:1962: finishing copy_from racing read to smithi01278544-39 2024-09-10T18:03:24.722 INFO:tasks.rados.rados.0.smithi012.stdout:1962: finishing copy_from to smithi01278544-39 2024-09-10T18:03:24.722 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1106 (ObjNum 620 snap 204 seq_num 620) dirty exists 2024-09-10T18:03:24.722 INFO:tasks.rados.rados.0.smithi012.stdout:1963: finishing write tid 1 to smithi01278544-23 2024-09-10T18:03:24.722 INFO:tasks.rados.rados.0.smithi012.stdout:1963: finishing write tid 2 to smithi01278544-23 2024-09-10T18:03:24.722 INFO:tasks.rados.rados.0.smithi012.stdout:1963: finishing write tid 3 to smithi01278544-23 2024-09-10T18:03:24.723 INFO:tasks.rados.rados.0.smithi012.stdout:1963: finishing write tid 4 to smithi01278544-23 2024-09-10T18:03:24.723 INFO:tasks.rados.rados.0.smithi012.stdout:1963: oid 23 updating version 0 to 878 2024-09-10T18:03:24.723 INFO:tasks.rados.rados.0.smithi012.stdout:1963: oid 23 updating version 878 to 880 2024-09-10T18:03:24.723 INFO:tasks.rados.rados.0.smithi012.stdout:1963: oid 23 version 880 is already newer than 879 2024-09-10T18:03:24.723 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 880 (ObjNum 621 snap 205 seq_num 621) dirty exists 2024-09-10T18:03:24.723 INFO:tasks.rados.rados.0.smithi012.stdout:1963: left oid 23 (ObjNum 621 snap 205 seq_num 621) 2024-09-10T18:03:24.723 INFO:tasks.rados.rados.0.smithi012.stdout:1964: finishing write tid 1 to smithi01278544-30 2024-09-10T18:03:24.723 INFO:tasks.rados.rados.0.smithi012.stdout:1965: expect (ObjNum 606 snap 200 seq_num 606) 2024-09-10T18:03:24.746 INFO:tasks.rados.rados.0.smithi012.stdout:1964: finishing write tid 2 to smithi01278544-30 2024-09-10T18:03:24.746 INFO:tasks.rados.rados.0.smithi012.stdout:1966: expect (ObjNum 598 snap 198 seq_num 598) 2024-09-10T18:03:24.758 INFO:tasks.rados.rados.0.smithi012.stdout:1964: finishing write tid 3 to smithi01278544-30 2024-09-10T18:03:24.758 INFO:tasks.rados.rados.0.smithi012.stdout:1964: finishing write tid 4 to smithi01278544-30 2024-09-10T18:03:24.758 INFO:tasks.rados.rados.0.smithi012.stdout:1964: oid 30 updating version 0 to 1108 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1964: oid 30 updating version 1108 to 1110 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1964: oid 30 version 1110 is already newer than 1109 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1110 (ObjNum 622 snap 205 seq_num 622) dirty exists 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1964: left oid 30 (ObjNum 622 snap 205 seq_num 622) 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1968: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 882 (ObjNum 33 snap 0 seq_num 3497328976) dirty dne 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1962: done (5 left) 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1963: done (4 left) 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1964: done (3 left) 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1965: done (2 left) 2024-09-10T18:03:24.759 INFO:tasks.rados.rados.0.smithi012.stdout:1966: done (1 left) 2024-09-10T18:03:24.760 INFO:tasks.rados.rados.0.smithi012.stdout:1968: done (0 left) 2024-09-10T18:03:24.760 INFO:tasks.rados.rados.0.smithi012.stdout:1969: read oid 21 snap -1 2024-09-10T18:03:24.760 INFO:tasks.rados.rados.0.smithi012.stdout:1969: expect deleted 2024-09-10T18:03:24.760 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 205 2024-09-10T18:03:24.760 INFO:tasks.rados.rados.0.smithi012.stdout:1970: seq_num 623 ranges {0=442368,442368=401408} 2024-09-10T18:03:24.760 INFO:tasks.rados.rados.0.smithi012.stdout:1970: writing smithi01278544-11 from 0 to 442368 tid 1 2024-09-10T18:03:24.762 INFO:tasks.rados.rados.0.smithi012.stdout:1970: writing smithi01278544-11 from 442368 to 843776 tid 2 2024-09-10T18:03:24.763 INFO:tasks.rados.rados.0.smithi012.stdout:1971: delete oid 25 current snap is 205 2024-09-10T18:03:24.766 INFO:tasks.rados.rados.0.smithi012.stdout:1970: finishing write tid 1 to smithi01278544-11 2024-09-10T18:03:24.766 INFO:tasks.rados.rados.0.smithi012.stdout:1970: finishing write tid 2 to smithi01278544-11 2024-09-10T18:03:24.766 INFO:tasks.rados.rados.0.smithi012.stdout:1970: finishing write tid 3 to smithi01278544-11 2024-09-10T18:03:24.771 INFO:tasks.rados.rados.0.smithi012.stdout:1970: finishing write tid 4 to smithi01278544-11 2024-09-10T18:03:24.771 INFO:tasks.rados.rados.0.smithi012.stdout:1970: oid 11 updating version 0 to 1365 2024-09-10T18:03:24.771 INFO:tasks.rados.rados.0.smithi012.stdout:1970: oid 11 version 1365 is already newer than 1363 2024-09-10T18:03:24.771 INFO:tasks.rados.rados.0.smithi012.stdout:1970: oid 11 version 1365 is already newer than 1364 2024-09-10T18:03:24.771 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1365 (ObjNum 623 snap 205 seq_num 623) dirty exists 2024-09-10T18:03:24.771 INFO:tasks.rados.rados.0.smithi012.stdout:1970: left oid 11 (ObjNum 623 snap 205 seq_num 623) 2024-09-10T18:03:24.772 INFO:tasks.rados.rados.0.smithi012.stdout:1969: done (2 left) 2024-09-10T18:03:24.772 INFO:tasks.rados.rados.0.smithi012.stdout:1970: done (1 left) 2024-09-10T18:03:24.772 INFO:tasks.rados.rados.0.smithi012.stdout:1971: done (0 left) 2024-09-10T18:03:24.772 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 205 2024-09-10T18:03:24.772 INFO:tasks.rados.rados.0.smithi012.stdout:1972: seq_num 625 ranges {712704=475136,1187840=401408} 2024-09-10T18:03:24.778 INFO:tasks.rados.rados.0.smithi012.stdout:1972: writing smithi01278544-46 from 712704 to 1187840 tid 1 2024-09-10T18:03:24.780 INFO:tasks.rados.rados.0.smithi012.stdout:1972: writing smithi01278544-46 from 1187840 to 1589248 tid 2 2024-09-10T18:03:24.780 INFO:tasks.rados.rados.0.smithi012.stdout:1973: read oid 31 snap -1 2024-09-10T18:03:24.780 INFO:tasks.rados.rados.0.smithi012.stdout:1973: expect (ObjNum 533 snap 181 seq_num 533) 2024-09-10T18:03:24.780 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 205 2024-09-10T18:03:24.780 INFO:tasks.rados.rados.0.smithi012.stdout:1974: seq_num 626 ranges {253952=491520,745472=401408} 2024-09-10T18:03:24.784 INFO:tasks.rados.rados.0.smithi012.stdout:1974: writing smithi01278544-47 from 253952 to 745472 tid 1 2024-09-10T18:03:24.787 INFO:tasks.rados.rados.0.smithi012.stdout:1974: writing smithi01278544-47 from 745472 to 1146880 tid 2 2024-09-10T18:03:24.787 INFO:tasks.rados.rados.0.smithi012.stdout:1975: read oid 22 snap -1 2024-09-10T18:03:24.787 INFO:tasks.rados.rados.0.smithi012.stdout:1975: expect deleted 2024-09-10T18:03:24.787 INFO:tasks.rados.rados.0.smithi012.stdout:1976: snap_remove snap 199 2024-09-10T18:03:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:24 smithi012 ceph-mon[89611]: pgmap v384: 121 pgs: 121 active+clean; 323 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 920 KiB/s wr, 22 op/s 2024-09-10T18:03:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:24 smithi012 ceph-mon[89611]: osdmap e476: 8 total, 8 up, 8 in 2024-09-10T18:03:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:24 smithi012 ceph-mon[92029]: pgmap v384: 121 pgs: 121 active+clean; 323 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 920 KiB/s wr, 22 op/s 2024-09-10T18:03:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:24 smithi012 ceph-mon[92029]: osdmap e476: 8 total, 8 up, 8 in 2024-09-10T18:03:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:24 smithi089 ceph-mon[84132]: pgmap v384: 121 pgs: 121 active+clean; 323 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 920 KiB/s wr, 22 op/s 2024-09-10T18:03:25.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:24 smithi089 ceph-mon[84132]: osdmap e476: 8 total, 8 up, 8 in 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1976: done (4 left) 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1977: copy_from oid 24 from oid 25 current snap is 205 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1978: copy_from oid 28 from oid 42 current snap is 205 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1972: finishing write tid 1 to smithi01278544-46 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1972: finishing write tid 2 to smithi01278544-46 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1972: finishing write tid 3 to smithi01278544-46 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1972: finishing write tid 4 to smithi01278544-46 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1972: oid 46 updating version 0 to 1236 2024-09-10T18:03:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:1972: oid 46 version 1236 is already newer than 1235 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1972: oid 46 version 1236 is already newer than 1234 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1236 (ObjNum 625 snap 205 seq_num 625) dirty exists 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1972: left oid 46 (ObjNum 625 snap 205 seq_num 625) 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1974: finishing write tid 1 to smithi01278544-47 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1974: finishing write tid 2 to smithi01278544-47 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1974: finishing write tid 3 to smithi01278544-47 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1974: finishing write tid 4 to smithi01278544-47 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1974: oid 47 updating version 0 to 1314 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1974: oid 47 updating version 1314 to 1316 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1974: oid 47 version 1316 is already newer than 1315 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1316 (ObjNum 626 snap 205 seq_num 626) dirty exists 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1974: left oid 47 (ObjNum 626 snap 205 seq_num 626) 2024-09-10T18:03:25.732 INFO:tasks.rados.rados.0.smithi012.stdout:1973: expect (ObjNum 533 snap 181 seq_num 533) 2024-09-10T18:03:25.915 INFO:tasks.rados.rados.0.smithi012.stdout:1977: finishing copy_from to smithi01278544-24 2024-09-10T18:03:25.915 INFO:tasks.rados.rados.0.smithi012.stdout:1977: got expected ENOENT (src dne) 2024-09-10T18:03:25.915 INFO:tasks.rados.rados.0.smithi012.stdout:1977: finishing copy_from racing read to smithi01278544-24 2024-09-10T18:03:25.915 INFO:tasks.rados.rados.0.smithi012.stdout:1978: finishing copy_from racing read to smithi01278544-28 2024-09-10T18:03:25.915 INFO:tasks.rados.rados.0.smithi012.stdout:1978: finishing copy_from to smithi01278544-28 2024-09-10T18:03:25.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1292 (ObjNum 617 snap 203 seq_num 617) dirty exists 2024-09-10T18:03:25.916 INFO:tasks.rados.rados.0.smithi012.stdout:1972: done (5 left) 2024-09-10T18:03:25.916 INFO:tasks.rados.rados.0.smithi012.stdout:1973: done (4 left) 2024-09-10T18:03:25.916 INFO:tasks.rados.rados.0.smithi012.stdout:1974: done (3 left) 2024-09-10T18:03:25.916 INFO:tasks.rados.rados.0.smithi012.stdout:1975: done (2 left) 2024-09-10T18:03:25.916 INFO:tasks.rados.rados.0.smithi012.stdout:1977: done (1 left) 2024-09-10T18:03:25.916 INFO:tasks.rados.rados.0.smithi012.stdout:1978: done (0 left) 2024-09-10T18:03:25.916 INFO:tasks.rados.rados.0.smithi012.stdout:1979: snap_remove snap 201 2024-09-10T18:03:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:25 smithi012 ceph-mon[89611]: osdmap e477: 8 total, 8 up, 8 in 2024-09-10T18:03:26.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:25 smithi012 ceph-mon[92029]: osdmap e477: 8 total, 8 up, 8 in 2024-09-10T18:03:26.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:25 smithi089 ceph-mon[84132]: osdmap e477: 8 total, 8 up, 8 in 2024-09-10T18:03:26.737 INFO:tasks.rados.rados.0.smithi012.stdout:1979: done (0 left) 2024-09-10T18:03:26.737 INFO:tasks.rados.rados.0.smithi012.stdout:1980: setattr oid 42 current snap is 205 2024-09-10T18:03:26.738 INFO:tasks.rados.rados.0.smithi012.stdout:1981: setattr oid 24 current snap is 205 2024-09-10T18:03:26.741 INFO:tasks.rados.rados.0.smithi012.stdout:1982: read oid 23 snap 203 2024-09-10T18:03:26.741 INFO:tasks.rados.rados.0.smithi012.stdout:1982: expect (ObjNum 611 snap 202 seq_num 611) 2024-09-10T18:03:26.741 INFO:tasks.rados.rados.0.smithi012.stdout:1983: delete oid 38 current snap is 205 2024-09-10T18:03:26.749 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 769 (ObjNum 4113 snap 0 seq_num 1500090327) dirty exists 2024-09-10T18:03:26.750 INFO:tasks.rados.rados.0.smithi012.stdout:1981: done (3 left) 2024-09-10T18:03:26.751 INFO:tasks.rados.rados.0.smithi012.stdout:1983: done (2 left) 2024-09-10T18:03:26.751 INFO:tasks.rados.rados.0.smithi012.stdout:1984: snap_create 2024-09-10T18:03:26.752 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1326 (ObjNum 617 snap 203 seq_num 617) dirty exists 2024-09-10T18:03:26.755 INFO:tasks.rados.rados.0.smithi012.stdout:1982: expect (ObjNum 611 snap 202 seq_num 611) 2024-09-10T18:03:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:26 smithi012 ceph-mon[89611]: pgmap v387: 121 pgs: 121 active+clean; 323 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 920 KiB/s wr, 22 op/s 2024-09-10T18:03:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:26 smithi012 ceph-mon[89611]: osdmap e478: 8 total, 8 up, 8 in 2024-09-10T18:03:27.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:26 smithi012 ceph-mon[92029]: pgmap v387: 121 pgs: 121 active+clean; 323 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 920 KiB/s wr, 22 op/s 2024-09-10T18:03:27.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:26 smithi012 ceph-mon[92029]: osdmap e478: 8 total, 8 up, 8 in 2024-09-10T18:03:27.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:27.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:26 smithi089 ceph-mon[84132]: pgmap v387: 121 pgs: 121 active+clean; 323 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 920 KiB/s wr, 22 op/s 2024-09-10T18:03:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:26 smithi089 ceph-mon[84132]: osdmap e478: 8 total, 8 up, 8 in 2024-09-10T18:03:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:26 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:27.716 INFO:tasks.rados.rados.0.smithi012.stdout:1980: done (2 left) 2024-09-10T18:03:27.716 INFO:tasks.rados.rados.0.smithi012.stdout:1982: done (1 left) 2024-09-10T18:03:27.716 INFO:tasks.rados.rados.0.smithi012.stdout:1984: done (0 left) 2024-09-10T18:03:27.716 INFO:tasks.rados.rados.0.smithi012.stdout:1985: delete oid 8 current snap is 206 2024-09-10T18:03:27.720 INFO:tasks.rados.rados.0.smithi012.stdout:1985: done (0 left) 2024-09-10T18:03:27.720 INFO:tasks.rados.rados.0.smithi012.stdout:1986: rollback oid 13 current snap is 206 2024-09-10T18:03:27.720 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 13 to 192 2024-09-10T18:03:27.720 INFO:tasks.rados.rados.0.smithi012.stdout:1987: snap_create 2024-09-10T18:03:27.725 INFO:tasks.rados.rados.0.smithi012.stdout:1986: finishing rollback tid 0 to smithi01278544-13 2024-09-10T18:03:27.726 INFO:tasks.rados.rados.0.smithi012.stdout:1986: finishing rollback tid 1 to smithi01278544-13 2024-09-10T18:03:27.726 INFO:tasks.rados.rados.0.smithi012.stdout:1986: finishing rollback tid 2 to smithi01278544-13 2024-09-10T18:03:27.726 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 885 (ObjNum 114385 snap 0 seq_num 3200230512) dirty exists 2024-09-10T18:03:28.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:27 smithi012 ceph-mon[89611]: osdmap e479: 8 total, 8 up, 8 in 2024-09-10T18:03:28.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:27 smithi012 ceph-mon[89611]: osdmap e480: 8 total, 8 up, 8 in 2024-09-10T18:03:28.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:27 smithi012 ceph-mon[92029]: osdmap e479: 8 total, 8 up, 8 in 2024-09-10T18:03:28.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:27 smithi012 ceph-mon[92029]: osdmap e480: 8 total, 8 up, 8 in 2024-09-10T18:03:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:27 smithi089 ceph-mon[84132]: osdmap e479: 8 total, 8 up, 8 in 2024-09-10T18:03:28.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:27 smithi089 ceph-mon[84132]: osdmap e480: 8 total, 8 up, 8 in 2024-09-10T18:03:28.718 INFO:tasks.rados.rados.0.smithi012.stdout:1986: done (1 left) 2024-09-10T18:03:28.718 INFO:tasks.rados.rados.0.smithi012.stdout:1987: done (0 left) 2024-09-10T18:03:28.718 INFO:tasks.rados.rados.0.smithi012.stdout:1988: snap_remove snap 204 2024-09-10T18:03:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:28 smithi012 ceph-mon[89611]: pgmap v390: 121 pgs: 121 active+clean; 327 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-09-10T18:03:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:28 smithi012 ceph-mon[89611]: osdmap e481: 8 total, 8 up, 8 in 2024-09-10T18:03:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:28 smithi012 ceph-mon[92029]: pgmap v390: 121 pgs: 121 active+clean; 327 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-09-10T18:03:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:28 smithi012 ceph-mon[92029]: osdmap e481: 8 total, 8 up, 8 in 2024-09-10T18:03:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:28 smithi089 ceph-mon[84132]: pgmap v390: 121 pgs: 121 active+clean; 327 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-09-10T18:03:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:28 smithi089 ceph-mon[84132]: osdmap e481: 8 total, 8 up, 8 in 2024-09-10T18:03:29.727 INFO:tasks.rados.rados.0.smithi012.stdout:1988: done (0 left) 2024-09-10T18:03:29.727 INFO:tasks.rados.rados.0.smithi012.stdout:1989: copy_from oid 10 from oid 48 current snap is 207 2024-09-10T18:03:29.728 INFO:tasks.rados.rados.0.smithi012.stdout:1990: snap_create 2024-09-10T18:03:29.744 INFO:tasks.rados.rados.0.smithi012.stdout:1989: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:03:29.747 INFO:tasks.rados.rados.0.smithi012.stdout:1989: finishing copy_from to smithi01278544-10 2024-09-10T18:03:29.747 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 699 (ObjNum 508 snap 172 seq_num 508) dirty exists 2024-09-10T18:03:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-10T18:03:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:29 smithi012 ceph-mon[89611]: osdmap e482: 8 total, 8 up, 8 in 2024-09-10T18:03:30.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-10T18:03:30.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:29 smithi012 ceph-mon[92029]: osdmap e482: 8 total, 8 up, 8 in 2024-09-10T18:03:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-10T18:03:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:29 smithi089 ceph-mon[84132]: osdmap e482: 8 total, 8 up, 8 in 2024-09-10T18:03:30.721 INFO:tasks.rados.rados.0.smithi012.stdout:1989: done (1 left) 2024-09-10T18:03:30.721 INFO:tasks.rados.rados.0.smithi012.stdout:1990: done (0 left) 2024-09-10T18:03:30.721 INFO:tasks.rados.rados.0.smithi012.stdout:1991: read oid 11 snap -1 2024-09-10T18:03:30.721 INFO:tasks.rados.rados.0.smithi012.stdout:1991: expect (ObjNum 623 snap 205 seq_num 623) 2024-09-10T18:03:30.721 INFO:tasks.rados.rados.0.smithi012.stdout:1992: read oid 12 snap -1 2024-09-10T18:03:30.721 INFO:tasks.rados.rados.0.smithi012.stdout:1992: expect deleted 2024-09-10T18:03:30.722 INFO:tasks.rados.rados.0.smithi012.stdout:1993: delete oid 31 current snap is 208 2024-09-10T18:03:30.725 INFO:tasks.rados.rados.0.smithi012.stdout:1992: done (2 left) 2024-09-10T18:03:30.725 INFO:tasks.rados.rados.0.smithi012.stdout:1993: done (1 left) 2024-09-10T18:03:30.725 INFO:tasks.rados.rados.0.smithi012.stdout:1994: read oid 27 snap -1 2024-09-10T18:03:30.725 INFO:tasks.rados.rados.0.smithi012.stdout:1994: expect deleted 2024-09-10T18:03:30.725 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 208 2024-09-10T18:03:30.725 INFO:tasks.rados.rados.0.smithi012.stdout:1995: seq_num 630 ranges {0=557056,557056=401408} 2024-09-10T18:03:30.728 INFO:tasks.rados.rados.0.smithi012.stdout:1995: writing smithi01278544-22 from 0 to 557056 tid 1 2024-09-10T18:03:30.731 INFO:tasks.rados.rados.0.smithi012.stdout:1995: writing smithi01278544-22 from 557056 to 958464 tid 2 2024-09-10T18:03:30.731 INFO:tasks.rados.rados.0.smithi012.stdout:1996: read oid 35 snap -1 2024-09-10T18:03:30.731 INFO:tasks.rados.rados.0.smithi012.stdout:1996: expect (ObjNum 612 snap 202 seq_num 612) 2024-09-10T18:03:30.731 INFO:tasks.rados.rados.0.smithi012.stdout:1997: rollback oid 48 current snap is 208 2024-09-10T18:03:30.731 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 48 to 205 2024-09-10T18:03:30.731 INFO:tasks.rados.rados.0.smithi012.stdout:1991: expect (ObjNum 623 snap 205 seq_num 623) 2024-09-10T18:03:30.758 INFO:tasks.rados.rados.0.smithi012.stdout:1991: done (4 left) 2024-09-10T18:03:30.758 INFO:tasks.rados.rados.0.smithi012.stdout:1994: done (3 left) 2024-09-10T18:03:30.758 INFO:tasks.rados.rados.0.smithi012.stdout:1998: delete oid 2 current snap is 208 2024-09-10T18:03:30.758 INFO:tasks.rados.rados.0.smithi012.stdout:1995: finishing write tid 1 to smithi01278544-22 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1997: finishing rollback tid 0 to smithi01278544-48 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1997: finishing rollback tid 1 to smithi01278544-48 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1997: finishing rollback tid 2 to smithi01278544-48 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 1110 (ObjNum 508 snap 172 seq_num 508) dirty exists 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1995: finishing write tid 2 to smithi01278544-22 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1995: finishing write tid 3 to smithi01278544-22 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1995: finishing write tid 4 to smithi01278544-22 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1995: oid 22 updating version 0 to 1396 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1995: oid 22 version 1396 is already newer than 1395 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1995: oid 22 version 1396 is already newer than 1394 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1396 (ObjNum 630 snap 208 seq_num 630) dirty exists 2024-09-10T18:03:30.759 INFO:tasks.rados.rados.0.smithi012.stdout:1995: left oid 22 (ObjNum 630 snap 208 seq_num 630) 2024-09-10T18:03:30.762 INFO:tasks.rados.rados.0.smithi012.stdout:1995: done (3 left) 2024-09-10T18:03:30.762 INFO:tasks.rados.rados.0.smithi012.stdout:1997: done (2 left) 2024-09-10T18:03:30.762 INFO:tasks.rados.rados.0.smithi012.stdout:1998: done (1 left) 2024-09-10T18:03:30.762 INFO:tasks.rados.rados.0.smithi012.stdout:1999: snap_create 2024-09-10T18:03:30.771 INFO:tasks.rados.rados.0.smithi012.stdout:1996: expect (ObjNum 612 snap 202 seq_num 612) 2024-09-10T18:03:30.895 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:30 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-10T18:03:30.895 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:30 smithi089 ceph-mon[84132]: Upgrade: osd.6 is safe to restart 2024-09-10T18:03:30.896 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:30 smithi089 ceph-mon[84132]: pgmap v393: 121 pgs: 121 active+clean; 335 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 21 op/s 2024-09-10T18:03:30.896 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:30.896 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T18:03:30.896 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:30.896 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:30 smithi089 ceph-mon[84132]: osdmap e483: 8 total, 8 up, 8 in 2024-09-10T18:03:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-10T18:03:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[89611]: Upgrade: osd.6 is safe to restart 2024-09-10T18:03:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[89611]: pgmap v393: 121 pgs: 121 active+clean; 335 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 21 op/s 2024-09-10T18:03:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[89611]: osdmap e483: 8 total, 8 up, 8 in 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[92029]: Upgrade: osd.6 is safe to restart 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[92029]: pgmap v393: 121 pgs: 121 active+clean; 335 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.2 MiB/s wr, 21 op/s 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:30 smithi012 ceph-mon[92029]: osdmap e483: 8 total, 8 up, 8 in 2024-09-10T18:03:31.770 INFO:tasks.rados.rados.0.smithi012.stdout:1996: done (1 left) 2024-09-10T18:03:31.771 INFO:tasks.rados.rados.0.smithi012.stdout:1999: done (0 left) 2024-09-10T18:03:31.771 INFO:tasks.rados.rados.0.smithi012.stdout:2000: copy_from oid 25 from oid 32 current snap is 209 2024-09-10T18:03:31.771 INFO:tasks.rados.rados.0.smithi012.stdout:2001: snap_create 2024-09-10T18:03:31.778 INFO:tasks.rados.rados.0.smithi012.stdout:2000: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:03:31.778 INFO:tasks.rados.rados.0.smithi012.stdout:2000: finishing copy_from to smithi01278544-25 2024-09-10T18:03:31.778 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1105 (ObjNum 600 snap 199 seq_num 600) dirty exists 2024-09-10T18:03:32.031 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:31 smithi089 ceph-mon[84132]: Upgrade: Updating osd.6 2024-09-10T18:03:32.031 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:31 smithi089 ceph-mon[84132]: Deploying daemon osd.6 on smithi089 2024-09-10T18:03:32.031 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:32.031 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:31 smithi012 ceph-mon[89611]: Upgrade: Updating osd.6 2024-09-10T18:03:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:31 smithi012 ceph-mon[89611]: Deploying daemon osd.6 on smithi089 2024-09-10T18:03:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:31 smithi012 ceph-mon[92029]: Upgrade: Updating osd.6 2024-09-10T18:03:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:31 smithi012 ceph-mon[92029]: Deploying daemon osd.6 on smithi089 2024-09-10T18:03:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:32.719 INFO:tasks.rados.rados.0.smithi012.stdout:2000: done (1 left) 2024-09-10T18:03:32.719 INFO:tasks.rados.rados.0.smithi012.stdout:2001: done (0 left) 2024-09-10T18:03:32.719 INFO:tasks.rados.rados.0.smithi012.stdout:2002: delete oid 44 current snap is 210 2024-09-10T18:03:32.723 INFO:tasks.rados.rados.0.smithi012.stdout:2002: done (0 left) 2024-09-10T18:03:32.723 INFO:tasks.rados.rados.0.smithi012.stdout:2003: copy_from oid 39 from oid 22 current snap is 210 2024-09-10T18:03:32.723 INFO:tasks.rados.rados.0.smithi012.stdout:2004: snap_remove snap 182 2024-09-10T18:03:33.025 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:32 smithi089 ceph-mon[84132]: pgmap v396: 121 pgs: 121 active+clean; 335 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 306 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T18:03:33.026 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:32 smithi089 ceph-mon[84132]: osdmap e484: 8 total, 8 up, 8 in 2024-09-10T18:03:33.026 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:32 smithi089 ceph-mon[84132]: osdmap e485: 8 total, 8 up, 8 in 2024-09-10T18:03:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:32 smithi012 ceph-mon[89611]: pgmap v396: 121 pgs: 121 active+clean; 335 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 306 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T18:03:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:32 smithi012 ceph-mon[89611]: osdmap e484: 8 total, 8 up, 8 in 2024-09-10T18:03:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:32 smithi012 ceph-mon[89611]: osdmap e485: 8 total, 8 up, 8 in 2024-09-10T18:03:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:32 smithi012 ceph-mon[92029]: pgmap v396: 121 pgs: 121 active+clean; 335 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 306 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-10T18:03:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:32 smithi012 ceph-mon[92029]: osdmap e484: 8 total, 8 up, 8 in 2024-09-10T18:03:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:32 smithi012 ceph-mon[92029]: osdmap e485: 8 total, 8 up, 8 in 2024-09-10T18:03:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:2003: finishing copy_from racing read to smithi01278544-39 2024-09-10T18:03:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:2003: finishing copy_from to smithi01278544-39 2024-09-10T18:03:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1396 (ObjNum 630 snap 208 seq_num 630) dirty exists 2024-09-10T18:03:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:2003: done (1 left) 2024-09-10T18:03:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:2004: done (0 left) 2024-09-10T18:03:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:2005: read oid 4 snap -1 2024-09-10T18:03:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:2005: expect (ObjNum 616 snap 203 seq_num 616) 2024-09-10T18:03:33.724 INFO:tasks.rados.rados.0.smithi012.stdout:2006: delete oid 24 current snap is 210 2024-09-10T18:03:33.728 INFO:tasks.rados.rados.0.smithi012.stdout:2006: done (1 left) 2024-09-10T18:03:33.728 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 210 2024-09-10T18:03:33.728 INFO:tasks.rados.rados.0.smithi012.stdout:2007: seq_num 634 ranges {7462912=622592,8085504=401408} 2024-09-10T18:03:33.748 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:33 smithi089 systemd[1]: Stopping Ceph osd.6 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:03:33.774 INFO:tasks.rados.rados.0.smithi012.stdout:2007: writing smithi01278544-42 from 7462912 to 8085504 tid 1 2024-09-10T18:03:33.776 INFO:tasks.rados.rados.0.smithi012.stdout:2007: writing smithi01278544-42 from 8085504 to 8486912 tid 2 2024-09-10T18:03:33.777 INFO:tasks.rados.rados.0.smithi012.stdout:2008: copy_from oid 1 from oid 8 current snap is 210 2024-09-10T18:03:33.777 INFO:tasks.rados.rados.0.smithi012.stdout:2005: expect (ObjNum 616 snap 203 seq_num 616) 2024-09-10T18:03:33.806 INFO:tasks.rados.rados.0.smithi012.stdout:2008: finishing copy_from to smithi01278544-1 2024-09-10T18:03:33.806 INFO:tasks.rados.rados.0.smithi012.stdout:2008: got expected ENOENT (src dne) 2024-09-10T18:03:33.806 INFO:tasks.rados.rados.0.smithi012.stdout:2008: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:03:33.806 INFO:tasks.rados.rados.0.smithi012.stdout:2007: finishing write tid 1 to smithi01278544-42 2024-09-10T18:03:33.806 INFO:tasks.rados.rados.0.smithi012.stdout:2007: finishing write tid 2 to smithi01278544-42 2024-09-10T18:03:33.806 INFO:tasks.rados.rados.0.smithi012.stdout:2007: finishing write tid 3 to smithi01278544-42 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2007: finishing write tid 4 to smithi01278544-42 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2007: oid 42 updating version 0 to 1352 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2007: oid 42 updating version 1352 to 1354 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2007: oid 42 version 1354 is already newer than 1353 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1354 (ObjNum 634 snap 210 seq_num 634) dirty exists 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2007: left oid 42 (ObjNum 634 snap 210 seq_num 634) 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2005: done (2 left) 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2007: done (1 left) 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2008: done (0 left) 2024-09-10T18:03:33.807 INFO:tasks.rados.rados.0.smithi012.stdout:2009: snap_create 2024-09-10T18:03:34.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[47693]: 2024-09-10T18:03:33.746+0000 7f04ec057640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:03:34.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[47693]: 2024-09-10T18:03:33.746+0000 7f04ec057640 -1 osd.6 486 *** Got signal Terminated *** 2024-09-10T18:03:34.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[47693]: 2024-09-10T18:03:33.746+0000 7f04ec057640 -1 osd.6 486 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:03:34.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:03:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:03:33] "GET /metrics HTTP/1.1" 200 36287 "" "Prometheus/2.43.0" 2024-09-10T18:03:34.734 INFO:tasks.rados.rados.0.smithi012.stdout:2009: done (0 left) 2024-09-10T18:03:34.734 INFO:tasks.rados.rados.0.smithi012.stdout:2010: delete oid 42 current snap is 211 2024-09-10T18:03:34.745 INFO:tasks.rados.rados.0.smithi012.stdout:2010: done (0 left) 2024-09-10T18:03:34.745 INFO:tasks.rados.rados.0.smithi012.stdout:2011: delete oid 48 current snap is 211 2024-09-10T18:03:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:34 smithi012 ceph-mon[89611]: pgmap v399: 121 pgs: 121 active+clean; 339 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-10T18:03:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:34 smithi012 ceph-mon[89611]: osdmap e486: 8 total, 8 up, 8 in 2024-09-10T18:03:35.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:34 smithi012 ceph-mon[89611]: osd.6 marked itself down and dead 2024-09-10T18:03:35.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:34 smithi012 ceph-mon[92029]: pgmap v399: 121 pgs: 121 active+clean; 339 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-10T18:03:35.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:34 smithi012 ceph-mon[92029]: osdmap e486: 8 total, 8 up, 8 in 2024-09-10T18:03:35.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:34 smithi012 ceph-mon[92029]: osd.6 marked itself down and dead 2024-09-10T18:03:35.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:34 smithi089 ceph-mon[84132]: pgmap v399: 121 pgs: 121 active+clean; 339 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-10T18:03:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:34 smithi089 ceph-mon[84132]: osdmap e486: 8 total, 8 up, 8 in 2024-09-10T18:03:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:34 smithi089 ceph-mon[84132]: osd.6 marked itself down and dead 2024-09-10T18:03:35.547 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:35 smithi089 podman[98575]: 2024-09-10 18:03:35.288513058 +0000 UTC m=+1.680192801 container died 63c1a65123fcb0b2190b2a887648dbe15b399aa09c892adb00fe0b4a64bf7671 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T18:03:35.755 INFO:tasks.rados.rados.0.smithi012.stdout:2011: done (0 left) 2024-09-10T18:03:35.755 INFO:tasks.rados.rados.0.smithi012.stdout:2012: rollback oid 47 current snap is 211 2024-09-10T18:03:35.755 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 179 2024-09-10T18:03:35.755 INFO:tasks.rados.rados.0.smithi012.stdout:2013: read oid 15 snap -1 2024-09-10T18:03:35.755 INFO:tasks.rados.rados.0.smithi012.stdout:2013: expect (ObjNum 607 snap 200 seq_num 607) 2024-09-10T18:03:35.755 INFO:tasks.rados.rados.0.smithi012.stdout:2014: setattr oid 4 current snap is 211 2024-09-10T18:03:35.756 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 211 2024-09-10T18:03:35.756 INFO:tasks.rados.rados.0.smithi012.stdout:2015: seq_num 637 ranges {6897664=671744,7569408=401408} 2024-09-10T18:03:35.798 INFO:tasks.rados.rados.0.smithi012.stdout:2015: writing smithi01278544-29 from 6897664 to 7569408 tid 1 2024-09-10T18:03:35.800 INFO:tasks.rados.rados.0.smithi012.stdout:2015: writing smithi01278544-29 from 7569408 to 7970816 tid 2 2024-09-10T18:03:35.800 INFO:tasks.rados.rados.0.smithi012.stdout:2016: snap_remove snap 184 2024-09-10T18:03:35.923 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:35 smithi089 ceph-mon[84132]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:03:35.923 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:35 smithi089 ceph-mon[84132]: osdmap e487: 8 total, 7 up, 8 in 2024-09-10T18:03:35.923 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:35 smithi089 podman[98575]: 2024-09-10 18:03:35.704121961 +0000 UTC m=+2.095801739 container cleanup 63c1a65123fcb0b2190b2a887648dbe15b399aa09c892adb00fe0b4a64bf7671 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=reef-7a853b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:03:35.923 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:35 smithi089 bash[98575]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6 2024-09-10T18:03:36.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:35 smithi012 ceph-mon[89611]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:03:36.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:35 smithi012 ceph-mon[89611]: osdmap e487: 8 total, 7 up, 8 in 2024-09-10T18:03:36.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:35 smithi012 ceph-mon[92029]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:03:36.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:35 smithi012 ceph-mon[92029]: osdmap e487: 8 total, 7 up, 8 in 2024-09-10T18:03:36.286 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:35 smithi089 podman[98592]: 2024-09-10 18:03:35.922386866 +0000 UTC m=+0.626464420 container remove 63c1a65123fcb0b2190b2a887648dbe15b399aa09c892adb00fe0b4a64bf7671 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=reef-7a853b1, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T18:03:36.643 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:36 smithi089 podman[98679]: 2024-09-10 18:03:36.234619216 +0000 UTC m=+0.015894851 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:03:36.643 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:36 smithi089 podman[98679]: 2024-09-10 18:03:36.415020323 +0000 UTC m=+0.196295990 container create 350aaef7a1805107474dfbcc13949f9e83449b1b4d34b3ddbba59aeeb3e7b558 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:03:36.748 INFO:tasks.rados.rados.0.smithi012.stdout:2016: done (4 left) 2024-09-10T18:03:36.748 INFO:tasks.rados.rados.0.smithi012.stdout:2017: snap_create 2024-09-10T18:03:36.749 INFO:tasks.rados.rados.0.smithi012.stdout:2013: expect (ObjNum 607 snap 200 seq_num 607) 2024-09-10T18:03:36.774 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 888 (ObjNum 616 snap 203 seq_num 616) dirty exists 2024-09-10T18:03:36.774 INFO:tasks.rados.rados.0.smithi012.stdout:2012: finishing rollback tid 0 to smithi01278544-47 2024-09-10T18:03:36.774 INFO:tasks.rados.rados.0.smithi012.stdout:2012: finishing rollback tid 1 to smithi01278544-47 2024-09-10T18:03:36.774 INFO:tasks.rados.rados.0.smithi012.stdout:2012: finishing rollback tid 2 to smithi01278544-47 2024-09-10T18:03:36.774 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1360 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:03:36.774 INFO:tasks.rados.rados.0.smithi012.stdout:2015: finishing write tid 1 to smithi01278544-29 2024-09-10T18:03:36.775 INFO:tasks.rados.rados.0.smithi012.stdout:2015: finishing write tid 2 to smithi01278544-29 2024-09-10T18:03:36.775 INFO:tasks.rados.rados.0.smithi012.stdout:2015: finishing write tid 3 to smithi01278544-29 2024-09-10T18:03:36.775 INFO:tasks.rados.rados.0.smithi012.stdout:2015: finishing write tid 4 to smithi01278544-29 2024-09-10T18:03:36.775 INFO:tasks.rados.rados.0.smithi012.stdout:2015: oid 29 updating version 0 to 754 2024-09-10T18:03:36.775 INFO:tasks.rados.rados.0.smithi012.stdout:2015: oid 29 updating version 754 to 755 2024-09-10T18:03:36.775 INFO:tasks.rados.rados.0.smithi012.stdout:2015: oid 29 updating version 755 to 756 2024-09-10T18:03:36.775 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 756 (ObjNum 637 snap 211 seq_num 637) dirty exists 2024-09-10T18:03:36.775 INFO:tasks.rados.rados.0.smithi012.stdout:2015: left oid 29 (ObjNum 637 snap 211 seq_num 637) 2024-09-10T18:03:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:36 smithi012 ceph-mon[89611]: pgmap v402: 121 pgs: 1 active+clean+snaptrim, 14 stale+active+clean, 106 active+clean; 339 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-10T18:03:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:36 smithi012 ceph-mon[89611]: osdmap e488: 8 total, 7 up, 8 in 2024-09-10T18:03:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:36 smithi012 ceph-mon[92029]: pgmap v402: 121 pgs: 1 active+clean+snaptrim, 14 stale+active+clean, 106 active+clean; 339 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-10T18:03:37.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:36 smithi012 ceph-mon[92029]: osdmap e488: 8 total, 7 up, 8 in 2024-09-10T18:03:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:36 smithi089 ceph-mon[84132]: pgmap v402: 121 pgs: 1 active+clean+snaptrim, 14 stale+active+clean, 106 active+clean; 339 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-10T18:03:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:36 smithi089 ceph-mon[84132]: osdmap e488: 8 total, 7 up, 8 in 2024-09-10T18:03:37.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:36 smithi089 podman[98679]: 2024-09-10 18:03:36.642613312 +0000 UTC m=+0.423888946 container init 350aaef7a1805107474dfbcc13949f9e83449b1b4d34b3ddbba59aeeb3e7b558 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T18:03:37.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:36 smithi089 podman[98679]: 2024-09-10 18:03:36.646090672 +0000 UTC m=+0.427366305 container start 350aaef7a1805107474dfbcc13949f9e83449b1b4d34b3ddbba59aeeb3e7b558 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:03:37.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:36 smithi089 podman[98679]: 2024-09-10 18:03:36.742814011 +0000 UTC m=+0.524089645 container attach 350aaef7a1805107474dfbcc13949f9e83449b1b4d34b3ddbba59aeeb3e7b558 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T18:03:37.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:36 smithi089 podman[98679]: 2024-09-10 18:03:36.844903757 +0000 UTC m=+0.626179392 container died 350aaef7a1805107474dfbcc13949f9e83449b1b4d34b3ddbba59aeeb3e7b558 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T18:03:37.719 INFO:tasks.rados.rados.0.smithi012.stdout:2012: done (4 left) 2024-09-10T18:03:37.719 INFO:tasks.rados.rados.0.smithi012.stdout:2013: done (3 left) 2024-09-10T18:03:37.719 INFO:tasks.rados.rados.0.smithi012.stdout:2014: done (2 left) 2024-09-10T18:03:37.720 INFO:tasks.rados.rados.0.smithi012.stdout:2015: done (1 left) 2024-09-10T18:03:37.720 INFO:tasks.rados.rados.0.smithi012.stdout:2017: done (0 left) 2024-09-10T18:03:37.720 INFO:tasks.rados.rados.0.smithi012.stdout:2018: delete oid 38 current snap is 212 2024-09-10T18:03:37.724 INFO:tasks.rados.rados.0.smithi012.stdout:2018: done (0 left) 2024-09-10T18:03:37.724 INFO:tasks.rados.rados.0.smithi012.stdout:2019: snap_remove snap 203 2024-09-10T18:03:37.999 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:37 smithi089 ceph-mon[84132]: osdmap e489: 8 total, 7 up, 8 in 2024-09-10T18:03:38.000 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:37 smithi089 ceph-mon[84132]: osdmap e490: 8 total, 7 up, 8 in 2024-09-10T18:03:38.000 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:37 smithi089 podman[98702]: 2024-09-10 18:03:37.555402903 +0000 UTC m=+0.699300227 container remove 350aaef7a1805107474dfbcc13949f9e83449b1b4d34b3ddbba59aeeb3e7b558 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:03:38.000 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:37 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.6.service: Deactivated successfully. 2024-09-10T18:03:38.000 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:37 smithi089 systemd[1]: Stopped Ceph osd.6 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:03:38.000 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:37 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.6.service: Consumed 14.172s CPU time. 2024-09-10T18:03:38.000 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:37 smithi089 systemd[1]: Starting Ceph osd.6 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:03:38.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:37 smithi012 ceph-mon[89611]: osdmap e489: 8 total, 7 up, 8 in 2024-09-10T18:03:38.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:37 smithi012 ceph-mon[89611]: osdmap e490: 8 total, 7 up, 8 in 2024-09-10T18:03:38.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:37 smithi012 ceph-mon[92029]: osdmap e489: 8 total, 7 up, 8 in 2024-09-10T18:03:38.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:37 smithi012 ceph-mon[92029]: osdmap e490: 8 total, 7 up, 8 in 2024-09-10T18:03:38.286 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:37 smithi089 podman[98799]: 2024-09-10 18:03:37.998514683 +0000 UTC m=+0.109314329 container create 8968f732c384368c0376ee07c938e04e2ed076fc23e76fd7ce3573ed91ad6e9f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T18:03:38.286 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 podman[98799]: 2024-09-10 18:03:37.905371467 +0000 UTC m=+0.016171084 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:03:38.286 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 podman[98799]: 2024-09-10 18:03:38.234732524 +0000 UTC m=+0.345532137 container init 8968f732c384368c0376ee07c938e04e2ed076fc23e76fd7ce3573ed91ad6e9f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T18:03:38.286 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 podman[98799]: 2024-09-10 18:03:38.238528661 +0000 UTC m=+0.349328277 container start 8968f732c384368c0376ee07c938e04e2ed076fc23e76fd7ce3573ed91ad6e9f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T18:03:38.723 INFO:tasks.rados.rados.0.smithi012.stdout:2019: done (0 left) 2024-09-10T18:03:38.723 INFO:tasks.rados.rados.0.smithi012.stdout:2020: rmattr oid 12 current snap is 212 2024-09-10T18:03:38.723 INFO:tasks.rados.rados.0.smithi012.stdout:2020: done (0 left) 2024-09-10T18:03:38.723 INFO:tasks.rados.rados.0.smithi012.stdout:2021: snap_remove snap 210 2024-09-10T18:03:38.751 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 podman[98799]: 2024-09-10 18:03:38.317903171 +0000 UTC m=+0.428702780 container attach 8968f732c384368c0376ee07c938e04e2ed076fc23e76fd7ce3573ed91ad6e9f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T18:03:38.751 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:03:38.751 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 bash[98799]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:03:38.752 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:03:38.752 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 bash[98799]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:03:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:38 smithi012 ceph-mon[89611]: pgmap v405: 121 pgs: 18 active+undersized, 1 active+clean+snaptrim, 9 stale+active+clean, 6 active+undersized+degraded, 87 active+clean; 352 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 5 op/s; 56/690 objects degraded (8.116%) 2024-09-10T18:03:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:38 smithi012 ceph-mon[89611]: Health check failed: Degraded data redundancy: 56/690 objects degraded (8.116%), 6 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:38 smithi012 ceph-mon[89611]: osdmap e491: 8 total, 7 up, 8 in 2024-09-10T18:03:39.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:38 smithi012 ceph-mon[92029]: pgmap v405: 121 pgs: 18 active+undersized, 1 active+clean+snaptrim, 9 stale+active+clean, 6 active+undersized+degraded, 87 active+clean; 352 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 5 op/s; 56/690 objects degraded (8.116%) 2024-09-10T18:03:39.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:38 smithi012 ceph-mon[92029]: Health check failed: Degraded data redundancy: 56/690 objects degraded (8.116%), 6 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:39.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:38 smithi012 ceph-mon[92029]: osdmap e491: 8 total, 7 up, 8 in 2024-09-10T18:03:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:38 smithi089 ceph-mon[84132]: pgmap v405: 121 pgs: 18 active+undersized, 1 active+clean+snaptrim, 9 stale+active+clean, 6 active+undersized+degraded, 87 active+clean; 352 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 5 op/s; 56/690 objects degraded (8.116%) 2024-09-10T18:03:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:38 smithi089 ceph-mon[84132]: Health check failed: Degraded data redundancy: 56/690 objects degraded (8.116%), 6 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:38 smithi089 ceph-mon[84132]: osdmap e491: 8 total, 7 up, 8 in 2024-09-10T18:03:39.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T18:03:39.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 bash[98799]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T18:03:39.037 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T18:03:39.037 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:38 smithi089 bash[98799]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T18:03:39.522 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T18:03:39.522 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 bash[98799]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T18:03:39.522 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T18:03:39.523 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 bash[98799]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T18:03:39.523 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-10T18:03:39.523 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 bash[98799]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-10T18:03:39.523 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T18:03:39.523 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 bash[98799]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T18:03:39.523 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate[98814]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-10T18:03:39.523 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 bash[98799]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-10T18:03:39.523 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 podman[98799]: 2024-09-10 18:03:39.158360334 +0000 UTC m=+1.269159947 container died 8968f732c384368c0376ee07c938e04e2ed076fc23e76fd7ce3573ed91ad6e9f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux ) 2024-09-10T18:03:39.727 INFO:tasks.rados.rados.0.smithi012.stdout:2021: done (0 left) 2024-09-10T18:03:39.727 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 212 2024-09-10T18:03:39.727 INFO:tasks.rados.rados.0.smithi012.stdout:2022: seq_num 639 ranges {32768=704512,737280=401408} 2024-09-10T18:03:39.731 INFO:tasks.rados.rados.0.smithi012.stdout:2022: writing smithi01278544-34 from 32768 to 737280 tid 1 2024-09-10T18:03:39.734 INFO:tasks.rados.rados.0.smithi012.stdout:2022: writing smithi01278544-34 from 737280 to 1138688 tid 2 2024-09-10T18:03:39.734 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 212 2024-09-10T18:03:39.734 INFO:tasks.rados.rados.0.smithi012.stdout:2023: seq_num 640 ranges {0=729088,729088=401408} 2024-09-10T18:03:39.739 INFO:tasks.rados.rados.0.smithi012.stdout:2023: writing smithi01278544-38 from 0 to 729088 tid 1 2024-09-10T18:03:39.742 INFO:tasks.rados.rados.0.smithi012.stdout:2023: writing smithi01278544-38 from 729088 to 1130496 tid 2 2024-09-10T18:03:39.742 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 212 2024-09-10T18:03:39.742 INFO:tasks.rados.rados.0.smithi012.stdout:2024: seq_num 641 ranges {417792=745472,1163264=401408} 2024-09-10T18:03:39.749 INFO:tasks.rados.rados.0.smithi012.stdout:2024: writing smithi01278544-1 from 417792 to 1163264 tid 1 2024-09-10T18:03:39.752 INFO:tasks.rados.rados.0.smithi012.stdout:2024: writing smithi01278544-1 from 1163264 to 1564672 tid 2 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2025: rollback oid 33 current snap is 212 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 33 to 200 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2022: finishing write tid 1 to smithi01278544-34 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2022: finishing write tid 2 to smithi01278544-34 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2022: finishing write tid 3 to smithi01278544-34 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2023: finishing write tid 1 to smithi01278544-38 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2022: finishing write tid 4 to smithi01278544-34 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2022: oid 34 updating version 0 to 883 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2022: oid 34 version 883 is already newer than 882 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2022: oid 34 version 883 is already newer than 881 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 883 (ObjNum 639 snap 212 seq_num 639) dirty exists 2024-09-10T18:03:39.753 INFO:tasks.rados.rados.0.smithi012.stdout:2022: left oid 34 (ObjNum 639 snap 212 seq_num 639) 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2023: finishing write tid 2 to smithi01278544-38 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2023: finishing write tid 3 to smithi01278544-38 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2023: finishing write tid 4 to smithi01278544-38 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2023: oid 38 updating version 0 to 1112 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2023: oid 38 updating version 1112 to 1114 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2023: oid 38 version 1114 is already newer than 1113 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1114 (ObjNum 640 snap 212 seq_num 640) dirty exists 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2023: left oid 38 (ObjNum 640 snap 212 seq_num 640) 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2022: done (3 left) 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2023: done (2 left) 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2026: rollback oid 9 current snap is 212 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 207 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2027: copy_from oid 7 from oid 35 current snap is 212 2024-09-10T18:03:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2028: read oid 47 snap -1 2024-09-10T18:03:39.755 INFO:tasks.rados.rados.0.smithi012.stdout:2028: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:39.755 INFO:tasks.rados.rados.0.smithi012.stdout:2029: copy_from oid 12 from oid 16 current snap is 212 2024-09-10T18:03:39.755 INFO:tasks.rados.rados.0.smithi012.stdout:2030: delete oid 23 current snap is 212 2024-09-10T18:03:39.755 INFO:tasks.rados.rados.0.smithi012.stdout:2029: finishing copy_from to smithi01278544-12 2024-09-10T18:03:39.755 INFO:tasks.rados.rados.0.smithi012.stdout:2029: got expected ENOENT (src dne) 2024-09-10T18:03:39.756 INFO:tasks.rados.rados.0.smithi012.stdout:2029: finishing copy_from racing read to smithi01278544-12 2024-09-10T18:03:39.756 INFO:tasks.rados.rados.0.smithi012.stdout:2024: finishing write tid 1 to smithi01278544-1 2024-09-10T18:03:39.756 INFO:tasks.rados.rados.0.smithi012.stdout:2024: finishing write tid 2 to smithi01278544-1 2024-09-10T18:03:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2024: finishing write tid 3 to smithi01278544-1 2024-09-10T18:03:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2029: done (6 left) 2024-09-10T18:03:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2030: done (5 left) 2024-09-10T18:03:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2031: copy_from oid 5 from oid 37 current snap is 212 2024-09-10T18:03:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2032: setattr oid 41 current snap is 212 2024-09-10T18:03:39.759 INFO:tasks.rados.rados.0.smithi012.stdout:2026: finishing rollback tid 1 to smithi01278544-9 2024-09-10T18:03:39.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1103 (ObjNum 129 snap 0 seq_num 3496647440) dirty dne 2024-09-10T18:03:39.759 INFO:tasks.rados.rados.0.smithi012.stdout:2024: finishing write tid 4 to smithi01278544-1 2024-09-10T18:03:39.759 INFO:tasks.rados.rados.0.smithi012.stdout:2024: oid 1 updating version 0 to 1116 2024-09-10T18:03:39.760 INFO:tasks.rados.rados.0.smithi012.stdout:2024: oid 1 version 1116 is already newer than 1115 2024-09-10T18:03:39.760 INFO:tasks.rados.rados.0.smithi012.stdout:2024: oid 1 updating version 1116 to 1117 2024-09-10T18:03:39.760 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1117 (ObjNum 641 snap 212 seq_num 641) dirty exists 2024-09-10T18:03:39.760 INFO:tasks.rados.rados.0.smithi012.stdout:2024: left oid 1 (ObjNum 641 snap 212 seq_num 641) 2024-09-10T18:03:39.761 INFO:tasks.rados.rados.0.smithi012.stdout:2024: done (6 left) 2024-09-10T18:03:39.761 INFO:tasks.rados.rados.0.smithi012.stdout:2026: done (5 left) 2024-09-10T18:03:39.761 INFO:tasks.rados.rados.0.smithi012.stdout:2033: read oid 3 snap -1 2024-09-10T18:03:39.761 INFO:tasks.rados.rados.0.smithi012.stdout:2033: expect (ObjNum 561 snap 186 seq_num 561) 2024-09-10T18:03:39.761 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 212 2024-09-10T18:03:39.761 INFO:tasks.rados.rados.0.smithi012.stdout:2034: seq_num 643 ranges {0=778240,778240=401408} 2024-09-10T18:03:39.765 INFO:tasks.rados.rados.0.smithi012.stdout:2034: writing smithi01278544-42 from 0 to 778240 tid 1 2024-09-10T18:03:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:2034: writing smithi01278544-42 from 778240 to 1179648 tid 2 2024-09-10T18:03:39.768 INFO:tasks.rados.rados.0.smithi012.stdout:2035: snap_remove snap 197 2024-09-10T18:03:40.074 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:39 smithi089 podman[98944]: 2024-09-10 18:03:39.805302763 +0000 UTC m=+0.640773796 container remove 8968f732c384368c0376ee07c938e04e2ed076fc23e76fd7ce3573ed91ad6e9f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T18:03:40.074 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:40 smithi089 podman[99005]: 2024-09-10 18:03:39.913590307 +0000 UTC m=+0.015611078 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:03:40.074 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:40 smithi089 podman[99005]: 2024-09-10 18:03:40.07313511 +0000 UTC m=+0.175155923 container create 71e430ee4ba6f6b93690f8591b25ab52a001811200e5d6df8ddb390d8bdf8645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T18:03:40.344 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:40 smithi089 podman[99005]: 2024-09-10 18:03:40.318577045 +0000 UTC m=+0.420597825 container init 71e430ee4ba6f6b93690f8591b25ab52a001811200e5d6df8ddb390d8bdf8645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux ) 2024-09-10T18:03:40.344 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:40 smithi089 podman[99005]: 2024-09-10 18:03:40.321815874 +0000 UTC m=+0.423836655 container start 71e430ee4ba6f6b93690f8591b25ab52a001811200e5d6df8ddb390d8bdf8645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T18:03:40.660 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:40 smithi089 ceph-osd[99023]: -- 172.21.15.89:0/1475088252 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557042e01a40 con 0x557043bd0400 2024-09-10T18:03:40.759 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 905 (ObjNum 33 snap 0 seq_num 3496508416) dirty exists 2024-09-10T18:03:40.759 INFO:tasks.rados.rados.0.smithi012.stdout:2027: finishing copy_from racing read to smithi01278544-7 2024-09-10T18:03:40.759 INFO:tasks.rados.rados.0.smithi012.stdout:2031: finishing copy_from racing read to smithi01278544-5 2024-09-10T18:03:40.759 INFO:tasks.rados.rados.0.smithi012.stdout:2033: expect (ObjNum 561 snap 186 seq_num 561) 2024-09-10T18:03:41.004 INFO:tasks.rados.rados.0.smithi012.stdout:2025: finishing rollback tid 1 to smithi01278544-33 2024-09-10T18:03:41.004 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 0 (ObjNum 33 snap 0 seq_num 3496774848) dirty dne 2024-09-10T18:03:41.004 INFO:tasks.rados.rados.0.smithi012.stdout:2027: finishing copy_from to smithi01278544-7 2024-09-10T18:03:41.004 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1107 (ObjNum 612 snap 202 seq_num 612) dirty exists 2024-09-10T18:03:41.005 INFO:tasks.rados.rados.0.smithi012.stdout:2028: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:40 smithi012 ceph-mon[89611]: pgmap v408: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 348 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 6 op/s; 96/693 objects degraded (13.853%) 2024-09-10T18:03:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:40 smithi012 ceph-mon[89611]: osdmap e492: 8 total, 7 up, 8 in 2024-09-10T18:03:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:40 smithi012 ceph-mon[92029]: pgmap v408: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 348 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 6 op/s; 96/693 objects degraded (13.853%) 2024-09-10T18:03:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:40 smithi012 ceph-mon[92029]: osdmap e492: 8 total, 7 up, 8 in 2024-09-10T18:03:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:41.035 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:40 smithi089 bash[99005]: 71e430ee4ba6f6b93690f8591b25ab52a001811200e5d6df8ddb390d8bdf8645 2024-09-10T18:03:41.035 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:40 smithi089 systemd[1]: Started Ceph osd.6 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:03:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:40 smithi089 ceph-mon[84132]: pgmap v408: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 348 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 6 op/s; 96/693 objects degraded (13.853%) 2024-09-10T18:03:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:40 smithi089 ceph-mon[84132]: osdmap e492: 8 total, 7 up, 8 in 2024-09-10T18:03:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:41 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:41 smithi012 ceph-mon[89611]: osdmap e493: 8 total, 7 up, 8 in 2024-09-10T18:03:42.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:41 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:42.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:41 smithi012 ceph-mon[92029]: osdmap e493: 8 total, 7 up, 8 in 2024-09-10T18:03:42.035 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:03:41.940+0000 7fad9f545640 -1 Falling back to public interface 2024-09-10T18:03:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:41 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:41 smithi089 ceph-mon[84132]: osdmap e493: 8 total, 7 up, 8 in 2024-09-10T18:03:42.400 INFO:tasks.rados.rados.0.smithi012.stdout:2031: finishing copy_from to smithi01278544-5 2024-09-10T18:03:42.400 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 879 (ObjNum 540 snap 182 seq_num 540) dirty exists 2024-09-10T18:03:42.400 INFO:tasks.rados.rados.0.smithi012.stdout:2034: finishing write tid 1 to smithi01278544-42 2024-09-10T18:03:42.400 INFO:tasks.rados.rados.0.smithi012.stdout:2034: finishing write tid 2 to smithi01278544-42 2024-09-10T18:03:42.400 INFO:tasks.rados.rados.0.smithi012.stdout:2034: finishing write tid 3 to smithi01278544-42 2024-09-10T18:03:42.400 INFO:tasks.rados.rados.0.smithi012.stdout:2034: finishing write tid 4 to smithi01278544-42 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2034: oid 42 updating version 0 to 1382 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2034: oid 42 version 1382 is already newer than 1380 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2034: oid 42 version 1382 is already newer than 1381 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1382 (ObjNum 643 snap 212 seq_num 643) dirty exists 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2034: left oid 42 (ObjNum 643 snap 212 seq_num 643) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2025: done (7 left) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2027: done (6 left) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2028: done (5 left) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2031: done (4 left) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2032: done (3 left) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2033: done (2 left) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2034: done (1 left) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2035: done (0 left) 2024-09-10T18:03:42.401 INFO:tasks.rados.rados.0.smithi012.stdout:2036: rollback oid 36 current snap is 212 2024-09-10T18:03:42.402 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 190 2024-09-10T18:03:42.402 INFO:tasks.rados.rados.0.smithi012.stdout:2037: read oid 33 snap -1 2024-09-10T18:03:42.402 INFO:tasks.rados.rados.0.smithi012.stdout:2037: expect deleted 2024-09-10T18:03:42.402 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 8 current snap is 212 2024-09-10T18:03:42.402 INFO:tasks.rados.rados.0.smithi012.stdout:2038: seq_num 644 ranges {0=794624,794624=401408} 2024-09-10T18:03:42.405 INFO:tasks.rados.rados.0.smithi012.stdout:2038: writing smithi01278544-8 from 0 to 794624 tid 1 2024-09-10T18:03:42.408 INFO:tasks.rados.rados.0.smithi012.stdout:2038: writing smithi01278544-8 from 794624 to 1196032 tid 2 2024-09-10T18:03:42.408 INFO:tasks.rados.rados.0.smithi012.stdout:2039: read oid 6 snap -1 2024-09-10T18:03:42.408 INFO:tasks.rados.rados.0.smithi012.stdout:2039: expect (ObjNum 570 snap 190 seq_num 570) 2024-09-10T18:03:42.408 INFO:tasks.rados.rados.0.smithi012.stdout:2040: read oid 35 snap 190 2024-09-10T18:03:42.408 INFO:tasks.rados.rados.0.smithi012.stdout:2040: expect (ObjNum 539 snap 182 seq_num 539) 2024-09-10T18:03:42.408 INFO:tasks.rados.rados.0.smithi012.stdout:2041: rollback oid 11 current snap is 212 2024-09-10T18:03:42.408 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 173 2024-09-10T18:03:42.408 INFO:tasks.rados.rados.0.smithi012.stdout:2036: finishing rollback tid 0 to smithi01278544-36 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2036: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2036: finishing rollback tid 2 to smithi01278544-36 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 773 (ObjNum 432 snap 143 seq_num 432) dirty exists 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2036: done (5 left) 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2037: done (4 left) 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2042: read oid 16 snap -1 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2042: expect deleted 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2043: copy_from oid 10 from oid 32 current snap is 212 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2044: read oid 1 snap -1 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2044: expect (ObjNum 641 snap 212 seq_num 641) 2024-09-10T18:03:42.409 INFO:tasks.rados.rados.0.smithi012.stdout:2045: setattr oid 44 current snap is 212 2024-09-10T18:03:42.410 INFO:tasks.rados.rados.0.smithi012.stdout:2038: finishing write tid 1 to smithi01278544-8 2024-09-10T18:03:42.410 INFO:tasks.rados.rados.0.smithi012.stdout:2038: finishing write tid 2 to smithi01278544-8 2024-09-10T18:03:42.410 INFO:tasks.rados.rados.0.smithi012.stdout:2046: copy_from oid 48 from oid 2 current snap is 212 2024-09-10T18:03:42.411 INFO:tasks.rados.rados.0.smithi012.stdout:2047: read oid 22 snap -1 2024-09-10T18:03:42.411 INFO:tasks.rados.rados.0.smithi012.stdout:2047: expect (ObjNum 630 snap 208 seq_num 630) 2024-09-10T18:03:42.411 INFO:tasks.rados.rados.0.smithi012.stdout:2048: copy_from oid 36 from oid 23 current snap is 212 2024-09-10T18:03:42.411 INFO:tasks.rados.rados.0.smithi012.stdout:2038: finishing write tid 3 to smithi01278544-8 2024-09-10T18:03:42.411 INFO:tasks.rados.rados.0.smithi012.stdout:2049: rmattr oid 42 current snap is 212 2024-09-10T18:03:42.411 INFO:tasks.rados.rados.0.smithi012.stdout:2049: done (11 left) 2024-09-10T18:03:42.411 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 212 2024-09-10T18:03:42.411 INFO:tasks.rados.rados.0.smithi012.stdout:2050: seq_num 645 ranges {9371648=409600,9781248=778240,10559488=24576} 2024-09-10T18:03:42.464 INFO:tasks.rados.rados.0.smithi012.stdout:2050: writing smithi01278544-14 from 9371648 to 9781248 tid 1 2024-09-10T18:03:42.469 INFO:tasks.rados.rados.0.smithi012.stdout:2050: writing smithi01278544-14 from 9781248 to 10559488 tid 2 2024-09-10T18:03:42.469 INFO:tasks.rados.rados.0.smithi012.stdout:2050: writing smithi01278544-14 from 10559488 to 10584064 tid 3 2024-09-10T18:03:42.469 INFO:tasks.rados.rados.0.smithi012.stdout:2051: rollback oid 46 current snap is 212 2024-09-10T18:03:42.469 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 209 2024-09-10T18:03:42.469 INFO:tasks.rados.rados.0.smithi012.stdout:2048: finishing copy_from to smithi01278544-36 2024-09-10T18:03:42.469 INFO:tasks.rados.rados.0.smithi012.stdout:2048: got expected ENOENT (src dne) 2024-09-10T18:03:42.469 INFO:tasks.rados.rados.0.smithi012.stdout:2048: finishing copy_from racing read to smithi01278544-36 2024-09-10T18:03:42.470 INFO:tasks.rados.rados.0.smithi012.stdout:2048: done (12 left) 2024-09-10T18:03:42.470 INFO:tasks.rados.rados.0.smithi012.stdout:2052: copy_from oid 12 from oid 26 current snap is 212 2024-09-10T18:03:42.470 INFO:tasks.rados.rados.0.smithi012.stdout:2041: finishing rollback tid 0 to smithi01278544-11 2024-09-10T18:03:42.470 INFO:tasks.rados.rados.0.smithi012.stdout:2041: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:03:42.470 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1414 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-09-10T18:03:42.470 INFO:tasks.rados.rados.0.smithi012.stdout:2044: expect (ObjNum 641 snap 212 seq_num 641) 2024-09-10T18:03:42.518 INFO:tasks.rados.rados.0.smithi012.stdout:2046: finishing copy_from to smithi01278544-48 2024-09-10T18:03:42.518 INFO:tasks.rados.rados.0.smithi012.stdout:2046: got expected ENOENT (src dne) 2024-09-10T18:03:42.518 INFO:tasks.rados.rados.0.smithi012.stdout:2046: finishing copy_from racing read to smithi01278544-48 2024-09-10T18:03:42.518 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1238 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-09-10T18:03:42.518 INFO:tasks.rados.rados.0.smithi012.stdout:2041: done (12 left) 2024-09-10T18:03:42.518 INFO:tasks.rados.rados.0.smithi012.stdout:2044: done (11 left) 2024-09-10T18:03:42.518 INFO:tasks.rados.rados.0.smithi012.stdout:2045: done (10 left) 2024-09-10T18:03:42.519 INFO:tasks.rados.rados.0.smithi012.stdout:2046: done (9 left) 2024-09-10T18:03:42.519 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 212 2024-09-10T18:03:42.519 INFO:tasks.rados.rados.0.smithi012.stdout:2047: expect (ObjNum 630 snap 208 seq_num 630) 2024-09-10T18:03:42.543 INFO:tasks.rados.rados.0.smithi012.stdout:2038: finishing write tid 4 to smithi01278544-8 2024-09-10T18:03:42.543 INFO:tasks.rados.rados.0.smithi012.stdout:2038: oid 8 updating version 0 to 1015 2024-09-10T18:03:42.543 INFO:tasks.rados.rados.0.smithi012.stdout:2038: oid 8 version 1015 is already newer than 1014 2024-09-10T18:03:42.543 INFO:tasks.rados.rados.0.smithi012.stdout:2038: oid 8 version 1015 is already newer than 1013 2024-09-10T18:03:42.543 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1015 (ObjNum 644 snap 212 seq_num 644) dirty exists 2024-09-10T18:03:42.544 INFO:tasks.rados.rados.0.smithi012.stdout:2038: left oid 8 (ObjNum 644 snap 212 seq_num 644) 2024-09-10T18:03:42.544 INFO:tasks.rados.rados.0.smithi012.stdout:2039: expect (ObjNum 570 snap 190 seq_num 570) 2024-09-10T18:03:42.901 INFO:tasks.rados.rados.0.smithi012.stdout:2043: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:03:42.901 INFO:tasks.rados.rados.0.smithi012.stdout:2043: finishing copy_from to smithi01278544-10 2024-09-10T18:03:42.901 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1105 (ObjNum 600 snap 199 seq_num 600) dirty exists 2024-09-10T18:03:42.902 INFO:tasks.rados.rados.0.smithi012.stdout:2040: expect (ObjNum 539 snap 182 seq_num 539) 2024-09-10T18:03:43.008 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:42 smithi089 ceph-mon[84132]: pgmap v411: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 348 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 11 op/s; 96/696 objects degraded (13.793%) 2024-09-10T18:03:43.008 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:42 smithi089 ceph-mon[84132]: osdmap e494: 8 total, 7 up, 8 in 2024-09-10T18:03:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:42 smithi012 ceph-mon[89611]: pgmap v411: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 348 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 11 op/s; 96/696 objects degraded (13.793%) 2024-09-10T18:03:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:42 smithi012 ceph-mon[89611]: osdmap e494: 8 total, 7 up, 8 in 2024-09-10T18:03:43.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:42 smithi012 ceph-mon[92029]: pgmap v411: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 348 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 11 op/s; 96/696 objects degraded (13.793%) 2024-09-10T18:03:43.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:42 smithi012 ceph-mon[92029]: osdmap e494: 8 total, 7 up, 8 in 2024-09-10T18:03:43.329 INFO:tasks.rados.rados.0.smithi012.stdout:2050: finishing write tid 1 to smithi01278544-14 2024-09-10T18:03:43.329 INFO:tasks.rados.rados.0.smithi012.stdout:2052: finishing copy_from racing read to smithi01278544-12 2024-09-10T18:03:43.329 INFO:tasks.rados.rados.0.smithi012.stdout:2052: finishing copy_from to smithi01278544-12 2024-09-10T18:03:43.329 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 768 (ObjNum 575 snap 192 seq_num 575) dirty exists 2024-09-10T18:03:43.329 INFO:tasks.rados.rados.0.smithi012.stdout:2051: finishing rollback tid 0 to smithi01278544-46 2024-09-10T18:03:43.329 INFO:tasks.rados.rados.0.smithi012.stdout:2051: finishing rollback tid 1 to smithi01278544-46 2024-09-10T18:03:43.329 INFO:tasks.rados.rados.0.smithi012.stdout:2050: finishing write tid 2 to smithi01278544-14 2024-09-10T18:03:43.329 INFO:tasks.rados.rados.0.smithi012.stdout:2051: finishing rollback tid 2 to smithi01278544-46 2024-09-10T18:03:43.330 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1241 (ObjNum 625 snap 205 seq_num 625) dirty exists 2024-09-10T18:03:43.330 INFO:tasks.rados.rados.0.smithi012.stdout:2050: finishing write tid 3 to smithi01278544-14 2024-09-10T18:03:43.330 INFO:tasks.rados.rados.0.smithi012.stdout:2053: seq_num 646 ranges {7970816=425984,8396800=655360,9052160=147456} 2024-09-10T18:03:43.375 INFO:tasks.rados.rados.0.smithi012.stdout:2053: writing smithi01278544-29 from 7970816 to 8396800 tid 1 2024-09-10T18:03:43.378 INFO:tasks.rados.rados.0.smithi012.stdout:2053: writing smithi01278544-29 from 8396800 to 9052160 tid 2 2024-09-10T18:03:43.380 INFO:tasks.rados.rados.0.smithi012.stdout:2053: writing smithi01278544-29 from 9052160 to 9199616 tid 3 2024-09-10T18:03:43.380 INFO:tasks.rados.rados.0.smithi012.stdout:2038: done (9 left) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2039: done (8 left) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2040: done (7 left) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2042: done (6 left) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2043: done (5 left) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2047: done (4 left) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2051: done (3 left) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2052: done (2 left) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2054: read oid 1 snap -1 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2054: expect (ObjNum 641 snap 212 seq_num 641) 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2055: rollback oid 46 current snap is 212 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 208 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2050: finishing write tid 4 to smithi01278544-14 2024-09-10T18:03:43.381 INFO:tasks.rados.rados.0.smithi012.stdout:2050: finishing write tid 5 to smithi01278544-14 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:2050: oid 14 updating version 0 to 1394 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:2050: oid 14 updating version 1394 to 1395 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:2050: oid 14 version 1395 is already newer than 1393 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:2050: oid 14 version 1395 is already newer than 1392 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1395 (ObjNum 645 snap 212 seq_num 645) dirty exists 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:2050: left oid 14 (ObjNum 645 snap 212 seq_num 645) 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:2053: finishing write tid 1 to smithi01278544-29 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:2050: done (3 left) 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 212 2024-09-10T18:03:43.382 INFO:tasks.rados.rados.0.smithi012.stdout:2056: seq_num 647 ranges {1179648=442368,1622016=589824,2211840=212992} 2024-09-10T18:03:43.389 INFO:tasks.rados.rados.0.smithi012.stdout:2056: writing smithi01278544-42 from 1179648 to 1622016 tid 1 2024-09-10T18:03:43.392 INFO:tasks.rados.rados.0.smithi012.stdout:2056: writing smithi01278544-42 from 1622016 to 2211840 tid 2 2024-09-10T18:03:43.394 INFO:tasks.rados.rados.0.smithi012.stdout:2056: writing smithi01278544-42 from 2211840 to 2424832 tid 3 2024-09-10T18:03:43.394 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 212 2024-09-10T18:03:43.394 INFO:tasks.rados.rados.0.smithi012.stdout:2053: finishing write tid 2 to smithi01278544-29 2024-09-10T18:03:43.394 INFO:tasks.rados.rados.0.smithi012.stdout:2057: seq_num 648 ranges {32768=458752,491520=475136,966656=327680} 2024-09-10T18:03:43.397 INFO:tasks.rados.rados.0.smithi012.stdout:2057: writing smithi01278544-12 from 32768 to 491520 tid 1 2024-09-10T18:03:43.400 INFO:tasks.rados.rados.0.smithi012.stdout:2057: writing smithi01278544-12 from 491520 to 966656 tid 2 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2057: writing smithi01278544-12 from 966656 to 1294336 tid 3 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2058: snap_create 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2053: finishing write tid 3 to smithi01278544-29 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2053: finishing write tid 4 to smithi01278544-29 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2053: finishing write tid 5 to smithi01278544-29 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2053: oid 29 updating version 0 to 757 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2053: oid 29 updating version 757 to 759 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2053: oid 29 updating version 759 to 760 2024-09-10T18:03:43.402 INFO:tasks.rados.rados.0.smithi012.stdout:2053: oid 29 version 760 is already newer than 758 2024-09-10T18:03:43.403 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 760 (ObjNum 646 snap 212 seq_num 646) dirty exists 2024-09-10T18:03:43.403 INFO:tasks.rados.rados.0.smithi012.stdout:2053: left oid 29 (ObjNum 646 snap 212 seq_num 646) 2024-09-10T18:03:43.403 INFO:tasks.rados.rados.0.smithi012.stdout:2055: finishing rollback tid 0 to smithi01278544-46 2024-09-10T18:03:43.403 INFO:tasks.rados.rados.0.smithi012.stdout:2055: finishing rollback tid 1 to smithi01278544-46 2024-09-10T18:03:43.403 INFO:tasks.rados.rados.0.smithi012.stdout:2055: finishing rollback tid 2 to smithi01278544-46 2024-09-10T18:03:43.403 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1244 (ObjNum 625 snap 205 seq_num 625) dirty exists 2024-09-10T18:03:43.403 INFO:tasks.rados.rados.0.smithi012.stdout:2054: expect (ObjNum 641 snap 212 seq_num 641) 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: finishing write tid 1 to smithi01278544-42 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: finishing write tid 2 to smithi01278544-42 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: finishing write tid 3 to smithi01278544-42 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: finishing write tid 4 to smithi01278544-42 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: finishing write tid 5 to smithi01278544-42 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: oid 42 updating version 0 to 1399 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: oid 42 version 1399 is already newer than 1396 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: oid 42 version 1399 is already newer than 1398 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: oid 42 version 1399 is already newer than 1397 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1399 (ObjNum 647 snap 212 seq_num 647) dirty exists 2024-09-10T18:03:43.450 INFO:tasks.rados.rados.0.smithi012.stdout:2056: left oid 42 (ObjNum 647 snap 212 seq_num 647) 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: finishing write tid 1 to smithi01278544-12 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: finishing write tid 2 to smithi01278544-12 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: finishing write tid 3 to smithi01278544-12 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: finishing write tid 4 to smithi01278544-12 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: finishing write tid 5 to smithi01278544-12 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: oid 12 updating version 0 to 1420 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: oid 12 version 1420 is already newer than 1419 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: oid 12 updating version 1420 to 1421 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: oid 12 version 1421 is already newer than 1418 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1421 (ObjNum 648 snap 212 seq_num 648) dirty exists 2024-09-10T18:03:43.451 INFO:tasks.rados.rados.0.smithi012.stdout:2057: left oid 12 (ObjNum 648 snap 212 seq_num 648) 2024-09-10T18:03:43.765 INFO:tasks.rados.rados.0.smithi012.stdout:2053: done (5 left) 2024-09-10T18:03:43.765 INFO:tasks.rados.rados.0.smithi012.stdout:2054: done (4 left) 2024-09-10T18:03:43.765 INFO:tasks.rados.rados.0.smithi012.stdout:2055: done (3 left) 2024-09-10T18:03:43.766 INFO:tasks.rados.rados.0.smithi012.stdout:2056: done (2 left) 2024-09-10T18:03:43.766 INFO:tasks.rados.rados.0.smithi012.stdout:2057: done (1 left) 2024-09-10T18:03:43.766 INFO:tasks.rados.rados.0.smithi012.stdout:2058: done (0 left) 2024-09-10T18:03:43.766 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 213 2024-09-10T18:03:43.766 INFO:tasks.rados.rados.0.smithi012.stdout:2059: seq_num 649 ranges {6791168=475136,7266304=761856,8028160=40960} 2024-09-10T18:03:43.805 INFO:tasks.rados.rados.0.smithi012.stdout:2059: writing smithi01278544-49 from 6791168 to 7266304 tid 1 2024-09-10T18:03:43.809 INFO:tasks.rados.rados.0.smithi012.stdout:2059: writing smithi01278544-49 from 7266304 to 8028160 tid 2 2024-09-10T18:03:43.809 INFO:tasks.rados.rados.0.smithi012.stdout:2059: writing smithi01278544-49 from 8028160 to 8069120 tid 3 2024-09-10T18:03:43.810 INFO:tasks.rados.rados.0.smithi012.stdout:2060: delete oid 40 current snap is 213 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:2060: done (1 left) 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:2061: read oid 6 snap 208 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:2061: expect (ObjNum 570 snap 190 seq_num 570) 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:2062: rollback oid 3 current snap is 213 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 212 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:2063: read oid 42 snap -1 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:2063: expect (ObjNum 647 snap 212 seq_num 647) 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 213 2024-09-10T18:03:43.812 INFO:tasks.rados.rados.0.smithi012.stdout:2064: seq_num 651 ranges {0=507904,507904=532480,1040384=270336} 2024-09-10T18:03:43.815 INFO:tasks.rados.rados.0.smithi012.stdout:2064: writing smithi01278544-41 from 0 to 507904 tid 1 2024-09-10T18:03:43.819 INFO:tasks.rados.rados.0.smithi012.stdout:2064: writing smithi01278544-41 from 507904 to 1040384 tid 2 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2064: writing smithi01278544-41 from 1040384 to 1310720 tid 3 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2065: read oid 28 snap -1 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2065: expect (ObjNum 617 snap 203 seq_num 617) 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 213 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2059: finishing write tid 1 to smithi01278544-49 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2059: finishing write tid 2 to smithi01278544-49 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2059: finishing write tid 3 to smithi01278544-49 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2059: finishing write tid 4 to smithi01278544-49 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2059: finishing write tid 5 to smithi01278544-49 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2059: oid 49 updating version 0 to 1110 2024-09-10T18:03:43.822 INFO:tasks.rados.rados.0.smithi012.stdout:2059: oid 49 updating version 1110 to 1111 2024-09-10T18:03:43.823 INFO:tasks.rados.rados.0.smithi012.stdout:2059: oid 49 version 1111 is already newer than 1109 2024-09-10T18:03:43.823 INFO:tasks.rados.rados.0.smithi012.stdout:2059: oid 49 version 1111 is already newer than 1108 2024-09-10T18:03:43.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1111 (ObjNum 649 snap 213 seq_num 649) dirty exists 2024-09-10T18:03:43.823 INFO:tasks.rados.rados.0.smithi012.stdout:2059: left oid 49 (ObjNum 649 snap 213 seq_num 649) 2024-09-10T18:03:43.824 INFO:tasks.rados.rados.0.smithi012.stdout:2066: seq_num 652 ranges {0=524288,524288=409600,933888=393216} 2024-09-10T18:03:43.826 INFO:tasks.rados.rados.0.smithi012.stdout:2066: writing smithi01278544-13 from 0 to 524288 tid 1 2024-09-10T18:03:43.829 INFO:tasks.rados.rados.0.smithi012.stdout:2066: writing smithi01278544-13 from 524288 to 933888 tid 2 2024-09-10T18:03:43.832 INFO:tasks.rados.rados.0.smithi012.stdout:2066: writing smithi01278544-13 from 933888 to 1327104 tid 3 2024-09-10T18:03:43.832 INFO:tasks.rados.rados.0.smithi012.stdout:2059: done (6 left) 2024-09-10T18:03:43.832 INFO:tasks.rados.rados.0.smithi012.stdout:2067: snap_remove snap 173 2024-09-10T18:03:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:03:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:03:43] "GET /metrics HTTP/1.1" 200 36287 "" "Prometheus/2.43.0" 2024-09-10T18:03:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:2067: done (6 left) 2024-09-10T18:03:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 213 2024-09-10T18:03:44.774 INFO:tasks.rados.rados.0.smithi012.stdout:2068: seq_num 653 ranges {6946816=540672,7487488=696320,8183808=106496} 2024-09-10T18:03:44.816 INFO:tasks.rados.rados.0.smithi012.stdout:2068: writing smithi01278544-5 from 6946816 to 7487488 tid 1 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:2068: writing smithi01278544-5 from 7487488 to 8183808 tid 2 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:2068: writing smithi01278544-5 from 8183808 to 8290304 tid 3 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:2064: finishing write tid 1 to smithi01278544-41 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:2069: read oid 21 snap -1 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:2069: expect deleted 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:2070: rollback oid 30 current snap is 213 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 207 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:2062: finishing rollback tid 0 to smithi01278544-3 2024-09-10T18:03:44.822 INFO:tasks.rados.rados.0.smithi012.stdout:2062: finishing rollback tid 1 to smithi01278544-3 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2062: finishing rollback tid 2 to smithi01278544-3 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1247 (ObjNum 561 snap 186 seq_num 561) dirty exists 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2064: finishing write tid 2 to smithi01278544-41 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2064: finishing write tid 3 to smithi01278544-41 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2062: done (8 left) 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2071: read oid 29 snap 209 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2071: expect (ObjNum 544 snap 183 seq_num 544) 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2072: rollback oid 1 current snap is 213 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 196 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2064: finishing write tid 4 to smithi01278544-41 2024-09-10T18:03:44.823 INFO:tasks.rados.rados.0.smithi012.stdout:2063: expect (ObjNum 647 snap 212 seq_num 647) 2024-09-10T18:03:44.913 INFO:tasks.rados.rados.0.smithi012.stdout:2066: finishing write tid 1 to smithi01278544-13 2024-09-10T18:03:44.913 INFO:tasks.rados.rados.0.smithi012.stdout:2066: finishing write tid 2 to smithi01278544-13 2024-09-10T18:03:44.913 INFO:tasks.rados.rados.0.smithi012.stdout:2066: finishing write tid 3 to smithi01278544-13 2024-09-10T18:03:44.913 INFO:tasks.rados.rados.0.smithi012.stdout:2066: finishing write tid 4 to smithi01278544-13 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2064: finishing write tid 5 to smithi01278544-41 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2064: oid 41 updating version 0 to 920 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2064: oid 41 version 920 is already newer than 918 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2064: oid 41 version 920 is already newer than 919 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2064: oid 41 version 920 is already newer than 917 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 920 (ObjNum 651 snap 213 seq_num 651) dirty exists 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2064: left oid 41 (ObjNum 651 snap 213 seq_num 651) 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2066: finishing write tid 5 to smithi01278544-13 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2066: oid 13 updating version 0 to 925 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2066: oid 13 version 925 is already newer than 923 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2066: oid 13 version 925 is already newer than 924 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:2066: oid 13 version 925 is already newer than 922 2024-09-10T18:03:44.914 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 925 (ObjNum 652 snap 213 seq_num 652) dirty exists 2024-09-10T18:03:44.915 INFO:tasks.rados.rados.0.smithi012.stdout:2066: left oid 13 (ObjNum 652 snap 213 seq_num 652) 2024-09-10T18:03:44.915 INFO:tasks.rados.rados.0.smithi012.stdout:2061: expect (ObjNum 570 snap 190 seq_num 570) 2024-09-10T18:03:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:44 smithi012 ceph-mon[89611]: pgmap v413: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 363 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.9 MiB/s wr, 15 op/s; 96/696 objects degraded (13.793%) 2024-09-10T18:03:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:44 smithi012 ceph-mon[89611]: osdmap e495: 8 total, 7 up, 8 in 2024-09-10T18:03:45.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:44 smithi012 ceph-mon[92029]: pgmap v413: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 363 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.9 MiB/s wr, 15 op/s; 96/696 objects degraded (13.793%) 2024-09-10T18:03:45.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:44 smithi012 ceph-mon[92029]: osdmap e495: 8 total, 7 up, 8 in 2024-09-10T18:03:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:44 smithi089 ceph-mon[84132]: pgmap v413: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 363 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 3.9 MiB/s wr, 15 op/s; 96/696 objects degraded (13.793%) 2024-09-10T18:03:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:44 smithi089 ceph-mon[84132]: osdmap e495: 8 total, 7 up, 8 in 2024-09-10T18:03:45.270 INFO:tasks.rados.rados.0.smithi012.stdout:2065: expect (ObjNum 617 snap 203 seq_num 617) 2024-09-10T18:03:45.915 INFO:tasks.rados.rados.0.smithi012.stdout:2068: finishing write tid 1 to smithi01278544-5 2024-09-10T18:03:45.915 INFO:tasks.rados.rados.0.smithi012.stdout:2068: finishing write tid 2 to smithi01278544-5 2024-09-10T18:03:45.915 INFO:tasks.rados.rados.0.smithi012.stdout:2070: finishing rollback tid 0 to smithi01278544-30 2024-09-10T18:03:45.915 INFO:tasks.rados.rados.0.smithi012.stdout:2072: finishing rollback tid 0 to smithi01278544-1 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2061: done (9 left) 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2063: done (8 left) 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2064: done (7 left) 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2065: done (6 left) 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2066: done (5 left) 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2069: done (4 left) 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2073: snap_create 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2072: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2070: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2072: finishing rollback tid 2 to smithi01278544-1 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1120 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2070: finishing rollback tid 2 to smithi01278544-30 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1113 (ObjNum 622 snap 205 seq_num 622) dirty exists 2024-09-10T18:03:45.916 INFO:tasks.rados.rados.0.smithi012.stdout:2068: finishing write tid 3 to smithi01278544-5 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:2068: finishing write tid 4 to smithi01278544-5 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:2068: finishing write tid 5 to smithi01278544-5 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:2068: oid 5 updating version 0 to 881 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:2068: oid 5 updating version 881 to 882 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:2068: oid 5 updating version 882 to 883 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:2068: oid 5 version 883 is already newer than 880 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 883 (ObjNum 653 snap 213 seq_num 653) dirty exists 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:2068: left oid 5 (ObjNum 653 snap 213 seq_num 653) 2024-09-10T18:03:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:2071: expect (ObjNum 544 snap 183 seq_num 544) 2024-09-10T18:03:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[89611]: osdmap e496: 8 total, 7 up, 8 in 2024-09-10T18:03:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[92029]: osdmap e496: 8 total, 7 up, 8 in 2024-09-10T18:03:46.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:45 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.035 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:45 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:03:45.981+0000 7fad9f545640 -1 osd.6 486 log_to_monitors true 2024-09-10T18:03:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:45 smithi089 ceph-mon[84132]: osdmap e496: 8 total, 7 up, 8 in 2024-09-10T18:03:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:45 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:46.868 INFO:tasks.rados.rados.0.smithi012.stdout:2068: done (4 left) 2024-09-10T18:03:46.868 INFO:tasks.rados.rados.0.smithi012.stdout:2070: done (3 left) 2024-09-10T18:03:46.868 INFO:tasks.rados.rados.0.smithi012.stdout:2071: done (2 left) 2024-09-10T18:03:46.868 INFO:tasks.rados.rados.0.smithi012.stdout:2072: done (1 left) 2024-09-10T18:03:46.868 INFO:tasks.rados.rados.0.smithi012.stdout:2073: done (0 left) 2024-09-10T18:03:46.868 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 214 2024-09-10T18:03:46.869 INFO:tasks.rados.rados.0.smithi012.stdout:2074: seq_num 654 ranges {0=557056,557056=630784,1187840=172032} 2024-09-10T18:03:46.871 INFO:tasks.rados.rados.0.smithi012.stdout:2074: writing smithi01278544-50 from 0 to 557056 tid 1 2024-09-10T18:03:46.875 INFO:tasks.rados.rados.0.smithi012.stdout:2074: writing smithi01278544-50 from 557056 to 1187840 tid 2 2024-09-10T18:03:46.876 INFO:tasks.rados.rados.0.smithi012.stdout:2074: writing smithi01278544-50 from 1187840 to 1359872 tid 3 2024-09-10T18:03:46.876 INFO:tasks.rados.rados.0.smithi012.stdout:2075: read oid 28 snap 208 2024-09-10T18:03:46.877 INFO:tasks.rados.rados.0.smithi012.stdout:2075: expect (ObjNum 617 snap 203 seq_num 617) 2024-09-10T18:03:46.877 INFO:tasks.rados.rados.0.smithi012.stdout:2076: snap_remove snap 190 2024-09-10T18:03:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[89611]: pgmap v416: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 366 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 4.4 MiB/s wr, 15 op/s; 98/702 objects degraded (13.960%) 2024-09-10T18:03:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 98/702 objects degraded (13.960%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[89611]: from='osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T18:03:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[89611]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T18:03:47.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:47.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[92029]: pgmap v416: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 366 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 4.4 MiB/s wr, 15 op/s; 98/702 objects degraded (13.960%) 2024-09-10T18:03:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 98/702 objects degraded (13.960%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[92029]: from='osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T18:03:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[92029]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T18:03:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:47.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:03:46 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:03:46.897+0000 7fad932e7640 -1 osd.6 486 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T18:03:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:46 smithi089 ceph-mon[84132]: pgmap v416: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 366 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 4.4 MiB/s wr, 15 op/s; 98/702 objects degraded (13.960%) 2024-09-10T18:03:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:46 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 98/702 objects degraded (13.960%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:46 smithi089 ceph-mon[84132]: from='osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T18:03:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:46 smithi089 ceph-mon[84132]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T18:03:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:03:47.882 INFO:tasks.rados.rados.0.smithi012.stdout:2076: done (2 left) 2024-09-10T18:03:47.882 INFO:tasks.rados.rados.0.smithi012.stdout:2077: read oid 36 snap -1 2024-09-10T18:03:47.882 INFO:tasks.rados.rados.0.smithi012.stdout:2077: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:03:47.884 INFO:tasks.rados.rados.0.smithi012.stdout:2078: read oid 15 snap 196 2024-09-10T18:03:47.884 INFO:tasks.rados.rados.0.smithi012.stdout:2078: expect deleted 2024-09-10T18:03:47.884 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 30 current snap is 214 2024-09-10T18:03:47.884 INFO:tasks.rados.rados.0.smithi012.stdout:2074: finishing write tid 1 to smithi01278544-50 2024-09-10T18:03:47.884 INFO:tasks.rados.rados.0.smithi012.stdout:2074: finishing write tid 2 to smithi01278544-50 2024-09-10T18:03:47.884 INFO:tasks.rados.rados.0.smithi012.stdout:2074: finishing write tid 3 to smithi01278544-50 2024-09-10T18:03:47.884 INFO:tasks.rados.rados.0.smithi012.stdout:2074: finishing write tid 4 to smithi01278544-50 2024-09-10T18:03:47.884 INFO:tasks.rados.rados.0.smithi012.stdout:2074: finishing write tid 5 to smithi01278544-50 2024-09-10T18:03:47.885 INFO:tasks.rados.rados.0.smithi012.stdout:2074: oid 50 updating version 0 to 754 2024-09-10T18:03:47.885 INFO:tasks.rados.rados.0.smithi012.stdout:2074: oid 50 version 754 is already newer than 752 2024-09-10T18:03:47.885 INFO:tasks.rados.rados.0.smithi012.stdout:2074: oid 50 version 754 is already newer than 753 2024-09-10T18:03:47.885 INFO:tasks.rados.rados.0.smithi012.stdout:2074: oid 50 version 754 is already newer than 751 2024-09-10T18:03:47.885 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 754 (ObjNum 654 snap 214 seq_num 654) dirty exists 2024-09-10T18:03:47.885 INFO:tasks.rados.rados.0.smithi012.stdout:2074: left oid 50 (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:03:47.885 INFO:tasks.rados.rados.0.smithi012.stdout:2075: expect (ObjNum 617 snap 203 seq_num 617) 2024-09-10T18:03:48.127 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:47 smithi089 ceph-mon[84132]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T18:03:48.128 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:47 smithi089 ceph-mon[84132]: osdmap e497: 8 total, 7 up, 8 in 2024-09-10T18:03:48.128 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:47 smithi089 ceph-mon[84132]: from='osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:48.128 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:47 smithi089 ceph-mon[84132]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:48.128 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:47 smithi089 ceph-mon[84132]: pgmap v418: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 376 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 27 op/s; 101/711 objects degraded (14.205%) 2024-09-10T18:03:48.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[92029]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T18:03:48.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[92029]: osdmap e497: 8 total, 7 up, 8 in 2024-09-10T18:03:48.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[92029]: from='osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:48.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[92029]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:48.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[92029]: pgmap v418: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 376 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 27 op/s; 101/711 objects degraded (14.205%) 2024-09-10T18:03:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[89611]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T18:03:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[89611]: osdmap e497: 8 total, 7 up, 8 in 2024-09-10T18:03:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[89611]: from='osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[89611]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:03:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:47 smithi012 ceph-mon[89611]: pgmap v418: 121 pgs: 34 active+undersized, 9 active+undersized+degraded, 78 active+clean; 376 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 27 op/s; 101/711 objects degraded (14.205%) 2024-09-10T18:03:48.535 INFO:tasks.rados.rados.0.smithi012.stdout:2077: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:03:48.537 INFO:tasks.rados.rados.0.smithi012.stdout:2079: seq_num 655 ranges {13287424=573440,13860864=516096,14376960=286720} 2024-09-10T18:03:48.613 INFO:tasks.rados.rados.0.smithi012.stdout:2079: writing smithi01278544-30 from 13287424 to 13860864 tid 1 2024-09-10T18:03:48.617 INFO:tasks.rados.rados.0.smithi012.stdout:2079: writing smithi01278544-30 from 13860864 to 14376960 tid 2 2024-09-10T18:03:48.617 INFO:tasks.rados.rados.0.smithi012.stdout:2079: writing smithi01278544-30 from 14376960 to 14663680 tid 3 2024-09-10T18:03:48.618 INFO:tasks.rados.rados.0.smithi012.stdout:2074: done (4 left) 2024-09-10T18:03:48.618 INFO:tasks.rados.rados.0.smithi012.stdout:2075: done (3 left) 2024-09-10T18:03:48.618 INFO:tasks.rados.rados.0.smithi012.stdout:2077: done (2 left) 2024-09-10T18:03:48.618 INFO:tasks.rados.rados.0.smithi012.stdout:2080: snap_remove snap 167 2024-09-10T18:03:48.879 INFO:tasks.rados.rados.0.smithi012.stdout:2080: done (2 left) 2024-09-10T18:03:48.879 INFO:tasks.rados.rados.0.smithi012.stdout:2081: snap_remove snap 209 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999] boot 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: osdmap e498: 8 total, 8 up, 8 in 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:03:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:48 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:03:48.961+0000 7f7a9b686640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-10T18:03:49.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:03:49.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999] boot 2024-09-10T18:03:49.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: osdmap e498: 8 total, 8 up, 8 in 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: osd.6 [v2:172.21.15.89:6816/730345999,v1:172.21.15.89:6817/730345999] boot 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: osdmap e498: 8 total, 8 up, 8 in 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T18:03:49.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:03:49.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:03:49.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:48 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:03:49.885 INFO:tasks.rados.rados.0.smithi012.stdout:2081: done (2 left) 2024-09-10T18:03:49.886 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 214 2024-09-10T18:03:49.886 INFO:tasks.rados.rados.0.smithi012.stdout:2082: seq_num 656 ranges {40960=589824,630784=802816} 2024-09-10T18:03:49.888 INFO:tasks.rados.rados.0.smithi012.stdout:2082: writing smithi01278544-36 from 40960 to 630784 tid 1 2024-09-10T18:03:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:2082: writing smithi01278544-36 from 630784 to 1433600 tid 2 2024-09-10T18:03:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:2083: setattr oid 11 current snap is 214 2024-09-10T18:03:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:2079: finishing write tid 1 to smithi01278544-30 2024-09-10T18:03:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:2079: finishing write tid 2 to smithi01278544-30 2024-09-10T18:03:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:2079: finishing write tid 3 to smithi01278544-30 2024-09-10T18:03:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:2079: finishing write tid 4 to smithi01278544-30 2024-09-10T18:03:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:2079: finishing write tid 5 to smithi01278544-30 2024-09-10T18:03:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:2079: oid 30 updating version 0 to 1115 2024-09-10T18:03:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:2079: oid 30 updating version 1115 to 1117 2024-09-10T18:03:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:2079: oid 30 version 1117 is already newer than 1114 2024-09-10T18:03:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:2079: oid 30 version 1117 is already newer than 1116 2024-09-10T18:03:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1117 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:03:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:2079: left oid 30 (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:03:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:2078: done (3 left) 2024-09-10T18:03:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:2079: done (2 left) 2024-09-10T18:03:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:2084: rollback oid 12 current snap is 214 2024-09-10T18:03:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 12 to 206 2024-09-10T18:03:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:2085: read oid 47 snap -1 2024-09-10T18:03:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:2085: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:49.897 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 214 2024-09-10T18:03:49.897 INFO:tasks.rados.rados.0.smithi012.stdout:2086: seq_num 657 ranges {573440=606208,1179648=688128,1867776=114688} 2024-09-10T18:03:49.902 INFO:tasks.rados.rados.0.smithi012.stdout:2086: writing smithi01278544-15 from 573440 to 1179648 tid 1 2024-09-10T18:03:49.907 INFO:tasks.rados.rados.0.smithi012.stdout:2086: writing smithi01278544-15 from 1179648 to 1867776 tid 2 2024-09-10T18:03:49.908 INFO:tasks.rados.rados.0.smithi012.stdout:2086: writing smithi01278544-15 from 1867776 to 1982464 tid 3 2024-09-10T18:03:49.908 INFO:tasks.rados.rados.0.smithi012.stdout:2087: snap_remove snap 198 2024-09-10T18:03:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: osdmap e499: 8 total, 8 up, 8 in 2024-09-10T18:03:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:50.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-10T18:03:50.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-10T18:03:50.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-10T18:03:50.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[89611]: pgmap v421: 121 pgs: 7 peering, 28 active+undersized, 8 active+undersized+degraded, 78 active+clean; 388 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 2.7 MiB/s wr, 19 op/s; 84/717 objects degraded (11.715%) 2024-09-10T18:03:50.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: osdmap e499: 8 total, 8 up, 8 in 2024-09-10T18:03:50.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:50.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-10T18:03:50.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-10T18:03:50.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-10T18:03:50.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:49 smithi012 ceph-mon[92029]: pgmap v421: 121 pgs: 7 peering, 28 active+undersized, 8 active+undersized+degraded, 78 active+clean; 388 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 2.7 MiB/s wr, 19 op/s; 84/717 objects degraded (11.715%) 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: osdmap e499: 8 total, 8 up, 8 in 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-10T18:03:50.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:49 smithi089 ceph-mon[84132]: pgmap v421: 121 pgs: 7 peering, 28 active+undersized, 8 active+undersized+degraded, 78 active+clean; 388 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 25 MiB/s rd, 2.7 MiB/s wr, 19 op/s; 84/717 objects degraded (11.715%) 2024-09-10T18:03:50.916 INFO:tasks.rados.rados.0.smithi012.stdout:2087: done (5 left) 2024-09-10T18:03:50.916 INFO:tasks.rados.rados.0.smithi012.stdout:2088: read oid 31 snap -1 2024-09-10T18:03:50.916 INFO:tasks.rados.rados.0.smithi012.stdout:2088: expect deleted 2024-09-10T18:03:50.916 INFO:tasks.rados.rados.0.smithi012.stdout:2089: copy_from oid 20 from oid 37 current snap is 214 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2082: finishing write tid 1 to smithi01278544-36 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2082: finishing write tid 2 to smithi01278544-36 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1464 (ObjNum 129 snap 0 seq_num 3496910640) dirty exists 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2082: finishing write tid 3 to smithi01278544-36 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2084: finishing rollback tid 0 to smithi01278544-12 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2084: finishing rollback tid 1 to smithi01278544-12 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1467 (ObjNum 129 snap 0 seq_num 3498052736) dirty dne 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2082: finishing write tid 4 to smithi01278544-36 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2082: oid 36 updating version 0 to 776 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2082: oid 36 version 776 is already newer than 775 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2082: oid 36 version 776 is already newer than 774 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 776 (ObjNum 656 snap 214 seq_num 656) dirty exists 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2082: left oid 36 (ObjNum 656 snap 214 seq_num 656) 2024-09-10T18:03:50.917 INFO:tasks.rados.rados.0.smithi012.stdout:2086: finishing write tid 1 to smithi01278544-15 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: finishing write tid 2 to smithi01278544-15 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: finishing write tid 3 to smithi01278544-15 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: finishing write tid 4 to smithi01278544-15 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: finishing write tid 5 to smithi01278544-15 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: oid 15 updating version 0 to 1114 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: oid 15 updating version 1114 to 1115 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: oid 15 version 1115 is already newer than 1112 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: oid 15 version 1115 is already newer than 1113 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 1115 (ObjNum 657 snap 214 seq_num 657) dirty exists 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2086: left oid 15 (ObjNum 657 snap 214 seq_num 657) 2024-09-10T18:03:50.918 INFO:tasks.rados.rados.0.smithi012.stdout:2085: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:03:51.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:50 smithi012 ceph-mon[89611]: osdmap e500: 8 total, 8 up, 8 in 2024-09-10T18:03:51.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:50 smithi012 ceph-mon[92029]: osdmap e500: 8 total, 8 up, 8 in 2024-09-10T18:03:51.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:50 smithi089 ceph-mon[84132]: osdmap e500: 8 total, 8 up, 8 in 2024-09-10T18:03:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:51 smithi012 ceph-mon[89611]: osdmap e501: 8 total, 8 up, 8 in 2024-09-10T18:03:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:51 smithi012 ceph-mon[89611]: pgmap v424: 121 pgs: 7 peering, 26 active+undersized, 7 active+undersized+degraded, 81 active+clean; 388 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 0 B/s wr, 2 op/s; 83/714 objects degraded (11.625%) 2024-09-10T18:03:52.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:51 smithi012 ceph-mon[92029]: osdmap e501: 8 total, 8 up, 8 in 2024-09-10T18:03:52.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:51 smithi012 ceph-mon[92029]: pgmap v424: 121 pgs: 7 peering, 26 active+undersized, 7 active+undersized+degraded, 81 active+clean; 388 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 0 B/s wr, 2 op/s; 83/714 objects degraded (11.625%) 2024-09-10T18:03:52.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:51 smithi089 ceph-mon[84132]: osdmap e501: 8 total, 8 up, 8 in 2024-09-10T18:03:52.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:51 smithi089 ceph-mon[84132]: pgmap v424: 121 pgs: 7 peering, 26 active+undersized, 7 active+undersized+degraded, 81 active+clean; 388 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 0 B/s wr, 2 op/s; 83/714 objects degraded (11.625%) 2024-09-10T18:03:52.326 INFO:tasks.rados.rados.0.smithi012.stdout:2089: finishing copy_from racing read to smithi01278544-20 2024-09-10T18:03:52.326 INFO:tasks.rados.rados.0.smithi012.stdout:2089: finishing copy_from to smithi01278544-20 2024-09-10T18:03:52.326 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 879 (ObjNum 540 snap 182 seq_num 540) dirty exists 2024-09-10T18:03:52.326 INFO:tasks.rados.rados.0.smithi012.stdout:2082: done (6 left) 2024-09-10T18:03:52.327 INFO:tasks.rados.rados.0.smithi012.stdout:2083: done (5 left) 2024-09-10T18:03:52.327 INFO:tasks.rados.rados.0.smithi012.stdout:2084: done (4 left) 2024-09-10T18:03:52.327 INFO:tasks.rados.rados.0.smithi012.stdout:2085: done (3 left) 2024-09-10T18:03:52.327 INFO:tasks.rados.rados.0.smithi012.stdout:2086: done (2 left) 2024-09-10T18:03:52.327 INFO:tasks.rados.rados.0.smithi012.stdout:2088: done (1 left) 2024-09-10T18:03:52.328 INFO:tasks.rados.rados.0.smithi012.stdout:2089: done (0 left) 2024-09-10T18:03:52.328 INFO:tasks.rados.rados.0.smithi012.stdout:2090: copy_from oid 8 from oid 18 current snap is 214 2024-09-10T18:03:52.328 INFO:tasks.rados.rados.0.smithi012.stdout:2091: read oid 46 snap 179 2024-09-10T18:03:52.328 INFO:tasks.rados.rados.0.smithi012.stdout:2091: expect (ObjNum 509 snap 172 seq_num 509) 2024-09-10T18:03:52.328 INFO:tasks.rados.rados.0.smithi012.stdout:2092: read oid 44 snap 207 2024-09-10T18:03:52.328 INFO:tasks.rados.rados.0.smithi012.stdout:2092: expect (ObjNum 605 snap 200 seq_num 605) 2024-09-10T18:03:52.329 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 214 2024-09-10T18:03:52.329 INFO:tasks.rados.rados.0.smithi012.stdout:2093: seq_num 658 ranges {32768=622592,655360=565248,1220608=237568} 2024-09-10T18:03:52.330 INFO:tasks.rados.rados.0.smithi012.stdout:2093: writing smithi01278544-26 from 32768 to 655360 tid 1 2024-09-10T18:03:52.333 INFO:tasks.rados.rados.0.smithi012.stdout:2093: writing smithi01278544-26 from 655360 to 1220608 tid 2 2024-09-10T18:03:52.334 INFO:tasks.rados.rados.0.smithi012.stdout:2093: writing smithi01278544-26 from 1220608 to 1458176 tid 3 2024-09-10T18:03:52.334 INFO:tasks.rados.rados.0.smithi012.stdout:2094: delete oid 7 current snap is 214 2024-09-10T18:03:52.334 INFO:tasks.rados.rados.0.smithi012.stdout:2090: finishing copy_from racing read to smithi01278544-8 2024-09-10T18:03:52.334 INFO:tasks.rados.rados.0.smithi012.stdout:2090: finishing copy_from to smithi01278544-8 2024-09-10T18:03:52.335 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1106 (ObjNum 620 snap 204 seq_num 620) dirty exists 2024-09-10T18:03:52.335 INFO:tasks.rados.rados.0.smithi012.stdout:2093: finishing write tid 1 to smithi01278544-26 2024-09-10T18:03:52.337 INFO:tasks.rados.rados.0.smithi012.stdout:2090: done (4 left) 2024-09-10T18:03:52.337 INFO:tasks.rados.rados.0.smithi012.stdout:2094: done (3 left) 2024-09-10T18:03:52.337 INFO:tasks.rados.rados.0.smithi012.stdout:2095: copy_from oid 8 from oid 13 current snap is 214 2024-09-10T18:03:52.337 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 214 2024-09-10T18:03:52.337 INFO:tasks.rados.rados.0.smithi012.stdout:2096: seq_num 660 ranges {557056=663552,1220608=737280,1957888=65536} 2024-09-10T18:03:52.344 INFO:tasks.rados.rados.0.smithi012.stdout:2096: writing smithi01278544-19 from 557056 to 1220608 tid 1 2024-09-10T18:03:52.350 INFO:tasks.rados.rados.0.smithi012.stdout:2096: writing smithi01278544-19 from 1220608 to 1957888 tid 2 2024-09-10T18:03:52.350 INFO:tasks.rados.rados.0.smithi012.stdout:2096: writing smithi01278544-19 from 1957888 to 2023424 tid 3 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2093: finishing write tid 2 to smithi01278544-26 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2097: delete oid 25 current snap is 214 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2093: finishing write tid 3 to smithi01278544-26 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2093: finishing write tid 4 to smithi01278544-26 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2093: finishing write tid 5 to smithi01278544-26 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2093: oid 26 updating version 0 to 779 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2093: oid 26 version 779 is already newer than 778 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2093: oid 26 version 779 is already newer than 777 2024-09-10T18:03:52.351 INFO:tasks.rados.rados.0.smithi012.stdout:2093: oid 26 updating version 779 to 780 2024-09-10T18:03:52.352 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 780 (ObjNum 658 snap 214 seq_num 658) dirty exists 2024-09-10T18:03:52.352 INFO:tasks.rados.rados.0.smithi012.stdout:2093: left oid 26 (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:03:52.352 INFO:tasks.rados.rados.0.smithi012.stdout:2095: finishing copy_from racing read to smithi01278544-8 2024-09-10T18:03:52.352 INFO:tasks.rados.rados.0.smithi012.stdout:2095: finishing copy_from to smithi01278544-8 2024-09-10T18:03:52.352 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 925 (ObjNum 652 snap 213 seq_num 652) dirty exists 2024-09-10T18:03:52.352 INFO:tasks.rados.rados.0.smithi012.stdout:2096: finishing write tid 1 to smithi01278544-19 2024-09-10T18:03:52.353 INFO:tasks.rados.rados.0.smithi012.stdout:2093: done (5 left) 2024-09-10T18:03:52.353 INFO:tasks.rados.rados.0.smithi012.stdout:2095: done (4 left) 2024-09-10T18:03:52.353 INFO:tasks.rados.rados.0.smithi012.stdout:2097: done (3 left) 2024-09-10T18:03:52.354 INFO:tasks.rados.rados.0.smithi012.stdout:2098: rmattr oid 2 current snap is 214 2024-09-10T18:03:52.354 INFO:tasks.rados.rados.0.smithi012.stdout:2098: done (3 left) 2024-09-10T18:03:52.354 INFO:tasks.rados.rados.0.smithi012.stdout:2099: snap_create 2024-09-10T18:03:52.354 INFO:tasks.rados.rados.0.smithi012.stdout:2096: finishing write tid 2 to smithi01278544-19 2024-09-10T18:03:52.354 INFO:tasks.rados.rados.0.smithi012.stdout:2096: finishing write tid 3 to smithi01278544-19 2024-09-10T18:03:52.354 INFO:tasks.rados.rados.0.smithi012.stdout:2096: finishing write tid 4 to smithi01278544-19 2024-09-10T18:03:52.355 INFO:tasks.rados.rados.0.smithi012.stdout:2096: finishing write tid 5 to smithi01278544-19 2024-09-10T18:03:52.355 INFO:tasks.rados.rados.0.smithi012.stdout:2096: oid 19 updating version 0 to 887 2024-09-10T18:03:52.355 INFO:tasks.rados.rados.0.smithi012.stdout:2096: oid 19 version 887 is already newer than 885 2024-09-10T18:03:52.355 INFO:tasks.rados.rados.0.smithi012.stdout:2096: oid 19 updating version 887 to 888 2024-09-10T18:03:52.356 INFO:tasks.rados.rados.0.smithi012.stdout:2096: oid 19 version 888 is already newer than 886 2024-09-10T18:03:52.356 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 888 (ObjNum 660 snap 214 seq_num 660) dirty exists 2024-09-10T18:03:52.356 INFO:tasks.rados.rados.0.smithi012.stdout:2096: left oid 19 (ObjNum 660 snap 214 seq_num 660) 2024-09-10T18:03:52.369 INFO:tasks.rados.rados.0.smithi012.stdout:2091: expect (ObjNum 509 snap 172 seq_num 509) 2024-09-10T18:03:52.549 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:03:52.928 INFO:tasks.rados.rados.0.smithi012.stdout:2092: expect (ObjNum 605 snap 200 seq_num 605) 2024-09-10T18:03:52.990 INFO:tasks.rados.rados.0.smithi012.stdout:2091: done (3 left) 2024-09-10T18:03:52.990 INFO:tasks.rados.rados.0.smithi012.stdout:2092: done (2 left) 2024-09-10T18:03:52.990 INFO:tasks.rados.rados.0.smithi012.stdout:2096: done (1 left) 2024-09-10T18:03:52.990 INFO:tasks.rados.rados.0.smithi012.stdout:2099: done (0 left) 2024-09-10T18:03:52.990 INFO:tasks.rados.rados.0.smithi012.stdout:2100: rollback oid 36 current snap is 215 2024-09-10T18:03:52.991 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 185 2024-09-10T18:03:52.991 INFO:tasks.rados.rados.0.smithi012.stdout:2101: delete oid 18 current snap is 215 2024-09-10T18:03:52.993 INFO:tasks.rados.rados.0.smithi012.stdout:2101: done (1 left) 2024-09-10T18:03:52.994 INFO:tasks.rados.rados.0.smithi012.stdout:2102: read oid 49 snap -1 2024-09-10T18:03:52.994 INFO:tasks.rados.rados.0.smithi012.stdout:2102: expect (ObjNum 649 snap 213 seq_num 649) 2024-09-10T18:03:52.994 INFO:tasks.rados.rados.0.smithi012.stdout:2103: copy_from oid 32 from oid 1 current snap is 215 2024-09-10T18:03:52.994 INFO:tasks.rados.rados.0.smithi012.stdout:2104: rollback oid 43 current snap is 215 2024-09-10T18:03:52.994 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 43 to 179 2024-09-10T18:03:52.995 INFO:tasks.rados.rados.0.smithi012.stdout:2105: rollback oid 41 current snap is 215 2024-09-10T18:03:52.995 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 200 2024-09-10T18:03:52.995 INFO:tasks.rados.rados.0.smithi012.stdout:2106: snap_create 2024-09-10T18:03:52.995 INFO:tasks.rados.rados.0.smithi012.stdout:2100: finishing rollback tid 0 to smithi01278544-36 2024-09-10T18:03:52.995 INFO:tasks.rados.rados.0.smithi012.stdout:2100: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:03:52.997 INFO:tasks.rados.rados.0.smithi012.stdout:2100: finishing rollback tid 2 to smithi01278544-36 2024-09-10T18:03:52.997 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 783 (ObjNum 432 snap 143 seq_num 432) dirty exists 2024-09-10T18:03:52.999 INFO:tasks.rados.rados.0.smithi012.stdout:2105: finishing rollback tid 0 to smithi01278544-41 2024-09-10T18:03:53.000 INFO:tasks.rados.rados.0.smithi012.stdout:2105: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:03:53.000 INFO:tasks.rados.rados.0.smithi012.stdout:2104: finishing rollback tid 0 to smithi01278544-43 2024-09-10T18:03:53.000 INFO:tasks.rados.rados.0.smithi012.stdout:2104: finishing rollback tid 1 to smithi01278544-43 2024-09-10T18:03:53.002 INFO:tasks.rados.rados.0.smithi012.stdout:2105: finishing rollback tid 2 to smithi01278544-41 2024-09-10T18:03:53.002 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 969 (ObjNum 558 snap 186 seq_num 558) dirty exists 2024-09-10T18:03:53.002 INFO:tasks.rados.rados.0.smithi012.stdout:2104: finishing rollback tid 2 to smithi01278544-43 2024-09-10T18:03:53.002 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 1450 (ObjNum 392 snap 126 seq_num 392) dirty exists 2024-09-10T18:03:53.034 INFO:tasks.rados.rados.0.smithi012.stdout:2102: expect (ObjNum 649 snap 213 seq_num 649) 2024-09-10T18:03:53.147 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:03:53.147 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (8m) 111s ago 9m 26.8M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:03:53.147 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (9m) 8s ago 9m 90.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (11m) 111s ago 11m 19.0M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (11m) 8s ago 11m 22.2M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (5m) 8s ago 14m 456M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (5m) 111s ago 16m 526M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (5m) 111s ago 16m 55.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (4m) 8s ago 15m 47.3M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (4m) 111s ago 15m 46.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (9m) 111s ago 9m 15.5M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (9m) 8s ago 9m 16.8M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (3m) 111s ago 14m 166M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (3m) 111s ago 14m 109M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:03:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (2m) 111s ago 13m 98.7M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:03:53.149 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (115s) 111s ago 13m 14.4M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:03:53.149 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (82s) 8s ago 13m 203M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 75e9a99555f3 2024-09-10T18:03:53.149 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (48s) 8s ago 12m 122M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 28c479f4ad60 2024-09-10T18:03:53.149 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (13s) 8s ago 12m 14.5M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 71e430ee4ba6 2024-09-10T18:03:53.149 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (11m) 8s ago 11m 189M 2479M 18.2.4-837-g7a853b17 f21ba1eea74e 7b26d2347fc8 2024-09-10T18:03:53.149 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (5m) 8s ago 10m 65.5M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:03:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:52 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 83/714 objects degraded (11.625%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:52 smithi012 ceph-mon[89611]: from='client.34473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:53.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:52 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 83/714 objects degraded (11.625%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:53.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:52 smithi012 ceph-mon[92029]: from='client.34473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:53.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:52 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 83/714 objects degraded (11.625%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T18:03:53.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:52 smithi089 ceph-mon[84132]: from='client.34473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:03:53.500 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 1, 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 7 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 3, 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 12 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:03:53.501 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:03:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2103: finishing copy_from racing read to smithi01278544-32 2024-09-10T18:03:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2103: finishing copy_from to smithi01278544-32 2024-09-10T18:03:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1120 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout: "mon" 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:03:53.802 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "12/20 daemons upgraded", 2024-09-10T18:03:53.803 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T18:03:53.803 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:03:53.803 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:03:53.931 INFO:tasks.rados.rados.0.smithi012.stdout:2100: done (5 left) 2024-09-10T18:03:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:2102: done (4 left) 2024-09-10T18:03:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:2103: done (3 left) 2024-09-10T18:03:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:2104: done (2 left) 2024-09-10T18:03:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:2105: done (1 left) 2024-09-10T18:03:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:2106: done (0 left) 2024-09-10T18:03:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:2107: read oid 42 snap 205 2024-09-10T18:03:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:2107: expect (ObjNum 617 snap 203 seq_num 617) 2024-09-10T18:03:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:2108: snap_create 2024-09-10T18:03:53.956 INFO:tasks.rados.rados.0.smithi012.stdout:2107: expect (ObjNum 617 snap 203 seq_num 617) 2024-09-10T18:03:54.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:03:53] "GET /metrics HTTP/1.1" 200 36286 "" "Prometheus/2.43.0" 2024-09-10T18:03:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[89611]: from='client.34479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[89611]: osdmap e502: 8 total, 8 up, 8 in 2024-09-10T18:03:54.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[89611]: pgmap v426: 121 pgs: 7 peering, 114 active+clean; 371 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 3.2 MiB/s wr, 13 op/s; 7.9 MiB/s, 2 objects/s recovering 2024-09-10T18:03:54.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[89611]: from='client.34485 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:54.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2432058379' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[92029]: from='client.34479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[92029]: osdmap e502: 8 total, 8 up, 8 in 2024-09-10T18:03:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[92029]: pgmap v426: 121 pgs: 7 peering, 114 active+clean; 371 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 3.2 MiB/s wr, 13 op/s; 7.9 MiB/s, 2 objects/s recovering 2024-09-10T18:03:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[92029]: from='client.34485 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:53 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2432058379' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:54.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:53 smithi089 ceph-mon[84132]: from='client.34479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:54.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:53 smithi089 ceph-mon[84132]: osdmap e502: 8 total, 8 up, 8 in 2024-09-10T18:03:54.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:53 smithi089 ceph-mon[84132]: pgmap v426: 121 pgs: 7 peering, 114 active+clean; 371 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 3.2 MiB/s wr, 13 op/s; 7.9 MiB/s, 2 objects/s recovering 2024-09-10T18:03:54.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:53 smithi089 ceph-mon[84132]: from='client.34485 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:54.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:53 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2432058379' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:03:54.935 INFO:tasks.rados.rados.0.smithi012.stdout:2107: done (1 left) 2024-09-10T18:03:54.935 INFO:tasks.rados.rados.0.smithi012.stdout:2108: done (0 left) 2024-09-10T18:03:54.935 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 217 2024-09-10T18:03:54.935 INFO:tasks.rados.rados.0.smithi012.stdout:2109: seq_num 663 ranges {958464=712704,1671168=442368,2113536=360448} 2024-09-10T18:03:54.944 INFO:tasks.rados.rados.0.smithi012.stdout:2109: writing smithi01278544-39 from 958464 to 1671168 tid 1 2024-09-10T18:03:54.947 INFO:tasks.rados.rados.0.smithi012.stdout:2109: writing smithi01278544-39 from 1671168 to 2113536 tid 2 2024-09-10T18:03:54.949 INFO:tasks.rados.rados.0.smithi012.stdout:2109: writing smithi01278544-39 from 2113536 to 2473984 tid 3 2024-09-10T18:03:54.949 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 217 2024-09-10T18:03:54.949 INFO:tasks.rados.rados.0.smithi012.stdout:2110: seq_num 664 ranges {1130496=729088,1859584=729088,2588672=73728} 2024-09-10T18:03:54.959 INFO:tasks.rados.rados.0.smithi012.stdout:2110: writing smithi01278544-38 from 1130496 to 1859584 tid 1 2024-09-10T18:03:54.965 INFO:tasks.rados.rados.0.smithi012.stdout:2110: writing smithi01278544-38 from 1859584 to 2588672 tid 2 2024-09-10T18:03:54.965 INFO:tasks.rados.rados.0.smithi012.stdout:2110: writing smithi01278544-38 from 2588672 to 2662400 tid 3 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2111: read oid 35 snap -1 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2111: expect (ObjNum 612 snap 202 seq_num 612) 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2112: copy_from oid 28 from oid 26 current snap is 217 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: finishing write tid 1 to smithi01278544-39 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: finishing write tid 2 to smithi01278544-39 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: finishing write tid 3 to smithi01278544-39 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: finishing write tid 4 to smithi01278544-39 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: finishing write tid 5 to smithi01278544-39 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: oid 39 updating version 0 to 1484 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: oid 39 updating version 1484 to 1485 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: oid 39 version 1485 is already newer than 1483 2024-09-10T18:03:54.966 INFO:tasks.rados.rados.0.smithi012.stdout:2109: oid 39 updating version 1485 to 1486 2024-09-10T18:03:54.967 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1486 (ObjNum 663 snap 217 seq_num 663) dirty exists 2024-09-10T18:03:54.967 INFO:tasks.rados.rados.0.smithi012.stdout:2109: left oid 39 (ObjNum 663 snap 217 seq_num 663) 2024-09-10T18:03:54.967 INFO:tasks.rados.rados.0.smithi012.stdout:2109: done (3 left) 2024-09-10T18:03:54.967 INFO:tasks.rados.rados.0.smithi012.stdout:2113: snap_remove snap 200 2024-09-10T18:03:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:54 smithi012 ceph-mon[89611]: from='client.44405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:54 smithi012 ceph-mon[89611]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 83/714 objects degraded (11.625%), 7 pgs degraded) 2024-09-10T18:03:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:54 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:03:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:54 smithi012 ceph-mon[89611]: osdmap e503: 8 total, 8 up, 8 in 2024-09-10T18:03:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:54 smithi012 ceph-mon[92029]: from='client.44405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:54 smithi012 ceph-mon[92029]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 83/714 objects degraded (11.625%), 7 pgs degraded) 2024-09-10T18:03:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:54 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:03:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:54 smithi012 ceph-mon[92029]: osdmap e503: 8 total, 8 up, 8 in 2024-09-10T18:03:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:54 smithi089 ceph-mon[84132]: from='client.44405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:03:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:54 smithi089 ceph-mon[84132]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 83/714 objects degraded (11.625%), 7 pgs degraded) 2024-09-10T18:03:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:54 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:03:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:54 smithi089 ceph-mon[84132]: osdmap e503: 8 total, 8 up, 8 in 2024-09-10T18:03:55.952 INFO:tasks.rados.rados.0.smithi012.stdout:2110: finishing write tid 1 to smithi01278544-38 2024-09-10T18:03:55.952 INFO:tasks.rados.rados.0.smithi012.stdout:2110: finishing write tid 2 to smithi01278544-38 2024-09-10T18:03:55.952 INFO:tasks.rados.rados.0.smithi012.stdout:2110: finishing write tid 3 to smithi01278544-38 2024-09-10T18:03:55.952 INFO:tasks.rados.rados.0.smithi012.stdout:2110: finishing write tid 4 to smithi01278544-38 2024-09-10T18:03:55.952 INFO:tasks.rados.rados.0.smithi012.stdout:2110: finishing write tid 5 to smithi01278544-38 2024-09-10T18:03:55.952 INFO:tasks.rados.rados.0.smithi012.stdout:2110: oid 38 updating version 0 to 1122 2024-09-10T18:03:55.952 INFO:tasks.rados.rados.0.smithi012.stdout:2110: oid 38 updating version 1122 to 1124 2024-09-10T18:03:55.952 INFO:tasks.rados.rados.0.smithi012.stdout:2110: oid 38 version 1124 is already newer than 1123 2024-09-10T18:03:55.953 INFO:tasks.rados.rados.0.smithi012.stdout:2110: oid 38 version 1124 is already newer than 1121 2024-09-10T18:03:55.953 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1124 (ObjNum 664 snap 217 seq_num 664) dirty exists 2024-09-10T18:03:55.953 INFO:tasks.rados.rados.0.smithi012.stdout:2110: left oid 38 (ObjNum 664 snap 217 seq_num 664) 2024-09-10T18:03:55.953 INFO:tasks.rados.rados.0.smithi012.stdout:2112: finishing copy_from racing read to smithi01278544-28 2024-09-10T18:03:55.953 INFO:tasks.rados.rados.0.smithi012.stdout:2112: finishing copy_from to smithi01278544-28 2024-09-10T18:03:55.953 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 780 (ObjNum 658 snap 214 seq_num 658) dirty exists 2024-09-10T18:03:55.953 INFO:tasks.rados.rados.0.smithi012.stdout:2111: expect (ObjNum 612 snap 202 seq_num 612) 2024-09-10T18:03:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:55 smithi012 ceph-mon[89611]: osdmap e504: 8 total, 8 up, 8 in 2024-09-10T18:03:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:55 smithi012 ceph-mon[89611]: pgmap v429: 121 pgs: 121 active+clean; 371 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 3.2 MiB/s wr, 14 op/s; 12 MiB/s, 4 objects/s recovering 2024-09-10T18:03:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:55 smithi012 ceph-mon[92029]: osdmap e504: 8 total, 8 up, 8 in 2024-09-10T18:03:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:55 smithi012 ceph-mon[92029]: pgmap v429: 121 pgs: 121 active+clean; 371 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 3.2 MiB/s wr, 14 op/s; 12 MiB/s, 4 objects/s recovering 2024-09-10T18:03:56.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:55 smithi089 ceph-mon[84132]: osdmap e504: 8 total, 8 up, 8 in 2024-09-10T18:03:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:55 smithi089 ceph-mon[84132]: pgmap v429: 121 pgs: 121 active+clean; 371 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.7 MiB/s rd, 3.2 MiB/s wr, 14 op/s; 12 MiB/s, 4 objects/s recovering 2024-09-10T18:03:56.529 INFO:tasks.rados.rados.0.smithi012.stdout:2110: done (3 left) 2024-09-10T18:03:56.530 INFO:tasks.rados.rados.0.smithi012.stdout:2111: done (2 left) 2024-09-10T18:03:56.530 INFO:tasks.rados.rados.0.smithi012.stdout:2112: done (1 left) 2024-09-10T18:03:56.530 INFO:tasks.rados.rados.0.smithi012.stdout:2113: done (0 left) 2024-09-10T18:03:56.530 INFO:tasks.rados.rados.0.smithi012.stdout:2114: read oid 33 snap -1 2024-09-10T18:03:56.530 INFO:tasks.rados.rados.0.smithi012.stdout:2114: expect deleted 2024-09-10T18:03:56.530 INFO:tasks.rados.rados.0.smithi012.stdout:2115: delete oid 13 current snap is 217 2024-09-10T18:03:56.533 INFO:tasks.rados.rados.0.smithi012.stdout:2114: done (1 left) 2024-09-10T18:03:56.533 INFO:tasks.rados.rados.0.smithi012.stdout:2115: done (0 left) 2024-09-10T18:03:56.533 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 217 2024-09-10T18:03:56.533 INFO:tasks.rados.rados.0.smithi012.stdout:2116: seq_num 666 ranges {1458176=761856,2220032=491520,2711552=311296} 2024-09-10T18:03:56.545 INFO:tasks.rados.rados.0.smithi012.stdout:2116: writing smithi01278544-26 from 1458176 to 2220032 tid 1 2024-09-10T18:03:56.547 INFO:tasks.rados.rados.0.smithi012.stdout:2116: writing smithi01278544-26 from 2220032 to 2711552 tid 2 2024-09-10T18:03:56.549 INFO:tasks.rados.rados.0.smithi012.stdout:2116: writing smithi01278544-26 from 2711552 to 3022848 tid 3 2024-09-10T18:03:56.549 INFO:tasks.rados.rados.0.smithi012.stdout:2117: read oid 21 snap 205 2024-09-10T18:03:56.549 INFO:tasks.rados.rados.0.smithi012.stdout:2117: expect deleted 2024-09-10T18:03:56.550 INFO:tasks.rados.rados.0.smithi012.stdout:2118: read oid 25 snap 207 2024-09-10T18:03:56.550 INFO:tasks.rados.rados.0.smithi012.stdout:2118: expect deleted 2024-09-10T18:03:56.550 INFO:tasks.rados.rados.0.smithi012.stdout:2119: snap_create 2024-09-10T18:03:56.550 INFO:tasks.rados.rados.0.smithi012.stdout:2116: finishing write tid 1 to smithi01278544-26 2024-09-10T18:03:56.551 INFO:tasks.rados.rados.0.smithi012.stdout:2116: finishing write tid 2 to smithi01278544-26 2024-09-10T18:03:56.553 INFO:tasks.rados.rados.0.smithi012.stdout:2116: finishing write tid 3 to smithi01278544-26 2024-09-10T18:03:56.553 INFO:tasks.rados.rados.0.smithi012.stdout:2116: finishing write tid 4 to smithi01278544-26 2024-09-10T18:03:56.555 INFO:tasks.rados.rados.0.smithi012.stdout:2116: finishing write tid 5 to smithi01278544-26 2024-09-10T18:03:56.555 INFO:tasks.rados.rados.0.smithi012.stdout:2116: oid 26 updating version 0 to 787 2024-09-10T18:03:56.555 INFO:tasks.rados.rados.0.smithi012.stdout:2116: oid 26 version 787 is already newer than 785 2024-09-10T18:03:56.555 INFO:tasks.rados.rados.0.smithi012.stdout:2116: oid 26 version 787 is already newer than 786 2024-09-10T18:03:56.555 INFO:tasks.rados.rados.0.smithi012.stdout:2116: oid 26 version 787 is already newer than 784 2024-09-10T18:03:56.555 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 787 (ObjNum 666 snap 217 seq_num 666) dirty exists 2024-09-10T18:03:56.555 INFO:tasks.rados.rados.0.smithi012.stdout:2116: left oid 26 (ObjNum 666 snap 217 seq_num 666) 2024-09-10T18:03:56.949 INFO:tasks.rados.rados.0.smithi012.stdout:2116: done (3 left) 2024-09-10T18:03:56.949 INFO:tasks.rados.rados.0.smithi012.stdout:2117: done (2 left) 2024-09-10T18:03:56.949 INFO:tasks.rados.rados.0.smithi012.stdout:2118: done (1 left) 2024-09-10T18:03:56.949 INFO:tasks.rados.rados.0.smithi012.stdout:2119: done (0 left) 2024-09-10T18:03:56.949 INFO:tasks.rados.rados.0.smithi012.stdout:2120: read oid 27 snap 206 2024-09-10T18:03:56.950 INFO:tasks.rados.rados.0.smithi012.stdout:2120: expect deleted 2024-09-10T18:03:56.950 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 218 2024-09-10T18:03:56.950 INFO:tasks.rados.rados.0.smithi012.stdout:2121: seq_num 667 ranges {8241152=778240,9019392=778240,9797632=24576} 2024-09-10T18:03:56.998 INFO:tasks.rados.rados.0.smithi012.stdout:2121: writing smithi01278544-35 from 8241152 to 9019392 tid 1 2024-09-10T18:03:57.003 INFO:tasks.rados.rados.0.smithi012.stdout:2121: writing smithi01278544-35 from 9019392 to 9797632 tid 2 2024-09-10T18:03:57.003 INFO:tasks.rados.rados.0.smithi012.stdout:2121: writing smithi01278544-35 from 9797632 to 9822208 tid 3 2024-09-10T18:03:57.003 INFO:tasks.rados.rados.0.smithi012.stdout:2122: rollback oid 40 current snap is 218 2024-09-10T18:03:57.003 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 40 to 196 2024-09-10T18:03:57.003 INFO:tasks.rados.rados.0.smithi012.stdout:2120: done (2 left) 2024-09-10T18:03:57.003 INFO:tasks.rados.rados.0.smithi012.stdout:2123: delete oid 14 current snap is 218 2024-09-10T18:03:57.003 INFO:tasks.rados.rados.0.smithi012.stdout:2121: finishing write tid 1 to smithi01278544-35 2024-09-10T18:03:57.006 INFO:tasks.rados.rados.0.smithi012.stdout:2121: finishing write tid 2 to smithi01278544-35 2024-09-10T18:03:57.006 INFO:tasks.rados.rados.0.smithi012.stdout:2121: finishing write tid 3 to smithi01278544-35 2024-09-10T18:03:57.007 INFO:tasks.rados.rados.0.smithi012.stdout:2121: finishing write tid 4 to smithi01278544-35 2024-09-10T18:03:57.008 INFO:tasks.rados.rados.0.smithi012.stdout:2122: finishing rollback tid 1 to smithi01278544-40 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2121: finishing write tid 5 to smithi01278544-35 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2121: oid 35 updating version 0 to 1122 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2121: oid 35 updating version 1122 to 1123 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2121: oid 35 version 1123 is already newer than 1121 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2121: oid 35 updating version 1123 to 1124 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1124 (ObjNum 667 snap 218 seq_num 667) dirty exists 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2121: left oid 35 (ObjNum 667 snap 218 seq_num 667) 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2122: finishing rollback tid 2 to smithi01278544-40 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1464 (ObjNum 582 snap 195 seq_num 582) dirty exists 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2121: done (2 left) 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2122: done (1 left) 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2123: done (0 left) 2024-09-10T18:03:57.009 INFO:tasks.rados.rados.0.smithi012.stdout:2124: setattr oid 29 current snap is 218 2024-09-10T18:03:57.010 INFO:tasks.rados.rados.0.smithi012.stdout:2125: rollback oid 3 current snap is 218 2024-09-10T18:03:57.010 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 216 2024-09-10T18:03:57.010 INFO:tasks.rados.rados.0.smithi012.stdout:2126: rollback oid 20 current snap is 218 2024-09-10T18:03:57.010 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 192 2024-09-10T18:03:57.010 INFO:tasks.rados.rados.0.smithi012.stdout:2127: read oid 43 snap 206 2024-09-10T18:03:57.011 INFO:tasks.rados.rados.0.smithi012.stdout:2127: expect (ObjNum 548 snap 183 seq_num 548) 2024-09-10T18:03:57.011 INFO:tasks.rados.rados.0.smithi012.stdout:2128: delete oid 8 current snap is 218 2024-09-10T18:03:57.015 INFO:tasks.rados.rados.0.smithi012.stdout:2128: done (4 left) 2024-09-10T18:03:57.015 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 218 2024-09-10T18:03:57.015 INFO:tasks.rados.rados.0.smithi012.stdout:2129: seq_num 670 ranges {0=425984,425984=483328,909312=507904,1417216=212992} 2024-09-10T18:03:57.019 INFO:tasks.rados.rados.0.smithi012.stdout:2129: writing smithi01278544-21 from 0 to 425984 tid 1 2024-09-10T18:03:57.021 INFO:tasks.rados.rados.0.smithi012.stdout:2129: writing smithi01278544-21 from 425984 to 909312 tid 2 2024-09-10T18:03:57.024 INFO:tasks.rados.rados.0.smithi012.stdout:2129: writing smithi01278544-21 from 909312 to 1417216 tid 3 2024-09-10T18:03:57.025 INFO:tasks.rados.rados.0.smithi012.stdout:2129: writing smithi01278544-21 from 1417216 to 1630208 tid 4 2024-09-10T18:03:57.025 INFO:tasks.rados.rados.0.smithi012.stdout:2130: delete oid 12 current snap is 218 2024-09-10T18:03:57.025 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 761 (ObjNum 646 snap 212 seq_num 646) dirty exists 2024-09-10T18:03:57.025 INFO:tasks.rados.rados.0.smithi012.stdout:2126: finishing rollback tid 0 to smithi01278544-20 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:2126: finishing rollback tid 1 to smithi01278544-20 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:2125: finishing rollback tid 0 to smithi01278544-3 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:2126: finishing rollback tid 2 to smithi01278544-20 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1500 (ObjNum 572 snap 190 seq_num 572) dirty exists 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:2125: finishing rollback tid 1 to smithi01278544-3 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:2125: finishing rollback tid 2 to smithi01278544-3 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1250 (ObjNum 561 snap 186 seq_num 561) dirty exists 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:2129: finishing write tid 1 to smithi01278544-21 2024-09-10T18:03:57.026 INFO:tasks.rados.rados.0.smithi012.stdout:2127: expect (ObjNum 548 snap 183 seq_num 548) 2024-09-10T18:03:57.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:56 smithi089 ceph-mon[84132]: osdmap e505: 8 total, 8 up, 8 in 2024-09-10T18:03:57.157 INFO:tasks.rados.rados.0.smithi012.stdout:2129: finishing write tid 2 to smithi01278544-21 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: finishing write tid 3 to smithi01278544-21 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: finishing write tid 4 to smithi01278544-21 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: finishing write tid 5 to smithi01278544-21 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: finishing write tid 6 to smithi01278544-21 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: oid 21 updating version 0 to 889 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: oid 21 updating version 889 to 891 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: oid 21 updating version 891 to 892 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: oid 21 updating version 892 to 893 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: oid 21 version 893 is already newer than 890 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 893 (ObjNum 670 snap 218 seq_num 670) dirty exists 2024-09-10T18:03:57.158 INFO:tasks.rados.rados.0.smithi012.stdout:2129: left oid 21 (ObjNum 670 snap 218 seq_num 670) 2024-09-10T18:03:57.159 INFO:tasks.rados.rados.0.smithi012.stdout:2124: done (5 left) 2024-09-10T18:03:57.159 INFO:tasks.rados.rados.0.smithi012.stdout:2125: done (4 left) 2024-09-10T18:03:57.159 INFO:tasks.rados.rados.0.smithi012.stdout:2126: done (3 left) 2024-09-10T18:03:57.159 INFO:tasks.rados.rados.0.smithi012.stdout:2127: done (2 left) 2024-09-10T18:03:57.159 INFO:tasks.rados.rados.0.smithi012.stdout:2129: done (1 left) 2024-09-10T18:03:57.159 INFO:tasks.rados.rados.0.smithi012.stdout:2130: done (0 left) 2024-09-10T18:03:57.159 INFO:tasks.rados.rados.0.smithi012.stdout:2131: snap_remove snap 211 2024-09-10T18:03:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:56 smithi012 ceph-mon[89611]: osdmap e505: 8 total, 8 up, 8 in 2024-09-10T18:03:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:56 smithi012 ceph-mon[92029]: osdmap e505: 8 total, 8 up, 8 in 2024-09-10T18:03:57.725 INFO:tasks.rados.rados.0.smithi012.stdout:2131: done (0 left) 2024-09-10T18:03:57.726 INFO:tasks.rados.rados.0.smithi012.stdout:2132: snap_remove snap 208 2024-09-10T18:03:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:57 smithi012 ceph-mon[89611]: osdmap e506: 8 total, 8 up, 8 in 2024-09-10T18:03:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:57 smithi012 ceph-mon[89611]: pgmap v432: 121 pgs: 121 active+clean; 368 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.2 MiB/s wr, 9 op/s; 4.5 MiB/s, 1 objects/s recovering 2024-09-10T18:03:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:57 smithi012 ceph-mon[89611]: osdmap e507: 8 total, 8 up, 8 in 2024-09-10T18:03:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:57 smithi012 ceph-mon[92029]: osdmap e506: 8 total, 8 up, 8 in 2024-09-10T18:03:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:57 smithi012 ceph-mon[92029]: pgmap v432: 121 pgs: 121 active+clean; 368 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.2 MiB/s wr, 9 op/s; 4.5 MiB/s, 1 objects/s recovering 2024-09-10T18:03:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:57 smithi012 ceph-mon[92029]: osdmap e507: 8 total, 8 up, 8 in 2024-09-10T18:03:58.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:57 smithi089 ceph-mon[84132]: osdmap e506: 8 total, 8 up, 8 in 2024-09-10T18:03:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:57 smithi089 ceph-mon[84132]: pgmap v432: 121 pgs: 121 active+clean; 368 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.2 MiB/s wr, 9 op/s; 4.5 MiB/s, 1 objects/s recovering 2024-09-10T18:03:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:57 smithi089 ceph-mon[84132]: osdmap e507: 8 total, 8 up, 8 in 2024-09-10T18:03:58.726 INFO:tasks.rados.rados.0.smithi012.stdout:2132: done (0 left) 2024-09-10T18:03:58.726 INFO:tasks.rados.rados.0.smithi012.stdout:2133: rollback oid 34 current snap is 218 2024-09-10T18:03:58.726 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 34 to 213 2024-09-10T18:03:58.726 INFO:tasks.rados.rados.0.smithi012.stdout:2134: snap_remove snap 207 2024-09-10T18:03:59.735 INFO:tasks.rados.rados.0.smithi012.stdout:2134: done (1 left) 2024-09-10T18:03:59.735 INFO:tasks.rados.rados.0.smithi012.stdout:2135: copy_from oid 27 from oid 37 current snap is 218 2024-09-10T18:03:59.735 INFO:tasks.rados.rados.0.smithi012.stdout:2133: finishing rollback tid 0 to smithi01278544-34 2024-09-10T18:03:59.735 INFO:tasks.rados.rados.0.smithi012.stdout:2133: finishing rollback tid 1 to smithi01278544-34 2024-09-10T18:03:59.735 INFO:tasks.rados.rados.0.smithi012.stdout:2133: finishing rollback tid 2 to smithi01278544-34 2024-09-10T18:03:59.735 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 896 (ObjNum 639 snap 212 seq_num 639) dirty exists 2024-09-10T18:03:59.735 INFO:tasks.rados.rados.0.smithi012.stdout:2133: done (1 left) 2024-09-10T18:03:59.735 INFO:tasks.rados.rados.0.smithi012.stdout:2136: snap_remove snap 216 2024-09-10T18:04:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:03:59 smithi012 ceph-mon[89611]: osdmap e508: 8 total, 8 up, 8 in 2024-09-10T18:04:00.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:03:59 smithi012 ceph-mon[92029]: osdmap e508: 8 total, 8 up, 8 in 2024-09-10T18:04:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:03:59 smithi089 ceph-mon[84132]: osdmap e508: 8 total, 8 up, 8 in 2024-09-10T18:04:00.748 INFO:tasks.rados.rados.0.smithi012.stdout:2136: done (1 left) 2024-09-10T18:04:00.749 INFO:tasks.rados.rados.0.smithi012.stdout:2137: delete oid 11 current snap is 218 2024-09-10T18:04:00.749 INFO:tasks.rados.rados.0.smithi012.stdout:2135: finishing copy_from racing read to smithi01278544-27 2024-09-10T18:04:00.749 INFO:tasks.rados.rados.0.smithi012.stdout:2135: finishing copy_from to smithi01278544-27 2024-09-10T18:04:00.749 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 879 (ObjNum 540 snap 182 seq_num 540) dirty exists 2024-09-10T18:04:00.753 INFO:tasks.rados.rados.0.smithi012.stdout:2135: done (1 left) 2024-09-10T18:04:00.753 INFO:tasks.rados.rados.0.smithi012.stdout:2137: done (0 left) 2024-09-10T18:04:00.753 INFO:tasks.rados.rados.0.smithi012.stdout:2138: read oid 47 snap -1 2024-09-10T18:04:00.753 INFO:tasks.rados.rados.0.smithi012.stdout:2138: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:04:00.753 INFO:tasks.rados.rados.0.smithi012.stdout:2139: read oid 1 snap -1 2024-09-10T18:04:00.753 INFO:tasks.rados.rados.0.smithi012.stdout:2139: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:04:00.753 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 218 2024-09-10T18:04:00.753 INFO:tasks.rados.rados.0.smithi012.stdout:2140: seq_num 673 ranges {9199616=475136,9674752=532480,10207232=671744} 2024-09-10T18:04:00.808 INFO:tasks.rados.rados.0.smithi012.stdout:2140: writing smithi01278544-29 from 9199616 to 9674752 tid 1 2024-09-10T18:04:00.811 INFO:tasks.rados.rados.0.smithi012.stdout:2140: writing smithi01278544-29 from 9674752 to 10207232 tid 2 2024-09-10T18:04:00.816 INFO:tasks.rados.rados.0.smithi012.stdout:2140: writing smithi01278544-29 from 10207232 to 10878976 tid 3 2024-09-10T18:04:00.816 INFO:tasks.rados.rados.0.smithi012.stdout:2141: read oid 45 snap 214 2024-09-10T18:04:00.817 INFO:tasks.rados.rados.0.smithi012.stdout:2141: expect (ObjNum 601 snap 199 seq_num 601) 2024-09-10T18:04:00.817 INFO:tasks.rados.rados.0.smithi012.stdout:2142: snap_remove snap 212 2024-09-10T18:04:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:00 smithi012 ceph-mon[89611]: pgmap v435: 121 pgs: 121 active+clean; 386 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 24 MiB/s rd, 5.6 MiB/s wr, 15 op/s 2024-09-10T18:04:01.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:00 smithi012 ceph-mon[89611]: osdmap e509: 8 total, 8 up, 8 in 2024-09-10T18:04:01.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:00 smithi012 ceph-mon[92029]: pgmap v435: 121 pgs: 121 active+clean; 386 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 24 MiB/s rd, 5.6 MiB/s wr, 15 op/s 2024-09-10T18:04:01.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:00 smithi012 ceph-mon[92029]: osdmap e509: 8 total, 8 up, 8 in 2024-09-10T18:04:01.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:00 smithi089 ceph-mon[84132]: pgmap v435: 121 pgs: 121 active+clean; 386 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 24 MiB/s rd, 5.6 MiB/s wr, 15 op/s 2024-09-10T18:04:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:00 smithi089 ceph-mon[84132]: osdmap e509: 8 total, 8 up, 8 in 2024-09-10T18:04:01.751 INFO:tasks.rados.rados.0.smithi012.stdout:2142: done (4 left) 2024-09-10T18:04:01.751 INFO:tasks.rados.rados.0.smithi012.stdout:2143: snap_create 2024-09-10T18:04:01.752 INFO:tasks.rados.rados.0.smithi012.stdout:2139: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:04:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:01 smithi012 ceph-mon[89611]: osdmap e510: 8 total, 8 up, 8 in 2024-09-10T18:04:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:02.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:01 smithi012 ceph-mon[92029]: osdmap e510: 8 total, 8 up, 8 in 2024-09-10T18:04:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:02.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:01 smithi089 ceph-mon[84132]: osdmap e510: 8 total, 8 up, 8 in 2024-09-10T18:04:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:02 smithi012 ceph-mon[89611]: pgmap v438: 121 pgs: 121 active+clean; 386 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 4.4 MiB/s wr, 6 op/s 2024-09-10T18:04:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:02 smithi012 ceph-mon[89611]: osdmap e511: 8 total, 8 up, 8 in 2024-09-10T18:04:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:02 smithi012 ceph-mon[89611]: osdmap e512: 8 total, 8 up, 8 in 2024-09-10T18:04:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:02 smithi012 ceph-mon[92029]: pgmap v438: 121 pgs: 121 active+clean; 386 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 4.4 MiB/s wr, 6 op/s 2024-09-10T18:04:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:02 smithi012 ceph-mon[92029]: osdmap e511: 8 total, 8 up, 8 in 2024-09-10T18:04:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:02 smithi012 ceph-mon[92029]: osdmap e512: 8 total, 8 up, 8 in 2024-09-10T18:04:03.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:02 smithi089 ceph-mon[84132]: pgmap v438: 121 pgs: 121 active+clean; 386 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 5.9 MiB/s rd, 4.4 MiB/s wr, 6 op/s 2024-09-10T18:04:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:02 smithi089 ceph-mon[84132]: osdmap e511: 8 total, 8 up, 8 in 2024-09-10T18:04:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:02 smithi089 ceph-mon[84132]: osdmap e512: 8 total, 8 up, 8 in 2024-09-10T18:04:03.156 INFO:tasks.rados.rados.0.smithi012.stdout:2138: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:04:04.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:04:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:04:03] "GET /metrics HTTP/1.1" 200 36283 "" "Prometheus/2.43.0" 2024-09-10T18:04:04.550 INFO:tasks.rados.rados.0.smithi012.stdout:2140: finishing write tid 1 to smithi01278544-29 2024-09-10T18:04:04.550 INFO:tasks.rados.rados.0.smithi012.stdout:2140: finishing write tid 2 to smithi01278544-29 2024-09-10T18:04:04.550 INFO:tasks.rados.rados.0.smithi012.stdout:2140: finishing write tid 3 to smithi01278544-29 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:2140: finishing write tid 4 to smithi01278544-29 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:2140: finishing write tid 5 to smithi01278544-29 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:2140: oid 29 updating version 0 to 765 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:2140: oid 29 version 765 is already newer than 762 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:2140: oid 29 version 765 is already newer than 764 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:2140: oid 29 version 765 is already newer than 763 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 765 (ObjNum 673 snap 218 seq_num 673) dirty exists 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:2140: left oid 29 (ObjNum 673 snap 218 seq_num 673) 2024-09-10T18:04:04.551 INFO:tasks.rados.rados.0.smithi012.stdout:2141: expect (ObjNum 601 snap 199 seq_num 601) 2024-09-10T18:04:04.577 INFO:tasks.rados.rados.0.smithi012.stdout:2138: done (4 left) 2024-09-10T18:04:04.577 INFO:tasks.rados.rados.0.smithi012.stdout:2139: done (3 left) 2024-09-10T18:04:04.578 INFO:tasks.rados.rados.0.smithi012.stdout:2140: done (2 left) 2024-09-10T18:04:04.578 INFO:tasks.rados.rados.0.smithi012.stdout:2141: done (1 left) 2024-09-10T18:04:04.578 INFO:tasks.rados.rados.0.smithi012.stdout:2143: done (0 left) 2024-09-10T18:04:04.578 INFO:tasks.rados.rados.0.smithi012.stdout:2144: setattr oid 11 current snap is 219 2024-09-10T18:04:04.579 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 219 2024-09-10T18:04:04.579 INFO:tasks.rados.rados.0.smithi012.stdout:2145: seq_num 674 ranges {0=491520,491520=417792,909312=483328,1392640=303104} 2024-09-10T18:04:04.581 INFO:tasks.rados.rados.0.smithi012.stdout:2145: writing smithi01278544-16 from 0 to 491520 tid 1 2024-09-10T18:04:04.584 INFO:tasks.rados.rados.0.smithi012.stdout:2145: writing smithi01278544-16 from 491520 to 909312 tid 2 2024-09-10T18:04:04.587 INFO:tasks.rados.rados.0.smithi012.stdout:2145: writing smithi01278544-16 from 909312 to 1392640 tid 3 2024-09-10T18:04:04.589 INFO:tasks.rados.rados.0.smithi012.stdout:2145: writing smithi01278544-16 from 1392640 to 1695744 tid 4 2024-09-10T18:04:04.589 INFO:tasks.rados.rados.0.smithi012.stdout:2146: delete oid 49 current snap is 219 2024-09-10T18:04:04.589 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1542 (ObjNum 65 snap 0 seq_num 1852858979) dirty exists 2024-09-10T18:04:04.590 INFO:tasks.rados.rados.0.smithi012.stdout:2145: finishing write tid 1 to smithi01278544-16 2024-09-10T18:04:04.590 INFO:tasks.rados.rados.0.smithi012.stdout:2145: finishing write tid 2 to smithi01278544-16 2024-09-10T18:04:04.590 INFO:tasks.rados.rados.0.smithi012.stdout:2145: finishing write tid 3 to smithi01278544-16 2024-09-10T18:04:04.592 INFO:tasks.rados.rados.0.smithi012.stdout:2144: done (2 left) 2024-09-10T18:04:04.592 INFO:tasks.rados.rados.0.smithi012.stdout:2146: done (1 left) 2024-09-10T18:04:04.592 INFO:tasks.rados.rados.0.smithi012.stdout:2147: read oid 3 snap 205 2024-09-10T18:04:04.592 INFO:tasks.rados.rados.0.smithi012.stdout:2147: expect (ObjNum 561 snap 186 seq_num 561) 2024-09-10T18:04:04.592 INFO:tasks.rados.rados.0.smithi012.stdout:2148: read oid 15 snap -1 2024-09-10T18:04:04.592 INFO:tasks.rados.rados.0.smithi012.stdout:2148: expect (ObjNum 657 snap 214 seq_num 657) 2024-09-10T18:04:04.592 INFO:tasks.rados.rados.0.smithi012.stdout:2149: read oid 21 snap -1 2024-09-10T18:04:04.592 INFO:tasks.rados.rados.0.smithi012.stdout:2149: expect (ObjNum 670 snap 218 seq_num 670) 2024-09-10T18:04:04.593 INFO:tasks.rados.rados.0.smithi012.stdout:2150: read oid 34 snap -1 2024-09-10T18:04:04.593 INFO:tasks.rados.rados.0.smithi012.stdout:2150: expect (ObjNum 639 snap 212 seq_num 639) 2024-09-10T18:04:04.593 INFO:tasks.rados.rados.0.smithi012.stdout:2151: snap_remove snap 206 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2151: done (5 left) 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2152: snap_create 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2145: finishing write tid 4 to smithi01278544-16 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2145: finishing write tid 5 to smithi01278544-16 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2145: finishing write tid 6 to smithi01278544-16 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2145: oid 16 updating version 0 to 1110 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2145: oid 16 version 1110 is already newer than 1109 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2145: oid 16 updating version 1110 to 1112 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2145: oid 16 version 1112 is already newer than 1111 2024-09-10T18:04:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2145: oid 16 version 1112 is already newer than 1108 2024-09-10T18:04:04.757 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 1112 (ObjNum 674 snap 219 seq_num 674) dirty exists 2024-09-10T18:04:04.757 INFO:tasks.rados.rados.0.smithi012.stdout:2145: left oid 16 (ObjNum 674 snap 219 seq_num 674) 2024-09-10T18:04:04.757 INFO:tasks.rados.rados.0.smithi012.stdout:2149: expect (ObjNum 670 snap 218 seq_num 670) 2024-09-10T18:04:04.807 INFO:tasks.rados.rados.0.smithi012.stdout:2148: expect (ObjNum 657 snap 214 seq_num 657) 2024-09-10T18:04:04.868 INFO:tasks.rados.rados.0.smithi012.stdout:2150: expect (ObjNum 639 snap 212 seq_num 639) 2024-09-10T18:04:04.899 INFO:tasks.rados.rados.0.smithi012.stdout:2147: expect (ObjNum 561 snap 186 seq_num 561) 2024-09-10T18:04:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:04 smithi012 ceph-mon[89611]: pgmap v441: 121 pgs: 121 active+clean; 395 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2024-09-10T18:04:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:04 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-10T18:04:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:04 smithi012 ceph-mon[92029]: pgmap v441: 121 pgs: 121 active+clean; 395 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2024-09-10T18:04:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:04 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-10T18:04:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:04 smithi089 ceph-mon[84132]: pgmap v441: 121 pgs: 121 active+clean; 395 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2024-09-10T18:04:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:04 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-10T18:04:05.762 INFO:tasks.rados.rados.0.smithi012.stdout:2145: done (5 left) 2024-09-10T18:04:05.762 INFO:tasks.rados.rados.0.smithi012.stdout:2147: done (4 left) 2024-09-10T18:04:05.762 INFO:tasks.rados.rados.0.smithi012.stdout:2148: done (3 left) 2024-09-10T18:04:05.762 INFO:tasks.rados.rados.0.smithi012.stdout:2149: done (2 left) 2024-09-10T18:04:05.762 INFO:tasks.rados.rados.0.smithi012.stdout:2150: done (1 left) 2024-09-10T18:04:05.762 INFO:tasks.rados.rados.0.smithi012.stdout:2152: done (0 left) 2024-09-10T18:04:05.762 INFO:tasks.rados.rados.0.smithi012.stdout:2153: snap_remove snap 217 2024-09-10T18:04:05.988 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:05 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-10T18:04:05.988 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:05 smithi089 ceph-mon[84132]: Upgrade: osd.7 is safe to restart 2024-09-10T18:04:05.988 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:05 smithi089 ceph-mon[84132]: osdmap e513: 8 total, 8 up, 8 in 2024-09-10T18:04:05.988 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:05.988 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T18:04:05.988 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:05 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-10T18:04:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[89611]: Upgrade: osd.7 is safe to restart 2024-09-10T18:04:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[89611]: osdmap e513: 8 total, 8 up, 8 in 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[92029]: Upgrade: osd.7 is safe to restart 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[92029]: osdmap e513: 8 total, 8 up, 8 in 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T18:04:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:05 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:06.764 INFO:tasks.rados.rados.0.smithi012.stdout:2153: done (0 left) 2024-09-10T18:04:06.764 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 220 2024-09-10T18:04:06.764 INFO:tasks.rados.rados.0.smithi012.stdout:2154: seq_num 676 ranges {6332416=524288,6856704=589824,7446528=450560,7897088=163840} 2024-09-10T18:04:06.801 INFO:tasks.rados.rados.0.smithi012.stdout:2154: writing smithi01278544-6 from 6332416 to 6856704 tid 1 2024-09-10T18:04:06.805 INFO:tasks.rados.rados.0.smithi012.stdout:2154: writing smithi01278544-6 from 6856704 to 7446528 tid 2 2024-09-10T18:04:06.808 INFO:tasks.rados.rados.0.smithi012.stdout:2154: writing smithi01278544-6 from 7446528 to 7897088 tid 3 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:2154: writing smithi01278544-6 from 7897088 to 8060928 tid 4 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:2155: copy_from oid 20 from oid 45 current snap is 220 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:2156: rollback oid 39 current snap is 220 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 218 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:2157: read oid 30 snap 214 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:2157: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:2158: rmattr oid 23 current snap is 220 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:2158: done (4 left) 2024-09-10T18:04:06.810 INFO:tasks.rados.rados.0.smithi012.stdout:2159: delete oid 27 current snap is 220 2024-09-10T18:04:06.811 INFO:tasks.rados.rados.0.smithi012.stdout:2154: finishing write tid 1 to smithi01278544-6 2024-09-10T18:04:06.813 INFO:tasks.rados.rados.0.smithi012.stdout:2159: done (4 left) 2024-09-10T18:04:06.813 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 220 2024-09-10T18:04:06.813 INFO:tasks.rados.rados.0.smithi012.stdout:2160: seq_num 678 ranges {12460032=565248,13025280=802816,13828096=401408} 2024-09-10T18:04:06.885 INFO:tasks.rados.rados.0.smithi012.stdout:2160: writing smithi01278544-32 from 12460032 to 13025280 tid 1 2024-09-10T18:04:06.890 INFO:tasks.rados.rados.0.smithi012.stdout:2160: writing smithi01278544-32 from 13025280 to 13828096 tid 2 2024-09-10T18:04:06.893 INFO:tasks.rados.rados.0.smithi012.stdout:2160: writing smithi01278544-32 from 13828096 to 14229504 tid 3 2024-09-10T18:04:06.893 INFO:tasks.rados.rados.0.smithi012.stdout:2161: rmattr oid 31 current snap is 220 2024-09-10T18:04:06.893 INFO:tasks.rados.rados.0.smithi012.stdout:2161: done (5 left) 2024-09-10T18:04:06.893 INFO:tasks.rados.rados.0.smithi012.stdout:2162: snap_create 2024-09-10T18:04:06.893 INFO:tasks.rados.rados.0.smithi012.stdout:2154: finishing write tid 2 to smithi01278544-6 2024-09-10T18:04:06.893 INFO:tasks.rados.rados.0.smithi012.stdout:2156: finishing rollback tid 0 to smithi01278544-39 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: finishing write tid 3 to smithi01278544-6 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: finishing write tid 4 to smithi01278544-6 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: finishing write tid 5 to smithi01278544-6 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: finishing write tid 6 to smithi01278544-6 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: oid 6 updating version 0 to 1114 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: oid 6 updating version 1114 to 1116 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: oid 6 version 1116 is already newer than 1113 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: oid 6 updating version 1116 to 1117 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: oid 6 version 1117 is already newer than 1115 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 1117 (ObjNum 676 snap 220 seq_num 676) dirty exists 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2154: left oid 6 (ObjNum 676 snap 220 seq_num 676) 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2155: finishing copy_from racing read to smithi01278544-20 2024-09-10T18:04:06.894 INFO:tasks.rados.rados.0.smithi012.stdout:2156: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:04:06.895 INFO:tasks.rados.rados.0.smithi012.stdout:2156: finishing rollback tid 2 to smithi01278544-39 2024-09-10T18:04:06.895 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1558 (ObjNum 663 snap 217 seq_num 663) dirty exists 2024-09-10T18:04:06.895 INFO:tasks.rados.rados.0.smithi012.stdout:2155: finishing copy_from to smithi01278544-20 2024-09-10T18:04:06.895 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1289 (ObjNum 601 snap 199 seq_num 601) dirty exists 2024-09-10T18:04:06.895 INFO:tasks.rados.rados.0.smithi012.stdout:2157: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:04:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:06 smithi012 ceph-mon[89611]: pgmap v443: 121 pgs: 121 active+clean; 394 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2024-09-10T18:04:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:06 smithi012 ceph-mon[89611]: Upgrade: Updating osd.7 2024-09-10T18:04:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:06 smithi012 ceph-mon[89611]: Deploying daemon osd.7 on smithi089 2024-09-10T18:04:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:06 smithi012 ceph-mon[89611]: osdmap e514: 8 total, 8 up, 8 in 2024-09-10T18:04:07.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:06 smithi012 ceph-mon[92029]: pgmap v443: 121 pgs: 121 active+clean; 394 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2024-09-10T18:04:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:06 smithi012 ceph-mon[92029]: Upgrade: Updating osd.7 2024-09-10T18:04:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:06 smithi012 ceph-mon[92029]: Deploying daemon osd.7 on smithi089 2024-09-10T18:04:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:06 smithi012 ceph-mon[92029]: osdmap e514: 8 total, 8 up, 8 in 2024-09-10T18:04:07.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:06 smithi089 ceph-mon[84132]: pgmap v443: 121 pgs: 121 active+clean; 394 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2024-09-10T18:04:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:06 smithi089 ceph-mon[84132]: Upgrade: Updating osd.7 2024-09-10T18:04:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:06 smithi089 ceph-mon[84132]: Deploying daemon osd.7 on smithi089 2024-09-10T18:04:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:06 smithi089 ceph-mon[84132]: osdmap e514: 8 total, 8 up, 8 in 2024-09-10T18:04:08.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:07 smithi012 ceph-mon[89611]: osdmap e515: 8 total, 8 up, 8 in 2024-09-10T18:04:08.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:07 smithi012 ceph-mon[89611]: osdmap e516: 8 total, 8 up, 8 in 2024-09-10T18:04:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:07 smithi012 ceph-mon[92029]: osdmap e515: 8 total, 8 up, 8 in 2024-09-10T18:04:08.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:07 smithi012 ceph-mon[92029]: osdmap e516: 8 total, 8 up, 8 in 2024-09-10T18:04:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:07 smithi089 ceph-mon[84132]: osdmap e515: 8 total, 8 up, 8 in 2024-09-10T18:04:08.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:07 smithi089 ceph-mon[84132]: osdmap e516: 8 total, 8 up, 8 in 2024-09-10T18:04:08.690 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:08 smithi089 systemd[1]: Stopping Ceph osd.7 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:04:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:2160: finishing write tid 1 to smithi01278544-32 2024-09-10T18:04:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:2160: finishing write tid 2 to smithi01278544-32 2024-09-10T18:04:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:2160: finishing write tid 3 to smithi01278544-32 2024-09-10T18:04:08.768 INFO:tasks.rados.rados.0.smithi012.stdout:2160: finishing write tid 4 to smithi01278544-32 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2160: finishing write tid 5 to smithi01278544-32 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2160: oid 32 updating version 0 to 1127 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2160: oid 32 version 1127 is already newer than 1126 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2160: oid 32 version 1127 is already newer than 1125 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2160: oid 32 updating version 1127 to 1128 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1128 (ObjNum 678 snap 220 seq_num 678) dirty exists 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2160: left oid 32 (ObjNum 678 snap 220 seq_num 678) 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2154: done (5 left) 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2155: done (4 left) 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2156: done (3 left) 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2157: done (2 left) 2024-09-10T18:04:08.769 INFO:tasks.rados.rados.0.smithi012.stdout:2160: done (1 left) 2024-09-10T18:04:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:2162: done (0 left) 2024-09-10T18:04:08.770 INFO:tasks.rados.rados.0.smithi012.stdout:2163: delete oid 46 current snap is 221 2024-09-10T18:04:08.771 INFO:tasks.rados.rados.0.smithi012.stdout:2163: done (0 left) 2024-09-10T18:04:08.771 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 221 2024-09-10T18:04:08.771 INFO:tasks.rados.rados.0.smithi012.stdout:2164: seq_num 680 ranges {0=598016,598016=573440,1171456=434176,1605632=196608} 2024-09-10T18:04:08.774 INFO:tasks.rados.rados.0.smithi012.stdout:2164: writing smithi01278544-49 from 0 to 598016 tid 1 2024-09-10T18:04:08.778 INFO:tasks.rados.rados.0.smithi012.stdout:2164: writing smithi01278544-49 from 598016 to 1171456 tid 2 2024-09-10T18:04:08.780 INFO:tasks.rados.rados.0.smithi012.stdout:2164: writing smithi01278544-49 from 1171456 to 1605632 tid 3 2024-09-10T18:04:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:2164: writing smithi01278544-49 from 1605632 to 1802240 tid 4 2024-09-10T18:04:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:2165: rmattr oid 35 current snap is 221 2024-09-10T18:04:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:2164: finishing write tid 1 to smithi01278544-49 2024-09-10T18:04:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 221 2024-09-10T18:04:08.782 INFO:tasks.rados.rados.0.smithi012.stdout:2166: seq_num 681 ranges {0=614400,614400=458752,1073152=638976,1712128=106496} 2024-09-10T18:04:08.785 INFO:tasks.rados.rados.0.smithi012.stdout:2166: writing smithi01278544-44 from 0 to 614400 tid 1 2024-09-10T18:04:08.789 INFO:tasks.rados.rados.0.smithi012.stdout:2166: writing smithi01278544-44 from 614400 to 1073152 tid 2 2024-09-10T18:04:08.794 INFO:tasks.rados.rados.0.smithi012.stdout:2166: writing smithi01278544-44 from 1073152 to 1712128 tid 3 2024-09-10T18:04:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2166: writing smithi01278544-44 from 1712128 to 1818624 tid 4 2024-09-10T18:04:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2167: delete oid 19 current snap is 221 2024-09-10T18:04:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 0 (ObjNum 667 snap 218 seq_num 667) dirty exists 2024-09-10T18:04:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2164: finishing write tid 2 to smithi01278544-49 2024-09-10T18:04:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2164: finishing write tid 3 to smithi01278544-49 2024-09-10T18:04:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2164: finishing write tid 4 to smithi01278544-49 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2164: finishing write tid 5 to smithi01278544-49 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2164: finishing write tid 6 to smithi01278544-49 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2164: oid 49 updating version 0 to 1120 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2164: oid 49 updating version 1120 to 1121 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2164: oid 49 version 1121 is already newer than 1119 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2164: oid 49 updating version 1121 to 1122 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2164: oid 49 version 1122 is already newer than 1118 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1122 (ObjNum 680 snap 221 seq_num 680) dirty exists 2024-09-10T18:04:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2164: left oid 49 (ObjNum 680 snap 221 seq_num 680) 2024-09-10T18:04:08.801 INFO:tasks.rados.rados.0.smithi012.stdout:2164: done (3 left) 2024-09-10T18:04:08.801 INFO:tasks.rados.rados.0.smithi012.stdout:2165: done (2 left) 2024-09-10T18:04:08.801 INFO:tasks.rados.rados.0.smithi012.stdout:2167: done (1 left) 2024-09-10T18:04:08.801 INFO:tasks.rados.rados.0.smithi012.stdout:2168: setattr oid 46 current snap is 221 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2166: finishing write tid 1 to smithi01278544-44 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2166: finishing write tid 2 to smithi01278544-44 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2166: finishing write tid 3 to smithi01278544-44 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2169: read oid 2 snap -1 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2169: expect deleted 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2170: copy_from oid 7 from oid 21 current snap is 221 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2171: read oid 38 snap -1 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2171: expect (ObjNum 664 snap 217 seq_num 664) 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2172: snap_create 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2166: finishing write tid 4 to smithi01278544-44 2024-09-10T18:04:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2166: finishing write tid 5 to smithi01278544-44 2024-09-10T18:04:08.806 INFO:tasks.rados.rados.0.smithi012.stdout:2166: finishing write tid 6 to smithi01278544-44 2024-09-10T18:04:08.806 INFO:tasks.rados.rados.0.smithi012.stdout:2166: oid 44 updating version 0 to 1254 2024-09-10T18:04:08.806 INFO:tasks.rados.rados.0.smithi012.stdout:2166: oid 44 updating version 1254 to 1256 2024-09-10T18:04:08.807 INFO:tasks.rados.rados.0.smithi012.stdout:2166: oid 44 updating version 1256 to 1257 2024-09-10T18:04:08.807 INFO:tasks.rados.rados.0.smithi012.stdout:2166: oid 44 version 1257 is already newer than 1253 2024-09-10T18:04:08.807 INFO:tasks.rados.rados.0.smithi012.stdout:2166: oid 44 version 1257 is already newer than 1255 2024-09-10T18:04:08.807 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1257 (ObjNum 681 snap 221 seq_num 681) dirty exists 2024-09-10T18:04:08.807 INFO:tasks.rados.rados.0.smithi012.stdout:2166: left oid 44 (ObjNum 681 snap 221 seq_num 681) 2024-09-10T18:04:08.807 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1258 (ObjNum 129 snap 0 seq_num 3496957216) dirty exists 2024-09-10T18:04:08.809 INFO:tasks.rados.rados.0.smithi012.stdout:2170: finishing copy_from racing read to smithi01278544-7 2024-09-10T18:04:08.811 INFO:tasks.rados.rados.0.smithi012.stdout:2170: finishing copy_from to smithi01278544-7 2024-09-10T18:04:08.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 893 (ObjNum 670 snap 218 seq_num 670) dirty exists 2024-09-10T18:04:08.811 INFO:tasks.rados.rados.0.smithi012.stdout:2171: expect (ObjNum 664 snap 217 seq_num 664) 2024-09-10T18:04:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:08 smithi012 ceph-mon[89611]: pgmap v446: 121 pgs: 121 active+clean; 396 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 383 KiB/s wr, 11 op/s 2024-09-10T18:04:09.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:08 smithi012 ceph-mon[89611]: osd.7 marked itself down and dead 2024-09-10T18:04:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:08 smithi012 ceph-mon[92029]: pgmap v446: 121 pgs: 121 active+clean; 396 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 383 KiB/s wr, 11 op/s 2024-09-10T18:04:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:08 smithi012 ceph-mon[92029]: osd.7 marked itself down and dead 2024-09-10T18:04:09.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:08 smithi089 ceph-mon[84132]: pgmap v446: 121 pgs: 121 active+clean; 396 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 383 KiB/s wr, 11 op/s 2024-09-10T18:04:09.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:08 smithi089 ceph-mon[84132]: osd.7 marked itself down and dead 2024-09-10T18:04:09.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:08 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[53229]: 2024-09-10T18:04:08.687+0000 7f5bcf841640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:04:09.037 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:08 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[53229]: 2024-09-10T18:04:08.687+0000 7f5bcf841640 -1 osd.7 516 *** Got signal Terminated *** 2024-09-10T18:04:09.037 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:08 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[53229]: 2024-09-10T18:04:08.687+0000 7f5bcf841640 -1 osd.7 516 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:04:09.606 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:09 smithi089 podman[103202]: 2024-09-10 18:04:09.340127975 +0000 UTC m=+0.748737778 container died 7b26d2347fc8cdf1df16459c91568eb1af7b772b13fab8604df063a615ceb41a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-7a853b1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T18:04:09.797 INFO:tasks.rados.rados.0.smithi012.stdout:2166: done (5 left) 2024-09-10T18:04:09.797 INFO:tasks.rados.rados.0.smithi012.stdout:2168: done (4 left) 2024-09-10T18:04:09.797 INFO:tasks.rados.rados.0.smithi012.stdout:2170: done (3 left) 2024-09-10T18:04:09.797 INFO:tasks.rados.rados.0.smithi012.stdout:2171: done (2 left) 2024-09-10T18:04:09.797 INFO:tasks.rados.rados.0.smithi012.stdout:2172: done (1 left) 2024-09-10T18:04:09.798 INFO:tasks.rados.rados.0.smithi012.stdout:2173: snap_create 2024-09-10T18:04:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:09 smithi012 ceph-mon[89611]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:04:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:09 smithi012 ceph-mon[89611]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-10T18:04:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:09 smithi012 ceph-mon[89611]: osdmap e517: 8 total, 7 up, 8 in 2024-09-10T18:04:10.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:09 smithi012 ceph-mon[92029]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:04:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:09 smithi012 ceph-mon[92029]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-10T18:04:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:09 smithi012 ceph-mon[92029]: osdmap e517: 8 total, 7 up, 8 in 2024-09-10T18:04:10.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:09 smithi089 ceph-mon[84132]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T18:04:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:09 smithi089 ceph-mon[84132]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-10T18:04:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:09 smithi089 ceph-mon[84132]: osdmap e517: 8 total, 7 up, 8 in 2024-09-10T18:04:10.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:09 smithi089 podman[103202]: 2024-09-10 18:04:09.81331293 +0000 UTC m=+1.221922781 container cleanup 7b26d2347fc8cdf1df16459c91568eb1af7b772b13fab8604df063a615ceb41a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, RELEASE=reef-7a853b1, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T18:04:10.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:09 smithi089 bash[103202]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7 2024-09-10T18:04:10.416 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:10 smithi089 podman[103227]: 2024-09-10 18:04:10.106867205 +0000 UTC m=+0.761816442 container remove 7b26d2347fc8cdf1df16459c91568eb1af7b772b13fab8604df063a615ceb41a (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=reef-7a853b1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-10T18:04:10.728 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:10 smithi089 podman[103316]: 2024-09-10 18:04:10.415856523 +0000 UTC m=+0.108691175 container create dc49468e685689d868ffc1a2fe77b74ec5c35938a5e64b6c5cae8b9868ac8f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:04:10.728 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:10 smithi089 podman[103316]: 2024-09-10 18:04:10.322983494 +0000 UTC m=+0.015818159 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:04:10.728 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:10 smithi089 podman[103316]: 2024-09-10 18:04:10.626821127 +0000 UTC m=+0.319655791 container init dc49468e685689d868ffc1a2fe77b74ec5c35938a5e64b6c5cae8b9868ac8f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T18:04:10.728 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:10 smithi089 podman[103316]: 2024-09-10 18:04:10.630112455 +0000 UTC m=+0.322947107 container start dc49468e685689d868ffc1a2fe77b74ec5c35938a5e64b6c5cae8b9868ac8f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:04:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:2169: done (1 left) 2024-09-10T18:04:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:2173: done (0 left) 2024-09-10T18:04:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:2174: delete oid 45 current snap is 223 2024-09-10T18:04:10.802 INFO:tasks.rados.rados.0.smithi012.stdout:2174: done (0 left) 2024-09-10T18:04:10.802 INFO:tasks.rados.rados.0.smithi012.stdout:2175: read oid 40 snap -1 2024-09-10T18:04:10.802 INFO:tasks.rados.rados.0.smithi012.stdout:2175: expect (ObjNum 582 snap 195 seq_num 582) 2024-09-10T18:04:10.802 INFO:tasks.rados.rados.0.smithi012.stdout:2176: snap_remove snap 220 2024-09-10T18:04:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:10 smithi012 ceph-mon[89611]: pgmap v449: 121 pgs: 18 stale+active+clean, 103 active+clean; 397 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 846 KiB/s wr, 13 op/s 2024-09-10T18:04:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:10 smithi012 ceph-mon[89611]: osdmap e518: 8 total, 7 up, 8 in 2024-09-10T18:04:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:10 smithi012 ceph-mon[92029]: pgmap v449: 121 pgs: 18 stale+active+clean, 103 active+clean; 397 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 846 KiB/s wr, 13 op/s 2024-09-10T18:04:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:10 smithi012 ceph-mon[92029]: osdmap e518: 8 total, 7 up, 8 in 2024-09-10T18:04:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:10 smithi089 ceph-mon[84132]: pgmap v449: 121 pgs: 18 stale+active+clean, 103 active+clean; 397 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 846 KiB/s wr, 13 op/s 2024-09-10T18:04:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:10 smithi089 ceph-mon[84132]: osdmap e518: 8 total, 7 up, 8 in 2024-09-10T18:04:11.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:10 smithi089 podman[103316]: 2024-09-10 18:04:10.726805754 +0000 UTC m=+0.419640414 container attach dc49468e685689d868ffc1a2fe77b74ec5c35938a5e64b6c5cae8b9868ac8f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T18:04:11.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:10 smithi089 podman[103316]: 2024-09-10 18:04:10.828680538 +0000 UTC m=+0.521515192 container died dc49468e685689d868ffc1a2fe77b74ec5c35938a5e64b6c5cae8b9868ac8f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T18:04:11.786 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:11 smithi089 podman[103338]: 2024-09-10 18:04:11.422164726 +0000 UTC m=+0.586354670 container remove dc49468e685689d868ffc1a2fe77b74ec5c35938a5e64b6c5cae8b9868ac8f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:04:11.786 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:11 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.7.service: Deactivated successfully. 2024-09-10T18:04:11.786 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:11 smithi089 systemd[1]: Stopped Ceph osd.7 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:04:11.786 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:11 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.7.service: Consumed 14.765s CPU time. 2024-09-10T18:04:11.786 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:11 smithi089 systemd[1]: Starting Ceph osd.7 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:04:11.806 INFO:tasks.rados.rados.0.smithi012.stdout:2176: done (1 left) 2024-09-10T18:04:11.807 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 223 2024-09-10T18:04:11.807 INFO:tasks.rados.rados.0.smithi012.stdout:2177: seq_num 684 ranges {40960=663552,704512=507904,1212416=409600,1622016=286720} 2024-09-10T18:04:11.811 INFO:tasks.rados.rados.0.smithi012.stdout:2177: writing smithi01278544-36 from 40960 to 704512 tid 1 2024-09-10T18:04:11.815 INFO:tasks.rados.rados.0.smithi012.stdout:2177: writing smithi01278544-36 from 704512 to 1212416 tid 2 2024-09-10T18:04:11.818 INFO:tasks.rados.rados.0.smithi012.stdout:2177: writing smithi01278544-36 from 1212416 to 1622016 tid 3 2024-09-10T18:04:11.820 INFO:tasks.rados.rados.0.smithi012.stdout:2177: writing smithi01278544-36 from 1622016 to 1908736 tid 4 2024-09-10T18:04:11.820 INFO:tasks.rados.rados.0.smithi012.stdout:2178: delete oid 1 current snap is 223 2024-09-10T18:04:11.820 INFO:tasks.rados.rados.0.smithi012.stdout:2175: expect (ObjNum 582 snap 195 seq_num 582) 2024-09-10T18:04:11.827 INFO:tasks.rados.rados.0.smithi012.stdout:2175: done (2 left) 2024-09-10T18:04:11.827 INFO:tasks.rados.rados.0.smithi012.stdout:2178: done (1 left) 2024-09-10T18:04:11.827 INFO:tasks.rados.rados.0.smithi012.stdout:2177: finishing write tid 1 to smithi01278544-36 2024-09-10T18:04:11.827 INFO:tasks.rados.rados.0.smithi012.stdout:2177: finishing write tid 2 to smithi01278544-36 2024-09-10T18:04:11.828 INFO:tasks.rados.rados.0.smithi012.stdout:2177: finishing write tid 3 to smithi01278544-36 2024-09-10T18:04:11.828 INFO:tasks.rados.rados.0.smithi012.stdout:2177: finishing write tid 4 to smithi01278544-36 2024-09-10T18:04:11.828 INFO:tasks.rados.rados.0.smithi012.stdout:2177: finishing write tid 5 to smithi01278544-36 2024-09-10T18:04:11.828 INFO:tasks.rados.rados.0.smithi012.stdout:2179: read oid 9 snap -1 2024-09-10T18:04:11.828 INFO:tasks.rados.rados.0.smithi012.stdout:2179: expect deleted 2024-09-10T18:04:11.828 INFO:tasks.rados.rados.0.smithi012.stdout:2180: delete oid 22 current snap is 223 2024-09-10T18:04:11.829 INFO:tasks.rados.rados.0.smithi012.stdout:2177: finishing write tid 6 to smithi01278544-36 2024-09-10T18:04:11.829 INFO:tasks.rados.rados.0.smithi012.stdout:2177: oid 36 updating version 0 to 792 2024-09-10T18:04:11.829 INFO:tasks.rados.rados.0.smithi012.stdout:2177: oid 36 version 792 is already newer than 791 2024-09-10T18:04:11.830 INFO:tasks.rados.rados.0.smithi012.stdout:2177: oid 36 version 792 is already newer than 789 2024-09-10T18:04:11.830 INFO:tasks.rados.rados.0.smithi012.stdout:2177: oid 36 version 792 is already newer than 790 2024-09-10T18:04:11.830 INFO:tasks.rados.rados.0.smithi012.stdout:2177: oid 36 version 792 is already newer than 788 2024-09-10T18:04:11.830 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 792 (ObjNum 684 snap 223 seq_num 684) dirty exists 2024-09-10T18:04:11.830 INFO:tasks.rados.rados.0.smithi012.stdout:2177: left oid 36 (ObjNum 684 snap 223 seq_num 684) 2024-09-10T18:04:11.841 INFO:tasks.rados.rados.0.smithi012.stdout:2177: done (2 left) 2024-09-10T18:04:11.841 INFO:tasks.rados.rados.0.smithi012.stdout:2179: done (1 left) 2024-09-10T18:04:11.841 INFO:tasks.rados.rados.0.smithi012.stdout:2180: done (0 left) 2024-09-10T18:04:11.842 INFO:tasks.rados.rados.0.smithi012.stdout:2181: delete oid 23 current snap is 223 2024-09-10T18:04:11.843 INFO:tasks.rados.rados.0.smithi012.stdout:2181: done (0 left) 2024-09-10T18:04:11.844 INFO:tasks.rados.rados.0.smithi012.stdout:2182: read oid 37 snap 192 2024-09-10T18:04:11.844 INFO:tasks.rados.rados.0.smithi012.stdout:2182: expect (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:04:11.844 INFO:tasks.rados.rados.0.smithi012.stdout:2183: read oid 33 snap -1 2024-09-10T18:04:11.844 INFO:tasks.rados.rados.0.smithi012.stdout:2183: expect deleted 2024-09-10T18:04:11.844 INFO:tasks.rados.rados.0.smithi012.stdout:2184: delete oid 4 current snap is 223 2024-09-10T18:04:11.868 INFO:tasks.rados.rados.0.smithi012.stdout:2182: expect (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:04:12.076 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:11 smithi089 ceph-mon[84132]: osdmap e519: 8 total, 7 up, 8 in 2024-09-10T18:04:12.077 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:11 smithi089 ceph-mon[84132]: pgmap v452: 121 pgs: 3 active+undersized, 18 stale+active+clean, 100 active+clean; 397 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 432 KiB/s wr, 2 op/s 2024-09-10T18:04:12.077 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:11 smithi089 podman[103433]: 2024-09-10 18:04:11.848452257 +0000 UTC m=+0.110427677 container create 912f7d54ebeeb4599b4ff3b89de2d74ff0596407003790f8326022e48b2c87fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:04:12.077 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:11 smithi089 podman[103433]: 2024-09-10 18:04:11.753939477 +0000 UTC m=+0.015914901 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:04:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:11 smithi012 ceph-mon[89611]: osdmap e519: 8 total, 7 up, 8 in 2024-09-10T18:04:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:11 smithi012 ceph-mon[89611]: pgmap v452: 121 pgs: 3 active+undersized, 18 stale+active+clean, 100 active+clean; 397 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 432 KiB/s wr, 2 op/s 2024-09-10T18:04:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:11 smithi012 ceph-mon[92029]: osdmap e519: 8 total, 7 up, 8 in 2024-09-10T18:04:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:11 smithi012 ceph-mon[92029]: pgmap v452: 121 pgs: 3 active+undersized, 18 stale+active+clean, 100 active+clean; 397 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 432 KiB/s wr, 2 op/s 2024-09-10T18:04:12.321 INFO:tasks.rados.rados.0.smithi012.stdout:2182: done (2 left) 2024-09-10T18:04:12.321 INFO:tasks.rados.rados.0.smithi012.stdout:2183: done (1 left) 2024-09-10T18:04:12.321 INFO:tasks.rados.rados.0.smithi012.stdout:2184: done (0 left) 2024-09-10T18:04:12.321 INFO:tasks.rados.rados.0.smithi012.stdout:2185: rollback oid 1 current snap is 223 2024-09-10T18:04:12.321 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 185 2024-09-10T18:04:12.321 INFO:tasks.rados.rados.0.smithi012.stdout:2186: snap_create 2024-09-10T18:04:12.323 INFO:tasks.rados.rados.0.smithi012.stdout:2185: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:04:12.323 INFO:tasks.rados.rados.0.smithi012.stdout:2185: finishing rollback tid 2 to smithi01278544-1 2024-09-10T18:04:12.323 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1127 (ObjNum 476 snap 155 seq_num 476) dirty exists 2024-09-10T18:04:12.536 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 podman[103433]: 2024-09-10 18:04:12.076034746 +0000 UTC m=+0.338010166 container init 912f7d54ebeeb4599b4ff3b89de2d74ff0596407003790f8326022e48b2c87fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T18:04:12.536 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 podman[103433]: 2024-09-10 18:04:12.079290621 +0000 UTC m=+0.341266042 container start 912f7d54ebeeb4599b4ff3b89de2d74ff0596407003790f8326022e48b2c87fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T18:04:12.537 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 podman[103433]: 2024-09-10 18:04:12.151070276 +0000 UTC m=+0.413045709 container attach 912f7d54ebeeb4599b4ff3b89de2d74ff0596407003790f8326022e48b2c87fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T18:04:12.537 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:04:12.537 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:04:12.537 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:04:12.537 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T18:04:12.728 INFO:tasks.rados.rados.0.smithi012.stdout:2185: done (1 left) 2024-09-10T18:04:12.728 INFO:tasks.rados.rados.0.smithi012.stdout:2186: done (0 left) 2024-09-10T18:04:12.728 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 224 2024-09-10T18:04:12.728 INFO:tasks.rados.rados.0.smithi012.stdout:2187: seq_num 689 ranges {712704=745472,1458176=786432,2244608=417792} 2024-09-10T18:04:12.735 INFO:tasks.rados.rados.0.smithi012.stdout:2187: writing smithi01278544-20 from 712704 to 1458176 tid 1 2024-09-10T18:04:12.739 INFO:tasks.rados.rados.0.smithi012.stdout:2187: writing smithi01278544-20 from 1458176 to 2244608 tid 2 2024-09-10T18:04:12.742 INFO:tasks.rados.rados.0.smithi012.stdout:2187: writing smithi01278544-20 from 2244608 to 2662400 tid 3 2024-09-10T18:04:12.742 INFO:tasks.rados.rados.0.smithi012.stdout:2188: delete oid 11 current snap is 224 2024-09-10T18:04:12.743 INFO:tasks.rados.rados.0.smithi012.stdout:2187: finishing write tid 1 to smithi01278544-20 2024-09-10T18:04:12.746 INFO:tasks.rados.rados.0.smithi012.stdout:2187: finishing write tid 2 to smithi01278544-20 2024-09-10T18:04:12.746 INFO:tasks.rados.rados.0.smithi012.stdout:2187: finishing write tid 3 to smithi01278544-20 2024-09-10T18:04:12.748 INFO:tasks.rados.rados.0.smithi012.stdout:2187: finishing write tid 4 to smithi01278544-20 2024-09-10T18:04:12.749 INFO:tasks.rados.rados.0.smithi012.stdout:2188: done (1 left) 2024-09-10T18:04:12.749 INFO:tasks.rados.rados.0.smithi012.stdout:2189: snap_remove snap 179 2024-09-10T18:04:12.967 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-mon[84132]: osdmap e520: 8 total, 7 up, 8 in 2024-09-10T18:04:12.967 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-mon[84132]: osdmap e521: 8 total, 7 up, 8 in 2024-09-10T18:04:12.967 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=sqlstore.transactions t=2024-09-10T18:04:12.655381494Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-10T18:04:12.967 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[60881]: logger=cleanup t=2024-09-10T18:04:12.656272667Z level=info msg="Completed cleanup jobs" duration=12.147587ms 2024-09-10T18:04:12.968 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T18:04:12.968 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T18:04:12.968 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-10T18:04:12.968 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-10T18:04:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:12 smithi012 ceph-mon[89611]: osdmap e520: 8 total, 7 up, 8 in 2024-09-10T18:04:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:12 smithi012 ceph-mon[89611]: osdmap e521: 8 total, 7 up, 8 in 2024-09-10T18:04:13.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:12 smithi012 ceph-mon[92029]: osdmap e520: 8 total, 7 up, 8 in 2024-09-10T18:04:13.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:12 smithi012 ceph-mon[92029]: osdmap e521: 8 total, 7 up, 8 in 2024-09-10T18:04:13.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-10T18:04:13.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-10T18:04:13.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-10T18:04:13.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-10T18:04:13.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-10T18:04:13.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-10T18:04:13.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T18:04:13.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T18:04:13.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate[103449]: --> ceph-volume raw activate successful for osd ID: 7 2024-09-10T18:04:13.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 bash[103433]: --> ceph-volume raw activate successful for osd ID: 7 2024-09-10T18:04:13.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:12 smithi089 podman[103433]: 2024-09-10 18:04:12.994286508 +0000 UTC m=+1.256261931 container died 912f7d54ebeeb4599b4ff3b89de2d74ff0596407003790f8326022e48b2c87fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:04:13.730 INFO:tasks.rados.rados.0.smithi012.stdout:2189: done (1 left) 2024-09-10T18:04:13.730 INFO:tasks.rados.rados.0.smithi012.stdout:2190: read oid 18 snap 215 2024-09-10T18:04:13.730 INFO:tasks.rados.rados.0.smithi012.stdout:2190: expect deleted 2024-09-10T18:04:13.730 INFO:tasks.rados.rados.0.smithi012.stdout:2191: delete oid 42 current snap is 224 2024-09-10T18:04:13.731 INFO:tasks.rados.rados.0.smithi012.stdout:2187: finishing write tid 5 to smithi01278544-20 2024-09-10T18:04:13.732 INFO:tasks.rados.rados.0.smithi012.stdout:2187: oid 20 updating version 0 to 1567 2024-09-10T18:04:13.732 INFO:tasks.rados.rados.0.smithi012.stdout:2187: oid 20 version 1567 is already newer than 1564 2024-09-10T18:04:13.732 INFO:tasks.rados.rados.0.smithi012.stdout:2187: oid 20 version 1567 is already newer than 1566 2024-09-10T18:04:13.732 INFO:tasks.rados.rados.0.smithi012.stdout:2187: oid 20 version 1567 is already newer than 1565 2024-09-10T18:04:13.732 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1567 (ObjNum 689 snap 224 seq_num 689) dirty exists 2024-09-10T18:04:13.732 INFO:tasks.rados.rados.0.smithi012.stdout:2187: left oid 20 (ObjNum 689 snap 224 seq_num 689) 2024-09-10T18:04:13.742 INFO:tasks.rados.rados.0.smithi012.stdout:2187: done (2 left) 2024-09-10T18:04:13.742 INFO:tasks.rados.rados.0.smithi012.stdout:2190: done (1 left) 2024-09-10T18:04:13.742 INFO:tasks.rados.rados.0.smithi012.stdout:2191: done (0 left) 2024-09-10T18:04:13.742 INFO:tasks.rados.rados.0.smithi012.stdout:2192: read oid 7 snap -1 2024-09-10T18:04:13.742 INFO:tasks.rados.rados.0.smithi012.stdout:2192: expect (ObjNum 670 snap 218 seq_num 670) 2024-09-10T18:04:13.742 INFO:tasks.rados.rados.0.smithi012.stdout:2193: snap_create 2024-09-10T18:04:13.753 INFO:tasks.rados.rados.0.smithi012.stdout:2192: expect (ObjNum 670 snap 218 seq_num 670) 2024-09-10T18:04:13.904 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:13 smithi089 podman[103589]: 2024-09-10 18:04:13.546319938 +0000 UTC m=+0.545709614 container remove 912f7d54ebeeb4599b4ff3b89de2d74ff0596407003790f8326022e48b2c87fd (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T18:04:13.904 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:13 smithi089 podman[103650]: 2024-09-10 18:04:13.6567514 +0000 UTC m=+0.016098758 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:04:13.904 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:13 smithi089 podman[103650]: 2024-09-10 18:04:13.772504354 +0000 UTC m=+0.131851749 container create 1b26f245f7dcf69b914ff44d23cb2d2f3b7738a80071ad3107c6a47eb306da9b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T18:04:14.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:04:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:04:13] "GET /metrics HTTP/1.1" 200 36283 "" "Prometheus/2.43.0" 2024-09-10T18:04:14.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:14 smithi089 podman[103650]: 2024-09-10 18:04:14.016894703 +0000 UTC m=+0.376242057 container init 1b26f245f7dcf69b914ff44d23cb2d2f3b7738a80071ad3107c6a47eb306da9b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T18:04:14.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:14 smithi089 podman[103650]: 2024-09-10 18:04:14.020149862 +0000 UTC m=+0.379497224 container start 1b26f245f7dcf69b914ff44d23cb2d2f3b7738a80071ad3107c6a47eb306da9b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:04:14.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:14 smithi089 ceph-osd[103670]: -- 172.21.15.89:0/2465165592 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569f0ae1a40 con 0x5569f18b2000 2024-09-10T18:04:14.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:14 smithi089 bash[103650]: 1b26f245f7dcf69b914ff44d23cb2d2f3b7738a80071ad3107c6a47eb306da9b 2024-09-10T18:04:14.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:14 smithi089 systemd[1]: Started Ceph osd.7 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:04:14.781 INFO:tasks.rados.rados.0.smithi012.stdout:2192: done (1 left) 2024-09-10T18:04:14.781 INFO:tasks.rados.rados.0.smithi012.stdout:2193: done (0 left) 2024-09-10T18:04:14.781 INFO:tasks.rados.rados.0.smithi012.stdout:2194: read oid 46 snap 218 2024-09-10T18:04:14.781 INFO:tasks.rados.rados.0.smithi012.stdout:2194: expect (ObjNum 625 snap 205 seq_num 625) 2024-09-10T18:04:14.781 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 225 2024-09-10T18:04:14.782 INFO:tasks.rados.rados.0.smithi012.stdout:2195: seq_num 692 ranges {14229504=794624,15024128=483328,15507456=720896} 2024-09-10T18:04:14.863 INFO:tasks.rados.rados.0.smithi012.stdout:2195: writing smithi01278544-32 from 14229504 to 15024128 tid 1 2024-09-10T18:04:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:2195: writing smithi01278544-32 from 15024128 to 15507456 tid 2 2024-09-10T18:04:14.870 INFO:tasks.rados.rados.0.smithi012.stdout:2195: writing smithi01278544-32 from 15507456 to 16228352 tid 3 2024-09-10T18:04:14.870 INFO:tasks.rados.rados.0.smithi012.stdout:2196: read oid 31 snap -1 2024-09-10T18:04:14.870 INFO:tasks.rados.rados.0.smithi012.stdout:2196: expect deleted 2024-09-10T18:04:14.870 INFO:tasks.rados.rados.0.smithi012.stdout:2197: copy_from oid 20 from oid 38 current snap is 225 2024-09-10T18:04:14.870 INFO:tasks.rados.rados.0.smithi012.stdout:2194: expect (ObjNum 625 snap 205 seq_num 625) 2024-09-10T18:04:14.929 INFO:tasks.rados.rados.0.smithi012.stdout:2195: finishing write tid 1 to smithi01278544-32 2024-09-10T18:04:14.929 INFO:tasks.rados.rados.0.smithi012.stdout:2195: finishing write tid 2 to smithi01278544-32 2024-09-10T18:04:14.929 INFO:tasks.rados.rados.0.smithi012.stdout:2195: finishing write tid 3 to smithi01278544-32 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2195: finishing write tid 4 to smithi01278544-32 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2195: finishing write tid 5 to smithi01278544-32 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2195: oid 32 updating version 0 to 1132 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2195: oid 32 version 1132 is already newer than 1131 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2195: oid 32 version 1132 is already newer than 1129 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2195: oid 32 version 1132 is already newer than 1130 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1132 (ObjNum 692 snap 225 seq_num 692) dirty exists 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2195: left oid 32 (ObjNum 692 snap 225 seq_num 692) 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2197: finishing copy_from racing read to smithi01278544-20 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2197: finishing copy_from to smithi01278544-20 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1124 (ObjNum 664 snap 217 seq_num 664) dirty exists 2024-09-10T18:04:14.930 INFO:tasks.rados.rados.0.smithi012.stdout:2194: done (3 left) 2024-09-10T18:04:14.931 INFO:tasks.rados.rados.0.smithi012.stdout:2195: done (2 left) 2024-09-10T18:04:14.931 INFO:tasks.rados.rados.0.smithi012.stdout:2196: done (1 left) 2024-09-10T18:04:14.931 INFO:tasks.rados.rados.0.smithi012.stdout:2197: done (0 left) 2024-09-10T18:04:14.931 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 225 2024-09-10T18:04:14.931 INFO:tasks.rados.rados.0.smithi012.stdout:2198: seq_num 693 ranges {2154496=409600,2564096=770048,3334144=581632,3915776=253952} 2024-09-10T18:04:14.942 INFO:tasks.rados.rados.0.smithi012.stdout:2198: writing smithi01278544-41 from 2154496 to 2564096 tid 1 2024-09-10T18:04:14.947 INFO:tasks.rados.rados.0.smithi012.stdout:2198: writing smithi01278544-41 from 2564096 to 3334144 tid 2 2024-09-10T18:04:14.950 INFO:tasks.rados.rados.0.smithi012.stdout:2198: writing smithi01278544-41 from 3334144 to 3915776 tid 3 2024-09-10T18:04:14.952 INFO:tasks.rados.rados.0.smithi012.stdout:2198: writing smithi01278544-41 from 3915776 to 4169728 tid 4 2024-09-10T18:04:14.952 INFO:tasks.rados.rados.0.smithi012.stdout:2199: snap_remove snap 214 2024-09-10T18:04:15.023 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:14 smithi089 ceph-mon[84132]: pgmap v455: 121 pgs: 26 active+undersized, 5 stale+active+clean, 10 active+undersized+degraded, 80 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 14 op/s; 48/693 objects degraded (6.926%) 2024-09-10T18:04:15.023 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:14 smithi089 ceph-mon[84132]: osdmap e522: 8 total, 7 up, 8 in 2024-09-10T18:04:15.023 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:14 smithi089 ceph-mon[84132]: Health check failed: Degraded data redundancy: 48/693 objects degraded (6.926%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:04:15.023 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:15.024 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:15.024 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[89611]: pgmap v455: 121 pgs: 26 active+undersized, 5 stale+active+clean, 10 active+undersized+degraded, 80 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 14 op/s; 48/693 objects degraded (6.926%) 2024-09-10T18:04:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[89611]: osdmap e522: 8 total, 7 up, 8 in 2024-09-10T18:04:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[89611]: Health check failed: Degraded data redundancy: 48/693 objects degraded (6.926%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:04:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[92029]: pgmap v455: 121 pgs: 26 active+undersized, 5 stale+active+clean, 10 active+undersized+degraded, 80 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 14 op/s; 48/693 objects degraded (6.926%) 2024-09-10T18:04:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[92029]: osdmap e522: 8 total, 7 up, 8 in 2024-09-10T18:04:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[92029]: Health check failed: Degraded data redundancy: 48/693 objects degraded (6.926%), 10 pgs degraded (PG_DEGRADED) 2024-09-10T18:04:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:15.285 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:15 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:04:15.164+0000 7f70383d6640 -1 Falling back to public interface 2024-09-10T18:04:15.789 INFO:tasks.rados.rados.0.smithi012.stdout:2199: done (1 left) 2024-09-10T18:04:15.789 INFO:tasks.rados.rados.0.smithi012.stdout:2200: delete oid 10 current snap is 225 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: finishing write tid 1 to smithi01278544-41 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: finishing write tid 2 to smithi01278544-41 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: finishing write tid 3 to smithi01278544-41 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: finishing write tid 4 to smithi01278544-41 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: finishing write tid 5 to smithi01278544-41 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: finishing write tid 6 to smithi01278544-41 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: oid 41 updating version 0 to 1022 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: oid 41 version 1022 is already newer than 1021 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: oid 41 version 1022 is already newer than 1020 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: oid 41 updating version 1022 to 1023 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: oid 41 version 1023 is already newer than 1019 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 1023 (ObjNum 693 snap 225 seq_num 693) dirty exists 2024-09-10T18:04:15.790 INFO:tasks.rados.rados.0.smithi012.stdout:2198: left oid 41 (ObjNum 693 snap 225 seq_num 693) 2024-09-10T18:04:15.799 INFO:tasks.rados.rados.0.smithi012.stdout:2198: done (1 left) 2024-09-10T18:04:15.799 INFO:tasks.rados.rados.0.smithi012.stdout:2200: done (0 left) 2024-09-10T18:04:15.799 INFO:tasks.rados.rados.0.smithi012.stdout:2201: setattr oid 9 current snap is 225 2024-09-10T18:04:15.801 INFO:tasks.rados.rados.0.smithi012.stdout:2202: rollback oid 23 current snap is 225 2024-09-10T18:04:15.802 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 23 to 213 2024-09-10T18:04:15.802 INFO:tasks.rados.rados.0.smithi012.stdout:2203: rollback oid 5 current snap is 225 2024-09-10T18:04:15.802 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 5 to 218 2024-09-10T18:04:15.802 INFO:tasks.rados.rados.0.smithi012.stdout:2204: rmattr oid 22 current snap is 225 2024-09-10T18:04:15.802 INFO:tasks.rados.rados.0.smithi012.stdout:2204: done (3 left) 2024-09-10T18:04:15.802 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 225 2024-09-10T18:04:15.802 INFO:tasks.rados.rados.0.smithi012.stdout:2205: seq_num 695 ranges {0=442368,442368=540672,983040=598016,1581056=466944} 2024-09-10T18:04:15.804 INFO:tasks.rados.rados.0.smithi012.stdout:2205: writing smithi01278544-27 from 0 to 442368 tid 1 2024-09-10T18:04:15.808 INFO:tasks.rados.rados.0.smithi012.stdout:2205: writing smithi01278544-27 from 442368 to 983040 tid 2 2024-09-10T18:04:15.813 INFO:tasks.rados.rados.0.smithi012.stdout:2205: writing smithi01278544-27 from 983040 to 1581056 tid 3 2024-09-10T18:04:15.816 INFO:tasks.rados.rados.0.smithi012.stdout:2205: writing smithi01278544-27 from 1581056 to 2048000 tid 4 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 225 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1128 (ObjNum 97 snap 0 seq_num 1) dirty exists 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:2205: finishing write tid 1 to smithi01278544-27 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:2205: finishing write tid 2 to smithi01278544-27 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:2203: finishing rollback tid 0 to smithi01278544-5 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:2203: finishing rollback tid 1 to smithi01278544-5 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:2203: finishing rollback tid 2 to smithi01278544-5 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 886 (ObjNum 653 snap 213 seq_num 653) dirty exists 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:2202: finishing rollback tid 1 to smithi01278544-23 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 884 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:2205: finishing write tid 3 to smithi01278544-27 2024-09-10T18:04:15.817 INFO:tasks.rados.rados.0.smithi012.stdout:2206: seq_num 696 ranges {3022848=458752,3481600=417792,3899392=753664,4653056=434176} 2024-09-10T18:04:15.836 INFO:tasks.rados.rados.0.smithi012.stdout:2206: writing smithi01278544-26 from 3022848 to 3481600 tid 1 2024-09-10T18:04:15.838 INFO:tasks.rados.rados.0.smithi012.stdout:2206: writing smithi01278544-26 from 3481600 to 3899392 tid 2 2024-09-10T18:04:15.842 INFO:tasks.rados.rados.0.smithi012.stdout:2206: writing smithi01278544-26 from 3899392 to 4653056 tid 3 2024-09-10T18:04:15.845 INFO:tasks.rados.rados.0.smithi012.stdout:2206: writing smithi01278544-26 from 4653056 to 5087232 tid 4 2024-09-10T18:04:15.845 INFO:tasks.rados.rados.0.smithi012.stdout:2201: done (4 left) 2024-09-10T18:04:15.845 INFO:tasks.rados.rados.0.smithi012.stdout:2202: done (3 left) 2024-09-10T18:04:15.845 INFO:tasks.rados.rados.0.smithi012.stdout:2203: done (2 left) 2024-09-10T18:04:15.845 INFO:tasks.rados.rados.0.smithi012.stdout:2207: read oid 47 snap -1 2024-09-10T18:04:15.845 INFO:tasks.rados.rados.0.smithi012.stdout:2207: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:04:15.845 INFO:tasks.rados.rados.0.smithi012.stdout:2208: snap_remove snap 218 2024-09-10T18:04:16.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:15 smithi012 ceph-mon[89611]: osdmap e523: 8 total, 7 up, 8 in 2024-09-10T18:04:16.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:15 smithi012 ceph-mon[92029]: osdmap e523: 8 total, 7 up, 8 in 2024-09-10T18:04:16.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:15 smithi089 ceph-mon[84132]: osdmap e523: 8 total, 7 up, 8 in 2024-09-10T18:04:16.793 INFO:tasks.rados.rados.0.smithi012.stdout:2208: done (3 left) 2024-09-10T18:04:16.793 INFO:tasks.rados.rados.0.smithi012.stdout:2209: copy_from oid 33 from oid 2 current snap is 225 2024-09-10T18:04:16.793 INFO:tasks.rados.rados.0.smithi012.stdout:2205: finishing write tid 4 to smithi01278544-27 2024-09-10T18:04:16.793 INFO:tasks.rados.rados.0.smithi012.stdout:2205: finishing write tid 5 to smithi01278544-27 2024-09-10T18:04:16.793 INFO:tasks.rados.rados.0.smithi012.stdout:2205: finishing write tid 6 to smithi01278544-27 2024-09-10T18:04:16.793 INFO:tasks.rados.rados.0.smithi012.stdout:2205: oid 27 updating version 0 to 1261 2024-09-10T18:04:16.793 INFO:tasks.rados.rados.0.smithi012.stdout:2205: oid 27 version 1261 is already newer than 1260 2024-09-10T18:04:16.793 INFO:tasks.rados.rados.0.smithi012.stdout:2205: oid 27 updating version 1261 to 1262 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2205: oid 27 updating version 1262 to 1263 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2205: oid 27 version 1263 is already newer than 1259 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1263 (ObjNum 695 snap 225 seq_num 695) dirty exists 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2205: left oid 27 (ObjNum 695 snap 225 seq_num 695) 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: finishing write tid 1 to smithi01278544-26 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: finishing write tid 2 to smithi01278544-26 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: finishing write tid 3 to smithi01278544-26 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: finishing write tid 4 to smithi01278544-26 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: finishing write tid 5 to smithi01278544-26 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: finishing write tid 6 to smithi01278544-26 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: oid 26 updating version 0 to 797 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: oid 26 version 797 is already newer than 795 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: oid 26 version 797 is already newer than 796 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: oid 26 version 797 is already newer than 794 2024-09-10T18:04:16.794 INFO:tasks.rados.rados.0.smithi012.stdout:2206: oid 26 version 797 is already newer than 793 2024-09-10T18:04:16.795 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 797 (ObjNum 696 snap 225 seq_num 696) dirty exists 2024-09-10T18:04:16.795 INFO:tasks.rados.rados.0.smithi012.stdout:2206: left oid 26 (ObjNum 696 snap 225 seq_num 696) 2024-09-10T18:04:16.795 INFO:tasks.rados.rados.0.smithi012.stdout:2207: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:04:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:16 smithi089 ceph-mon[84132]: pgmap v458: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 412 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 16 op/s; 53/696 objects degraded (7.615%) 2024-09-10T18:04:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:16 smithi089 ceph-mon[84132]: osdmap e524: 8 total, 7 up, 8 in 2024-09-10T18:04:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:16 smithi012 ceph-mon[89611]: pgmap v458: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 412 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 16 op/s; 53/696 objects degraded (7.615%) 2024-09-10T18:04:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:16 smithi012 ceph-mon[89611]: osdmap e524: 8 total, 7 up, 8 in 2024-09-10T18:04:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:16 smithi012 ceph-mon[92029]: pgmap v458: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 412 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 16 op/s; 53/696 objects degraded (7.615%) 2024-09-10T18:04:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:16 smithi012 ceph-mon[92029]: osdmap e524: 8 total, 7 up, 8 in 2024-09-10T18:04:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:17 smithi089 ceph-mon[84132]: osdmap e525: 8 total, 7 up, 8 in 2024-09-10T18:04:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:17 smithi089 ceph-mon[84132]: pgmap v461: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 2.1 MiB/s wr, 12 op/s; 54/666 objects degraded (8.108%) 2024-09-10T18:04:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:17 smithi089 ceph-mon[84132]: osdmap e526: 8 total, 7 up, 8 in 2024-09-10T18:04:18.201 INFO:tasks.rados.rados.0.smithi012.stdout:2205: done (3 left) 2024-09-10T18:04:18.201 INFO:tasks.rados.rados.0.smithi012.stdout:2206: done (2 left) 2024-09-10T18:04:18.201 INFO:tasks.rados.rados.0.smithi012.stdout:2207: done (1 left) 2024-09-10T18:04:18.201 INFO:tasks.rados.rados.0.smithi012.stdout:2210: rmattr oid 44 current snap is 225 2024-09-10T18:04:18.201 INFO:tasks.rados.rados.0.smithi012.stdout:2211: copy_from oid 21 from oid 29 current snap is 225 2024-09-10T18:04:18.201 INFO:tasks.rados.rados.0.smithi012.stdout:2212: snap_create 2024-09-10T18:04:18.201 INFO:tasks.rados.rados.0.smithi012.stdout:2209: finishing copy_from to smithi01278544-33 2024-09-10T18:04:18.202 INFO:tasks.rados.rados.0.smithi012.stdout:2209: got expected ENOENT (src dne) 2024-09-10T18:04:18.202 INFO:tasks.rados.rados.0.smithi012.stdout:2209: finishing copy_from racing read to smithi01278544-33 2024-09-10T18:04:18.203 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1264 (ObjNum 681 snap 221 seq_num 681) dirty exists 2024-09-10T18:04:18.244 INFO:tasks.rados.rados.0.smithi012.stdout:2211: finishing copy_from racing read to smithi01278544-21 2024-09-10T18:04:18.245 INFO:tasks.rados.rados.0.smithi012.stdout:2211: finishing copy_from to smithi01278544-21 2024-09-10T18:04:18.245 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 765 (ObjNum 673 snap 218 seq_num 673) dirty exists 2024-09-10T18:04:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:17 smithi012 ceph-mon[89611]: osdmap e525: 8 total, 7 up, 8 in 2024-09-10T18:04:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:17 smithi012 ceph-mon[89611]: pgmap v461: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 2.1 MiB/s wr, 12 op/s; 54/666 objects degraded (8.108%) 2024-09-10T18:04:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:17 smithi012 ceph-mon[89611]: osdmap e526: 8 total, 7 up, 8 in 2024-09-10T18:04:18.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:17 smithi012 ceph-mon[92029]: osdmap e525: 8 total, 7 up, 8 in 2024-09-10T18:04:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:17 smithi012 ceph-mon[92029]: pgmap v461: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 2.1 MiB/s wr, 12 op/s; 54/666 objects degraded (8.108%) 2024-09-10T18:04:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:17 smithi012 ceph-mon[92029]: osdmap e526: 8 total, 7 up, 8 in 2024-09-10T18:04:18.801 INFO:tasks.rados.rados.0.smithi012.stdout:2209: done (3 left) 2024-09-10T18:04:18.801 INFO:tasks.rados.rados.0.smithi012.stdout:2210: done (2 left) 2024-09-10T18:04:18.802 INFO:tasks.rados.rados.0.smithi012.stdout:2211: done (1 left) 2024-09-10T18:04:18.802 INFO:tasks.rados.rados.0.smithi012.stdout:2212: done (0 left) 2024-09-10T18:04:18.802 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 226 2024-09-10T18:04:18.802 INFO:tasks.rados.rados.0.smithi012.stdout:2213: seq_num 697 ranges {155648=475136,630784=704512,1335296=557056,1892352=344064} 2024-09-10T18:04:18.805 INFO:tasks.rados.rados.0.smithi012.stdout:2213: writing smithi01278544-40 from 155648 to 630784 tid 1 2024-09-10T18:04:18.809 INFO:tasks.rados.rados.0.smithi012.stdout:2213: writing smithi01278544-40 from 630784 to 1335296 tid 2 2024-09-10T18:04:18.813 INFO:tasks.rados.rados.0.smithi012.stdout:2213: writing smithi01278544-40 from 1335296 to 1892352 tid 3 2024-09-10T18:04:18.815 INFO:tasks.rados.rados.0.smithi012.stdout:2213: writing smithi01278544-40 from 1892352 to 2236416 tid 4 2024-09-10T18:04:18.815 INFO:tasks.rados.rados.0.smithi012.stdout:2213: finishing write tid 1 to smithi01278544-40 2024-09-10T18:04:18.815 INFO:tasks.rados.rados.0.smithi012.stdout:2214: setattr oid 23 current snap is 226 2024-09-10T18:04:18.816 INFO:tasks.rados.rados.0.smithi012.stdout:2213: finishing write tid 2 to smithi01278544-40 2024-09-10T18:04:18.817 INFO:tasks.rados.rados.0.smithi012.stdout:2215: delete oid 21 current snap is 226 2024-09-10T18:04:18.819 INFO:tasks.rados.rados.0.smithi012.stdout:2213: finishing write tid 3 to smithi01278544-40 2024-09-10T18:04:18.819 INFO:tasks.rados.rados.0.smithi012.stdout:2213: finishing write tid 4 to smithi01278544-40 2024-09-10T18:04:18.820 INFO:tasks.rados.rados.0.smithi012.stdout:2213: finishing write tid 5 to smithi01278544-40 2024-09-10T18:04:18.821 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 898 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:04:18.821 INFO:tasks.rados.rados.0.smithi012.stdout:2213: finishing write tid 6 to smithi01278544-40 2024-09-10T18:04:18.822 INFO:tasks.rados.rados.0.smithi012.stdout:2213: oid 40 updating version 0 to 1532 2024-09-10T18:04:18.822 INFO:tasks.rados.rados.0.smithi012.stdout:2213: oid 40 updating version 1532 to 1533 2024-09-10T18:04:18.822 INFO:tasks.rados.rados.0.smithi012.stdout:2213: oid 40 updating version 1533 to 1534 2024-09-10T18:04:18.822 INFO:tasks.rados.rados.0.smithi012.stdout:2213: oid 40 version 1534 is already newer than 1531 2024-09-10T18:04:18.822 INFO:tasks.rados.rados.0.smithi012.stdout:2213: oid 40 version 1534 is already newer than 1530 2024-09-10T18:04:18.822 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1534 (ObjNum 697 snap 226 seq_num 697) dirty exists 2024-09-10T18:04:18.822 INFO:tasks.rados.rados.0.smithi012.stdout:2213: left oid 40 (ObjNum 697 snap 226 seq_num 697) 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2213: done (2 left) 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2214: done (1 left) 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2215: done (0 left) 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2216: read oid 41 snap -1 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2216: expect (ObjNum 693 snap 225 seq_num 693) 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2217: rollback oid 4 current snap is 226 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 196 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2218: setattr oid 3 current snap is 226 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 226 2024-09-10T18:04:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2219: seq_num 699 ranges {0=516096,516096=475136,991232=573440,1564672=557056} 2024-09-10T18:04:18.825 INFO:tasks.rados.rados.0.smithi012.stdout:2219: writing smithi01278544-10 from 0 to 516096 tid 1 2024-09-10T18:04:18.828 INFO:tasks.rados.rados.0.smithi012.stdout:2219: writing smithi01278544-10 from 516096 to 991232 tid 2 2024-09-10T18:04:18.832 INFO:tasks.rados.rados.0.smithi012.stdout:2219: writing smithi01278544-10 from 991232 to 1564672 tid 3 2024-09-10T18:04:18.836 INFO:tasks.rados.rados.0.smithi012.stdout:2219: writing smithi01278544-10 from 1564672 to 2121728 tid 4 2024-09-10T18:04:18.836 INFO:tasks.rados.rados.0.smithi012.stdout:2220: copy_from oid 47 from oid 11 current snap is 226 2024-09-10T18:04:18.836 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1265 (ObjNum 561 snap 186 seq_num 561) dirty exists 2024-09-10T18:04:18.836 INFO:tasks.rados.rados.0.smithi012.stdout:2219: finishing write tid 1 to smithi01278544-10 2024-09-10T18:04:18.836 INFO:tasks.rados.rados.0.smithi012.stdout:2219: finishing write tid 2 to smithi01278544-10 2024-09-10T18:04:18.836 INFO:tasks.rados.rados.0.smithi012.stdout:2218: done (4 left) 2024-09-10T18:04:18.836 INFO:tasks.rados.rados.0.smithi012.stdout:2221: snap_remove snap 205 2024-09-10T18:04:19.285 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:18 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:04:18.845+0000 7f70383d6640 -1 osd.7 516 log_to_monitors true 2024-09-10T18:04:19.852 INFO:tasks.rados.rados.0.smithi012.stdout:2221: done (4 left) 2024-09-10T18:04:19.852 INFO:tasks.rados.rados.0.smithi012.stdout:2222: snap_create 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2219: finishing write tid 3 to smithi01278544-10 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2217: finishing rollback tid 1 to smithi01278544-4 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2217: finishing rollback tid 2 to smithi01278544-4 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1035 (ObjNum 586 snap 196 seq_num 586) dirty exists 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2220: finishing copy_from to smithi01278544-47 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2220: got expected ENOENT (src dne) 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2220: finishing copy_from racing read to smithi01278544-47 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2219: finishing write tid 4 to smithi01278544-10 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2219: finishing write tid 5 to smithi01278544-10 2024-09-10T18:04:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:2216: expect (ObjNum 693 snap 225 seq_num 693) 2024-09-10T18:04:20.001 INFO:tasks.rados.rados.0.smithi012.stdout:2219: finishing write tid 6 to smithi01278544-10 2024-09-10T18:04:20.001 INFO:tasks.rados.rados.0.smithi012.stdout:2219: oid 10 updating version 0 to 1604 2024-09-10T18:04:20.001 INFO:tasks.rados.rados.0.smithi012.stdout:2219: oid 10 updating version 1604 to 1606 2024-09-10T18:04:20.001 INFO:tasks.rados.rados.0.smithi012.stdout:2219: oid 10 version 1606 is already newer than 1605 2024-09-10T18:04:20.001 INFO:tasks.rados.rados.0.smithi012.stdout:2219: oid 10 version 1606 is already newer than 1602 2024-09-10T18:04:20.001 INFO:tasks.rados.rados.0.smithi012.stdout:2219: oid 10 version 1606 is already newer than 1603 2024-09-10T18:04:20.002 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1606 (ObjNum 699 snap 226 seq_num 699) dirty exists 2024-09-10T18:04:20.002 INFO:tasks.rados.rados.0.smithi012.stdout:2219: left oid 10 (ObjNum 699 snap 226 seq_num 699) 2024-09-10T18:04:20.150 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:04:19.935+0000 7f702c178640 -1 osd.7 516 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T18:04:20.150 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-mon[84132]: osdmap e527: 8 total, 7 up, 8 in 2024-09-10T18:04:20.150 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.151 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.151 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-mon[84132]: from='osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T18:04:20.151 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-mon[84132]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T18:04:20.151 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-mon[84132]: pgmap v464: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 410 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 3.0 MiB/s wr, 18 op/s; 55/666 objects degraded (8.258%) 2024-09-10T18:04:20.151 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.151 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:19 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[92029]: osdmap e527: 8 total, 7 up, 8 in 2024-09-10T18:04:20.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[92029]: from='osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[92029]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[92029]: pgmap v464: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 410 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 3.0 MiB/s wr, 18 op/s; 55/666 objects degraded (8.258%) 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[89611]: osdmap e527: 8 total, 7 up, 8 in 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[89611]: from='osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[89611]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[89611]: pgmap v464: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 410 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 3.0 MiB/s wr, 18 op/s; 55/666 objects degraded (8.258%) 2024-09-10T18:04:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:19 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:20.852 INFO:tasks.rados.rados.0.smithi012.stdout:2216: done (4 left) 2024-09-10T18:04:20.852 INFO:tasks.rados.rados.0.smithi012.stdout:2217: done (3 left) 2024-09-10T18:04:20.853 INFO:tasks.rados.rados.0.smithi012.stdout:2219: done (2 left) 2024-09-10T18:04:20.853 INFO:tasks.rados.rados.0.smithi012.stdout:2220: done (1 left) 2024-09-10T18:04:20.853 INFO:tasks.rados.rados.0.smithi012.stdout:2222: done (0 left) 2024-09-10T18:04:20.853 INFO:tasks.rados.rados.0.smithi012.stdout:2223: rollback oid 29 current snap is 227 2024-09-10T18:04:20.853 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 29 to 196 2024-09-10T18:04:20.853 INFO:tasks.rados.rados.0.smithi012.stdout:2224: snap_remove snap 226 2024-09-10T18:04:21.115 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:20 smithi089 ceph-mon[84132]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T18:04:21.115 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:20 smithi089 ceph-mon[84132]: from='osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:04:21.115 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:20 smithi089 ceph-mon[84132]: osdmap e528: 8 total, 7 up, 8 in 2024-09-10T18:04:21.115 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:20 smithi089 ceph-mon[84132]: Health check update: Degraded data redundancy: 55/666 objects degraded (8.258%), 13 pgs degraded (PG_DEGRADED) 2024-09-10T18:04:21.115 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:20 smithi089 ceph-mon[84132]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:04:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[89611]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T18:04:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[89611]: from='osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:04:21.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[89611]: osdmap e528: 8 total, 7 up, 8 in 2024-09-10T18:04:21.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[89611]: Health check update: Degraded data redundancy: 55/666 objects degraded (8.258%), 13 pgs degraded (PG_DEGRADED) 2024-09-10T18:04:21.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[89611]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:04:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[92029]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T18:04:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[92029]: from='osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:04:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[92029]: osdmap e528: 8 total, 7 up, 8 in 2024-09-10T18:04:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[92029]: Health check update: Degraded data redundancy: 55/666 objects degraded (8.258%), 13 pgs degraded (PG_DEGRADED) 2024-09-10T18:04:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:20 smithi012 ceph-mon[92029]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-10T18:04:21.860 INFO:tasks.rados.rados.0.smithi012.stdout:2224: done (1 left) 2024-09-10T18:04:21.860 INFO:tasks.rados.rados.0.smithi012.stdout:2225: rollback oid 42 current snap is 227 2024-09-10T18:04:21.860 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 42 to 222 2024-09-10T18:04:21.860 INFO:tasks.rados.rados.0.smithi012.stdout:2226: delete oid 2 current snap is 227 2024-09-10T18:04:21.867 INFO:tasks.rados.rados.0.smithi012.stdout:2225: finishing rollback tid 1 to smithi01278544-42 2024-09-10T18:04:21.868 INFO:tasks.rados.rados.0.smithi012.stdout:2225: finishing rollback tid 2 to smithi01278544-42 2024-09-10T18:04:21.868 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1546 (ObjNum 647 snap 212 seq_num 647) dirty exists 2024-09-10T18:04:21.881 INFO:tasks.rados.rados.0.smithi012.stdout:2223: finishing rollback tid 0 to smithi01278544-29 2024-09-10T18:04:21.881 INFO:tasks.rados.rados.0.smithi012.stdout:2223: finishing rollback tid 1 to smithi01278544-29 2024-09-10T18:04:21.882 INFO:tasks.rados.rados.0.smithi012.stdout:2223: finishing rollback tid 2 to smithi01278544-29 2024-09-10T18:04:21.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 768 (ObjNum 544 snap 183 seq_num 544) dirty exists 2024-09-10T18:04:21.884 INFO:tasks.rados.rados.0.smithi012.stdout:2223: done (2 left) 2024-09-10T18:04:21.884 INFO:tasks.rados.rados.0.smithi012.stdout:2225: done (1 left) 2024-09-10T18:04:21.884 INFO:tasks.rados.rados.0.smithi012.stdout:2226: done (0 left) 2024-09-10T18:04:21.884 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 227 2024-09-10T18:04:21.884 INFO:tasks.rados.rados.0.smithi012.stdout:2227: seq_num 701 ranges {1138688=548864,1687552=696320,2383872=540672,2924544=368640} 2024-09-10T18:04:21.894 INFO:tasks.rados.rados.0.smithi012.stdout:2227: writing smithi01278544-34 from 1138688 to 1687552 tid 1 2024-09-10T18:04:21.898 INFO:tasks.rados.rados.0.smithi012.stdout:2227: writing smithi01278544-34 from 1687552 to 2383872 tid 2 2024-09-10T18:04:21.901 INFO:tasks.rados.rados.0.smithi012.stdout:2227: writing smithi01278544-34 from 2383872 to 2924544 tid 3 2024-09-10T18:04:21.904 INFO:tasks.rados.rados.0.smithi012.stdout:2227: writing smithi01278544-34 from 2924544 to 3293184 tid 4 2024-09-10T18:04:21.904 INFO:tasks.rados.rados.0.smithi012.stdout:2228: rmattr oid 44 current snap is 227 2024-09-10T18:04:21.905 INFO:tasks.rados.rados.0.smithi012.stdout:2227: finishing write tid 1 to smithi01278544-34 2024-09-10T18:04:21.905 INFO:tasks.rados.rados.0.smithi012.stdout:2227: finishing write tid 2 to smithi01278544-34 2024-09-10T18:04:21.905 INFO:tasks.rados.rados.0.smithi012.stdout:2229: rmattr oid 10 current snap is 227 2024-09-10T18:04:21.905 INFO:tasks.rados.rados.0.smithi012.stdout:2229: done (2 left) 2024-09-10T18:04:21.905 INFO:tasks.rados.rados.0.smithi012.stdout:2230: copy_from oid 23 from oid 37 current snap is 227 2024-09-10T18:04:21.905 INFO:tasks.rados.rados.0.smithi012.stdout:2231: copy_from oid 11 from oid 50 current snap is 227 2024-09-10T18:04:21.905 INFO:tasks.rados.rados.0.smithi012.stdout:2232: snap_remove snap 223 2024-09-10T18:04:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[89611]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:04:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[89611]: osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873] boot 2024-09-10T18:04:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[89611]: osdmap e529: 8 total, 8 up, 8 in 2024-09-10T18:04:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T18:04:22.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[89611]: pgmap v467: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 410 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 992 KiB/s wr, 8 op/s; 55/660 objects degraded (8.333%) 2024-09-10T18:04:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[92029]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:04:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[92029]: osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873] boot 2024-09-10T18:04:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[92029]: osdmap e529: 8 total, 8 up, 8 in 2024-09-10T18:04:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T18:04:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:21 smithi012 ceph-mon[92029]: pgmap v467: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 410 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 992 KiB/s wr, 8 op/s; 55/660 objects degraded (8.333%) 2024-09-10T18:04:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:21 smithi089 ceph-mon[84132]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T18:04:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:21 smithi089 ceph-mon[84132]: osd.7 [v2:172.21.15.89:6824/476453873,v1:172.21.15.89:6825/476453873] boot 2024-09-10T18:04:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:21 smithi089 ceph-mon[84132]: osdmap e529: 8 total, 8 up, 8 in 2024-09-10T18:04:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T18:04:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:21 smithi089 ceph-mon[84132]: pgmap v467: 121 pgs: 36 active+undersized, 13 active+undersized+degraded, 72 active+clean; 410 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 992 KiB/s wr, 8 op/s; 55/660 objects degraded (8.333%) 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: finishing write tid 3 to smithi01278544-34 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1266 (ObjNum 681 snap 221 seq_num 681) dirty exists 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: finishing write tid 4 to smithi01278544-34 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: finishing write tid 5 to smithi01278544-34 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: finishing write tid 6 to smithi01278544-34 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: oid 34 updating version 0 to 906 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: oid 34 updating version 906 to 907 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: oid 34 version 907 is already newer than 905 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: oid 34 updating version 907 to 909 2024-09-10T18:04:22.879 INFO:tasks.rados.rados.0.smithi012.stdout:2227: oid 34 version 909 is already newer than 908 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 909 (ObjNum 701 snap 227 seq_num 701) dirty exists 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2227: left oid 34 (ObjNum 701 snap 227 seq_num 701) 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2231: finishing copy_from racing read to smithi01278544-11 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2231: finishing copy_from to smithi01278544-11 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 754 (ObjNum 654 snap 214 seq_num 654) dirty exists 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2230: finishing copy_from racing read to smithi01278544-23 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2230: finishing copy_from to smithi01278544-23 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 879 (ObjNum 540 snap 182 seq_num 540) dirty exists 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2227: done (4 left) 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2228: done (3 left) 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2230: done (2 left) 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2231: done (1 left) 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2232: done (0 left) 2024-09-10T18:04:22.880 INFO:tasks.rados.rados.0.smithi012.stdout:2233: rollback oid 17 current snap is 227 2024-09-10T18:04:22.881 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 17 to 224 2024-09-10T18:04:22.881 INFO:tasks.rados.rados.0.smithi012.stdout:2234: rollback oid 9 current snap is 227 2024-09-10T18:04:22.881 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 196 2024-09-10T18:04:22.881 INFO:tasks.rados.rados.0.smithi012.stdout:2235: read oid 48 snap -1 2024-09-10T18:04:22.881 INFO:tasks.rados.rados.0.smithi012.stdout:2235: expect deleted 2024-09-10T18:04:22.881 INFO:tasks.rados.rados.0.smithi012.stdout:2236: rollback oid 47 current snap is 227 2024-09-10T18:04:22.881 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 219 2024-09-10T18:04:22.881 INFO:tasks.rados.rados.0.smithi012.stdout:2237: snap_remove snap 192 2024-09-10T18:04:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:22 smithi012 ceph-mon[89611]: osdmap e530: 8 total, 8 up, 8 in 2024-09-10T18:04:23.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:22 smithi012 ceph-mon[92029]: osdmap e530: 8 total, 8 up, 8 in 2024-09-10T18:04:23.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:22 smithi089 ceph-mon[84132]: osdmap e530: 8 total, 8 up, 8 in 2024-09-10T18:04:23.889 INFO:tasks.rados.rados.0.smithi012.stdout:2237: done (4 left) 2024-09-10T18:04:23.889 INFO:tasks.rados.rados.0.smithi012.stdout:2238: rollback oid 40 current snap is 227 2024-09-10T18:04:23.889 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 40 to 224 2024-09-10T18:04:23.889 INFO:tasks.rados.rados.0.smithi012.stdout:2236: finishing rollback tid 0 to smithi01278544-47 2024-09-10T18:04:23.889 INFO:tasks.rados.rados.0.smithi012.stdout:2234: finishing rollback tid 0 to smithi01278544-9 2024-09-10T18:04:23.889 INFO:tasks.rados.rados.0.smithi012.stdout:2234: finishing rollback tid 1 to smithi01278544-9 2024-09-10T18:04:23.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1130 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:04:23.889 INFO:tasks.rados.rados.0.smithi012.stdout:2236: finishing rollback tid 1 to smithi01278544-47 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:2236: finishing rollback tid 2 to smithi01278544-47 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1554 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:2233: finishing rollback tid 0 to smithi01278544-17 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:2233: finishing rollback tid 1 to smithi01278544-17 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:2233: finishing rollback tid 2 to smithi01278544-17 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 889 (ObjNum 545 snap 183 seq_num 545) dirty exists 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:2233: done (4 left) 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:2234: done (3 left) 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:2235: done (2 left) 2024-09-10T18:04:23.890 INFO:tasks.rados.rados.0.smithi012.stdout:2236: done (1 left) 2024-09-10T18:04:23.891 INFO:tasks.rados.rados.0.smithi012.stdout:2239: delete oid 36 current snap is 227 2024-09-10T18:04:23.897 INFO:tasks.rados.rados.0.smithi012.stdout:2239: done (1 left) 2024-09-10T18:04:23.897 INFO:tasks.rados.rados.0.smithi012.stdout:2240: rollback oid 34 current snap is 227 2024-09-10T18:04:23.897 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 34 to 196 2024-09-10T18:04:23.898 INFO:tasks.rados.rados.0.smithi012.stdout:2241: snap_create 2024-09-10T18:04:23.907 INFO:tasks.rados.rados.0.smithi012.stdout:2238: finishing rollback tid 0 to smithi01278544-40 2024-09-10T18:04:23.908 INFO:tasks.rados.rados.0.smithi012.stdout:2238: finishing rollback tid 1 to smithi01278544-40 2024-09-10T18:04:23.908 INFO:tasks.rados.rados.0.smithi012.stdout:2238: finishing rollback tid 2 to smithi01278544-40 2024-09-10T18:04:23.908 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1557 (ObjNum 582 snap 195 seq_num 582) dirty exists 2024-09-10T18:04:23.918 INFO:tasks.rados.rados.0.smithi012.stdout:2240: finishing rollback tid 0 to smithi01278544-34 2024-09-10T18:04:23.918 INFO:tasks.rados.rados.0.smithi012.stdout:2240: finishing rollback tid 1 to smithi01278544-34 2024-09-10T18:04:23.918 INFO:tasks.rados.rados.0.smithi012.stdout:2240: finishing rollback tid 2 to smithi01278544-34 2024-09-10T18:04:23.918 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 917 (ObjNum 558 snap 186 seq_num 558) dirty exists 2024-09-10T18:04:24.154 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:04:24.155 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:04:23] "GET /metrics HTTP/1.1" 200 36360 "" "Prometheus/2.43.0" 2024-09-10T18:04:24.155 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: osdmap e531: 8 total, 8 up, 8 in 2024-09-10T18:04:24.155 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.155 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.155 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:24.155 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: pgmap v470: 121 pgs: 12 peering, 21 active+undersized, 8 active+undersized+degraded, 80 active+clean; 415 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 16 op/s; 31/627 objects degraded (4.944%); 2.4 MiB/s, 0 objects/s recovering 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all osd 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-10T18:04:24.156 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: osdmap e531: 8 total, 8 up, 8 in 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.157 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: pgmap v470: 121 pgs: 12 peering, 21 active+undersized, 8 active+undersized+degraded, 80 active+clean; 415 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 16 op/s; 31/627 objects degraded (4.944%); 2.4 MiB/s, 0 objects/s recovering 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all osd 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-10T18:04:24.158 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-10T18:04:24.159 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: Upgrade: Setting require_osd_release to 19 squid 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: Upgrade: Setting require_osd_release to 19 squid 2024-09-10T18:04:24.160 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:23 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-10T18:04:24.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: osdmap e531: 8 total, 8 up, 8 in 2024-09-10T18:04:24.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:24.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: pgmap v470: 121 pgs: 12 peering, 21 active+undersized, 8 active+undersized+degraded, 80 active+clean; 415 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 16 op/s; 31/627 objects degraded (4.944%); 2.4 MiB/s, 0 objects/s recovering 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all osd 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-10T18:04:24.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-10T18:04:24.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-10T18:04:24.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: Upgrade: Setting require_osd_release to 19 squid 2024-09-10T18:04:24.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:23 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-10T18:04:24.752 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:04:24.752 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (9m) 2m ago 10m 26.8M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:04:24.752 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (10m) 5s ago 10m 90.4M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:04:24.752 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (12m) 2m ago 12m 19.0M - 18.2.4-837-g7a853b17 f21ba1eea74e 7fbc47915988 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (11m) 5s ago 11m 22.5M - 18.2.4-837-g7a853b17 f21ba1eea74e b1f6c0623c2e 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (5m) 5s ago 15m 456M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (6m) 2m ago 17m 526M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (5m) 2m ago 17m 55.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (4m) 5s ago 15m 53.7M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (5m) 2m ago 15m 46.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (10m) 2m ago 9m 15.5M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (9m) 5s ago 9m 17.2M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (4m) 2m ago 15m 166M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (3m) 2m ago 14m 109M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:04:24.753 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (3m) 2m ago 14m 98.7M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:04:24.754 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (2m) 2m ago 13m 14.4M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:04:24.754 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (113s) 5s ago 13m 250M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 75e9a99555f3 2024-09-10T18:04:24.754 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (79s) 5s ago 13m 161M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 28c479f4ad60 2024-09-10T18:04:24.754 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (44s) 5s ago 12m 118M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 71e430ee4ba6 2024-09-10T18:04:24.754 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (11s) 5s ago 12m 11.4M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 1b26f245f7dc 2024-09-10T18:04:24.754 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (5m) 5s ago 10m 65.5M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:04:24.890 INFO:tasks.rados.rados.0.smithi012.stdout:2238: done (2 left) 2024-09-10T18:04:24.890 INFO:tasks.rados.rados.0.smithi012.stdout:2240: done (1 left) 2024-09-10T18:04:24.890 INFO:tasks.rados.rados.0.smithi012.stdout:2241: done (0 left) 2024-09-10T18:04:24.890 INFO:tasks.rados.rados.0.smithi012.stdout:2242: snap_create 2024-09-10T18:04:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[92029]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-10T18:04:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-10T18:04:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[92029]: osdmap e532: 8 total, 8 up, 8 in 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds ok-to-stop", "ids": ["a"]} : dispatch 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[92029]: Upgrade: It appears safe to stop mds.a 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[92029]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[92029]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[92029]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[89611]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[89611]: osdmap e532: 8 total, 8 up, 8 in 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds ok-to-stop", "ids": ["a"]} : dispatch 2024-09-10T18:04:25.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[89611]: Upgrade: It appears safe to stop mds.a 2024-09-10T18:04:25.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[89611]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[89611]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:24 smithi012 ceph-mon[89611]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.105 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 8 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:04:25.106 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:04:25.107 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2 2024-09-10T18:04:25.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:04:25.107 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:04:25.107 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 18.2.4-837-g7a853b17 (7a853b1706d076d58e0da7a5d3b9b9eb36276880) reef (stable)": 2, 2024-09-10T18:04:25.107 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 13 2024-09-10T18:04:25.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:04:25.107 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:04:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:24 smithi089 ceph-mon[84132]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-10T18:04:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:24 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-10T18:04:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:24 smithi089 ceph-mon[84132]: osdmap e532: 8 total, 8 up, 8 in 2024-09-10T18:04:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:24 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds ok-to-stop", "ids": ["a"]} : dispatch 2024-09-10T18:04:25.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:24 smithi089 ceph-mon[84132]: Upgrade: It appears safe to stop mds.a 2024-09-10T18:04:25.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:24 smithi089 ceph-mon[84132]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:24 smithi089 ceph-mon[84132]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:24 smithi089 ceph-mon[84132]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:25.424 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "mon", 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "osd" 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "13/20 daemons upgraded", 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading mds daemons", 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:04:25.425 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:04:25.894 INFO:tasks.rados.rados.0.smithi012.stdout:2242: done (0 left) 2024-09-10T18:04:25.894 INFO:tasks.rados.rados.0.smithi012.stdout:2243: snap_create 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: osdmap e533: 8 total, 8 up, 8 in 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: pgmap v473: 121 pgs: 12 peering, 3 active+undersized, 106 active+clean; 408 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 3.6 MiB/s wr, 16 op/s; 6.4 MiB/s, 1 objects/s recovering 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/295441263' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: Upgrade: Updating mds.a 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[89611]: Deploying daemon mds.a on smithi012 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: osdmap e533: 8 total, 8 up, 8 in 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: pgmap v473: 121 pgs: 12 peering, 3 active+undersized, 106 active+clean; 408 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 3.6 MiB/s wr, 16 op/s; 6.4 MiB/s, 1 objects/s recovering 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/295441263' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: Upgrade: Updating mds.a 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:26.053 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:25 smithi012 ceph-mon[92029]: Deploying daemon mds.a on smithi012 2024-09-10T18:04:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: osdmap e533: 8 total, 8 up, 8 in 2024-09-10T18:04:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: pgmap v473: 121 pgs: 12 peering, 3 active+undersized, 106 active+clean; 408 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 3.6 MiB/s wr, 16 op/s; 6.4 MiB/s, 1 objects/s recovering 2024-09-10T18:04:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/295441263' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: Upgrade: Updating mds.a 2024-09-10T18:04:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:04:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:26.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:25 smithi089 ceph-mon[84132]: Deploying daemon mds.a on smithi012 2024-09-10T18:04:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:2243: done (0 left) 2024-09-10T18:04:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:2244: read oid 21 snap -1 2024-09-10T18:04:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:2244: expect deleted 2024-09-10T18:04:26.902 INFO:tasks.rados.rados.0.smithi012.stdout:2245: delete oid 10 current snap is 230 2024-09-10T18:04:26.907 INFO:tasks.rados.rados.0.smithi012.stdout:2244: done (1 left) 2024-09-10T18:04:26.907 INFO:tasks.rados.rados.0.smithi012.stdout:2245: done (0 left) 2024-09-10T18:04:26.907 INFO:tasks.rados.rados.0.smithi012.stdout:2246: rollback oid 38 current snap is 230 2024-09-10T18:04:26.907 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 38 to 222 2024-09-10T18:04:26.907 INFO:tasks.rados.rados.0.smithi012.stdout:2247: snap_remove snap 221 2024-09-10T18:04:27.182 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:26 smithi012 ceph-mon[89611]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/627 objects degraded (4.944%), 8 pgs degraded) 2024-09-10T18:04:27.182 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:26 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:04:27.182 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:26 smithi012 ceph-mon[89611]: osdmap e534: 8 total, 8 up, 8 in 2024-09-10T18:04:27.182 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:26 smithi012 ceph-mon[92029]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/627 objects degraded (4.944%), 8 pgs degraded) 2024-09-10T18:04:27.182 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:26 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:04:27.182 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:26 smithi012 ceph-mon[92029]: osdmap e534: 8 total, 8 up, 8 in 2024-09-10T18:04:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:26 smithi089 ceph-mon[84132]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/627 objects degraded (4.944%), 8 pgs degraded) 2024-09-10T18:04:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:26 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:04:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:26 smithi089 ceph-mon[84132]: osdmap e534: 8 total, 8 up, 8 in 2024-09-10T18:04:27.534 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:27 smithi012 systemd[1]: Stopping Ceph mds.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:04:27.736 INFO:tasks.rados.rados.0.smithi012.stdout:2247: done (1 left) 2024-09-10T18:04:27.736 INFO:tasks.rados.rados.0.smithi012.stdout:2248: snap_create 2024-09-10T18:04:27.736 INFO:tasks.rados.rados.0.smithi012.stdout:2246: finishing rollback tid 0 to smithi01278544-38 2024-09-10T18:04:27.736 INFO:tasks.rados.rados.0.smithi012.stdout:2246: finishing rollback tid 1 to smithi01278544-38 2024-09-10T18:04:27.736 INFO:tasks.rados.rados.0.smithi012.stdout:2246: finishing rollback tid 2 to smithi01278544-38 2024-09-10T18:04:27.736 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1133 (ObjNum 664 snap 217 seq_num 664) dirty exists 2024-09-10T18:04:27.902 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[63889]: 2024-09-10T18:04:27.551+0000 7fb5a3d66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:04:27.902 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:27 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[63889]: 2024-09-10T18:04:27.551+0000 7fb5a3d66640 -1 mds.a *** got signal Terminated *** 2024-09-10T18:04:28.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:27 smithi012 ceph-mon[92029]: osdmap e535: 8 total, 8 up, 8 in 2024-09-10T18:04:28.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:27 smithi012 ceph-mon[92029]: pgmap v476: 121 pgs: 121 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 2.5 MiB/s wr, 6 op/s; 4.0 MiB/s, 0 objects/s recovering 2024-09-10T18:04:28.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:27 smithi012 ceph-mon[92029]: osdmap e536: 8 total, 8 up, 8 in 2024-09-10T18:04:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:27 smithi012 ceph-mon[89611]: osdmap e535: 8 total, 8 up, 8 in 2024-09-10T18:04:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:27 smithi012 ceph-mon[89611]: pgmap v476: 121 pgs: 121 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 2.5 MiB/s wr, 6 op/s; 4.0 MiB/s, 0 objects/s recovering 2024-09-10T18:04:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:27 smithi012 ceph-mon[89611]: osdmap e536: 8 total, 8 up, 8 in 2024-09-10T18:04:28.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:27 smithi089 ceph-mon[84132]: osdmap e535: 8 total, 8 up, 8 in 2024-09-10T18:04:28.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:27 smithi089 ceph-mon[84132]: pgmap v476: 121 pgs: 121 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 2.5 MiB/s wr, 6 op/s; 4.0 MiB/s, 0 objects/s recovering 2024-09-10T18:04:28.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:27 smithi089 ceph-mon[84132]: osdmap e536: 8 total, 8 up, 8 in 2024-09-10T18:04:28.736 INFO:tasks.rados.rados.0.smithi012.stdout:2246: done (1 left) 2024-09-10T18:04:28.736 INFO:tasks.rados.rados.0.smithi012.stdout:2248: done (0 left) 2024-09-10T18:04:28.736 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 231 2024-09-10T18:04:28.736 INFO:tasks.rados.rados.0.smithi012.stdout:2249: seq_num 704 ranges {155648=598016,753664=745472,1499136=712704,2211840=147456} 2024-09-10T18:04:28.740 INFO:tasks.rados.rados.0.smithi012.stdout:2249: writing smithi01278544-40 from 155648 to 753664 tid 1 2024-09-10T18:04:28.744 INFO:tasks.rados.rados.0.smithi012.stdout:2249: writing smithi01278544-40 from 753664 to 1499136 tid 2 2024-09-10T18:04:28.748 INFO:tasks.rados.rados.0.smithi012.stdout:2249: writing smithi01278544-40 from 1499136 to 2211840 tid 3 2024-09-10T18:04:28.750 INFO:tasks.rados.rados.0.smithi012.stdout:2249: writing smithi01278544-40 from 2211840 to 2359296 tid 4 2024-09-10T18:04:28.750 INFO:tasks.rados.rados.0.smithi012.stdout:2250: setattr oid 18 current snap is 231 2024-09-10T18:04:28.750 INFO:tasks.rados.rados.0.smithi012.stdout:2249: finishing write tid 1 to smithi01278544-40 2024-09-10T18:04:28.750 INFO:tasks.rados.rados.0.smithi012.stdout:2249: finishing write tid 2 to smithi01278544-40 2024-09-10T18:04:28.752 INFO:tasks.rados.rados.0.smithi012.stdout:2251: setattr oid 7 current snap is 231 2024-09-10T18:04:28.753 INFO:tasks.rados.rados.0.smithi012.stdout:2252: rollback oid 12 current snap is 231 2024-09-10T18:04:28.754 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 12 to 185 2024-09-10T18:04:28.754 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 231 2024-09-10T18:04:28.754 INFO:tasks.rados.rados.0.smithi012.stdout:2253: seq_num 705 ranges {221184=614400,835584=630784,1466368=524288,1990656=450560} 2024-09-10T18:04:28.758 INFO:tasks.rados.rados.0.smithi012.stdout:2253: writing smithi01278544-4 from 221184 to 835584 tid 1 2024-09-10T18:04:28.762 INFO:tasks.rados.rados.0.smithi012.stdout:2253: writing smithi01278544-4 from 835584 to 1466368 tid 2 2024-09-10T18:04:28.766 INFO:tasks.rados.rados.0.smithi012.stdout:2253: writing smithi01278544-4 from 1466368 to 1990656 tid 3 2024-09-10T18:04:28.769 INFO:tasks.rados.rados.0.smithi012.stdout:2253: writing smithi01278544-4 from 1990656 to 2441216 tid 4 2024-09-10T18:04:28.769 INFO:tasks.rados.rados.0.smithi012.stdout:2254: read oid 32 snap 230 2024-09-10T18:04:28.769 INFO:tasks.rados.rados.0.smithi012.stdout:2254: expect (ObjNum 692 snap 225 seq_num 692) 2024-09-10T18:04:28.769 INFO:tasks.rados.rados.0.smithi012.stdout:2255: read oid 41 snap -1 2024-09-10T18:04:28.770 INFO:tasks.rados.rados.0.smithi012.stdout:2255: expect (ObjNum 693 snap 225 seq_num 693) 2024-09-10T18:04:28.770 INFO:tasks.rados.rados.0.smithi012.stdout:2256: rmattr oid 10 current snap is 231 2024-09-10T18:04:28.770 INFO:tasks.rados.rados.0.smithi012.stdout:2256: done (7 left) 2024-09-10T18:04:28.770 INFO:tasks.rados.rados.0.smithi012.stdout:2257: read oid 27 snap -1 2024-09-10T18:04:28.770 INFO:tasks.rados.rados.0.smithi012.stdout:2257: expect (ObjNum 695 snap 225 seq_num 695) 2024-09-10T18:04:28.770 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 231 2024-09-10T18:04:28.770 INFO:tasks.rados.rados.0.smithi012.stdout:2249: finishing write tid 3 to smithi01278544-40 2024-09-10T18:04:28.770 INFO:tasks.rados.rados.0.smithi012.stdout:2258: seq_num 706 ranges {2662400=630784,3293184=516096,3809280=729088,4538368=360448} 2024-09-10T18:04:28.788 INFO:tasks.rados.rados.0.smithi012.stdout:2258: writing smithi01278544-38 from 2662400 to 3293184 tid 1 2024-09-10T18:04:28.791 INFO:tasks.rados.rados.0.smithi012.stdout:2258: writing smithi01278544-38 from 3293184 to 3809280 tid 2 2024-09-10T18:04:28.796 INFO:tasks.rados.rados.0.smithi012.stdout:2258: writing smithi01278544-38 from 3809280 to 4538368 tid 3 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:2258: writing smithi01278544-38 from 4538368 to 4898816 tid 4 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:2259: copy_from oid 33 from oid 46 current snap is 231 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:2249: finishing write tid 4 to smithi01278544-40 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:2249: finishing write tid 5 to smithi01278544-40 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 1123 (ObjNum 65 snap 0 seq_num 1399609944) dirty exists 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:2249: finishing write tid 6 to smithi01278544-40 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:2249: oid 40 updating version 0 to 1580 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:2249: oid 40 updating version 1580 to 1581 2024-09-10T18:04:28.799 INFO:tasks.rados.rados.0.smithi012.stdout:2249: oid 40 version 1581 is already newer than 1577 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2249: oid 40 version 1581 is already newer than 1578 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2249: oid 40 version 1581 is already newer than 1579 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1581 (ObjNum 704 snap 231 seq_num 704) dirty exists 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2249: left oid 40 (ObjNum 704 snap 231 seq_num 704) 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2252: finishing rollback tid 1 to smithi01278544-12 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2252: finishing rollback tid 2 to smithi01278544-12 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1643 (ObjNum 129 snap 0 seq_num 3496957216) dirty exists 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1109 (ObjNum 670 snap 218 seq_num 670) dirty exists 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2253: finishing write tid 1 to smithi01278544-4 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2253: finishing write tid 2 to smithi01278544-4 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2249: done (9 left) 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2250: done (8 left) 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2251: done (7 left) 2024-09-10T18:04:28.800 INFO:tasks.rados.rados.0.smithi012.stdout:2252: done (6 left) 2024-09-10T18:04:28.801 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 231 2024-09-10T18:04:28.801 INFO:tasks.rados.rados.0.smithi012.stdout:2253: finishing write tid 3 to smithi01278544-4 2024-09-10T18:04:28.801 INFO:tasks.rados.rados.0.smithi012.stdout:2257: expect (ObjNum 695 snap 225 seq_num 695) 2024-09-10T18:04:28.855 INFO:tasks.rados.rados.0.smithi012.stdout:2253: finishing write tid 4 to smithi01278544-4 2024-09-10T18:04:28.855 INFO:tasks.rados.rados.0.smithi012.stdout:2253: finishing write tid 5 to smithi01278544-4 2024-09-10T18:04:28.855 INFO:tasks.rados.rados.0.smithi012.stdout:2258: finishing write tid 1 to smithi01278544-38 2024-09-10T18:04:28.855 INFO:tasks.rados.rados.0.smithi012.stdout:2255: expect (ObjNum 693 snap 225 seq_num 693) 2024-09-10T18:04:28.903 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:28 smithi012 podman[117101]: 2024-09-10 18:04:28.630073193 +0000 UTC m=+1.300905521 container died 7fbc479159888769c1cf49a8ff5a8753d7c68f615ad59157a973659dd4705e52 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=reef-7a853b1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:2253: finishing write tid 6 to smithi01278544-4 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:2253: oid 4 updating version 0 to 1058 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:2253: oid 4 updating version 1058 to 1060 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:2253: oid 4 version 1060 is already newer than 1059 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:2253: oid 4 updating version 1060 to 1061 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:2253: oid 4 version 1061 is already newer than 1057 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1061 (ObjNum 705 snap 231 seq_num 705) dirty exists 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:2253: left oid 4 (ObjNum 705 snap 231 seq_num 705) 2024-09-10T18:04:29.002 INFO:tasks.rados.rados.0.smithi012.stdout:2258: finishing write tid 2 to smithi01278544-38 2024-09-10T18:04:29.003 INFO:tasks.rados.rados.0.smithi012.stdout:2260: seq_num 707 ranges {0=647168,647168=802816,1449984=532480,1982464=270336} 2024-09-10T18:04:29.005 INFO:tasks.rados.rados.0.smithi012.stdout:2260: writing smithi01278544-19 from 0 to 647168 tid 1 2024-09-10T18:04:29.010 INFO:tasks.rados.rados.0.smithi012.stdout:2260: writing smithi01278544-19 from 647168 to 1449984 tid 2 2024-09-10T18:04:29.013 INFO:tasks.rados.rados.0.smithi012.stdout:2260: writing smithi01278544-19 from 1449984 to 1982464 tid 3 2024-09-10T18:04:29.016 INFO:tasks.rados.rados.0.smithi012.stdout:2260: writing smithi01278544-19 from 1982464 to 2252800 tid 4 2024-09-10T18:04:29.016 INFO:tasks.rados.rados.0.smithi012.stdout:2253: done (6 left) 2024-09-10T18:04:29.016 INFO:tasks.rados.rados.0.smithi012.stdout:2255: done (5 left) 2024-09-10T18:04:29.016 INFO:tasks.rados.rados.0.smithi012.stdout:2257: done (4 left) 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2261: read oid 4 snap -1 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2261: expect (ObjNum 705 snap 231 seq_num 705) 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2262: read oid 5 snap -1 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2262: expect (ObjNum 653 snap 213 seq_num 653) 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2263: copy_from oid 14 from oid 17 current snap is 231 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: finishing write tid 3 to smithi01278544-38 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2259: finishing copy_from racing read to smithi01278544-33 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: finishing write tid 4 to smithi01278544-38 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: finishing write tid 5 to smithi01278544-38 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: finishing write tid 6 to smithi01278544-38 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: oid 38 updating version 0 to 1135 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: oid 38 updating version 1135 to 1138 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: oid 38 version 1138 is already newer than 1136 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: oid 38 version 1138 is already newer than 1137 2024-09-10T18:04:29.017 INFO:tasks.rados.rados.0.smithi012.stdout:2258: oid 38 version 1138 is already newer than 1134 2024-09-10T18:04:29.018 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1138 (ObjNum 706 snap 231 seq_num 706) dirty exists 2024-09-10T18:04:29.018 INFO:tasks.rados.rados.0.smithi012.stdout:2258: left oid 38 (ObjNum 706 snap 231 seq_num 706) 2024-09-10T18:04:29.018 INFO:tasks.rados.rados.0.smithi012.stdout:2259: finishing copy_from to smithi01278544-33 2024-09-10T18:04:29.018 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 1258 (ObjNum 33 snap 0 seq_num 3497490352) dirty exists 2024-09-10T18:04:29.018 INFO:tasks.rados.rados.0.smithi012.stdout:2254: expect (ObjNum 692 snap 225 seq_num 692) 2024-09-10T18:04:29.269 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:28 smithi012 ceph-mon[89611]: fsmap cephfs:1 {0=b=up:active} 2024-09-10T18:04:29.269 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:28 smithi012 ceph-mon[89611]: osdmap e537: 8 total, 8 up, 8 in 2024-09-10T18:04:29.270 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:28 smithi012 ceph-mon[92029]: fsmap cephfs:1 {0=b=up:active} 2024-09-10T18:04:29.270 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:28 smithi012 ceph-mon[92029]: osdmap e537: 8 total, 8 up, 8 in 2024-09-10T18:04:29.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:28 smithi089 ceph-mon[84132]: fsmap cephfs:1 {0=b=up:active} 2024-09-10T18:04:29.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:28 smithi089 ceph-mon[84132]: osdmap e537: 8 total, 8 up, 8 in 2024-09-10T18:04:29.534 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:29 smithi012 podman[117101]: 2024-09-10 18:04:29.268870608 +0000 UTC m=+1.939702925 container cleanup 7fbc479159888769c1cf49a8ff5a8753d7c68f615ad59157a973659dd4705e52 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-7a853b1, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T18:04:29.534 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:29 smithi012 bash[117101]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a 2024-09-10T18:04:29.841 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:29 smithi012 podman[117114]: 2024-09-10 18:04:29.586956189 +0000 UTC m=+0.958820187 container remove 7fbc479159888769c1cf49a8ff5a8753d7c68f615ad59157a973659dd4705e52 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=reef-7a853b1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T18:04:30.145 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:29 smithi012 ceph-mon[89611]: pgmap v479: 121 pgs: 121 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 2.5 MiB/s wr, 6 op/s 2024-09-10T18:04:30.145 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:29 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-10T18:04:30.145 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:29 smithi012 systemd[1]: Stopped Ceph mds.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:04:30.145 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:29 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.a.service: Consumed 1.151s CPU time. 2024-09-10T18:04:30.146 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:30 smithi012 systemd[1]: Starting Ceph mds.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:04:30.146 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:29 smithi012 ceph-mon[92029]: pgmap v479: 121 pgs: 121 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 2.5 MiB/s wr, 6 op/s 2024-09-10T18:04:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:29 smithi089 ceph-mon[84132]: pgmap v479: 121 pgs: 121 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 2.5 MiB/s wr, 6 op/s 2024-09-10T18:04:30.445 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:30 smithi012 podman[117240]: 2024-09-10 18:04:30.224319848 +0000 UTC m=+0.016538904 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:04:30.445 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:30 smithi012 podman[117240]: 2024-09-10 18:04:30.338430624 +0000 UTC m=+0.130649667 container create 34b133ecae8a03d863de1d89b496a90dd2c894a78767e88b2ac6effd5fad110a (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T18:04:30.784 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:30 smithi012 podman[117240]: 2024-09-10 18:04:30.574307596 +0000 UTC m=+0.366526638 container init 34b133ecae8a03d863de1d89b496a90dd2c894a78767e88b2ac6effd5fad110a (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T18:04:30.784 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:30 smithi012 podman[117240]: 2024-09-10 18:04:30.577796698 +0000 UTC m=+0.370015751 container start 34b133ecae8a03d863de1d89b496a90dd2c894a78767e88b2ac6effd5fad110a (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:04:30.784 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[117263]: starting mds.a at 2024-09-10T18:04:30.784 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:30 smithi012 bash[117240]: 34b133ecae8a03d863de1d89b496a90dd2c894a78767e88b2ac6effd5fad110a 2024-09-10T18:04:30.785 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:30 smithi012 systemd[1]: Started Ceph mds.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:04:30.977 INFO:tasks.rados.rados.0.smithi012.stdout:2260: finishing write tid 1 to smithi01278544-19 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: finishing write tid 2 to smithi01278544-19 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: finishing write tid 3 to smithi01278544-19 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: finishing write tid 4 to smithi01278544-19 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: finishing write tid 5 to smithi01278544-19 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: finishing write tid 6 to smithi01278544-19 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: oid 19 updating version 0 to 930 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: oid 19 version 930 is already newer than 929 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: oid 19 version 930 is already newer than 927 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: oid 19 version 930 is already newer than 928 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: oid 19 version 930 is already newer than 926 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 930 (ObjNum 707 snap 231 seq_num 707) dirty exists 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2260: left oid 19 (ObjNum 707 snap 231 seq_num 707) 2024-09-10T18:04:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:2261: expect (ObjNum 705 snap 231 seq_num 705) 2024-09-10T18:04:31.056 INFO:tasks.rados.rados.0.smithi012.stdout:2262: expect (ObjNum 653 snap 213 seq_num 653) 2024-09-10T18:04:31.666 INFO:tasks.rados.rados.0.smithi012.stdout:2263: finishing copy_from racing read to smithi01278544-14 2024-09-10T18:04:31.666 INFO:tasks.rados.rados.0.smithi012.stdout:2263: finishing copy_from to smithi01278544-14 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 889 (ObjNum 545 snap 183 seq_num 545) dirty exists 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:2254: done (6 left) 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:2258: done (5 left) 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:2259: done (4 left) 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:2260: done (3 left) 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:2261: done (2 left) 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:2262: done (1 left) 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:2263: done (0 left) 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 231 2024-09-10T18:04:31.667 INFO:tasks.rados.rados.0.smithi012.stdout:2264: seq_num 708 ranges {0=663552,663552=737280,1400832=696320,2097152=172032} 2024-09-10T18:04:31.669 INFO:tasks.rados.rados.0.smithi012.stdout:2264: writing smithi01278544-22 from 0 to 663552 tid 1 2024-09-10T18:04:31.673 INFO:tasks.rados.rados.0.smithi012.stdout:2264: writing smithi01278544-22 from 663552 to 1400832 tid 2 2024-09-10T18:04:31.677 INFO:tasks.rados.rados.0.smithi012.stdout:2264: writing smithi01278544-22 from 1400832 to 2097152 tid 3 2024-09-10T18:04:31.678 INFO:tasks.rados.rados.0.smithi012.stdout:2264: writing smithi01278544-22 from 2097152 to 2269184 tid 4 2024-09-10T18:04:31.678 INFO:tasks.rados.rados.0.smithi012.stdout:2265: snap_create 2024-09-10T18:04:31.679 INFO:tasks.rados.rados.0.smithi012.stdout:2264: finishing write tid 1 to smithi01278544-22 2024-09-10T18:04:31.679 INFO:tasks.rados.rados.0.smithi012.stdout:2264: finishing write tid 2 to smithi01278544-22 2024-09-10T18:04:31.683 INFO:tasks.rados.rados.0.smithi012.stdout:2264: finishing write tid 3 to smithi01278544-22 2024-09-10T18:04:31.683 INFO:tasks.rados.rados.0.smithi012.stdout:2264: finishing write tid 4 to smithi01278544-22 2024-09-10T18:04:31.684 INFO:tasks.rados.rados.0.smithi012.stdout:2264: finishing write tid 5 to smithi01278544-22 2024-09-10T18:04:31.686 INFO:tasks.rados.rados.0.smithi012.stdout:2264: finishing write tid 6 to smithi01278544-22 2024-09-10T18:04:31.686 INFO:tasks.rados.rados.0.smithi012.stdout:2264: oid 22 updating version 0 to 1647 2024-09-10T18:04:31.686 INFO:tasks.rados.rados.0.smithi012.stdout:2264: oid 22 updating version 1647 to 1648 2024-09-10T18:04:31.686 INFO:tasks.rados.rados.0.smithi012.stdout:2264: oid 22 version 1648 is already newer than 1646 2024-09-10T18:04:31.686 INFO:tasks.rados.rados.0.smithi012.stdout:2264: oid 22 version 1648 is already newer than 1645 2024-09-10T18:04:31.686 INFO:tasks.rados.rados.0.smithi012.stdout:2264: oid 22 version 1648 is already newer than 1644 2024-09-10T18:04:31.686 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1648 (ObjNum 708 snap 231 seq_num 708) dirty exists 2024-09-10T18:04:31.686 INFO:tasks.rados.rados.0.smithi012.stdout:2264: left oid 22 (ObjNum 708 snap 231 seq_num 708) 2024-09-10T18:04:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[89611]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:boot 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[89611]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[92029]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:boot 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[92029]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T18:04:32.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:31 smithi089 ceph-mon[84132]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:boot 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:31 smithi089 ceph-mon[84132]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:32.449 INFO:tasks.rados.rados.0.smithi012.stdout:2264: done (1 left) 2024-09-10T18:04:32.453 INFO:tasks.rados.rados.0.smithi012.stdout:2265: done (0 left) 2024-09-10T18:04:32.453 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 232 2024-09-10T18:04:32.453 INFO:tasks.rados.rados.0.smithi012.stdout:2266: seq_num 709 ranges {3858432=679936,4538368=614400,5152768=499712,5652480=491520} 2024-09-10T18:04:32.473 INFO:tasks.rados.rados.0.smithi012.stdout:2266: writing smithi01278544-43 from 3858432 to 4538368 tid 1 2024-09-10T18:04:32.477 INFO:tasks.rados.rados.0.smithi012.stdout:2266: writing smithi01278544-43 from 4538368 to 5152768 tid 2 2024-09-10T18:04:32.480 INFO:tasks.rados.rados.0.smithi012.stdout:2266: writing smithi01278544-43 from 5152768 to 5652480 tid 3 2024-09-10T18:04:32.484 INFO:tasks.rados.rados.0.smithi012.stdout:2266: writing smithi01278544-43 from 5652480 to 6144000 tid 4 2024-09-10T18:04:32.484 INFO:tasks.rados.rados.0.smithi012.stdout:2267: snap_remove snap 230 2024-09-10T18:04:32.733 INFO:tasks.rados.rados.0.smithi012.stdout:2267: done (1 left) 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2268: copy_from oid 29 from oid 6 current snap is 232 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2269: copy_from oid 22 from oid 16 current snap is 232 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2270: delete oid 13 current snap is 232 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: finishing write tid 1 to smithi01278544-43 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: finishing write tid 2 to smithi01278544-43 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: finishing write tid 3 to smithi01278544-43 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: finishing write tid 4 to smithi01278544-43 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: finishing write tid 5 to smithi01278544-43 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: finishing write tid 6 to smithi01278544-43 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: oid 43 updating version 0 to 1589 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: oid 43 version 1589 is already newer than 1587 2024-09-10T18:04:32.734 INFO:tasks.rados.rados.0.smithi012.stdout:2266: oid 43 version 1589 is already newer than 1588 2024-09-10T18:04:32.735 INFO:tasks.rados.rados.0.smithi012.stdout:2266: oid 43 version 1589 is already newer than 1585 2024-09-10T18:04:32.735 INFO:tasks.rados.rados.0.smithi012.stdout:2266: oid 43 version 1589 is already newer than 1586 2024-09-10T18:04:32.735 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 1589 (ObjNum 709 snap 232 seq_num 709) dirty exists 2024-09-10T18:04:32.735 INFO:tasks.rados.rados.0.smithi012.stdout:2266: left oid 43 (ObjNum 709 snap 232 seq_num 709) 2024-09-10T18:04:32.738 INFO:tasks.rados.rados.0.smithi012.stdout:2266: done (3 left) 2024-09-10T18:04:32.738 INFO:tasks.rados.rados.0.smithi012.stdout:2270: done (2 left) 2024-09-10T18:04:32.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 232 2024-09-10T18:04:32.738 INFO:tasks.rados.rados.0.smithi012.stdout:2271: seq_num 711 ranges {2252800=712704,2965504=786432,3751936=516096,4268032=303104} 2024-09-10T18:04:32.754 INFO:tasks.rados.rados.0.smithi012.stdout:2271: writing smithi01278544-19 from 2252800 to 2965504 tid 1 2024-09-10T18:04:32.759 INFO:tasks.rados.rados.0.smithi012.stdout:2271: writing smithi01278544-19 from 2965504 to 3751936 tid 2 2024-09-10T18:04:32.763 INFO:tasks.rados.rados.0.smithi012.stdout:2271: writing smithi01278544-19 from 3751936 to 4268032 tid 3 2024-09-10T18:04:32.765 INFO:tasks.rados.rados.0.smithi012.stdout:2271: writing smithi01278544-19 from 4268032 to 4571136 tid 4 2024-09-10T18:04:32.765 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 232 2024-09-10T18:04:32.765 INFO:tasks.rados.rados.0.smithi012.stdout:2269: finishing copy_from racing read to smithi01278544-22 2024-09-10T18:04:32.765 INFO:tasks.rados.rados.0.smithi012.stdout:2272: seq_num 712 ranges {2441216=729088,3170304=671744,3842048=671744,4513792=262144} 2024-09-10T18:04:32.782 INFO:tasks.rados.rados.0.smithi012.stdout:2272: writing smithi01278544-4 from 2441216 to 3170304 tid 1 2024-09-10T18:04:32.786 INFO:tasks.rados.rados.0.smithi012.stdout:2272: writing smithi01278544-4 from 3170304 to 3842048 tid 2 2024-09-10T18:04:32.790 INFO:tasks.rados.rados.0.smithi012.stdout:2272: writing smithi01278544-4 from 3842048 to 4513792 tid 3 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2272: writing smithi01278544-4 from 4513792 to 4775936 tid 4 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2273: read oid 15 snap -1 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2273: expect (ObjNum 657 snap 214 seq_num 657) 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2274: copy_from oid 7 from oid 14 current snap is 232 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2269: finishing copy_from to smithi01278544-22 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1112 (ObjNum 674 snap 219 seq_num 674) dirty exists 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2271: finishing write tid 1 to smithi01278544-19 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2269: done (5 left) 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2275: read oid 35 snap -1 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2275: expect (ObjNum 667 snap 218 seq_num 667) 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2276: setattr oid 31 current snap is 232 2024-09-10T18:04:32.793 INFO:tasks.rados.rados.0.smithi012.stdout:2271: finishing write tid 2 to smithi01278544-19 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2268: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: finishing write tid 3 to smithi01278544-19 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: finishing write tid 4 to smithi01278544-19 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: finishing write tid 5 to smithi01278544-19 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: finishing write tid 6 to smithi01278544-19 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: oid 19 updating version 0 to 933 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: oid 19 version 933 is already newer than 932 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: oid 19 updating version 933 to 935 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: oid 19 updating version 935 to 936 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: oid 19 version 936 is already newer than 934 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 936 (ObjNum 711 snap 232 seq_num 711) dirty exists 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2271: left oid 19 (ObjNum 711 snap 232 seq_num 711) 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2268: finishing copy_from to smithi01278544-29 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1117 (ObjNum 676 snap 220 seq_num 676) dirty exists 2024-09-10T18:04:32.794 INFO:tasks.rados.rados.0.smithi012.stdout:2272: finishing write tid 1 to smithi01278544-4 2024-09-10T18:04:32.795 INFO:tasks.rados.rados.0.smithi012.stdout:2272: finishing write tid 2 to smithi01278544-4 2024-09-10T18:04:32.795 INFO:tasks.rados.rados.0.smithi012.stdout:2272: finishing write tid 3 to smithi01278544-4 2024-09-10T18:04:32.795 INFO:tasks.rados.rados.0.smithi012.stdout:2268: done (6 left) 2024-09-10T18:04:32.795 INFO:tasks.rados.rados.0.smithi012.stdout:2271: done (5 left) 2024-09-10T18:04:32.795 INFO:tasks.rados.rados.0.smithi012.stdout:2277: setattr oid 26 current snap is 232 2024-09-10T18:04:32.797 INFO:tasks.rados.rados.0.smithi012.stdout:2278: rmattr oid 36 current snap is 232 2024-09-10T18:04:32.797 INFO:tasks.rados.rados.0.smithi012.stdout:2278: done (6 left) 2024-09-10T18:04:32.797 INFO:tasks.rados.rados.0.smithi012.stdout:2279: read oid 45 snap -1 2024-09-10T18:04:32.797 INFO:tasks.rados.rados.0.smithi012.stdout:2279: expect deleted 2024-09-10T18:04:32.797 INFO:tasks.rados.rados.0.smithi012.stdout:2280: read oid 6 snap -1 2024-09-10T18:04:32.797 INFO:tasks.rados.rados.0.smithi012.stdout:2280: expect (ObjNum 676 snap 220 seq_num 676) 2024-09-10T18:04:32.797 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 232 2024-09-10T18:04:32.797 INFO:tasks.rados.rados.0.smithi012.stdout:2281: seq_num 713 ranges {2662400=745472,3407872=557056,3964928=483328,4448256=565248} 2024-09-10T18:04:32.817 INFO:tasks.rados.rados.0.smithi012.stdout:2281: writing smithi01278544-20 from 2662400 to 3407872 tid 1 2024-09-10T18:04:32.821 INFO:tasks.rados.rados.0.smithi012.stdout:2281: writing smithi01278544-20 from 3407872 to 3964928 tid 2 2024-09-10T18:04:32.824 INFO:tasks.rados.rados.0.smithi012.stdout:2281: writing smithi01278544-20 from 3964928 to 4448256 tid 3 2024-09-10T18:04:32.827 INFO:tasks.rados.rados.0.smithi012.stdout:2281: writing smithi01278544-20 from 4448256 to 5013504 tid 4 2024-09-10T18:04:32.827 INFO:tasks.rados.rados.0.smithi012.stdout:2282: snap_create 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:2272: finishing write tid 4 to smithi01278544-4 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:2272: finishing write tid 5 to smithi01278544-4 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:2272: finishing write tid 6 to smithi01278544-4 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:2272: oid 4 updating version 0 to 1067 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:2272: oid 4 updating version 1067 to 1070 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:2272: oid 4 version 1070 is already newer than 1068 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:2272: oid 4 version 1070 is already newer than 1066 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:2272: oid 4 version 1070 is already newer than 1069 2024-09-10T18:04:32.828 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1070 (ObjNum 712 snap 232 seq_num 712) dirty exists 2024-09-10T18:04:32.829 INFO:tasks.rados.rados.0.smithi012.stdout:2272: left oid 4 (ObjNum 712 snap 232 seq_num 712) 2024-09-10T18:04:32.829 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 1071 (ObjNum 33 snap 0 seq_num 3496819728) dirty exists 2024-09-10T18:04:32.829 INFO:tasks.rados.rados.0.smithi012.stdout:2273: expect (ObjNum 657 snap 214 seq_num 657) 2024-09-10T18:04:32.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 799 (ObjNum 696 snap 225 seq_num 696) dirty exists 2024-09-10T18:04:32.894 INFO:tasks.rados.rados.0.smithi012.stdout:2281: finishing write tid 1 to smithi01278544-20 2024-09-10T18:04:32.894 INFO:tasks.rados.rados.0.smithi012.stdout:2281: finishing write tid 2 to smithi01278544-20 2024-09-10T18:04:32.894 INFO:tasks.rados.rados.0.smithi012.stdout:2280: expect (ObjNum 676 snap 220 seq_num 676) 2024-09-10T18:04:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:32 smithi012 ceph-mon[89611]: pgmap v480: 121 pgs: 121 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-09-10T18:04:33.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:32 smithi012 ceph-mon[89611]: osdmap e538: 8 total, 8 up, 8 in 2024-09-10T18:04:33.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:32 smithi012 ceph-mon[92029]: pgmap v480: 121 pgs: 121 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-09-10T18:04:33.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:32 smithi012 ceph-mon[92029]: osdmap e538: 8 total, 8 up, 8 in 2024-09-10T18:04:33.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:32 smithi089 ceph-mon[84132]: pgmap v480: 121 pgs: 121 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-09-10T18:04:33.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:32 smithi089 ceph-mon[84132]: osdmap e538: 8 total, 8 up, 8 in 2024-09-10T18:04:33.403 INFO:tasks.rados.rados.0.smithi012.stdout:2281: finishing write tid 3 to smithi01278544-20 2024-09-10T18:04:33.403 INFO:tasks.rados.rados.0.smithi012.stdout:2281: finishing write tid 4 to smithi01278544-20 2024-09-10T18:04:33.403 INFO:tasks.rados.rados.0.smithi012.stdout:2281: finishing write tid 5 to smithi01278544-20 2024-09-10T18:04:33.403 INFO:tasks.rados.rados.0.smithi012.stdout:2281: finishing write tid 6 to smithi01278544-20 2024-09-10T18:04:33.403 INFO:tasks.rados.rados.0.smithi012.stdout:2281: oid 20 updating version 0 to 1655 2024-09-10T18:04:33.403 INFO:tasks.rados.rados.0.smithi012.stdout:2281: oid 20 version 1655 is already newer than 1652 2024-09-10T18:04:33.404 INFO:tasks.rados.rados.0.smithi012.stdout:2281: oid 20 version 1655 is already newer than 1654 2024-09-10T18:04:33.404 INFO:tasks.rados.rados.0.smithi012.stdout:2281: oid 20 version 1655 is already newer than 1653 2024-09-10T18:04:33.404 INFO:tasks.rados.rados.0.smithi012.stdout:2281: oid 20 updating version 1655 to 1656 2024-09-10T18:04:33.404 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1656 (ObjNum 713 snap 232 seq_num 713) dirty exists 2024-09-10T18:04:33.404 INFO:tasks.rados.rados.0.smithi012.stdout:2281: left oid 20 (ObjNum 713 snap 232 seq_num 713) 2024-09-10T18:04:33.404 INFO:tasks.rados.rados.0.smithi012.stdout:2275: expect (ObjNum 667 snap 218 seq_num 667) 2024-09-10T18:04:34.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:04:33 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:04:33] "GET /metrics HTTP/1.1" 200 36355 "" "Prometheus/2.43.0" 2024-09-10T18:04:34.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:33 smithi012 ceph-mon[89611]: osdmap e539: 8 total, 8 up, 8 in 2024-09-10T18:04:34.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:33 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:33 smithi012 ceph-mon[92029]: osdmap e539: 8 total, 8 up, 8 in 2024-09-10T18:04:34.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:33 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:33 smithi089 ceph-mon[84132]: osdmap e539: 8 total, 8 up, 8 in 2024-09-10T18:04:34.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:33 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.159 INFO:tasks.rados.rados.0.smithi012.stdout:2274: finishing copy_from racing read to smithi01278544-7 2024-09-10T18:04:34.159 INFO:tasks.rados.rados.0.smithi012.stdout:2274: finishing copy_from to smithi01278544-7 2024-09-10T18:04:34.159 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 889 (ObjNum 545 snap 183 seq_num 545) dirty exists 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2272: done (9 left) 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2273: done (8 left) 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2274: done (7 left) 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2275: done (6 left) 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2276: done (5 left) 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2277: done (4 left) 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2279: done (3 left) 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2280: done (2 left) 2024-09-10T18:04:34.160 INFO:tasks.rados.rados.0.smithi012.stdout:2281: done (1 left) 2024-09-10T18:04:34.161 INFO:tasks.rados.rados.0.smithi012.stdout:2282: done (0 left) 2024-09-10T18:04:34.161 INFO:tasks.rados.rados.0.smithi012.stdout:2283: copy_from oid 27 from oid 9 current snap is 233 2024-09-10T18:04:34.161 INFO:tasks.rados.rados.0.smithi012.stdout:2284: read oid 16 snap 229 2024-09-10T18:04:34.161 INFO:tasks.rados.rados.0.smithi012.stdout:2284: expect (ObjNum 674 snap 219 seq_num 674) 2024-09-10T18:04:34.161 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 233 2024-09-10T18:04:34.161 INFO:tasks.rados.rados.0.smithi012.stdout:2285: seq_num 714 ranges {0=761856,761856=442368,1204224=688128,1892352=475136} 2024-09-10T18:04:34.164 INFO:tasks.rados.rados.0.smithi012.stdout:2285: writing smithi01278544-36 from 0 to 761856 tid 1 2024-09-10T18:04:34.167 INFO:tasks.rados.rados.0.smithi012.stdout:2285: writing smithi01278544-36 from 761856 to 1204224 tid 2 2024-09-10T18:04:34.172 INFO:tasks.rados.rados.0.smithi012.stdout:2285: writing smithi01278544-36 from 1204224 to 1892352 tid 3 2024-09-10T18:04:34.175 INFO:tasks.rados.rados.0.smithi012.stdout:2285: writing smithi01278544-36 from 1892352 to 2367488 tid 4 2024-09-10T18:04:34.175 INFO:tasks.rados.rados.0.smithi012.stdout:2286: setattr oid 44 current snap is 233 2024-09-10T18:04:34.175 INFO:tasks.rados.rados.0.smithi012.stdout:2283: finishing copy_from to smithi01278544-27 2024-09-10T18:04:34.175 INFO:tasks.rados.rados.0.smithi012.stdout:2283: got expected ENOENT (src dne) 2024-09-10T18:04:34.175 INFO:tasks.rados.rados.0.smithi012.stdout:2283: finishing copy_from racing read to smithi01278544-27 2024-09-10T18:04:34.175 INFO:tasks.rados.rados.0.smithi012.stdout:2284: expect (ObjNum 674 snap 219 seq_num 674) 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: finishing write tid 1 to smithi01278544-36 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: finishing write tid 2 to smithi01278544-36 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: finishing write tid 3 to smithi01278544-36 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: finishing write tid 4 to smithi01278544-36 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: finishing write tid 5 to smithi01278544-36 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: finishing write tid 6 to smithi01278544-36 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: oid 36 updating version 0 to 804 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: oid 36 version 804 is already newer than 803 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: oid 36 version 804 is already newer than 800 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: oid 36 version 804 is already newer than 802 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:2285: oid 36 version 804 is already newer than 801 2024-09-10T18:04:34.222 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 804 (ObjNum 714 snap 233 seq_num 714) dirty exists 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2285: left oid 36 (ObjNum 714 snap 233 seq_num 714) 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2283: done (3 left) 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2284: done (2 left) 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2285: done (1 left) 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2287: copy_from oid 29 from oid 48 current snap is 233 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2288: read oid 1 snap -1 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2288: expect (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2289: read oid 19 snap 225 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2289: expect deleted 2024-09-10T18:04:34.223 INFO:tasks.rados.rados.0.smithi012.stdout:2290: delete oid 42 current snap is 233 2024-09-10T18:04:34.225 INFO:tasks.rados.rados.0.smithi012.stdout:2289: done (4 left) 2024-09-10T18:04:34.225 INFO:tasks.rados.rados.0.smithi012.stdout:2290: done (3 left) 2024-09-10T18:04:34.225 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 233 2024-09-10T18:04:34.225 INFO:tasks.rados.rados.0.smithi012.stdout:2291: seq_num 716 ranges {4571136=794624,5365760=655360,6021120=704512,6725632=245760} 2024-09-10T18:04:34.255 INFO:tasks.rados.rados.0.smithi012.stdout:2291: writing smithi01278544-19 from 4571136 to 5365760 tid 1 2024-09-10T18:04:34.258 INFO:tasks.rados.rados.0.smithi012.stdout:2291: writing smithi01278544-19 from 5365760 to 6021120 tid 2 2024-09-10T18:04:34.263 INFO:tasks.rados.rados.0.smithi012.stdout:2291: writing smithi01278544-19 from 6021120 to 6725632 tid 3 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:2291: writing smithi01278544-19 from 6725632 to 6971392 tid 4 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:2292: rmattr oid 20 current snap is 233 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:2292: done (4 left) 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:2293: copy_from oid 9 from oid 47 current snap is 233 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 233 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1267 (ObjNum 681 snap 221 seq_num 681) dirty exists 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:2287: finishing copy_from to smithi01278544-29 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:2287: got expected ENOENT (src dne) 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:2287: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:04:34.265 INFO:tasks.rados.rados.0.smithi012.stdout:2294: seq_num 717 ranges {1359872=16384} 2024-09-10T18:04:34.272 INFO:tasks.rados.rados.0.smithi012.stdout:2294: writing smithi01278544-11 from 1359872 to 1376256 tid 1 2024-09-10T18:04:34.273 INFO:tasks.rados.rados.0.smithi012.stdout:2286: done (5 left) 2024-09-10T18:04:34.273 INFO:tasks.rados.rados.0.smithi012.stdout:2287: done (4 left) 2024-09-10T18:04:34.273 INFO:tasks.rados.rados.0.smithi012.stdout:2295: snap_remove snap 219 2024-09-10T18:04:34.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:34 smithi012 ceph-mon[89611]: pgmap v483: 121 pgs: 121 active+clean; 428 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 3.1 MiB/s wr, 22 op/s 2024-09-10T18:04:34.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:34 smithi012 ceph-mon[89611]: osdmap e540: 8 total, 8 up, 8 in 2024-09-10T18:04:34.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:34 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.976 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:34 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.977 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:34 smithi012 ceph-mon[92029]: pgmap v483: 121 pgs: 121 active+clean; 428 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 3.1 MiB/s wr, 22 op/s 2024-09-10T18:04:34.977 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:34 smithi012 ceph-mon[92029]: osdmap e540: 8 total, 8 up, 8 in 2024-09-10T18:04:34.977 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:34 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:34.977 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:34 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:34 smithi089 ceph-mon[84132]: pgmap v483: 121 pgs: 121 active+clean; 428 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 3.1 MiB/s wr, 22 op/s 2024-09-10T18:04:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:34 smithi089 ceph-mon[84132]: osdmap e540: 8 total, 8 up, 8 in 2024-09-10T18:04:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:34 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:34 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:35.227 INFO:tasks.rados.rados.0.smithi012.stdout:2295: done (4 left) 2024-09-10T18:04:35.227 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 233 2024-09-10T18:04:35.227 INFO:tasks.rados.rados.0.smithi012.stdout:2296: seq_num 718 ranges {0=32768} 2024-09-10T18:04:35.227 INFO:tasks.rados.rados.0.smithi012.stdout:2296: writing smithi01278544-48 from 0 to 32768 tid 1 2024-09-10T18:04:35.227 INFO:tasks.rados.rados.0.smithi012.stdout:2297: rollback oid 8 current snap is 233 2024-09-10T18:04:35.227 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 8 to 231 2024-09-10T18:04:35.227 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 233 2024-09-10T18:04:35.228 INFO:tasks.rados.rados.0.smithi012.stdout:2298: seq_num 719 ranges {0=49152} 2024-09-10T18:04:35.228 INFO:tasks.rados.rados.0.smithi012.stdout:2298: writing smithi01278544-2 from 0 to 49152 tid 1 2024-09-10T18:04:35.228 INFO:tasks.rados.rados.0.smithi012.stdout:2299: snap_create 2024-09-10T18:04:35.228 INFO:tasks.rados.rados.0.smithi012.stdout:2288: expect (ObjNum 476 snap 155 seq_num 476) 2024-09-10T18:04:35.558 INFO:tasks.rados.rados.0.smithi012.stdout:2291: finishing write tid 1 to smithi01278544-19 2024-09-10T18:04:35.558 INFO:tasks.rados.rados.0.smithi012.stdout:2291: finishing write tid 2 to smithi01278544-19 2024-09-10T18:04:35.558 INFO:tasks.rados.rados.0.smithi012.stdout:2291: finishing write tid 3 to smithi01278544-19 2024-09-10T18:04:35.558 INFO:tasks.rados.rados.0.smithi012.stdout:2291: finishing write tid 4 to smithi01278544-19 2024-09-10T18:04:35.558 INFO:tasks.rados.rados.0.smithi012.stdout:2291: finishing write tid 5 to smithi01278544-19 2024-09-10T18:04:35.558 INFO:tasks.rados.rados.0.smithi012.stdout:2291: finishing write tid 6 to smithi01278544-19 2024-09-10T18:04:35.558 INFO:tasks.rados.rados.0.smithi012.stdout:2291: oid 19 updating version 0 to 941 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2291: oid 19 updating version 941 to 942 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2291: oid 19 version 942 is already newer than 940 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2291: oid 19 version 942 is already newer than 938 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2291: oid 19 version 942 is already newer than 939 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 942 (ObjNum 716 snap 233 seq_num 716) dirty exists 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2291: left oid 19 (ObjNum 716 snap 233 seq_num 716) 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2294: finishing write tid 1 to smithi01278544-11 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2294: finishing write tid 2 to smithi01278544-11 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2294: finishing write tid 3 to smithi01278544-11 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2294: oid 11 updating version 0 to 1659 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2294: oid 11 version 1659 is already newer than 1658 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1659 (ObjNum 717 snap 233 seq_num 717) dirty exists 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2294: left oid 11 (ObjNum 717 snap 233 seq_num 717) 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2293: finishing copy_from racing read to smithi01278544-9 2024-09-10T18:04:35.559 INFO:tasks.rados.rados.0.smithi012.stdout:2293: finishing copy_from to smithi01278544-9 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1554 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2298: finishing write tid 1 to smithi01278544-2 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2298: finishing write tid 2 to smithi01278544-2 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2296: finishing write tid 1 to smithi01278544-48 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2296: finishing write tid 2 to smithi01278544-48 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2298: finishing write tid 3 to smithi01278544-2 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2298: oid 2 updating version 0 to 1124 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2298: oid 2 updating version 1124 to 1125 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1125 (ObjNum 719 snap 233 seq_num 719) dirty exists 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2298: left oid 2 (ObjNum 719 snap 233 seq_num 719) 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2297: finishing rollback tid 1 to smithi01278544-8 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1107 (ObjNum 129 snap 0 seq_num 3011971104) dirty dne 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2296: finishing write tid 3 to smithi01278544-48 2024-09-10T18:04:35.560 INFO:tasks.rados.rados.0.smithi012.stdout:2296: oid 48 updating version 0 to 1556 2024-09-10T18:04:35.561 INFO:tasks.rados.rados.0.smithi012.stdout:2296: oid 48 version 1556 is already newer than 1555 2024-09-10T18:04:35.561 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 1556 (ObjNum 718 snap 233 seq_num 718) dirty exists 2024-09-10T18:04:35.561 INFO:tasks.rados.rados.0.smithi012.stdout:2296: left oid 48 (ObjNum 718 snap 233 seq_num 718) 2024-09-10T18:04:36.236 INFO:tasks.rados.rados.0.smithi012.stdout:2288: done (7 left) 2024-09-10T18:04:36.236 INFO:tasks.rados.rados.0.smithi012.stdout:2291: done (6 left) 2024-09-10T18:04:36.237 INFO:tasks.rados.rados.0.smithi012.stdout:2293: done (5 left) 2024-09-10T18:04:36.237 INFO:tasks.rados.rados.0.smithi012.stdout:2294: done (4 left) 2024-09-10T18:04:36.237 INFO:tasks.rados.rados.0.smithi012.stdout:2296: done (3 left) 2024-09-10T18:04:36.237 INFO:tasks.rados.rados.0.smithi012.stdout:2297: done (2 left) 2024-09-10T18:04:36.237 INFO:tasks.rados.rados.0.smithi012.stdout:2298: done (1 left) 2024-09-10T18:04:36.237 INFO:tasks.rados.rados.0.smithi012.stdout:2299: done (0 left) 2024-09-10T18:04:36.237 INFO:tasks.rados.rados.0.smithi012.stdout:2300: snap_remove snap 213 2024-09-10T18:04:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:36 smithi012 ceph-mon[92029]: pgmap v485: 121 pgs: 121 active+clean; 430 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-09-10T18:04:36.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:36 smithi012 ceph-mon[92029]: osdmap e541: 8 total, 8 up, 8 in 2024-09-10T18:04:36.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:36 smithi012 ceph-mon[89611]: pgmap v485: 121 pgs: 121 active+clean; 430 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-09-10T18:04:36.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:36 smithi012 ceph-mon[89611]: osdmap e541: 8 total, 8 up, 8 in 2024-09-10T18:04:36.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:36 smithi089 ceph-mon[84132]: pgmap v485: 121 pgs: 121 active+clean; 430 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-09-10T18:04:36.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:36 smithi089 ceph-mon[84132]: osdmap e541: 8 total, 8 up, 8 in 2024-09-10T18:04:37.240 INFO:tasks.rados.rados.0.smithi012.stdout:2300: done (0 left) 2024-09-10T18:04:37.241 INFO:tasks.rados.rados.0.smithi012.stdout:2301: read oid 16 snap -1 2024-09-10T18:04:37.241 INFO:tasks.rados.rados.0.smithi012.stdout:2301: expect (ObjNum 674 snap 219 seq_num 674) 2024-09-10T18:04:37.241 INFO:tasks.rados.rados.0.smithi012.stdout:2302: read oid 15 snap -1 2024-09-10T18:04:37.241 INFO:tasks.rados.rados.0.smithi012.stdout:2302: expect (ObjNum 657 snap 214 seq_num 657) 2024-09-10T18:04:37.241 INFO:tasks.rados.rados.0.smithi012.stdout:2303: snap_create 2024-09-10T18:04:37.260 INFO:tasks.rados.rados.0.smithi012.stdout:2301: expect (ObjNum 674 snap 219 seq_num 674) 2024-09-10T18:04:37.308 INFO:tasks.rados.rados.0.smithi012.stdout:2302: expect (ObjNum 657 snap 214 seq_num 657) 2024-09-10T18:04:37.355 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:37 smithi012 ceph-mon[89611]: osdmap e542: 8 total, 8 up, 8 in 2024-09-10T18:04:37.355 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:37 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:37.355 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:37 smithi012 ceph-mon[92029]: osdmap e542: 8 total, 8 up, 8 in 2024-09-10T18:04:37.355 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:37 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:37.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:37 smithi089 ceph-mon[84132]: osdmap e542: 8 total, 8 up, 8 in 2024-09-10T18:04:37.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:37 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:37.742 INFO:tasks.rados.rados.0.smithi012.stdout:2301: done (2 left) 2024-09-10T18:04:37.742 INFO:tasks.rados.rados.0.smithi012.stdout:2302: done (1 left) 2024-09-10T18:04:37.742 INFO:tasks.rados.rados.0.smithi012.stdout:2303: done (0 left) 2024-09-10T18:04:37.743 INFO:tasks.rados.rados.0.smithi012.stdout:2304: setattr oid 33 current snap is 235 2024-09-10T18:04:37.743 INFO:tasks.rados.rados.0.smithi012.stdout:2305: delete oid 35 current snap is 235 2024-09-10T18:04:37.746 INFO:tasks.rados.rados.0.smithi012.stdout:2305: done (1 left) 2024-09-10T18:04:37.746 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 235 2024-09-10T18:04:37.747 INFO:tasks.rados.rados.0.smithi012.stdout:2306: seq_num 721 ranges {1802240=81920} 2024-09-10T18:04:37.757 INFO:tasks.rados.rados.0.smithi012.stdout:2306: writing smithi01278544-49 from 1802240 to 1884160 tid 1 2024-09-10T18:04:37.757 INFO:tasks.rados.rados.0.smithi012.stdout:2307: snap_create 2024-09-10T18:04:37.757 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 1617 (ObjNum 129 snap 0 seq_num 3013336813) dirty exists 2024-09-10T18:04:37.762 INFO:tasks.rados.rados.0.smithi012.stdout:2306: finishing write tid 1 to smithi01278544-49 2024-09-10T18:04:37.762 INFO:tasks.rados.rados.0.smithi012.stdout:2306: finishing write tid 2 to smithi01278544-49 2024-09-10T18:04:37.764 INFO:tasks.rados.rados.0.smithi012.stdout:2306: finishing write tid 3 to smithi01278544-49 2024-09-10T18:04:37.764 INFO:tasks.rados.rados.0.smithi012.stdout:2306: oid 49 updating version 0 to 1127 2024-09-10T18:04:37.764 INFO:tasks.rados.rados.0.smithi012.stdout:2306: oid 49 version 1127 is already newer than 1126 2024-09-10T18:04:37.764 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1127 (ObjNum 721 snap 235 seq_num 721) dirty exists 2024-09-10T18:04:37.764 INFO:tasks.rados.rados.0.smithi012.stdout:2306: left oid 49 (ObjNum 721 snap 235 seq_num 721) 2024-09-10T18:04:38.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: pgmap v488: 121 pgs: 121 active+clean; 449 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 7.0 MiB/s wr, 29 op/s 2024-09-10T18:04:38.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: osdmap e543: 8 total, 8 up, 8 in 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds ok-to-stop", "ids": ["b"]} : dispatch 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: Upgrade: It appears safe to stop mds.b 2024-09-10T18:04:38.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[89611]: osdmap e544: 8 total, 8 up, 8 in 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: pgmap v488: 121 pgs: 121 active+clean; 449 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 7.0 MiB/s wr, 29 op/s 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: osdmap e543: 8 total, 8 up, 8 in 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds ok-to-stop", "ids": ["b"]} : dispatch 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: Upgrade: It appears safe to stop mds.b 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:38 smithi012 ceph-mon[92029]: osdmap e544: 8 total, 8 up, 8 in 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: pgmap v488: 121 pgs: 121 active+clean; 449 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 7.0 MiB/s wr, 29 op/s 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: osdmap e543: 8 total, 8 up, 8 in 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds ok-to-stop", "ids": ["b"]} : dispatch 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: Upgrade: It appears safe to stop mds.b 2024-09-10T18:04:38.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:38 smithi089 ceph-mon[84132]: osdmap e544: 8 total, 8 up, 8 in 2024-09-10T18:04:38.742 INFO:tasks.rados.rados.0.smithi012.stdout:2304: done (2 left) 2024-09-10T18:04:38.742 INFO:tasks.rados.rados.0.smithi012.stdout:2306: done (1 left) 2024-09-10T18:04:38.742 INFO:tasks.rados.rados.0.smithi012.stdout:2307: done (0 left) 2024-09-10T18:04:38.743 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 236 2024-09-10T18:04:38.743 INFO:tasks.rados.rados.0.smithi012.stdout:2308: seq_num 722 ranges {16228352=98304} 2024-09-10T18:04:38.832 INFO:tasks.rados.rados.0.smithi012.stdout:2308: writing smithi01278544-32 from 16228352 to 16326656 tid 1 2024-09-10T18:04:38.832 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 236 2024-09-10T18:04:38.832 INFO:tasks.rados.rados.0.smithi012.stdout:2309: seq_num 723 ranges {0=114688} 2024-09-10T18:04:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:2309: writing smithi01278544-12 from 0 to 114688 tid 1 2024-09-10T18:04:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:2310: rmattr oid 2 current snap is 236 2024-09-10T18:04:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:2310: done (2 left) 2024-09-10T18:04:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:2311: rollback oid 46 current snap is 236 2024-09-10T18:04:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 233 2024-09-10T18:04:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:2312: delete oid 16 current snap is 236 2024-09-10T18:04:38.837 INFO:tasks.rados.rados.0.smithi012.stdout:2312: done (3 left) 2024-09-10T18:04:38.837 INFO:tasks.rados.rados.0.smithi012.stdout:2313: setattr oid 49 current snap is 236 2024-09-10T18:04:38.837 INFO:tasks.rados.rados.0.smithi012.stdout:2309: finishing write tid 1 to smithi01278544-12 2024-09-10T18:04:38.837 INFO:tasks.rados.rados.0.smithi012.stdout:2309: finishing write tid 2 to smithi01278544-12 2024-09-10T18:04:38.839 INFO:tasks.rados.rados.0.smithi012.stdout:2314: rmattr oid 47 current snap is 236 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:2315: read oid 17 snap -1 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:2315: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:2316: snap_create 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:2309: finishing write tid 3 to smithi01278544-12 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:2309: oid 12 updating version 0 to 1683 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:2309: oid 12 updating version 1683 to 1684 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1684 (ObjNum 723 snap 236 seq_num 723) dirty exists 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:2309: left oid 12 (ObjNum 723 snap 236 seq_num 723) 2024-09-10T18:04:38.840 INFO:tasks.rados.rados.0.smithi012.stdout:2311: finishing rollback tid 0 to smithi01278544-46 2024-09-10T18:04:38.841 INFO:tasks.rados.rados.0.smithi012.stdout:2308: finishing write tid 1 to smithi01278544-32 2024-09-10T18:04:38.841 INFO:tasks.rados.rados.0.smithi012.stdout:2308: finishing write tid 2 to smithi01278544-32 2024-09-10T18:04:38.842 INFO:tasks.rados.rados.0.smithi012.stdout:2311: finishing rollback tid 1 to smithi01278544-46 2024-09-10T18:04:38.842 INFO:tasks.rados.rados.0.smithi012.stdout:2311: finishing rollback tid 2 to smithi01278544-46 2024-09-10T18:04:38.842 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1270 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-09-10T18:04:38.843 INFO:tasks.rados.rados.0.smithi012.stdout:2308: finishing write tid 3 to smithi01278544-32 2024-09-10T18:04:38.843 INFO:tasks.rados.rados.0.smithi012.stdout:2308: oid 32 updating version 0 to 1135 2024-09-10T18:04:38.843 INFO:tasks.rados.rados.0.smithi012.stdout:2308: oid 32 version 1135 is already newer than 1134 2024-09-10T18:04:38.843 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1135 (ObjNum 722 snap 236 seq_num 722) dirty exists 2024-09-10T18:04:38.843 INFO:tasks.rados.rados.0.smithi012.stdout:2308: left oid 32 (ObjNum 722 snap 236 seq_num 722) 2024-09-10T18:04:38.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1619 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:04:38.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1128 (ObjNum 721 snap 235 seq_num 721) dirty exists 2024-09-10T18:04:38.877 INFO:tasks.rados.rados.0.smithi012.stdout:2315: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:04:39.747 INFO:tasks.rados.rados.0.smithi012.stdout:2308: done (6 left) 2024-09-10T18:04:39.747 INFO:tasks.rados.rados.0.smithi012.stdout:2309: done (5 left) 2024-09-10T18:04:39.747 INFO:tasks.rados.rados.0.smithi012.stdout:2311: done (4 left) 2024-09-10T18:04:39.748 INFO:tasks.rados.rados.0.smithi012.stdout:2313: done (3 left) 2024-09-10T18:04:39.748 INFO:tasks.rados.rados.0.smithi012.stdout:2314: done (2 left) 2024-09-10T18:04:39.748 INFO:tasks.rados.rados.0.smithi012.stdout:2315: done (1 left) 2024-09-10T18:04:39.748 INFO:tasks.rados.rados.0.smithi012.stdout:2316: done (0 left) 2024-09-10T18:04:39.748 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 237 2024-09-10T18:04:39.748 INFO:tasks.rados.rados.0.smithi012.stdout:2317: seq_num 725 ranges {0=147456} 2024-09-10T18:04:39.748 INFO:tasks.rados.rados.0.smithi012.stdout:2317: writing smithi01278544-24 from 0 to 147456 tid 1 2024-09-10T18:04:39.748 INFO:tasks.rados.rados.0.smithi012.stdout:2318: delete oid 9 current snap is 237 2024-09-10T18:04:39.752 INFO:tasks.rados.rados.0.smithi012.stdout:2317: finishing write tid 1 to smithi01278544-24 2024-09-10T18:04:39.754 INFO:tasks.rados.rados.0.smithi012.stdout:2317: finishing write tid 2 to smithi01278544-24 2024-09-10T18:04:39.755 INFO:tasks.rados.rados.0.smithi012.stdout:2318: done (1 left) 2024-09-10T18:04:39.755 INFO:tasks.rados.rados.0.smithi012.stdout:2319: read oid 27 snap -1 2024-09-10T18:04:39.755 INFO:tasks.rados.rados.0.smithi012.stdout:2319: expect (ObjNum 695 snap 225 seq_num 695) 2024-09-10T18:04:39.756 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 237 2024-09-10T18:04:39.756 INFO:tasks.rados.rados.0.smithi012.stdout:2320: seq_num 727 ranges {114688=180224} 2024-09-10T18:04:39.757 INFO:tasks.rados.rados.0.smithi012.stdout:2320: writing smithi01278544-12 from 114688 to 294912 tid 1 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2321: rollback oid 30 current snap is 237 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 236 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2317: finishing write tid 3 to smithi01278544-24 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2317: oid 24 updating version 0 to 806 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2317: oid 24 version 806 is already newer than 805 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 806 (ObjNum 725 snap 237 seq_num 725) dirty exists 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2317: left oid 24 (ObjNum 725 snap 237 seq_num 725) 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2317: done (3 left) 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 237 2024-09-10T18:04:39.758 INFO:tasks.rados.rados.0.smithi012.stdout:2322: seq_num 728 ranges {6144000=196608} 2024-09-10T18:04:39.792 INFO:tasks.rados.rados.0.smithi012.stdout:2322: writing smithi01278544-43 from 6144000 to 6340608 tid 1 2024-09-10T18:04:39.793 INFO:tasks.rados.rados.0.smithi012.stdout:2323: copy_from oid 45 from oid 49 current snap is 237 2024-09-10T18:04:39.793 INFO:tasks.rados.rados.0.smithi012.stdout:2319: expect (ObjNum 695 snap 225 seq_num 695) 2024-09-10T18:04:39.850 INFO:tasks.rados.rados.0.smithi012.stdout:2321: finishing rollback tid 0 to smithi01278544-30 2024-09-10T18:04:39.850 INFO:tasks.rados.rados.0.smithi012.stdout:2321: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:04:39.850 INFO:tasks.rados.rados.0.smithi012.stdout:2319: done (4 left) 2024-09-10T18:04:39.850 INFO:tasks.rados.rados.0.smithi012.stdout:2324: rollback oid 36 current snap is 237 2024-09-10T18:04:39.850 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 215 2024-09-10T18:04:39.850 INFO:tasks.rados.rados.0.smithi012.stdout:2321: finishing rollback tid 2 to smithi01278544-30 2024-09-10T18:04:39.850 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1138 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:04:39.850 INFO:tasks.rados.rados.0.smithi012.stdout:2320: finishing write tid 1 to smithi01278544-12 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2320: finishing write tid 2 to smithi01278544-12 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2320: finishing write tid 3 to smithi01278544-12 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2320: oid 12 updating version 0 to 1687 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2320: oid 12 version 1687 is already newer than 1686 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1687 (ObjNum 727 snap 237 seq_num 727) dirty exists 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2320: left oid 12 (ObjNum 727 snap 237 seq_num 727) 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2322: finishing write tid 1 to smithi01278544-43 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2322: finishing write tid 2 to smithi01278544-43 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2322: finishing write tid 3 to smithi01278544-43 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2322: oid 43 updating version 0 to 1621 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2322: oid 43 updating version 1621 to 1622 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 1622 (ObjNum 728 snap 237 seq_num 728) dirty exists 2024-09-10T18:04:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:2322: left oid 43 (ObjNum 728 snap 237 seq_num 728) 2024-09-10T18:04:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:2323: finishing copy_from racing read to smithi01278544-45 2024-09-10T18:04:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:2320: done (4 left) 2024-09-10T18:04:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:2321: done (3 left) 2024-09-10T18:04:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:2322: done (2 left) 2024-09-10T18:04:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:2325: delete oid 48 current snap is 237 2024-09-10T18:04:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:2323: finishing copy_from to smithi01278544-45 2024-09-10T18:04:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1128 (ObjNum 721 snap 235 seq_num 721) dirty exists 2024-09-10T18:04:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:2323: done (2 left) 2024-09-10T18:04:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:2325: done (1 left) 2024-09-10T18:04:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:2326: read oid 20 snap 232 2024-09-10T18:04:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:2326: expect (ObjNum 713 snap 232 seq_num 713) 2024-09-10T18:04:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:2327: snap_create 2024-09-10T18:04:39.854 INFO:tasks.rados.rados.0.smithi012.stdout:2324: finishing rollback tid 0 to smithi01278544-36 2024-09-10T18:04:39.854 INFO:tasks.rados.rados.0.smithi012.stdout:2324: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:04:39.855 INFO:tasks.rados.rados.0.smithi012.stdout:2324: finishing rollback tid 2 to smithi01278544-36 2024-09-10T18:04:39.855 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 809 (ObjNum 432 snap 143 seq_num 432) dirty exists 2024-09-10T18:04:39.873 INFO:tasks.rados.rados.0.smithi012.stdout:2326: expect (ObjNum 713 snap 232 seq_num 713) 2024-09-10T18:04:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:39 smithi012 ceph-mon[89611]: osdmap e545: 8 total, 8 up, 8 in 2024-09-10T18:04:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:04:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:39 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:40.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:39 smithi012 ceph-mon[92029]: osdmap e545: 8 total, 8 up, 8 in 2024-09-10T18:04:40.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:40.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:04:40.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:39 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:39 smithi089 ceph-mon[84132]: osdmap e545: 8 total, 8 up, 8 in 2024-09-10T18:04:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:40.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T18:04:40.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:39 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:40.751 INFO:tasks.rados.rados.0.smithi012.stdout:2324: done (2 left) 2024-09-10T18:04:40.751 INFO:tasks.rados.rados.0.smithi012.stdout:2326: done (1 left) 2024-09-10T18:04:40.751 INFO:tasks.rados.rados.0.smithi012.stdout:2327: done (0 left) 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:2328: read oid 21 snap -1 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:2328: expect deleted 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:2329: read oid 9 snap 222 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:2329: expect deleted 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:2330: read oid 28 snap -1 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:2330: expect (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 238 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:2331: seq_num 730 ranges {0=229376} 2024-09-10T18:04:40.752 INFO:tasks.rados.rados.0.smithi012.stdout:2331: writing smithi01278544-31 from 0 to 229376 tid 1 2024-09-10T18:04:40.753 INFO:tasks.rados.rados.0.smithi012.stdout:2332: delete oid 17 current snap is 238 2024-09-10T18:04:40.758 INFO:tasks.rados.rados.0.smithi012.stdout:2331: finishing write tid 1 to smithi01278544-31 2024-09-10T18:04:40.758 INFO:tasks.rados.rados.0.smithi012.stdout:2331: finishing write tid 2 to smithi01278544-31 2024-09-10T18:04:40.760 INFO:tasks.rados.rados.0.smithi012.stdout:2331: finishing write tid 3 to smithi01278544-31 2024-09-10T18:04:40.761 INFO:tasks.rados.rados.0.smithi012.stdout:2331: oid 31 updating version 0 to 1084 2024-09-10T18:04:40.761 INFO:tasks.rados.rados.0.smithi012.stdout:2331: oid 31 version 1084 is already newer than 1083 2024-09-10T18:04:40.761 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 1084 (ObjNum 730 snap 238 seq_num 730) dirty exists 2024-09-10T18:04:40.761 INFO:tasks.rados.rados.0.smithi012.stdout:2331: left oid 31 (ObjNum 730 snap 238 seq_num 730) 2024-09-10T18:04:40.762 INFO:tasks.rados.rados.0.smithi012.stdout:2328: done (4 left) 2024-09-10T18:04:40.762 INFO:tasks.rados.rados.0.smithi012.stdout:2329: done (3 left) 2024-09-10T18:04:40.762 INFO:tasks.rados.rados.0.smithi012.stdout:2331: done (2 left) 2024-09-10T18:04:40.762 INFO:tasks.rados.rados.0.smithi012.stdout:2332: done (1 left) 2024-09-10T18:04:40.762 INFO:tasks.rados.rados.0.smithi012.stdout:2333: delete oid 27 current snap is 238 2024-09-10T18:04:40.764 INFO:tasks.rados.rados.0.smithi012.stdout:2330: expect (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:04:40.803 INFO:tasks.rados.rados.0.smithi012.stdout:2330: done (1 left) 2024-09-10T18:04:40.803 INFO:tasks.rados.rados.0.smithi012.stdout:2333: done (0 left) 2024-09-10T18:04:40.803 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 8 current snap is 238 2024-09-10T18:04:40.803 INFO:tasks.rados.rados.0.smithi012.stdout:2334: seq_num 733 ranges {0=278528} 2024-09-10T18:04:40.804 INFO:tasks.rados.rados.0.smithi012.stdout:2334: writing smithi01278544-8 from 0 to 278528 tid 1 2024-09-10T18:04:40.804 INFO:tasks.rados.rados.0.smithi012.stdout:2335: setattr oid 49 current snap is 238 2024-09-10T18:04:40.805 INFO:tasks.rados.rados.0.smithi012.stdout:2336: snap_remove snap 185 2024-09-10T18:04:40.963 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:40 smithi089 ceph-mon[84132]: Upgrade: Updating mds.b 2024-09-10T18:04:40.963 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:40 smithi089 ceph-mon[84132]: Deploying daemon mds.b on smithi089 2024-09-10T18:04:40.963 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:40 smithi089 ceph-mon[84132]: pgmap v492: 121 pgs: 121 active+clean; 462 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 27 op/s 2024-09-10T18:04:40.963 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:40 smithi089 ceph-mon[84132]: osdmap e546: 8 total, 8 up, 8 in 2024-09-10T18:04:40.964 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:40 smithi089 systemd[1]: Stopping Ceph mds.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:04:40.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-mon[89611]: Upgrade: Updating mds.b 2024-09-10T18:04:40.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-mon[89611]: Deploying daemon mds.b on smithi089 2024-09-10T18:04:40.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-mon[89611]: pgmap v492: 121 pgs: 121 active+clean; 462 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 27 op/s 2024-09-10T18:04:40.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-mon[89611]: osdmap e546: 8 total, 8 up, 8 in 2024-09-10T18:04:40.965 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-mon[92029]: Upgrade: Updating mds.b 2024-09-10T18:04:40.965 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-mon[92029]: Deploying daemon mds.b on smithi089 2024-09-10T18:04:40.965 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-mon[92029]: pgmap v492: 121 pgs: 121 active+clean; 462 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 27 op/s 2024-09-10T18:04:40.965 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-mon[92029]: osdmap e546: 8 total, 8 up, 8 in 2024-09-10T18:04:40.973 INFO:tasks.rados.rados.0.smithi012.stdout:2336: done (2 left) 2024-09-10T18:04:40.973 INFO:tasks.rados.rados.0.smithi012.stdout:2337: delete oid 41 current snap is 238 2024-09-10T18:04:40.974 INFO:tasks.rados.rados.0.smithi012.stdout:2334: finishing write tid 1 to smithi01278544-8 2024-09-10T18:04:40.974 INFO:tasks.rados.rados.0.smithi012.stdout:2334: finishing write tid 2 to smithi01278544-8 2024-09-10T18:04:40.974 INFO:tasks.rados.rados.0.smithi012.stdout:2334: finishing write tid 3 to smithi01278544-8 2024-09-10T18:04:40.974 INFO:tasks.rados.rados.0.smithi012.stdout:2334: oid 8 updating version 0 to 1119 2024-09-10T18:04:40.974 INFO:tasks.rados.rados.0.smithi012.stdout:2334: oid 8 updating version 1119 to 1120 2024-09-10T18:04:40.974 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1120 (ObjNum 733 snap 238 seq_num 733) dirty exists 2024-09-10T18:04:40.974 INFO:tasks.rados.rados.0.smithi012.stdout:2334: left oid 8 (ObjNum 733 snap 238 seq_num 733) 2024-09-10T18:04:40.974 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1129 (ObjNum 721 snap 235 seq_num 721) dirty exists 2024-09-10T18:04:40.989 INFO:tasks.rados.rados.0.smithi012.stdout:2334: done (2 left) 2024-09-10T18:04:40.989 INFO:tasks.rados.rados.0.smithi012.stdout:2335: done (1 left) 2024-09-10T18:04:40.989 INFO:tasks.rados.rados.0.smithi012.stdout:2337: done (0 left) 2024-09-10T18:04:40.989 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 238 2024-09-10T18:04:40.990 INFO:tasks.rados.rados.0.smithi012.stdout:2338: seq_num 735 ranges {0=311296} 2024-09-10T18:04:40.992 INFO:tasks.rados.rados.0.smithi012.stdout:2338: writing smithi01278544-21 from 0 to 311296 tid 1 2024-09-10T18:04:40.992 INFO:tasks.rados.rados.0.smithi012.stdout:2339: rollback oid 24 current snap is 238 2024-09-10T18:04:40.992 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 24 to 224 2024-09-10T18:04:40.992 INFO:tasks.rados.rados.0.smithi012.stdout:2340: copy_from oid 44 from oid 15 current snap is 238 2024-09-10T18:04:40.992 INFO:tasks.rados.rados.0.smithi012.stdout:2341: rmattr oid 11 current snap is 238 2024-09-10T18:04:40.992 INFO:tasks.rados.rados.0.smithi012.stdout:2341: done (3 left) 2024-09-10T18:04:40.992 INFO:tasks.rados.rados.0.smithi012.stdout:2342: rmattr oid 47 current snap is 238 2024-09-10T18:04:40.992 INFO:tasks.rados.rados.0.smithi012.stdout:2343: delete oid 46 current snap is 238 2024-09-10T18:04:40.996 INFO:tasks.rados.rados.0.smithi012.stdout:2339: finishing rollback tid 0 to smithi01278544-24 2024-09-10T18:04:40.997 INFO:tasks.rados.rados.0.smithi012.stdout:2339: finishing rollback tid 1 to smithi01278544-24 2024-09-10T18:04:40.997 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 811 (ObjNum 705 snap 0 seq_num 3496571152) dirty dne 2024-09-10T18:04:40.997 INFO:tasks.rados.rados.0.smithi012.stdout:2338: finishing write tid 1 to smithi01278544-21 2024-09-10T18:04:40.998 INFO:tasks.rados.rados.0.smithi012.stdout:2338: finishing write tid 2 to smithi01278544-21 2024-09-10T18:04:41.000 INFO:tasks.rados.rados.0.smithi012.stdout:2338: finishing write tid 3 to smithi01278544-21 2024-09-10T18:04:41.000 INFO:tasks.rados.rados.0.smithi012.stdout:2338: oid 21 updating version 0 to 955 2024-09-10T18:04:41.000 INFO:tasks.rados.rados.0.smithi012.stdout:2338: oid 21 updating version 955 to 956 2024-09-10T18:04:41.001 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 956 (ObjNum 735 snap 238 seq_num 735) dirty exists 2024-09-10T18:04:41.001 INFO:tasks.rados.rados.0.smithi012.stdout:2338: left oid 21 (ObjNum 735 snap 238 seq_num 735) 2024-09-10T18:04:41.002 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1633 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:04:41.002 INFO:tasks.rados.rados.0.smithi012.stdout:2340: finishing copy_from racing read to smithi01278544-44 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:2338: done (4 left) 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:2339: done (3 left) 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:2342: done (2 left) 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:2343: done (1 left) 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:2344: read oid 47 snap -1 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:2344: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:2345: rmattr oid 35 current snap is 238 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:2346: rollback oid 10 current snap is 238 2024-09-10T18:04:41.003 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 237 2024-09-10T18:04:41.004 INFO:tasks.rados.rados.0.smithi012.stdout:2347: delete oid 23 current snap is 238 2024-09-10T18:04:41.004 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 0 (ObjNum 145 snap 0 seq_num 3012828058) dirty dne 2024-09-10T18:04:41.005 INFO:tasks.rados.rados.0.smithi012.stdout:2340: finishing copy_from to smithi01278544-44 2024-09-10T18:04:41.005 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1115 (ObjNum 657 snap 214 seq_num 657) dirty exists 2024-09-10T18:04:41.005 INFO:tasks.rados.rados.0.smithi012.stdout:2346: finishing rollback tid 1 to smithi01278544-10 2024-09-10T18:04:41.005 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1633 (ObjNum 97 snap 0 seq_num 3497386576) dirty dne 2024-09-10T18:04:41.006 INFO:tasks.rados.rados.0.smithi012.stdout:2340: done (4 left) 2024-09-10T18:04:41.006 INFO:tasks.rados.rados.0.smithi012.stdout:2345: done (3 left) 2024-09-10T18:04:41.006 INFO:tasks.rados.rados.0.smithi012.stdout:2346: done (2 left) 2024-09-10T18:04:41.007 INFO:tasks.rados.rados.0.smithi012.stdout:2347: done (1 left) 2024-09-10T18:04:41.007 INFO:tasks.rados.rados.0.smithi012.stdout:2348: rollback oid 15 current snap is 238 2024-09-10T18:04:41.007 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 15 to 231 2024-09-10T18:04:41.007 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 238 2024-09-10T18:04:41.007 INFO:tasks.rados.rados.0.smithi012.stdout:2349: seq_num 738 ranges {4898816=368640} 2024-09-10T18:04:41.036 INFO:tasks.rados.rados.0.smithi012.stdout:2349: writing smithi01278544-38 from 4898816 to 5267456 tid 1 2024-09-10T18:04:41.036 INFO:tasks.rados.rados.0.smithi012.stdout:2350: read oid 28 snap 228 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:2350: expect (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:2351: rmattr oid 10 current snap is 238 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:2351: done (4 left) 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 238 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:2348: finishing rollback tid 0 to smithi01278544-15 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:2348: finishing rollback tid 1 to smithi01278544-15 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:2348: finishing rollback tid 2 to smithi01278544-15 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 1132 (ObjNum 657 snap 214 seq_num 657) dirty exists 2024-09-10T18:04:41.037 INFO:tasks.rados.rados.0.smithi012.stdout:2352: seq_num 739 ranges {0=385024} 2024-09-10T18:04:41.039 INFO:tasks.rados.rados.0.smithi012.stdout:2352: writing smithi01278544-13 from 0 to 385024 tid 1 2024-09-10T18:04:41.039 INFO:tasks.rados.rados.0.smithi012.stdout:2348: done (4 left) 2024-09-10T18:04:41.039 INFO:tasks.rados.rados.0.smithi012.stdout:2353: snap_create 2024-09-10T18:04:41.043 INFO:tasks.rados.rados.0.smithi012.stdout:2349: finishing write tid 1 to smithi01278544-38 2024-09-10T18:04:41.043 INFO:tasks.rados.rados.0.smithi012.stdout:2352: finishing write tid 1 to smithi01278544-13 2024-09-10T18:04:41.043 INFO:tasks.rados.rados.0.smithi012.stdout:2349: finishing write tid 2 to smithi01278544-38 2024-09-10T18:04:41.045 INFO:tasks.rados.rados.0.smithi012.stdout:2352: finishing write tid 2 to smithi01278544-13 2024-09-10T18:04:41.048 INFO:tasks.rados.rados.0.smithi012.stdout:2350: expect (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2349: finishing write tid 3 to smithi01278544-38 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2349: oid 38 updating version 0 to 1559 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2349: oid 38 updating version 1559 to 1560 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1560 (ObjNum 738 snap 238 seq_num 738) dirty exists 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2349: left oid 38 (ObjNum 738 snap 238 seq_num 738) 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2352: finishing write tid 3 to smithi01278544-13 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2352: oid 13 updating version 0 to 1095 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2352: oid 13 updating version 1095 to 1096 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1096 (ObjNum 739 snap 238 seq_num 739) dirty exists 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2352: left oid 13 (ObjNum 739 snap 238 seq_num 739) 2024-09-10T18:04:41.086 INFO:tasks.rados.rados.0.smithi012.stdout:2344: expect (ObjNum 523 snap 179 seq_num 523) 2024-09-10T18:04:41.259 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:40 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a[89607]: 2024-09-10T18:04:40.962+0000 7ffb60229640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T18:04:41.286 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b[57151]: 2024-09-10T18:04:40.961+0000 7f4c7beb7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:04:41.286 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b[57151]: 2024-09-10T18:04:40.961+0000 7f4c7beb7640 -1 mds.b *** got signal Terminated *** 2024-09-10T18:04:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[89611]: osdmap e547: 8 total, 8 up, 8 in 2024-09-10T18:04:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[89611]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T18:04:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[89611]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T18:04:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[89611]: osdmap e548: 8 total, 8 up, 8 in 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[89611]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[89611]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[89611]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[89611]: fsmap cephfs:1/1 {0=a=up:replay} 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[92029]: osdmap e547: 8 total, 8 up, 8 in 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[92029]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[92029]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[92029]: osdmap e548: 8 total, 8 up, 8 in 2024-09-10T18:04:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[92029]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-09-10T18:04:42.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[92029]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T18:04:42.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[92029]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-09-10T18:04:42.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:41 smithi012 ceph-mon[92029]: fsmap cephfs:1/1 {0=a=up:replay} 2024-09-10T18:04:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:41 smithi089 ceph-mon[84132]: osdmap e547: 8 total, 8 up, 8 in 2024-09-10T18:04:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:41 smithi089 ceph-mon[84132]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T18:04:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:41 smithi089 ceph-mon[84132]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T18:04:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:41 smithi089 ceph-mon[84132]: osdmap e548: 8 total, 8 up, 8 in 2024-09-10T18:04:42.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:41 smithi089 ceph-mon[84132]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-09-10T18:04:42.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:41 smithi089 ceph-mon[84132]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T18:04:42.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:41 smithi089 ceph-mon[84132]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-09-10T18:04:42.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:41 smithi089 ceph-mon[84132]: fsmap cephfs:1/1 {0=a=up:replay} 2024-09-10T18:04:42.477 INFO:tasks.rados.rados.0.smithi012.stdout:2344: done (4 left) 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2349: done (3 left) 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2350: done (2 left) 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2352: done (1 left) 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2353: done (0 left) 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2354: read oid 13 snap 237 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2354: expect deleted 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2355: read oid 44 snap 236 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2355: expect (ObjNum 681 snap 221 seq_num 681) 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2356: delete oid 16 current snap is 239 2024-09-10T18:04:42.478 INFO:tasks.rados.rados.0.smithi012.stdout:2354: done (2 left) 2024-09-10T18:04:42.479 INFO:tasks.rados.rados.0.smithi012.stdout:2356: done (1 left) 2024-09-10T18:04:42.479 INFO:tasks.rados.rados.0.smithi012.stdout:2357: delete oid 40 current snap is 239 2024-09-10T18:04:42.482 INFO:tasks.rados.rados.0.smithi012.stdout:2357: done (1 left) 2024-09-10T18:04:42.482 INFO:tasks.rados.rados.0.smithi012.stdout:2358: snap_create 2024-09-10T18:04:42.492 INFO:tasks.rados.rados.0.smithi012.stdout:2355: expect (ObjNum 681 snap 221 seq_num 681) 2024-09-10T18:04:42.737 INFO:tasks.rados.rados.0.smithi012.stdout:2355: done (1 left) 2024-09-10T18:04:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:2358: done (0 left) 2024-09-10T18:04:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 240 2024-09-10T18:04:42.738 INFO:tasks.rados.rados.0.smithi012.stdout:2359: seq_num 742 ranges {385024=434176} 2024-09-10T18:04:42.742 INFO:tasks.rados.rados.0.smithi012.stdout:2359: writing smithi01278544-13 from 385024 to 819200 tid 1 2024-09-10T18:04:42.742 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 240 2024-09-10T18:04:42.742 INFO:tasks.rados.rados.0.smithi012.stdout:2360: seq_num 743 ranges {0=450560} 2024-09-10T18:04:42.745 INFO:tasks.rados.rados.0.smithi012.stdout:2360: writing smithi01278544-17 from 0 to 450560 tid 1 2024-09-10T18:04:42.745 INFO:tasks.rados.rados.0.smithi012.stdout:2361: read oid 30 snap -1 2024-09-10T18:04:42.745 INFO:tasks.rados.rados.0.smithi012.stdout:2361: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:04:42.746 INFO:tasks.rados.rados.0.smithi012.stdout:2362: read oid 12 snap -1 2024-09-10T18:04:42.746 INFO:tasks.rados.rados.0.smithi012.stdout:2362: expect (ObjNum 727 snap 237 seq_num 727) 2024-09-10T18:04:42.746 INFO:tasks.rados.rados.0.smithi012.stdout:2363: rmattr oid 47 current snap is 240 2024-09-10T18:04:42.746 INFO:tasks.rados.rados.0.smithi012.stdout:2359: finishing write tid 1 to smithi01278544-13 2024-09-10T18:04:42.746 INFO:tasks.rados.rados.0.smithi012.stdout:2364: rollback oid 3 current snap is 240 2024-09-10T18:04:42.746 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 233 2024-09-10T18:04:42.747 INFO:tasks.rados.rados.0.smithi012.stdout:2359: finishing write tid 2 to smithi01278544-13 2024-09-10T18:04:42.747 INFO:tasks.rados.rados.0.smithi012.stdout:2365: snap_create 2024-09-10T18:04:42.748 INFO:tasks.rados.rados.0.smithi012.stdout:2359: finishing write tid 3 to smithi01278544-13 2024-09-10T18:04:42.748 INFO:tasks.rados.rados.0.smithi012.stdout:2359: oid 13 updating version 0 to 1098 2024-09-10T18:04:42.748 INFO:tasks.rados.rados.0.smithi012.stdout:2359: oid 13 updating version 1098 to 1099 2024-09-10T18:04:42.748 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1099 (ObjNum 742 snap 240 seq_num 742) dirty exists 2024-09-10T18:04:42.748 INFO:tasks.rados.rados.0.smithi012.stdout:2359: left oid 13 (ObjNum 742 snap 240 seq_num 742) 2024-09-10T18:04:42.755 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1639 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:04:42.756 INFO:tasks.rados.rados.0.smithi012.stdout:2360: finishing write tid 1 to smithi01278544-17 2024-09-10T18:04:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:2360: finishing write tid 2 to smithi01278544-17 2024-09-10T18:04:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:2362: expect (ObjNum 727 snap 237 seq_num 727) 2024-09-10T18:04:42.770 INFO:tasks.rados.rados.0.smithi012.stdout:2364: finishing rollback tid 0 to smithi01278544-3 2024-09-10T18:04:42.770 INFO:tasks.rados.rados.0.smithi012.stdout:2360: finishing write tid 3 to smithi01278544-17 2024-09-10T18:04:42.771 INFO:tasks.rados.rados.0.smithi012.stdout:2360: oid 17 updating version 0 to 891 2024-09-10T18:04:42.771 INFO:tasks.rados.rados.0.smithi012.stdout:2360: oid 17 updating version 891 to 892 2024-09-10T18:04:42.771 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 892 (ObjNum 743 snap 240 seq_num 743) dirty exists 2024-09-10T18:04:42.771 INFO:tasks.rados.rados.0.smithi012.stdout:2360: left oid 17 (ObjNum 743 snap 240 seq_num 743) 2024-09-10T18:04:42.771 INFO:tasks.rados.rados.0.smithi012.stdout:2364: finishing rollback tid 1 to smithi01278544-3 2024-09-10T18:04:42.771 INFO:tasks.rados.rados.0.smithi012.stdout:2364: finishing rollback tid 2 to smithi01278544-3 2024-09-10T18:04:42.771 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1275 (ObjNum 561 snap 186 seq_num 561) dirty exists 2024-09-10T18:04:42.822 INFO:tasks.rados.rados.0.smithi012.stdout:2361: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:04:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[89611]: pgmap v496: 121 pgs: 121 active+clean; 461 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-09-10T18:04:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[89611]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:reconnect 2024-09-10T18:04:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[89611]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-09-10T18:04:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[89611]: osdmap e549: 8 total, 8 up, 8 in 2024-09-10T18:04:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T18:04:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[89611]: osdmap e550: 8 total, 8 up, 8 in 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[92029]: pgmap v496: 121 pgs: 121 active+clean; 461 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[92029]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:reconnect 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[92029]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[92029]: osdmap e549: 8 total, 8 up, 8 in 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:42 smithi012 ceph-mon[92029]: osdmap e550: 8 total, 8 up, 8 in 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:42 smithi089 ceph-mon[84132]: pgmap v496: 121 pgs: 121 active+clean; 461 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:42 smithi089 ceph-mon[84132]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:reconnect 2024-09-10T18:04:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:42 smithi089 ceph-mon[84132]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-09-10T18:04:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:42 smithi089 ceph-mon[84132]: osdmap e549: 8 total, 8 up, 8 in 2024-09-10T18:04:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:42 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T18:04:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:42 smithi089 ceph-mon[84132]: osdmap e550: 8 total, 8 up, 8 in 2024-09-10T18:04:44.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:04:43] "GET /metrics HTTP/1.1" 200 36355 "" "Prometheus/2.43.0" 2024-09-10T18:04:44.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[89611]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:rejoin 2024-09-10T18:04:44.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[89611]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-09-10T18:04:44.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[89611]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-09-10T18:04:44.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[89611]: pgmap v499: 121 pgs: 121 active+clean; 437 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 40 MiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-10T18:04:44.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[89611]: osdmap e551: 8 total, 8 up, 8 in 2024-09-10T18:04:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[92029]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:rejoin 2024-09-10T18:04:44.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[92029]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-09-10T18:04:44.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[92029]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-09-10T18:04:44.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[92029]: pgmap v499: 121 pgs: 121 active+clean; 437 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 40 MiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-10T18:04:44.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:43 smithi012 ceph-mon[92029]: osdmap e551: 8 total, 8 up, 8 in 2024-09-10T18:04:44.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:43 smithi089 ceph-mon[84132]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:rejoin 2024-09-10T18:04:44.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:43 smithi089 ceph-mon[84132]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-09-10T18:04:44.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:43 smithi089 ceph-mon[84132]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-09-10T18:04:44.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:43 smithi089 ceph-mon[84132]: pgmap v499: 121 pgs: 121 active+clean; 437 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 40 MiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-10T18:04:44.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:43 smithi089 ceph-mon[84132]: osdmap e551: 8 total, 8 up, 8 in 2024-09-10T18:04:44.697 INFO:tasks.rados.rados.0.smithi012.stdout:2359: done (6 left) 2024-09-10T18:04:44.697 INFO:tasks.rados.rados.0.smithi012.stdout:2360: done (5 left) 2024-09-10T18:04:44.697 INFO:tasks.rados.rados.0.smithi012.stdout:2361: done (4 left) 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:2362: done (3 left) 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:2363: done (2 left) 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:2364: done (1 left) 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:2365: done (0 left) 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:2366: rmattr oid 32 current snap is 241 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:2367: rollback oid 9 current snap is 241 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 225 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 241 2024-09-10T18:04:44.698 INFO:tasks.rados.rados.0.smithi012.stdout:2368: seq_num 744 ranges {8110080=466944} 2024-09-10T18:04:44.744 INFO:tasks.rados.rados.0.smithi012.stdout:2368: writing smithi01278544-7 from 8110080 to 8577024 tid 1 2024-09-10T18:04:44.744 INFO:tasks.rados.rados.0.smithi012.stdout:2369: snap_create 2024-09-10T18:04:44.744 INFO:tasks.rados.rados.0.smithi012.stdout:2367: finishing rollback tid 1 to smithi01278544-9 2024-09-10T18:04:44.744 INFO:tasks.rados.rados.0.smithi012.stdout:2367: finishing rollback tid 2 to smithi01278544-9 2024-09-10T18:04:44.745 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1562 (ObjNum 65 snap 0 seq_num 1582590296) dirty exists 2024-09-10T18:04:44.745 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1139 (ObjNum 722 snap 236 seq_num 722) dirty exists 2024-09-10T18:04:44.748 INFO:tasks.rados.rados.0.smithi012.stdout:2368: finishing write tid 1 to smithi01278544-7 2024-09-10T18:04:44.749 INFO:tasks.rados.rados.0.smithi012.stdout:2368: finishing write tid 2 to smithi01278544-7 2024-09-10T18:04:44.750 INFO:tasks.rados.rados.0.smithi012.stdout:2368: finishing write tid 3 to smithi01278544-7 2024-09-10T18:04:44.750 INFO:tasks.rados.rados.0.smithi012.stdout:2368: oid 7 updating version 0 to 1111 2024-09-10T18:04:44.750 INFO:tasks.rados.rados.0.smithi012.stdout:2368: oid 7 version 1111 is already newer than 1110 2024-09-10T18:04:44.750 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1111 (ObjNum 744 snap 241 seq_num 744) dirty exists 2024-09-10T18:04:44.750 INFO:tasks.rados.rados.0.smithi012.stdout:2368: left oid 7 (ObjNum 744 snap 241 seq_num 744) 2024-09-10T18:04:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:2366: done (3 left) 2024-09-10T18:04:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:2367: done (2 left) 2024-09-10T18:04:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:2368: done (1 left) 2024-09-10T18:04:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:2369: done (0 left) 2024-09-10T18:04:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 242 2024-09-10T18:04:45.005 INFO:tasks.rados.rados.0.smithi012.stdout:2370: seq_num 745 ranges {0=483328} 2024-09-10T18:04:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:2370: writing smithi01278544-33 from 0 to 483328 tid 1 2024-09-10T18:04:45.007 INFO:tasks.rados.rados.0.smithi012.stdout:2371: snap_create 2024-09-10T18:04:45.013 INFO:tasks.rados.rados.0.smithi012.stdout:2370: finishing write tid 1 to smithi01278544-33 2024-09-10T18:04:45.014 INFO:tasks.rados.rados.0.smithi012.stdout:2370: finishing write tid 2 to smithi01278544-33 2024-09-10T18:04:45.015 INFO:tasks.rados.rados.0.smithi012.stdout:2370: finishing write tid 3 to smithi01278544-33 2024-09-10T18:04:45.015 INFO:tasks.rados.rados.0.smithi012.stdout:2370: oid 33 updating version 0 to 1642 2024-09-10T18:04:45.015 INFO:tasks.rados.rados.0.smithi012.stdout:2370: oid 33 version 1642 is already newer than 1641 2024-09-10T18:04:45.015 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 1642 (ObjNum 745 snap 242 seq_num 745) dirty exists 2024-09-10T18:04:45.015 INFO:tasks.rados.rados.0.smithi012.stdout:2370: left oid 33 (ObjNum 745 snap 242 seq_num 745) 2024-09-10T18:04:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:44 smithi012 ceph-mon[89611]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T18:04:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:44 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:04:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:44 smithi012 ceph-mon[89611]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:active 2024-09-10T18:04:45.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:44 smithi012 ceph-mon[89611]: fsmap cephfs:1 {0=a=up:active} 2024-09-10T18:04:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:44 smithi012 ceph-mon[92029]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T18:04:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:44 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:04:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:44 smithi012 ceph-mon[92029]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:active 2024-09-10T18:04:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:44 smithi012 ceph-mon[92029]: fsmap cephfs:1 {0=a=up:active} 2024-09-10T18:04:45.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:44 smithi089 ceph-mon[84132]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T18:04:45.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:44 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:04:45.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:44 smithi089 ceph-mon[84132]: mds.? [v2:172.21.15.12:6834/198565730,v1:172.21.15.12:6835/198565730] up:active 2024-09-10T18:04:45.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:44 smithi089 ceph-mon[84132]: fsmap cephfs:1 {0=a=up:active} 2024-09-10T18:04:46.012 INFO:tasks.rados.rados.0.smithi012.stdout:2370: done (1 left) 2024-09-10T18:04:46.012 INFO:tasks.rados.rados.0.smithi012.stdout:2371: done (0 left) 2024-09-10T18:04:46.013 INFO:tasks.rados.rados.0.smithi012.stdout:2372: delete oid 46 current snap is 243 2024-09-10T18:04:46.016 INFO:tasks.rados.rados.0.smithi012.stdout:2372: done (0 left) 2024-09-10T18:04:46.017 INFO:tasks.rados.rados.0.smithi012.stdout:2373: delete oid 40 current snap is 243 2024-09-10T18:04:46.021 INFO:tasks.rados.rados.0.smithi012.stdout:2373: done (0 left) 2024-09-10T18:04:46.021 INFO:tasks.rados.rados.0.smithi012.stdout:2374: snap_create 2024-09-10T18:04:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:46 smithi012 ceph-mon[89611]: osdmap e552: 8 total, 8 up, 8 in 2024-09-10T18:04:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:46 smithi012 ceph-mon[89611]: pgmap v502: 121 pgs: 121 active+clean; 412 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 28 MiB/s rd, 1.4 MiB/s wr, 44 op/s 2024-09-10T18:04:46.284 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:04:45 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[117263]: 2024-09-10T18:04:45.917+0000 7fc58c3d1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T18:04:46.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:46 smithi012 ceph-mon[92029]: osdmap e552: 8 total, 8 up, 8 in 2024-09-10T18:04:46.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:46 smithi012 ceph-mon[92029]: pgmap v502: 121 pgs: 121 active+clean; 412 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 28 MiB/s rd, 1.4 MiB/s wr, 44 op/s 2024-09-10T18:04:46.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:46 smithi089 ceph-mon[84132]: osdmap e552: 8 total, 8 up, 8 in 2024-09-10T18:04:46.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:46 smithi089 ceph-mon[84132]: pgmap v502: 121 pgs: 121 active+clean; 412 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 28 MiB/s rd, 1.4 MiB/s wr, 44 op/s 2024-09-10T18:04:47.014 INFO:tasks.rados.rados.0.smithi012.stdout:2374: done (0 left) 2024-09-10T18:04:47.014 INFO:tasks.rados.rados.0.smithi012.stdout:2375: read oid 50 snap -1 2024-09-10T18:04:47.014 INFO:tasks.rados.rados.0.smithi012.stdout:2375: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:04:47.014 INFO:tasks.rados.rados.0.smithi012.stdout:2376: read oid 18 snap -1 2024-09-10T18:04:47.014 INFO:tasks.rados.rados.0.smithi012.stdout:2376: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:04:47.014 INFO:tasks.rados.rados.0.smithi012.stdout:2377: setattr oid 7 current snap is 244 2024-09-10T18:04:47.017 INFO:tasks.rados.rados.0.smithi012.stdout:2376: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:04:47.020 INFO:tasks.rados.rados.0.smithi012.stdout:2376: done (2 left) 2024-09-10T18:04:47.021 INFO:tasks.rados.rados.0.smithi012.stdout:2378: snap_create 2024-09-10T18:04:47.025 INFO:tasks.rados.rados.0.smithi012.stdout:2375: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:04:47.061 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1112 (ObjNum 744 snap 241 seq_num 744) dirty exists 2024-09-10T18:04:47.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:47 smithi089 ceph-mon[84132]: osdmap e553: 8 total, 8 up, 8 in 2024-09-10T18:04:47.114 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:47 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:47.114 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:46 smithi089 podman[107948]: 2024-09-10 18:04:46.822304486 +0000 UTC m=+5.964511608 container died b1f6c0623c2ebd999ac0c6de93d3fad853cd19ba3d3fd2a358d333d37d48cd12 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=reef-7a853b1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:04:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:47 smithi012 ceph-mon[89611]: osdmap e553: 8 total, 8 up, 8 in 2024-09-10T18:04:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:47 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:47 smithi012 ceph-mon[92029]: osdmap e553: 8 total, 8 up, 8 in 2024-09-10T18:04:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:47 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:04:47.460 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:47 smithi089 podman[107948]: 2024-09-10 18:04:47.287156576 +0000 UTC m=+6.429363688 container cleanup b1f6c0623c2ebd999ac0c6de93d3fad853cd19ba3d3fd2a358d333d37d48cd12 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-7a853b1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T18:04:47.460 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:47 smithi089 bash[107948]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2375: done (2 left) 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2377: done (1 left) 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2378: done (0 left) 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2379: read oid 21 snap -1 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2379: expect (ObjNum 735 snap 238 seq_num 735) 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2380: read oid 16 snap -1 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2380: expect deleted 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2381: read oid 33 snap -1 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2381: expect (ObjNum 745 snap 242 seq_num 745) 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2382: read oid 37 snap -1 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2382: expect (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:04:47.740 INFO:tasks.rados.rados.0.smithi012.stdout:2383: snap_remove snap 229 2024-09-10T18:04:47.785 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:47 smithi089 podman[107970]: 2024-09-10 18:04:47.680505353 +0000 UTC m=+0.855937116 container remove b1f6c0623c2ebd999ac0c6de93d3fad853cd19ba3d3fd2a358d333d37d48cd12 (image=quay.ceph.io/ceph-ci/ceph@sha256:ef14fa6264e59c23a50911ff257310d925626ef2ed8aade654f62752810262e6, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=reef-7a853b1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:04:48.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:48 smithi089 ceph-mon[84132]: osdmap e554: 8 total, 8 up, 8 in 2024-09-10T18:04:48.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:48 smithi089 ceph-mon[84132]: pgmap v505: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 632 KiB/s wr, 35 op/s 2024-09-10T18:04:48.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:48 smithi089 ceph-mon[84132]: osdmap e555: 8 total, 8 up, 8 in 2024-09-10T18:04:48.233 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:47 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-10T18:04:48.234 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:47 smithi089 systemd[1]: Stopped Ceph mds.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:04:48.234 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:47 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.b.service: Consumed 1.693s CPU time. 2024-09-10T18:04:48.234 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:48 smithi089 systemd[1]: Starting Ceph mds.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:04:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:48 smithi012 ceph-mon[89611]: osdmap e554: 8 total, 8 up, 8 in 2024-09-10T18:04:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:48 smithi012 ceph-mon[89611]: pgmap v505: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 632 KiB/s wr, 35 op/s 2024-09-10T18:04:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:48 smithi012 ceph-mon[89611]: osdmap e555: 8 total, 8 up, 8 in 2024-09-10T18:04:48.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:48 smithi012 ceph-mon[92029]: osdmap e554: 8 total, 8 up, 8 in 2024-09-10T18:04:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:48 smithi012 ceph-mon[92029]: pgmap v505: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 632 KiB/s wr, 35 op/s 2024-09-10T18:04:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:48 smithi012 ceph-mon[92029]: osdmap e555: 8 total, 8 up, 8 in 2024-09-10T18:04:48.495 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:48 smithi089 podman[108103]: 2024-09-10 18:04:48.134367393 +0000 UTC m=+0.015818076 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:04:48.495 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:48 smithi089 podman[108103]: 2024-09-10 18:04:48.256564264 +0000 UTC m=+0.138014950 container create fd9833aea5e48cc417fc36066d46e2d5b60a8b676ed2766458fa04f7ea93e57f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T18:04:48.495 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:48 smithi089 podman[108103]: 2024-09-10 18:04:48.494235213 +0000 UTC m=+0.375685899 container init fd9833aea5e48cc417fc36066d46e2d5b60a8b676ed2766458fa04f7ea93e57f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T18:04:48.741 INFO:tasks.rados.rados.0.smithi012.stdout:2383: done (4 left) 2024-09-10T18:04:48.741 INFO:tasks.rados.rados.0.smithi012.stdout:2384: rmattr oid 27 current snap is 245 2024-09-10T18:04:48.741 INFO:tasks.rados.rados.0.smithi012.stdout:2384: done (4 left) 2024-09-10T18:04:48.741 INFO:tasks.rados.rados.0.smithi012.stdout:2385: delete oid 1 current snap is 245 2024-09-10T18:04:48.741 INFO:tasks.rados.rados.0.smithi012.stdout:2379: expect (ObjNum 735 snap 238 seq_num 735) 2024-09-10T18:04:48.754 INFO:tasks.rados.rados.0.smithi012.stdout:2381: expect (ObjNum 745 snap 242 seq_num 745) 2024-09-10T18:04:48.773 INFO:tasks.rados.rados.0.smithi012.stdout:2382: expect (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:04:48.785 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:48 smithi089 podman[108103]: 2024-09-10 18:04:48.497212148 +0000 UTC m=+0.378662836 container start fd9833aea5e48cc417fc36066d46e2d5b60a8b676ed2766458fa04f7ea93e57f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T18:04:48.786 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b[108118]: starting mds.b at 2024-09-10T18:04:48.786 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:48 smithi089 bash[108103]: fd9833aea5e48cc417fc36066d46e2d5b60a8b676ed2766458fa04f7ea93e57f 2024-09-10T18:04:48.786 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:04:48 smithi089 systemd[1]: Started Ceph mds.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:2379: done (4 left) 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:2380: done (3 left) 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:2381: done (2 left) 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:2382: done (1 left) 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:2385: done (0 left) 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:2386: rollback oid 38 current snap is 245 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 38 to 241 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:2387: rollback oid 39 current snap is 245 2024-09-10T18:04:49.229 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 240 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:2388: read oid 2 snap 233 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:2388: expect (ObjNum 719 snap 233 seq_num 719) 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:2389: read oid 37 snap 215 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:2389: expect (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:2390: rollback oid 4 current snap is 245 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 240 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:2391: rollback oid 50 current snap is 245 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 243 2024-09-10T18:04:49.230 INFO:tasks.rados.rados.0.smithi012.stdout:2392: snap_create 2024-09-10T18:04:49.231 INFO:tasks.rados.rados.0.smithi012.stdout:2391: finishing rollback tid 0 to smithi01278544-50 2024-09-10T18:04:49.231 INFO:tasks.rados.rados.0.smithi012.stdout:2388: expect (ObjNum 719 snap 233 seq_num 719) 2024-09-10T18:04:49.234 INFO:tasks.rados.rados.0.smithi012.stdout:2386: finishing rollback tid 0 to smithi01278544-38 2024-09-10T18:04:49.234 INFO:tasks.rados.rados.0.smithi012.stdout:2386: finishing rollback tid 1 to smithi01278544-38 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:2391: finishing rollback tid 1 to smithi01278544-50 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:2386: finishing rollback tid 2 to smithi01278544-38 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1566 (ObjNum 738 snap 238 seq_num 738) dirty exists 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:2391: finishing rollback tid 2 to smithi01278544-50 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 757 (ObjNum 654 snap 214 seq_num 654) dirty exists 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:2387: finishing rollback tid 0 to smithi01278544-39 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:2387: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:2387: finishing rollback tid 2 to smithi01278544-39 2024-09-10T18:04:49.236 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1710 (ObjNum 663 snap 217 seq_num 663) dirty exists 2024-09-10T18:04:49.242 INFO:tasks.rados.rados.0.smithi012.stdout:2390: finishing rollback tid 0 to smithi01278544-4 2024-09-10T18:04:49.246 INFO:tasks.rados.rados.0.smithi012.stdout:2390: finishing rollback tid 1 to smithi01278544-4 2024-09-10T18:04:49.246 INFO:tasks.rados.rados.0.smithi012.stdout:2390: finishing rollback tid 2 to smithi01278544-4 2024-09-10T18:04:49.246 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1107 (ObjNum 712 snap 232 seq_num 712) dirty exists 2024-09-10T18:04:49.250 INFO:tasks.rados.rados.0.smithi012.stdout:2389: expect (ObjNum 540 snap 182 seq_num 540) 2024-09-10T18:04:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:50.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[92029]: osdmap e556: 8 total, 8 up, 8 in 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[92029]: mds.? [v2:172.21.15.89:6832/3045602254,v1:172.21.15.89:6833/3045602254] up:boot 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[92029]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[89611]: osdmap e556: 8 total, 8 up, 8 in 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[89611]: mds.? [v2:172.21.15.89:6832/3045602254,v1:172.21.15.89:6833/3045602254] up:boot 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[89611]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-09-10T18:04:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:49 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T18:04:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:49 smithi089 ceph-mon[84132]: osdmap e556: 8 total, 8 up, 8 in 2024-09-10T18:04:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:49 smithi089 ceph-mon[84132]: mds.? [v2:172.21.15.89:6832/3045602254,v1:172.21.15.89:6833/3045602254] up:boot 2024-09-10T18:04:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:49 smithi089 ceph-mon[84132]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-09-10T18:04:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:49 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T18:04:50.040 INFO:tasks.rados.rados.0.smithi012.stdout:2386: done (6 left) 2024-09-10T18:04:50.040 INFO:tasks.rados.rados.0.smithi012.stdout:2387: done (5 left) 2024-09-10T18:04:50.040 INFO:tasks.rados.rados.0.smithi012.stdout:2388: done (4 left) 2024-09-10T18:04:50.040 INFO:tasks.rados.rados.0.smithi012.stdout:2389: done (3 left) 2024-09-10T18:04:50.041 INFO:tasks.rados.rados.0.smithi012.stdout:2390: done (2 left) 2024-09-10T18:04:50.041 INFO:tasks.rados.rados.0.smithi012.stdout:2391: done (1 left) 2024-09-10T18:04:50.041 INFO:tasks.rados.rados.0.smithi012.stdout:2392: done (0 left) 2024-09-10T18:04:50.041 INFO:tasks.rados.rados.0.smithi012.stdout:2393: copy_from oid 12 from oid 43 current snap is 246 2024-09-10T18:04:50.041 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 246 2024-09-10T18:04:50.041 INFO:tasks.rados.rados.0.smithi012.stdout:2394: seq_num 749 ranges {1884160=548864} 2024-09-10T18:04:50.054 INFO:tasks.rados.rados.0.smithi012.stdout:2394: writing smithi01278544-49 from 1884160 to 2433024 tid 1 2024-09-10T18:04:50.054 INFO:tasks.rados.rados.0.smithi012.stdout:2395: copy_from oid 6 from oid 21 current snap is 246 2024-09-10T18:04:50.054 INFO:tasks.rados.rados.0.smithi012.stdout:2396: snap_remove snap 238 2024-09-10T18:04:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:50 smithi012 ceph-mon[89611]: pgmap v508: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.6 MiB/s rd, 432 KiB/s wr, 28 op/s 2024-09-10T18:04:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:50 smithi012 ceph-mon[89611]: osdmap e557: 8 total, 8 up, 8 in 2024-09-10T18:04:51.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:50 smithi012 ceph-mon[92029]: pgmap v508: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.6 MiB/s rd, 432 KiB/s wr, 28 op/s 2024-09-10T18:04:51.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:50 smithi012 ceph-mon[92029]: osdmap e557: 8 total, 8 up, 8 in 2024-09-10T18:04:51.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:50 smithi089 ceph-mon[84132]: pgmap v508: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.6 MiB/s rd, 432 KiB/s wr, 28 op/s 2024-09-10T18:04:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:50 smithi089 ceph-mon[84132]: osdmap e557: 8 total, 8 up, 8 in 2024-09-10T18:04:51.039 INFO:tasks.rados.rados.0.smithi012.stdout:2396: done (3 left) 2024-09-10T18:04:51.039 INFO:tasks.rados.rados.0.smithi012.stdout:2397: snap_remove snap 240 2024-09-10T18:04:52.044 INFO:tasks.rados.rados.0.smithi012.stdout:2397: done (3 left) 2024-09-10T18:04:52.044 INFO:tasks.rados.rados.0.smithi012.stdout:2398: read oid 20 snap 244 2024-09-10T18:04:52.045 INFO:tasks.rados.rados.0.smithi012.stdout:2398: expect (ObjNum 713 snap 232 seq_num 713) 2024-09-10T18:04:52.045 INFO:tasks.rados.rados.0.smithi012.stdout:2399: snap_remove snap 245 2024-09-10T18:04:52.085 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:52 smithi089 ceph-mon[84132]: osdmap e558: 8 total, 8 up, 8 in 2024-09-10T18:04:52.085 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:52 smithi089 ceph-mon[84132]: pgmap v511: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 0 B/s wr, 11 op/s 2024-09-10T18:04:52.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:52 smithi012 ceph-mon[89611]: osdmap e558: 8 total, 8 up, 8 in 2024-09-10T18:04:52.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:52 smithi012 ceph-mon[89611]: pgmap v511: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 0 B/s wr, 11 op/s 2024-09-10T18:04:52.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:52 smithi012 ceph-mon[92029]: osdmap e558: 8 total, 8 up, 8 in 2024-09-10T18:04:52.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:52 smithi012 ceph-mon[92029]: pgmap v511: 121 pgs: 121 active+clean; 406 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 0 B/s wr, 11 op/s 2024-09-10T18:04:52.738 INFO:tasks.rados.rados.0.smithi012.stdout:2399: done (4 left) 2024-09-10T18:04:52.738 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 246 2024-09-10T18:04:52.738 INFO:tasks.rados.rados.0.smithi012.stdout:2400: seq_num 750 ranges {1982464=565248} 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:2400: writing smithi01278544-15 from 1982464 to 2547712 tid 1 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:2401: rollback oid 16 current snap is 246 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 222 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:2395: finishing copy_from racing read to smithi01278544-6 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:2402: read oid 35 snap -1 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:2402: expect deleted 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:2403: snap_create 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:2395: finishing copy_from to smithi01278544-6 2024-09-10T18:04:52.754 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 956 (ObjNum 735 snap 238 seq_num 735) dirty exists 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2394: finishing write tid 1 to smithi01278544-49 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2394: finishing write tid 2 to smithi01278544-49 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2394: finishing write tid 3 to smithi01278544-49 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2394: oid 49 updating version 0 to 1134 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2394: oid 49 version 1134 is already newer than 1133 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1134 (ObjNum 749 snap 246 seq_num 749) dirty exists 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2394: left oid 49 (ObjNum 749 snap 246 seq_num 749) 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2393: finishing copy_from racing read to smithi01278544-12 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2393: finishing copy_from to smithi01278544-12 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1622 (ObjNum 728 snap 237 seq_num 728) dirty exists 2024-09-10T18:04:52.755 INFO:tasks.rados.rados.0.smithi012.stdout:2398: expect (ObjNum 713 snap 232 seq_num 713) 2024-09-10T18:04:52.950 INFO:tasks.rados.rados.0.smithi012.stdout:2401: finishing rollback tid 1 to smithi01278544-16 2024-09-10T18:04:52.950 INFO:tasks.rados.rados.0.smithi012.stdout:2401: finishing rollback tid 2 to smithi01278544-16 2024-09-10T18:04:52.951 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 1122 (ObjNum 674 snap 219 seq_num 674) dirty exists 2024-09-10T18:04:52.951 INFO:tasks.rados.rados.0.smithi012.stdout:2400: finishing write tid 1 to smithi01278544-15 2024-09-10T18:04:52.951 INFO:tasks.rados.rados.0.smithi012.stdout:2400: finishing write tid 2 to smithi01278544-15 2024-09-10T18:04:52.951 INFO:tasks.rados.rados.0.smithi012.stdout:2400: finishing write tid 3 to smithi01278544-15 2024-09-10T18:04:52.951 INFO:tasks.rados.rados.0.smithi012.stdout:2400: oid 15 updating version 0 to 1136 2024-09-10T18:04:52.951 INFO:tasks.rados.rados.0.smithi012.stdout:2400: oid 15 version 1136 is already newer than 1135 2024-09-10T18:04:52.951 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 1136 (ObjNum 750 snap 246 seq_num 750) dirty exists 2024-09-10T18:04:52.951 INFO:tasks.rados.rados.0.smithi012.stdout:2400: left oid 15 (ObjNum 750 snap 246 seq_num 750) 2024-09-10T18:04:53.352 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:53 smithi089 ceph-mon[84132]: osdmap e559: 8 total, 8 up, 8 in 2024-09-10T18:04:53.353 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:53 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.353 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:53 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.353 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:53 smithi089 ceph-mon[84132]: osdmap e560: 8 total, 8 up, 8 in 2024-09-10T18:04:53.353 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:53 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.353 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:53 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[92029]: osdmap e559: 8 total, 8 up, 8 in 2024-09-10T18:04:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[92029]: osdmap e560: 8 total, 8 up, 8 in 2024-09-10T18:04:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[89611]: osdmap e559: 8 total, 8 up, 8 in 2024-09-10T18:04:53.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[89611]: osdmap e560: 8 total, 8 up, 8 in 2024-09-10T18:04:53.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2393: done (7 left) 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2394: done (6 left) 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2395: done (5 left) 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2398: done (4 left) 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2400: done (3 left) 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2401: done (2 left) 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2402: done (1 left) 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2403: done (0 left) 2024-09-10T18:04:53.742 INFO:tasks.rados.rados.0.smithi012.stdout:2404: delete oid 35 current snap is 247 2024-09-10T18:04:53.745 INFO:tasks.rados.rados.0.smithi012.stdout:2404: done (0 left) 2024-09-10T18:04:53.745 INFO:tasks.rados.rados.0.smithi012.stdout:2405: snap_create 2024-09-10T18:04:54.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:04:53 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:04:53] "GET /metrics HTTP/1.1" 200 36130 "" "Prometheus/2.43.0" 2024-09-10T18:04:54.744 INFO:tasks.rados.rados.0.smithi012.stdout:2405: done (0 left) 2024-09-10T18:04:54.745 INFO:tasks.rados.rados.0.smithi012.stdout:2406: copy_from oid 2 from oid 45 current snap is 248 2024-09-10T18:04:54.745 INFO:tasks.rados.rados.0.smithi012.stdout:2407: rmattr oid 23 current snap is 248 2024-09-10T18:04:54.745 INFO:tasks.rados.rados.0.smithi012.stdout:2407: done (1 left) 2024-09-10T18:04:54.745 INFO:tasks.rados.rados.0.smithi012.stdout:2408: rmattr oid 14 current snap is 248 2024-09-10T18:04:54.745 INFO:tasks.rados.rados.0.smithi012.stdout:2409: delete oid 48 current snap is 248 2024-09-10T18:04:54.752 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1661 (ObjNum 545 snap 183 seq_num 545) dirty exists 2024-09-10T18:04:54.753 INFO:tasks.rados.rados.0.smithi012.stdout:2408: done (2 left) 2024-09-10T18:04:54.753 INFO:tasks.rados.rados.0.smithi012.stdout:2409: done (1 left) 2024-09-10T18:04:54.753 INFO:tasks.rados.rados.0.smithi012.stdout:2410: snap_remove snap 233 2024-09-10T18:04:54.964 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:54 smithi089 ceph-mon[84132]: pgmap v514: 121 pgs: 121 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2024-09-10T18:04:54.965 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:54 smithi089 ceph-mon[84132]: osdmap e561: 8 total, 8 up, 8 in 2024-09-10T18:04:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:54 smithi012 ceph-mon[89611]: pgmap v514: 121 pgs: 121 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2024-09-10T18:04:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:54 smithi012 ceph-mon[89611]: osdmap e561: 8 total, 8 up, 8 in 2024-09-10T18:04:55.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:54 smithi012 ceph-mon[92029]: pgmap v514: 121 pgs: 121 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2024-09-10T18:04:55.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:54 smithi012 ceph-mon[92029]: osdmap e561: 8 total, 8 up, 8 in 2024-09-10T18:04:55.749 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:04:55.757 INFO:tasks.rados.rados.0.smithi012.stdout:2410: done (1 left) 2024-09-10T18:04:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 248 2024-09-10T18:04:55.758 INFO:tasks.rados.rados.0.smithi012.stdout:2411: seq_num 753 ranges {1695744=614400} 2024-09-10T18:04:55.772 INFO:tasks.rados.rados.0.smithi012.stdout:2411: writing smithi01278544-22 from 1695744 to 2310144 tid 1 2024-09-10T18:04:55.772 INFO:tasks.rados.rados.0.smithi012.stdout:2406: finishing copy_from racing read to smithi01278544-2 2024-09-10T18:04:55.772 INFO:tasks.rados.rados.0.smithi012.stdout:2406: finishing copy_from to smithi01278544-2 2024-09-10T18:04:55.772 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1128 (ObjNum 721 snap 235 seq_num 721) dirty exists 2024-09-10T18:04:55.772 INFO:tasks.rados.rados.0.smithi012.stdout:2406: done (1 left) 2024-09-10T18:04:55.772 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 248 2024-09-10T18:04:55.772 INFO:tasks.rados.rados.0.smithi012.stdout:2412: seq_num 754 ranges {819200=630784} 2024-09-10T18:04:55.781 INFO:tasks.rados.rados.0.smithi012.stdout:2412: writing smithi01278544-13 from 819200 to 1449984 tid 1 2024-09-10T18:04:55.781 INFO:tasks.rados.rados.0.smithi012.stdout:2413: snap_remove snap 228 2024-09-10T18:04:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:55 smithi012 ceph-mon[89611]: osdmap e562: 8 total, 8 up, 8 in 2024-09-10T18:04:56.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:55 smithi012 ceph-mon[92029]: osdmap e562: 8 total, 8 up, 8 in 2024-09-10T18:04:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:55 smithi089 ceph-mon[84132]: osdmap e562: 8 total, 8 up, 8 in 2024-09-10T18:04:56.366 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (9m) 22s ago 10m 27.7M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (10m) 4s ago 10m 90.4M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (26s) 22s ago 12m 13.2M - 19.3.0-4858-gbad1f558 542e6e6af07c 34b133ecae8a 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (8s) 4s ago 12m 11.0M - 19.3.0-4858-gbad1f558 542e6e6af07c fd9833aea5e4 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (6m) 4s ago 15m 456M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (6m) 22s ago 17m 530M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (6m) 22s ago 17m 69.0M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (5m) 4s ago 16m 51.8M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (5m) 22s ago 16m 56.5M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (10m) 22s ago 10m 15.8M - 1.5.0 0da6a335fe13 33d3201f4d4f 2024-09-10T18:04:56.367 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (10m) 4s ago 10m 16.7M - 1.5.0 0da6a335fe13 ba0632e17e74 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (4m) 22s ago 15m 311M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (4m) 22s ago 15m 218M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (3m) 22s ago 14m 202M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (2m) 22s ago 14m 151M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (2m) 4s ago 14m 285M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 75e9a99555f3 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (111s) 4s ago 13m 201M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 28c479f4ad60 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (76s) 4s ago 13m 136M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 71e430ee4ba6 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (42s) 4s ago 12m 72.8M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 1b26f245f7dc 2024-09-10T18:04:56.368 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (6m) 4s ago 11m 61.2M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 8 2024-09-10T18:04:56.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:04:56.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:04:56.734 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:04:56.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:04:56.734 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:04:56.734 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 15 2024-09-10T18:04:56.734 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:04:56.734 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:04:56.778 INFO:tasks.rados.rados.0.smithi012.stdout:2413: done (2 left) 2024-09-10T18:04:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:2414: setattr oid 10 current snap is 248 2024-09-10T18:04:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:2415: rmattr oid 17 current snap is 248 2024-09-10T18:04:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:2415: done (3 left) 2024-09-10T18:04:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:2416: rollback oid 21 current snap is 248 2024-09-10T18:04:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 232 2024-09-10T18:04:56.779 INFO:tasks.rados.rados.0.smithi012.stdout:2417: snap_remove snap 234 2024-09-10T18:04:56.987 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: pgmap v517: 121 pgs: 121 active+clean; 415 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-09-10T18:04:56.987 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='client.44453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:56.987 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: osdmap e563: 8 total, 8 up, 8 in 2024-09-10T18:04:56.987 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.a"} : dispatch 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.b"} : dispatch 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.989 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2785669190' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: pgmap v517: 121 pgs: 121 active+clean; 415 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='client.44453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: osdmap e563: 8 total, 8 up, 8 in 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.990 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.a"} : dispatch 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-09-10T18:04:56.991 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.b"} : dispatch 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.992 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:56.993 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:56.993 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:56 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2785669190' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: pgmap v517: 121 pgs: 121 active+clean; 415 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-09-10T18:04:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='client.44453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: osdmap e563: 8 total, 8 up, 8 in 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.a"} : dispatch 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.b"} : dispatch 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:04:57.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:56 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2785669190' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:04:57.050 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "mds", 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "mon", 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "osd" 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "15/20 daemons upgraded", 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:04:57.051 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:04:57.741 INFO:tasks.rados.rados.0.smithi012.stdout:2417: done (4 left) 2024-09-10T18:04:57.741 INFO:tasks.rados.rados.0.smithi012.stdout:2418: delete oid 16 current snap is 248 2024-09-10T18:04:57.741 INFO:tasks.rados.rados.0.smithi012.stdout:2411: finishing write tid 1 to smithi01278544-22 2024-09-10T18:04:57.741 INFO:tasks.rados.rados.0.smithi012.stdout:2411: finishing write tid 2 to smithi01278544-22 2024-09-10T18:04:57.741 INFO:tasks.rados.rados.0.smithi012.stdout:2411: finishing write tid 3 to smithi01278544-22 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2411: oid 22 updating version 0 to 1729 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2411: oid 22 version 1729 is already newer than 1728 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1729 (ObjNum 753 snap 248 seq_num 753) dirty exists 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2411: left oid 22 (ObjNum 753 snap 248 seq_num 753) 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2412: finishing write tid 1 to smithi01278544-13 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2412: finishing write tid 2 to smithi01278544-13 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2412: finishing write tid 3 to smithi01278544-13 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2412: oid 13 updating version 0 to 1122 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2412: oid 13 version 1122 is already newer than 1121 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1122 (ObjNum 754 snap 248 seq_num 754) dirty exists 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2412: left oid 13 (ObjNum 754 snap 248 seq_num 754) 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1738 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2416: finishing rollback tid 0 to smithi01278544-21 2024-09-10T18:04:57.742 INFO:tasks.rados.rados.0.smithi012.stdout:2416: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:04:57.743 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 965 (ObjNum 145 snap 0 seq_num 3496739040) dirty dne 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2411: done (4 left) 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2412: done (3 left) 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2414: done (2 left) 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2416: done (1 left) 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2418: done (0 left) 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2419: read oid 50 snap -1 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2419: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2420: rollback oid 21 current snap is 248 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 224 2024-09-10T18:04:57.751 INFO:tasks.rados.rados.0.smithi012.stdout:2421: delete oid 35 current snap is 248 2024-09-10T18:04:57.761 INFO:tasks.rados.rados.0.smithi012.stdout:2421: done (2 left) 2024-09-10T18:04:57.762 INFO:tasks.rados.rados.0.smithi012.stdout:2422: delete oid 33 current snap is 248 2024-09-10T18:04:57.765 INFO:tasks.rados.rados.0.smithi012.stdout:2419: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:04:57.805 INFO:tasks.rados.rados.0.smithi012.stdout:2420: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:04:57.805 INFO:tasks.rados.rados.0.smithi012.stdout:2420: finishing rollback tid 2 to smithi01278544-21 2024-09-10T18:04:57.805 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 971 (ObjNum 670 snap 218 seq_num 670) dirty exists 2024-09-10T18:04:57.805 INFO:tasks.rados.rados.0.smithi012.stdout:2419: done (2 left) 2024-09-10T18:04:57.806 INFO:tasks.rados.rados.0.smithi012.stdout:2420: done (1 left) 2024-09-10T18:04:57.806 INFO:tasks.rados.rados.0.smithi012.stdout:2422: done (0 left) 2024-09-10T18:04:57.806 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 248 2024-09-10T18:04:57.806 INFO:tasks.rados.rados.0.smithi012.stdout:2423: seq_num 758 ranges {0=704512} 2024-09-10T18:04:57.809 INFO:tasks.rados.rados.0.smithi012.stdout:2423: writing smithi01278544-35 from 0 to 704512 tid 1 2024-09-10T18:04:57.809 INFO:tasks.rados.rados.0.smithi012.stdout:2424: delete oid 17 current snap is 248 2024-09-10T18:04:57.811 INFO:tasks.rados.rados.0.smithi012.stdout:2424: done (1 left) 2024-09-10T18:04:57.811 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 248 2024-09-10T18:04:57.811 INFO:tasks.rados.rados.0.smithi012.stdout:2425: seq_num 760 ranges {5349376=737280} 2024-09-10T18:04:57.845 INFO:tasks.rados.rados.0.smithi012.stdout:2425: writing smithi01278544-3 from 5349376 to 6086656 tid 1 2024-09-10T18:04:57.845 INFO:tasks.rados.rados.0.smithi012.stdout:2426: snap_create 2024-09-10T18:04:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2423: finishing write tid 1 to smithi01278544-35 2024-09-10T18:04:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2423: finishing write tid 2 to smithi01278544-35 2024-09-10T18:04:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2423: finishing write tid 3 to smithi01278544-35 2024-09-10T18:04:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2423: oid 35 updating version 0 to 1141 2024-09-10T18:04:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2423: oid 35 version 1141 is already newer than 1140 2024-09-10T18:04:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1141 (ObjNum 758 snap 248 seq_num 758) dirty exists 2024-09-10T18:04:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2423: left oid 35 (ObjNum 758 snap 248 seq_num 758) 2024-09-10T18:04:57.850 INFO:tasks.rados.rados.0.smithi012.stdout:2425: finishing write tid 1 to smithi01278544-3 2024-09-10T18:04:57.850 INFO:tasks.rados.rados.0.smithi012.stdout:2425: finishing write tid 2 to smithi01278544-3 2024-09-10T18:04:57.853 INFO:tasks.rados.rados.0.smithi012.stdout:2425: finishing write tid 3 to smithi01278544-3 2024-09-10T18:04:57.854 INFO:tasks.rados.rados.0.smithi012.stdout:2425: oid 3 updating version 0 to 1276 2024-09-10T18:04:57.854 INFO:tasks.rados.rados.0.smithi012.stdout:2425: oid 3 updating version 1276 to 1277 2024-09-10T18:04:57.854 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1277 (ObjNum 760 snap 248 seq_num 760) dirty exists 2024-09-10T18:04:57.854 INFO:tasks.rados.rados.0.smithi012.stdout:2425: left oid 3 (ObjNum 760 snap 248 seq_num 760) 2024-09-10T18:04:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: from='client.34551 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all mds 2024-09-10T18:04:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all rgw 2024-09-10T18:04:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T18:04:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all ceph-exporter 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all iscsi 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all nfs 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: Upgrade: Setting container_image for all nvmeof 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: from='client.34557 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: osdmap e564: 8 total, 8 up, 8 in 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[89611]: osdmap e565: 8 total, 8 up, 8 in 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: from='client.34551 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all mds 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all rgw 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T18:04:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all ceph-exporter 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all iscsi 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all nfs 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: Upgrade: Setting container_image for all nvmeof 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: from='client.34557 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: osdmap e564: 8 total, 8 up, 8 in 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:57 smithi012 ceph-mon[92029]: osdmap e565: 8 total, 8 up, 8 in 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: from='client.34551 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all mds 2024-09-10T18:04:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all rgw 2024-09-10T18:04:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T18:04:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all ceph-exporter 2024-09-10T18:04:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all iscsi 2024-09-10T18:04:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all nfs 2024-09-10T18:04:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: Upgrade: Setting container_image for all nvmeof 2024-09-10T18:04:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: from='client.34557 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: osdmap e564: 8 total, 8 up, 8 in 2024-09-10T18:04:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:57 smithi089 ceph-mon[84132]: osdmap e565: 8 total, 8 up, 8 in 2024-09-10T18:04:58.760 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:58 smithi012 systemd[1]: Stopping Ceph node-exporter.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:04:58.780 INFO:tasks.rados.rados.0.smithi012.stdout:2423: done (2 left) 2024-09-10T18:04:58.780 INFO:tasks.rados.rados.0.smithi012.stdout:2425: done (1 left) 2024-09-10T18:04:58.780 INFO:tasks.rados.rados.0.smithi012.stdout:2426: done (0 left) 2024-09-10T18:04:58.780 INFO:tasks.rados.rados.0.smithi012.stdout:2427: delete oid 47 current snap is 249 2024-09-10T18:04:58.786 INFO:tasks.rados.rados.0.smithi012.stdout:2427: done (0 left) 2024-09-10T18:04:58.786 INFO:tasks.rados.rados.0.smithi012.stdout:2428: copy_from oid 37 from oid 34 current snap is 249 2024-09-10T18:04:58.786 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 249 2024-09-10T18:04:58.786 INFO:tasks.rados.rados.0.smithi012.stdout:2429: seq_num 762 ranges {0=770048} 2024-09-10T18:04:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:2429: writing smithi01278544-9 from 0 to 770048 tid 1 2024-09-10T18:04:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:2430: rollback oid 27 current snap is 249 2024-09-10T18:04:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 248 2024-09-10T18:04:58.791 INFO:tasks.rados.rados.0.smithi012.stdout:2431: delete oid 28 current snap is 249 2024-09-10T18:04:58.794 INFO:tasks.rados.rados.0.smithi012.stdout:2431: done (3 left) 2024-09-10T18:04:58.794 INFO:tasks.rados.rados.0.smithi012.stdout:2432: delete oid 35 current snap is 249 2024-09-10T18:04:58.796 INFO:tasks.rados.rados.0.smithi012.stdout:2429: finishing write tid 1 to smithi01278544-9 2024-09-10T18:04:58.796 INFO:tasks.rados.rados.0.smithi012.stdout:2430: finishing rollback tid 1 to smithi01278544-27 2024-09-10T18:04:58.797 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1271 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:04:58.797 INFO:tasks.rados.rados.0.smithi012.stdout:2429: finishing write tid 2 to smithi01278544-9 2024-09-10T18:04:58.797 INFO:tasks.rados.rados.0.smithi012.stdout:2430: done (3 left) 2024-09-10T18:04:58.797 INFO:tasks.rados.rados.0.smithi012.stdout:2432: done (2 left) 2024-09-10T18:04:58.797 INFO:tasks.rados.rados.0.smithi012.stdout:2433: snap_create 2024-09-10T18:04:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2428: finishing copy_from racing read to smithi01278544-37 2024-09-10T18:04:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:2428: finishing copy_from to smithi01278544-37 2024-09-10T18:04:58.800 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 917 (ObjNum 558 snap 186 seq_num 558) dirty exists 2024-09-10T18:04:58.802 INFO:tasks.rados.rados.0.smithi012.stdout:2429: finishing write tid 3 to smithi01278544-9 2024-09-10T18:04:58.802 INFO:tasks.rados.rados.0.smithi012.stdout:2429: oid 9 updating version 0 to 1568 2024-09-10T18:04:58.802 INFO:tasks.rados.rados.0.smithi012.stdout:2429: oid 9 version 1568 is already newer than 1567 2024-09-10T18:04:58.803 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1568 (ObjNum 762 snap 249 seq_num 762) dirty exists 2024-09-10T18:04:58.803 INFO:tasks.rados.rados.0.smithi012.stdout:2429: left oid 9 (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:04:59.034 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:58 smithi012 podman[121261]: 2024-09-10 18:04:58.758911486 +0000 UTC m=+0.132959868 container died 33d3201f4d4f402b0bcad46569ad30d24be9cdf3ce9a229a681e4f3acabb019e (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:04:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:58 smithi012 ceph-mon[89611]: from='client.44477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:58 smithi012 ceph-mon[89611]: pgmap v520: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 418 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 882 KiB/s wr, 12 op/s 2024-09-10T18:04:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:58 smithi012 ceph-mon[92029]: from='client.44477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:58 smithi012 ceph-mon[92029]: pgmap v520: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 418 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 882 KiB/s wr, 12 op/s 2024-09-10T18:04:59.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:58 smithi089 ceph-mon[84132]: from='client.44477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:04:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:58 smithi089 ceph-mon[84132]: pgmap v520: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 418 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 882 KiB/s wr, 12 op/s 2024-09-10T18:04:59.392 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 podman[121261]: 2024-09-10 18:04:59.156997902 +0000 UTC m=+0.531046287 container cleanup 33d3201f4d4f402b0bcad46569ad30d24be9cdf3ce9a229a681e4f3acabb019e (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:04:59.392 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 bash[121261]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a 2024-09-10T18:04:59.756 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 podman[121275]: 2024-09-10 18:04:59.391483541 +0000 UTC m=+0.631231554 container remove 33d3201f4d4f402b0bcad46569ad30d24be9cdf3ce9a229a681e4f3acabb019e (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:04:59.856 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-10T18:04:59.856 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-10T18:04:59.856 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 systemd[1]: Stopped Ceph node-exporter.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:04:59.856 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.a.service: Consumed 2.954s CPU time. 2024-09-10T18:04:59.856 INFO:tasks.rados.rados.0.smithi012.stdout:2428: done (2 left) 2024-09-10T18:04:59.857 INFO:tasks.rados.rados.0.smithi012.stdout:2429: done (1 left) 2024-09-10T18:04:59.857 INFO:tasks.rados.rados.0.smithi012.stdout:2433: done (0 left) 2024-09-10T18:04:59.857 INFO:tasks.rados.rados.0.smithi012.stdout:2434: snap_remove snap 239 2024-09-10T18:05:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:59 smithi012 ceph-mon[89611]: Upgrade: Updating node-exporter.a (1/2) 2024-09-10T18:05:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:59 smithi012 ceph-mon[89611]: Deploying daemon node-exporter.a on smithi012 2024-09-10T18:05:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:04:59 smithi012 ceph-mon[89611]: osdmap e566: 8 total, 8 up, 8 in 2024-09-10T18:05:00.034 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 systemd[1]: Starting Ceph node-exporter.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:05:00.035 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:04:59 smithi012 bash[121402]: Trying to pull quay.io/prometheus/node-exporter:v1.7.0... 2024-09-10T18:05:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:59 smithi012 ceph-mon[92029]: Upgrade: Updating node-exporter.a (1/2) 2024-09-10T18:05:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:59 smithi012 ceph-mon[92029]: Deploying daemon node-exporter.a on smithi012 2024-09-10T18:05:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:04:59 smithi012 ceph-mon[92029]: osdmap e566: 8 total, 8 up, 8 in 2024-09-10T18:05:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:59 smithi089 ceph-mon[84132]: Upgrade: Updating node-exporter.a (1/2) 2024-09-10T18:05:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:59 smithi089 ceph-mon[84132]: Deploying daemon node-exporter.a on smithi012 2024-09-10T18:05:00.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:04:59 smithi089 ceph-mon[84132]: osdmap e566: 8 total, 8 up, 8 in 2024-09-10T18:05:00.784 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:00 smithi012 bash[121402]: Getting image source signatures 2024-09-10T18:05:00.784 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:00 smithi012 bash[121402]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-09-10T18:05:00.785 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:00 smithi012 bash[121402]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-09-10T18:05:00.785 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:00 smithi012 bash[121402]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-09-10T18:05:00.794 INFO:tasks.rados.rados.0.smithi012.stdout:2434: done (0 left) 2024-09-10T18:05:00.794 INFO:tasks.rados.rados.0.smithi012.stdout:2435: snap_create 2024-09-10T18:05:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:00 smithi012 ceph-mon[89611]: pgmap v523: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 418 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 322 KiB/s wr, 10 op/s 2024-09-10T18:05:01.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:00 smithi012 ceph-mon[89611]: osdmap e567: 8 total, 8 up, 8 in 2024-09-10T18:05:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:00 smithi012 ceph-mon[92029]: pgmap v523: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 418 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 322 KiB/s wr, 10 op/s 2024-09-10T18:05:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:00 smithi012 ceph-mon[92029]: osdmap e567: 8 total, 8 up, 8 in 2024-09-10T18:05:01.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:00 smithi089 ceph-mon[84132]: pgmap v523: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 418 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 322 KiB/s wr, 10 op/s 2024-09-10T18:05:01.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:00 smithi089 ceph-mon[84132]: osdmap e567: 8 total, 8 up, 8 in 2024-09-10T18:05:01.807 INFO:tasks.rados.rados.0.smithi012.stdout:2435: done (0 left) 2024-09-10T18:05:01.807 INFO:tasks.rados.rados.0.smithi012.stdout:2436: snap_remove snap 237 2024-09-10T18:05:02.011 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:01 smithi012 bash[121402]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-09-10T18:05:02.011 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:01 smithi012 ceph-mon[89611]: osdmap e568: 8 total, 8 up, 8 in 2024-09-10T18:05:02.011 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:01 smithi012 ceph-mon[89611]: pgmap v526: 121 pgs: 121 active+clean; 421 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 852 KiB/s wr, 2 op/s 2024-09-10T18:05:02.011 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:02.011 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:01 smithi012 ceph-mon[92029]: osdmap e568: 8 total, 8 up, 8 in 2024-09-10T18:05:02.012 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:01 smithi012 ceph-mon[92029]: pgmap v526: 121 pgs: 121 active+clean; 421 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 852 KiB/s wr, 2 op/s 2024-09-10T18:05:02.012 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:02.284 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 bash[121402]: Writing manifest to image destination 2024-09-10T18:05:02.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:01 smithi089 ceph-mon[84132]: osdmap e568: 8 total, 8 up, 8 in 2024-09-10T18:05:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:01 smithi089 ceph-mon[84132]: pgmap v526: 121 pgs: 121 active+clean; 421 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 852 KiB/s wr, 2 op/s 2024-09-10T18:05:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:02.632 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 podman[121402]: 2024-09-10 18:05:02.288937467 +0000 UTC m=+2.432765614 image pull 72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e quay.io/prometheus/node-exporter:v1.7.0 2024-09-10T18:05:02.633 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 podman[121402]: 2024-09-10 18:05:02.387276456 +0000 UTC m=+2.531104606 container create bb42e60bc4f1815fc079805a2d5153a0fa9d83679b33f7afe2bbf952b18b0cf8 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:02.744 INFO:tasks.rados.rados.0.smithi012.stdout:2436: done (0 left) 2024-09-10T18:05:02.744 INFO:tasks.rados.rados.0.smithi012.stdout:2437: setattr oid 43 current snap is 251 2024-09-10T18:05:02.746 INFO:tasks.rados.rados.0.smithi012.stdout:2438: setattr oid 29 current snap is 251 2024-09-10T18:05:02.747 INFO:tasks.rados.rados.0.smithi012.stdout:2439: rmattr oid 12 current snap is 251 2024-09-10T18:05:02.747 INFO:tasks.rados.rados.0.smithi012.stdout:2439: done (2 left) 2024-09-10T18:05:02.747 INFO:tasks.rados.rados.0.smithi012.stdout:2440: read oid 3 snap -1 2024-09-10T18:05:02.747 INFO:tasks.rados.rados.0.smithi012.stdout:2440: expect (ObjNum 760 snap 248 seq_num 760) 2024-09-10T18:05:02.748 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 251 2024-09-10T18:05:02.749 INFO:tasks.rados.rados.0.smithi012.stdout:2441: seq_num 765 ranges {0=417792,417792=401408} 2024-09-10T18:05:02.750 INFO:tasks.rados.rados.0.smithi012.stdout:2441: writing smithi01278544-27 from 0 to 417792 tid 1 2024-09-10T18:05:02.753 INFO:tasks.rados.rados.0.smithi012.stdout:2441: writing smithi01278544-27 from 417792 to 819200 tid 2 2024-09-10T18:05:02.753 INFO:tasks.rados.rados.0.smithi012.stdout:2442: snap_create 2024-09-10T18:05:02.760 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1118 (ObjNum 676 snap 220 seq_num 676) dirty exists 2024-09-10T18:05:02.763 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 1701 (ObjNum 728 snap 237 seq_num 728) dirty exists 2024-09-10T18:05:02.789 INFO:tasks.rados.rados.0.smithi012.stdout:2440: expect (ObjNum 760 snap 248 seq_num 760) 2024-09-10T18:05:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-mon[89611]: osdmap e569: 8 total, 8 up, 8 in 2024-09-10T18:05:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-mon[89611]: osdmap e570: 8 total, 8 up, 8 in 2024-09-10T18:05:03.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-mon[92029]: osdmap e569: 8 total, 8 up, 8 in 2024-09-10T18:05:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-mon[92029]: osdmap e570: 8 total, 8 up, 8 in 2024-09-10T18:05:03.035 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 podman[121402]: 2024-09-10 18:05:02.631462917 +0000 UTC m=+2.775291069 container init bb42e60bc4f1815fc079805a2d5153a0fa9d83679b33f7afe2bbf952b18b0cf8 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:03.035 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 podman[121402]: 2024-09-10 18:05:02.636633794 +0000 UTC m=+2.780461939 container start bb42e60bc4f1815fc079805a2d5153a0fa9d83679b33f7afe2bbf952b18b0cf8 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:03.035 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.641Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-10T18:05:03.035 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.641Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-10T18:05:03.035 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.641Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-10T18:05:03.035 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.641Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.642Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.642Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=arp 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-10T18:05:03.036 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=edac 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-10T18:05:03.037 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=os 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-10T18:05:03.038 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=stat 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=time 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=uname 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-10T18:05:03.039 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-10T18:05:03.040 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a[121489]: ts=2024-09-10T18:05:02.643Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-10T18:05:03.040 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 bash[121402]: bb42e60bc4f1815fc079805a2d5153a0fa9d83679b33f7afe2bbf952b18b0cf8 2024-09-10T18:05:03.040 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:05:02 smithi012 systemd[1]: Started Ceph node-exporter.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:05:03.135 INFO:tasks.rados.rados.0.smithi012.stdout:2441: finishing write tid 1 to smithi01278544-27 2024-09-10T18:05:03.135 INFO:tasks.rados.rados.0.smithi012.stdout:2441: finishing write tid 2 to smithi01278544-27 2024-09-10T18:05:03.135 INFO:tasks.rados.rados.0.smithi012.stdout:2441: finishing write tid 3 to smithi01278544-27 2024-09-10T18:05:03.136 INFO:tasks.rados.rados.0.smithi012.stdout:2441: finishing write tid 4 to smithi01278544-27 2024-09-10T18:05:03.136 INFO:tasks.rados.rados.0.smithi012.stdout:2441: oid 27 updating version 0 to 1279 2024-09-10T18:05:03.136 INFO:tasks.rados.rados.0.smithi012.stdout:2441: oid 27 version 1279 is already newer than 1278 2024-09-10T18:05:03.136 INFO:tasks.rados.rados.0.smithi012.stdout:2441: oid 27 updating version 1279 to 1280 2024-09-10T18:05:03.136 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1280 (ObjNum 765 snap 251 seq_num 765) dirty exists 2024-09-10T18:05:03.136 INFO:tasks.rados.rados.0.smithi012.stdout:2441: left oid 27 (ObjNum 765 snap 251 seq_num 765) 2024-09-10T18:05:03.203 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:02 smithi089 ceph-mon[84132]: osdmap e569: 8 total, 8 up, 8 in 2024-09-10T18:05:03.204 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:02 smithi089 ceph-mon[84132]: osdmap e570: 8 total, 8 up, 8 in 2024-09-10T18:05:03.750 INFO:tasks.rados.rados.0.smithi012.stdout:2437: done (4 left) 2024-09-10T18:05:03.750 INFO:tasks.rados.rados.0.smithi012.stdout:2438: done (3 left) 2024-09-10T18:05:03.750 INFO:tasks.rados.rados.0.smithi012.stdout:2440: done (2 left) 2024-09-10T18:05:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:2441: done (1 left) 2024-09-10T18:05:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:2442: done (0 left) 2024-09-10T18:05:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:2443: rmattr oid 11 current snap is 252 2024-09-10T18:05:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:2443: done (0 left) 2024-09-10T18:05:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:2444: read oid 43 snap -1 2024-09-10T18:05:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:2444: expect (ObjNum 728 snap 237 seq_num 728) 2024-09-10T18:05:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 252 2024-09-10T18:05:03.751 INFO:tasks.rados.rados.0.smithi012.stdout:2445: seq_num 766 ranges {1630208=434176,2064384=401408} 2024-09-10T18:05:03.762 INFO:tasks.rados.rados.0.smithi012.stdout:2445: writing smithi01278544-21 from 1630208 to 2064384 tid 1 2024-09-10T18:05:03.765 INFO:tasks.rados.rados.0.smithi012.stdout:2445: writing smithi01278544-21 from 2064384 to 2465792 tid 2 2024-09-10T18:05:03.765 INFO:tasks.rados.rados.0.smithi012.stdout:2446: delete oid 24 current snap is 252 2024-09-10T18:05:03.767 INFO:tasks.rados.rados.0.smithi012.stdout:2446: done (2 left) 2024-09-10T18:05:03.767 INFO:tasks.rados.rados.0.smithi012.stdout:2447: setattr oid 7 current snap is 252 2024-09-10T18:05:03.771 INFO:tasks.rados.rados.0.smithi012.stdout:2448: read oid 2 snap -1 2024-09-10T18:05:03.771 INFO:tasks.rados.rados.0.smithi012.stdout:2448: expect (ObjNum 721 snap 235 seq_num 721) 2024-09-10T18:05:03.771 INFO:tasks.rados.rados.0.smithi012.stdout:2449: rollback oid 33 current snap is 252 2024-09-10T18:05:03.771 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 33 to 222 2024-09-10T18:05:03.772 INFO:tasks.rados.rados.0.smithi012.stdout:2450: snap_create 2024-09-10T18:05:03.773 INFO:tasks.rados.rados.0.smithi012.stdout:2445: finishing write tid 1 to smithi01278544-21 2024-09-10T18:05:03.777 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1113 (ObjNum 744 snap 241 seq_num 744) dirty exists 2024-09-10T18:05:03.778 INFO:tasks.rados.rados.0.smithi012.stdout:2444: expect (ObjNum 728 snap 237 seq_num 728) 2024-09-10T18:05:04.146 INFO:tasks.rados.rados.0.smithi012.stdout:2445: finishing write tid 2 to smithi01278544-21 2024-09-10T18:05:04.146 INFO:tasks.rados.rados.0.smithi012.stdout:2445: finishing write tid 3 to smithi01278544-21 2024-09-10T18:05:04.146 INFO:tasks.rados.rados.0.smithi012.stdout:2449: finishing rollback tid 1 to smithi01278544-33 2024-09-10T18:05:04.147 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 1691 (ObjNum 4113 snap 0 seq_num 3770126603) dirty dne 2024-09-10T18:05:04.147 INFO:tasks.rados.rados.0.smithi012.stdout:2445: finishing write tid 4 to smithi01278544-21 2024-09-10T18:05:04.147 INFO:tasks.rados.rados.0.smithi012.stdout:2445: oid 21 updating version 0 to 977 2024-09-10T18:05:04.147 INFO:tasks.rados.rados.0.smithi012.stdout:2445: oid 21 updating version 977 to 979 2024-09-10T18:05:04.147 INFO:tasks.rados.rados.0.smithi012.stdout:2445: oid 21 version 979 is already newer than 978 2024-09-10T18:05:04.147 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 979 (ObjNum 766 snap 252 seq_num 766) dirty exists 2024-09-10T18:05:04.147 INFO:tasks.rados.rados.0.smithi012.stdout:2445: left oid 21 (ObjNum 766 snap 252 seq_num 766) 2024-09-10T18:05:04.147 INFO:tasks.rados.rados.0.smithi012.stdout:2448: expect (ObjNum 721 snap 235 seq_num 721) 2024-09-10T18:05:04.201 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:03 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:04.202 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:03 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:04.202 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:03 smithi089 ceph-mon[84132]: pgmap v529: 121 pgs: 121 active+clean; 423 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 997 KiB/s rd, 860 KiB/s wr, 5 op/s 2024-09-10T18:05:04.202 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:03 smithi089 ceph-mon[84132]: osdmap e571: 8 total, 8 up, 8 in 2024-09-10T18:05:04.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:05:03] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.43.0" 2024-09-10T18:05:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:04.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-mon[89611]: pgmap v529: 121 pgs: 121 active+clean; 423 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 997 KiB/s rd, 860 KiB/s wr, 5 op/s 2024-09-10T18:05:04.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-mon[89611]: osdmap e571: 8 total, 8 up, 8 in 2024-09-10T18:05:04.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:04.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:04.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-mon[92029]: pgmap v529: 121 pgs: 121 active+clean; 423 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 997 KiB/s rd, 860 KiB/s wr, 5 op/s 2024-09-10T18:05:04.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:03 smithi012 ceph-mon[92029]: osdmap e571: 8 total, 8 up, 8 in 2024-09-10T18:05:04.746 INFO:tasks.rados.rados.0.smithi012.stdout:2444: done (5 left) 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2445: done (4 left) 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2447: done (3 left) 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2448: done (2 left) 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2449: done (1 left) 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2450: done (0 left) 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2451: copy_from oid 16 from oid 7 current snap is 253 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2452: read oid 14 snap -1 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2452: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 253 2024-09-10T18:05:04.747 INFO:tasks.rados.rados.0.smithi012.stdout:2453: seq_num 768 ranges {0=466944,466944=401408} 2024-09-10T18:05:04.749 INFO:tasks.rados.rados.0.smithi012.stdout:2453: writing smithi01278544-33 from 0 to 466944 tid 1 2024-09-10T18:05:04.751 INFO:tasks.rados.rados.0.smithi012.stdout:2453: writing smithi01278544-33 from 466944 to 868352 tid 2 2024-09-10T18:05:04.751 INFO:tasks.rados.rados.0.smithi012.stdout:2454: delete oid 21 current snap is 253 2024-09-10T18:05:04.755 INFO:tasks.rados.rados.0.smithi012.stdout:2454: done (3 left) 2024-09-10T18:05:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2455: rollback oid 21 current snap is 253 2024-09-10T18:05:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 251 2024-09-10T18:05:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2456: read oid 38 snap -1 2024-09-10T18:05:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2456: expect (ObjNum 738 snap 238 seq_num 738) 2024-09-10T18:05:04.756 INFO:tasks.rados.rados.0.smithi012.stdout:2457: snap_remove snap 244 2024-09-10T18:05:05.026 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:04 smithi089 systemd[1]: Stopping Ceph node-exporter.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:05:05.286 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:05 smithi089 podman[111986]: 2024-09-10 18:05:05.024490248 +0000 UTC m=+0.131207653 container died ba0632e17e74521c6a0d2ed638b5f3b2693fe37d6c13c37a16e67c44f1648520 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:05:05.741 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:05 smithi089 podman[111986]: 2024-09-10 18:05:05.505817543 +0000 UTC m=+0.612534946 container cleanup ba0632e17e74521c6a0d2ed638b5f3b2693fe37d6c13c37a16e67c44f1648520 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:05:05.741 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:05 smithi089 bash[111986]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b 2024-09-10T18:05:05.752 INFO:tasks.rados.rados.0.smithi012.stdout:2457: done (5 left) 2024-09-10T18:05:05.752 INFO:tasks.rados.rados.0.smithi012.stdout:2458: read oid 26 snap -1 2024-09-10T18:05:05.753 INFO:tasks.rados.rados.0.smithi012.stdout:2458: expect (ObjNum 696 snap 225 seq_num 696) 2024-09-10T18:05:05.753 INFO:tasks.rados.rados.0.smithi012.stdout:2459: rmattr oid 48 current snap is 253 2024-09-10T18:05:05.753 INFO:tasks.rados.rados.0.smithi012.stdout:2460: read oid 20 snap -1 2024-09-10T18:05:05.753 INFO:tasks.rados.rados.0.smithi012.stdout:2460: expect (ObjNum 713 snap 232 seq_num 713) 2024-09-10T18:05:05.753 INFO:tasks.rados.rados.0.smithi012.stdout:2461: delete oid 36 current snap is 253 2024-09-10T18:05:05.754 INFO:tasks.rados.rados.0.smithi012.stdout:2455: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:05:05.754 INFO:tasks.rados.rados.0.smithi012.stdout:2455: finishing rollback tid 2 to smithi01278544-21 2024-09-10T18:05:05.754 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 983 (ObjNum 670 snap 218 seq_num 670) dirty exists 2024-09-10T18:05:05.754 INFO:tasks.rados.rados.0.smithi012.stdout:2456: expect (ObjNum 738 snap 238 seq_num 738) 2024-09-10T18:05:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:05 smithi012 ceph-mon[89611]: Upgrade: Updating node-exporter.b (2/2) 2024-09-10T18:05:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:05 smithi012 ceph-mon[89611]: Deploying daemon node-exporter.b on smithi089 2024-09-10T18:05:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:05 smithi012 ceph-mon[89611]: osdmap e572: 8 total, 8 up, 8 in 2024-09-10T18:05:06.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:05 smithi012 ceph-mon[92029]: Upgrade: Updating node-exporter.b (2/2) 2024-09-10T18:05:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:05 smithi012 ceph-mon[92029]: Deploying daemon node-exporter.b on smithi089 2024-09-10T18:05:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:05 smithi012 ceph-mon[92029]: osdmap e572: 8 total, 8 up, 8 in 2024-09-10T18:05:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:05 smithi089 ceph-mon[84132]: Upgrade: Updating node-exporter.b (2/2) 2024-09-10T18:05:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:05 smithi089 ceph-mon[84132]: Deploying daemon node-exporter.b on smithi089 2024-09-10T18:05:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:05 smithi089 ceph-mon[84132]: osdmap e572: 8 total, 8 up, 8 in 2024-09-10T18:05:06.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:05 smithi089 podman[111998]: 2024-09-10 18:05:05.740364249 +0000 UTC m=+0.715236190 container remove ba0632e17e74521c6a0d2ed638b5f3b2693fe37d6c13c37a16e67c44f1648520 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:05:06.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:05 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-10T18:05:06.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:05 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-10T18:05:06.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:05 smithi089 systemd[1]: Stopped Ceph node-exporter.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:05:06.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:05 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.b.service: Consumed 2.652s CPU time. 2024-09-10T18:05:06.045 INFO:tasks.rados.rados.0.smithi012.stdout:2452: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:05:06.536 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:06 smithi089 systemd[1]: Starting Ceph node-exporter.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:05:06.536 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:06 smithi089 bash[112123]: Trying to pull quay.io/prometheus/node-exporter:v1.7.0... 2024-09-10T18:05:06.584 INFO:tasks.rados.rados.0.smithi012.stdout:2453: finishing write tid 1 to smithi01278544-33 2024-09-10T18:05:06.584 INFO:tasks.rados.rados.0.smithi012.stdout:2453: finishing write tid 2 to smithi01278544-33 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2453: finishing write tid 3 to smithi01278544-33 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2453: finishing write tid 4 to smithi01278544-33 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2453: oid 33 updating version 0 to 1711 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2453: oid 33 updating version 1711 to 1712 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2453: oid 33 updating version 1712 to 1713 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 1713 (ObjNum 768 snap 253 seq_num 768) dirty exists 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2453: left oid 33 (ObjNum 768 snap 253 seq_num 768) 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2451: finishing copy_from racing read to smithi01278544-16 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2451: finishing copy_from to smithi01278544-16 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 1113 (ObjNum 744 snap 241 seq_num 744) dirty exists 2024-09-10T18:05:06.585 INFO:tasks.rados.rados.0.smithi012.stdout:2451: done (8 left) 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:2452: done (7 left) 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:2453: done (6 left) 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:2455: done (5 left) 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:2456: done (4 left) 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:2461: done (3 left) 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:2462: rollback oid 40 current snap is 253 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 40 to 246 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:05:06.586 INFO:tasks.rados.rados.0.smithi012.stdout:2460: expect (ObjNum 713 snap 232 seq_num 713) 2024-09-10T18:05:06.777 INFO:tasks.rados.rados.0.smithi012.stdout:2458: expect (ObjNum 696 snap 225 seq_num 696) 2024-09-10T18:05:06.987 INFO:tasks.rados.rados.0.smithi012.stdout:2462: finishing rollback tid 1 to smithi01278544-40 2024-09-10T18:05:06.987 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1637 (ObjNum 0 snap 0 seq_num 304) dirty dne 2024-09-10T18:05:06.987 INFO:tasks.rados.rados.0.smithi012.stdout:2458: done (3 left) 2024-09-10T18:05:06.987 INFO:tasks.rados.rados.0.smithi012.stdout:2459: done (2 left) 2024-09-10T18:05:06.987 INFO:tasks.rados.rados.0.smithi012.stdout:2460: done (1 left) 2024-09-10T18:05:06.987 INFO:tasks.rados.rados.0.smithi012.stdout:2462: done (0 left) 2024-09-10T18:05:06.987 INFO:tasks.rados.rados.0.smithi012.stdout:2463: snap_remove snap 243 2024-09-10T18:05:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:06 smithi012 ceph-mon[89611]: pgmap v532: 121 pgs: 121 active+clean; 424 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 368 KiB/s wr, 6 op/s 2024-09-10T18:05:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:06 smithi012 ceph-mon[89611]: osdmap e573: 8 total, 8 up, 8 in 2024-09-10T18:05:07.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:06 smithi012 ceph-mon[92029]: pgmap v532: 121 pgs: 121 active+clean; 424 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 368 KiB/s wr, 6 op/s 2024-09-10T18:05:07.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:06 smithi012 ceph-mon[92029]: osdmap e573: 8 total, 8 up, 8 in 2024-09-10T18:05:07.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:06 smithi089 ceph-mon[84132]: pgmap v532: 121 pgs: 121 active+clean; 424 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 368 KiB/s wr, 6 op/s 2024-09-10T18:05:07.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:06 smithi089 ceph-mon[84132]: osdmap e573: 8 total, 8 up, 8 in 2024-09-10T18:05:07.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:06 smithi089 bash[112123]: Getting image source signatures 2024-09-10T18:05:07.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:06 smithi089 bash[112123]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-09-10T18:05:07.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:06 smithi089 bash[112123]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-09-10T18:05:07.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:06 smithi089 bash[112123]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-09-10T18:05:07.750 INFO:tasks.rados.rados.0.smithi012.stdout:2463: done (0 left) 2024-09-10T18:05:07.750 INFO:tasks.rados.rados.0.smithi012.stdout:2464: copy_from oid 44 from oid 16 current snap is 253 2024-09-10T18:05:07.750 INFO:tasks.rados.rados.0.smithi012.stdout:2465: read oid 35 snap -1 2024-09-10T18:05:07.750 INFO:tasks.rados.rados.0.smithi012.stdout:2465: expect deleted 2024-09-10T18:05:07.750 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 253 2024-09-10T18:05:07.750 INFO:tasks.rados.rados.0.smithi012.stdout:2466: seq_num 771 ranges {0=516096,516096=401408} 2024-09-10T18:05:07.751 INFO:tasks.rados.rados.0.smithi012.stdout:2466: writing smithi01278544-41 from 0 to 516096 tid 1 2024-09-10T18:05:07.752 INFO:tasks.rados.rados.0.smithi012.stdout:2466: writing smithi01278544-41 from 516096 to 917504 tid 2 2024-09-10T18:05:07.752 INFO:tasks.rados.rados.0.smithi012.stdout:2467: snap_remove snap 232 2024-09-10T18:05:08.742 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:08 smithi089 bash[112123]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-09-10T18:05:08.742 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:08 smithi089 bash[112123]: Writing manifest to image destination 2024-09-10T18:05:08.759 INFO:tasks.rados.rados.0.smithi012.stdout:2467: done (3 left) 2024-09-10T18:05:08.759 INFO:tasks.rados.rados.0.smithi012.stdout:2468: read oid 14 snap -1 2024-09-10T18:05:08.759 INFO:tasks.rados.rados.0.smithi012.stdout:2468: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:05:08.759 INFO:tasks.rados.rados.0.smithi012.stdout:2469: read oid 30 snap -1 2024-09-10T18:05:08.759 INFO:tasks.rados.rados.0.smithi012.stdout:2469: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:05:08.759 INFO:tasks.rados.rados.0.smithi012.stdout:2470: read oid 26 snap 222 2024-09-10T18:05:08.760 INFO:tasks.rados.rados.0.smithi012.stdout:2470: expect (ObjNum 666 snap 217 seq_num 666) 2024-09-10T18:05:08.760 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 253 2024-09-10T18:05:08.760 INFO:tasks.rados.rados.0.smithi012.stdout:2471: seq_num 772 ranges {4775936=532480,5308416=401408} 2024-09-10T18:05:08.791 INFO:tasks.rados.rados.0.smithi012.stdout:2471: writing smithi01278544-4 from 4775936 to 5308416 tid 1 2024-09-10T18:05:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2471: writing smithi01278544-4 from 5308416 to 5709824 tid 2 2024-09-10T18:05:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2472: snap_create 2024-09-10T18:05:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2466: finishing write tid 1 to smithi01278544-41 2024-09-10T18:05:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2466: finishing write tid 2 to smithi01278544-41 2024-09-10T18:05:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2466: finishing write tid 3 to smithi01278544-41 2024-09-10T18:05:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2466: finishing write tid 4 to smithi01278544-41 2024-09-10T18:05:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2466: oid 41 updating version 0 to 1159 2024-09-10T18:05:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2466: oid 41 updating version 1159 to 1161 2024-09-10T18:05:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2466: oid 41 version 1161 is already newer than 1160 2024-09-10T18:05:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 1161 (ObjNum 771 snap 253 seq_num 771) dirty exists 2024-09-10T18:05:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2466: left oid 41 (ObjNum 771 snap 253 seq_num 771) 2024-09-10T18:05:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2464: finishing copy_from racing read to smithi01278544-44 2024-09-10T18:05:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2464: finishing copy_from to smithi01278544-44 2024-09-10T18:05:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1113 (ObjNum 744 snap 241 seq_num 744) dirty exists 2024-09-10T18:05:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:2471: finishing write tid 1 to smithi01278544-4 2024-09-10T18:05:08.800 INFO:tasks.rados.rados.0.smithi012.stdout:2471: finishing write tid 2 to smithi01278544-4 2024-09-10T18:05:08.800 INFO:tasks.rados.rados.0.smithi012.stdout:2471: finishing write tid 3 to smithi01278544-4 2024-09-10T18:05:08.802 INFO:tasks.rados.rados.0.smithi012.stdout:2471: finishing write tid 4 to smithi01278544-4 2024-09-10T18:05:08.802 INFO:tasks.rados.rados.0.smithi012.stdout:2471: oid 4 updating version 0 to 1173 2024-09-10T18:05:08.802 INFO:tasks.rados.rados.0.smithi012.stdout:2471: oid 4 updating version 1173 to 1174 2024-09-10T18:05:08.802 INFO:tasks.rados.rados.0.smithi012.stdout:2471: oid 4 updating version 1174 to 1175 2024-09-10T18:05:08.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1175 (ObjNum 772 snap 253 seq_num 772) dirty exists 2024-09-10T18:05:08.802 INFO:tasks.rados.rados.0.smithi012.stdout:2471: left oid 4 (ObjNum 772 snap 253 seq_num 772) 2024-09-10T18:05:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:2468: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:05:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:08 smithi012 ceph-mon[89611]: pgmap v534: 121 pgs: 121 active+clean; 436 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 23 op/s 2024-09-10T18:05:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:08 smithi012 ceph-mon[89611]: osdmap e574: 8 total, 8 up, 8 in 2024-09-10T18:05:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:08 smithi012 ceph-mon[92029]: pgmap v534: 121 pgs: 121 active+clean; 436 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 23 op/s 2024-09-10T18:05:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:08 smithi012 ceph-mon[92029]: osdmap e574: 8 total, 8 up, 8 in 2024-09-10T18:05:09.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:08 smithi089 ceph-mon[84132]: pgmap v534: 121 pgs: 121 active+clean; 436 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 2.6 MiB/s wr, 23 op/s 2024-09-10T18:05:09.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:08 smithi089 ceph-mon[84132]: osdmap e574: 8 total, 8 up, 8 in 2024-09-10T18:05:09.036 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:08 smithi089 podman[112123]: 2024-09-10 18:05:08.893725158 +0000 UTC m=+2.688522441 image pull 72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e quay.io/prometheus/node-exporter:v1.7.0 2024-09-10T18:05:09.348 INFO:tasks.rados.rados.0.smithi012.stdout:2470: expect (ObjNum 666 snap 217 seq_num 666) 2024-09-10T18:05:09.403 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 podman[112123]: 2024-09-10 18:05:09.069678576 +0000 UTC m=+2.864475849 container create 3b018abc72f32f152abb33e2b7d91c72f7bcdc9baa03ab0e24af91773b6c2df7 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:05:09.403 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 podman[112123]: 2024-09-10 18:05:09.295137631 +0000 UTC m=+3.089934905 container init 3b018abc72f32f152abb33e2b7d91c72f7bcdc9baa03ab0e24af91773b6c2df7 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:05:09.403 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 podman[112123]: 2024-09-10 18:05:09.297712386 +0000 UTC m=+3.092509669 container start 3b018abc72f32f152abb33e2b7d91c72f7bcdc9baa03ab0e24af91773b6c2df7 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:05:09.403 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.301Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.301Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.301Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.301Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=node_exporter.go:117 level=info collector=arp 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-10T18:05:09.404 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.302Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=edac 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-10T18:05:09.405 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=os 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-10T18:05:09.406 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=stat 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=time 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=uname 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-10T18:05:09.407 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-10T18:05:09.408 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-10T18:05:09.408 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-10T18:05:09.408 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b[112197]: ts=2024-09-10T18:05:09.303Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-10T18:05:09.408 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 bash[112123]: 3b018abc72f32f152abb33e2b7d91c72f7bcdc9baa03ab0e24af91773b6c2df7 2024-09-10T18:05:09.452 INFO:tasks.rados.rados.0.smithi012.stdout:2469: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:05:09.760 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:05:09 smithi089 systemd[1]: Started Ceph node-exporter.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:05:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:09 smithi012 ceph-mon[89611]: osdmap e575: 8 total, 8 up, 8 in 2024-09-10T18:05:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:09 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:09 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:09 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:09 smithi012 ceph-mon[92029]: osdmap e575: 8 total, 8 up, 8 in 2024-09-10T18:05:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:09 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:09 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:09 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-mon[84132]: osdmap e575: 8 total, 8 up, 8 in 2024-09-10T18:05:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:09 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:10 smithi012 ceph-mon[89611]: pgmap v537: 121 pgs: 121 active+clean; 436 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2024-09-10T18:05:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:10 smithi012 ceph-mon[89611]: osdmap e576: 8 total, 8 up, 8 in 2024-09-10T18:05:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:10 smithi012 ceph-mon[92029]: pgmap v537: 121 pgs: 121 active+clean; 436 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2024-09-10T18:05:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:10 smithi012 ceph-mon[92029]: osdmap e576: 8 total, 8 up, 8 in 2024-09-10T18:05:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:10 smithi089 ceph-mon[84132]: pgmap v537: 121 pgs: 121 active+clean; 436 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 2.4 MiB/s wr, 24 op/s 2024-09-10T18:05:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:10 smithi089 ceph-mon[84132]: osdmap e576: 8 total, 8 up, 8 in 2024-09-10T18:05:11.354 INFO:tasks.rados.rados.0.smithi012.stdout:2464: done (7 left) 2024-09-10T18:05:11.354 INFO:tasks.rados.rados.0.smithi012.stdout:2465: done (6 left) 2024-09-10T18:05:11.354 INFO:tasks.rados.rados.0.smithi012.stdout:2466: done (5 left) 2024-09-10T18:05:11.354 INFO:tasks.rados.rados.0.smithi012.stdout:2468: done (4 left) 2024-09-10T18:05:11.354 INFO:tasks.rados.rados.0.smithi012.stdout:2469: done (3 left) 2024-09-10T18:05:11.354 INFO:tasks.rados.rados.0.smithi012.stdout:2470: done (2 left) 2024-09-10T18:05:11.354 INFO:tasks.rados.rados.0.smithi012.stdout:2471: done (1 left) 2024-09-10T18:05:11.355 INFO:tasks.rados.rados.0.smithi012.stdout:2472: done (0 left) 2024-09-10T18:05:11.355 INFO:tasks.rados.rados.0.smithi012.stdout:2473: read oid 5 snap 241 2024-09-10T18:05:11.355 INFO:tasks.rados.rados.0.smithi012.stdout:2473: expect (ObjNum 653 snap 213 seq_num 653) 2024-09-10T18:05:11.355 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 254 2024-09-10T18:05:11.355 INFO:tasks.rados.rados.0.smithi012.stdout:2474: seq_num 773 ranges {6971392=548864,7520256=401408} 2024-09-10T18:05:11.395 INFO:tasks.rados.rados.0.smithi012.stdout:2474: writing smithi01278544-19 from 6971392 to 7520256 tid 1 2024-09-10T18:05:11.397 INFO:tasks.rados.rados.0.smithi012.stdout:2474: writing smithi01278544-19 from 7520256 to 7921664 tid 2 2024-09-10T18:05:11.397 INFO:tasks.rados.rados.0.smithi012.stdout:2475: delete oid 18 current snap is 254 2024-09-10T18:05:11.397 INFO:tasks.rados.rados.0.smithi012.stdout:2473: expect (ObjNum 653 snap 213 seq_num 653) 2024-09-10T18:05:12.007 INFO:tasks.rados.rados.0.smithi012.stdout:2474: finishing write tid 1 to smithi01278544-19 2024-09-10T18:05:12.007 INFO:tasks.rados.rados.0.smithi012.stdout:2474: finishing write tid 2 to smithi01278544-19 2024-09-10T18:05:12.007 INFO:tasks.rados.rados.0.smithi012.stdout:2474: finishing write tid 3 to smithi01278544-19 2024-09-10T18:05:12.007 INFO:tasks.rados.rados.0.smithi012.stdout:2474: finishing write tid 4 to smithi01278544-19 2024-09-10T18:05:12.007 INFO:tasks.rados.rados.0.smithi012.stdout:2474: oid 19 updating version 0 to 993 2024-09-10T18:05:12.007 INFO:tasks.rados.rados.0.smithi012.stdout:2474: oid 19 updating version 993 to 995 2024-09-10T18:05:12.007 INFO:tasks.rados.rados.0.smithi012.stdout:2474: oid 19 version 995 is already newer than 994 2024-09-10T18:05:12.007 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 995 (ObjNum 773 snap 254 seq_num 773) dirty exists 2024-09-10T18:05:12.008 INFO:tasks.rados.rados.0.smithi012.stdout:2474: left oid 19 (ObjNum 773 snap 254 seq_num 773) 2024-09-10T18:05:12.008 INFO:tasks.rados.rados.0.smithi012.stdout:2473: done (2 left) 2024-09-10T18:05:12.008 INFO:tasks.rados.rados.0.smithi012.stdout:2474: done (1 left) 2024-09-10T18:05:12.008 INFO:tasks.rados.rados.0.smithi012.stdout:2475: done (0 left) 2024-09-10T18:05:12.008 INFO:tasks.rados.rados.0.smithi012.stdout:2476: delete oid 41 current snap is 254 2024-09-10T18:05:12.008 INFO:tasks.rados.rados.0.smithi012.stdout:2476: done (0 left) 2024-09-10T18:05:12.009 INFO:tasks.rados.rados.0.smithi012.stdout:2477: read oid 40 snap -1 2024-09-10T18:05:12.009 INFO:tasks.rados.rados.0.smithi012.stdout:2477: expect deleted 2024-09-10T18:05:12.009 INFO:tasks.rados.rados.0.smithi012.stdout:2478: snap_create 2024-09-10T18:05:12.747 INFO:tasks.rados.rados.0.smithi012.stdout:2477: done (1 left) 2024-09-10T18:05:12.747 INFO:tasks.rados.rados.0.smithi012.stdout:2478: done (0 left) 2024-09-10T18:05:12.747 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 255 2024-09-10T18:05:12.748 INFO:tasks.rados.rados.0.smithi012.stdout:2479: seq_num 776 ranges {0=606208,606208=401408} 2024-09-10T18:05:12.753 INFO:tasks.rados.rados.0.smithi012.stdout:2479: writing smithi01278544-35 from 0 to 606208 tid 1 2024-09-10T18:05:12.754 INFO:tasks.rados.rados.0.smithi012.stdout:2479: writing smithi01278544-35 from 606208 to 1007616 tid 2 2024-09-10T18:05:12.754 INFO:tasks.rados.rados.0.smithi012.stdout:2480: snap_create 2024-09-10T18:05:12.758 INFO:tasks.rados.rados.0.smithi012.stdout:2479: finishing write tid 1 to smithi01278544-35 2024-09-10T18:05:12.758 INFO:tasks.rados.rados.0.smithi012.stdout:2479: finishing write tid 2 to smithi01278544-35 2024-09-10T18:05:12.758 INFO:tasks.rados.rados.0.smithi012.stdout:2479: finishing write tid 3 to smithi01278544-35 2024-09-10T18:05:12.760 INFO:tasks.rados.rados.0.smithi012.stdout:2479: finishing write tid 4 to smithi01278544-35 2024-09-10T18:05:12.761 INFO:tasks.rados.rados.0.smithi012.stdout:2479: oid 35 updating version 0 to 1143 2024-09-10T18:05:12.761 INFO:tasks.rados.rados.0.smithi012.stdout:2479: oid 35 updating version 1143 to 1144 2024-09-10T18:05:12.761 INFO:tasks.rados.rados.0.smithi012.stdout:2479: oid 35 updating version 1144 to 1145 2024-09-10T18:05:12.761 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1145 (ObjNum 776 snap 255 seq_num 776) dirty exists 2024-09-10T18:05:12.761 INFO:tasks.rados.rados.0.smithi012.stdout:2479: left oid 35 (ObjNum 776 snap 255 seq_num 776) 2024-09-10T18:05:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:12 smithi012 ceph-mon[89611]: pgmap v539: 121 pgs: 121 active+clean; 438 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2024-09-10T18:05:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:12 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:12 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:12 smithi012 ceph-mon[89611]: osdmap e577: 8 total, 8 up, 8 in 2024-09-10T18:05:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:12 smithi012 ceph-mon[92029]: pgmap v539: 121 pgs: 121 active+clean; 438 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2024-09-10T18:05:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:12 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:12 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:12 smithi012 ceph-mon[92029]: osdmap e577: 8 total, 8 up, 8 in 2024-09-10T18:05:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:12 smithi089 ceph-mon[84132]: pgmap v539: 121 pgs: 121 active+clean; 438 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2024-09-10T18:05:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:12 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:12 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:12 smithi089 ceph-mon[84132]: osdmap e577: 8 total, 8 up, 8 in 2024-09-10T18:05:13.747 INFO:tasks.rados.rados.0.smithi012.stdout:2479: done (1 left) 2024-09-10T18:05:13.748 INFO:tasks.rados.rados.0.smithi012.stdout:2480: done (0 left) 2024-09-10T18:05:13.748 INFO:tasks.rados.rados.0.smithi012.stdout:2481: read oid 2 snap -1 2024-09-10T18:05:13.748 INFO:tasks.rados.rados.0.smithi012.stdout:2481: expect (ObjNum 721 snap 235 seq_num 721) 2024-09-10T18:05:13.748 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 256 2024-09-10T18:05:13.748 INFO:tasks.rados.rados.0.smithi012.stdout:2482: seq_num 777 ranges {0=622592,622592=401408} 2024-09-10T18:05:13.751 INFO:tasks.rados.rados.0.smithi012.stdout:2482: writing smithi01278544-25 from 0 to 622592 tid 1 2024-09-10T18:05:13.753 INFO:tasks.rados.rados.0.smithi012.stdout:2482: writing smithi01278544-25 from 622592 to 1024000 tid 2 2024-09-10T18:05:13.753 INFO:tasks.rados.rados.0.smithi012.stdout:2483: rollback oid 13 current snap is 256 2024-09-10T18:05:13.753 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 13 to 251 2024-09-10T18:05:13.753 INFO:tasks.rados.rados.0.smithi012.stdout:2484: delete oid 32 current snap is 256 2024-09-10T18:05:13.757 INFO:tasks.rados.rados.0.smithi012.stdout:2483: finishing rollback tid 0 to smithi01278544-13 2024-09-10T18:05:13.757 INFO:tasks.rados.rados.0.smithi012.stdout:2481: expect (ObjNum 721 snap 235 seq_num 721) 2024-09-10T18:05:13.845 INFO:tasks.rados.rados.0.smithi012.stdout:2483: finishing rollback tid 1 to smithi01278544-13 2024-09-10T18:05:13.845 INFO:tasks.rados.rados.0.smithi012.stdout:2483: finishing rollback tid 2 to smithi01278544-13 2024-09-10T18:05:13.846 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1181 (ObjNum 754 snap 248 seq_num 754) dirty exists 2024-09-10T18:05:13.846 INFO:tasks.rados.rados.0.smithi012.stdout:2482: finishing write tid 1 to smithi01278544-25 2024-09-10T18:05:13.846 INFO:tasks.rados.rados.0.smithi012.stdout:2482: finishing write tid 2 to smithi01278544-25 2024-09-10T18:05:13.846 INFO:tasks.rados.rados.0.smithi012.stdout:2482: finishing write tid 3 to smithi01278544-25 2024-09-10T18:05:13.846 INFO:tasks.rados.rados.0.smithi012.stdout:2481: done (3 left) 2024-09-10T18:05:13.847 INFO:tasks.rados.rados.0.smithi012.stdout:2483: done (2 left) 2024-09-10T18:05:13.847 INFO:tasks.rados.rados.0.smithi012.stdout:2484: done (1 left) 2024-09-10T18:05:13.847 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 256 2024-09-10T18:05:13.847 INFO:tasks.rados.rados.0.smithi012.stdout:2482: finishing write tid 4 to smithi01278544-25 2024-09-10T18:05:13.847 INFO:tasks.rados.rados.0.smithi012.stdout:2482: oid 25 updating version 0 to 1777 2024-09-10T18:05:13.848 INFO:tasks.rados.rados.0.smithi012.stdout:2482: oid 25 updating version 1777 to 1778 2024-09-10T18:05:13.848 INFO:tasks.rados.rados.0.smithi012.stdout:2482: oid 25 updating version 1778 to 1779 2024-09-10T18:05:13.848 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1779 (ObjNum 777 snap 256 seq_num 777) dirty exists 2024-09-10T18:05:13.848 INFO:tasks.rados.rados.0.smithi012.stdout:2482: left oid 25 (ObjNum 777 snap 256 seq_num 777) 2024-09-10T18:05:13.848 INFO:tasks.rados.rados.0.smithi012.stdout:2485: seq_num 779 ranges {229376=655360,884736=401408} 2024-09-10T18:05:13.849 INFO:tasks.rados.rados.0.smithi012.stdout:2485: writing smithi01278544-31 from 229376 to 884736 tid 1 2024-09-10T18:05:13.852 INFO:tasks.rados.rados.0.smithi012.stdout:2485: writing smithi01278544-31 from 884736 to 1286144 tid 2 2024-09-10T18:05:13.852 INFO:tasks.rados.rados.0.smithi012.stdout:2482: done (1 left) 2024-09-10T18:05:13.852 INFO:tasks.rados.rados.0.smithi012.stdout:2486: delete oid 38 current snap is 256 2024-09-10T18:05:13.855 INFO:tasks.rados.rados.0.smithi012.stdout:2486: done (1 left) 2024-09-10T18:05:13.856 INFO:tasks.rados.rados.0.smithi012.stdout:2487: snap_remove snap 231 2024-09-10T18:05:14.034 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:05:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:05:13] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.43.0" 2024-09-10T18:05:14.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[89611]: pgmap v541: 121 pgs: 121 active+clean; 447 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.0 MiB/s wr, 6 op/s 2024-09-10T18:05:14.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[89611]: osdmap e578: 8 total, 8 up, 8 in 2024-09-10T18:05:14.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.455 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[92029]: pgmap v541: 121 pgs: 121 active+clean; 447 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.0 MiB/s wr, 6 op/s 2024-09-10T18:05:14.455 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.455 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.455 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.455 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.455 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[92029]: osdmap e578: 8 total, 8 up, 8 in 2024-09-10T18:05:14.455 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.455 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.524 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:14 smithi089 ceph-mon[84132]: pgmap v541: 121 pgs: 121 active+clean; 447 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.0 MiB/s wr, 6 op/s 2024-09-10T18:05:14.524 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.524 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.524 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.524 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.524 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:14 smithi089 ceph-mon[84132]: osdmap e578: 8 total, 8 up, 8 in 2024-09-10T18:05:14.524 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.525 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:2485: finishing write tid 1 to smithi01278544-31 2024-09-10T18:05:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:2485: finishing write tid 2 to smithi01278544-31 2024-09-10T18:05:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:2485: finishing write tid 3 to smithi01278544-31 2024-09-10T18:05:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:2485: finishing write tid 4 to smithi01278544-31 2024-09-10T18:05:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:2485: oid 31 updating version 0 to 1185 2024-09-10T18:05:14.835 INFO:tasks.rados.rados.0.smithi012.stdout:2485: oid 31 version 1185 is already newer than 1184 2024-09-10T18:05:14.836 INFO:tasks.rados.rados.0.smithi012.stdout:2485: oid 31 version 1185 is already newer than 1183 2024-09-10T18:05:14.836 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 1185 (ObjNum 779 snap 256 seq_num 779) dirty exists 2024-09-10T18:05:14.836 INFO:tasks.rados.rados.0.smithi012.stdout:2485: left oid 31 (ObjNum 779 snap 256 seq_num 779) 2024-09-10T18:05:14.836 INFO:tasks.rados.rados.0.smithi012.stdout:2485: done (1 left) 2024-09-10T18:05:14.836 INFO:tasks.rados.rados.0.smithi012.stdout:2487: done (0 left) 2024-09-10T18:05:14.836 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 256 2024-09-10T18:05:14.836 INFO:tasks.rados.rados.0.smithi012.stdout:2488: seq_num 781 ranges {0=688128,688128=401408} 2024-09-10T18:05:14.839 INFO:tasks.rados.rados.0.smithi012.stdout:2488: writing smithi01278544-32 from 0 to 688128 tid 1 2024-09-10T18:05:14.843 INFO:tasks.rados.rados.0.smithi012.stdout:2488: writing smithi01278544-32 from 688128 to 1089536 tid 2 2024-09-10T18:05:14.843 INFO:tasks.rados.rados.0.smithi012.stdout:2489: snap_remove snap 253 2024-09-10T18:05:15.839 INFO:tasks.rados.rados.0.smithi012.stdout:2489: done (1 left) 2024-09-10T18:05:15.839 INFO:tasks.rados.rados.0.smithi012.stdout:2490: copy_from oid 8 from oid 42 current snap is 256 2024-09-10T18:05:15.839 INFO:tasks.rados.rados.0.smithi012.stdout:2491: read oid 9 snap 249 2024-09-10T18:05:15.839 INFO:tasks.rados.rados.0.smithi012.stdout:2491: expect (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:05:15.839 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 256 2024-09-10T18:05:15.839 INFO:tasks.rados.rados.0.smithi012.stdout:2492: seq_num 782 ranges {2433024=704512,3137536=401408} 2024-09-10T18:05:15.855 INFO:tasks.rados.rados.0.smithi012.stdout:2492: writing smithi01278544-49 from 2433024 to 3137536 tid 1 2024-09-10T18:05:15.857 INFO:tasks.rados.rados.0.smithi012.stdout:2492: writing smithi01278544-49 from 3137536 to 3538944 tid 2 2024-09-10T18:05:15.857 INFO:tasks.rados.rados.0.smithi012.stdout:2493: snap_remove snap 225 2024-09-10T18:05:16.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:15 smithi089 ceph-mon[84132]: osdmap e579: 8 total, 8 up, 8 in 2024-09-10T18:05:16.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:15 smithi089 ceph-mon[84132]: pgmap v544: 121 pgs: 121 active+clean; 447 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 2.1 MiB/s wr, 6 op/s 2024-09-10T18:05:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:15 smithi012 ceph-mon[89611]: osdmap e579: 8 total, 8 up, 8 in 2024-09-10T18:05:16.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:15 smithi012 ceph-mon[89611]: pgmap v544: 121 pgs: 121 active+clean; 447 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 2.1 MiB/s wr, 6 op/s 2024-09-10T18:05:16.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:15 smithi012 ceph-mon[92029]: osdmap e579: 8 total, 8 up, 8 in 2024-09-10T18:05:16.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:15 smithi012 ceph-mon[92029]: pgmap v544: 121 pgs: 121 active+clean; 447 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 2.1 MiB/s wr, 6 op/s 2024-09-10T18:05:16.842 INFO:tasks.rados.rados.0.smithi012.stdout:2488: finishing write tid 1 to smithi01278544-32 2024-09-10T18:05:16.842 INFO:tasks.rados.rados.0.smithi012.stdout:2488: finishing write tid 2 to smithi01278544-32 2024-09-10T18:05:16.842 INFO:tasks.rados.rados.0.smithi012.stdout:2488: finishing write tid 3 to smithi01278544-32 2024-09-10T18:05:16.842 INFO:tasks.rados.rados.0.smithi012.stdout:2488: finishing write tid 4 to smithi01278544-32 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:2488: oid 32 updating version 0 to 1148 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:2488: oid 32 updating version 1148 to 1149 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:2488: oid 32 version 1149 is already newer than 1147 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1149 (ObjNum 781 snap 256 seq_num 781) dirty exists 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:2488: left oid 32 (ObjNum 781 snap 256 seq_num 781) 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:2490: finishing copy_from to smithi01278544-8 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:2490: got expected ENOENT (src dne) 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:2490: finishing copy_from racing read to smithi01278544-8 2024-09-10T18:05:16.843 INFO:tasks.rados.rados.0.smithi012.stdout:2491: expect (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:05:16.875 INFO:tasks.rados.rados.0.smithi012.stdout:2492: finishing write tid 1 to smithi01278544-49 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2492: finishing write tid 2 to smithi01278544-49 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2492: finishing write tid 3 to smithi01278544-49 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2492: finishing write tid 4 to smithi01278544-49 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2492: oid 49 updating version 0 to 1138 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2492: oid 49 updating version 1138 to 1139 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2492: oid 49 updating version 1139 to 1140 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1140 (ObjNum 782 snap 256 seq_num 782) dirty exists 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2492: left oid 49 (ObjNum 782 snap 256 seq_num 782) 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2488: done (4 left) 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2490: done (3 left) 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2491: done (2 left) 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2492: done (1 left) 2024-09-10T18:05:16.876 INFO:tasks.rados.rados.0.smithi012.stdout:2493: done (0 left) 2024-09-10T18:05:16.877 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 256 2024-09-10T18:05:16.877 INFO:tasks.rados.rados.0.smithi012.stdout:2494: seq_num 783 ranges {8577024=720896,9297920=401408} 2024-09-10T18:05:16.926 INFO:tasks.rados.rados.0.smithi012.stdout:2494: writing smithi01278544-16 from 8577024 to 9297920 tid 1 2024-09-10T18:05:16.928 INFO:tasks.rados.rados.0.smithi012.stdout:2494: writing smithi01278544-16 from 9297920 to 9699328 tid 2 2024-09-10T18:05:16.929 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 256 2024-09-10T18:05:16.929 INFO:tasks.rados.rados.0.smithi012.stdout:2495: seq_num 784 ranges {5709824=737280,6447104=401408} 2024-09-10T18:05:16.964 INFO:tasks.rados.rados.0.smithi012.stdout:2495: writing smithi01278544-4 from 5709824 to 6447104 tid 1 2024-09-10T18:05:16.966 INFO:tasks.rados.rados.0.smithi012.stdout:2495: writing smithi01278544-4 from 6447104 to 6848512 tid 2 2024-09-10T18:05:16.966 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 256 2024-09-10T18:05:16.967 INFO:tasks.rados.rados.0.smithi012.stdout:2494: finishing write tid 1 to smithi01278544-16 2024-09-10T18:05:16.967 INFO:tasks.rados.rados.0.smithi012.stdout:2496: seq_num 785 ranges {1024000=753664,1777664=401408} 2024-09-10T18:05:16.976 INFO:tasks.rados.rados.0.smithi012.stdout:2496: writing smithi01278544-25 from 1024000 to 1777664 tid 1 2024-09-10T18:05:16.979 INFO:tasks.rados.rados.0.smithi012.stdout:2496: writing smithi01278544-25 from 1777664 to 2179072 tid 2 2024-09-10T18:05:16.979 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 256 2024-09-10T18:05:16.979 INFO:tasks.rados.rados.0.smithi012.stdout:2497: seq_num 786 ranges {0=770048,770048=401408} 2024-09-10T18:05:16.983 INFO:tasks.rados.rados.0.smithi012.stdout:2497: writing smithi01278544-48 from 0 to 770048 tid 1 2024-09-10T18:05:16.986 INFO:tasks.rados.rados.0.smithi012.stdout:2497: writing smithi01278544-48 from 770048 to 1171456 tid 2 2024-09-10T18:05:16.986 INFO:tasks.rados.rados.0.smithi012.stdout:2498: rollback oid 30 current snap is 256 2024-09-10T18:05:16.986 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 247 2024-09-10T18:05:16.986 INFO:tasks.rados.rados.0.smithi012.stdout:2494: finishing write tid 2 to smithi01278544-16 2024-09-10T18:05:16.986 INFO:tasks.rados.rados.0.smithi012.stdout:2494: finishing write tid 3 to smithi01278544-16 2024-09-10T18:05:16.986 INFO:tasks.rados.rados.0.smithi012.stdout:2494: finishing write tid 4 to smithi01278544-16 2024-09-10T18:05:16.986 INFO:tasks.rados.rados.0.smithi012.stdout:2494: oid 16 updating version 0 to 1126 2024-09-10T18:05:16.986 INFO:tasks.rados.rados.0.smithi012.stdout:2494: oid 16 version 1126 is already newer than 1125 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2494: oid 16 version 1126 is already newer than 1124 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 1126 (ObjNum 783 snap 256 seq_num 783) dirty exists 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2494: left oid 16 (ObjNum 783 snap 256 seq_num 783) 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2495: finishing write tid 1 to smithi01278544-4 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2495: finishing write tid 2 to smithi01278544-4 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2495: finishing write tid 3 to smithi01278544-4 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2495: finishing write tid 4 to smithi01278544-4 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2495: oid 4 updating version 0 to 1204 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2495: oid 4 updating version 1204 to 1205 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2495: oid 4 version 1205 is already newer than 1203 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1205 (ObjNum 784 snap 256 seq_num 784) dirty exists 2024-09-10T18:05:16.987 INFO:tasks.rados.rados.0.smithi012.stdout:2495: left oid 4 (ObjNum 784 snap 256 seq_num 784) 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: finishing write tid 1 to smithi01278544-25 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: finishing write tid 2 to smithi01278544-25 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: finishing write tid 3 to smithi01278544-25 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: finishing write tid 4 to smithi01278544-25 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: oid 25 updating version 0 to 1794 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: oid 25 updating version 1794 to 1796 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: oid 25 version 1796 is already newer than 1795 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1796 (ObjNum 785 snap 256 seq_num 785) dirty exists 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: left oid 25 (ObjNum 785 snap 256 seq_num 785) 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2494: done (4 left) 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2495: done (3 left) 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2496: done (2 left) 2024-09-10T18:05:16.988 INFO:tasks.rados.rados.0.smithi012.stdout:2499: snap_create 2024-09-10T18:05:16.989 INFO:tasks.rados.rados.0.smithi012.stdout:2497: finishing write tid 1 to smithi01278544-48 2024-09-10T18:05:16.989 INFO:tasks.rados.rados.0.smithi012.stdout:2497: finishing write tid 2 to smithi01278544-48 2024-09-10T18:05:16.989 INFO:tasks.rados.rados.0.smithi012.stdout:2497: finishing write tid 3 to smithi01278544-48 2024-09-10T18:05:16.990 INFO:tasks.rados.rados.0.smithi012.stdout:2497: finishing write tid 4 to smithi01278544-48 2024-09-10T18:05:16.991 INFO:tasks.rados.rados.0.smithi012.stdout:2497: oid 48 updating version 0 to 1572 2024-09-10T18:05:16.991 INFO:tasks.rados.rados.0.smithi012.stdout:2497: oid 48 version 1572 is already newer than 1570 2024-09-10T18:05:16.991 INFO:tasks.rados.rados.0.smithi012.stdout:2497: oid 48 version 1572 is already newer than 1571 2024-09-10T18:05:16.991 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 1572 (ObjNum 786 snap 256 seq_num 786) dirty exists 2024-09-10T18:05:16.991 INFO:tasks.rados.rados.0.smithi012.stdout:2497: left oid 48 (ObjNum 786 snap 256 seq_num 786) 2024-09-10T18:05:16.991 INFO:tasks.rados.rados.0.smithi012.stdout:2498: finishing rollback tid 0 to smithi01278544-30 2024-09-10T18:05:16.991 INFO:tasks.rados.rados.0.smithi012.stdout:2498: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:05:16.991 INFO:tasks.rados.rados.0.smithi012.stdout:2498: finishing rollback tid 2 to smithi01278544-30 2024-09-10T18:05:16.992 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1152 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:05:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:16 smithi012 ceph-mon[89611]: osdmap e580: 8 total, 8 up, 8 in 2024-09-10T18:05:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:16 smithi012 ceph-mon[92029]: osdmap e580: 8 total, 8 up, 8 in 2024-09-10T18:05:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:17.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:16 smithi089 ceph-mon[84132]: osdmap e580: 8 total, 8 up, 8 in 2024-09-10T18:05:17.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:17.746 INFO:tasks.rados.rados.0.smithi012.stdout:2497: done (2 left) 2024-09-10T18:05:17.747 INFO:tasks.rados.rados.0.smithi012.stdout:2498: done (1 left) 2024-09-10T18:05:17.747 INFO:tasks.rados.rados.0.smithi012.stdout:2499: done (0 left) 2024-09-10T18:05:17.747 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 257 2024-09-10T18:05:17.747 INFO:tasks.rados.rados.0.smithi012.stdout:2500: seq_num 787 ranges {0=786432,786432=401408} 2024-09-10T18:05:17.751 INFO:tasks.rados.rados.0.smithi012.stdout:2500: writing smithi01278544-10 from 0 to 786432 tid 1 2024-09-10T18:05:17.754 INFO:tasks.rados.rados.0.smithi012.stdout:2500: writing smithi01278544-10 from 786432 to 1187840 tid 2 2024-09-10T18:05:17.754 INFO:tasks.rados.rados.0.smithi012.stdout:2501: read oid 21 snap -1 2024-09-10T18:05:17.754 INFO:tasks.rados.rados.0.smithi012.stdout:2501: expect (ObjNum 670 snap 218 seq_num 670) 2024-09-10T18:05:17.754 INFO:tasks.rados.rados.0.smithi012.stdout:2502: snap_remove snap 250 2024-09-10T18:05:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: osdmap e581: 8 total, 8 up, 8 in 2024-09-10T18:05:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: pgmap v547: 121 pgs: 121 active+clean; 448 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 740 KiB/s wr, 6 op/s 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:17 smithi089 ceph-mon[84132]: osdmap e582: 8 total, 8 up, 8 in 2024-09-10T18:05:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: osdmap e581: 8 total, 8 up, 8 in 2024-09-10T18:05:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:05:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:05:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: pgmap v547: 121 pgs: 121 active+clean; 448 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 740 KiB/s wr, 6 op/s 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[89611]: osdmap e582: 8 total, 8 up, 8 in 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: osdmap e581: 8 total, 8 up, 8 in 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: pgmap v547: 121 pgs: 121 active+clean; 448 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 740 KiB/s wr, 6 op/s 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:18.289 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:17 smithi012 ceph-mon[92029]: osdmap e582: 8 total, 8 up, 8 in 2024-09-10T18:05:18.752 INFO:tasks.rados.rados.0.smithi012.stdout:2502: done (2 left) 2024-09-10T18:05:18.752 INFO:tasks.rados.rados.0.smithi012.stdout:2503: read oid 23 snap -1 2024-09-10T18:05:18.752 INFO:tasks.rados.rados.0.smithi012.stdout:2503: expect deleted 2024-09-10T18:05:18.752 INFO:tasks.rados.rados.0.smithi012.stdout:2504: snap_create 2024-09-10T18:05:18.752 INFO:tasks.rados.rados.0.smithi012.stdout:2500: finishing write tid 1 to smithi01278544-10 2024-09-10T18:05:18.752 INFO:tasks.rados.rados.0.smithi012.stdout:2500: finishing write tid 2 to smithi01278544-10 2024-09-10T18:05:18.752 INFO:tasks.rados.rados.0.smithi012.stdout:2500: finishing write tid 3 to smithi01278544-10 2024-09-10T18:05:18.753 INFO:tasks.rados.rados.0.smithi012.stdout:2501: expect (ObjNum 670 snap 218 seq_num 670) 2024-09-10T18:05:18.800 INFO:tasks.rados.rados.0.smithi012.stdout:2500: finishing write tid 4 to smithi01278544-10 2024-09-10T18:05:18.800 INFO:tasks.rados.rados.0.smithi012.stdout:2500: oid 10 updating version 0 to 1799 2024-09-10T18:05:18.800 INFO:tasks.rados.rados.0.smithi012.stdout:2500: oid 10 version 1799 is already newer than 1798 2024-09-10T18:05:18.800 INFO:tasks.rados.rados.0.smithi012.stdout:2500: oid 10 updating version 1799 to 1800 2024-09-10T18:05:18.800 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1800 (ObjNum 787 snap 257 seq_num 787) dirty exists 2024-09-10T18:05:18.800 INFO:tasks.rados.rados.0.smithi012.stdout:2500: left oid 10 (ObjNum 787 snap 257 seq_num 787) 2024-09-10T18:05:19.760 INFO:tasks.rados.rados.0.smithi012.stdout:2500: done (3 left) 2024-09-10T18:05:19.760 INFO:tasks.rados.rados.0.smithi012.stdout:2501: done (2 left) 2024-09-10T18:05:19.760 INFO:tasks.rados.rados.0.smithi012.stdout:2503: done (1 left) 2024-09-10T18:05:19.761 INFO:tasks.rados.rados.0.smithi012.stdout:2504: done (0 left) 2024-09-10T18:05:19.761 INFO:tasks.rados.rados.0.smithi012.stdout:2505: rollback oid 30 current snap is 258 2024-09-10T18:05:19.761 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 247 2024-09-10T18:05:19.761 INFO:tasks.rados.rados.0.smithi012.stdout:2506: delete oid 21 current snap is 258 2024-09-10T18:05:19.765 INFO:tasks.rados.rados.0.smithi012.stdout:2506: done (1 left) 2024-09-10T18:05:19.765 INFO:tasks.rados.rados.0.smithi012.stdout:2507: snap_create 2024-09-10T18:05:19.767 INFO:tasks.rados.rados.0.smithi012.stdout:2505: finishing rollback tid 0 to smithi01278544-30 2024-09-10T18:05:19.768 INFO:tasks.rados.rados.0.smithi012.stdout:2505: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:05:19.769 INFO:tasks.rados.rados.0.smithi012.stdout:2505: finishing rollback tid 2 to smithi01278544-30 2024-09-10T18:05:19.769 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1155 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:05:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:19 smithi012 ceph-mon[89611]: Upgrade: Updating prometheus.a 2024-09-10T18:05:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:19 smithi012 ceph-mon[89611]: Deploying daemon prometheus.a on smithi089 2024-09-10T18:05:20.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:19 smithi012 ceph-mon[89611]: osdmap e583: 8 total, 8 up, 8 in 2024-09-10T18:05:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:19 smithi012 ceph-mon[92029]: Upgrade: Updating prometheus.a 2024-09-10T18:05:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:19 smithi012 ceph-mon[92029]: Deploying daemon prometheus.a on smithi089 2024-09-10T18:05:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:19 smithi012 ceph-mon[92029]: osdmap e583: 8 total, 8 up, 8 in 2024-09-10T18:05:20.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:19 smithi089 ceph-mon[84132]: Upgrade: Updating prometheus.a 2024-09-10T18:05:20.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:19 smithi089 ceph-mon[84132]: Deploying daemon prometheus.a on smithi089 2024-09-10T18:05:20.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:19 smithi089 ceph-mon[84132]: osdmap e583: 8 total, 8 up, 8 in 2024-09-10T18:05:20.763 INFO:tasks.rados.rados.0.smithi012.stdout:2505: done (1 left) 2024-09-10T18:05:20.763 INFO:tasks.rados.rados.0.smithi012.stdout:2507: done (0 left) 2024-09-10T18:05:20.763 INFO:tasks.rados.rados.0.smithi012.stdout:2508: snap_create 2024-09-10T18:05:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:20 smithi012 ceph-mon[89611]: pgmap v550: 121 pgs: 121 active+clean; 450 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 585 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-10T18:05:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:20 smithi012 ceph-mon[89611]: osdmap e584: 8 total, 8 up, 8 in 2024-09-10T18:05:21.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:20 smithi012 ceph-mon[92029]: pgmap v550: 121 pgs: 121 active+clean; 450 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 585 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-10T18:05:21.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:20 smithi012 ceph-mon[92029]: osdmap e584: 8 total, 8 up, 8 in 2024-09-10T18:05:21.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:20 smithi089 ceph-mon[84132]: pgmap v550: 121 pgs: 121 active+clean; 450 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 585 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-10T18:05:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:20 smithi089 ceph-mon[84132]: osdmap e584: 8 total, 8 up, 8 in 2024-09-10T18:05:21.769 INFO:tasks.rados.rados.0.smithi012.stdout:2508: done (0 left) 2024-09-10T18:05:21.769 INFO:tasks.rados.rados.0.smithi012.stdout:2509: delete oid 36 current snap is 260 2024-09-10T18:05:21.770 INFO:tasks.rados.rados.0.smithi012.stdout:2509: done (0 left) 2024-09-10T18:05:21.770 INFO:tasks.rados.rados.0.smithi012.stdout:2510: delete oid 1 current snap is 260 2024-09-10T18:05:21.775 INFO:tasks.rados.rados.0.smithi012.stdout:2510: done (0 left) 2024-09-10T18:05:21.775 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 260 2024-09-10T18:05:21.775 INFO:tasks.rados.rados.0.smithi012.stdout:2511: seq_num 791 ranges {0=450560,450560=475136,925696=327680} 2024-09-10T18:05:21.777 INFO:tasks.rados.rados.0.smithi012.stdout:2511: writing smithi01278544-21 from 0 to 450560 tid 1 2024-09-10T18:05:21.780 INFO:tasks.rados.rados.0.smithi012.stdout:2511: writing smithi01278544-21 from 450560 to 925696 tid 2 2024-09-10T18:05:21.782 INFO:tasks.rados.rados.0.smithi012.stdout:2511: writing smithi01278544-21 from 925696 to 1253376 tid 3 2024-09-10T18:05:21.782 INFO:tasks.rados.rados.0.smithi012.stdout:2512: copy_from oid 19 from oid 49 current snap is 260 2024-09-10T18:05:21.782 INFO:tasks.rados.rados.0.smithi012.stdout:2511: finishing write tid 1 to smithi01278544-21 2024-09-10T18:05:21.782 INFO:tasks.rados.rados.0.smithi012.stdout:2513: read oid 9 snap -1 2024-09-10T18:05:21.783 INFO:tasks.rados.rados.0.smithi012.stdout:2513: expect (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:05:21.783 INFO:tasks.rados.rados.0.smithi012.stdout:2514: snap_remove snap 252 2024-09-10T18:05:22.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:21 smithi012 ceph-mon[89611]: osdmap e585: 8 total, 8 up, 8 in 2024-09-10T18:05:22.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:21 smithi012 ceph-mon[92029]: osdmap e585: 8 total, 8 up, 8 in 2024-09-10T18:05:22.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:21 smithi089 ceph-mon[84132]: osdmap e585: 8 total, 8 up, 8 in 2024-09-10T18:05:22.752 INFO:tasks.rados.rados.0.smithi012.stdout:2514: done (3 left) 2024-09-10T18:05:22.752 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 260 2024-09-10T18:05:22.752 INFO:tasks.rados.rados.0.smithi012.stdout:2515: seq_num 792 ranges {1884160=466944,2351104=761856,3112960=40960} 2024-09-10T18:05:22.766 INFO:tasks.rados.rados.0.smithi012.stdout:2515: writing smithi01278544-45 from 1884160 to 2351104 tid 1 2024-09-10T18:05:22.770 INFO:tasks.rados.rados.0.smithi012.stdout:2515: writing smithi01278544-45 from 2351104 to 3112960 tid 2 2024-09-10T18:05:22.771 INFO:tasks.rados.rados.0.smithi012.stdout:2515: writing smithi01278544-45 from 3112960 to 3153920 tid 3 2024-09-10T18:05:22.771 INFO:tasks.rados.rados.0.smithi012.stdout:2516: snap_remove snap 258 2024-09-10T18:05:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:22 smithi012 ceph-mon[89611]: pgmap v553: 121 pgs: 121 active+clean; 451 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 585 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-09-10T18:05:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:22 smithi012 ceph-mon[89611]: osdmap e586: 8 total, 8 up, 8 in 2024-09-10T18:05:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:22 smithi012 ceph-mon[89611]: osdmap e587: 8 total, 8 up, 8 in 2024-09-10T18:05:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:22 smithi012 ceph-mon[92029]: pgmap v553: 121 pgs: 121 active+clean; 451 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 585 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-09-10T18:05:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:22 smithi012 ceph-mon[92029]: osdmap e586: 8 total, 8 up, 8 in 2024-09-10T18:05:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:22 smithi012 ceph-mon[92029]: osdmap e587: 8 total, 8 up, 8 in 2024-09-10T18:05:23.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:22 smithi089 ceph-mon[84132]: pgmap v553: 121 pgs: 121 active+clean; 451 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 585 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-09-10T18:05:23.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:22 smithi089 ceph-mon[84132]: osdmap e586: 8 total, 8 up, 8 in 2024-09-10T18:05:23.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:22 smithi089 ceph-mon[84132]: osdmap e587: 8 total, 8 up, 8 in 2024-09-10T18:05:23.779 INFO:tasks.rados.rados.0.smithi012.stdout:2516: done (4 left) 2024-09-10T18:05:23.780 INFO:tasks.rados.rados.0.smithi012.stdout:2517: snap_remove snap 236 2024-09-10T18:05:24.284 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:05:23 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:05:23] "GET /metrics HTTP/1.1" 200 36357 "" "Prometheus/2.43.0" 2024-09-10T18:05:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2517: done (4 left) 2024-09-10T18:05:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2518: read oid 29 snap 242 2024-09-10T18:05:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2518: expect (ObjNum 676 snap 220 seq_num 676) 2024-09-10T18:05:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2519: snap_create 2024-09-10T18:05:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2511: finishing write tid 2 to smithi01278544-21 2024-09-10T18:05:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2511: finishing write tid 3 to smithi01278544-21 2024-09-10T18:05:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2511: finishing write tid 4 to smithi01278544-21 2024-09-10T18:05:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2513: expect (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:05:24.816 INFO:tasks.rados.rados.0.smithi012.stdout:2511: finishing write tid 5 to smithi01278544-21 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2511: oid 21 updating version 0 to 1013 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2511: oid 21 updating version 1013 to 1015 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2511: oid 21 version 1015 is already newer than 1014 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2511: oid 21 version 1015 is already newer than 1012 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 1015 (ObjNum 791 snap 260 seq_num 791) dirty exists 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2511: left oid 21 (ObjNum 791 snap 260 seq_num 791) 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2512: finishing copy_from racing read to smithi01278544-19 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2512: finishing copy_from to smithi01278544-19 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1140 (ObjNum 782 snap 256 seq_num 782) dirty exists 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2515: finishing write tid 1 to smithi01278544-45 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2515: finishing write tid 2 to smithi01278544-45 2024-09-10T18:05:24.817 INFO:tasks.rados.rados.0.smithi012.stdout:2515: finishing write tid 3 to smithi01278544-45 2024-09-10T18:05:24.818 INFO:tasks.rados.rados.0.smithi012.stdout:2515: finishing write tid 4 to smithi01278544-45 2024-09-10T18:05:24.818 INFO:tasks.rados.rados.0.smithi012.stdout:2515: finishing write tid 5 to smithi01278544-45 2024-09-10T18:05:24.818 INFO:tasks.rados.rados.0.smithi012.stdout:2515: oid 45 updating version 0 to 1766 2024-09-10T18:05:24.818 INFO:tasks.rados.rados.0.smithi012.stdout:2515: oid 45 version 1766 is already newer than 1765 2024-09-10T18:05:24.818 INFO:tasks.rados.rados.0.smithi012.stdout:2515: oid 45 version 1766 is already newer than 1764 2024-09-10T18:05:24.818 INFO:tasks.rados.rados.0.smithi012.stdout:2515: oid 45 updating version 1766 to 1767 2024-09-10T18:05:24.818 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1767 (ObjNum 792 snap 260 seq_num 792) dirty exists 2024-09-10T18:05:24.818 INFO:tasks.rados.rados.0.smithi012.stdout:2515: left oid 45 (ObjNum 792 snap 260 seq_num 792) 2024-09-10T18:05:24.832 INFO:tasks.rados.rados.0.smithi012.stdout:2518: expect (ObjNum 676 snap 220 seq_num 676) 2024-09-10T18:05:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:24 smithi089 ceph-mon[84132]: pgmap v556: 121 pgs: 121 active+clean; 444 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-09-10T18:05:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:24 smithi089 ceph-mon[84132]: osdmap e588: 8 total, 8 up, 8 in 2024-09-10T18:05:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:24 smithi012 ceph-mon[89611]: pgmap v556: 121 pgs: 121 active+clean; 444 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-09-10T18:05:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:24 smithi012 ceph-mon[89611]: osdmap e588: 8 total, 8 up, 8 in 2024-09-10T18:05:25.284 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:05:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:05:24.825+0000 7f1ca137b640 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 130 after trimming was started 2024-09-10T18:05:25.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:24 smithi012 ceph-mon[92029]: pgmap v556: 121 pgs: 121 active+clean; 444 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-09-10T18:05:25.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:24 smithi012 ceph-mon[92029]: osdmap e588: 8 total, 8 up, 8 in 2024-09-10T18:05:25.780 INFO:tasks.rados.rados.0.smithi012.stdout:2511: done (5 left) 2024-09-10T18:05:25.780 INFO:tasks.rados.rados.0.smithi012.stdout:2512: done (4 left) 2024-09-10T18:05:25.780 INFO:tasks.rados.rados.0.smithi012.stdout:2513: done (3 left) 2024-09-10T18:05:25.780 INFO:tasks.rados.rados.0.smithi012.stdout:2515: done (2 left) 2024-09-10T18:05:25.780 INFO:tasks.rados.rados.0.smithi012.stdout:2518: done (1 left) 2024-09-10T18:05:25.780 INFO:tasks.rados.rados.0.smithi012.stdout:2519: done (0 left) 2024-09-10T18:05:25.780 INFO:tasks.rados.rados.0.smithi012.stdout:2520: setattr oid 44 current snap is 261 2024-09-10T18:05:25.782 INFO:tasks.rados.rados.0.smithi012.stdout:2521: rollback oid 17 current snap is 261 2024-09-10T18:05:25.782 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 17 to 256 2024-09-10T18:05:25.782 INFO:tasks.rados.rados.0.smithi012.stdout:2522: snap_remove snap 257 2024-09-10T18:05:26.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:25 smithi089 ceph-mon[84132]: osdmap e589: 8 total, 8 up, 8 in 2024-09-10T18:05:26.052 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:25 smithi089 ceph-mon[84132]: osdmap e590: 8 total, 8 up, 8 in 2024-09-10T18:05:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:25 smithi012 ceph-mon[89611]: osdmap e589: 8 total, 8 up, 8 in 2024-09-10T18:05:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:25 smithi012 ceph-mon[89611]: osdmap e590: 8 total, 8 up, 8 in 2024-09-10T18:05:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:25 smithi012 ceph-mon[92029]: osdmap e589: 8 total, 8 up, 8 in 2024-09-10T18:05:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:25 smithi012 ceph-mon[92029]: osdmap e590: 8 total, 8 up, 8 in 2024-09-10T18:05:26.783 INFO:tasks.rados.rados.0.smithi012.stdout:2522: done (2 left) 2024-09-10T18:05:26.783 INFO:tasks.rados.rados.0.smithi012.stdout:2523: delete oid 48 current snap is 261 2024-09-10T18:05:26.783 INFO:tasks.rados.rados.0.smithi012.stdout:2521: finishing rollback tid 1 to smithi01278544-17 2024-09-10T18:05:26.784 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 893 (ObjNum 1025 snap 0 seq_num 3200229584) dirty dne 2024-09-10T18:05:26.784 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1281 (ObjNum 744 snap 241 seq_num 744) dirty exists 2024-09-10T18:05:26.790 INFO:tasks.rados.rados.0.smithi012.stdout:2520: done (2 left) 2024-09-10T18:05:26.790 INFO:tasks.rados.rados.0.smithi012.stdout:2521: done (1 left) 2024-09-10T18:05:26.790 INFO:tasks.rados.rados.0.smithi012.stdout:2523: done (0 left) 2024-09-10T18:05:26.790 INFO:tasks.rados.rados.0.smithi012.stdout:2524: setattr oid 14 current snap is 261 2024-09-10T18:05:26.792 INFO:tasks.rados.rados.0.smithi012.stdout:2525: snap_remove snap 248 2024-09-10T18:05:27.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:26 smithi089 ceph-mon[84132]: pgmap v559: 121 pgs: 121 active+clean; 444 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 846 KiB/s wr, 5 op/s 2024-09-10T18:05:27.119 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:26 smithi089 ceph-mon[84132]: osdmap e591: 8 total, 8 up, 8 in 2024-09-10T18:05:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:26 smithi012 ceph-mon[89611]: pgmap v559: 121 pgs: 121 active+clean; 444 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 846 KiB/s wr, 5 op/s 2024-09-10T18:05:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:26 smithi012 ceph-mon[89611]: osdmap e591: 8 total, 8 up, 8 in 2024-09-10T18:05:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:26 smithi012 ceph-mon[92029]: pgmap v559: 121 pgs: 121 active+clean; 444 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 846 KiB/s wr, 5 op/s 2024-09-10T18:05:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:26 smithi012 ceph-mon[92029]: osdmap e591: 8 total, 8 up, 8 in 2024-09-10T18:05:27.375 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:05:27.757 INFO:tasks.rados.rados.0.smithi012.stdout:2525: done (1 left) 2024-09-10T18:05:27.757 INFO:tasks.rados.rados.0.smithi012.stdout:2526: rollback oid 37 current snap is 261 2024-09-10T18:05:27.757 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 37 to 241 2024-09-10T18:05:27.758 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1783 (ObjNum 545 snap 183 seq_num 545) dirty exists 2024-09-10T18:05:27.758 INFO:tasks.rados.rados.0.smithi012.stdout:2524: done (1 left) 2024-09-10T18:05:27.758 INFO:tasks.rados.rados.0.smithi012.stdout:2527: snap_remove snap 260 2024-09-10T18:05:27.982 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:05:27.982 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (10m) 15s ago 11m 27.7M - 0.25.0 c8568f914cd2 24404959babd 2024-09-10T18:05:27.982 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (11m) 14s ago 11m 90.4M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:05:27.982 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (57s) 15s ago 13m 14.6M - 19.3.0-4858-gbad1f558 542e6e6af07c 34b133ecae8a 2024-09-10T18:05:27.982 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (39s) 14s ago 13m 12.5M - 19.3.0-4858-gbad1f558 542e6e6af07c fd9833aea5e4 2024-09-10T18:05:27.982 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (6m) 14s ago 16m 456M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:05:27.982 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (7m) 15s ago 18m 531M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (6m) 15s ago 18m 68.8M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (5m) 14s ago 16m 53.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (6m) 15s ago 16m 57.9M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (25s) 15s ago 11m 7944k - 1.7.0 72c9c2088986 bb42e60bc4f1 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (19s) 14s ago 10m 3686k - 1.7.0 72c9c2088986 3b018abc72f3 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (5m) 15s ago 16m 359M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (4m) 15s ago 15m 236M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (4m) 15s ago 15m 226M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (3m) 15s ago 14m 166M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (2m) 14s ago 14m 299M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 75e9a99555f3 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (2m) 14s ago 14m 230M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 28c479f4ad60 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (108s) 14s ago 13m 156M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 71e430ee4ba6 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (74s) 14s ago 13m 81.8M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 1b26f245f7dc 2024-09-10T18:05:27.983 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (6m) 14s ago 11m 61.2M - 2.43.0 a07b618ecd1d 023c2089aef0 2024-09-10T18:05:28.335 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:05:28.335 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:05:28.335 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:05:28.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:05:28.335 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 8 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 15 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:05:28.336 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "mds", 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "mon", 2024-09-10T18:05:28.637 INFO:teuthology.orchestra.run.smithi012.stdout: "osd" 2024-09-10T18:05:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:05:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "15/20 daemons upgraded", 2024-09-10T18:05:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-10T18:05:28.638 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:05:28.638 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:05:28.756 INFO:tasks.rados.rados.0.smithi012.stdout:2527: done (1 left) 2024-09-10T18:05:28.756 INFO:tasks.rados.rados.0.smithi012.stdout:2528: copy_from oid 41 from oid 7 current snap is 261 2024-09-10T18:05:28.756 INFO:tasks.rados.rados.0.smithi012.stdout:2526: finishing rollback tid 0 to smithi01278544-37 2024-09-10T18:05:28.756 INFO:tasks.rados.rados.0.smithi012.stdout:2526: finishing rollback tid 1 to smithi01278544-37 2024-09-10T18:05:28.756 INFO:tasks.rados.rados.0.smithi012.stdout:2526: finishing rollback tid 2 to smithi01278544-37 2024-09-10T18:05:28.757 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 1233 (ObjNum 540 snap 182 seq_num 540) dirty exists 2024-09-10T18:05:28.757 INFO:tasks.rados.rados.0.smithi012.stdout:2526: done (1 left) 2024-09-10T18:05:28.757 INFO:tasks.rados.rados.0.smithi012.stdout:2529: read oid 14 snap -1 2024-09-10T18:05:28.757 INFO:tasks.rados.rados.0.smithi012.stdout:2529: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:05:28.757 INFO:tasks.rados.rados.0.smithi012.stdout:2530: delete oid 1 current snap is 261 2024-09-10T18:05:28.765 INFO:tasks.rados.rados.0.smithi012.stdout:2530: done (2 left) 2024-09-10T18:05:28.765 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 261 2024-09-10T18:05:28.765 INFO:tasks.rados.rados.0.smithi012.stdout:2531: seq_num 795 ranges {0=524288,524288=417792,942080=385024} 2024-09-10T18:05:28.768 INFO:tasks.rados.rados.0.smithi012.stdout:2531: writing smithi01278544-28 from 0 to 524288 tid 1 2024-09-10T18:05:28.771 INFO:tasks.rados.rados.0.smithi012.stdout:2531: writing smithi01278544-28 from 524288 to 942080 tid 2 2024-09-10T18:05:28.774 INFO:tasks.rados.rados.0.smithi012.stdout:2531: writing smithi01278544-28 from 942080 to 1327104 tid 3 2024-09-10T18:05:28.774 INFO:tasks.rados.rados.0.smithi012.stdout:2532: rollback oid 11 current snap is 261 2024-09-10T18:05:28.774 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 256 2024-09-10T18:05:28.774 INFO:tasks.rados.rados.0.smithi012.stdout:2533: snap_create 2024-09-10T18:05:28.775 INFO:tasks.rados.rados.0.smithi012.stdout:2531: finishing write tid 1 to smithi01278544-28 2024-09-10T18:05:28.775 INFO:tasks.rados.rados.0.smithi012.stdout:2531: finishing write tid 2 to smithi01278544-28 2024-09-10T18:05:28.777 INFO:tasks.rados.rados.0.smithi012.stdout:2531: finishing write tid 3 to smithi01278544-28 2024-09-10T18:05:28.778 INFO:tasks.rados.rados.0.smithi012.stdout:2531: finishing write tid 4 to smithi01278544-28 2024-09-10T18:05:28.779 INFO:tasks.rados.rados.0.smithi012.stdout:2532: finishing rollback tid 0 to smithi01278544-11 2024-09-10T18:05:28.780 INFO:tasks.rados.rados.0.smithi012.stdout:2532: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:05:28.782 INFO:tasks.rados.rados.0.smithi012.stdout:2532: finishing rollback tid 2 to smithi01278544-11 2024-09-10T18:05:28.782 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1816 (ObjNum 717 snap 233 seq_num 717) dirty exists 2024-09-10T18:05:28.783 INFO:tasks.rados.rados.0.smithi012.stdout:2531: finishing write tid 5 to smithi01278544-28 2024-09-10T18:05:28.784 INFO:tasks.rados.rados.0.smithi012.stdout:2531: oid 28 updating version 0 to 1294 2024-09-10T18:05:28.784 INFO:tasks.rados.rados.0.smithi012.stdout:2531: oid 28 updating version 1294 to 1295 2024-09-10T18:05:28.784 INFO:tasks.rados.rados.0.smithi012.stdout:2531: oid 28 updating version 1295 to 1297 2024-09-10T18:05:28.784 INFO:tasks.rados.rados.0.smithi012.stdout:2531: oid 28 version 1297 is already newer than 1296 2024-09-10T18:05:28.784 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1297 (ObjNum 795 snap 261 seq_num 795) dirty exists 2024-09-10T18:05:28.784 INFO:tasks.rados.rados.0.smithi012.stdout:2531: left oid 28 (ObjNum 795 snap 261 seq_num 795) 2024-09-10T18:05:28.792 INFO:tasks.rados.rados.0.smithi012.stdout:2529: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:05:28.958 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:28 smithi089 ceph-mon[84132]: pgmap v562: 121 pgs: 121 active+clean; 449 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-09-10T18:05:28.958 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:28 smithi089 ceph-mon[84132]: from='client.44483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:28.958 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:28 smithi089 ceph-mon[84132]: from='client.34581 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:28.958 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:28 smithi089 ceph-mon[84132]: osdmap e592: 8 total, 8 up, 8 in 2024-09-10T18:05:28.958 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:28 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2847818800' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[89611]: pgmap v562: 121 pgs: 121 active+clean; 449 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-09-10T18:05:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[89611]: from='client.44483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[89611]: from='client.34581 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[89611]: osdmap e592: 8 total, 8 up, 8 in 2024-09-10T18:05:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2847818800' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[92029]: pgmap v562: 121 pgs: 121 active+clean; 449 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 6.3 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-09-10T18:05:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[92029]: from='client.44483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[92029]: from='client.34581 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[92029]: osdmap e592: 8 total, 8 up, 8 in 2024-09-10T18:05:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:28 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2847818800' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:29.217 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:28 smithi089 systemd[1]: Stopping Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:05:29.337 INFO:tasks.rados.rados.0.smithi012.stdout:2528: finishing copy_from racing read to smithi01278544-41 2024-09-10T18:05:29.337 INFO:tasks.rados.rados.0.smithi012.stdout:2528: finishing copy_from to smithi01278544-41 2024-09-10T18:05:29.337 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 1113 (ObjNum 744 snap 241 seq_num 744) dirty exists 2024-09-10T18:05:29.476 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.216Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.217Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.217Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[75346]: ts=2024-09-10T18:05:29.217Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-10T18:05:29.477 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 podman[116359]: 2024-09-10 18:05:29.226443763 +0000 UTC m=+0.125568974 container died 023c2089aef02417d4888cb976c51afb74393361f219a7b4970376d3890c43a1 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:29.757 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 podman[116359]: 2024-09-10 18:05:29.582875845 +0000 UTC m=+0.482001050 container cleanup 023c2089aef02417d4888cb976c51afb74393361f219a7b4970376d3890c43a1 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:29.757 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 bash[116359]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a 2024-09-10T18:05:29.761 INFO:tasks.rados.rados.0.smithi012.stdout:2528: done (4 left) 2024-09-10T18:05:29.761 INFO:tasks.rados.rados.0.smithi012.stdout:2529: done (3 left) 2024-09-10T18:05:29.761 INFO:tasks.rados.rados.0.smithi012.stdout:2531: done (2 left) 2024-09-10T18:05:29.761 INFO:tasks.rados.rados.0.smithi012.stdout:2532: done (1 left) 2024-09-10T18:05:29.761 INFO:tasks.rados.rados.0.smithi012.stdout:2533: done (0 left) 2024-09-10T18:05:29.761 INFO:tasks.rados.rados.0.smithi012.stdout:2534: snap_remove snap 255 2024-09-10T18:05:30.007 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-mon[84132]: from='client.44492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:30.008 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-mon[84132]: from='client.44504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:30.008 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:29 smithi089 ceph-mon[84132]: osdmap e593: 8 total, 8 up, 8 in 2024-09-10T18:05:30.008 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:29 smithi089 podman[116374]: 2024-09-10 18:05:29.79231371 +0000 UTC m=+0.567749270 container remove 023c2089aef02417d4888cb976c51afb74393361f219a7b4970376d3890c43a1 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:30.008 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:30 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-10T18:05:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:29 smithi012 ceph-mon[89611]: from='client.44492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:29 smithi012 ceph-mon[89611]: from='client.44504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:29 smithi012 ceph-mon[89611]: osdmap e593: 8 total, 8 up, 8 in 2024-09-10T18:05:30.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:29 smithi012 ceph-mon[92029]: from='client.44492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:30.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:29 smithi012 ceph-mon[92029]: from='client.44504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:30.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:29 smithi012 ceph-mon[92029]: osdmap e593: 8 total, 8 up, 8 in 2024-09-10T18:05:30.286 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:30 smithi089 systemd[1]: Stopped Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:05:30.286 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:30 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service: Consumed 2.507s CPU time. 2024-09-10T18:05:30.286 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:30 smithi089 systemd[1]: Starting Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:05:30.764 INFO:tasks.rados.rados.0.smithi012.stdout:2534: done (0 left) 2024-09-10T18:05:30.764 INFO:tasks.rados.rados.0.smithi012.stdout:2535: delete oid 47 current snap is 262 2024-09-10T18:05:30.765 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:30 smithi089 podman[116503]: 2024-09-10 18:05:30.31503608 +0000 UTC m=+0.016810493 image pull 1d3b7f56885b6dd623f1785be963aa9c195f86bc256ea454e8d02a7980b79c53 quay.io/prometheus/prometheus:v2.51.0 2024-09-10T18:05:30.765 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:30 smithi089 podman[116503]: 2024-09-10 18:05:30.435055529 +0000 UTC m=+0.136829942 container create 876b047992b8b172cead92fbe9e770505389145c9796c79bcbf51ec80f166723 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:30.784 INFO:tasks.rados.rados.0.smithi012.stdout:2535: done (0 left) 2024-09-10T18:05:30.785 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 262 2024-09-10T18:05:30.785 INFO:tasks.rados.rados.0.smithi012.stdout:2536: seq_num 797 ranges {819200=557056,1376256=589824,1966080=212992} 2024-09-10T18:05:30.792 INFO:tasks.rados.rados.0.smithi012.stdout:2536: writing smithi01278544-27 from 819200 to 1376256 tid 1 2024-09-10T18:05:30.795 INFO:tasks.rados.rados.0.smithi012.stdout:2536: writing smithi01278544-27 from 1376256 to 1966080 tid 2 2024-09-10T18:05:30.797 INFO:tasks.rados.rados.0.smithi012.stdout:2536: writing smithi01278544-27 from 1966080 to 2179072 tid 3 2024-09-10T18:05:30.797 INFO:tasks.rados.rados.0.smithi012.stdout:2537: read oid 18 snap -1 2024-09-10T18:05:30.797 INFO:tasks.rados.rados.0.smithi012.stdout:2537: expect deleted 2024-09-10T18:05:30.797 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 262 2024-09-10T18:05:30.797 INFO:tasks.rados.rados.0.smithi012.stdout:2536: finishing write tid 1 to smithi01278544-27 2024-09-10T18:05:30.797 INFO:tasks.rados.rados.0.smithi012.stdout:2538: seq_num 798 ranges {6340608=573440,6914048=466944,7380992=335872} 2024-09-10T18:05:30.834 INFO:tasks.rados.rados.0.smithi012.stdout:2538: writing smithi01278544-43 from 6340608 to 6914048 tid 1 2024-09-10T18:05:30.837 INFO:tasks.rados.rados.0.smithi012.stdout:2538: writing smithi01278544-43 from 6914048 to 7380992 tid 2 2024-09-10T18:05:30.839 INFO:tasks.rados.rados.0.smithi012.stdout:2538: writing smithi01278544-43 from 7380992 to 7716864 tid 3 2024-09-10T18:05:30.839 INFO:tasks.rados.rados.0.smithi012.stdout:2539: read oid 8 snap 249 2024-09-10T18:05:30.839 INFO:tasks.rados.rados.0.smithi012.stdout:2539: expect (ObjNum 733 snap 238 seq_num 733) 2024-09-10T18:05:30.839 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 262 2024-09-10T18:05:30.840 INFO:tasks.rados.rados.0.smithi012.stdout:2540: seq_num 799 ranges {1449984=589824,2039808=802816} 2024-09-10T18:05:30.850 INFO:tasks.rados.rados.0.smithi012.stdout:2540: writing smithi01278544-13 from 1449984 to 2039808 tid 1 2024-09-10T18:05:30.855 INFO:tasks.rados.rados.0.smithi012.stdout:2540: writing smithi01278544-13 from 2039808 to 2842624 tid 2 2024-09-10T18:05:30.855 INFO:tasks.rados.rados.0.smithi012.stdout:2541: snap_remove snap 246 2024-09-10T18:05:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:30 smithi012 ceph-mon[89611]: pgmap v565: 121 pgs: 121 active+clean; 448 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-09-10T18:05:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:30 smithi012 ceph-mon[89611]: osdmap e594: 8 total, 8 up, 8 in 2024-09-10T18:05:31.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:30 smithi012 ceph-mon[92029]: pgmap v565: 121 pgs: 121 active+clean; 448 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-09-10T18:05:31.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:30 smithi012 ceph-mon[92029]: osdmap e594: 8 total, 8 up, 8 in 2024-09-10T18:05:31.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:30 smithi089 ceph-mon[84132]: pgmap v565: 121 pgs: 121 active+clean; 448 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-09-10T18:05:31.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:30 smithi089 ceph-mon[84132]: osdmap e594: 8 total, 8 up, 8 in 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:2536: finishing write tid 2 to smithi01278544-27 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:2536: finishing write tid 3 to smithi01278544-27 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:2536: finishing write tid 4 to smithi01278544-27 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:2536: finishing write tid 5 to smithi01278544-27 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:2536: oid 27 updating version 0 to 1282 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:2536: oid 27 updating version 1282 to 1284 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:2536: oid 27 updating version 1284 to 1285 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:2536: oid 27 version 1285 is already newer than 1283 2024-09-10T18:05:31.779 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1285 (ObjNum 797 snap 262 seq_num 797) dirty exists 2024-09-10T18:05:31.780 INFO:tasks.rados.rados.0.smithi012.stdout:2536: left oid 27 (ObjNum 797 snap 262 seq_num 797) 2024-09-10T18:05:31.780 INFO:tasks.rados.rados.0.smithi012.stdout:2538: finishing write tid 1 to smithi01278544-43 2024-09-10T18:05:31.780 INFO:tasks.rados.rados.0.smithi012.stdout:2538: finishing write tid 2 to smithi01278544-43 2024-09-10T18:05:31.780 INFO:tasks.rados.rados.0.smithi012.stdout:2538: finishing write tid 3 to smithi01278544-43 2024-09-10T18:05:31.780 INFO:tasks.rados.rados.0.smithi012.stdout:2539: expect (ObjNum 733 snap 238 seq_num 733) 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2538: finishing write tid 4 to smithi01278544-43 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2538: finishing write tid 5 to smithi01278544-43 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2538: oid 43 updating version 0 to 1803 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2538: oid 43 version 1803 is already newer than 1801 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2538: oid 43 version 1803 is already newer than 1802 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2538: oid 43 version 1803 is already newer than 1800 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 1803 (ObjNum 798 snap 262 seq_num 798) dirty exists 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2538: left oid 43 (ObjNum 798 snap 262 seq_num 798) 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2540: finishing write tid 1 to smithi01278544-13 2024-09-10T18:05:31.793 INFO:tasks.rados.rados.0.smithi012.stdout:2540: finishing write tid 2 to smithi01278544-13 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2540: finishing write tid 3 to smithi01278544-13 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2540: finishing write tid 4 to smithi01278544-13 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2540: oid 13 updating version 0 to 1250 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2540: oid 13 updating version 1250 to 1252 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2540: oid 13 version 1252 is already newer than 1251 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1252 (ObjNum 799 snap 262 seq_num 799) dirty exists 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2540: left oid 13 (ObjNum 799 snap 262 seq_num 799) 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2536: done (5 left) 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2537: done (4 left) 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2538: done (3 left) 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2539: done (2 left) 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2540: done (1 left) 2024-09-10T18:05:31.794 INFO:tasks.rados.rados.0.smithi012.stdout:2541: done (0 left) 2024-09-10T18:05:31.795 INFO:tasks.rados.rados.0.smithi012.stdout:2542: read oid 27 snap -1 2024-09-10T18:05:31.795 INFO:tasks.rados.rados.0.smithi012.stdout:2542: expect (ObjNum 797 snap 262 seq_num 797) 2024-09-10T18:05:31.795 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 262 2024-09-10T18:05:31.795 INFO:tasks.rados.rados.0.smithi012.stdout:2543: seq_num 800 ranges {0=606208,606208=688128,1294336=114688} 2024-09-10T18:05:31.796 INFO:tasks.rados.rados.0.smithi012.stdout:2543: writing smithi01278544-40 from 0 to 606208 tid 1 2024-09-10T18:05:31.800 INFO:tasks.rados.rados.0.smithi012.stdout:2543: writing smithi01278544-40 from 606208 to 1294336 tid 2 2024-09-10T18:05:31.801 INFO:tasks.rados.rados.0.smithi012.stdout:2543: writing smithi01278544-40 from 1294336 to 1409024 tid 3 2024-09-10T18:05:31.802 INFO:tasks.rados.rados.0.smithi012.stdout:2544: snap_create 2024-09-10T18:05:31.806 INFO:tasks.rados.rados.0.smithi012.stdout:2542: expect (ObjNum 797 snap 262 seq_num 797) 2024-09-10T18:05:31.879 INFO:tasks.rados.rados.0.smithi012.stdout:2543: finishing write tid 1 to smithi01278544-40 2024-09-10T18:05:31.879 INFO:tasks.rados.rados.0.smithi012.stdout:2543: finishing write tid 2 to smithi01278544-40 2024-09-10T18:05:31.879 INFO:tasks.rados.rados.0.smithi012.stdout:2543: finishing write tid 3 to smithi01278544-40 2024-09-10T18:05:31.879 INFO:tasks.rados.rados.0.smithi012.stdout:2543: finishing write tid 4 to smithi01278544-40 2024-09-10T18:05:31.879 INFO:tasks.rados.rados.0.smithi012.stdout:2543: finishing write tid 5 to smithi01278544-40 2024-09-10T18:05:31.880 INFO:tasks.rados.rados.0.smithi012.stdout:2543: oid 40 updating version 0 to 1810 2024-09-10T18:05:31.880 INFO:tasks.rados.rados.0.smithi012.stdout:2543: oid 40 updating version 1810 to 1811 2024-09-10T18:05:31.880 INFO:tasks.rados.rados.0.smithi012.stdout:2543: oid 40 version 1811 is already newer than 1809 2024-09-10T18:05:31.880 INFO:tasks.rados.rados.0.smithi012.stdout:2543: oid 40 version 1811 is already newer than 1808 2024-09-10T18:05:31.880 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1811 (ObjNum 800 snap 262 seq_num 800) dirty exists 2024-09-10T18:05:31.880 INFO:tasks.rados.rados.0.smithi012.stdout:2543: left oid 40 (ObjNum 800 snap 262 seq_num 800) 2024-09-10T18:05:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:31 smithi012 ceph-mon[89611]: osdmap e595: 8 total, 8 up, 8 in 2024-09-10T18:05:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:31 smithi012 ceph-mon[92029]: osdmap e595: 8 total, 8 up, 8 in 2024-09-10T18:05:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-mon[84132]: osdmap e595: 8 total, 8 up, 8 in 2024-09-10T18:05:32.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:32.036 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 podman[116503]: 2024-09-10 18:05:31.914222738 +0000 UTC m=+1.615997153 container init 876b047992b8b172cead92fbe9e770505389145c9796c79bcbf51ec80f166723 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:32.036 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 podman[116503]: 2024-09-10 18:05:31.917350369 +0000 UTC m=+1.619124782 container start 876b047992b8b172cead92fbe9e770505389145c9796c79bcbf51ec80f166723 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.938Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.938Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.938Z caller=main.go:623 level=info host_details="(Linux 5.14.0-505.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 x86_64 smithi089 (none))" 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.938Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.939Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.940Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.941Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.942Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.942Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.944Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-10T18:05:32.037 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.945Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=732.453µs 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.945Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.946Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.952Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.953Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.957Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.958Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.958Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=31.071µs wal_replay_duration=12.865637ms wbl_replay_duration=133ns total_replay_duration=13.65286ms 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.960Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.960Z caller=main.go:1153 level=info msg="TSDB started" 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.960Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.976Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.143899ms db_storage=849ns remote_storage=1.246µs web_handler=321ns query_engine=563ns scrape=418.134µs scrape_sd=110.122µs notify=16.118µs notify_sd=245.453µs rules=14.968292ms tracing=5.47µs 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.976Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2024-09-10T18:05:32.038 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:05:31.976Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2024-09-10T18:05:32.764 INFO:tasks.rados.rados.0.smithi012.stdout:2542: done (2 left) 2024-09-10T18:05:32.764 INFO:tasks.rados.rados.0.smithi012.stdout:2543: done (1 left) 2024-09-10T18:05:32.764 INFO:tasks.rados.rados.0.smithi012.stdout:2544: done (0 left) 2024-09-10T18:05:32.764 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 263 2024-09-10T18:05:32.764 INFO:tasks.rados.rados.0.smithi012.stdout:2545: seq_num 801 ranges {6340608=622592,6963200=573440,7536640=229376} 2024-09-10T18:05:32.774 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:32 smithi089 bash[116503]: 876b047992b8b172cead92fbe9e770505389145c9796c79bcbf51ec80f166723 2024-09-10T18:05:32.774 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:05:32 smithi089 systemd[1]: Started Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:05:32.802 INFO:tasks.rados.rados.0.smithi012.stdout:2545: writing smithi01278544-12 from 6340608 to 6963200 tid 1 2024-09-10T18:05:32.805 INFO:tasks.rados.rados.0.smithi012.stdout:2545: writing smithi01278544-12 from 6963200 to 7536640 tid 2 2024-09-10T18:05:32.806 INFO:tasks.rados.rados.0.smithi012.stdout:2545: writing smithi01278544-12 from 7536640 to 7766016 tid 3 2024-09-10T18:05:32.807 INFO:tasks.rados.rados.0.smithi012.stdout:2546: rollback oid 49 current snap is 263 2024-09-10T18:05:32.807 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 49 to 235 2024-09-10T18:05:32.807 INFO:tasks.rados.rados.0.smithi012.stdout:2547: copy_from oid 20 from oid 40 current snap is 263 2024-09-10T18:05:32.807 INFO:tasks.rados.rados.0.smithi012.stdout:2548: rollback oid 8 current snap is 263 2024-09-10T18:05:32.807 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 8 to 235 2024-09-10T18:05:32.807 INFO:tasks.rados.rados.0.smithi012.stdout:2549: delete oid 31 current snap is 263 2024-09-10T18:05:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:2548: finishing rollback tid 0 to smithi01278544-8 2024-09-10T18:05:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:2548: finishing rollback tid 1 to smithi01278544-8 2024-09-10T18:05:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1128 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:05:32.814 INFO:tasks.rados.rados.0.smithi012.stdout:2546: finishing rollback tid 0 to smithi01278544-49 2024-09-10T18:05:32.814 INFO:tasks.rados.rados.0.smithi012.stdout:2548: done (4 left) 2024-09-10T18:05:32.814 INFO:tasks.rados.rados.0.smithi012.stdout:2549: done (3 left) 2024-09-10T18:05:32.814 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 263 2024-09-10T18:05:32.814 INFO:tasks.rados.rados.0.smithi012.stdout:2550: seq_num 803 ranges {5087232=655360,5742592=745472,6488064=57344} 2024-09-10T18:05:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:2550: writing smithi01278544-26 from 5087232 to 5742592 tid 1 2024-09-10T18:05:32.850 INFO:tasks.rados.rados.0.smithi012.stdout:2550: writing smithi01278544-26 from 5742592 to 6488064 tid 2 2024-09-10T18:05:32.851 INFO:tasks.rados.rados.0.smithi012.stdout:2550: writing smithi01278544-26 from 6488064 to 6545408 tid 3 2024-09-10T18:05:32.851 INFO:tasks.rados.rados.0.smithi012.stdout:2551: setattr oid 6 current snap is 263 2024-09-10T18:05:32.851 INFO:tasks.rados.rados.0.smithi012.stdout:2545: finishing write tid 1 to smithi01278544-12 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: finishing write tid 2 to smithi01278544-12 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: finishing write tid 3 to smithi01278544-12 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2546: finishing rollback tid 1 to smithi01278544-49 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: finishing write tid 4 to smithi01278544-12 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2546: finishing rollback tid 2 to smithi01278544-49 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1150 (ObjNum 721 snap 235 seq_num 721) dirty exists 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: finishing write tid 5 to smithi01278544-12 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: oid 12 updating version 0 to 1826 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: oid 12 updating version 1826 to 1829 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: oid 12 version 1829 is already newer than 1828 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: oid 12 version 1829 is already newer than 1827 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1829 (ObjNum 801 snap 263 seq_num 801) dirty exists 2024-09-10T18:05:32.852 INFO:tasks.rados.rados.0.smithi012.stdout:2545: left oid 12 (ObjNum 801 snap 263 seq_num 801) 2024-09-10T18:05:32.853 INFO:tasks.rados.rados.0.smithi012.stdout:2547: finishing copy_from racing read to smithi01278544-20 2024-09-10T18:05:32.853 INFO:tasks.rados.rados.0.smithi012.stdout:2547: finishing copy_from to smithi01278544-20 2024-09-10T18:05:32.853 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1811 (ObjNum 800 snap 262 seq_num 800) dirty exists 2024-09-10T18:05:32.853 INFO:tasks.rados.rados.0.smithi012.stdout:2550: finishing write tid 1 to smithi01278544-26 2024-09-10T18:05:32.853 INFO:tasks.rados.rados.0.smithi012.stdout:2545: done (4 left) 2024-09-10T18:05:32.854 INFO:tasks.rados.rados.0.smithi012.stdout:2546: done (3 left) 2024-09-10T18:05:32.854 INFO:tasks.rados.rados.0.smithi012.stdout:2547: done (2 left) 2024-09-10T18:05:32.854 INFO:tasks.rados.rados.0.smithi012.stdout:2552: read oid 33 snap -1 2024-09-10T18:05:32.854 INFO:tasks.rados.rados.0.smithi012.stdout:2552: expect (ObjNum 768 snap 253 seq_num 768) 2024-09-10T18:05:32.854 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 263 2024-09-10T18:05:32.854 INFO:tasks.rados.rados.0.smithi012.stdout:2553: seq_num 804 ranges {0=671744,671744=622592,1294336=180224} 2024-09-10T18:05:32.857 INFO:tasks.rados.rados.0.smithi012.stdout:2553: writing smithi01278544-17 from 0 to 671744 tid 1 2024-09-10T18:05:32.861 INFO:tasks.rados.rados.0.smithi012.stdout:2553: writing smithi01278544-17 from 671744 to 1294336 tid 2 2024-09-10T18:05:32.862 INFO:tasks.rados.rados.0.smithi012.stdout:2553: writing smithi01278544-17 from 1294336 to 1474560 tid 3 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2554: setattr oid 36 current snap is 263 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: finishing write tid 2 to smithi01278544-26 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: finishing write tid 3 to smithi01278544-26 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: finishing write tid 4 to smithi01278544-26 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 1129 (ObjNum 735 snap 238 seq_num 735) dirty exists 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: finishing write tid 5 to smithi01278544-26 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: oid 26 updating version 0 to 816 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: oid 26 version 816 is already newer than 815 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: oid 26 version 816 is already newer than 813 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: oid 26 version 816 is already newer than 814 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 816 (ObjNum 803 snap 263 seq_num 803) dirty exists 2024-09-10T18:05:32.863 INFO:tasks.rados.rados.0.smithi012.stdout:2550: left oid 26 (ObjNum 803 snap 263 seq_num 803) 2024-09-10T18:05:32.864 INFO:tasks.rados.rados.0.smithi012.stdout:2552: expect (ObjNum 768 snap 253 seq_num 768) 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: finishing write tid 1 to smithi01278544-17 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: finishing write tid 2 to smithi01278544-17 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: finishing write tid 3 to smithi01278544-17 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: finishing write tid 4 to smithi01278544-17 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: finishing write tid 5 to smithi01278544-17 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: oid 17 updating version 0 to 897 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: oid 17 version 897 is already newer than 896 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: oid 17 version 897 is already newer than 895 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:2553: oid 17 version 897 is already newer than 894 2024-09-10T18:05:32.887 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 897 (ObjNum 804 snap 263 seq_num 804) dirty exists 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2553: left oid 17 (ObjNum 804 snap 263 seq_num 804) 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2550: done (4 left) 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2551: done (3 left) 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2552: done (2 left) 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2553: done (1 left) 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2555: read oid 5 snap 227 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2555: expect (ObjNum 653 snap 213 seq_num 653) 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2556: rmattr oid 9 current snap is 263 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2557: copy_from oid 22 from oid 47 current snap is 263 2024-09-10T18:05:32.888 INFO:tasks.rados.rados.0.smithi012.stdout:2558: delete oid 17 current snap is 263 2024-09-10T18:05:32.889 INFO:tasks.rados.rados.0.smithi012.stdout:2557: finishing copy_from to smithi01278544-22 2024-09-10T18:05:32.889 INFO:tasks.rados.rados.0.smithi012.stdout:2557: got expected ENOENT (src dne) 2024-09-10T18:05:32.889 INFO:tasks.rados.rados.0.smithi012.stdout:2557: finishing copy_from racing read to smithi01278544-22 2024-09-10T18:05:32.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1574 (ObjNum 762 snap 249 seq_num 762) dirty exists 2024-09-10T18:05:32.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 817 (ObjNum 97 snap 0 seq_num 3497813920) dirty exists 2024-09-10T18:05:32.916 INFO:tasks.rados.rados.0.smithi012.stdout:2554: done (4 left) 2024-09-10T18:05:32.916 INFO:tasks.rados.rados.0.smithi012.stdout:2556: done (3 left) 2024-09-10T18:05:32.916 INFO:tasks.rados.rados.0.smithi012.stdout:2557: done (2 left) 2024-09-10T18:05:32.917 INFO:tasks.rados.rados.0.smithi012.stdout:2558: done (1 left) 2024-09-10T18:05:32.917 INFO:tasks.rados.rados.0.smithi012.stdout:2559: setattr oid 24 current snap is 263 2024-09-10T18:05:32.918 INFO:tasks.rados.rados.0.smithi012.stdout:2560: read oid 10 snap -1 2024-09-10T18:05:32.918 INFO:tasks.rados.rados.0.smithi012.stdout:2560: expect (ObjNum 787 snap 257 seq_num 787) 2024-09-10T18:05:32.918 INFO:tasks.rados.rados.0.smithi012.stdout:2561: delete oid 37 current snap is 263 2024-09-10T18:05:32.922 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 818 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:05:32.922 INFO:tasks.rados.rados.0.smithi012.stdout:2559: done (3 left) 2024-09-10T18:05:32.922 INFO:tasks.rados.rados.0.smithi012.stdout:2561: done (2 left) 2024-09-10T18:05:32.922 INFO:tasks.rados.rados.0.smithi012.stdout:2562: delete oid 32 current snap is 263 2024-09-10T18:05:32.924 INFO:tasks.rados.rados.0.smithi012.stdout:2555: expect (ObjNum 653 snap 213 seq_num 653) 2024-09-10T18:05:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[89611]: pgmap v568: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 463 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 1 op/s 2024-09-10T18:05:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[89611]: osdmap e596: 8 total, 8 up, 8 in 2024-09-10T18:05:33.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:33.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:33.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:33.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[89611]: osdmap e597: 8 total, 8 up, 8 in 2024-09-10T18:05:33.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[92029]: pgmap v568: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 463 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 1 op/s 2024-09-10T18:05:33.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[92029]: osdmap e596: 8 total, 8 up, 8 in 2024-09-10T18:05:33.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:33.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:33.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:33.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:32 smithi012 ceph-mon[92029]: osdmap e597: 8 total, 8 up, 8 in 2024-09-10T18:05:33.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:32 smithi089 ceph-mon[84132]: pgmap v568: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 463 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 1 op/s 2024-09-10T18:05:33.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:32 smithi089 ceph-mon[84132]: osdmap e596: 8 total, 8 up, 8 in 2024-09-10T18:05:33.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:33.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:33.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:33.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:32 smithi089 ceph-mon[84132]: osdmap e597: 8 total, 8 up, 8 in 2024-09-10T18:05:33.526 INFO:tasks.rados.rados.0.smithi012.stdout:2560: expect (ObjNum 787 snap 257 seq_num 787) 2024-09-10T18:05:33.558 INFO:tasks.rados.rados.0.smithi012.stdout:2555: done (2 left) 2024-09-10T18:05:33.558 INFO:tasks.rados.rados.0.smithi012.stdout:2560: done (1 left) 2024-09-10T18:05:33.558 INFO:tasks.rados.rados.0.smithi012.stdout:2562: done (0 left) 2024-09-10T18:05:33.558 INFO:tasks.rados.rados.0.smithi012.stdout:2563: snap_create 2024-09-10T18:05:33.781 INFO:tasks.rados.rados.0.smithi012.stdout:2563: done (0 left) 2024-09-10T18:05:33.781 INFO:tasks.rados.rados.0.smithi012.stdout:2564: snap_remove snap 259 2024-09-10T18:05:34.789 INFO:tasks.rados.rados.0.smithi012.stdout:2564: done (0 left) 2024-09-10T18:05:34.789 INFO:tasks.rados.rados.0.smithi012.stdout:2565: rmattr oid 26 current snap is 264 2024-09-10T18:05:34.789 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 264 2024-09-10T18:05:34.789 INFO:tasks.rados.rados.0.smithi012.stdout:2566: seq_num 808 ranges {1376256=737280,2113536=614400,2727936=188416} 2024-09-10T18:05:34.802 INFO:tasks.rados.rados.0.smithi012.stdout:2566: writing smithi01278544-11 from 1376256 to 2113536 tid 1 2024-09-10T18:05:34.806 INFO:tasks.rados.rados.0.smithi012.stdout:2566: writing smithi01278544-11 from 2113536 to 2727936 tid 2 2024-09-10T18:05:34.808 INFO:tasks.rados.rados.0.smithi012.stdout:2566: writing smithi01278544-11 from 2727936 to 2916352 tid 3 2024-09-10T18:05:34.808 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 819 (ObjNum 803 snap 263 seq_num 803) dirty exists 2024-09-10T18:05:34.808 INFO:tasks.rados.rados.0.smithi012.stdout:2566: finishing write tid 1 to smithi01278544-11 2024-09-10T18:05:34.808 INFO:tasks.rados.rados.0.smithi012.stdout:2565: done (1 left) 2024-09-10T18:05:34.808 INFO:tasks.rados.rados.0.smithi012.stdout:2567: copy_from oid 15 from oid 9 current snap is 264 2024-09-10T18:05:34.808 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 41 current snap is 264 2024-09-10T18:05:34.809 INFO:tasks.rados.rados.0.smithi012.stdout:2568: seq_num 809 ranges {8577024=753664,9330688=499712,9830400=303104} 2024-09-10T18:05:34.859 INFO:tasks.rados.rados.0.smithi012.stdout:2568: writing smithi01278544-41 from 8577024 to 9330688 tid 1 2024-09-10T18:05:34.862 INFO:tasks.rados.rados.0.smithi012.stdout:2568: writing smithi01278544-41 from 9330688 to 9830400 tid 2 2024-09-10T18:05:34.865 INFO:tasks.rados.rados.0.smithi012.stdout:2568: writing smithi01278544-41 from 9830400 to 10133504 tid 3 2024-09-10T18:05:34.866 INFO:tasks.rados.rados.0.smithi012.stdout:2569: delete oid 38 current snap is 264 2024-09-10T18:05:34.866 INFO:tasks.rados.rados.0.smithi012.stdout:2566: finishing write tid 2 to smithi01278544-11 2024-09-10T18:05:34.866 INFO:tasks.rados.rados.0.smithi012.stdout:2566: finishing write tid 3 to smithi01278544-11 2024-09-10T18:05:34.866 INFO:tasks.rados.rados.0.smithi012.stdout:2566: finishing write tid 4 to smithi01278544-11 2024-09-10T18:05:34.866 INFO:tasks.rados.rados.0.smithi012.stdout:2567: finishing copy_from racing read to smithi01278544-15 2024-09-10T18:05:34.866 INFO:tasks.rados.rados.0.smithi012.stdout:2567: finishing copy_from to smithi01278544-15 2024-09-10T18:05:34.867 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 1574 (ObjNum 762 snap 249 seq_num 762) dirty exists 2024-09-10T18:05:34.867 INFO:tasks.rados.rados.0.smithi012.stdout:2566: finishing write tid 5 to smithi01278544-11 2024-09-10T18:05:34.867 INFO:tasks.rados.rados.0.smithi012.stdout:2566: oid 11 updating version 0 to 1840 2024-09-10T18:05:34.867 INFO:tasks.rados.rados.0.smithi012.stdout:2566: oid 11 updating version 1840 to 1842 2024-09-10T18:05:34.867 INFO:tasks.rados.rados.0.smithi012.stdout:2566: oid 11 version 1842 is already newer than 1841 2024-09-10T18:05:34.868 INFO:tasks.rados.rados.0.smithi012.stdout:2566: oid 11 version 1842 is already newer than 1839 2024-09-10T18:05:34.868 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 1842 (ObjNum 808 snap 264 seq_num 808) dirty exists 2024-09-10T18:05:34.868 INFO:tasks.rados.rados.0.smithi012.stdout:2566: left oid 11 (ObjNum 808 snap 264 seq_num 808) 2024-09-10T18:05:34.870 INFO:tasks.rados.rados.0.smithi012.stdout:2566: done (3 left) 2024-09-10T18:05:34.870 INFO:tasks.rados.rados.0.smithi012.stdout:2567: done (2 left) 2024-09-10T18:05:34.870 INFO:tasks.rados.rados.0.smithi012.stdout:2569: done (1 left) 2024-09-10T18:05:34.870 INFO:tasks.rados.rados.0.smithi012.stdout:2570: rollback oid 42 current snap is 264 2024-09-10T18:05:34.871 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 42 to 242 2024-09-10T18:05:34.871 INFO:tasks.rados.rados.0.smithi012.stdout:2571: rollback oid 35 current snap is 264 2024-09-10T18:05:34.871 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 35 to 256 2024-09-10T18:05:34.871 INFO:tasks.rados.rados.0.smithi012.stdout:2572: rollback oid 19 current snap is 264 2024-09-10T18:05:34.871 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 19 to 262 2024-09-10T18:05:34.871 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 264 2024-09-10T18:05:34.871 INFO:tasks.rados.rados.0.smithi012.stdout:2573: seq_num 811 ranges {6848512=786432,7634944=663552,8298496=139264} 2024-09-10T18:05:34.909 INFO:tasks.rados.rados.0.smithi012.stdout:2573: writing smithi01278544-4 from 6848512 to 7634944 tid 1 2024-09-10T18:05:34.913 INFO:tasks.rados.rados.0.smithi012.stdout:2573: writing smithi01278544-4 from 7634944 to 8298496 tid 2 2024-09-10T18:05:34.914 INFO:tasks.rados.rados.0.smithi012.stdout:2573: writing smithi01278544-4 from 8298496 to 8437760 tid 3 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2574: snap_create 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2568: finishing write tid 1 to smithi01278544-41 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2568: finishing write tid 2 to smithi01278544-41 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2568: finishing write tid 3 to smithi01278544-41 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2570: finishing rollback tid 1 to smithi01278544-42 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1595 (ObjNum 97 snap 0 seq_num 3497856784) dirty dne 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2571: finishing rollback tid 0 to smithi01278544-35 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2568: finishing write tid 4 to smithi01278544-41 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2571: finishing rollback tid 1 to smithi01278544-35 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:2571: finishing rollback tid 2 to smithi01278544-35 2024-09-10T18:05:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1159 (ObjNum 776 snap 255 seq_num 776) dirty exists 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2568: finishing write tid 5 to smithi01278544-41 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2568: oid 41 updating version 0 to 1275 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2568: oid 41 version 1275 is already newer than 1273 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2568: oid 41 version 1275 is already newer than 1272 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2568: oid 41 version 1275 is already newer than 1274 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 1275 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2568: left oid 41 (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2572: finishing rollback tid 0 to smithi01278544-19 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2572: finishing rollback tid 1 to smithi01278544-19 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2572: finishing rollback tid 2 to smithi01278544-19 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1143 (ObjNum 782 snap 256 seq_num 782) dirty exists 2024-09-10T18:05:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:2573: finishing write tid 1 to smithi01278544-4 2024-09-10T18:05:34.917 INFO:tasks.rados.rados.0.smithi012.stdout:2573: finishing write tid 2 to smithi01278544-4 2024-09-10T18:05:34.917 INFO:tasks.rados.rados.0.smithi012.stdout:2573: finishing write tid 3 to smithi01278544-4 2024-09-10T18:05:34.917 INFO:tasks.rados.rados.0.smithi012.stdout:2573: finishing write tid 4 to smithi01278544-4 2024-09-10T18:05:34.918 INFO:tasks.rados.rados.0.smithi012.stdout:2573: finishing write tid 5 to smithi01278544-4 2024-09-10T18:05:34.918 INFO:tasks.rados.rados.0.smithi012.stdout:2573: oid 4 updating version 0 to 1278 2024-09-10T18:05:34.918 INFO:tasks.rados.rados.0.smithi012.stdout:2573: oid 4 updating version 1278 to 1279 2024-09-10T18:05:34.918 INFO:tasks.rados.rados.0.smithi012.stdout:2573: oid 4 updating version 1279 to 1280 2024-09-10T18:05:34.918 INFO:tasks.rados.rados.0.smithi012.stdout:2573: oid 4 version 1280 is already newer than 1277 2024-09-10T18:05:34.918 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1280 (ObjNum 811 snap 264 seq_num 811) dirty exists 2024-09-10T18:05:34.918 INFO:tasks.rados.rados.0.smithi012.stdout:2573: left oid 4 (ObjNum 811 snap 264 seq_num 811) 2024-09-10T18:05:35.177 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:34 smithi089 ceph-mon[84132]: pgmap v571: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 466 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-09-10T18:05:35.177 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:34 smithi089 ceph-mon[84132]: osdmap e598: 8 total, 8 up, 8 in 2024-09-10T18:05:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:34 smithi012 ceph-mon[89611]: pgmap v571: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 466 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-09-10T18:05:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:34 smithi012 ceph-mon[89611]: osdmap e598: 8 total, 8 up, 8 in 2024-09-10T18:05:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:34 smithi012 ceph-mon[92029]: pgmap v571: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 466 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-09-10T18:05:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:34 smithi012 ceph-mon[92029]: osdmap e598: 8 total, 8 up, 8 in 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2568: done (5 left) 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2570: done (4 left) 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2571: done (3 left) 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2572: done (2 left) 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2573: done (1 left) 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2574: done (0 left) 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2575: read oid 19 snap -1 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2575: expect (ObjNum 782 snap 256 seq_num 782) 2024-09-10T18:05:35.806 INFO:tasks.rados.rados.0.smithi012.stdout:2576: setattr oid 34 current snap is 265 2024-09-10T18:05:35.808 INFO:tasks.rados.rados.0.smithi012.stdout:2577: read oid 44 snap -1 2024-09-10T18:05:35.808 INFO:tasks.rados.rados.0.smithi012.stdout:2577: expect (ObjNum 744 snap 241 seq_num 744) 2024-09-10T18:05:35.808 INFO:tasks.rados.rados.0.smithi012.stdout:2578: read oid 31 snap -1 2024-09-10T18:05:35.808 INFO:tasks.rados.rados.0.smithi012.stdout:2578: expect deleted 2024-09-10T18:05:35.808 INFO:tasks.rados.rados.0.smithi012.stdout:2579: snap_remove snap 264 2024-09-10T18:05:36.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:35 smithi089 ceph-mon[84132]: osdmap e599: 8 total, 8 up, 8 in 2024-09-10T18:05:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:35 smithi012 ceph-mon[89611]: osdmap e599: 8 total, 8 up, 8 in 2024-09-10T18:05:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:35 smithi012 ceph-mon[92029]: osdmap e599: 8 total, 8 up, 8 in 2024-09-10T18:05:36.809 INFO:tasks.rados.rados.0.smithi012.stdout:2575: expect (ObjNum 782 snap 256 seq_num 782) 2024-09-10T18:05:37.013 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1144 (ObjNum 558 snap 186 seq_num 558) dirty exists 2024-09-10T18:05:37.013 INFO:tasks.rados.rados.0.smithi012.stdout:2577: expect (ObjNum 744 snap 241 seq_num 744) 2024-09-10T18:05:37.199 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:36 smithi089 ceph-mon[84132]: pgmap v574: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 468 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2024-09-10T18:05:37.199 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:36 smithi089 ceph-mon[84132]: osdmap e600: 8 total, 8 up, 8 in 2024-09-10T18:05:37.199 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.199 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.200 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.200 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:36 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[89611]: pgmap v574: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 468 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2024-09-10T18:05:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[89611]: osdmap e600: 8 total, 8 up, 8 in 2024-09-10T18:05:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[92029]: pgmap v574: 121 pgs: 1 active+clean+snaptrim, 120 active+clean; 468 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2024-09-10T18:05:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[92029]: osdmap e600: 8 total, 8 up, 8 in 2024-09-10T18:05:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:36 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:37.710 INFO:tasks.rados.rados.0.smithi012.stdout:2575: done (4 left) 2024-09-10T18:05:37.710 INFO:tasks.rados.rados.0.smithi012.stdout:2576: done (3 left) 2024-09-10T18:05:37.711 INFO:tasks.rados.rados.0.smithi012.stdout:2577: done (2 left) 2024-09-10T18:05:37.711 INFO:tasks.rados.rados.0.smithi012.stdout:2578: done (1 left) 2024-09-10T18:05:37.711 INFO:tasks.rados.rados.0.smithi012.stdout:2579: done (0 left) 2024-09-10T18:05:37.711 INFO:tasks.rados.rados.0.smithi012.stdout:2580: rollback oid 40 current snap is 265 2024-09-10T18:05:37.711 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 40 to 224 2024-09-10T18:05:37.711 INFO:tasks.rados.rados.0.smithi012.stdout:2581: snap_remove snap 241 2024-09-10T18:05:37.754 INFO:tasks.rados.rados.0.smithi012.stdout:2581: done (1 left) 2024-09-10T18:05:37.754 INFO:tasks.rados.rados.0.smithi012.stdout:2582: delete oid 34 current snap is 265 2024-09-10T18:05:37.754 INFO:tasks.rados.rados.0.smithi012.stdout:2580: finishing rollback tid 0 to smithi01278544-40 2024-09-10T18:05:37.755 INFO:tasks.rados.rados.0.smithi012.stdout:2580: finishing rollback tid 1 to smithi01278544-40 2024-09-10T18:05:37.755 INFO:tasks.rados.rados.0.smithi012.stdout:2580: finishing rollback tid 2 to smithi01278544-40 2024-09-10T18:05:37.755 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1828 (ObjNum 582 snap 195 seq_num 582) dirty exists 2024-09-10T18:05:37.764 INFO:tasks.rados.rados.0.smithi012.stdout:2580: done (1 left) 2024-09-10T18:05:37.765 INFO:tasks.rados.rados.0.smithi012.stdout:2582: done (0 left) 2024-09-10T18:05:37.765 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 265 2024-09-10T18:05:37.765 INFO:tasks.rados.rados.0.smithi012.stdout:2583: seq_num 813 ranges {0=417792,417792=434176,851968=442368,1294336=327680} 2024-09-10T18:05:37.767 INFO:tasks.rados.rados.0.smithi012.stdout:2583: writing smithi01278544-34 from 0 to 417792 tid 1 2024-09-10T18:05:37.770 INFO:tasks.rados.rados.0.smithi012.stdout:2583: writing smithi01278544-34 from 417792 to 851968 tid 2 2024-09-10T18:05:37.774 INFO:tasks.rados.rados.0.smithi012.stdout:2583: writing smithi01278544-34 from 851968 to 1294336 tid 3 2024-09-10T18:05:37.776 INFO:tasks.rados.rados.0.smithi012.stdout:2583: writing smithi01278544-34 from 1294336 to 1622016 tid 4 2024-09-10T18:05:37.777 INFO:tasks.rados.rados.0.smithi012.stdout:2584: snap_create 2024-09-10T18:05:37.777 INFO:tasks.rados.rados.0.smithi012.stdout:2583: finishing write tid 1 to smithi01278544-34 2024-09-10T18:05:37.778 INFO:tasks.rados.rados.0.smithi012.stdout:2583: finishing write tid 2 to smithi01278544-34 2024-09-10T18:05:37.780 INFO:tasks.rados.rados.0.smithi012.stdout:2583: finishing write tid 3 to smithi01278544-34 2024-09-10T18:05:37.781 INFO:tasks.rados.rados.0.smithi012.stdout:2583: finishing write tid 4 to smithi01278544-34 2024-09-10T18:05:37.782 INFO:tasks.rados.rados.0.smithi012.stdout:2583: finishing write tid 5 to smithi01278544-34 2024-09-10T18:05:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:2583: finishing write tid 6 to smithi01278544-34 2024-09-10T18:05:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:2583: oid 34 updating version 0 to 1146 2024-09-10T18:05:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:2583: oid 34 updating version 1146 to 1148 2024-09-10T18:05:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:2583: oid 34 updating version 1148 to 1150 2024-09-10T18:05:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:2583: oid 34 version 1150 is already newer than 1149 2024-09-10T18:05:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:2583: oid 34 version 1150 is already newer than 1147 2024-09-10T18:05:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1150 (ObjNum 813 snap 265 seq_num 813) dirty exists 2024-09-10T18:05:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:2583: left oid 34 (ObjNum 813 snap 265 seq_num 813) 2024-09-10T18:05:38.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:37 smithi089 ceph-mon[84132]: osdmap e601: 8 total, 8 up, 8 in 2024-09-10T18:05:38.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:37 smithi089 ceph-mon[84132]: pgmap v577: 121 pgs: 121 active+clean; 478 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 3.3 MiB/s wr, 29 op/s 2024-09-10T18:05:38.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:37 smithi089 ceph-mon[84132]: osdmap e602: 8 total, 8 up, 8 in 2024-09-10T18:05:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:37 smithi012 ceph-mon[89611]: osdmap e601: 8 total, 8 up, 8 in 2024-09-10T18:05:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:37 smithi012 ceph-mon[89611]: pgmap v577: 121 pgs: 121 active+clean; 478 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 3.3 MiB/s wr, 29 op/s 2024-09-10T18:05:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:37 smithi012 ceph-mon[89611]: osdmap e602: 8 total, 8 up, 8 in 2024-09-10T18:05:38.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:37 smithi012 ceph-mon[92029]: osdmap e601: 8 total, 8 up, 8 in 2024-09-10T18:05:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:37 smithi012 ceph-mon[92029]: pgmap v577: 121 pgs: 121 active+clean; 478 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 MiB/s rd, 3.3 MiB/s wr, 29 op/s 2024-09-10T18:05:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:37 smithi012 ceph-mon[92029]: osdmap e602: 8 total, 8 up, 8 in 2024-09-10T18:05:38.755 INFO:tasks.rados.rados.0.smithi012.stdout:2583: done (1 left) 2024-09-10T18:05:38.755 INFO:tasks.rados.rados.0.smithi012.stdout:2584: done (0 left) 2024-09-10T18:05:38.756 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 266 2024-09-10T18:05:38.756 INFO:tasks.rados.rados.0.smithi012.stdout:2585: seq_num 814 ranges {0=442368,442368=770048,1212416=434176} 2024-09-10T18:05:38.758 INFO:tasks.rados.rados.0.smithi012.stdout:2585: writing smithi01278544-37 from 0 to 442368 tid 1 2024-09-10T18:05:38.762 INFO:tasks.rados.rados.0.smithi012.stdout:2585: writing smithi01278544-37 from 442368 to 1212416 tid 2 2024-09-10T18:05:38.765 INFO:tasks.rados.rados.0.smithi012.stdout:2585: writing smithi01278544-37 from 1212416 to 1646592 tid 3 2024-09-10T18:05:38.765 INFO:tasks.rados.rados.0.smithi012.stdout:2586: rollback oid 2 current snap is 266 2024-09-10T18:05:38.765 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 2 to 196 2024-09-10T18:05:38.765 INFO:tasks.rados.rados.0.smithi012.stdout:2585: finishing write tid 1 to smithi01278544-37 2024-09-10T18:05:38.765 INFO:tasks.rados.rados.0.smithi012.stdout:2587: delete oid 36 current snap is 266 2024-09-10T18:05:38.769 INFO:tasks.rados.rados.0.smithi012.stdout:2585: finishing write tid 2 to smithi01278544-37 2024-09-10T18:05:38.769 INFO:tasks.rados.rados.0.smithi012.stdout:2585: finishing write tid 3 to smithi01278544-37 2024-09-10T18:05:38.769 INFO:tasks.rados.rados.0.smithi012.stdout:2585: finishing write tid 4 to smithi01278544-37 2024-09-10T18:05:38.770 INFO:tasks.rados.rados.0.smithi012.stdout:2587: done (2 left) 2024-09-10T18:05:38.770 INFO:tasks.rados.rados.0.smithi012.stdout:2588: snap_remove snap 263 2024-09-10T18:05:39.765 INFO:tasks.rados.rados.0.smithi012.stdout:2585: finishing write tid 5 to smithi01278544-37 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2585: oid 37 updating version 0 to 1289 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2585: oid 37 updating version 1289 to 1292 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2585: oid 37 version 1292 is already newer than 1290 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2585: oid 37 version 1292 is already newer than 1291 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 1292 (ObjNum 814 snap 266 seq_num 814) dirty exists 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2585: left oid 37 (ObjNum 814 snap 266 seq_num 814) 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2586: finishing rollback tid 0 to smithi01278544-2 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2586: finishing rollback tid 1 to smithi01278544-2 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2586: finishing rollback tid 2 to smithi01278544-2 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1577 (ObjNum 523 snap 179 seq_num 523) dirty exists 2024-09-10T18:05:39.766 INFO:tasks.rados.rados.0.smithi012.stdout:2585: done (2 left) 2024-09-10T18:05:39.767 INFO:tasks.rados.rados.0.smithi012.stdout:2586: done (1 left) 2024-09-10T18:05:39.767 INFO:tasks.rados.rados.0.smithi012.stdout:2588: done (0 left) 2024-09-10T18:05:39.767 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 266 2024-09-10T18:05:39.767 INFO:tasks.rados.rados.0.smithi012.stdout:2589: seq_num 816 ranges {3538944=475136,4014080=540672,4554752=614400,5169152=49152} 2024-09-10T18:05:39.788 INFO:tasks.rados.rados.0.smithi012.stdout:2589: writing smithi01278544-19 from 3538944 to 4014080 tid 1 2024-09-10T18:05:39.790 INFO:tasks.rados.rados.0.smithi012.stdout:2589: writing smithi01278544-19 from 4014080 to 4554752 tid 2 2024-09-10T18:05:39.794 INFO:tasks.rados.rados.0.smithi012.stdout:2589: writing smithi01278544-19 from 4554752 to 5169152 tid 3 2024-09-10T18:05:39.795 INFO:tasks.rados.rados.0.smithi012.stdout:2589: writing smithi01278544-19 from 5169152 to 5218304 tid 4 2024-09-10T18:05:39.795 INFO:tasks.rados.rados.0.smithi012.stdout:2590: rollback oid 21 current snap is 266 2024-09-10T18:05:39.795 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 242 2024-09-10T18:05:39.795 INFO:tasks.rados.rados.0.smithi012.stdout:2589: finishing write tid 1 to smithi01278544-19 2024-09-10T18:05:39.795 INFO:tasks.rados.rados.0.smithi012.stdout:2589: finishing write tid 2 to smithi01278544-19 2024-09-10T18:05:39.795 INFO:tasks.rados.rados.0.smithi012.stdout:2591: snap_remove snap 262 2024-09-10T18:05:39.947 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:39 smithi089 ceph-mon[84132]: osdmap e603: 8 total, 8 up, 8 in 2024-09-10T18:05:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:39 smithi012 ceph-mon[89611]: osdmap e603: 8 total, 8 up, 8 in 2024-09-10T18:05:40.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:39 smithi012 ceph-mon[92029]: osdmap e603: 8 total, 8 up, 8 in 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: pgmap v580: 121 pgs: 121 active+clean; 479 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 36 op/s 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: osdmap e604: 8 total, 8 up, 8 in 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: pgmap v580: 121 pgs: 121 active+clean; 479 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 36 op/s 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: osdmap e604: 8 total, 8 up, 8 in 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:40.759 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:05:40.760 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:05:40.760 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:40.760 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-10T18:05:40.760 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:40.760 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:40.760 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:40.760 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:40.768 INFO:tasks.rados.rados.0.smithi012.stdout:2591: done (2 left) 2024-09-10T18:05:40.768 INFO:tasks.rados.rados.0.smithi012.stdout:2592: delete oid 17 current snap is 266 2024-09-10T18:05:40.768 INFO:tasks.rados.rados.0.smithi012.stdout:2589: finishing write tid 3 to smithi01278544-19 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: finishing write tid 4 to smithi01278544-19 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: finishing write tid 5 to smithi01278544-19 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: finishing write tid 6 to smithi01278544-19 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: oid 19 updating version 0 to 1151 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: oid 19 updating version 1151 to 1152 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: oid 19 updating version 1152 to 1153 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: oid 19 updating version 1153 to 1155 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: oid 19 version 1155 is already newer than 1154 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1155 (ObjNum 816 snap 266 seq_num 816) dirty exists 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2589: left oid 19 (ObjNum 816 snap 266 seq_num 816) 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2590: finishing rollback tid 0 to smithi01278544-21 2024-09-10T18:05:40.769 INFO:tasks.rados.rados.0.smithi012.stdout:2590: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:05:40.770 INFO:tasks.rados.rados.0.smithi012.stdout:2590: finishing rollback tid 2 to smithi01278544-21 2024-09-10T18:05:40.770 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 1158 (ObjNum 735 snap 238 seq_num 735) dirty exists 2024-09-10T18:05:40.789 INFO:tasks.rados.rados.0.smithi012.stdout:2589: done (2 left) 2024-09-10T18:05:40.789 INFO:tasks.rados.rados.0.smithi012.stdout:2590: done (1 left) 2024-09-10T18:05:40.789 INFO:tasks.rados.rados.0.smithi012.stdout:2592: done (0 left) 2024-09-10T18:05:40.789 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 266 2024-09-10T18:05:40.789 INFO:tasks.rados.rados.0.smithi012.stdout:2593: seq_num 818 ranges {1187840=507904,1695744=704512,2400256=499712} 2024-09-10T18:05:40.799 INFO:tasks.rados.rados.0.smithi012.stdout:2593: writing smithi01278544-10 from 1187840 to 1695744 tid 1 2024-09-10T18:05:40.803 INFO:tasks.rados.rados.0.smithi012.stdout:2593: writing smithi01278544-10 from 1695744 to 2400256 tid 2 2024-09-10T18:05:40.806 INFO:tasks.rados.rados.0.smithi012.stdout:2593: writing smithi01278544-10 from 2400256 to 2899968 tid 3 2024-09-10T18:05:40.806 INFO:tasks.rados.rados.0.smithi012.stdout:2594: read oid 6 snap -1 2024-09-10T18:05:40.806 INFO:tasks.rados.rados.0.smithi012.stdout:2594: expect (ObjNum 735 snap 238 seq_num 735) 2024-09-10T18:05:40.806 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 266 2024-09-10T18:05:40.806 INFO:tasks.rados.rados.0.smithi012.stdout:2593: finishing write tid 1 to smithi01278544-10 2024-09-10T18:05:40.806 INFO:tasks.rados.rados.0.smithi012.stdout:2595: seq_num 819 ranges {1327104=524288,1851392=589824,2441216=614400} 2024-09-10T18:05:40.816 INFO:tasks.rados.rados.0.smithi012.stdout:2595: writing smithi01278544-28 from 1327104 to 1851392 tid 1 2024-09-10T18:05:40.819 INFO:tasks.rados.rados.0.smithi012.stdout:2595: writing smithi01278544-28 from 1851392 to 2441216 tid 2 2024-09-10T18:05:40.823 INFO:tasks.rados.rados.0.smithi012.stdout:2595: writing smithi01278544-28 from 2441216 to 3055616 tid 3 2024-09-10T18:05:40.823 INFO:tasks.rados.rados.0.smithi012.stdout:2596: setattr oid 27 current snap is 266 2024-09-10T18:05:40.823 INFO:tasks.rados.rados.0.smithi012.stdout:2593: finishing write tid 2 to smithi01278544-10 2024-09-10T18:05:40.823 INFO:tasks.rados.rados.0.smithi012.stdout:2594: expect (ObjNum 735 snap 238 seq_num 735) 2024-09-10T18:05:40.843 INFO:tasks.rados.rados.0.smithi012.stdout:2593: finishing write tid 3 to smithi01278544-10 2024-09-10T18:05:40.843 INFO:tasks.rados.rados.0.smithi012.stdout:2593: finishing write tid 4 to smithi01278544-10 2024-09-10T18:05:40.843 INFO:tasks.rados.rados.0.smithi012.stdout:2593: finishing write tid 5 to smithi01278544-10 2024-09-10T18:05:40.843 INFO:tasks.rados.rados.0.smithi012.stdout:2593: oid 10 updating version 0 to 1865 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2593: oid 10 version 1865 is already newer than 1862 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2593: oid 10 version 1865 is already newer than 1864 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2593: oid 10 version 1865 is already newer than 1863 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1865 (ObjNum 818 snap 266 seq_num 818) dirty exists 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2593: left oid 10 (ObjNum 818 snap 266 seq_num 818) 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2595: finishing write tid 1 to smithi01278544-28 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2595: finishing write tid 2 to smithi01278544-28 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2595: finishing write tid 3 to smithi01278544-28 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2595: finishing write tid 4 to smithi01278544-28 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2595: finishing write tid 5 to smithi01278544-28 2024-09-10T18:05:40.844 INFO:tasks.rados.rados.0.smithi012.stdout:2595: oid 28 updating version 0 to 1298 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2595: oid 28 updating version 1298 to 1300 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2595: oid 28 version 1300 is already newer than 1299 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2595: oid 28 updating version 1300 to 1301 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1301 (ObjNum 819 snap 266 seq_num 819) dirty exists 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2595: left oid 28 (ObjNum 819 snap 266 seq_num 819) 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2593: done (3 left) 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2594: done (2 left) 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2595: done (1 left) 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2597: copy_from oid 34 from oid 32 current snap is 266 2024-09-10T18:05:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:2598: snap_create 2024-09-10T18:05:40.848 INFO:tasks.rados.rados.0.smithi012.stdout:2597: finishing copy_from to smithi01278544-34 2024-09-10T18:05:40.848 INFO:tasks.rados.rados.0.smithi012.stdout:2597: got expected ENOENT (src dne) 2024-09-10T18:05:40.848 INFO:tasks.rados.rados.0.smithi012.stdout:2597: finishing copy_from racing read to smithi01278544-34 2024-09-10T18:05:40.848 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1286 (ObjNum 797 snap 262 seq_num 797) dirty exists 2024-09-10T18:05:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:05:41.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:40 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: pgmap v580: 121 pgs: 121 active+clean; 479 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 36 op/s 2024-09-10T18:05:41.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: osdmap e604: 8 total, 8 up, 8 in 2024-09-10T18:05:41.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:41.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:41.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.039 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:40 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:41.774 INFO:tasks.rados.rados.0.smithi012.stdout:2596: done (2 left) 2024-09-10T18:05:41.774 INFO:tasks.rados.rados.0.smithi012.stdout:2597: done (1 left) 2024-09-10T18:05:41.774 INFO:tasks.rados.rados.0.smithi012.stdout:2598: done (0 left) 2024-09-10T18:05:41.774 INFO:tasks.rados.rados.0.smithi012.stdout:2599: rollback oid 6 current snap is 267 2024-09-10T18:05:41.775 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 6 to 251 2024-09-10T18:05:41.775 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 267 2024-09-10T18:05:41.775 INFO:tasks.rados.rados.0.smithi012.stdout:2600: seq_num 820 ranges {770048=540672,1310720=475136,1785856=598016,2383872=131072} 2024-09-10T18:05:41.782 INFO:tasks.rados.rados.0.smithi012.stdout:2600: writing smithi01278544-9 from 770048 to 1310720 tid 1 2024-09-10T18:05:41.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:41 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T18:05:41.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:41 smithi012 ceph-mon[89611]: osdmap e605: 8 total, 8 up, 8 in 2024-09-10T18:05:41.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:41 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T18:05:41.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:41 smithi012 ceph-mon[92029]: osdmap e605: 8 total, 8 up, 8 in 2024-09-10T18:05:41.785 INFO:tasks.rados.rados.0.smithi012.stdout:2600: writing smithi01278544-9 from 1310720 to 1785856 tid 2 2024-09-10T18:05:41.788 INFO:tasks.rados.rados.0.smithi012.stdout:2600: writing smithi01278544-9 from 1785856 to 2383872 tid 3 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2600: writing smithi01278544-9 from 2383872 to 2514944 tid 4 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2601: copy_from oid 19 from oid 31 current snap is 267 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2599: finishing rollback tid 0 to smithi01278544-6 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2599: finishing rollback tid 1 to smithi01278544-6 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2599: finishing rollback tid 2 to smithi01278544-6 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 1132 (ObjNum 735 snap 238 seq_num 735) dirty exists 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2600: finishing write tid 1 to smithi01278544-9 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2600: finishing write tid 2 to smithi01278544-9 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2599: done (2 left) 2024-09-10T18:05:41.790 INFO:tasks.rados.rados.0.smithi012.stdout:2602: rollback oid 34 current snap is 267 2024-09-10T18:05:41.791 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 34 to 266 2024-09-10T18:05:41.791 INFO:tasks.rados.rados.0.smithi012.stdout:2603: delete oid 7 current snap is 267 2024-09-10T18:05:41.793 INFO:tasks.rados.rados.0.smithi012.stdout:2601: finishing copy_from to smithi01278544-19 2024-09-10T18:05:41.793 INFO:tasks.rados.rados.0.smithi012.stdout:2601: got expected ENOENT (src dne) 2024-09-10T18:05:41.794 INFO:tasks.rados.rados.0.smithi012.stdout:2600: finishing write tid 3 to smithi01278544-9 2024-09-10T18:05:41.795 INFO:tasks.rados.rados.0.smithi012.stdout:2601: finishing copy_from racing read to smithi01278544-19 2024-09-10T18:05:41.795 INFO:tasks.rados.rados.0.smithi012.stdout:2602: finishing rollback tid 0 to smithi01278544-34 2024-09-10T18:05:41.795 INFO:tasks.rados.rados.0.smithi012.stdout:2600: finishing write tid 4 to smithi01278544-9 2024-09-10T18:05:41.795 INFO:tasks.rados.rados.0.smithi012.stdout:2600: finishing write tid 5 to smithi01278544-9 2024-09-10T18:05:41.797 INFO:tasks.rados.rados.0.smithi012.stdout:2602: finishing rollback tid 1 to smithi01278544-34 2024-09-10T18:05:41.797 INFO:tasks.rados.rados.0.smithi012.stdout:2602: finishing rollback tid 2 to smithi01278544-34 2024-09-10T18:05:41.797 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1161 (ObjNum 813 snap 265 seq_num 813) dirty exists 2024-09-10T18:05:41.798 INFO:tasks.rados.rados.0.smithi012.stdout:2601: done (3 left) 2024-09-10T18:05:41.798 INFO:tasks.rados.rados.0.smithi012.stdout:2602: done (2 left) 2024-09-10T18:05:41.798 INFO:tasks.rados.rados.0.smithi012.stdout:2603: done (1 left) 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2604: read oid 22 snap -1 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2604: expect (ObjNum 753 snap 248 seq_num 753) 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2605: read oid 50 snap -1 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2605: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2606: delete oid 11 current snap is 267 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2600: finishing write tid 6 to smithi01278544-9 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2600: oid 9 updating version 0 to 1576 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2600: oid 9 updating version 1576 to 1579 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2600: oid 9 version 1579 is already newer than 1577 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2600: oid 9 version 1579 is already newer than 1578 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2600: oid 9 version 1579 is already newer than 1575 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1579 (ObjNum 820 snap 267 seq_num 820) dirty exists 2024-09-10T18:05:41.799 INFO:tasks.rados.rados.0.smithi012.stdout:2600: left oid 9 (ObjNum 820 snap 267 seq_num 820) 2024-09-10T18:05:41.803 INFO:tasks.rados.rados.0.smithi012.stdout:2605: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:05:41.840 INFO:tasks.rados.rados.0.smithi012.stdout:2604: expect (ObjNum 753 snap 248 seq_num 753) 2024-09-10T18:05:41.930 INFO:tasks.rados.rados.0.smithi012.stdout:2600: done (3 left) 2024-09-10T18:05:41.931 INFO:tasks.rados.rados.0.smithi012.stdout:2604: done (2 left) 2024-09-10T18:05:41.931 INFO:tasks.rados.rados.0.smithi012.stdout:2605: done (1 left) 2024-09-10T18:05:41.931 INFO:tasks.rados.rados.0.smithi012.stdout:2606: done (0 left) 2024-09-10T18:05:41.931 INFO:tasks.rados.rados.0.smithi012.stdout:2607: read oid 37 snap -1 2024-09-10T18:05:41.931 INFO:tasks.rados.rados.0.smithi012.stdout:2607: expect (ObjNum 814 snap 266 seq_num 814) 2024-09-10T18:05:41.931 INFO:tasks.rados.rados.0.smithi012.stdout:2608: read oid 22 snap -1 2024-09-10T18:05:41.931 INFO:tasks.rados.rados.0.smithi012.stdout:2608: expect (ObjNum 753 snap 248 seq_num 753) 2024-09-10T18:05:41.931 INFO:tasks.rados.rados.0.smithi012.stdout:2609: setattr oid 9 current snap is 267 2024-09-10T18:05:41.932 INFO:tasks.rados.rados.0.smithi012.stdout:2610: snap_create 2024-09-10T18:05:41.935 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 1580 (ObjNum 820 snap 267 seq_num 820) dirty exists 2024-09-10T18:05:41.937 INFO:tasks.rados.rados.0.smithi012.stdout:2607: expect (ObjNum 814 snap 266 seq_num 814) 2024-09-10T18:05:41.981 INFO:tasks.rados.rados.0.smithi012.stdout:2608: expect (ObjNum 753 snap 248 seq_num 753) 2024-09-10T18:05:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:41 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T18:05:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:41 smithi089 ceph-mon[84132]: osdmap e605: 8 total, 8 up, 8 in 2024-09-10T18:05:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:2607: done (3 left) 2024-09-10T18:05:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:2608: done (2 left) 2024-09-10T18:05:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:2609: done (1 left) 2024-09-10T18:05:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:2610: done (0 left) 2024-09-10T18:05:42.758 INFO:tasks.rados.rados.0.smithi012.stdout:2611: snap_remove snap 266 2024-09-10T18:05:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[89611]: pgmap v583: 121 pgs: 121 active+clean; 492 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 758 KiB/s wr, 14 op/s 2024-09-10T18:05:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[89611]: Upgrade: Updating alertmanager.a 2024-09-10T18:05:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[89611]: Deploying daemon alertmanager.a on smithi012 2024-09-10T18:05:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[89611]: osdmap e606: 8 total, 8 up, 8 in 2024-09-10T18:05:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[89611]: osdmap e607: 8 total, 8 up, 8 in 2024-09-10T18:05:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[92029]: pgmap v583: 121 pgs: 121 active+clean; 492 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 758 KiB/s wr, 14 op/s 2024-09-10T18:05:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[92029]: Upgrade: Updating alertmanager.a 2024-09-10T18:05:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[92029]: Deploying daemon alertmanager.a on smithi012 2024-09-10T18:05:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[92029]: osdmap e606: 8 total, 8 up, 8 in 2024-09-10T18:05:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:42 smithi012 ceph-mon[92029]: osdmap e607: 8 total, 8 up, 8 in 2024-09-10T18:05:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:42 smithi089 ceph-mon[84132]: pgmap v583: 121 pgs: 121 active+clean; 492 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 758 KiB/s wr, 14 op/s 2024-09-10T18:05:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:42 smithi089 ceph-mon[84132]: Upgrade: Updating alertmanager.a 2024-09-10T18:05:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:42 smithi089 ceph-mon[84132]: Deploying daemon alertmanager.a on smithi012 2024-09-10T18:05:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:42 smithi089 ceph-mon[84132]: osdmap e606: 8 total, 8 up, 8 in 2024-09-10T18:05:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:42 smithi089 ceph-mon[84132]: osdmap e607: 8 total, 8 up, 8 in 2024-09-10T18:05:43.758 INFO:tasks.rados.rados.0.smithi012.stdout:2611: done (0 left) 2024-09-10T18:05:43.759 INFO:tasks.rados.rados.0.smithi012.stdout:2612: read oid 30 snap 242 2024-09-10T18:05:43.759 INFO:tasks.rados.rados.0.smithi012.stdout:2612: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:05:43.759 INFO:tasks.rados.rados.0.smithi012.stdout:2613: snap_remove snap 235 2024-09-10T18:05:44.754 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:05:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:05:44] "GET /metrics HTTP/1.1" 200 36358 "" "Prometheus/2.51.0" 2024-09-10T18:05:44.766 INFO:tasks.rados.rados.0.smithi012.stdout:2613: done (1 left) 2024-09-10T18:05:44.766 INFO:tasks.rados.rados.0.smithi012.stdout:2614: snap_remove snap 227 2024-09-10T18:05:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:44 smithi012 ceph-mon[89611]: pgmap v586: 121 pgs: 121 active+clean; 496 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 254 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-09-10T18:05:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:44 smithi012 ceph-mon[89611]: osdmap e608: 8 total, 8 up, 8 in 2024-09-10T18:05:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:44 smithi012 ceph-mon[92029]: pgmap v586: 121 pgs: 121 active+clean; 496 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 254 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-09-10T18:05:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:44 smithi012 ceph-mon[92029]: osdmap e608: 8 total, 8 up, 8 in 2024-09-10T18:05:45.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:44 smithi089 ceph-mon[84132]: pgmap v586: 121 pgs: 121 active+clean; 496 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 254 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-09-10T18:05:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:44 smithi089 ceph-mon[84132]: osdmap e608: 8 total, 8 up, 8 in 2024-09-10T18:05:45.781 INFO:tasks.rados.rados.0.smithi012.stdout:2614: done (1 left) 2024-09-10T18:05:45.781 INFO:tasks.rados.rados.0.smithi012.stdout:2615: rmattr oid 43 current snap is 268 2024-09-10T18:05:45.782 INFO:tasks.rados.rados.0.smithi012.stdout:2612: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:05:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:45 smithi012 ceph-mon[89611]: osdmap e609: 8 total, 8 up, 8 in 2024-09-10T18:05:46.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:45 smithi012 ceph-mon[92029]: osdmap e609: 8 total, 8 up, 8 in 2024-09-10T18:05:46.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:45 smithi089 ceph-mon[84132]: osdmap e609: 8 total, 8 up, 8 in 2024-09-10T18:05:46.867 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:46 smithi012 ceph-mon[89611]: pgmap v589: 121 pgs: 121 active+clean; 500 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 254 KiB/s rd, 2.0 MiB/s wr, 19 op/s 2024-09-10T18:05:46.868 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:46 smithi012 ceph-mon[89611]: osdmap e610: 8 total, 8 up, 8 in 2024-09-10T18:05:46.868 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:46.868 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:46 smithi012 ceph-mon[92029]: pgmap v589: 121 pgs: 121 active+clean; 500 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 254 KiB/s rd, 2.0 MiB/s wr, 19 op/s 2024-09-10T18:05:46.868 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:46 smithi012 ceph-mon[92029]: osdmap e610: 8 total, 8 up, 8 in 2024-09-10T18:05:46.868 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:46 smithi089 ceph-mon[84132]: pgmap v589: 121 pgs: 121 active+clean; 500 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 254 KiB/s rd, 2.0 MiB/s wr, 19 op/s 2024-09-10T18:05:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:46 smithi089 ceph-mon[84132]: osdmap e610: 8 total, 8 up, 8 in 2024-09-10T18:05:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:05:47.668 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 1854 (ObjNum 798 snap 262 seq_num 798) dirty exists 2024-09-10T18:05:47.668 INFO:tasks.rados.rados.0.smithi012.stdout:2612: done (1 left) 2024-09-10T18:05:47.669 INFO:tasks.rados.rados.0.smithi012.stdout:2615: done (0 left) 2024-09-10T18:05:47.669 INFO:tasks.rados.rados.0.smithi012.stdout:2616: read oid 39 snap 247 2024-09-10T18:05:47.669 INFO:tasks.rados.rados.0.smithi012.stdout:2616: expect (ObjNum 663 snap 217 seq_num 663) 2024-09-10T18:05:47.669 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 268 2024-09-10T18:05:47.669 INFO:tasks.rados.rados.0.smithi012.stdout:2617: seq_num 823 ranges {0=589824,589824=573440,1163264=630784} 2024-09-10T18:05:47.671 INFO:tasks.rados.rados.0.smithi012.stdout:2617: writing smithi01278544-31 from 0 to 589824 tid 1 2024-09-10T18:05:47.675 INFO:tasks.rados.rados.0.smithi012.stdout:2617: writing smithi01278544-31 from 589824 to 1163264 tid 2 2024-09-10T18:05:47.679 INFO:tasks.rados.rados.0.smithi012.stdout:2617: writing smithi01278544-31 from 1163264 to 1794048 tid 3 2024-09-10T18:05:47.679 INFO:tasks.rados.rados.0.smithi012.stdout:2618: copy_from oid 14 from oid 35 current snap is 268 2024-09-10T18:05:47.679 INFO:tasks.rados.rados.0.smithi012.stdout:2617: finishing write tid 1 to smithi01278544-31 2024-09-10T18:05:47.679 INFO:tasks.rados.rados.0.smithi012.stdout:2617: finishing write tid 2 to smithi01278544-31 2024-09-10T18:05:47.679 INFO:tasks.rados.rados.0.smithi012.stdout:2619: read oid 43 snap -1 2024-09-10T18:05:47.679 INFO:tasks.rados.rados.0.smithi012.stdout:2619: expect (ObjNum 798 snap 262 seq_num 798) 2024-09-10T18:05:47.679 INFO:tasks.rados.rados.0.smithi012.stdout:2620: snap_create 2024-09-10T18:05:47.680 INFO:tasks.rados.rados.0.smithi012.stdout:2616: expect (ObjNum 663 snap 217 seq_num 663) 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2617: finishing write tid 3 to smithi01278544-31 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2617: finishing write tid 4 to smithi01278544-31 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2617: finishing write tid 5 to smithi01278544-31 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2617: oid 31 updating version 0 to 1321 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2617: oid 31 version 1321 is already newer than 1319 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2617: oid 31 version 1321 is already newer than 1320 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2617: oid 31 updating version 1321 to 1322 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 1322 (ObjNum 823 snap 268 seq_num 823) dirty exists 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2617: left oid 31 (ObjNum 823 snap 268 seq_num 823) 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2618: finishing copy_from racing read to smithi01278544-14 2024-09-10T18:05:47.766 INFO:tasks.rados.rados.0.smithi012.stdout:2616: done (4 left) 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:2617: done (3 left) 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:2620: done (2 left) 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:2621: rmattr oid 36 current snap is 269 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:2621: done (2 left) 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:2622: rollback oid 8 current snap is 269 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 8 to 224 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:2618: finishing copy_from to smithi01278544-14 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1159 (ObjNum 776 snap 255 seq_num 776) dirty exists 2024-09-10T18:05:47.767 INFO:tasks.rados.rados.0.smithi012.stdout:2619: expect (ObjNum 798 snap 262 seq_num 798) 2024-09-10T18:05:48.275 INFO:tasks.rados.rados.0.smithi012.stdout:2622: finishing rollback tid 1 to smithi01278544-8 2024-09-10T18:05:48.275 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1128 (ObjNum 129 snap 0 seq_num 3496441440) dirty dne 2024-09-10T18:05:48.275 INFO:tasks.rados.rados.0.smithi012.stdout:2618: done (2 left) 2024-09-10T18:05:48.275 INFO:tasks.rados.rados.0.smithi012.stdout:2619: done (1 left) 2024-09-10T18:05:48.275 INFO:tasks.rados.rados.0.smithi012.stdout:2622: done (0 left) 2024-09-10T18:05:48.275 INFO:tasks.rados.rados.0.smithi012.stdout:2623: delete oid 5 current snap is 269 2024-09-10T18:05:48.277 INFO:tasks.rados.rados.0.smithi012.stdout:2623: done (0 left) 2024-09-10T18:05:48.277 INFO:tasks.rados.rados.0.smithi012.stdout:2624: copy_from oid 45 from oid 47 current snap is 269 2024-09-10T18:05:48.277 INFO:tasks.rados.rados.0.smithi012.stdout:2625: snap_remove snap 268 2024-09-10T18:05:48.775 INFO:tasks.rados.rados.0.smithi012.stdout:2625: done (1 left) 2024-09-10T18:05:48.775 INFO:tasks.rados.rados.0.smithi012.stdout:2626: setattr oid 1 current snap is 269 2024-09-10T18:05:48.776 INFO:tasks.rados.rados.0.smithi012.stdout:2624: finishing copy_from to smithi01278544-45 2024-09-10T18:05:48.776 INFO:tasks.rados.rados.0.smithi012.stdout:2624: got expected ENOENT (src dne) 2024-09-10T18:05:48.776 INFO:tasks.rados.rados.0.smithi012.stdout:2624: finishing copy_from racing read to smithi01278544-45 2024-09-10T18:05:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:2624: done (1 left) 2024-09-10T18:05:48.777 INFO:tasks.rados.rados.0.smithi012.stdout:2627: snap_create 2024-09-10T18:05:48.782 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1581 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:05:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:48 smithi012 ceph-mon[89611]: pgmap v591: 121 pgs: 121 active+clean; 485 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.1 MiB/s rd, 785 KiB/s wr, 15 op/s 2024-09-10T18:05:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:48 smithi012 ceph-mon[89611]: osdmap e611: 8 total, 8 up, 8 in 2024-09-10T18:05:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:48 smithi012 ceph-mon[92029]: pgmap v591: 121 pgs: 121 active+clean; 485 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.1 MiB/s rd, 785 KiB/s wr, 15 op/s 2024-09-10T18:05:49.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:48 smithi012 ceph-mon[92029]: osdmap e611: 8 total, 8 up, 8 in 2024-09-10T18:05:49.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:48 smithi089 ceph-mon[84132]: pgmap v591: 121 pgs: 121 active+clean; 485 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.1 MiB/s rd, 785 KiB/s wr, 15 op/s 2024-09-10T18:05:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:48 smithi089 ceph-mon[84132]: osdmap e611: 8 total, 8 up, 8 in 2024-09-10T18:05:49.781 INFO:tasks.rados.rados.0.smithi012.stdout:2626: done (1 left) 2024-09-10T18:05:49.782 INFO:tasks.rados.rados.0.smithi012.stdout:2627: done (0 left) 2024-09-10T18:05:49.782 INFO:tasks.rados.rados.0.smithi012.stdout:2628: snap_remove snap 196 2024-09-10T18:05:49.950 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:49 smithi012 ceph-mon[89611]: osdmap e612: 8 total, 8 up, 8 in 2024-09-10T18:05:49.950 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:49 smithi012 ceph-mon[92029]: osdmap e612: 8 total, 8 up, 8 in 2024-09-10T18:05:49.951 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:49 smithi012 systemd[1]: Stopping Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:05:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:49 smithi089 ceph-mon[84132]: osdmap e612: 8 total, 8 up, 8 in 2024-09-10T18:05:50.276 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[74428]: ts=2024-09-10T18:05:49.948Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-10T18:05:50.276 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:49 smithi012 podman[125531]: 2024-09-10 18:05:49.99967151 +0000 UTC m=+0.174084175 container died 24404959babd19984f0525fb8bbe3b5faedc4900f8116f1b49e719bd8b5bed68 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:50.534 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:50 smithi012 podman[125531]: 2024-09-10 18:05:50.374400913 +0000 UTC m=+0.548813577 container cleanup 24404959babd19984f0525fb8bbe3b5faedc4900f8116f1b49e719bd8b5bed68 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:50.534 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:50 smithi012 bash[125531]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a 2024-09-10T18:05:50.792 INFO:tasks.rados.rados.0.smithi012.stdout:2628: done (0 left) 2024-09-10T18:05:50.837 INFO:tasks.rados.rados.0.smithi012.stdout:2629: delete oid 29 current snap is 270 2024-09-10T18:05:50.839 INFO:tasks.rados.rados.0.smithi012.stdout:2629: done (0 left) 2024-09-10T18:05:50.839 INFO:tasks.rados.rados.0.smithi012.stdout:2630: copy_from oid 14 from oid 22 current snap is 270 2024-09-10T18:05:50.840 INFO:tasks.rados.rados.0.smithi012.stdout:2631: delete oid 40 current snap is 270 2024-09-10T18:05:50.840 INFO:tasks.rados.rados.0.smithi012.stdout:2631: done (1 left) 2024-09-10T18:05:50.840 INFO:tasks.rados.rados.0.smithi012.stdout:2632: delete oid 21 current snap is 270 2024-09-10T18:05:50.840 INFO:tasks.rados.rados.0.smithi012.stdout:2632: done (1 left) 2024-09-10T18:05:50.840 INFO:tasks.rados.rados.0.smithi012.stdout:2633: rmattr oid 28 current snap is 270 2024-09-10T18:05:50.840 INFO:tasks.rados.rados.0.smithi012.stdout:2633: done (1 left) 2024-09-10T18:05:50.840 INFO:tasks.rados.rados.0.smithi012.stdout:2634: read oid 7 snap 265 2024-09-10T18:05:50.840 INFO:tasks.rados.rados.0.smithi012.stdout:2634: expect (ObjNum 744 snap 241 seq_num 744) 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2635: delete oid 18 current snap is 270 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2630: finishing copy_from racing read to smithi01278544-14 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2630: finishing copy_from to smithi01278544-14 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1729 (ObjNum 753 snap 248 seq_num 753) dirty exists 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2630: done (2 left) 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2635: done (1 left) 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 270 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2636: seq_num 829 ranges {0=688128,688128=729088,1417216=475136} 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2636: writing smithi01278544-48 from 0 to 688128 tid 1 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2636: writing smithi01278544-48 from 688128 to 1417216 tid 2 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2636: writing smithi01278544-48 from 1417216 to 1892352 tid 3 2024-09-10T18:05:50.841 INFO:tasks.rados.rados.0.smithi012.stdout:2637: snap_remove snap 267 2024-09-10T18:05:50.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:50 smithi012 ceph-mon[89611]: pgmap v594: 121 pgs: 121 active+clean; 470 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T18:05:50.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:50 smithi012 ceph-mon[89611]: osdmap e613: 8 total, 8 up, 8 in 2024-09-10T18:05:50.953 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:50 smithi012 podman[125544]: 2024-09-10 18:05:50.658971826 +0000 UTC m=+0.655021047 container remove 24404959babd19984f0525fb8bbe3b5faedc4900f8116f1b49e719bd8b5bed68 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:50.954 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:50 smithi012 podman[125544]: 2024-09-10 18:05:50.734488242 +0000 UTC m=+0.730537463 volume remove a3d7d561d605e3f20d11e7b1fc75c7338c0394473450c54ece407eda5890b0f9 2024-09-10T18:05:50.954 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:50 smithi012 ceph-mon[92029]: pgmap v594: 121 pgs: 121 active+clean; 470 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T18:05:50.954 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:50 smithi012 ceph-mon[92029]: osdmap e613: 8 total, 8 up, 8 in 2024-09-10T18:05:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:50 smithi089 ceph-mon[84132]: pgmap v594: 121 pgs: 121 active+clean; 470 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T18:05:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:50 smithi089 ceph-mon[84132]: osdmap e613: 8 total, 8 up, 8 in 2024-09-10T18:05:51.249 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:50 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-10T18:05:51.249 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:50 smithi012 systemd[1]: Stopped Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:05:51.250 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:50 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@alertmanager.a.service: Consumed 1.539s CPU time. 2024-09-10T18:05:51.534 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:51 smithi012 systemd[1]: Starting Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:05:51.534 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:51 smithi012 podman[125668]: 2024-09-10 18:05:51.360376046 +0000 UTC m=+0.016531234 image pull 11f11916f8cdfb17c1da74b20deb2075d778357b4d60474d82453303f8d461f5 quay.io/prometheus/alertmanager:v0.27.0 2024-09-10T18:05:51.797 INFO:tasks.rados.rados.0.smithi012.stdout:2637: done (2 left) 2024-09-10T18:05:51.797 INFO:tasks.rados.rados.0.smithi012.stdout:2638: snap_remove snap 247 2024-09-10T18:05:51.860 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:51 smithi012 ceph-mon[89611]: osdmap e614: 8 total, 8 up, 8 in 2024-09-10T18:05:51.861 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:51 smithi012 podman[125668]: 2024-09-10 18:05:51.586447318 +0000 UTC m=+0.242603058 volume create e2acfcdcad8e402a79ee9d20d0d731c5ffebc2b35a6f3930b983f9dc0b70d594 2024-09-10T18:05:51.861 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:51 smithi012 podman[125668]: 2024-09-10 18:05:51.670092414 +0000 UTC m=+0.326247656 container create eb5017cfa54234828b30d6bab5f8725f88047e14560a4814382006172e5a82b2 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:51.861 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:51 smithi012 ceph-mon[92029]: osdmap e614: 8 total, 8 up, 8 in 2024-09-10T18:05:52.284 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:51 smithi012 podman[125668]: 2024-09-10 18:05:51.98986825 +0000 UTC m=+0.646023438 container init eb5017cfa54234828b30d6bab5f8725f88047e14560a4814382006172e5a82b2 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:52.285 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:51 smithi012 podman[125668]: 2024-09-10 18:05:51.993205047 +0000 UTC m=+0.649360234 container start eb5017cfa54234828b30d6bab5f8725f88047e14560a4814382006172e5a82b2 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:05:52.285 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:52.004Z caller=main.go:181 level=info msg="Starting Alertmanager" version="(version=0.27.0, branch=HEAD, revision=0aa3c2aad14cff039931923ab16b26b7481783b5)" 2024-09-10T18:05:52.285 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:52.004Z caller=main.go:182 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@22cd11f671e9, date=20240228-11:51:20, tags=netgo)" 2024-09-10T18:05:52.285 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:52.005Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.12 port=9094 2024-09-10T18:05:52.285 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:52.006Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-10T18:05:52.286 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:52.029Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-10T18:05:52.286 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:52.029Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-10T18:05:52.286 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:52.031Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9093 2024-09-10T18:05:52.286 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:52.031Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-10T18:05:52.286 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 bash[125668]: eb5017cfa54234828b30d6bab5f8725f88047e14560a4814382006172e5a82b2 2024-09-10T18:05:52.286 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:52 smithi012 systemd[1]: Started Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:05:52.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:51 smithi089 ceph-mon[84132]: osdmap e614: 8 total, 8 up, 8 in 2024-09-10T18:05:52.767 INFO:tasks.rados.rados.0.smithi012.stdout:2638: done (2 left) 2024-09-10T18:05:52.768 INFO:tasks.rados.rados.0.smithi012.stdout:2639: delete oid 31 current snap is 270 2024-09-10T18:05:52.768 INFO:tasks.rados.rados.0.smithi012.stdout:2636: finishing write tid 1 to smithi01278544-48 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: finishing write tid 2 to smithi01278544-48 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: finishing write tid 3 to smithi01278544-48 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: finishing write tid 4 to smithi01278544-48 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: finishing write tid 5 to smithi01278544-48 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: oid 48 updating version 0 to 1582 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: oid 48 updating version 1582 to 1583 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: oid 48 updating version 1583 to 1584 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: oid 48 updating version 1584 to 1585 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 1585 (ObjNum 829 snap 270 seq_num 829) dirty exists 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2636: left oid 48 (ObjNum 829 snap 270 seq_num 829) 2024-09-10T18:05:52.769 INFO:tasks.rados.rados.0.smithi012.stdout:2634: expect (ObjNum 744 snap 241 seq_num 744) 2024-09-10T18:05:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[92029]: pgmap v597: 121 pgs: 121 active+clean; 470 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 438 KiB/s wr, 2 op/s 2024-09-10T18:05:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[92029]: osdmap e615: 8 total, 8 up, 8 in 2024-09-10T18:05:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:53.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:53.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:53.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[92029]: osdmap e616: 8 total, 8 up, 8 in 2024-09-10T18:05:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[89611]: pgmap v597: 121 pgs: 121 active+clean; 470 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 438 KiB/s wr, 2 op/s 2024-09-10T18:05:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[89611]: osdmap e615: 8 total, 8 up, 8 in 2024-09-10T18:05:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:52 smithi012 ceph-mon[89611]: osdmap e616: 8 total, 8 up, 8 in 2024-09-10T18:05:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:52 smithi089 ceph-mon[84132]: pgmap v597: 121 pgs: 121 active+clean; 470 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 438 KiB/s wr, 2 op/s 2024-09-10T18:05:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:52 smithi089 ceph-mon[84132]: osdmap e615: 8 total, 8 up, 8 in 2024-09-10T18:05:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:52 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:52 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:52 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:52 smithi089 ceph-mon[84132]: osdmap e616: 8 total, 8 up, 8 in 2024-09-10T18:05:53.484 INFO:tasks.rados.rados.0.smithi012.stdout:2634: done (2 left) 2024-09-10T18:05:53.484 INFO:tasks.rados.rados.0.smithi012.stdout:2636: done (1 left) 2024-09-10T18:05:53.484 INFO:tasks.rados.rados.0.smithi012.stdout:2639: done (0 left) 2024-09-10T18:05:53.485 INFO:tasks.rados.rados.0.smithi012.stdout:2640: delete oid 19 current snap is 270 2024-09-10T18:05:53.488 INFO:tasks.rados.rados.0.smithi012.stdout:2640: done (0 left) 2024-09-10T18:05:53.488 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 270 2024-09-10T18:05:53.488 INFO:tasks.rados.rados.0.smithi012.stdout:2641: seq_num 832 ranges {0=737280,737280=786432,1523712=417792} 2024-09-10T18:05:53.493 INFO:tasks.rados.rados.0.smithi012.stdout:2641: writing smithi01278544-18 from 0 to 737280 tid 1 2024-09-10T18:05:53.499 INFO:tasks.rados.rados.0.smithi012.stdout:2641: writing smithi01278544-18 from 737280 to 1523712 tid 2 2024-09-10T18:05:53.503 INFO:tasks.rados.rados.0.smithi012.stdout:2641: writing smithi01278544-18 from 1523712 to 1941504 tid 3 2024-09-10T18:05:53.503 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 270 2024-09-10T18:05:53.503 INFO:tasks.rados.rados.0.smithi012.stdout:2641: finishing write tid 1 to smithi01278544-18 2024-09-10T18:05:53.503 INFO:tasks.rados.rados.0.smithi012.stdout:2642: seq_num 833 ranges {2310144=761856,3072000=671744,3743744=532480} 2024-09-10T18:05:53.520 INFO:tasks.rados.rados.0.smithi012.stdout:2642: writing smithi01278544-14 from 2310144 to 3072000 tid 1 2024-09-10T18:05:53.524 INFO:tasks.rados.rados.0.smithi012.stdout:2642: writing smithi01278544-14 from 3072000 to 3743744 tid 2 2024-09-10T18:05:53.528 INFO:tasks.rados.rados.0.smithi012.stdout:2642: writing smithi01278544-14 from 3743744 to 4276224 tid 3 2024-09-10T18:05:53.528 INFO:tasks.rados.rados.0.smithi012.stdout:2643: delete oid 35 current snap is 270 2024-09-10T18:05:53.528 INFO:tasks.rados.rados.0.smithi012.stdout:2641: finishing write tid 2 to smithi01278544-18 2024-09-10T18:05:53.529 INFO:tasks.rados.rados.0.smithi012.stdout:2641: finishing write tid 3 to smithi01278544-18 2024-09-10T18:05:53.529 INFO:tasks.rados.rados.0.smithi012.stdout:2641: finishing write tid 4 to smithi01278544-18 2024-09-10T18:05:53.529 INFO:tasks.rados.rados.0.smithi012.stdout:2641: finishing write tid 5 to smithi01278544-18 2024-09-10T18:05:53.529 INFO:tasks.rados.rados.0.smithi012.stdout:2641: oid 18 updating version 0 to 1580 2024-09-10T18:05:53.529 INFO:tasks.rados.rados.0.smithi012.stdout:2641: oid 18 updating version 1580 to 1581 2024-09-10T18:05:53.529 INFO:tasks.rados.rados.0.smithi012.stdout:2641: oid 18 version 1581 is already newer than 1579 2024-09-10T18:05:53.529 INFO:tasks.rados.rados.0.smithi012.stdout:2641: oid 18 version 1581 is already newer than 1578 2024-09-10T18:05:53.530 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 1581 (ObjNum 832 snap 270 seq_num 832) dirty exists 2024-09-10T18:05:53.530 INFO:tasks.rados.rados.0.smithi012.stdout:2641: left oid 18 (ObjNum 832 snap 270 seq_num 832) 2024-09-10T18:05:53.530 INFO:tasks.rados.rados.0.smithi012.stdout:2642: finishing write tid 1 to smithi01278544-14 2024-09-10T18:05:53.530 INFO:tasks.rados.rados.0.smithi012.stdout:2641: done (2 left) 2024-09-10T18:05:53.530 INFO:tasks.rados.rados.0.smithi012.stdout:2643: done (1 left) 2024-09-10T18:05:53.530 INFO:tasks.rados.rados.0.smithi012.stdout:2644: setattr oid 35 current snap is 270 2024-09-10T18:05:53.531 INFO:tasks.rados.rados.0.smithi012.stdout:2642: finishing write tid 2 to smithi01278544-14 2024-09-10T18:05:53.532 INFO:tasks.rados.rados.0.smithi012.stdout:2642: finishing write tid 3 to smithi01278544-14 2024-09-10T18:05:53.532 INFO:tasks.rados.rados.0.smithi012.stdout:2642: finishing write tid 4 to smithi01278544-14 2024-09-10T18:05:53.532 INFO:tasks.rados.rados.0.smithi012.stdout:2645: copy_from oid 26 from oid 1 current snap is 270 2024-09-10T18:05:53.532 INFO:tasks.rados.rados.0.smithi012.stdout:2646: copy_from oid 17 from oid 29 current snap is 270 2024-09-10T18:05:53.533 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 270 2024-09-10T18:05:53.533 INFO:tasks.rados.rados.0.smithi012.stdout:2647: seq_num 835 ranges {2179072=794624,2973696=442368,3416064=712704,4128768=49152} 2024-09-10T18:05:53.550 INFO:tasks.rados.rados.0.smithi012.stdout:2647: writing smithi01278544-27 from 2179072 to 2973696 tid 1 2024-09-10T18:05:53.553 INFO:tasks.rados.rados.0.smithi012.stdout:2647: writing smithi01278544-27 from 2973696 to 3416064 tid 2 2024-09-10T18:05:53.557 INFO:tasks.rados.rados.0.smithi012.stdout:2647: writing smithi01278544-27 from 3416064 to 4128768 tid 3 2024-09-10T18:05:53.558 INFO:tasks.rados.rados.0.smithi012.stdout:2647: writing smithi01278544-27 from 4128768 to 4177920 tid 4 2024-09-10T18:05:53.558 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 270 2024-09-10T18:05:53.558 INFO:tasks.rados.rados.0.smithi012.stdout:2648: seq_num 836 ranges {12460032=409600,12869632=720896,13590528=516096,14106624=368640} 2024-09-10T18:05:53.628 INFO:tasks.rados.rados.0.smithi012.stdout:2648: writing smithi01278544-2 from 12460032 to 12869632 tid 1 2024-09-10T18:05:53.632 INFO:tasks.rados.rados.0.smithi012.stdout:2648: writing smithi01278544-2 from 12869632 to 13590528 tid 2 2024-09-10T18:05:53.635 INFO:tasks.rados.rados.0.smithi012.stdout:2648: writing smithi01278544-2 from 13590528 to 14106624 tid 3 2024-09-10T18:05:53.638 INFO:tasks.rados.rados.0.smithi012.stdout:2648: writing smithi01278544-2 from 14106624 to 14475264 tid 4 2024-09-10T18:05:53.638 INFO:tasks.rados.rados.0.smithi012.stdout:2649: read oid 9 snap -1 2024-09-10T18:05:53.638 INFO:tasks.rados.rados.0.smithi012.stdout:2649: expect (ObjNum 820 snap 267 seq_num 820) 2024-09-10T18:05:53.638 INFO:tasks.rados.rados.0.smithi012.stdout:2646: finishing copy_from to smithi01278544-17 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2646: got expected ENOENT (src dne) 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2646: finishing copy_from racing read to smithi01278544-17 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2642: finishing write tid 5 to smithi01278544-14 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2642: oid 14 updating version 0 to 1898 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2642: oid 14 version 1898 is already newer than 1896 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2642: oid 14 version 1898 is already newer than 1895 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2642: oid 14 version 1898 is already newer than 1897 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1898 (ObjNum 833 snap 270 seq_num 833) dirty exists 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2642: left oid 14 (ObjNum 833 snap 270 seq_num 833) 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1161 (ObjNum 4113 snap 0 seq_num 1491291516) dirty exists 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2645: finishing copy_from racing read to smithi01278544-26 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:2645: finishing copy_from to smithi01278544-26 2024-09-10T18:05:53.639 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 1581 (ObjNum 33 snap 0 seq_num 3496452096) dirty exists 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: finishing write tid 1 to smithi01278544-27 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: finishing write tid 2 to smithi01278544-27 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: finishing write tid 3 to smithi01278544-27 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: finishing write tid 4 to smithi01278544-27 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: finishing write tid 5 to smithi01278544-27 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: finishing write tid 6 to smithi01278544-27 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: oid 27 updating version 0 to 1289 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: oid 27 updating version 1289 to 1291 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: oid 27 version 1291 is already newer than 1287 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: oid 27 version 1291 is already newer than 1288 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: oid 27 version 1291 is already newer than 1290 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1291 (ObjNum 835 snap 270 seq_num 835) dirty exists 2024-09-10T18:05:53.640 INFO:tasks.rados.rados.0.smithi012.stdout:2647: left oid 27 (ObjNum 835 snap 270 seq_num 835) 2024-09-10T18:05:53.641 INFO:tasks.rados.rados.0.smithi012.stdout:2648: finishing write tid 1 to smithi01278544-2 2024-09-10T18:05:53.641 INFO:tasks.rados.rados.0.smithi012.stdout:2642: done (6 left) 2024-09-10T18:05:53.641 INFO:tasks.rados.rados.0.smithi012.stdout:2644: done (5 left) 2024-09-10T18:05:53.641 INFO:tasks.rados.rados.0.smithi012.stdout:2645: done (4 left) 2024-09-10T18:05:53.641 INFO:tasks.rados.rados.0.smithi012.stdout:2646: done (3 left) 2024-09-10T18:05:53.641 INFO:tasks.rados.rados.0.smithi012.stdout:2647: done (2 left) 2024-09-10T18:05:53.641 INFO:tasks.rados.rados.0.smithi012.stdout:2650: snap_remove snap 254 2024-09-10T18:05:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:2650: done (2 left) 2024-09-10T18:05:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 270 2024-09-10T18:05:53.804 INFO:tasks.rados.rados.0.smithi012.stdout:2651: seq_num 837 ranges {4177920=425984,4603904=655360,5259264=729088,5988352=221184} 2024-09-10T18:05:53.832 INFO:tasks.rados.rados.0.smithi012.stdout:2651: writing smithi01278544-27 from 4177920 to 4603904 tid 1 2024-09-10T18:05:53.837 INFO:tasks.rados.rados.0.smithi012.stdout:2651: writing smithi01278544-27 from 4603904 to 5259264 tid 2 2024-09-10T18:05:53.842 INFO:tasks.rados.rados.0.smithi012.stdout:2651: writing smithi01278544-27 from 5259264 to 5988352 tid 3 2024-09-10T18:05:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:2651: writing smithi01278544-27 from 5988352 to 6209536 tid 4 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2652: rollback oid 7 current snap is 270 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 7 to 261 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: finishing write tid 2 to smithi01278544-2 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: finishing write tid 3 to smithi01278544-2 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: finishing write tid 4 to smithi01278544-2 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: finishing write tid 5 to smithi01278544-2 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: finishing write tid 6 to smithi01278544-2 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: oid 2 updating version 0 to 1586 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: oid 2 version 1586 is already newer than 1582 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: oid 2 version 1586 is already newer than 1584 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: oid 2 version 1586 is already newer than 1583 2024-09-10T18:05:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:2648: oid 2 version 1586 is already newer than 1585 2024-09-10T18:05:53.846 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1586 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:05:53.846 INFO:tasks.rados.rados.0.smithi012.stdout:2648: left oid 2 (ObjNum 836 snap 270 seq_num 836) 2024-09-10T18:05:53.846 INFO:tasks.rados.rados.0.smithi012.stdout:2649: expect (ObjNum 820 snap 267 seq_num 820) 2024-09-10T18:05:53.928 INFO:tasks.rados.rados.0.smithi012.stdout:2651: finishing write tid 1 to smithi01278544-27 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2651: finishing write tid 2 to smithi01278544-27 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2648: done (3 left) 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2649: done (2 left) 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2653: setattr oid 36 current snap is 270 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2651: finishing write tid 3 to smithi01278544-27 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2651: finishing write tid 4 to smithi01278544-27 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2652: finishing rollback tid 1 to smithi01278544-7 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2652: finishing rollback tid 2 to smithi01278544-7 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1116 (ObjNum 744 snap 241 seq_num 744) dirty exists 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2651: finishing write tid 5 to smithi01278544-27 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2651: finishing write tid 6 to smithi01278544-27 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2651: oid 27 updating version 0 to 1294 2024-09-10T18:05:53.929 INFO:tasks.rados.rados.0.smithi012.stdout:2651: oid 27 version 1294 is already newer than 1293 2024-09-10T18:05:53.930 INFO:tasks.rados.rados.0.smithi012.stdout:2651: oid 27 version 1294 is already newer than 1292 2024-09-10T18:05:53.930 INFO:tasks.rados.rados.0.smithi012.stdout:2651: oid 27 updating version 1294 to 1295 2024-09-10T18:05:53.930 INFO:tasks.rados.rados.0.smithi012.stdout:2651: oid 27 updating version 1295 to 1296 2024-09-10T18:05:53.930 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1296 (ObjNum 837 snap 270 seq_num 837) dirty exists 2024-09-10T18:05:53.930 INFO:tasks.rados.rados.0.smithi012.stdout:2651: left oid 27 (ObjNum 837 snap 270 seq_num 837) 2024-09-10T18:05:53.930 INFO:tasks.rados.rados.0.smithi012.stdout:2651: done (2 left) 2024-09-10T18:05:53.931 INFO:tasks.rados.rados.0.smithi012.stdout:2652: done (1 left) 2024-09-10T18:05:53.931 INFO:tasks.rados.rados.0.smithi012.stdout:2654: rollback oid 3 current snap is 270 2024-09-10T18:05:53.931 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 261 2024-09-10T18:05:53.931 INFO:tasks.rados.rados.0.smithi012.stdout:2655: snap_create 2024-09-10T18:05:53.932 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 1582 (ObjNum 65 snap 0 seq_num 1869640805) dirty exists 2024-09-10T18:05:53.934 INFO:tasks.rados.rados.0.smithi012.stdout:2654: finishing rollback tid 0 to smithi01278544-3 2024-09-10T18:05:53.934 INFO:tasks.rados.rados.0.smithi012.stdout:2654: finishing rollback tid 1 to smithi01278544-3 2024-09-10T18:05:53.934 INFO:tasks.rados.rados.0.smithi012.stdout:2654: finishing rollback tid 2 to smithi01278544-3 2024-09-10T18:05:53.935 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1299 (ObjNum 760 snap 248 seq_num 760) dirty exists 2024-09-10T18:05:54.034 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:05:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:05:54.007Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000163099s 2024-09-10T18:05:54.588 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:05:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:05:54] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.51.0" 2024-09-10T18:05:54.805 INFO:tasks.rados.rados.0.smithi012.stdout:2653: done (2 left) 2024-09-10T18:05:54.805 INFO:tasks.rados.rados.0.smithi012.stdout:2654: done (1 left) 2024-09-10T18:05:54.805 INFO:tasks.rados.rados.0.smithi012.stdout:2655: done (0 left) 2024-09-10T18:05:54.806 INFO:tasks.rados.rados.0.smithi012.stdout:2656: rollback oid 14 current snap is 271 2024-09-10T18:05:54.806 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 14 to 256 2024-09-10T18:05:54.806 INFO:tasks.rados.rados.0.smithi012.stdout:2657: snap_create 2024-09-10T18:05:54.812 INFO:tasks.rados.rados.0.smithi012.stdout:2656: finishing rollback tid 0 to smithi01278544-14 2024-09-10T18:05:54.812 INFO:tasks.rados.rados.0.smithi012.stdout:2656: finishing rollback tid 1 to smithi01278544-14 2024-09-10T18:05:54.813 INFO:tasks.rados.rados.0.smithi012.stdout:2656: finishing rollback tid 2 to smithi01278544-14 2024-09-10T18:05:54.813 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1908 (ObjNum 545 snap 183 seq_num 545) dirty exists 2024-09-10T18:05:54.911 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:54 smithi012 ceph-mon[89611]: pgmap v600: 121 pgs: 121 active+clean; 402 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 6 op/s 2024-09-10T18:05:54.912 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:54 smithi012 ceph-mon[89611]: osdmap e617: 8 total, 8 up, 8 in 2024-09-10T18:05:54.912 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:54 smithi012 ceph-mon[92029]: pgmap v600: 121 pgs: 121 active+clean; 402 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 6 op/s 2024-09-10T18:05:54.912 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:54 smithi012 ceph-mon[92029]: osdmap e617: 8 total, 8 up, 8 in 2024-09-10T18:05:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:54 smithi089 ceph-mon[84132]: pgmap v600: 121 pgs: 121 active+clean; 402 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 6 op/s 2024-09-10T18:05:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:54 smithi089 ceph-mon[84132]: osdmap e617: 8 total, 8 up, 8 in 2024-09-10T18:05:55.811 INFO:tasks.rados.rados.0.smithi012.stdout:2656: done (1 left) 2024-09-10T18:05:55.811 INFO:tasks.rados.rados.0.smithi012.stdout:2657: done (0 left) 2024-09-10T18:05:55.811 INFO:tasks.rados.rados.0.smithi012.stdout:2658: read oid 49 snap -1 2024-09-10T18:05:55.811 INFO:tasks.rados.rados.0.smithi012.stdout:2658: expect (ObjNum 721 snap 235 seq_num 721) 2024-09-10T18:05:55.811 INFO:tasks.rados.rados.0.smithi012.stdout:2659: rmattr oid 6 current snap is 272 2024-09-10T18:05:55.812 INFO:tasks.rados.rados.0.smithi012.stdout:2659: done (1 left) 2024-09-10T18:05:55.812 INFO:tasks.rados.rados.0.smithi012.stdout:2660: rollback oid 28 current snap is 272 2024-09-10T18:05:55.812 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 28 to 242 2024-09-10T18:05:55.812 INFO:tasks.rados.rados.0.smithi012.stdout:2661: copy_from oid 34 from oid 35 current snap is 272 2024-09-10T18:05:55.812 INFO:tasks.rados.rados.0.smithi012.stdout:2662: delete oid 27 current snap is 272 2024-09-10T18:05:55.815 INFO:tasks.rados.rados.0.smithi012.stdout:2661: finishing copy_from racing read to smithi01278544-34 2024-09-10T18:05:55.815 INFO:tasks.rados.rados.0.smithi012.stdout:2660: finishing rollback tid 0 to smithi01278544-28 2024-09-10T18:05:55.817 INFO:tasks.rados.rados.0.smithi012.stdout:2661: finishing copy_from to smithi01278544-34 2024-09-10T18:05:55.817 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1161 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:05:55.817 INFO:tasks.rados.rados.0.smithi012.stdout:2661: done (3 left) 2024-09-10T18:05:55.818 INFO:tasks.rados.rados.0.smithi012.stdout:2662: done (2 left) 2024-09-10T18:05:55.818 INFO:tasks.rados.rados.0.smithi012.stdout:2663: read oid 26 snap 261 2024-09-10T18:05:55.818 INFO:tasks.rados.rados.0.smithi012.stdout:2663: expect (ObjNum 696 snap 225 seq_num 696) 2024-09-10T18:05:55.818 INFO:tasks.rados.rados.0.smithi012.stdout:2664: rmattr oid 6 current snap is 272 2024-09-10T18:05:55.818 INFO:tasks.rados.rados.0.smithi012.stdout:2664: done (3 left) 2024-09-10T18:05:55.818 INFO:tasks.rados.rados.0.smithi012.stdout:2665: snap_remove snap 222 2024-09-10T18:05:56.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:55 smithi012 ceph-mon[89611]: osdmap e618: 8 total, 8 up, 8 in 2024-09-10T18:05:56.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:55 smithi012 ceph-mon[89611]: pgmap v603: 121 pgs: 121 active+clean; 369 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2024-09-10T18:05:56.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:56.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:55 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:55 smithi012 ceph-mon[92029]: osdmap e618: 8 total, 8 up, 8 in 2024-09-10T18:05:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:55 smithi012 ceph-mon[92029]: pgmap v603: 121 pgs: 121 active+clean; 369 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2024-09-10T18:05:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:55 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:55 smithi089 ceph-mon[84132]: osdmap e618: 8 total, 8 up, 8 in 2024-09-10T18:05:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:55 smithi089 ceph-mon[84132]: pgmap v603: 121 pgs: 121 active+clean; 369 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2024-09-10T18:05:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:55 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:56.818 INFO:tasks.rados.rados.0.smithi012.stdout:2665: done (3 left) 2024-09-10T18:05:56.818 INFO:tasks.rados.rados.0.smithi012.stdout:2666: snap_remove snap 270 2024-09-10T18:05:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:56 smithi012 ceph-mon[89611]: osdmap e619: 8 total, 8 up, 8 in 2024-09-10T18:05:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:56 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:56 smithi012 ceph-mon[92029]: osdmap e619: 8 total, 8 up, 8 in 2024-09-10T18:05:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:56 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:57.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:56 smithi089 ceph-mon[84132]: osdmap e619: 8 total, 8 up, 8 in 2024-09-10T18:05:57.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:57.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:56 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:57.766 INFO:tasks.rados.rados.0.smithi012.stdout:2666: done (3 left) 2024-09-10T18:05:57.766 INFO:tasks.rados.rados.0.smithi012.stdout:2667: rmattr oid 1 current snap is 272 2024-09-10T18:05:57.766 INFO:tasks.rados.rados.0.smithi012.stdout:2660: finishing rollback tid 1 to smithi01278544-28 2024-09-10T18:05:57.766 INFO:tasks.rados.rados.0.smithi012.stdout:2660: finishing rollback tid 2 to smithi01278544-28 2024-09-10T18:05:57.766 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1304 (ObjNum 658 snap 214 seq_num 658) dirty exists 2024-09-10T18:05:57.766 INFO:tasks.rados.rados.0.smithi012.stdout:2658: expect (ObjNum 721 snap 235 seq_num 721) 2024-09-10T18:05:57.847 INFO:tasks.rados.rados.0.smithi012.stdout:2663: expect (ObjNum 696 snap 225 seq_num 696) 2024-09-10T18:05:57.966 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:57 smithi012 ceph-mon[89611]: osdmap e620: 8 total, 8 up, 8 in 2024-09-10T18:05:57.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:57 smithi012 ceph-mon[89611]: pgmap v606: 121 pgs: 121 active+clean; 383 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 17 op/s 2024-09-10T18:05:57.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:57 smithi012 ceph-mon[89611]: osdmap e621: 8 total, 8 up, 8 in 2024-09-10T18:05:57.967 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:57 smithi012 ceph-mon[92029]: osdmap e620: 8 total, 8 up, 8 in 2024-09-10T18:05:57.967 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:57 smithi012 ceph-mon[92029]: pgmap v606: 121 pgs: 121 active+clean; 383 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 17 op/s 2024-09-10T18:05:57.967 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:57 smithi012 ceph-mon[92029]: osdmap e621: 8 total, 8 up, 8 in 2024-09-10T18:05:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:57 smithi089 ceph-mon[84132]: osdmap e620: 8 total, 8 up, 8 in 2024-09-10T18:05:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:57 smithi089 ceph-mon[84132]: pgmap v606: 121 pgs: 121 active+clean; 383 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 17 op/s 2024-09-10T18:05:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:57 smithi089 ceph-mon[84132]: osdmap e621: 8 total, 8 up, 8 in 2024-09-10T18:05:58.062 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1586 (ObjNum 4113 snap 0 seq_num 1491291516) dirty exists 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2658: done (3 left) 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2660: done (2 left) 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2663: done (1 left) 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2667: done (0 left) 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2668: read oid 19 snap -1 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2668: expect deleted 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2669: read oid 50 snap -1 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2669: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 272 2024-09-10T18:05:58.063 INFO:tasks.rados.rados.0.smithi012.stdout:2670: seq_num 839 ranges {2842624=458752,3301376=425984,3727360=688128,4415488=491520} 2024-09-10T18:05:58.080 INFO:tasks.rados.rados.0.smithi012.stdout:2670: writing smithi01278544-13 from 2842624 to 3301376 tid 1 2024-09-10T18:05:58.082 INFO:tasks.rados.rados.0.smithi012.stdout:2670: writing smithi01278544-13 from 3301376 to 3727360 tid 2 2024-09-10T18:05:58.086 INFO:tasks.rados.rados.0.smithi012.stdout:2670: writing smithi01278544-13 from 3727360 to 4415488 tid 3 2024-09-10T18:05:58.090 INFO:tasks.rados.rados.0.smithi012.stdout:2670: writing smithi01278544-13 from 4415488 to 4907008 tid 4 2024-09-10T18:05:58.090 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 272 2024-09-10T18:05:58.090 INFO:tasks.rados.rados.0.smithi012.stdout:2671: seq_num 840 ranges {0=475136,475136=712704,1187840=499712,1687552=393216} 2024-09-10T18:05:58.092 INFO:tasks.rados.rados.0.smithi012.stdout:2671: writing smithi01278544-32 from 0 to 475136 tid 1 2024-09-10T18:05:58.097 INFO:tasks.rados.rados.0.smithi012.stdout:2671: writing smithi01278544-32 from 475136 to 1187840 tid 2 2024-09-10T18:05:58.099 INFO:tasks.rados.rados.0.smithi012.stdout:2671: writing smithi01278544-32 from 1187840 to 1687552 tid 3 2024-09-10T18:05:58.102 INFO:tasks.rados.rados.0.smithi012.stdout:2671: writing smithi01278544-32 from 1687552 to 2080768 tid 4 2024-09-10T18:05:58.102 INFO:tasks.rados.rados.0.smithi012.stdout:2672: snap_remove snap 224 2024-09-10T18:05:58.832 INFO:tasks.rados.rados.0.smithi012.stdout:2669: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:05:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:2670: finishing write tid 1 to smithi01278544-13 2024-09-10T18:05:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:2670: finishing write tid 2 to smithi01278544-13 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: finishing write tid 3 to smithi01278544-13 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: finishing write tid 4 to smithi01278544-13 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: finishing write tid 5 to smithi01278544-13 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: finishing write tid 6 to smithi01278544-13 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: oid 13 updating version 0 to 1362 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: oid 13 version 1362 is already newer than 1361 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: oid 13 version 1362 is already newer than 1359 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: oid 13 version 1362 is already newer than 1358 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: oid 13 version 1362 is already newer than 1360 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1362 (ObjNum 839 snap 272 seq_num 839) dirty exists 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2670: left oid 13 (ObjNum 839 snap 272 seq_num 839) 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2671: finishing write tid 1 to smithi01278544-32 2024-09-10T18:05:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:2668: done (4 left) 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2669: done (3 left) 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2670: done (2 left) 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2672: done (1 left) 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2673: copy_from oid 48 from oid 10 current snap is 272 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: finishing write tid 2 to smithi01278544-32 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: finishing write tid 3 to smithi01278544-32 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: finishing write tid 4 to smithi01278544-32 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: finishing write tid 5 to smithi01278544-32 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: finishing write tid 6 to smithi01278544-32 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: oid 32 updating version 0 to 1163 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: oid 32 updating version 1163 to 1165 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: oid 32 version 1165 is already newer than 1162 2024-09-10T18:05:58.879 INFO:tasks.rados.rados.0.smithi012.stdout:2671: oid 32 updating version 1165 to 1166 2024-09-10T18:05:58.880 INFO:tasks.rados.rados.0.smithi012.stdout:2671: oid 32 version 1166 is already newer than 1164 2024-09-10T18:05:58.880 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 1166 (ObjNum 840 snap 272 seq_num 840) dirty exists 2024-09-10T18:05:58.880 INFO:tasks.rados.rados.0.smithi012.stdout:2671: left oid 32 (ObjNum 840 snap 272 seq_num 840) 2024-09-10T18:05:58.880 INFO:tasks.rados.rados.0.smithi012.stdout:2671: done (1 left) 2024-09-10T18:05:58.880 INFO:tasks.rados.rados.0.smithi012.stdout:2674: snap_remove snap 251 2024-09-10T18:05:58.973 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:05:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:05:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (8s) 4s ago 12m 17.6M - 0.27.0 11f11916f8cd eb5017cfa542 2024-09-10T18:05:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (11m) 23s ago 11m 87.1M - 9.4.7 954c08fa6188 dfdd59da1bca 2024-09-10T18:05:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (89s) 4s ago 13m 15.0M - 19.3.0-4858-gbad1f558 542e6e6af07c 34b133ecae8a 2024-09-10T18:05:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (71s) 23s ago 13m 12.6M - 19.3.0-4858-gbad1f558 542e6e6af07c fd9833aea5e4 2024-09-10T18:05:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (7m) 23s ago 16m 456M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:05:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (7m) 4s ago 18m 533M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:05:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (7m) 4s ago 18m 71.8M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (6m) 23s ago 17m 55.6M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (6m) 4s ago 17m 59.2M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (57s) 4s ago 11m 8132k - 1.7.0 72c9c2088986 bb42e60bc4f1 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (50s) 23s ago 11m 7726k - 1.7.0 72c9c2088986 3b018abc72f3 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (5m) 4s ago 16m 305M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (5m) 4s ago 16m 267M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (4m) 4s ago 15m 246M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (4m) 4s ago 15m 185M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (3m) 23s ago 15m 319M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 75e9a99555f3 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (2m) 23s ago 14m 257M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 28c479f4ad60 2024-09-10T18:05:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (2m) 23s ago 14m 173M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 71e430ee4ba6 2024-09-10T18:05:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (105s) 23s ago 13m 111M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 1b26f245f7dc 2024-09-10T18:05:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (29s) 23s ago 12m 32.6M - 2.51.0 1d3b7f56885b 876b047992b8 2024-09-10T18:05:59.835 INFO:tasks.rados.rados.0.smithi012.stdout:2673: finishing copy_from racing read to smithi01278544-48 2024-09-10T18:05:59.835 INFO:tasks.rados.rados.0.smithi012.stdout:2673: finishing copy_from to smithi01278544-48 2024-09-10T18:05:59.836 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 1865 (ObjNum 818 snap 266 seq_num 818) dirty exists 2024-09-10T18:05:59.836 INFO:tasks.rados.rados.0.smithi012.stdout:2673: done (1 left) 2024-09-10T18:05:59.836 INFO:tasks.rados.rados.0.smithi012.stdout:2674: done (0 left) 2024-09-10T18:05:59.836 INFO:tasks.rados.rados.0.smithi012.stdout:2675: copy_from oid 3 from oid 2 current snap is 272 2024-09-10T18:05:59.836 INFO:tasks.rados.rados.0.smithi012.stdout:2676: read oid 17 snap -1 2024-09-10T18:05:59.836 INFO:tasks.rados.rados.0.smithi012.stdout:2676: expect deleted 2024-09-10T18:05:59.836 INFO:tasks.rados.rados.0.smithi012.stdout:2677: delete oid 35 current snap is 272 2024-09-10T18:05:59.854 INFO:tasks.rados.rados.0.smithi012.stdout:2676: done (2 left) 2024-09-10T18:05:59.854 INFO:tasks.rados.rados.0.smithi012.stdout:2677: done (1 left) 2024-09-10T18:05:59.854 INFO:tasks.rados.rados.0.smithi012.stdout:2678: setattr oid 27 current snap is 272 2024-09-10T18:05:59.856 INFO:tasks.rados.rados.0.smithi012.stdout:2679: snap_create 2024-09-10T18:05:59.874 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1301 (ObjNum 33 snap 0 seq_num 3496264512) dirty exists 2024-09-10T18:05:59.899 INFO:tasks.rados.rados.0.smithi012.stdout:2675: finishing copy_from racing read to smithi01278544-3 2024-09-10T18:05:59.903 INFO:tasks.rados.rados.0.smithi012.stdout:2675: finishing copy_from to smithi01278544-3 2024-09-10T18:05:59.903 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1586 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:05:59.948 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 8 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:05:59.949 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 15 2024-09-10T18:05:59.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:05:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:05:59.950 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: osdmap e622: 8 total, 8 up, 8 in 2024-09-10T18:05:59.950 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='client.34599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:59.950 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: pgmap v609: 121 pgs: 121 active+clean; 384 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.4 MiB/s wr, 21 op/s 2024-09-10T18:05:59.950 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:59.950 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:59.950 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:05:59.950 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='client.34605 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.951 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[92029]: from='client.34611 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: osdmap e622: 8 total, 8 up, 8 in 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='client.34599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: pgmap v609: 121 pgs: 121 active+clean; 384 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.4 MiB/s wr, 21 op/s 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:59.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='client.34605 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:05:59.954 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:05:59 smithi012 ceph-mon[89611]: from='client.34611 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:00.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: osdmap e622: 8 total, 8 up, 8 in 2024-09-10T18:06:00.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='client.34599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:00.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: pgmap v609: 121 pgs: 121 active+clean; 384 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.4 MiB/s wr, 21 op/s 2024-09-10T18:06:00.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:00.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='client.34605 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:00.038 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:05:59 smithi089 ceph-mon[84132]: from='client.34611 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:00.249 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:06:00.249 INFO:teuthology.orchestra.run.smithi012.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e", 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "in_progress": true, 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "services_complete": [ 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "mds", 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr", 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "mon", 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "osd" 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "progress": "15/20 daemons upgraded", 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "message": "Currently upgrading grafana daemons", 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout: "is_paused": false 2024-09-10T18:06:00.250 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:06:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:2675: done (2 left) 2024-09-10T18:06:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:2678: done (1 left) 2024-09-10T18:06:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:2679: done (0 left) 2024-09-10T18:06:00.840 INFO:tasks.rados.rados.0.smithi012.stdout:2680: snap_remove snap 272 2024-09-10T18:06:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:00 smithi012 ceph-mon[89611]: osdmap e623: 8 total, 8 up, 8 in 2024-09-10T18:06:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:00 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3090872825' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:00 smithi012 ceph-mon[89611]: from='client.44534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:00 smithi012 ceph-mon[92029]: osdmap e623: 8 total, 8 up, 8 in 2024-09-10T18:06:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:00 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3090872825' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:00 smithi012 ceph-mon[92029]: from='client.44534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:01.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:00 smithi089 ceph-mon[84132]: osdmap e623: 8 total, 8 up, 8 in 2024-09-10T18:06:01.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:00 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3090872825' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:01.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:00 smithi089 ceph-mon[84132]: from='client.44534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:01.847 INFO:tasks.rados.rados.0.smithi012.stdout:2680: done (0 left) 2024-09-10T18:06:01.847 INFO:tasks.rados.rados.0.smithi012.stdout:2681: snap_remove snap 215 2024-09-10T18:06:02.284 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:06:02 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:06:02.010Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003644129s 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[89611]: osdmap e624: 8 total, 8 up, 8 in 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[89611]: Upgrade: Updating grafana.a 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[89611]: Deploying daemon grafana.a on smithi089 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[89611]: pgmap v612: 121 pgs: 121 active+clean; 386 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 504 KiB/s wr, 16 op/s 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[92029]: osdmap e624: 8 total, 8 up, 8 in 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[92029]: Upgrade: Updating grafana.a 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[92029]: Deploying daemon grafana.a on smithi089 2024-09-10T18:06:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[92029]: pgmap v612: 121 pgs: 121 active+clean; 386 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 504 KiB/s wr, 16 op/s 2024-09-10T18:06:02.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:01 smithi089 ceph-mon[84132]: osdmap e624: 8 total, 8 up, 8 in 2024-09-10T18:06:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:01 smithi089 ceph-mon[84132]: Upgrade: Updating grafana.a 2024-09-10T18:06:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:01 smithi089 ceph-mon[84132]: Deploying daemon grafana.a on smithi089 2024-09-10T18:06:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:01 smithi089 ceph-mon[84132]: pgmap v612: 121 pgs: 121 active+clean; 386 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 504 KiB/s wr, 16 op/s 2024-09-10T18:06:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:02.767 INFO:tasks.rados.rados.0.smithi012.stdout:2681: done (0 left) 2024-09-10T18:06:02.767 INFO:tasks.rados.rados.0.smithi012.stdout:2682: rollback oid 18 current snap is 273 2024-09-10T18:06:02.767 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 261 2024-09-10T18:06:02.767 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 273 2024-09-10T18:06:02.768 INFO:tasks.rados.rados.0.smithi012.stdout:2683: seq_num 842 ranges {2899968=507904,3407872=475136,3883008=516096,4399104=499712,4898816=114688} 2024-09-10T18:06:02.787 INFO:tasks.rados.rados.0.smithi012.stdout:2683: writing smithi01278544-10 from 2899968 to 3407872 tid 1 2024-09-10T18:06:02.790 INFO:tasks.rados.rados.0.smithi012.stdout:2683: writing smithi01278544-10 from 3407872 to 3883008 tid 2 2024-09-10T18:06:02.794 INFO:tasks.rados.rados.0.smithi012.stdout:2683: writing smithi01278544-10 from 3883008 to 4399104 tid 3 2024-09-10T18:06:02.798 INFO:tasks.rados.rados.0.smithi012.stdout:2683: writing smithi01278544-10 from 4399104 to 4898816 tid 4 2024-09-10T18:06:02.799 INFO:tasks.rados.rados.0.smithi012.stdout:2683: writing smithi01278544-10 from 4898816 to 5013504 tid 5 2024-09-10T18:06:02.799 INFO:tasks.rados.rados.0.smithi012.stdout:2684: snap_create 2024-09-10T18:06:02.799 INFO:tasks.rados.rados.0.smithi012.stdout:2682: finishing rollback tid 0 to smithi01278544-18 2024-09-10T18:06:02.799 INFO:tasks.rados.rados.0.smithi012.stdout:2682: finishing rollback tid 1 to smithi01278544-18 2024-09-10T18:06:02.799 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 1588 (ObjNum 65 snap 0 seq_num 1517442397) dirty dne 2024-09-10T18:06:02.800 INFO:tasks.rados.rados.0.smithi012.stdout:2683: finishing write tid 1 to smithi01278544-10 2024-09-10T18:06:02.800 INFO:tasks.rados.rados.0.smithi012.stdout:2683: finishing write tid 2 to smithi01278544-10 2024-09-10T18:06:02.800 INFO:tasks.rados.rados.0.smithi012.stdout:2683: finishing write tid 3 to smithi01278544-10 2024-09-10T18:06:02.804 INFO:tasks.rados.rados.0.smithi012.stdout:2683: finishing write tid 4 to smithi01278544-10 2024-09-10T18:06:02.804 INFO:tasks.rados.rados.0.smithi012.stdout:2683: finishing write tid 5 to smithi01278544-10 2024-09-10T18:06:02.804 INFO:tasks.rados.rados.0.smithi012.stdout:2683: finishing write tid 6 to smithi01278544-10 2024-09-10T18:06:02.805 INFO:tasks.rados.rados.0.smithi012.stdout:2683: finishing write tid 7 to smithi01278544-10 2024-09-10T18:06:02.805 INFO:tasks.rados.rados.0.smithi012.stdout:2683: oid 10 updating version 0 to 1954 2024-09-10T18:06:02.805 INFO:tasks.rados.rados.0.smithi012.stdout:2683: oid 10 version 1954 is already newer than 1953 2024-09-10T18:06:02.805 INFO:tasks.rados.rados.0.smithi012.stdout:2683: oid 10 version 1954 is already newer than 1949 2024-09-10T18:06:02.805 INFO:tasks.rados.rados.0.smithi012.stdout:2683: oid 10 version 1954 is already newer than 1950 2024-09-10T18:06:02.805 INFO:tasks.rados.rados.0.smithi012.stdout:2683: oid 10 version 1954 is already newer than 1951 2024-09-10T18:06:02.806 INFO:tasks.rados.rados.0.smithi012.stdout:2683: oid 10 version 1954 is already newer than 1952 2024-09-10T18:06:02.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 1954 (ObjNum 842 snap 273 seq_num 842) dirty exists 2024-09-10T18:06:02.806 INFO:tasks.rados.rados.0.smithi012.stdout:2683: left oid 10 (ObjNum 842 snap 273 seq_num 842) 2024-09-10T18:06:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:02 smithi012 ceph-mon[89611]: osdmap e625: 8 total, 8 up, 8 in 2024-09-10T18:06:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:02 smithi012 ceph-mon[89611]: osdmap e626: 8 total, 8 up, 8 in 2024-09-10T18:06:03.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:02 smithi012 ceph-mon[92029]: osdmap e625: 8 total, 8 up, 8 in 2024-09-10T18:06:03.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:02 smithi012 ceph-mon[92029]: osdmap e626: 8 total, 8 up, 8 in 2024-09-10T18:06:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:02 smithi089 ceph-mon[84132]: osdmap e625: 8 total, 8 up, 8 in 2024-09-10T18:06:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:02 smithi089 ceph-mon[84132]: osdmap e626: 8 total, 8 up, 8 in 2024-09-10T18:06:03.765 INFO:tasks.rados.rados.0.smithi012.stdout:2682: done (2 left) 2024-09-10T18:06:03.765 INFO:tasks.rados.rados.0.smithi012.stdout:2683: done (1 left) 2024-09-10T18:06:03.766 INFO:tasks.rados.rados.0.smithi012.stdout:2684: done (0 left) 2024-09-10T18:06:03.766 INFO:tasks.rados.rados.0.smithi012.stdout:2685: rollback oid 20 current snap is 274 2024-09-10T18:06:03.766 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 265 2024-09-10T18:06:03.766 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 274 2024-09-10T18:06:03.766 INFO:tasks.rados.rados.0.smithi012.stdout:2686: seq_num 843 ranges {0=524288,524288=761856,1286144=671744,1957888=172032} 2024-09-10T18:06:03.768 INFO:tasks.rados.rados.0.smithi012.stdout:2686: writing smithi01278544-35 from 0 to 524288 tid 1 2024-09-10T18:06:03.772 INFO:tasks.rados.rados.0.smithi012.stdout:2686: writing smithi01278544-35 from 524288 to 1286144 tid 2 2024-09-10T18:06:03.776 INFO:tasks.rados.rados.0.smithi012.stdout:2686: writing smithi01278544-35 from 1286144 to 1957888 tid 3 2024-09-10T18:06:03.777 INFO:tasks.rados.rados.0.smithi012.stdout:2686: writing smithi01278544-35 from 1957888 to 2129920 tid 4 2024-09-10T18:06:03.777 INFO:tasks.rados.rados.0.smithi012.stdout:2687: delete oid 5 current snap is 274 2024-09-10T18:06:03.777 INFO:tasks.rados.rados.0.smithi012.stdout:2685: finishing rollback tid 0 to smithi01278544-20 2024-09-10T18:06:03.777 INFO:tasks.rados.rados.0.smithi012.stdout:2686: finishing write tid 1 to smithi01278544-35 2024-09-10T18:06:03.778 INFO:tasks.rados.rados.0.smithi012.stdout:2685: finishing rollback tid 1 to smithi01278544-20 2024-09-10T18:06:03.778 INFO:tasks.rados.rados.0.smithi012.stdout:2685: finishing rollback tid 2 to smithi01278544-20 2024-09-10T18:06:03.778 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1958 (ObjNum 800 snap 262 seq_num 800) dirty exists 2024-09-10T18:06:03.778 INFO:tasks.rados.rados.0.smithi012.stdout:2686: finishing write tid 2 to smithi01278544-35 2024-09-10T18:06:03.781 INFO:tasks.rados.rados.0.smithi012.stdout:2686: finishing write tid 3 to smithi01278544-35 2024-09-10T18:06:03.782 INFO:tasks.rados.rados.0.smithi012.stdout:2686: finishing write tid 4 to smithi01278544-35 2024-09-10T18:06:03.782 INFO:tasks.rados.rados.0.smithi012.stdout:2685: done (2 left) 2024-09-10T18:06:03.782 INFO:tasks.rados.rados.0.smithi012.stdout:2687: done (1 left) 2024-09-10T18:06:03.782 INFO:tasks.rados.rados.0.smithi012.stdout:2688: setattr oid 3 current snap is 274 2024-09-10T18:06:03.782 INFO:tasks.rados.rados.0.smithi012.stdout:2686: finishing write tid 5 to smithi01278544-35 2024-09-10T18:06:03.783 INFO:tasks.rados.rados.0.smithi012.stdout:2686: finishing write tid 6 to smithi01278544-35 2024-09-10T18:06:03.783 INFO:tasks.rados.rados.0.smithi012.stdout:2686: oid 35 updating version 0 to 1169 2024-09-10T18:06:03.783 INFO:tasks.rados.rados.0.smithi012.stdout:2686: oid 35 updating version 1169 to 1170 2024-09-10T18:06:03.783 INFO:tasks.rados.rados.0.smithi012.stdout:2686: oid 35 updating version 1170 to 1171 2024-09-10T18:06:03.783 INFO:tasks.rados.rados.0.smithi012.stdout:2686: oid 35 updating version 1171 to 1172 2024-09-10T18:06:03.783 INFO:tasks.rados.rados.0.smithi012.stdout:2686: oid 35 version 1172 is already newer than 1168 2024-09-10T18:06:03.783 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1172 (ObjNum 843 snap 274 seq_num 843) dirty exists 2024-09-10T18:06:03.784 INFO:tasks.rados.rados.0.smithi012.stdout:2686: left oid 35 (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:06:03.784 INFO:tasks.rados.rados.0.smithi012.stdout:2686: done (1 left) 2024-09-10T18:06:03.785 INFO:tasks.rados.rados.0.smithi012.stdout:2689: rmattr oid 27 current snap is 274 2024-09-10T18:06:03.785 INFO:tasks.rados.rados.0.smithi012.stdout:2690: rmattr oid 29 current snap is 274 2024-09-10T18:06:03.785 INFO:tasks.rados.rados.0.smithi012.stdout:2690: done (2 left) 2024-09-10T18:06:03.785 INFO:tasks.rados.rados.0.smithi012.stdout:2691: read oid 13 snap 269 2024-09-10T18:06:03.785 INFO:tasks.rados.rados.0.smithi012.stdout:2691: expect (ObjNum 799 snap 262 seq_num 799) 2024-09-10T18:06:03.785 INFO:tasks.rados.rados.0.smithi012.stdout:2692: read oid 2 snap -1 2024-09-10T18:06:03.785 INFO:tasks.rados.rados.0.smithi012.stdout:2692: expect (ObjNum 836 snap 270 seq_num 836) 2024-09-10T18:06:03.785 INFO:tasks.rados.rados.0.smithi012.stdout:2693: snap_remove snap 256 2024-09-10T18:06:04.767 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1587 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:06:04.768 INFO:tasks.rados.rados.0.smithi012.stdout:2691: expect (ObjNum 799 snap 262 seq_num 799) 2024-09-10T18:06:04.769 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:06:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:06:04] "GET /metrics HTTP/1.1" 200 36353 "" "Prometheus/2.51.0" 2024-09-10T18:06:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1588 (ObjNum 81 snap 0 seq_num 0) dirty exists 2024-09-10T18:06:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:2692: expect (ObjNum 836 snap 270 seq_num 836) 2024-09-10T18:06:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:04 smithi012 ceph-mon[89611]: pgmap v615: 121 pgs: 121 active+clean; 376 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-09-10T18:06:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:04 smithi012 ceph-mon[89611]: osdmap e627: 8 total, 8 up, 8 in 2024-09-10T18:06:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:04 smithi012 ceph-mon[92029]: pgmap v615: 121 pgs: 121 active+clean; 376 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-09-10T18:06:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:04 smithi012 ceph-mon[92029]: osdmap e627: 8 total, 8 up, 8 in 2024-09-10T18:06:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:04 smithi089 ceph-mon[84132]: pgmap v615: 121 pgs: 121 active+clean; 376 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 10 op/s 2024-09-10T18:06:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:04 smithi089 ceph-mon[84132]: osdmap e627: 8 total, 8 up, 8 in 2024-09-10T18:06:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:05 smithi012 ceph-mon[89611]: osdmap e628: 8 total, 8 up, 8 in 2024-09-10T18:06:06.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:05 smithi012 ceph-mon[92029]: osdmap e628: 8 total, 8 up, 8 in 2024-09-10T18:06:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:05 smithi089 ceph-mon[84132]: osdmap e628: 8 total, 8 up, 8 in 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:2688: done (4 left) 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:2689: done (3 left) 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:2691: done (2 left) 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:2692: done (1 left) 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:2693: done (0 left) 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:2694: read oid 29 snap -1 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:2694: expect deleted 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 274 2024-09-10T18:06:06.543 INFO:tasks.rados.rados.0.smithi012.stdout:2695: seq_num 845 ranges {8437760=557056,8994816=581632,9576448=688128,10264576=335872} 2024-09-10T18:06:06.591 INFO:tasks.rados.rados.0.smithi012.stdout:2695: writing smithi01278544-4 from 8437760 to 8994816 tid 1 2024-09-10T18:06:06.595 INFO:tasks.rados.rados.0.smithi012.stdout:2695: writing smithi01278544-4 from 8994816 to 9576448 tid 2 2024-09-10T18:06:06.599 INFO:tasks.rados.rados.0.smithi012.stdout:2695: writing smithi01278544-4 from 9576448 to 10264576 tid 3 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2695: writing smithi01278544-4 from 10264576 to 10600448 tid 4 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2696: rollback oid 27 current snap is 274 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 273 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2695: finishing write tid 1 to smithi01278544-4 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2695: finishing write tid 2 to smithi01278544-4 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2694: done (2 left) 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2697: rmattr oid 49 current snap is 274 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2697: done (2 left) 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2698: read oid 12 snap 261 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2698: expect (ObjNum 728 snap 237 seq_num 728) 2024-09-10T18:06:06.602 INFO:tasks.rados.rados.0.smithi012.stdout:2699: delete oid 43 current snap is 274 2024-09-10T18:06:06.604 INFO:tasks.rados.rados.0.smithi012.stdout:2695: finishing write tid 3 to smithi01278544-4 2024-09-10T18:06:06.606 INFO:tasks.rados.rados.0.smithi012.stdout:2696: finishing rollback tid 0 to smithi01278544-27 2024-09-10T18:06:06.608 INFO:tasks.rados.rados.0.smithi012.stdout:2695: finishing write tid 4 to smithi01278544-4 2024-09-10T18:06:06.608 INFO:tasks.rados.rados.0.smithi012.stdout:2699: done (3 left) 2024-09-10T18:06:06.608 INFO:tasks.rados.rados.0.smithi012.stdout:2700: copy_from oid 38 from oid 23 current snap is 274 2024-09-10T18:06:06.608 INFO:tasks.rados.rados.0.smithi012.stdout:2701: read oid 5 snap -1 2024-09-10T18:06:06.608 INFO:tasks.rados.rados.0.smithi012.stdout:2701: expect deleted 2024-09-10T18:06:06.608 INFO:tasks.rados.rados.0.smithi012.stdout:2702: read oid 20 snap -1 2024-09-10T18:06:06.608 INFO:tasks.rados.rados.0.smithi012.stdout:2702: expect (ObjNum 800 snap 262 seq_num 800) 2024-09-10T18:06:06.608 INFO:tasks.rados.rados.0.smithi012.stdout:2703: rollback oid 39 current snap is 274 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 242 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:2695: finishing write tid 5 to smithi01278544-4 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:2704: rollback oid 47 current snap is 274 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 271 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:2705: setattr oid 49 current snap is 274 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:2696: finishing rollback tid 1 to smithi01278544-27 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:2696: finishing rollback tid 2 to smithi01278544-27 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1591 (ObjNum 81 snap 0 seq_num 3496689888) dirty exists 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:2700: finishing copy_from to smithi01278544-38 2024-09-10T18:06:06.609 INFO:tasks.rados.rados.0.smithi012.stdout:2700: got expected ENOENT (src dne) 2024-09-10T18:06:06.610 INFO:tasks.rados.rados.0.smithi012.stdout:2700: finishing copy_from racing read to smithi01278544-38 2024-09-10T18:06:06.610 INFO:tasks.rados.rados.0.smithi012.stdout:2695: finishing write tid 6 to smithi01278544-4 2024-09-10T18:06:06.610 INFO:tasks.rados.rados.0.smithi012.stdout:2695: oid 4 updating version 0 to 1395 2024-09-10T18:06:06.610 INFO:tasks.rados.rados.0.smithi012.stdout:2695: oid 4 version 1395 is already newer than 1394 2024-09-10T18:06:06.610 INFO:tasks.rados.rados.0.smithi012.stdout:2695: oid 4 version 1395 is already newer than 1392 2024-09-10T18:06:06.610 INFO:tasks.rados.rados.0.smithi012.stdout:2695: oid 4 version 1395 is already newer than 1393 2024-09-10T18:06:06.610 INFO:tasks.rados.rados.0.smithi012.stdout:2695: oid 4 updating version 1395 to 1396 2024-09-10T18:06:06.611 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1396 (ObjNum 845 snap 274 seq_num 845) dirty exists 2024-09-10T18:06:06.611 INFO:tasks.rados.rados.0.smithi012.stdout:2695: left oid 4 (ObjNum 845 snap 274 seq_num 845) 2024-09-10T18:06:06.611 INFO:tasks.rados.rados.0.smithi012.stdout:2695: done (8 left) 2024-09-10T18:06:06.611 INFO:tasks.rados.rados.0.smithi012.stdout:2696: done (7 left) 2024-09-10T18:06:06.611 INFO:tasks.rados.rados.0.smithi012.stdout:2700: done (6 left) 2024-09-10T18:06:06.611 INFO:tasks.rados.rados.0.smithi012.stdout:2701: done (5 left) 2024-09-10T18:06:06.611 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 274 2024-09-10T18:06:06.611 INFO:tasks.rados.rados.0.smithi012.stdout:2706: seq_num 847 ranges {0=589824,589824=753664,1343488=655360,1998848=196608} 2024-09-10T18:06:06.613 INFO:tasks.rados.rados.0.smithi012.stdout:2706: writing smithi01278544-38 from 0 to 589824 tid 1 2024-09-10T18:06:06.617 INFO:tasks.rados.rados.0.smithi012.stdout:2706: writing smithi01278544-38 from 589824 to 1343488 tid 2 2024-09-10T18:06:06.622 INFO:tasks.rados.rados.0.smithi012.stdout:2706: writing smithi01278544-38 from 1343488 to 1998848 tid 3 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:2706: writing smithi01278544-38 from 1998848 to 2195456 tid 4 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:2707: read oid 14 snap -1 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:2707: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:2708: delete oid 40 current snap is 274 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:2704: finishing rollback tid 1 to smithi01278544-47 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1693 (ObjNum 65 snap 0 seq_num 3496998432) dirty dne 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1589 (ObjNum 721 snap 235 seq_num 721) dirty exists 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:2706: finishing write tid 1 to smithi01278544-38 2024-09-10T18:06:06.624 INFO:tasks.rados.rados.0.smithi012.stdout:2706: finishing write tid 2 to smithi01278544-38 2024-09-10T18:06:06.627 INFO:tasks.rados.rados.0.smithi012.stdout:2706: finishing write tid 3 to smithi01278544-38 2024-09-10T18:06:06.628 INFO:tasks.rados.rados.0.smithi012.stdout:2706: finishing write tid 4 to smithi01278544-38 2024-09-10T18:06:06.628 INFO:tasks.rados.rados.0.smithi012.stdout:2706: finishing write tid 5 to smithi01278544-38 2024-09-10T18:06:06.630 INFO:tasks.rados.rados.0.smithi012.stdout:2706: finishing write tid 6 to smithi01278544-38 2024-09-10T18:06:06.630 INFO:tasks.rados.rados.0.smithi012.stdout:2706: oid 38 updating version 0 to 1869 2024-09-10T18:06:06.630 INFO:tasks.rados.rados.0.smithi012.stdout:2706: oid 38 updating version 1869 to 1870 2024-09-10T18:06:06.630 INFO:tasks.rados.rados.0.smithi012.stdout:2706: oid 38 version 1870 is already newer than 1868 2024-09-10T18:06:06.630 INFO:tasks.rados.rados.0.smithi012.stdout:2706: oid 38 version 1870 is already newer than 1866 2024-09-10T18:06:06.630 INFO:tasks.rados.rados.0.smithi012.stdout:2706: oid 38 version 1870 is already newer than 1867 2024-09-10T18:06:06.630 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1870 (ObjNum 847 snap 274 seq_num 847) dirty exists 2024-09-10T18:06:06.630 INFO:tasks.rados.rados.0.smithi012.stdout:2706: left oid 38 (ObjNum 847 snap 274 seq_num 847) 2024-09-10T18:06:06.641 INFO:tasks.rados.rados.0.smithi012.stdout:2698: expect (ObjNum 728 snap 237 seq_num 728) 2024-09-10T18:06:07.012 INFO:tasks.rados.rados.0.smithi012.stdout:2703: finishing rollback tid 0 to smithi01278544-39 2024-09-10T18:06:07.012 INFO:tasks.rados.rados.0.smithi012.stdout:2702: expect (ObjNum 800 snap 262 seq_num 800) 2024-09-10T18:06:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:06 smithi012 ceph-mon[89611]: pgmap v618: 121 pgs: 121 active+clean; 345 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 10 op/s 2024-09-10T18:06:07.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:06 smithi012 ceph-mon[92029]: pgmap v618: 121 pgs: 121 active+clean; 345 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 10 op/s 2024-09-10T18:06:07.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:06 smithi089 ceph-mon[84132]: pgmap v618: 121 pgs: 121 active+clean; 345 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 10 op/s 2024-09-10T18:06:07.049 INFO:tasks.rados.rados.0.smithi012.stdout:2703: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:06:07.049 INFO:tasks.rados.rados.0.smithi012.stdout:2703: finishing rollback tid 2 to smithi01278544-39 2024-09-10T18:06:07.049 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 1970 (ObjNum 663 snap 217 seq_num 663) dirty exists 2024-09-10T18:06:07.049 INFO:tasks.rados.rados.0.smithi012.stdout:2707: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2698: done (7 left) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2702: done (6 left) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2703: done (5 left) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2704: done (4 left) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2705: done (3 left) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2706: done (2 left) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2707: done (1 left) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2708: done (0 left) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2709: read oid 16 snap -1 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2709: expect (ObjNum 783 snap 256 seq_num 783) 2024-09-10T18:06:07.588 INFO:tasks.rados.rados.0.smithi012.stdout:2710: snap_create 2024-09-10T18:06:07.612 INFO:tasks.rados.rados.0.smithi012.stdout:2709: expect (ObjNum 783 snap 256 seq_num 783) 2024-09-10T18:06:08.479 INFO:tasks.rados.rados.0.smithi012.stdout:2709: done (1 left) 2024-09-10T18:06:08.479 INFO:tasks.rados.rados.0.smithi012.stdout:2710: done (0 left) 2024-09-10T18:06:08.479 INFO:tasks.rados.rados.0.smithi012.stdout:2711: rollback oid 5 current snap is 275 2024-09-10T18:06:08.479 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 5 to 273 2024-09-10T18:06:08.479 INFO:tasks.rados.rados.0.smithi012.stdout:2712: read oid 13 snap -1 2024-09-10T18:06:08.479 INFO:tasks.rados.rados.0.smithi012.stdout:2712: expect (ObjNum 839 snap 272 seq_num 839) 2024-09-10T18:06:08.479 INFO:tasks.rados.rados.0.smithi012.stdout:2713: snap_create 2024-09-10T18:06:08.479 INFO:tasks.rados.rados.0.smithi012.stdout:2711: finishing rollback tid 1 to smithi01278544-5 2024-09-10T18:06:08.480 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 899 (ObjNum 33 snap 0 seq_num 3497551408) dirty dne 2024-09-10T18:06:08.493 INFO:tasks.rados.rados.0.smithi012.stdout:2712: expect (ObjNum 839 snap 272 seq_num 839) 2024-09-10T18:06:08.781 INFO:tasks.rados.rados.0.smithi012.stdout:2711: done (2 left) 2024-09-10T18:06:08.782 INFO:tasks.rados.rados.0.smithi012.stdout:2712: done (1 left) 2024-09-10T18:06:08.782 INFO:tasks.rados.rados.0.smithi012.stdout:2713: done (0 left) 2024-09-10T18:06:08.782 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 276 2024-09-10T18:06:08.782 INFO:tasks.rados.rados.0.smithi012.stdout:2714: seq_num 849 ranges {7766016=622592,8388608=516096,8904704=663552,9568256=425984} 2024-09-10T18:06:08.827 INFO:tasks.rados.rados.0.smithi012.stdout:2714: writing smithi01278544-12 from 7766016 to 8388608 tid 1 2024-09-10T18:06:08.829 INFO:tasks.rados.rados.0.smithi012.stdout:2714: writing smithi01278544-12 from 8388608 to 8904704 tid 2 2024-09-10T18:06:08.833 INFO:tasks.rados.rados.0.smithi012.stdout:2714: writing smithi01278544-12 from 8904704 to 9568256 tid 3 2024-09-10T18:06:08.836 INFO:tasks.rados.rados.0.smithi012.stdout:2714: writing smithi01278544-12 from 9568256 to 9994240 tid 4 2024-09-10T18:06:08.836 INFO:tasks.rados.rados.0.smithi012.stdout:2715: rollback oid 47 current snap is 276 2024-09-10T18:06:08.836 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 271 2024-09-10T18:06:08.836 INFO:tasks.rados.rados.0.smithi012.stdout:2714: finishing write tid 1 to smithi01278544-12 2024-09-10T18:06:08.836 INFO:tasks.rados.rados.0.smithi012.stdout:2716: snap_create 2024-09-10T18:06:08.836 INFO:tasks.rados.rados.0.smithi012.stdout:2714: finishing write tid 2 to smithi01278544-12 2024-09-10T18:06:08.838 INFO:tasks.rados.rados.0.smithi012.stdout:2715: finishing rollback tid 1 to smithi01278544-47 2024-09-10T18:06:08.838 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1693 (ObjNum 33 snap 0 seq_num 3497490352) dirty dne 2024-09-10T18:06:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2714: finishing write tid 3 to smithi01278544-12 2024-09-10T18:06:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2714: finishing write tid 4 to smithi01278544-12 2024-09-10T18:06:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2714: finishing write tid 5 to smithi01278544-12 2024-09-10T18:06:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2714: finishing write tid 6 to smithi01278544-12 2024-09-10T18:06:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2714: oid 12 updating version 0 to 1972 2024-09-10T18:06:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2714: oid 12 updating version 1972 to 1974 2024-09-10T18:06:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2714: oid 12 updating version 1974 to 1975 2024-09-10T18:06:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2714: oid 12 version 1975 is already newer than 1973 2024-09-10T18:06:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2714: oid 12 updating version 1975 to 1976 2024-09-10T18:06:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 1976 (ObjNum 849 snap 276 seq_num 849) dirty exists 2024-09-10T18:06:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2714: left oid 12 (ObjNum 849 snap 276 seq_num 849) 2024-09-10T18:06:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:08 smithi012 ceph-mon[89611]: pgmap v619: 121 pgs: 121 active+clean; 304 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.9 MiB/s wr, 16 op/s 2024-09-10T18:06:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:08 smithi012 ceph-mon[89611]: osdmap e629: 8 total, 8 up, 8 in 2024-09-10T18:06:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:08 smithi012 ceph-mon[92029]: pgmap v619: 121 pgs: 121 active+clean; 304 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.9 MiB/s wr, 16 op/s 2024-09-10T18:06:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:08 smithi012 ceph-mon[92029]: osdmap e629: 8 total, 8 up, 8 in 2024-09-10T18:06:09.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:08 smithi089 ceph-mon[84132]: pgmap v619: 121 pgs: 121 active+clean; 304 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 3.9 MiB/s wr, 16 op/s 2024-09-10T18:06:09.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:08 smithi089 ceph-mon[84132]: osdmap e629: 8 total, 8 up, 8 in 2024-09-10T18:06:09.787 INFO:tasks.rados.rados.0.smithi012.stdout:2714: done (2 left) 2024-09-10T18:06:09.788 INFO:tasks.rados.rados.0.smithi012.stdout:2715: done (1 left) 2024-09-10T18:06:09.788 INFO:tasks.rados.rados.0.smithi012.stdout:2716: done (0 left) 2024-09-10T18:06:09.788 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 277 2024-09-10T18:06:09.788 INFO:tasks.rados.rados.0.smithi012.stdout:2717: seq_num 850 ranges {1409024=638976,2048000=802816,2850816=475136,3325952=327680} 2024-09-10T18:06:09.798 INFO:tasks.rados.rados.0.smithi012.stdout:2717: writing smithi01278544-20 from 1409024 to 2048000 tid 1 2024-09-10T18:06:09.803 INFO:tasks.rados.rados.0.smithi012.stdout:2717: writing smithi01278544-20 from 2048000 to 2850816 tid 2 2024-09-10T18:06:09.806 INFO:tasks.rados.rados.0.smithi012.stdout:2717: writing smithi01278544-20 from 2850816 to 3325952 tid 3 2024-09-10T18:06:09.808 INFO:tasks.rados.rados.0.smithi012.stdout:2717: writing smithi01278544-20 from 3325952 to 3653632 tid 4 2024-09-10T18:06:09.808 INFO:tasks.rados.rados.0.smithi012.stdout:2718: read oid 17 snap 274 2024-09-10T18:06:09.808 INFO:tasks.rados.rados.0.smithi012.stdout:2718: expect deleted 2024-09-10T18:06:09.808 INFO:tasks.rados.rados.0.smithi012.stdout:2719: setattr oid 26 current snap is 277 2024-09-10T18:06:09.808 INFO:tasks.rados.rados.0.smithi012.stdout:2717: finishing write tid 1 to smithi01278544-20 2024-09-10T18:06:09.809 INFO:tasks.rados.rados.0.smithi012.stdout:2720: read oid 14 snap -1 2024-09-10T18:06:09.809 INFO:tasks.rados.rados.0.smithi012.stdout:2720: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:06:09.809 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 277 2024-09-10T18:06:09.809 INFO:tasks.rados.rados.0.smithi012.stdout:2721: seq_num 851 ranges {9699328=655360,10354688=688128,11042816=679936,11722752=237568} 2024-09-10T18:06:09.866 INFO:tasks.rados.rados.0.smithi012.stdout:2721: writing smithi01278544-16 from 9699328 to 10354688 tid 1 2024-09-10T18:06:09.871 INFO:tasks.rados.rados.0.smithi012.stdout:2721: writing smithi01278544-16 from 10354688 to 11042816 tid 2 2024-09-10T18:06:09.875 INFO:tasks.rados.rados.0.smithi012.stdout:2721: writing smithi01278544-16 from 11042816 to 11722752 tid 3 2024-09-10T18:06:09.877 INFO:tasks.rados.rados.0.smithi012.stdout:2721: writing smithi01278544-16 from 11722752 to 11960320 tid 4 2024-09-10T18:06:09.877 INFO:tasks.rados.rados.0.smithi012.stdout:2722: rollback oid 45 current snap is 277 2024-09-10T18:06:09.877 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 45 to 273 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:2717: finishing write tid 2 to smithi01278544-20 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:2723: read oid 5 snap -1 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:2723: expect deleted 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 277 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 1583 (ObjNum 65 snap 0 seq_num 1869639281) dirty exists 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:2717: finishing write tid 3 to smithi01278544-20 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:2717: finishing write tid 4 to smithi01278544-20 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:2717: finishing write tid 5 to smithi01278544-20 2024-09-10T18:06:09.878 INFO:tasks.rados.rados.0.smithi012.stdout:2724: seq_num 852 ranges {8577024=671744,9248768=622592,9871360=442368,10313728=540672} 2024-09-10T18:06:09.928 INFO:tasks.rados.rados.0.smithi012.stdout:2724: writing smithi01278544-44 from 8577024 to 9248768 tid 1 2024-09-10T18:06:09.931 INFO:tasks.rados.rados.0.smithi012.stdout:2724: writing smithi01278544-44 from 9248768 to 9871360 tid 2 2024-09-10T18:06:09.934 INFO:tasks.rados.rados.0.smithi012.stdout:2724: writing smithi01278544-44 from 9871360 to 10313728 tid 3 2024-09-10T18:06:09.937 INFO:tasks.rados.rados.0.smithi012.stdout:2724: writing smithi01278544-44 from 10313728 to 10854400 tid 4 2024-09-10T18:06:09.937 INFO:tasks.rados.rados.0.smithi012.stdout:2718: done (7 left) 2024-09-10T18:06:09.937 INFO:tasks.rados.rados.0.smithi012.stdout:2719: done (6 left) 2024-09-10T18:06:09.937 INFO:tasks.rados.rados.0.smithi012.stdout:2725: copy_from oid 10 from oid 18 current snap is 277 2024-09-10T18:06:09.937 INFO:tasks.rados.rados.0.smithi012.stdout:2717: finishing write tid 6 to smithi01278544-20 2024-09-10T18:06:09.937 INFO:tasks.rados.rados.0.smithi012.stdout:2717: oid 20 updating version 0 to 1979 2024-09-10T18:06:09.938 INFO:tasks.rados.rados.0.smithi012.stdout:2717: oid 20 updating version 1979 to 1981 2024-09-10T18:06:09.938 INFO:tasks.rados.rados.0.smithi012.stdout:2717: oid 20 version 1981 is already newer than 1978 2024-09-10T18:06:09.938 INFO:tasks.rados.rados.0.smithi012.stdout:2717: oid 20 version 1981 is already newer than 1980 2024-09-10T18:06:09.938 INFO:tasks.rados.rados.0.smithi012.stdout:2717: oid 20 updating version 1981 to 1982 2024-09-10T18:06:09.938 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 1982 (ObjNum 850 snap 277 seq_num 850) dirty exists 2024-09-10T18:06:09.938 INFO:tasks.rados.rados.0.smithi012.stdout:2717: left oid 20 (ObjNum 850 snap 277 seq_num 850) 2024-09-10T18:06:09.938 INFO:tasks.rados.rados.0.smithi012.stdout:2720: expect (ObjNum 545 snap 183 seq_num 545) 2024-09-10T18:06:10.006 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:09 smithi089 ceph-mon[84132]: osdmap e630: 8 total, 8 up, 8 in 2024-09-10T18:06:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:09 smithi012 ceph-mon[89611]: osdmap e630: 8 total, 8 up, 8 in 2024-09-10T18:06:10.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:09 smithi012 ceph-mon[92029]: osdmap e630: 8 total, 8 up, 8 in 2024-09-10T18:06:10.477 INFO:tasks.rados.rados.0.smithi012.stdout:2721: finishing write tid 1 to smithi01278544-16 2024-09-10T18:06:10.477 INFO:tasks.rados.rados.0.smithi012.stdout:2721: finishing write tid 2 to smithi01278544-16 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2721: finishing write tid 3 to smithi01278544-16 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2721: finishing write tid 4 to smithi01278544-16 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2721: finishing write tid 5 to smithi01278544-16 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2717: done (6 left) 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2720: done (5 left) 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2723: done (4 left) 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 277 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2722: finishing rollback tid 0 to smithi01278544-45 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2722: finishing rollback tid 1 to smithi01278544-45 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2722: finishing rollback tid 2 to smithi01278544-45 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1957 (ObjNum 792 snap 260 seq_num 792) dirty exists 2024-09-10T18:06:10.478 INFO:tasks.rados.rados.0.smithi012.stdout:2726: seq_num 853 ranges {8577024=696320,9273344=507904,9781248=647168,10428416=450560} 2024-09-10T18:06:10.527 INFO:tasks.rados.rados.0.smithi012.stdout:2726: writing smithi01278544-7 from 8577024 to 9273344 tid 1 2024-09-10T18:06:10.530 INFO:tasks.rados.rados.0.smithi012.stdout:2726: writing smithi01278544-7 from 9273344 to 9781248 tid 2 2024-09-10T18:06:10.534 INFO:tasks.rados.rados.0.smithi012.stdout:2726: writing smithi01278544-7 from 9781248 to 10428416 tid 3 2024-09-10T18:06:10.537 INFO:tasks.rados.rados.0.smithi012.stdout:2726: writing smithi01278544-7 from 10428416 to 10878976 tid 4 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2722: done (4 left) 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2727: read oid 35 snap -1 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2727: expect (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2728: copy_from oid 26 from oid 43 current snap is 277 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2721: finishing write tid 6 to smithi01278544-16 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2721: oid 16 updating version 0 to 1137 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2721: oid 16 version 1137 is already newer than 1133 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2721: oid 16 version 1137 is already newer than 1134 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2721: oid 16 version 1137 is already newer than 1136 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2721: oid 16 version 1137 is already newer than 1135 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 1137 (ObjNum 851 snap 277 seq_num 851) dirty exists 2024-09-10T18:06:10.538 INFO:tasks.rados.rados.0.smithi012.stdout:2721: left oid 16 (ObjNum 851 snap 277 seq_num 851) 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2724: finishing write tid 1 to smithi01278544-44 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2721: done (5 left) 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2729: read oid 42 snap -1 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2729: expect deleted 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 277 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2724: finishing write tid 2 to smithi01278544-44 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2724: finishing write tid 3 to smithi01278544-44 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2725: finishing copy_from to smithi01278544-10 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2725: got expected ENOENT (src dne) 2024-09-10T18:06:10.539 INFO:tasks.rados.rados.0.smithi012.stdout:2730: seq_num 854 ranges {4907008=712704,5619712=794624,6414336=450560,6864896=360448} 2024-09-10T18:06:10.568 INFO:tasks.rados.rados.0.smithi012.stdout:2730: writing smithi01278544-13 from 4907008 to 5619712 tid 1 2024-09-10T18:06:10.572 INFO:tasks.rados.rados.0.smithi012.stdout:2730: writing smithi01278544-13 from 5619712 to 6414336 tid 2 2024-09-10T18:06:10.575 INFO:tasks.rados.rados.0.smithi012.stdout:2730: writing smithi01278544-13 from 6414336 to 6864896 tid 3 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2730: writing smithi01278544-13 from 6864896 to 7225344 tid 4 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2731: setattr oid 15 current snap is 277 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2725: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2724: finishing write tid 4 to smithi01278544-44 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2724: finishing write tid 5 to smithi01278544-44 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2724: finishing write tid 6 to smithi01278544-44 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2724: oid 44 updating version 0 to 1593 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2724: oid 44 version 1593 is already newer than 1592 2024-09-10T18:06:10.578 INFO:tasks.rados.rados.0.smithi012.stdout:2724: oid 44 updating version 1593 to 1595 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2724: oid 44 version 1595 is already newer than 1594 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2724: oid 44 updating version 1595 to 1596 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1596 (ObjNum 852 snap 277 seq_num 852) dirty exists 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2724: left oid 44 (ObjNum 852 snap 277 seq_num 852) 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2726: finishing write tid 1 to smithi01278544-7 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2726: finishing write tid 2 to smithi01278544-7 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2728: finishing copy_from to smithi01278544-26 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2728: got expected ENOENT (src dne) 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2728: finishing copy_from racing read to smithi01278544-26 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2726: finishing write tid 3 to smithi01278544-7 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2726: finishing write tid 4 to smithi01278544-7 2024-09-10T18:06:10.579 INFO:tasks.rados.rados.0.smithi012.stdout:2726: finishing write tid 5 to smithi01278544-7 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:2726: finishing write tid 6 to smithi01278544-7 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:2726: oid 7 updating version 0 to 1118 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:2726: oid 7 updating version 1118 to 1119 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:2726: oid 7 version 1119 is already newer than 1117 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:2726: oid 7 updating version 1119 to 1120 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:2726: oid 7 updating version 1120 to 1121 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1121 (ObjNum 853 snap 277 seq_num 853) dirty exists 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:2726: left oid 7 (ObjNum 853 snap 277 seq_num 853) 2024-09-10T18:06:10.580 INFO:tasks.rados.rados.0.smithi012.stdout:2727: expect (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:06:10.635 INFO:tasks.rados.rados.0.smithi012.stdout:2730: finishing write tid 1 to smithi01278544-13 2024-09-10T18:06:10.636 INFO:tasks.rados.rados.0.smithi012.stdout:2730: finishing write tid 2 to smithi01278544-13 2024-09-10T18:06:10.636 INFO:tasks.rados.rados.0.smithi012.stdout:2730: finishing write tid 3 to smithi01278544-13 2024-09-10T18:06:10.636 INFO:tasks.rados.rados.0.smithi012.stdout:2730: finishing write tid 4 to smithi01278544-13 2024-09-10T18:06:10.636 INFO:tasks.rados.rados.0.smithi012.stdout:2730: finishing write tid 5 to smithi01278544-13 2024-09-10T18:06:10.636 INFO:tasks.rados.rados.0.smithi012.stdout:2730: finishing write tid 6 to smithi01278544-13 2024-09-10T18:06:10.636 INFO:tasks.rados.rados.0.smithi012.stdout:2730: oid 13 updating version 0 to 1400 2024-09-10T18:06:10.636 INFO:tasks.rados.rados.0.smithi012.stdout:2730: oid 13 updating version 1400 to 1402 2024-09-10T18:06:10.636 INFO:tasks.rados.rados.0.smithi012.stdout:2730: oid 13 version 1402 is already newer than 1401 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2730: oid 13 version 1402 is already newer than 1398 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2730: oid 13 version 1402 is already newer than 1399 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1402 (ObjNum 854 snap 277 seq_num 854) dirty exists 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2730: left oid 13 (ObjNum 854 snap 277 seq_num 854) 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2724: done (7 left) 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2725: done (6 left) 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2726: done (5 left) 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2727: done (4 left) 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2728: done (3 left) 2024-09-10T18:06:10.637 INFO:tasks.rados.rados.0.smithi012.stdout:2729: done (2 left) 2024-09-10T18:06:10.638 INFO:tasks.rados.rados.0.smithi012.stdout:2730: done (1 left) 2024-09-10T18:06:10.638 INFO:tasks.rados.rados.0.smithi012.stdout:2732: read oid 47 snap -1 2024-09-10T18:06:10.638 INFO:tasks.rados.rados.0.smithi012.stdout:2732: expect deleted 2024-09-10T18:06:10.638 INFO:tasks.rados.rados.0.smithi012.stdout:2733: rmattr oid 44 current snap is 277 2024-09-10T18:06:10.638 INFO:tasks.rados.rados.0.smithi012.stdout:2734: snap_create 2024-09-10T18:06:10.639 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1597 (ObjNum 852 snap 277 seq_num 852) dirty exists 2024-09-10T18:06:10.640 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 1590 (ObjNum 762 snap 249 seq_num 762) dirty exists 2024-09-10T18:06:10.793 INFO:tasks.rados.rados.0.smithi012.stdout:2731: done (3 left) 2024-09-10T18:06:10.793 INFO:tasks.rados.rados.0.smithi012.stdout:2732: done (2 left) 2024-09-10T18:06:10.793 INFO:tasks.rados.rados.0.smithi012.stdout:2733: done (1 left) 2024-09-10T18:06:10.793 INFO:tasks.rados.rados.0.smithi012.stdout:2734: done (0 left) 2024-09-10T18:06:10.793 INFO:tasks.rados.rados.0.smithi012.stdout:2735: delete oid 33 current snap is 278 2024-09-10T18:06:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:2735: done (0 left) 2024-09-10T18:06:10.797 INFO:tasks.rados.rados.0.smithi012.stdout:2736: snap_remove snap 277 2024-09-10T18:06:10.889 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:10 smithi089 ceph-mon[84132]: pgmap v622: 121 pgs: 121 active+clean; 307 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-10T18:06:10.890 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:10 smithi089 ceph-mon[84132]: osdmap e631: 8 total, 8 up, 8 in 2024-09-10T18:06:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:10 smithi012 ceph-mon[89611]: pgmap v622: 121 pgs: 121 active+clean; 307 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-10T18:06:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:10 smithi012 ceph-mon[89611]: osdmap e631: 8 total, 8 up, 8 in 2024-09-10T18:06:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:10 smithi012 ceph-mon[92029]: pgmap v622: 121 pgs: 121 active+clean; 307 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-10T18:06:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:10 smithi012 ceph-mon[92029]: osdmap e631: 8 total, 8 up, 8 in 2024-09-10T18:06:11.802 INFO:tasks.rados.rados.0.smithi012.stdout:2736: done (0 left) 2024-09-10T18:06:11.802 INFO:tasks.rados.rados.0.smithi012.stdout:2737: snap_remove snap 261 2024-09-10T18:06:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:11 smithi089 ceph-mon[84132]: osdmap e632: 8 total, 8 up, 8 in 2024-09-10T18:06:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:11 smithi012 ceph-mon[89611]: osdmap e632: 8 total, 8 up, 8 in 2024-09-10T18:06:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:11 smithi012 ceph-mon[92029]: osdmap e632: 8 total, 8 up, 8 in 2024-09-10T18:06:12.332 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:12 smithi089 systemd[1]: Stopping Ceph grafana.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:06:12.598 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:12 smithi089 podman[120249]: 2024-09-10 18:06:12.33145952 +0000 UTC m=+0.112802842 container died dfdd59da1bcad7bec4f96ed7ddfacb6e9591a98eafa08a743329dd83cf82164d (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, io.openshift.expose-services=, build-date=2022-04-29T11:48:11.055897, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.tags=base rhel8, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vcs-type=git, name=ubi8, description=Ceph Grafana Container, vendor=Red Hat, Inc., release=239.1651231664, version=8.5, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, io.buildah.version=1.32.0) 2024-09-10T18:06:12.765 INFO:tasks.rados.rados.0.smithi012.stdout:2737: done (0 left) 2024-09-10T18:06:12.765 INFO:tasks.rados.rados.0.smithi012.stdout:2738: read oid 40 snap -1 2024-09-10T18:06:12.765 INFO:tasks.rados.rados.0.smithi012.stdout:2738: expect deleted 2024-09-10T18:06:12.765 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 278 2024-09-10T18:06:12.766 INFO:tasks.rados.rados.0.smithi012.stdout:2739: seq_num 856 ranges {11960320=745472,12705792=557056,13262848=417792,13680640=434176,14114816=196608} 2024-09-10T18:06:12.837 INFO:tasks.rados.rados.0.smithi012.stdout:2739: writing smithi01278544-16 from 11960320 to 12705792 tid 1 2024-09-10T18:06:12.840 INFO:tasks.rados.rados.0.smithi012.stdout:2739: writing smithi01278544-16 from 12705792 to 13262848 tid 2 2024-09-10T18:06:12.843 INFO:tasks.rados.rados.0.smithi012.stdout:2739: writing smithi01278544-16 from 13262848 to 13680640 tid 3 2024-09-10T18:06:12.845 INFO:tasks.rados.rados.0.smithi012.stdout:2739: writing smithi01278544-16 from 13680640 to 14114816 tid 4 2024-09-10T18:06:12.847 INFO:tasks.rados.rados.0.smithi012.stdout:2739: writing smithi01278544-16 from 14114816 to 14311424 tid 5 2024-09-10T18:06:12.847 INFO:tasks.rados.rados.0.smithi012.stdout:2740: delete oid 9 current snap is 278 2024-09-10T18:06:12.847 INFO:tasks.rados.rados.0.smithi012.stdout:2739: finishing write tid 1 to smithi01278544-16 2024-09-10T18:06:12.847 INFO:tasks.rados.rados.0.smithi012.stdout:2739: finishing write tid 2 to smithi01278544-16 2024-09-10T18:06:12.848 INFO:tasks.rados.rados.0.smithi012.stdout:2739: finishing write tid 3 to smithi01278544-16 2024-09-10T18:06:12.851 INFO:tasks.rados.rados.0.smithi012.stdout:2738: done (2 left) 2024-09-10T18:06:12.851 INFO:tasks.rados.rados.0.smithi012.stdout:2740: done (1 left) 2024-09-10T18:06:12.851 INFO:tasks.rados.rados.0.smithi012.stdout:2741: rollback oid 33 current snap is 278 2024-09-10T18:06:12.851 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 33 to 276 2024-09-10T18:06:12.852 INFO:tasks.rados.rados.0.smithi012.stdout:2742: rollback oid 3 current snap is 278 2024-09-10T18:06:12.852 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 274 2024-09-10T18:06:12.852 INFO:tasks.rados.rados.0.smithi012.stdout:2743: copy_from oid 47 from oid 34 current snap is 278 2024-09-10T18:06:12.852 INFO:tasks.rados.rados.0.smithi012.stdout:2744: copy_from oid 13 from oid 17 current snap is 278 2024-09-10T18:06:12.852 INFO:tasks.rados.rados.0.smithi012.stdout:2745: snap_remove snap 242 2024-09-10T18:06:12.990 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:12 smithi089 ceph-mon[84132]: pgmap v625: 121 pgs: 121 active+clean; 311 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-10T18:06:12.991 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:12 smithi089 ceph-mon[84132]: osdmap e633: 8 total, 8 up, 8 in 2024-09-10T18:06:12.991 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:12 smithi089 ceph-mon[84132]: osdmap e634: 8 total, 8 up, 8 in 2024-09-10T18:06:12.991 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:12 smithi089 podman[120249]: 2024-09-10 18:06:12.695855654 +0000 UTC m=+0.477198973 container cleanup dfdd59da1bcad7bec4f96ed7ddfacb6e9591a98eafa08a743329dd83cf82164d (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, com.redhat.component=ubi8-container, io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, description=Ceph Grafana Container, io.openshift.expose-services=, release=239.1651231664, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.32.0, maintainer=Paul Cuzner , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, build-date=2022-04-29T11:48:11.055897, distribution-scope=public, name=ubi8) 2024-09-10T18:06:12.991 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:12 smithi089 bash[120249]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a 2024-09-10T18:06:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:12 smithi012 ceph-mon[89611]: pgmap v625: 121 pgs: 121 active+clean; 311 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-10T18:06:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:12 smithi012 ceph-mon[89611]: osdmap e633: 8 total, 8 up, 8 in 2024-09-10T18:06:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:12 smithi012 ceph-mon[89611]: osdmap e634: 8 total, 8 up, 8 in 2024-09-10T18:06:13.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:12 smithi012 ceph-mon[92029]: pgmap v625: 121 pgs: 121 active+clean; 311 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-10T18:06:13.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:12 smithi012 ceph-mon[92029]: osdmap e633: 8 total, 8 up, 8 in 2024-09-10T18:06:13.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:12 smithi012 ceph-mon[92029]: osdmap e634: 8 total, 8 up, 8 in 2024-09-10T18:06:13.285 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:12 smithi089 podman[120261]: 2024-09-10 18:06:12.989362335 +0000 UTC m=+0.656391987 container remove dfdd59da1bcad7bec4f96ed7ddfacb6e9591a98eafa08a743329dd83cf82164d (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, io.buildah.version=1.32.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, architecture=x86_64, build-date=2022-04-29T11:48:11.055897, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=Ceph Grafana Container, io.openshift.expose-services=, io.openshift.tags=base rhel8, vcs-type=git, name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, maintainer=Paul Cuzner , io.k8s.display-name=Red Hat Universal Base Image 8, distribution-scope=public, release=239.1651231664, vendor=Red Hat, Inc.) 2024-09-10T18:06:13.286 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:12 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-09-10T18:06:13.286 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@grafana.a.service: Failed with result 'exit-code'. 2024-09-10T18:06:13.286 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 systemd[1]: Stopped Ceph grafana.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:06:13.286 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@grafana.a.service: Consumed 10.504s CPU time. 2024-09-10T18:06:13.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 systemd[1]: Starting Ceph grafana.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:06:13.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 podman[120389]: 2024-09-10 18:06:13.445305529 +0000 UTC m=+0.016534792 image pull c8b91775d855b99270fc5d22f3c6737e8cca01ef4c25c8b0362295e0746fa39b quay.io/ceph/grafana:10.4.0 2024-09-10T18:06:13.665 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 podman[120389]: 2024-09-10 18:06:13.549133764 +0000 UTC m=+0.120363058 container create bb062cb57fa336a99dc3fc58c37cb2239a54cf8b0bb32c6e00e1fb91cacfdf20 (image=quay.io/ceph/grafana:10.4.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-09-10T18:06:13.811 INFO:tasks.rados.rados.0.smithi012.stdout:2745: done (5 left) 2024-09-10T18:06:13.811 INFO:tasks.rados.rados.0.smithi012.stdout:2746: delete oid 42 current snap is 278 2024-09-10T18:06:13.811 INFO:tasks.rados.rados.0.smithi012.stdout:2739: finishing write tid 4 to smithi01278544-16 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: finishing write tid 5 to smithi01278544-16 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: finishing write tid 6 to smithi01278544-16 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2744: finishing copy_from to smithi01278544-13 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2744: got expected ENOENT (src dne) 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2744: finishing copy_from racing read to smithi01278544-13 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: finishing write tid 7 to smithi01278544-16 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: oid 16 updating version 0 to 1139 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: oid 16 updating version 1139 to 1141 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: oid 16 updating version 1141 to 1142 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: oid 16 version 1142 is already newer than 1140 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: oid 16 version 1142 is already newer than 1138 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:2739: oid 16 updating version 1142 to 1143 2024-09-10T18:06:13.812 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 1143 (ObjNum 856 snap 278 seq_num 856) dirty exists 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:2739: left oid 16 (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:2741: finishing rollback tid 1 to smithi01278544-33 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:2741: finishing rollback tid 2 to smithi01278544-33 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 1971 (ObjNum 768 snap 253 seq_num 768) dirty exists 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:2742: finishing rollback tid 0 to smithi01278544-3 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:2742: finishing rollback tid 1 to smithi01278544-3 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:2742: finishing rollback tid 2 to smithi01278544-3 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1600 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:2743: finishing copy_from racing read to smithi01278544-47 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:2743: finishing copy_from to smithi01278544-47 2024-09-10T18:06:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 1161 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:06:13.819 INFO:tasks.rados.rados.0.smithi012.stdout:2739: done (5 left) 2024-09-10T18:06:13.819 INFO:tasks.rados.rados.0.smithi012.stdout:2741: done (4 left) 2024-09-10T18:06:13.819 INFO:tasks.rados.rados.0.smithi012.stdout:2742: done (3 left) 2024-09-10T18:06:13.819 INFO:tasks.rados.rados.0.smithi012.stdout:2743: done (2 left) 2024-09-10T18:06:13.819 INFO:tasks.rados.rados.0.smithi012.stdout:2744: done (1 left) 2024-09-10T18:06:13.819 INFO:tasks.rados.rados.0.smithi012.stdout:2746: done (0 left) 2024-09-10T18:06:13.819 INFO:tasks.rados.rados.0.smithi012.stdout:2747: delete oid 21 current snap is 278 2024-09-10T18:06:13.831 INFO:tasks.rados.rados.0.smithi012.stdout:2747: done (0 left) 2024-09-10T18:06:13.831 INFO:tasks.rados.rados.0.smithi012.stdout:2748: copy_from oid 13 from oid 17 current snap is 278 2024-09-10T18:06:13.831 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 278 2024-09-10T18:06:13.831 INFO:tasks.rados.rados.0.smithi012.stdout:2749: seq_num 860 ranges {0=8192} 2024-09-10T18:06:13.831 INFO:tasks.rados.rados.0.smithi012.stdout:2749: writing smithi01278544-26 from 0 to 8192 tid 1 2024-09-10T18:06:13.831 INFO:tasks.rados.rados.0.smithi012.stdout:2750: snap_create 2024-09-10T18:06:13.832 INFO:tasks.rados.rados.0.smithi012.stdout:2748: finishing copy_from to smithi01278544-13 2024-09-10T18:06:13.832 INFO:tasks.rados.rados.0.smithi012.stdout:2748: got expected ENOENT (src dne) 2024-09-10T18:06:13.833 INFO:tasks.rados.rados.0.smithi012.stdout:2748: finishing copy_from racing read to smithi01278544-13 2024-09-10T18:06:13.838 INFO:tasks.rados.rados.0.smithi012.stdout:2749: finishing write tid 1 to smithi01278544-26 2024-09-10T18:06:13.838 INFO:tasks.rados.rados.0.smithi012.stdout:2749: finishing write tid 2 to smithi01278544-26 2024-09-10T18:06:13.839 INFO:tasks.rados.rados.0.smithi012.stdout:2749: finishing write tid 3 to smithi01278544-26 2024-09-10T18:06:13.839 INFO:tasks.rados.rados.0.smithi012.stdout:2749: oid 26 updating version 0 to 1585 2024-09-10T18:06:13.840 INFO:tasks.rados.rados.0.smithi012.stdout:2749: oid 26 version 1585 is already newer than 1584 2024-09-10T18:06:13.840 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 1585 (ObjNum 860 snap 278 seq_num 860) dirty exists 2024-09-10T18:06:13.840 INFO:tasks.rados.rados.0.smithi012.stdout:2749: left oid 26 (ObjNum 860 snap 278 seq_num 860) 2024-09-10T18:06:13.930 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 podman[120389]: 2024-09-10 18:06:13.784637427 +0000 UTC m=+0.355866678 container init bb062cb57fa336a99dc3fc58c37cb2239a54cf8b0bb32c6e00e1fb91cacfdf20 (image=quay.io/ceph/grafana:10.4.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-09-10T18:06:13.930 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 podman[120389]: 2024-09-10 18:06:13.787390738 +0000 UTC m=+0.358619996 container start bb062cb57fa336a99dc3fc58c37cb2239a54cf8b0bb32c6e00e1fb91cacfdf20 (image=quay.io/ceph/grafana:10.4.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-09-10T18:06:13.930 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 bash[120389]: bb062cb57fa336a99dc3fc58c37cb2239a54cf8b0bb32c6e00e1fb91cacfdf20 2024-09-10T18:06:13.930 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 systemd[1]: Started Ceph grafana.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:06:14.181 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929093729Z level=info msg="Starting Grafana" version=10.4.0 commit=03f502a94d17f7dc4e6c34acdf8428aedd986e4c branch=HEAD compiled=2024-09-10T18:06:13Z 2024-09-10T18:06:14.181 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.92949461Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-10T18:06:14.181 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929507163Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-10T18:06:14.181 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929512147Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-09-10T18:06:14.181 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929516857Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-09-10T18:06:14.181 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929521914Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929526326Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929530726Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929535353Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929539419Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929543214Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929546913Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929551425Z level=info msg=Target target=[all] 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929561716Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929566038Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929570325Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929574512Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-10T18:06:14.182 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929579223Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-10T18:06:14.183 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=settings t=2024-09-10T18:06:13.929583848Z level=info msg="App mode production" 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=sqlstore t=2024-09-10T18:06:13.92984648Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=sqlstore t=2024-09-10T18:06:13.92986043Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.93033956Z level=info msg="Starting DB migrations" 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.941947084Z level=info msg="Executing migration" id="Add uid column to user" 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.947451195Z level=info msg="Migration successfully executed" id="Add uid column to user" duration=5.503353ms 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.947865231Z level=info msg="Executing migration" id="Update uid column values for users" 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.948019283Z level=info msg="Migration successfully executed" id="Update uid column values for users" duration=153.975µs 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.948405912Z level=info msg="Executing migration" id="Add unique index user_uid" 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.949152069Z level=info msg="Migration successfully executed" id="Add unique index user_uid" duration=745.967µs 2024-09-10T18:06:14.184 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.949702556Z level=info msg="Executing migration" id="Add playlist column created_at" 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.954882228Z level=info msg="Migration successfully executed" id="Add playlist column created_at" duration=5.178486ms 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.955433461Z level=info msg="Executing migration" id="Add playlist column updated_at" 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.960793878Z level=info msg="Migration successfully executed" id="Add playlist column updated_at" duration=5.346875ms 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.96135855Z level=info msg="Executing migration" id="Add column uid in team" 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.966883908Z level=info msg="Migration successfully executed" id="Add column uid in team" duration=5.524042ms 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.967278684Z level=info msg="Executing migration" id="Update uid column values in team" 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.967408308Z level=info msg="Migration successfully executed" id="Update uid column values in team" duration=130.283µs 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.968069063Z level=info msg="Executing migration" id="Add unique index team_org_id_uid" 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.968814572Z level=info msg="Migration successfully executed" id="Add unique index team_org_id_uid" duration=745.653µs 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.969249833Z level=info msg="Executing migration" id="add index user_auth_token.revoked_at" 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.969952778Z level=info msg="Migration successfully executed" id="add index user_auth_token.revoked_at" duration=702.357µs 2024-09-10T18:06:14.185 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.97036143Z level=info msg="Executing migration" id="add result_fingerprint column to alert_instance" 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.975631804Z level=info msg="Migration successfully executed" id="add result_fingerprint column to alert_instance" duration=5.270336ms 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.976069387Z level=info msg="Executing migration" id="add last_applied column to alert_configuration_history" 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.981565869Z level=info msg="Migration successfully executed" id="add last_applied column to alert_configuration_history" duration=5.495833ms 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.981981721Z level=info msg="Executing migration" id="alter library_element model to mediumtext" 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.982061433Z level=info msg="Migration successfully executed" id="alter library_element model to mediumtext" duration=79.833µs 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.982837102Z level=info msg="Executing migration" id="permission kind migration" 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.987873665Z level=info msg="Migration successfully executed" id="permission kind migration" duration=5.037157ms 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.988267075Z level=info msg="Executing migration" id="permission attribute migration" 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.993458289Z level=info msg="Migration successfully executed" id="permission attribute migration" duration=5.191256ms 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.993884432Z level=info msg="Executing migration" id="permission identifier migration" 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:13 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:13.999707104Z level=info msg="Migration successfully executed" id="permission identifier migration" duration=5.821769ms 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.000119027Z level=info msg="Executing migration" id="add permission identifier index" 2024-09-10T18:06:14.186 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.001112462Z level=info msg="Migration successfully executed" id="add permission identifier index" duration=993.344µs 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.001481776Z level=info msg="Executing migration" id="add permission action scope role_id index" 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.002354306Z level=info msg="Migration successfully executed" id="add permission action scope role_id index" duration=872.032µs 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.002702061Z level=info msg="Executing migration" id="remove permission role_id action scope index" 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.003438201Z level=info msg="Migration successfully executed" id="remove permission role_id action scope index" duration=736.021µs 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.003823462Z level=info msg="Executing migration" id="rbac disabled migrator" 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.003849082Z level=info msg="Migration successfully executed" id="rbac disabled migrator" duration=25.962µs 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.004603597Z level=info msg="Executing migration" id="drop index IDX_correlation_uid - v1" 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.005317051Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_uid - v1" duration=713.342µs 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.005662786Z level=info msg="Executing migration" id="drop index IDX_correlation_source_uid - v1" 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.006362057Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_source_uid - v1" duration=699.016µs 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.006709927Z level=info msg="Executing migration" id="Rename table correlation to correlation_tmp_qwerty - v1" 2024-09-10T18:06:14.187 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.022400813Z level=info msg="Migration successfully executed" id="Rename table correlation to correlation_tmp_qwerty - v1" duration=15.690106ms 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.022891068Z level=info msg="Executing migration" id="create correlation v2" 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.023618159Z level=info msg="Migration successfully executed" id="create correlation v2" duration=726.916µs 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.02405078Z level=info msg="Executing migration" id="create index IDX_correlation_uid - v2" 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.024748842Z level=info msg="Migration successfully executed" id="create index IDX_correlation_uid - v2" duration=697.801µs 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.025104704Z level=info msg="Executing migration" id="create index IDX_correlation_source_uid - v2" 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.025800105Z level=info msg="Migration successfully executed" id="create index IDX_correlation_source_uid - v2" duration=695.164µs 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.026157946Z level=info msg="Executing migration" id="create index IDX_correlation_org_id - v2" 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.026843282Z level=info msg="Migration successfully executed" id="create index IDX_correlation_org_id - v2" duration=685.446µs 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.027206263Z level=info msg="Executing migration" id="copy correlation v1 to v2" 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.027381224Z level=info msg="Migration successfully executed" id="copy correlation v1 to v2" duration=175.45µs 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.028035864Z level=info msg="Executing migration" id="drop correlation_tmp_qwerty" 2024-09-10T18:06:14.188 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.028602604Z level=info msg="Migration successfully executed" id="drop correlation_tmp_qwerty" duration=566.54µs 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.028957201Z level=info msg="Executing migration" id="add provisioning column" 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.034102322Z level=info msg="Migration successfully executed" id="add provisioning column" duration=5.126264ms 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.034500932Z level=info msg="Executing migration" id="backfill empty share column fields with default of public" 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.034639395Z level=info msg="Migration successfully executed" id="backfill empty share column fields with default of public" duration=137.972µs 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.035245948Z level=info msg="Executing migration" id="migrate contents column to mediumblob for MySQL" 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.035283975Z level=info msg="Migration successfully executed" id="migrate contents column to mediumblob for MySQL" duration=37.911µs 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.036051706Z level=info msg="Executing migration" id="add origin column to seed_assignment" 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.041465448Z level=info msg="Migration successfully executed" id="add origin column to seed_assignment" duration=5.413097ms 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.041856303Z level=info msg="Executing migration" id="add origin to plugin seed_assignment" 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.042076575Z level=info msg="Migration successfully executed" id="add origin to plugin seed_assignment" duration=220.696µs 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.042685503Z level=info msg="Executing migration" id="prevent seeding OnCall access" 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.042802782Z level=info msg="Migration successfully executed" id="prevent seeding OnCall access" duration=116.876µs 2024-09-10T18:06:14.189 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.043540428Z level=info msg="Executing migration" id="managed folder permissions library panel actions migration" 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.044549333Z level=info msg="Migration successfully executed" id="managed folder permissions library panel actions migration" duration=1.008561ms 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.046478466Z level=info msg="Executing migration" id="Remove unique index for folder.title and folder.parent_uid" 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.047220669Z level=info msg="Migration successfully executed" id="Remove unique index for folder.title and folder.parent_uid" duration=741.753µs 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.049269615Z level=info msg="Executing migration" id="Add unique index for title, parent_uid, and org_id" 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.050048653Z level=info msg="Migration successfully executed" id="Add unique index for title, parent_uid, and org_id" duration=778.357µs 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.05040193Z level=info msg="Executing migration" id="Sync dashboard and folder table" 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.050874112Z level=info msg="Migration successfully executed" id="Sync dashboard and folder table" duration=472.047µs 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.052225821Z level=info msg="Executing migration" id="Remove ghost folders from the folder table" 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.05242278Z level=info msg="Migration successfully executed" id="Remove ghost folders from the folder table" duration=196.943µs 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.054317553Z level=info msg="Executing migration" id="Remove unique index UQE_folder_uid_org_id" 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.055051059Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_uid_org_id" duration=733.907µs 2024-09-10T18:06:14.190 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.055392131Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_uid" 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.056109597Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_uid" duration=715.466µs 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.056449991Z level=info msg="Executing migration" id="Remove unique index UQE_folder_title_parent_uid_org_id" 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.057136281Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_title_parent_uid_org_id" duration=685.069µs 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.058647144Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_parent_uid_title" 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.059365274Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_parent_uid_title" duration=718.004µs 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.060450872Z level=info msg="Executing migration" id="Remove index IDX_folder_parent_uid_org_id" 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.061132153Z level=info msg="Migration successfully executed" id="Remove index IDX_folder_parent_uid_org_id" duration=681.246µs 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.062513217Z level=info msg="Executing migration" id="create anon_device table" 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.063109402Z level=info msg="Migration successfully executed" id="create anon_device table" duration=596.49µs 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.064596902Z level=info msg="Executing migration" id="add unique index anon_device.device_id" 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.065319455Z level=info msg="Migration successfully executed" id="add unique index anon_device.device_id" duration=722.814µs 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.066416168Z level=info msg="Executing migration" id="add index anon_device.updated_at" 2024-09-10T18:06:14.191 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.067123132Z level=info msg="Migration successfully executed" id="add index anon_device.updated_at" duration=706.667µs 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.06824061Z level=info msg="Executing migration" id="create signing_key table" 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.068816727Z level=info msg="Migration successfully executed" id="create signing_key table" duration=576.446µs 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.070093138Z level=info msg="Executing migration" id="add unique index signing_key.key_id" 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.070793363Z level=info msg="Migration successfully executed" id="add unique index signing_key.key_id" duration=700.986µs 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.07224727Z level=info msg="Executing migration" id="set legacy alert migration status in kvstore" 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.072906415Z level=info msg="Migration successfully executed" id="set legacy alert migration status in kvstore" duration=659.19µs 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.074128469Z level=info msg="Executing migration" id="migrate record of created folders during legacy migration to kvstore" 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.07455982Z level=info msg="Migration successfully executed" id="migrate record of created folders during legacy migration to kvstore" duration=432.539µs 2024-09-10T18:06:14.192 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.074956884Z level=info msg="Executing migration" id="Add folder_uid for dashboard" 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.08011686Z level=info msg="Migration successfully executed" id="Add folder_uid for dashboard" duration=5.159467ms 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.080458282Z level=info msg="Executing migration" id="Populate dashboard folder_uid column" 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.08219902Z level=info msg="Migration successfully executed" id="Populate dashboard folder_uid column" duration=1.741435ms 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.082731693Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title" 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.083660787Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title" duration=927.717µs 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.083988966Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_id_title" 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.084740144Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_id_title" duration=751.154µs 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.085075262Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_uid_title" 2024-09-10T18:06:14.193 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.085808607Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_uid_title" duration=733.871µs 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.086174185Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.087021936Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" duration=847.834µs 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.08737876Z level=info msg="Executing migration" id="Restore index for dashboard_org_id_folder_id_title" 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.08816252Z level=info msg="Migration successfully executed" id="Restore index for dashboard_org_id_folder_id_title" duration=783.878µs 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.08857229Z level=info msg="Executing migration" id="create sso_setting table" 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.089348015Z level=info msg="Migration successfully executed" id="create sso_setting table" duration=775.977µs 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.089764419Z level=info msg="Executing migration" id="copy kvstore migration status to each org" 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.090411941Z level=info msg="Migration successfully executed" id="copy kvstore migration status to each org" duration=648.039µs 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.090749597Z level=info msg="Executing migration" id="add back entry for orgid=0 migrated status" 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.091156757Z level=info msg="Migration successfully executed" id="add back entry for orgid=0 migrated status" duration=407.235µs 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.092629844Z level=info msg="Executing migration" id="alter kv_store.value to longtext" 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.092690225Z level=info msg="Migration successfully executed" id="alter kv_store.value to longtext" duration=59.731µs 2024-09-10T18:06:14.194 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.093515822Z level=info msg="Executing migration" id="add notification_settings column to alert_rule table" 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.098810407Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule table" duration=5.293514ms 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.099183101Z level=info msg="Executing migration" id="add notification_settings column to alert_rule_version table" 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.104475543Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule_version table" duration=5.29237ms 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.104855053Z level=info msg="Executing migration" id="removing scope from alert.instances:read action migration" 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.105090497Z level=info msg="Migration successfully executed" id="removing scope from alert.instances:read action migration" duration=237.535µs 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=migrator t=2024-09-10T18:06:14.105683724Z level=info msg="migrations completed" performed=65 skipped=482 duration=163.812072ms 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=sqlstore t=2024-09-10T18:06:14.106383003Z level=info msg="Created default organization" 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=secrets t=2024-09-10T18:06:14.108426955Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=plugin.store t=2024-09-10T18:06:14.123215075Z level=info msg="Loading plugins..." 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=local.finder t=2024-09-10T18:06:14.168689957Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=plugin.store t=2024-09-10T18:06:14.168711706Z level=info msg="Plugins loaded" count=55 duration=45.497712ms 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=query_data t=2024-09-10T18:06:14.170731222Z level=info msg="Query Service initialization" 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=live.push_http t=2024-09-10T18:06:14.173108759Z level=info msg="Live Push Gateway initialization" 2024-09-10T18:06:14.195 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=ngalert.migration t=2024-09-10T18:06:14.1743583Z level=info msg=Starting 2024-09-10T18:06:14.196 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=ngalert.state.manager t=2024-09-10T18:06:14.180130436Z level=info msg="Running in alternative execution of Error/NoData mode" 2024-09-10T18:06:14.196 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=infra.usagestats.collector t=2024-09-10T18:06:14.181609626Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-10T18:06:14.536 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=provisioning.datasources t=2024-09-10T18:06:14.184362197Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-09-10T18:06:14.536 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=provisioning.datasources t=2024-09-10T18:06:14.18465468Z level=info msg="inserting datasource from configuration" name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-10T18:06:14.536 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=provisioning.alerting t=2024-09-10T18:06:14.216691491Z level=info msg="starting to provision alerting" 2024-09-10T18:06:14.536 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=provisioning.alerting t=2024-09-10T18:06:14.216715156Z level=info msg="finished to provision alerting" 2024-09-10T18:06:14.536 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=grafanaStorageLogger t=2024-09-10T18:06:14.217028161Z level=info msg="Storage starting" 2024-09-10T18:06:14.536 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=ngalert.state.manager t=2024-09-10T18:06:14.217670268Z level=info msg="Warming state cache for startup" 2024-09-10T18:06:14.536 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=http.server t=2024-09-10T18:06:14.219590117Z level=info msg="HTTP Server TLS settings" MinTLSVersion=TLS1.2 configuredciphers=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,TLS_RSA_WITH_AES_128_GCM_SHA256,TLS_RSA_WITH_AES_256_GCM_SHA384,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA 2024-09-10T18:06:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=http.server t=2024-09-10T18:06:14.219932361Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-10T18:06:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=ngalert.multiorg.alertmanager t=2024-09-10T18:06:14.220181953Z level=info msg="Starting MultiOrg Alertmanager" 2024-09-10T18:06:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=provisioning.dashboard t=2024-09-10T18:06:14.237738027Z level=info msg="starting to provision dashboards" 2024-09-10T18:06:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=ngalert.state.manager t=2024-09-10T18:06:14.238342864Z level=info msg="State cache has been initialized" states=0 duration=20.672031ms 2024-09-10T18:06:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=ngalert.scheduler t=2024-09-10T18:06:14.238365222Z level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1 2024-09-10T18:06:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=ticker t=2024-09-10T18:06:14.238426495Z level=info msg=starting first_tick=2024-09-10T18:06:20Z 2024-09-10T18:06:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=plugins.update.checker t=2024-09-10T18:06:14.300172022Z level=info msg="Update check succeeded" duration=79.862526ms 2024-09-10T18:06:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=grafana.update.checker t=2024-09-10T18:06:14.313158637Z level=info msg="Update check succeeded" duration=96.298288ms 2024-09-10T18:06:14.538 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=provisioning.dashboard t=2024-09-10T18:06:14.407225821Z level=info msg="finished to provision dashboards" 2024-09-10T18:06:14.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:06:14] "GET /metrics HTTP/1.1" 200 36353 "" "Prometheus/2.51.0" 2024-09-10T18:06:14.801 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=grafana-apiserver t=2024-09-10T18:06:14.538583813Z level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager" 2024-09-10T18:06:14.801 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=grafana-apiserver t=2024-09-10T18:06:14.538955449Z level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager" 2024-09-10T18:06:14.813 INFO:tasks.rados.rados.0.smithi012.stdout:2748: done (2 left) 2024-09-10T18:06:14.813 INFO:tasks.rados.rados.0.smithi012.stdout:2749: done (1 left) 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2750: done (0 left) 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2751: copy_from oid 24 from oid 35 current snap is 279 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2752: read oid 32 snap 275 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2752: expect (ObjNum 840 snap 272 seq_num 840) 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2753: read oid 38 snap -1 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2753: expect (ObjNum 847 snap 274 seq_num 847) 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2754: read oid 50 snap 265 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2754: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:06:14.814 INFO:tasks.rados.rados.0.smithi012.stdout:2755: snap_remove snap 269 2024-09-10T18:06:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[89611]: pgmap v628: 121 pgs: 121 active+clean; 321 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 34 op/s 2024-09-10T18:06:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[89611]: osdmap e635: 8 total, 8 up, 8 in 2024-09-10T18:06:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:15.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[92029]: pgmap v628: 121 pgs: 121 active+clean; 321 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 34 op/s 2024-09-10T18:06:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[92029]: osdmap e635: 8 total, 8 up, 8 in 2024-09-10T18:06:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:15.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:14 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-mon[84132]: pgmap v628: 121 pgs: 121 active+clean; 321 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 3.8 MiB/s wr, 34 op/s 2024-09-10T18:06:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-mon[84132]: osdmap e635: 8 total, 8 up, 8 in 2024-09-10T18:06:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:14 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:15.824 INFO:tasks.rados.rados.0.smithi012.stdout:2755: done (4 left) 2024-09-10T18:06:15.824 INFO:tasks.rados.rados.0.smithi012.stdout:2756: delete oid 6 current snap is 279 2024-09-10T18:06:15.824 INFO:tasks.rados.rados.0.smithi012.stdout:2752: expect (ObjNum 840 snap 272 seq_num 840) 2024-09-10T18:06:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:2751: finishing copy_from racing read to smithi01278544-24 2024-09-10T18:06:15.889 INFO:tasks.rados.rados.0.smithi012.stdout:2754: expect (ObjNum 654 snap 214 seq_num 654) 2024-09-10T18:06:15.925 INFO:tasks.rados.rados.0.smithi012.stdout:2751: finishing copy_from to smithi01278544-24 2024-09-10T18:06:15.925 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 1172 (ObjNum 843 snap 274 seq_num 843) dirty exists 2024-09-10T18:06:15.925 INFO:tasks.rados.rados.0.smithi012.stdout:2753: expect (ObjNum 847 snap 274 seq_num 847) 2024-09-10T18:06:15.982 INFO:tasks.rados.rados.0.smithi012.stdout:2751: done (4 left) 2024-09-10T18:06:15.983 INFO:tasks.rados.rados.0.smithi012.stdout:2752: done (3 left) 2024-09-10T18:06:15.983 INFO:tasks.rados.rados.0.smithi012.stdout:2753: done (2 left) 2024-09-10T18:06:15.983 INFO:tasks.rados.rados.0.smithi012.stdout:2754: done (1 left) 2024-09-10T18:06:15.983 INFO:tasks.rados.rados.0.smithi012.stdout:2756: done (0 left) 2024-09-10T18:06:15.983 INFO:tasks.rados.rados.0.smithi012.stdout:2757: rollback oid 31 current snap is 279 2024-09-10T18:06:15.983 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 275 2024-09-10T18:06:15.983 INFO:tasks.rados.rados.0.smithi012.stdout:2758: snap_remove snap 265 2024-09-10T18:06:16.203 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:15 smithi089 ceph-mon[84132]: osdmap e636: 8 total, 8 up, 8 in 2024-09-10T18:06:16.204 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:15 smithi089 ceph-mon[84132]: pgmap v631: 121 pgs: 121 active+clean; 320 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 30 op/s 2024-09-10T18:06:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:15 smithi012 ceph-mon[89611]: osdmap e636: 8 total, 8 up, 8 in 2024-09-10T18:06:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:15 smithi012 ceph-mon[89611]: pgmap v631: 121 pgs: 121 active+clean; 320 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 30 op/s 2024-09-10T18:06:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:15 smithi012 ceph-mon[92029]: osdmap e636: 8 total, 8 up, 8 in 2024-09-10T18:06:16.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:15 smithi012 ceph-mon[92029]: pgmap v631: 121 pgs: 121 active+clean; 320 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 30 op/s 2024-09-10T18:06:16.821 INFO:tasks.rados.rados.0.smithi012.stdout:2757: finishing rollback tid 1 to smithi01278544-31 2024-09-10T18:06:16.821 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 1338 (ObjNum 993 snap 0 seq_num 3222432464) dirty dne 2024-09-10T18:06:16.821 INFO:tasks.rados.rados.0.smithi012.stdout:2757: done (1 left) 2024-09-10T18:06:16.821 INFO:tasks.rados.rados.0.smithi012.stdout:2758: done (0 left) 2024-09-10T18:06:16.821 INFO:tasks.rados.rados.0.smithi012.stdout:2759: read oid 17 snap -1 2024-09-10T18:06:16.821 INFO:tasks.rados.rados.0.smithi012.stdout:2759: expect deleted 2024-09-10T18:06:16.821 INFO:tasks.rados.rados.0.smithi012.stdout:2760: snap_create 2024-09-10T18:06:17.256 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:16 smithi089 ceph-mon[84132]: osdmap e637: 8 total, 8 up, 8 in 2024-09-10T18:06:17.256 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:16 smithi012 ceph-mon[89611]: osdmap e637: 8 total, 8 up, 8 in 2024-09-10T18:06:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:16 smithi012 ceph-mon[92029]: osdmap e637: 8 total, 8 up, 8 in 2024-09-10T18:06:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:2759: done (1 left) 2024-09-10T18:06:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:2760: done (0 left) 2024-09-10T18:06:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:2761: copy_from oid 40 from oid 4 current snap is 280 2024-09-10T18:06:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:2762: rollback oid 41 current snap is 280 2024-09-10T18:06:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 271 2024-09-10T18:06:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:2763: snap_create 2024-09-10T18:06:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:2762: finishing rollback tid 0 to smithi01278544-41 2024-09-10T18:06:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:2762: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:06:17.839 INFO:tasks.rados.rados.0.smithi012.stdout:2762: finishing rollback tid 2 to smithi01278544-41 2024-09-10T18:06:17.839 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 1435 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:06:17.874 INFO:tasks.rados.rados.0.smithi012.stdout:2761: finishing copy_from racing read to smithi01278544-40 2024-09-10T18:06:17.875 INFO:tasks.rados.rados.0.smithi012.stdout:2761: finishing copy_from to smithi01278544-40 2024-09-10T18:06:17.875 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 1396 (ObjNum 845 snap 274 seq_num 845) dirty exists 2024-09-10T18:06:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:17 smithi012 ceph-mon[89611]: osdmap e638: 8 total, 8 up, 8 in 2024-09-10T18:06:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:17 smithi012 ceph-mon[89611]: pgmap v634: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 996 KiB/s rd, 574 KiB/s wr, 9 op/s 2024-09-10T18:06:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:17 smithi012 ceph-mon[89611]: osdmap e639: 8 total, 8 up, 8 in 2024-09-10T18:06:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:17 smithi012 ceph-mon[92029]: osdmap e638: 8 total, 8 up, 8 in 2024-09-10T18:06:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:17 smithi012 ceph-mon[92029]: pgmap v634: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 996 KiB/s rd, 574 KiB/s wr, 9 op/s 2024-09-10T18:06:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:17 smithi012 ceph-mon[92029]: osdmap e639: 8 total, 8 up, 8 in 2024-09-10T18:06:18.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:17 smithi089 ceph-mon[84132]: osdmap e638: 8 total, 8 up, 8 in 2024-09-10T18:06:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:17 smithi089 ceph-mon[84132]: pgmap v634: 121 pgs: 121 active+clean; 285 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 996 KiB/s rd, 574 KiB/s wr, 9 op/s 2024-09-10T18:06:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:17 smithi089 ceph-mon[84132]: osdmap e639: 8 total, 8 up, 8 in 2024-09-10T18:06:18.823 INFO:tasks.rados.rados.0.smithi012.stdout:2761: done (2 left) 2024-09-10T18:06:18.824 INFO:tasks.rados.rados.0.smithi012.stdout:2762: done (1 left) 2024-09-10T18:06:18.824 INFO:tasks.rados.rados.0.smithi012.stdout:2763: done (0 left) 2024-09-10T18:06:18.824 INFO:tasks.rados.rados.0.smithi012.stdout:2764: read oid 10 snap 271 2024-09-10T18:06:18.824 INFO:tasks.rados.rados.0.smithi012.stdout:2764: expect (ObjNum 818 snap 266 seq_num 818) 2024-09-10T18:06:18.824 INFO:tasks.rados.rados.0.smithi012.stdout:2765: read oid 15 snap -1 2024-09-10T18:06:18.824 INFO:tasks.rados.rados.0.smithi012.stdout:2765: expect (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:06:18.824 INFO:tasks.rados.rados.0.smithi012.stdout:2766: snap_create 2024-09-10T18:06:18.834 INFO:tasks.rados.rados.0.smithi012.stdout:2765: expect (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:06:18.859 INFO:tasks.rados.rados.0.smithi012.stdout:2764: expect (ObjNum 818 snap 266 seq_num 818) 2024-09-10T18:06:19.832 INFO:tasks.rados.rados.0.smithi012.stdout:2764: done (2 left) 2024-09-10T18:06:19.832 INFO:tasks.rados.rados.0.smithi012.stdout:2765: done (1 left) 2024-09-10T18:06:19.833 INFO:tasks.rados.rados.0.smithi012.stdout:2766: done (0 left) 2024-09-10T18:06:19.833 INFO:tasks.rados.rados.0.smithi012.stdout:2767: rollback oid 30 current snap is 282 2024-09-10T18:06:19.833 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 280 2024-09-10T18:06:19.833 INFO:tasks.rados.rados.0.smithi012.stdout:2768: delete oid 14 current snap is 282 2024-09-10T18:06:19.837 INFO:tasks.rados.rados.0.smithi012.stdout:2768: done (1 left) 2024-09-10T18:06:19.838 INFO:tasks.rados.rados.0.smithi012.stdout:2769: rollback oid 47 current snap is 282 2024-09-10T18:06:19.838 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 271 2024-09-10T18:06:19.838 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 282 2024-09-10T18:06:19.838 INFO:tasks.rados.rados.0.smithi012.stdout:2770: seq_num 863 ranges {868352=57344} 2024-09-10T18:06:19.843 INFO:tasks.rados.rados.0.smithi012.stdout:2770: writing smithi01278544-33 from 868352 to 925696 tid 1 2024-09-10T18:06:19.843 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 282 2024-09-10T18:06:19.843 INFO:tasks.rados.rados.0.smithi012.stdout:2767: finishing rollback tid 0 to smithi01278544-30 2024-09-10T18:06:19.844 INFO:tasks.rados.rados.0.smithi012.stdout:2767: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:06:19.844 INFO:tasks.rados.rados.0.smithi012.stdout:2767: finishing rollback tid 2 to smithi01278544-30 2024-09-10T18:06:19.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1175 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:06:19.844 INFO:tasks.rados.rados.0.smithi012.stdout:2771: seq_num 864 ranges {10600448=73728} 2024-09-10T18:06:19.902 INFO:tasks.rados.rados.0.smithi012.stdout:2771: writing smithi01278544-4 from 10600448 to 10674176 tid 1 2024-09-10T18:06:19.903 INFO:tasks.rados.rados.0.smithi012.stdout:2767: done (3 left) 2024-09-10T18:06:19.903 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 282 2024-09-10T18:06:19.903 INFO:tasks.rados.rados.0.smithi012.stdout:2772: seq_num 865 ranges {0=90112} 2024-09-10T18:06:19.903 INFO:tasks.rados.rados.0.smithi012.stdout:2772: writing smithi01278544-34 from 0 to 90112 tid 1 2024-09-10T18:06:19.903 INFO:tasks.rados.rados.0.smithi012.stdout:2773: snap_create 2024-09-10T18:06:19.904 INFO:tasks.rados.rados.0.smithi012.stdout:2769: finishing rollback tid 0 to smithi01278544-47 2024-09-10T18:06:19.904 INFO:tasks.rados.rados.0.smithi012.stdout:2769: finishing rollback tid 1 to smithi01278544-47 2024-09-10T18:06:19.904 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 2009 (ObjNum 705 snap 0 seq_num 3200229264) dirty dne 2024-09-10T18:06:19.904 INFO:tasks.rados.rados.0.smithi012.stdout:2770: finishing write tid 1 to smithi01278544-33 2024-09-10T18:06:19.904 INFO:tasks.rados.rados.0.smithi012.stdout:2770: finishing write tid 2 to smithi01278544-33 2024-09-10T18:06:19.904 INFO:tasks.rados.rados.0.smithi012.stdout:2770: finishing write tid 3 to smithi01278544-33 2024-09-10T18:06:19.905 INFO:tasks.rados.rados.0.smithi012.stdout:2770: oid 33 updating version 0 to 2011 2024-09-10T18:06:19.905 INFO:tasks.rados.rados.0.smithi012.stdout:2770: oid 33 updating version 2011 to 2012 2024-09-10T18:06:19.905 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 2012 (ObjNum 863 snap 282 seq_num 863) dirty exists 2024-09-10T18:06:19.905 INFO:tasks.rados.rados.0.smithi012.stdout:2770: left oid 33 (ObjNum 863 snap 282 seq_num 863) 2024-09-10T18:06:19.907 INFO:tasks.rados.rados.0.smithi012.stdout:2771: finishing write tid 1 to smithi01278544-4 2024-09-10T18:06:19.908 INFO:tasks.rados.rados.0.smithi012.stdout:2771: finishing write tid 2 to smithi01278544-4 2024-09-10T18:06:19.908 INFO:tasks.rados.rados.0.smithi012.stdout:2772: finishing write tid 1 to smithi01278544-34 2024-09-10T18:06:19.908 INFO:tasks.rados.rados.0.smithi012.stdout:2772: finishing write tid 2 to smithi01278544-34 2024-09-10T18:06:19.908 INFO:tasks.rados.rados.0.smithi012.stdout:2771: finishing write tid 3 to smithi01278544-4 2024-09-10T18:06:19.909 INFO:tasks.rados.rados.0.smithi012.stdout:2771: oid 4 updating version 0 to 1438 2024-09-10T18:06:19.909 INFO:tasks.rados.rados.0.smithi012.stdout:2771: oid 4 version 1438 is already newer than 1437 2024-09-10T18:06:19.909 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1438 (ObjNum 864 snap 282 seq_num 864) dirty exists 2024-09-10T18:06:19.909 INFO:tasks.rados.rados.0.smithi012.stdout:2771: left oid 4 (ObjNum 864 snap 282 seq_num 864) 2024-09-10T18:06:19.909 INFO:tasks.rados.rados.0.smithi012.stdout:2772: finishing write tid 3 to smithi01278544-34 2024-09-10T18:06:19.909 INFO:tasks.rados.rados.0.smithi012.stdout:2772: oid 34 updating version 0 to 1179 2024-09-10T18:06:19.909 INFO:tasks.rados.rados.0.smithi012.stdout:2772: oid 34 version 1179 is already newer than 1178 2024-09-10T18:06:19.909 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1179 (ObjNum 865 snap 282 seq_num 865) dirty exists 2024-09-10T18:06:19.910 INFO:tasks.rados.rados.0.smithi012.stdout:2772: left oid 34 (ObjNum 865 snap 282 seq_num 865) 2024-09-10T18:06:20.169 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:19 smithi089 ceph-mon[84132]: osdmap e640: 8 total, 8 up, 8 in 2024-09-10T18:06:20.170 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:19 smithi089 ceph-mon[84132]: pgmap v637: 121 pgs: 121 active+clean; 278 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-09-10T18:06:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:19 smithi012 ceph-mon[89611]: osdmap e640: 8 total, 8 up, 8 in 2024-09-10T18:06:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:19 smithi012 ceph-mon[89611]: pgmap v637: 121 pgs: 121 active+clean; 278 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-09-10T18:06:20.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:19 smithi012 ceph-mon[92029]: osdmap e640: 8 total, 8 up, 8 in 2024-09-10T18:06:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:19 smithi012 ceph-mon[92029]: pgmap v637: 121 pgs: 121 active+clean; 278 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-09-10T18:06:20.837 INFO:tasks.rados.rados.0.smithi012.stdout:2769: done (4 left) 2024-09-10T18:06:20.837 INFO:tasks.rados.rados.0.smithi012.stdout:2770: done (3 left) 2024-09-10T18:06:20.837 INFO:tasks.rados.rados.0.smithi012.stdout:2771: done (2 left) 2024-09-10T18:06:20.837 INFO:tasks.rados.rados.0.smithi012.stdout:2772: done (1 left) 2024-09-10T18:06:20.837 INFO:tasks.rados.rados.0.smithi012.stdout:2773: done (0 left) 2024-09-10T18:06:20.837 INFO:tasks.rados.rados.0.smithi012.stdout:2774: copy_from oid 48 from oid 43 current snap is 283 2024-09-10T18:06:20.837 INFO:tasks.rados.rados.0.smithi012.stdout:2775: setattr oid 7 current snap is 283 2024-09-10T18:06:20.838 INFO:tasks.rados.rados.0.smithi012.stdout:2776: read oid 36 snap 249 2024-09-10T18:06:20.838 INFO:tasks.rados.rados.0.smithi012.stdout:2776: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:06:20.838 INFO:tasks.rados.rados.0.smithi012.stdout:2777: snap_create 2024-09-10T18:06:20.840 INFO:tasks.rados.rados.0.smithi012.stdout:2774: finishing copy_from to smithi01278544-48 2024-09-10T18:06:20.840 INFO:tasks.rados.rados.0.smithi012.stdout:2774: got expected ENOENT (src dne) 2024-09-10T18:06:20.840 INFO:tasks.rados.rados.0.smithi012.stdout:2774: finishing copy_from racing read to smithi01278544-48 2024-09-10T18:06:20.841 INFO:tasks.rados.rados.0.smithi012.stdout:2776: expect (ObjNum 432 snap 143 seq_num 432) 2024-09-10T18:06:20.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1122 (ObjNum 853 snap 277 seq_num 853) dirty exists 2024-09-10T18:06:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:20 smithi089 ceph-mon[84132]: osdmap e641: 8 total, 8 up, 8 in 2024-09-10T18:06:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:20 smithi012 ceph-mon[89611]: osdmap e641: 8 total, 8 up, 8 in 2024-09-10T18:06:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:20 smithi012 ceph-mon[92029]: osdmap e641: 8 total, 8 up, 8 in 2024-09-10T18:06:21.843 INFO:tasks.rados.rados.0.smithi012.stdout:2774: done (3 left) 2024-09-10T18:06:21.844 INFO:tasks.rados.rados.0.smithi012.stdout:2775: done (2 left) 2024-09-10T18:06:21.844 INFO:tasks.rados.rados.0.smithi012.stdout:2776: done (1 left) 2024-09-10T18:06:21.844 INFO:tasks.rados.rados.0.smithi012.stdout:2777: done (0 left) 2024-09-10T18:06:21.844 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 284 2024-09-10T18:06:21.844 INFO:tasks.rados.rados.0.smithi012.stdout:2778: seq_num 866 ranges {7225344=106496} 2024-09-10T18:06:21.885 INFO:tasks.rados.rados.0.smithi012.stdout:2778: writing smithi01278544-13 from 7225344 to 7331840 tid 1 2024-09-10T18:06:21.885 INFO:tasks.rados.rados.0.smithi012.stdout:2779: copy_from oid 41 from oid 46 current snap is 284 2024-09-10T18:06:21.885 INFO:tasks.rados.rados.0.smithi012.stdout:2780: snap_remove snap 249 2024-09-10T18:06:22.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:21 smithi089 ceph-mon[84132]: osdmap e642: 8 total, 8 up, 8 in 2024-09-10T18:06:22.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:21 smithi089 ceph-mon[84132]: pgmap v640: 121 pgs: 121 active+clean; 276 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 540 KiB/s wr, 5 op/s 2024-09-10T18:06:22.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:21 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[89611]: osdmap e642: 8 total, 8 up, 8 in 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[89611]: pgmap v640: 121 pgs: 121 active+clean; 276 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 540 KiB/s wr, 5 op/s 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[92029]: osdmap e642: 8 total, 8 up, 8 in 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[92029]: pgmap v640: 121 pgs: 121 active+clean; 276 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.6 MiB/s rd, 540 KiB/s wr, 5 op/s 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:21 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:22.771 INFO:tasks.rados.rados.0.smithi012.stdout:2780: done (2 left) 2024-09-10T18:06:22.772 INFO:tasks.rados.rados.0.smithi012.stdout:2781: read oid 23 snap -1 2024-09-10T18:06:22.772 INFO:tasks.rados.rados.0.smithi012.stdout:2781: expect deleted 2024-09-10T18:06:22.772 INFO:tasks.rados.rados.0.smithi012.stdout:2782: rollback oid 28 current snap is 284 2024-09-10T18:06:22.772 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 28 to 271 2024-09-10T18:06:22.772 INFO:tasks.rados.rados.0.smithi012.stdout:2783: setattr oid 3 current snap is 284 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2778: finishing write tid 1 to smithi01278544-13 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2778: finishing write tid 2 to smithi01278544-13 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2778: finishing write tid 3 to smithi01278544-13 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2778: oid 13 updating version 0 to 1441 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2778: oid 13 version 1441 is already newer than 1440 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1441 (ObjNum 866 snap 284 seq_num 866) dirty exists 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2778: left oid 13 (ObjNum 866 snap 284 seq_num 866) 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2779: finishing copy_from to smithi01278544-41 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2779: got expected ENOENT (src dne) 2024-09-10T18:06:22.774 INFO:tasks.rados.rados.0.smithi012.stdout:2779: finishing copy_from racing read to smithi01278544-41 2024-09-10T18:06:22.775 INFO:tasks.rados.rados.0.smithi012.stdout:2778: done (4 left) 2024-09-10T18:06:22.775 INFO:tasks.rados.rados.0.smithi012.stdout:2779: done (3 left) 2024-09-10T18:06:22.775 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 284 2024-09-10T18:06:22.775 INFO:tasks.rados.rados.0.smithi012.stdout:2784: seq_num 867 ranges {0=122880} 2024-09-10T18:06:22.775 INFO:tasks.rados.rados.0.smithi012.stdout:2784: writing smithi01278544-1 from 0 to 122880 tid 1 2024-09-10T18:06:22.775 INFO:tasks.rados.rados.0.smithi012.stdout:2785: snap_remove snap 282 2024-09-10T18:06:23.207 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:22 smithi089 ceph-mon[84132]: osdmap e643: 8 total, 8 up, 8 in 2024-09-10T18:06:23.207 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:22 smithi089 ceph-mon[84132]: osdmap e644: 8 total, 8 up, 8 in 2024-09-10T18:06:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:22 smithi012 ceph-mon[89611]: osdmap e643: 8 total, 8 up, 8 in 2024-09-10T18:06:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:22 smithi012 ceph-mon[89611]: osdmap e644: 8 total, 8 up, 8 in 2024-09-10T18:06:23.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:22 smithi012 ceph-mon[92029]: osdmap e643: 8 total, 8 up, 8 in 2024-09-10T18:06:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:22 smithi012 ceph-mon[92029]: osdmap e644: 8 total, 8 up, 8 in 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:2785: done (4 left) 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:2786: delete oid 5 current snap is 284 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:2782: finishing rollback tid 0 to smithi01278544-28 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:2782: finishing rollback tid 1 to smithi01278544-28 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:2782: finishing rollback tid 2 to smithi01278544-28 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1307 (ObjNum 819 snap 266 seq_num 819) dirty exists 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:2784: finishing write tid 1 to smithi01278544-1 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:2784: finishing write tid 2 to smithi01278544-1 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1601 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:06:23.771 INFO:tasks.rados.rados.0.smithi012.stdout:2784: finishing write tid 3 to smithi01278544-1 2024-09-10T18:06:23.772 INFO:tasks.rados.rados.0.smithi012.stdout:2784: oid 1 updating version 0 to 1873 2024-09-10T18:06:23.772 INFO:tasks.rados.rados.0.smithi012.stdout:2784: oid 1 version 1873 is already newer than 1872 2024-09-10T18:06:23.772 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1873 (ObjNum 867 snap 284 seq_num 867) dirty exists 2024-09-10T18:06:23.772 INFO:tasks.rados.rados.0.smithi012.stdout:2784: left oid 1 (ObjNum 867 snap 284 seq_num 867) 2024-09-10T18:06:23.774 INFO:tasks.rados.rados.0.smithi012.stdout:2781: done (4 left) 2024-09-10T18:06:23.775 INFO:tasks.rados.rados.0.smithi012.stdout:2782: done (3 left) 2024-09-10T18:06:23.775 INFO:tasks.rados.rados.0.smithi012.stdout:2783: done (2 left) 2024-09-10T18:06:23.775 INFO:tasks.rados.rados.0.smithi012.stdout:2784: done (1 left) 2024-09-10T18:06:23.775 INFO:tasks.rados.rados.0.smithi012.stdout:2786: done (0 left) 2024-09-10T18:06:23.775 INFO:tasks.rados.rados.0.smithi012.stdout:2787: snap_create 2024-09-10T18:06:24.767 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:06:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:06:24] "GET /metrics HTTP/1.1" 200 36358 "" "Prometheus/2.51.0" 2024-09-10T18:06:24.777 INFO:tasks.rados.rados.0.smithi012.stdout:2787: done (0 left) 2024-09-10T18:06:24.778 INFO:tasks.rados.rados.0.smithi012.stdout:2788: read oid 43 snap 280 2024-09-10T18:06:24.778 INFO:tasks.rados.rados.0.smithi012.stdout:2788: expect deleted 2024-09-10T18:06:24.778 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 8 current snap is 285 2024-09-10T18:06:24.778 INFO:tasks.rados.rados.0.smithi012.stdout:2789: seq_num 869 ranges {0=155648} 2024-09-10T18:06:24.778 INFO:tasks.rados.rados.0.smithi012.stdout:2789: writing smithi01278544-8 from 0 to 155648 tid 1 2024-09-10T18:06:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2790: rollback oid 29 current snap is 285 2024-09-10T18:06:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 29 to 276 2024-09-10T18:06:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 285 2024-09-10T18:06:24.779 INFO:tasks.rados.rados.0.smithi012.stdout:2791: seq_num 870 ranges {3153920=172032} 2024-09-10T18:06:24.797 INFO:tasks.rados.rados.0.smithi012.stdout:2791: writing smithi01278544-45 from 3153920 to 3325952 tid 1 2024-09-10T18:06:24.797 INFO:tasks.rados.rados.0.smithi012.stdout:2792: delete oid 23 current snap is 285 2024-09-10T18:06:24.797 INFO:tasks.rados.rados.0.smithi012.stdout:2790: finishing rollback tid 1 to smithi01278544-29 2024-09-10T18:06:24.797 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-09-10T18:06:24.798 INFO:tasks.rados.rados.0.smithi012.stdout:2789: finishing write tid 1 to smithi01278544-8 2024-09-10T18:06:24.798 INFO:tasks.rados.rados.0.smithi012.stdout:2789: finishing write tid 2 to smithi01278544-8 2024-09-10T18:06:24.798 INFO:tasks.rados.rados.0.smithi012.stdout:2789: finishing write tid 3 to smithi01278544-8 2024-09-10T18:06:24.798 INFO:tasks.rados.rados.0.smithi012.stdout:2789: oid 8 updating version 0 to 1145 2024-09-10T18:06:24.798 INFO:tasks.rados.rados.0.smithi012.stdout:2789: oid 8 updating version 1145 to 1146 2024-09-10T18:06:24.798 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1146 (ObjNum 869 snap 285 seq_num 869) dirty exists 2024-09-10T18:06:24.798 INFO:tasks.rados.rados.0.smithi012.stdout:2789: left oid 8 (ObjNum 869 snap 285 seq_num 869) 2024-09-10T18:06:24.799 INFO:tasks.rados.rados.0.smithi012.stdout:2788: done (4 left) 2024-09-10T18:06:24.799 INFO:tasks.rados.rados.0.smithi012.stdout:2789: done (3 left) 2024-09-10T18:06:24.800 INFO:tasks.rados.rados.0.smithi012.stdout:2790: done (2 left) 2024-09-10T18:06:24.800 INFO:tasks.rados.rados.0.smithi012.stdout:2792: done (1 left) 2024-09-10T18:06:24.800 INFO:tasks.rados.rados.0.smithi012.stdout:2793: setattr oid 30 current snap is 285 2024-09-10T18:06:24.802 INFO:tasks.rados.rados.0.smithi012.stdout:2791: finishing write tid 1 to smithi01278544-45 2024-09-10T18:06:24.802 INFO:tasks.rados.rados.0.smithi012.stdout:2791: finishing write tid 2 to smithi01278544-45 2024-09-10T18:06:24.803 INFO:tasks.rados.rados.0.smithi012.stdout:2794: read oid 40 snap -1 2024-09-10T18:06:24.804 INFO:tasks.rados.rados.0.smithi012.stdout:2794: expect (ObjNum 845 snap 274 seq_num 845) 2024-09-10T18:06:24.804 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 285 2024-09-10T18:06:24.804 INFO:tasks.rados.rados.0.smithi012.stdout:2795: seq_num 872 ranges {122880=212992} 2024-09-10T18:06:24.805 INFO:tasks.rados.rados.0.smithi012.stdout:2795: writing smithi01278544-1 from 122880 to 335872 tid 1 2024-09-10T18:06:24.806 INFO:tasks.rados.rados.0.smithi012.stdout:2796: snap_create 2024-09-10T18:06:24.806 INFO:tasks.rados.rados.0.smithi012.stdout:2791: finishing write tid 3 to smithi01278544-45 2024-09-10T18:06:24.806 INFO:tasks.rados.rados.0.smithi012.stdout:2791: oid 45 updating version 0 to 2020 2024-09-10T18:06:24.806 INFO:tasks.rados.rados.0.smithi012.stdout:2791: oid 45 updating version 2020 to 2021 2024-09-10T18:06:24.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2021 (ObjNum 870 snap 285 seq_num 870) dirty exists 2024-09-10T18:06:24.806 INFO:tasks.rados.rados.0.smithi012.stdout:2791: left oid 45 (ObjNum 870 snap 285 seq_num 870) 2024-09-10T18:06:24.810 INFO:tasks.rados.rados.0.smithi012.stdout:2795: finishing write tid 1 to smithi01278544-1 2024-09-10T18:06:24.810 INFO:tasks.rados.rados.0.smithi012.stdout:2795: finishing write tid 2 to smithi01278544-1 2024-09-10T18:06:24.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1176 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:06:24.812 INFO:tasks.rados.rados.0.smithi012.stdout:2795: finishing write tid 3 to smithi01278544-1 2024-09-10T18:06:24.812 INFO:tasks.rados.rados.0.smithi012.stdout:2795: oid 1 updating version 0 to 1875 2024-09-10T18:06:24.812 INFO:tasks.rados.rados.0.smithi012.stdout:2795: oid 1 version 1875 is already newer than 1874 2024-09-10T18:06:24.812 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1875 (ObjNum 872 snap 285 seq_num 872) dirty exists 2024-09-10T18:06:24.812 INFO:tasks.rados.rados.0.smithi012.stdout:2795: left oid 1 (ObjNum 872 snap 285 seq_num 872) 2024-09-10T18:06:24.842 INFO:tasks.rados.rados.0.smithi012.stdout:2794: expect (ObjNum 845 snap 274 seq_num 845) 2024-09-10T18:06:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:24 smithi012 ceph-mon[89611]: pgmap v643: 121 pgs: 121 active+clean; 260 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-09-10T18:06:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:24 smithi012 ceph-mon[89611]: osdmap e645: 8 total, 8 up, 8 in 2024-09-10T18:06:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:24 smithi012 ceph-mon[92029]: pgmap v643: 121 pgs: 121 active+clean; 260 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-09-10T18:06:25.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:24 smithi012 ceph-mon[92029]: osdmap e645: 8 total, 8 up, 8 in 2024-09-10T18:06:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:24 smithi089 ceph-mon[84132]: pgmap v643: 121 pgs: 121 active+clean; 260 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-09-10T18:06:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:24 smithi089 ceph-mon[84132]: osdmap e645: 8 total, 8 up, 8 in 2024-09-10T18:06:25.791 INFO:tasks.rados.rados.0.smithi012.stdout:2791: done (4 left) 2024-09-10T18:06:25.791 INFO:tasks.rados.rados.0.smithi012.stdout:2793: done (3 left) 2024-09-10T18:06:25.791 INFO:tasks.rados.rados.0.smithi012.stdout:2794: done (2 left) 2024-09-10T18:06:25.791 INFO:tasks.rados.rados.0.smithi012.stdout:2795: done (1 left) 2024-09-10T18:06:25.791 INFO:tasks.rados.rados.0.smithi012.stdout:2796: done (0 left) 2024-09-10T18:06:25.791 INFO:tasks.rados.rados.0.smithi012.stdout:2797: snap_create 2024-09-10T18:06:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: osdmap e646: 8 total, 8 up, 8 in 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.036 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-10T18:06:26.037 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T18:06:26.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: osdmap e646: 8 total, 8 up, 8 in 2024-09-10T18:06:26.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.038 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-10T18:06:26.039 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T18:06:26.040 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.041 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-10T18:06:26.042 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.043 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.044 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: osdmap e646: 8 total, 8 up, 8 in 2024-09-10T18:06:26.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.046 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.047 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.048 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-10T18:06:26.049 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-10T18:06:26.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T18:06:26.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-10T18:06:26.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T18:06:26.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-10T18:06:26.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T18:06:26.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.050 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:06:26.051 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:26.786 INFO:tasks.rados.rados.0.smithi012.stdout:2797: done (0 left) 2024-09-10T18:06:26.786 INFO:tasks.rados.rados.0.smithi012.stdout:2798: delete oid 14 current snap is 287 2024-09-10T18:06:26.790 INFO:tasks.rados.rados.0.smithi012.stdout:2798: done (0 left) 2024-09-10T18:06:26.790 INFO:tasks.rados.rados.0.smithi012.stdout:2799: snap_create 2024-09-10T18:06:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:26 smithi089 ceph-mon[84132]: pgmap v646: 121 pgs: 121 active+clean; 245 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-09-10T18:06:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:26 smithi089 ceph-mon[84132]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T18:06:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:26 smithi089 ceph-mon[84132]: Upgrade: Finalizing container_image settings 2024-09-10T18:06:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:26 smithi089 ceph-mon[84132]: Upgrade: Complete! 2024-09-10T18:06:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:26 smithi089 ceph-mon[84132]: osdmap e647: 8 total, 8 up, 8 in 2024-09-10T18:06:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:26 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[89611]: pgmap v646: 121 pgs: 121 active+clean; 245 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-09-10T18:06:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[89611]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T18:06:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[89611]: Upgrade: Finalizing container_image settings 2024-09-10T18:06:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[89611]: Upgrade: Complete! 2024-09-10T18:06:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[89611]: osdmap e647: 8 total, 8 up, 8 in 2024-09-10T18:06:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[92029]: pgmap v646: 121 pgs: 121 active+clean; 245 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-09-10T18:06:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[92029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T18:06:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[92029]: Upgrade: Finalizing container_image settings 2024-09-10T18:06:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[92029]: Upgrade: Complete! 2024-09-10T18:06:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[92029]: osdmap e647: 8 total, 8 up, 8 in 2024-09-10T18:06:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:06:27.770 INFO:tasks.rados.rados.0.smithi012.stdout:2799: done (0 left) 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2800: copy_from oid 50 from oid 8 current snap is 288 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2801: copy_from oid 29 from oid 43 current snap is 288 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2802: read oid 40 snap -1 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2802: expect (ObjNum 845 snap 274 seq_num 845) 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2803: read oid 20 snap -1 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2803: expect (ObjNum 850 snap 277 seq_num 850) 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2804: read oid 26 snap -1 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2804: expect (ObjNum 860 snap 278 seq_num 860) 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2805: copy_from oid 32 from oid 23 current snap is 288 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2806: read oid 17 snap 287 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:2806: expect deleted 2024-09-10T18:06:27.771 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 288 2024-09-10T18:06:27.772 INFO:tasks.rados.rados.0.smithi012.stdout:2807: seq_num 874 ranges {0=245760} 2024-09-10T18:06:27.772 INFO:tasks.rados.rados.0.smithi012.stdout:2807: writing smithi01278544-27 from 0 to 245760 tid 1 2024-09-10T18:06:27.772 INFO:tasks.rados.rados.0.smithi012.stdout:2808: copy_from oid 45 from oid 16 current snap is 288 2024-09-10T18:06:27.772 INFO:tasks.rados.rados.0.smithi012.stdout:2809: delete oid 25 current snap is 288 2024-09-10T18:06:27.774 INFO:tasks.rados.rados.0.smithi012.stdout:2804: expect (ObjNum 860 snap 278 seq_num 860) 2024-09-10T18:06:27.780 INFO:tasks.rados.rados.0.smithi012.stdout:2805: finishing copy_from to smithi01278544-32 2024-09-10T18:06:27.780 INFO:tasks.rados.rados.0.smithi012.stdout:2805: got expected ENOENT (src dne) 2024-09-10T18:06:27.780 INFO:tasks.rados.rados.0.smithi012.stdout:2805: finishing copy_from racing read to smithi01278544-32 2024-09-10T18:06:27.781 INFO:tasks.rados.rados.0.smithi012.stdout:2800: finishing copy_from racing read to smithi01278544-50 2024-09-10T18:06:27.782 INFO:tasks.rados.rados.0.smithi012.stdout:2801: finishing copy_from to smithi01278544-29 2024-09-10T18:06:27.783 INFO:tasks.rados.rados.0.smithi012.stdout:2801: got expected ENOENT (src dne) 2024-09-10T18:06:27.783 INFO:tasks.rados.rados.0.smithi012.stdout:2801: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:06:27.783 INFO:tasks.rados.rados.0.smithi012.stdout:2807: finishing write tid 1 to smithi01278544-27 2024-09-10T18:06:27.783 INFO:tasks.rados.rados.0.smithi012.stdout:2807: finishing write tid 2 to smithi01278544-27 2024-09-10T18:06:27.787 INFO:tasks.rados.rados.0.smithi012.stdout:2807: finishing write tid 3 to smithi01278544-27 2024-09-10T18:06:27.787 INFO:tasks.rados.rados.0.smithi012.stdout:2807: oid 27 updating version 0 to 1602 2024-09-10T18:06:27.787 INFO:tasks.rados.rados.0.smithi012.stdout:2807: oid 27 updating version 1602 to 1603 2024-09-10T18:06:27.787 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1603 (ObjNum 874 snap 288 seq_num 874) dirty exists 2024-09-10T18:06:27.787 INFO:tasks.rados.rados.0.smithi012.stdout:2807: left oid 27 (ObjNum 874 snap 288 seq_num 874) 2024-09-10T18:06:27.787 INFO:tasks.rados.rados.0.smithi012.stdout:2800: finishing copy_from to smithi01278544-50 2024-09-10T18:06:27.787 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 1146 (ObjNum 869 snap 285 seq_num 869) dirty exists 2024-09-10T18:06:27.802 INFO:tasks.rados.rados.0.smithi012.stdout:2803: expect (ObjNum 850 snap 277 seq_num 850) 2024-09-10T18:06:27.928 INFO:tasks.rados.rados.0.smithi012.stdout:2802: expect (ObjNum 845 snap 274 seq_num 845) 2024-09-10T18:06:28.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:27 smithi012 ceph-mon[89611]: osdmap e648: 8 total, 8 up, 8 in 2024-09-10T18:06:28.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:27 smithi012 ceph-mon[89611]: osdmap e649: 8 total, 8 up, 8 in 2024-09-10T18:06:28.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:27 smithi012 ceph-mon[92029]: osdmap e648: 8 total, 8 up, 8 in 2024-09-10T18:06:28.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:27 smithi012 ceph-mon[92029]: osdmap e649: 8 total, 8 up, 8 in 2024-09-10T18:06:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:27 smithi089 ceph-mon[84132]: osdmap e648: 8 total, 8 up, 8 in 2024-09-10T18:06:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:27 smithi089 ceph-mon[84132]: osdmap e649: 8 total, 8 up, 8 in 2024-09-10T18:06:28.669 INFO:tasks.rados.rados.0.smithi012.stdout:2808: finishing copy_from racing read to smithi01278544-45 2024-09-10T18:06:28.669 INFO:tasks.rados.rados.0.smithi012.stdout:2808: finishing copy_from to smithi01278544-45 2024-09-10T18:06:28.669 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 1143 (ObjNum 856 snap 278 seq_num 856) dirty exists 2024-09-10T18:06:28.669 INFO:tasks.rados.rados.0.smithi012.stdout:2800: done (9 left) 2024-09-10T18:06:28.669 INFO:tasks.rados.rados.0.smithi012.stdout:2801: done (8 left) 2024-09-10T18:06:28.669 INFO:tasks.rados.rados.0.smithi012.stdout:2802: done (7 left) 2024-09-10T18:06:28.669 INFO:tasks.rados.rados.0.smithi012.stdout:2803: done (6 left) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2804: done (5 left) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2805: done (4 left) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2806: done (3 left) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2807: done (2 left) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2808: done (1 left) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2809: done (0 left) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2810: read oid 30 snap -1 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2810: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2811: copy_from oid 1 from oid 13 current snap is 288 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2812: rollback oid 27 current snap is 288 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 280 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2813: read oid 50 snap -1 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2813: expect (ObjNum 869 snap 285 seq_num 869) 2024-09-10T18:06:28.670 INFO:tasks.rados.rados.0.smithi012.stdout:2814: delete oid 40 current snap is 288 2024-09-10T18:06:28.677 INFO:tasks.rados.rados.0.smithi012.stdout:2814: done (4 left) 2024-09-10T18:06:28.677 INFO:tasks.rados.rados.0.smithi012.stdout:2815: setattr oid 31 current snap is 288 2024-09-10T18:06:28.677 INFO:tasks.rados.rados.0.smithi012.stdout:2812: finishing rollback tid 0 to smithi01278544-27 2024-09-10T18:06:28.678 INFO:tasks.rados.rados.0.smithi012.stdout:2812: finishing rollback tid 1 to smithi01278544-27 2024-09-10T18:06:28.678 INFO:tasks.rados.rados.0.smithi012.stdout:2812: finishing rollback tid 2 to smithi01278544-27 2024-09-10T18:06:28.678 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1606 (ObjNum 65 snap 0 seq_num 1499615842) dirty exists 2024-09-10T18:06:28.679 INFO:tasks.rados.rados.0.smithi012.stdout:2812: done (4 left) 2024-09-10T18:06:28.679 INFO:tasks.rados.rados.0.smithi012.stdout:2816: snap_remove snap 284 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2816: done (4 left) 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2817: read oid 40 snap 271 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2817: expect deleted 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2818: read oid 33 snap -1 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2818: expect (ObjNum 863 snap 282 seq_num 863) 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2819: read oid 45 snap -1 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2819: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2820: read oid 34 snap -1 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2820: expect (ObjNum 865 snap 282 seq_num 865) 2024-09-10T18:06:28.804 INFO:tasks.rados.rados.0.smithi012.stdout:2821: snap_remove snap 276 2024-09-10T18:06:29.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:28 smithi012 ceph-mon[89611]: pgmap v649: 121 pgs: 121 active+clean; 201 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 136 KiB/s wr, 9 op/s 2024-09-10T18:06:29.197 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:28 smithi012 ceph-mon[92029]: pgmap v649: 121 pgs: 121 active+clean; 201 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 136 KiB/s wr, 9 op/s 2024-09-10T18:06:29.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:28 smithi089 ceph-mon[84132]: pgmap v649: 121 pgs: 121 active+clean; 201 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 136 KiB/s wr, 9 op/s 2024-09-10T18:06:29.805 INFO:tasks.rados.rados.0.smithi012.stdout:2821: done (8 left) 2024-09-10T18:06:29.805 INFO:tasks.rados.rados.0.smithi012.stdout:2822: delete oid 6 current snap is 288 2024-09-10T18:06:29.806 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 1452 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:06:29.806 INFO:tasks.rados.rados.0.smithi012.stdout:2813: expect (ObjNum 869 snap 285 seq_num 869) 2024-09-10T18:06:29.813 INFO:tasks.rados.rados.0.smithi012.stdout:2811: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:06:29.813 INFO:tasks.rados.rados.0.smithi012.stdout:2811: finishing copy_from to smithi01278544-1 2024-09-10T18:06:29.813 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1441 (ObjNum 866 snap 284 seq_num 866) dirty exists 2024-09-10T18:06:29.813 INFO:tasks.rados.rados.0.smithi012.stdout:2810: expect (ObjNum 655 snap 214 seq_num 655) 2024-09-10T18:06:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:29 smithi012 ceph-mon[89611]: osdmap e650: 8 total, 8 up, 8 in 2024-09-10T18:06:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:29 smithi012 ceph-mon[89611]: pgmap v652: 121 pgs: 121 active+clean; 209 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-09-10T18:06:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:29 smithi012 ceph-mon[89611]: osdmap e651: 8 total, 8 up, 8 in 2024-09-10T18:06:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:29 smithi012 ceph-mon[92029]: osdmap e650: 8 total, 8 up, 8 in 2024-09-10T18:06:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:29 smithi012 ceph-mon[92029]: pgmap v652: 121 pgs: 121 active+clean; 209 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-09-10T18:06:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:29 smithi012 ceph-mon[92029]: osdmap e651: 8 total, 8 up, 8 in 2024-09-10T18:06:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:29 smithi089 ceph-mon[84132]: osdmap e650: 8 total, 8 up, 8 in 2024-09-10T18:06:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:29 smithi089 ceph-mon[84132]: pgmap v652: 121 pgs: 121 active+clean; 209 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-09-10T18:06:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:29 smithi089 ceph-mon[84132]: osdmap e651: 8 total, 8 up, 8 in 2024-09-10T18:06:31.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:30 smithi012 ceph-mon[89611]: from='client.44540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:31.283 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:30 smithi012 ceph-mon[92029]: from='client.44540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:31.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:30 smithi089 ceph-mon[84132]: from='client.44540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:31.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -e sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 -- bash -c 'ceph orch ps' 2024-09-10T18:06:31.515 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:06:31.717 INFO:tasks.rados.rados.0.smithi012.stdout:2820: expect (ObjNum 865 snap 282 seq_num 865) 2024-09-10T18:06:31.722 INFO:tasks.rados.rados.0.smithi012.stdout:2818: expect (ObjNum 863 snap 282 seq_num 863) 2024-09-10T18:06:31.765 INFO:tasks.rados.rados.0.smithi012.stdout:2819: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:06:31.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:31 smithi012 ceph-mon[89611]: pgmap v654: 121 pgs: 121 active+clean; 209 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 16 op/s 2024-09-10T18:06:31.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:31.937 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:31 smithi012 ceph-mon[92029]: pgmap v654: 121 pgs: 121 active+clean; 209 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 16 op/s 2024-09-10T18:06:31.937 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:31 smithi089 ceph-mon[84132]: pgmap v654: 121 pgs: 121 active+clean; 209 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 16 op/s 2024-09-10T18:06:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:33.115 INFO:tasks.rados.rados.0.smithi012.stdout:2810: done (8 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2811: done (7 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2813: done (6 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2815: done (5 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2817: done (4 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2818: done (3 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2819: done (2 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2820: done (1 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2822: done (0 left) 2024-09-10T18:06:33.116 INFO:tasks.rados.rados.0.smithi012.stdout:2823: snap_remove snap 274 2024-09-10T18:06:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T18:06:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:alertmanager.a smithi012 *:9093,9094 running (42s) 38s ago 12m 17.6M - 0.27.0 11f11916f8cd eb5017cfa542 2024-09-10T18:06:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:grafana.a smithi089 *:3000 running (19s) 12s ago 12m 47.4M - c8b91775d855 bb062cb57fa3 2024-09-10T18:06:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (2m) 38s ago 14m 15.0M - 19.3.0-4858-gbad1f558 542e6e6af07c 34b133ecae8a 2024-09-10T18:06:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi089 running (105s) 12s ago 14m 12.8M - 19.3.0-4858-gbad1f558 542e6e6af07c fd9833aea5e4 2024-09-10T18:06:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi089 *:8443,9283,8765 running (7m) 12s ago 17m 457M - 19.3.0-4858-gbad1f558 542e6e6af07c 0de40d6da7f2 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi012 *:8443,9283,8765 running (8m) 38s ago 19m 533M - 19.3.0-4858-gbad1f558 542e6e6af07c 5fc00b3b01db 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (7m) 38s ago 19m 71.8M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 1cb889155ac0 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi089 running (6m) 12s ago 17m 57.3M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9c846e5fd93f 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi012 running (7m) 38s ago 17m 59.2M 2048M 19.3.0-4858-gbad1f558 542e6e6af07c 9cece0ad58da 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.a smithi012 *:9100 running (91s) 38s ago 12m 8132k - 1.7.0 72c9c2088986 bb42e60bc4f1 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:node-exporter.b smithi089 *:9100 running (84s) 12s ago 12m 10.1M - 1.7.0 72c9c2088986 3b018abc72f3 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (6m) 38s ago 17m 305M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 9e9fabb2b979 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi012 running (5m) 38s ago 16m 267M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 320b64c71288 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi012 running (5m) 38s ago 16m 246M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 0c6517cd615a 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (4m) 38s ago 16m 185M 2481M 19.3.0-4858-gbad1f558 542e6e6af07c 6e4dd760071c 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi089 running (4m) 12s ago 15m 256M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 75e9a99555f3 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi089 running (3m) 12s ago 15m 306M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 28c479f4ad60 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi089 running (2m) 12s ago 14m 219M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 71e430ee4ba6 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi089 running (2m) 12s ago 14m 116M 2479M 19.3.0-4858-gbad1f558 542e6e6af07c 1b26f245f7dc 2024-09-10T18:06:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:prometheus.a smithi089 *:9095 running (63s) 12s ago 12m 35.5M - 2.51.0 1d3b7f56885b 876b047992b8 2024-09-10T18:06:33.778 INFO:tasks.rados.rados.0.smithi012.stdout:2823: done (0 left) 2024-09-10T18:06:33.778 INFO:tasks.rados.rados.0.smithi012.stdout:2824: copy_from oid 37 from oid 2 current snap is 288 2024-09-10T18:06:33.778 INFO:tasks.rados.rados.0.smithi012.stdout:2825: read oid 12 snap 278 2024-09-10T18:06:33.778 INFO:tasks.rados.rados.0.smithi012.stdout:2825: expect (ObjNum 849 snap 276 seq_num 849) 2024-09-10T18:06:33.778 INFO:tasks.rados.rados.0.smithi012.stdout:2826: copy_from oid 22 from oid 41 current snap is 288 2024-09-10T18:06:33.778 INFO:tasks.rados.rados.0.smithi012.stdout:2827: snap_remove snap 281 2024-09-10T18:06:34.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:33 smithi012 ceph-mon[89611]: osdmap e652: 8 total, 8 up, 8 in 2024-09-10T18:06:34.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:33 smithi012 ceph-mon[92029]: osdmap e652: 8 total, 8 up, 8 in 2024-09-10T18:06:34.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:33 smithi089 ceph-mon[84132]: osdmap e652: 8 total, 8 up, 8 in 2024-09-10T18:06:34.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -e sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 -- bash -c 'ceph versions' 2024-09-10T18:06:34.248 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:06:34.585 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:06:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:06:34] "GET /metrics HTTP/1.1" 200 36353 "" "Prometheus/2.51.0" 2024-09-10T18:06:34.781 INFO:tasks.rados.rados.0.smithi012.stdout:2827: done (3 left) 2024-09-10T18:06:34.781 INFO:tasks.rados.rados.0.smithi012.stdout:2828: setattr oid 35 current snap is 288 2024-09-10T18:06:34.782 INFO:tasks.rados.rados.0.smithi012.stdout:2825: expect (ObjNum 849 snap 276 seq_num 849) 2024-09-10T18:06:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:34 smithi012 ceph-mon[89611]: pgmap v656: 121 pgs: 121 active+clean; 222 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 4.0 MiB/s wr, 16 op/s 2024-09-10T18:06:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:34 smithi012 ceph-mon[89611]: from='client.34635 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:34 smithi012 ceph-mon[89611]: osdmap e653: 8 total, 8 up, 8 in 2024-09-10T18:06:35.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:34 smithi012 ceph-mon[92029]: pgmap v656: 121 pgs: 121 active+clean; 222 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 4.0 MiB/s wr, 16 op/s 2024-09-10T18:06:35.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:34 smithi012 ceph-mon[92029]: from='client.34635 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:35.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:34 smithi012 ceph-mon[92029]: osdmap e653: 8 total, 8 up, 8 in 2024-09-10T18:06:35.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:34 smithi089 ceph-mon[84132]: pgmap v656: 121 pgs: 121 active+clean; 222 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 4.0 MiB/s wr, 16 op/s 2024-09-10T18:06:35.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:34 smithi089 ceph-mon[84132]: from='client.34635 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T18:06:35.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:34 smithi089 ceph-mon[84132]: osdmap e653: 8 total, 8 up, 8 in 2024-09-10T18:06:35.481 INFO:tasks.rados.rados.0.smithi012.stdout:2826: finishing copy_from racing read to smithi01278544-22 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2824: finishing copy_from racing read to smithi01278544-37 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2826: finishing copy_from to smithi01278544-22 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 1435 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2824: finishing copy_from to smithi01278544-37 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 1586 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2824: done (3 left) 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2825: done (2 left) 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2826: done (1 left) 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2829: copy_from oid 38 from oid 50 current snap is 288 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2830: read oid 1 snap 273 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2830: expect (ObjNum -797961536 snap 22079 seq_num 3496741184) 2024-09-10T18:06:35.482 INFO:tasks.rados.rados.0.smithi012.stdout:2831: snap_remove snap 280 2024-09-10T18:06:35.787 INFO:tasks.rados.rados.0.smithi012.stdout:2831: done (3 left) 2024-09-10T18:06:35.787 INFO:tasks.rados.rados.0.smithi012.stdout:2832: rollback oid 3 current snap is 288 2024-09-10T18:06:35.787 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 283 2024-09-10T18:06:35.787 INFO:tasks.rados.rados.0.smithi012.stdout:2833: rollback oid 22 current snap is 288 2024-09-10T18:06:35.788 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 22 to 285 2024-09-10T18:06:35.788 INFO:tasks.rados.rados.0.smithi012.stdout:2830: expect (ObjNum -797961536 snap 22079 seq_num 3496741184) 2024-09-10T18:06:35.789 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 1177 (ObjNum 843 snap 274 seq_num 843) dirty exists 2024-09-10T18:06:35.789 INFO:tasks.rados.rados.0.smithi012.stdout:2829: finishing copy_from racing read to smithi01278544-38 2024-09-10T18:06:35.789 INFO:tasks.rados.rados.0.smithi012.stdout:2829: finishing copy_from to smithi01278544-38 2024-09-10T18:06:35.790 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1146 (ObjNum 869 snap 285 seq_num 869) dirty exists 2024-09-10T18:06:35.790 INFO:tasks.rados.rados.0.smithi012.stdout:2828: done (4 left) 2024-09-10T18:06:35.790 INFO:tasks.rados.rados.0.smithi012.stdout:2829: done (3 left) 2024-09-10T18:06:35.790 INFO:tasks.rados.rados.0.smithi012.stdout:2830: done (2 left) 2024-09-10T18:06:35.790 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 288 2024-09-10T18:06:35.790 INFO:tasks.rados.rados.0.smithi012.stdout:2834: seq_num 878 ranges {0=311296} 2024-09-10T18:06:35.792 INFO:tasks.rados.rados.0.smithi012.stdout:2834: writing smithi01278544-19 from 0 to 311296 tid 1 2024-09-10T18:06:35.792 INFO:tasks.rados.rados.0.smithi012.stdout:2835: read oid 40 snap -1 2024-09-10T18:06:35.792 INFO:tasks.rados.rados.0.smithi012.stdout:2835: expect deleted 2024-09-10T18:06:35.792 INFO:tasks.rados.rados.0.smithi012.stdout:2836: snap_remove snap 287 2024-09-10T18:06:36.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:35 smithi012 ceph-mon[89611]: osdmap e654: 8 total, 8 up, 8 in 2024-09-10T18:06:36.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:35 smithi012 ceph-mon[92029]: osdmap e654: 8 total, 8 up, 8 in 2024-09-10T18:06:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:35 smithi089 ceph-mon[84132]: osdmap e654: 8 total, 8 up, 8 in 2024-09-10T18:06:36.328 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T18:06:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": { 2024-09-10T18:06:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 3 2024-09-10T18:06:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:06:36.328 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": { 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": { 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 8 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 2 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T18:06:36.329 INFO:teuthology.orchestra.run.smithi012.stdout: "overall": { 2024-09-10T18:06:36.330 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)": 15 2024-09-10T18:06:36.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T18:06:36.330 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T18:06:36.793 INFO:tasks.rados.rados.0.smithi012.stdout:2836: done (4 left) 2024-09-10T18:06:36.793 INFO:tasks.rados.rados.0.smithi012.stdout:2837: delete oid 27 current snap is 288 2024-09-10T18:06:36.793 INFO:tasks.rados.rados.0.smithi012.stdout:2834: finishing write tid 1 to smithi01278544-19 2024-09-10T18:06:36.793 INFO:tasks.rados.rados.0.smithi012.stdout:2834: finishing write tid 2 to smithi01278544-19 2024-09-10T18:06:36.793 INFO:tasks.rados.rados.0.smithi012.stdout:2834: finishing write tid 3 to smithi01278544-19 2024-09-10T18:06:36.793 INFO:tasks.rados.rados.0.smithi012.stdout:2834: oid 19 updating version 0 to 1194 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:2834: oid 19 version 1194 is already newer than 1193 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1194 (ObjNum 878 snap 288 seq_num 878) dirty exists 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:2834: left oid 19 (ObjNum 878 snap 288 seq_num 878) 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:2833: finishing rollback tid 0 to smithi01278544-22 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:2833: finishing rollback tid 1 to smithi01278544-22 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:2833: finishing rollback tid 2 to smithi01278544-22 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2053 (ObjNum 753 snap 248 seq_num 753) dirty exists 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:2832: finishing rollback tid 0 to smithi01278544-3 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:2832: finishing rollback tid 1 to smithi01278544-3 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:2832: finishing rollback tid 2 to smithi01278544-3 2024-09-10T18:06:36.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1609 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:06:36.801 INFO:tasks.rados.rados.0.smithi012.stdout:2832: done (4 left) 2024-09-10T18:06:36.801 INFO:tasks.rados.rados.0.smithi012.stdout:2833: done (3 left) 2024-09-10T18:06:36.801 INFO:tasks.rados.rados.0.smithi012.stdout:2834: done (2 left) 2024-09-10T18:06:36.801 INFO:tasks.rados.rados.0.smithi012.stdout:2835: done (1 left) 2024-09-10T18:06:36.802 INFO:tasks.rados.rados.0.smithi012.stdout:2837: done (0 left) 2024-09-10T18:06:36.802 INFO:tasks.rados.rados.0.smithi012.stdout:2838: read oid 26 snap -1 2024-09-10T18:06:36.802 INFO:tasks.rados.rados.0.smithi012.stdout:2838: expect (ObjNum 860 snap 278 seq_num 860) 2024-09-10T18:06:36.802 INFO:tasks.rados.rados.0.smithi012.stdout:2839: delete oid 44 current snap is 288 2024-09-10T18:06:36.804 INFO:tasks.rados.rados.0.smithi012.stdout:2838: expect (ObjNum 860 snap 278 seq_num 860) 2024-09-10T18:06:36.808 INFO:tasks.rados.rados.0.smithi012.stdout:2838: done (1 left) 2024-09-10T18:06:36.808 INFO:tasks.rados.rados.0.smithi012.stdout:2839: done (0 left) 2024-09-10T18:06:36.808 INFO:tasks.rados.rados.0.smithi012.stdout:2840: rollback oid 28 current snap is 288 2024-09-10T18:06:36.809 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 28 to 279 2024-09-10T18:06:36.809 INFO:tasks.rados.rados.0.smithi012.stdout:2841: setattr oid 20 current snap is 288 2024-09-10T18:06:36.809 INFO:tasks.rados.rados.0.smithi012.stdout:2842: delete oid 10 current snap is 288 2024-09-10T18:06:36.811 INFO:tasks.rados.rados.0.smithi012.stdout:2840: finishing rollback tid 0 to smithi01278544-28 2024-09-10T18:06:36.811 INFO:tasks.rados.rados.0.smithi012.stdout:2840: finishing rollback tid 1 to smithi01278544-28 2024-09-10T18:06:36.811 INFO:tasks.rados.rados.0.smithi012.stdout:2840: finishing rollback tid 2 to smithi01278544-28 2024-09-10T18:06:36.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1310 (ObjNum 658 snap 214 seq_num 658) dirty exists 2024-09-10T18:06:36.814 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2063 (ObjNum 850 snap 277 seq_num 850) dirty exists 2024-09-10T18:06:36.814 INFO:tasks.rados.rados.0.smithi012.stdout:2840: done (2 left) 2024-09-10T18:06:36.814 INFO:tasks.rados.rados.0.smithi012.stdout:2841: done (1 left) 2024-09-10T18:06:36.814 INFO:tasks.rados.rados.0.smithi012.stdout:2842: done (0 left) 2024-09-10T18:06:36.814 INFO:tasks.rados.rados.0.smithi012.stdout:2843: copy_from oid 8 from oid 46 current snap is 288 2024-09-10T18:06:36.815 INFO:tasks.rados.rados.0.smithi012.stdout:2844: snap_remove snap 285 2024-09-10T18:06:37.016 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:36 smithi012 ceph-mon[89611]: pgmap v659: 121 pgs: 121 active+clean; 222 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-09-10T18:06:37.016 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:36 smithi012 ceph-mon[89611]: osdmap e655: 8 total, 8 up, 8 in 2024-09-10T18:06:37.016 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:36 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3747238678' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:37.017 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:36 smithi012 ceph-mon[92029]: pgmap v659: 121 pgs: 121 active+clean; 222 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-09-10T18:06:37.017 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:36 smithi012 ceph-mon[92029]: osdmap e655: 8 total, 8 up, 8 in 2024-09-10T18:06:37.017 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:36 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3747238678' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:36 smithi089 ceph-mon[84132]: pgmap v659: 121 pgs: 121 active+clean; 222 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-09-10T18:06:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:36 smithi089 ceph-mon[84132]: osdmap e655: 8 total, 8 up, 8 in 2024-09-10T18:06:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:36 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3747238678' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:37.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -e sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-10T18:06:37.243 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:06:37.776 INFO:tasks.rados.rados.0.smithi012.stdout:2844: done (1 left) 2024-09-10T18:06:37.776 INFO:tasks.rados.rados.0.smithi012.stdout:2845: rmattr oid 36 current snap is 288 2024-09-10T18:06:37.776 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 288 2024-09-10T18:06:37.777 INFO:tasks.rados.rados.0.smithi012.stdout:2846: seq_num 882 ranges {155648=376832} 2024-09-10T18:06:37.779 INFO:tasks.rados.rados.0.smithi012.stdout:2846: writing smithi01278544-38 from 155648 to 532480 tid 1 2024-09-10T18:06:37.780 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 288 2024-09-10T18:06:37.780 INFO:tasks.rados.rados.0.smithi012.stdout:2843: finishing copy_from to smithi01278544-8 2024-09-10T18:06:37.780 INFO:tasks.rados.rados.0.smithi012.stdout:2843: got expected ENOENT (src dne) 2024-09-10T18:06:37.780 INFO:tasks.rados.rados.0.smithi012.stdout:2843: finishing copy_from racing read to smithi01278544-8 2024-09-10T18:06:37.784 INFO:tasks.rados.rados.0.smithi012.stdout:2847: seq_num 883 ranges {1884160=393216} 2024-09-10T18:06:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:2847: writing smithi01278544-49 from 1884160 to 2277376 tid 1 2024-09-10T18:06:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:2843: done (3 left) 2024-09-10T18:06:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 288 2024-09-10T18:06:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 1586 (ObjNum 33 snap 0 seq_num 3491047216) dirty exists 2024-09-10T18:06:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:2846: finishing write tid 1 to smithi01278544-38 2024-09-10T18:06:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:2846: finishing write tid 2 to smithi01278544-38 2024-09-10T18:06:37.794 INFO:tasks.rados.rados.0.smithi012.stdout:2846: finishing write tid 3 to smithi01278544-38 2024-09-10T18:06:37.794 INFO:tasks.rados.rados.0.smithi012.stdout:2846: oid 38 updating version 0 to 1877 2024-09-10T18:06:37.794 INFO:tasks.rados.rados.0.smithi012.stdout:2846: oid 38 version 1877 is already newer than 1876 2024-09-10T18:06:37.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1877 (ObjNum 882 snap 288 seq_num 882) dirty exists 2024-09-10T18:06:37.794 INFO:tasks.rados.rados.0.smithi012.stdout:2846: left oid 38 (ObjNum 882 snap 288 seq_num 882) 2024-09-10T18:06:37.794 INFO:tasks.rados.rados.0.smithi012.stdout:2848: seq_num 884 ranges {14475264=409600} 2024-09-10T18:06:37.875 INFO:tasks.rados.rados.0.smithi012.stdout:2848: writing smithi01278544-2 from 14475264 to 14884864 tid 1 2024-09-10T18:06:37.875 INFO:tasks.rados.rados.0.smithi012.stdout:2845: done (3 left) 2024-09-10T18:06:37.875 INFO:tasks.rados.rados.0.smithi012.stdout:2846: done (2 left) 2024-09-10T18:06:37.875 INFO:tasks.rados.rados.0.smithi012.stdout:2849: copy_from oid 42 from oid 30 current snap is 288 2024-09-10T18:06:37.875 INFO:tasks.rados.rados.0.smithi012.stdout:2847: finishing write tid 1 to smithi01278544-49 2024-09-10T18:06:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:2847: finishing write tid 2 to smithi01278544-49 2024-09-10T18:06:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:2847: finishing write tid 3 to smithi01278544-49 2024-09-10T18:06:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:2847: oid 49 updating version 0 to 1592 2024-09-10T18:06:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:2847: oid 49 version 1592 is already newer than 1591 2024-09-10T18:06:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1592 (ObjNum 883 snap 288 seq_num 883) dirty exists 2024-09-10T18:06:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:2847: left oid 49 (ObjNum 883 snap 288 seq_num 883) 2024-09-10T18:06:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:2847: done (2 left) 2024-09-10T18:06:37.876 INFO:tasks.rados.rados.0.smithi012.stdout:2850: snap_create 2024-09-10T18:06:37.880 INFO:tasks.rados.rados.0.smithi012.stdout:2848: finishing write tid 1 to smithi01278544-2 2024-09-10T18:06:37.881 INFO:tasks.rados.rados.0.smithi012.stdout:2848: finishing write tid 2 to smithi01278544-2 2024-09-10T18:06:37.882 INFO:tasks.rados.rados.0.smithi012.stdout:2848: finishing write tid 3 to smithi01278544-2 2024-09-10T18:06:37.882 INFO:tasks.rados.rados.0.smithi012.stdout:2848: oid 2 updating version 0 to 1594 2024-09-10T18:06:37.882 INFO:tasks.rados.rados.0.smithi012.stdout:2848: oid 2 version 1594 is already newer than 1593 2024-09-10T18:06:37.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1594 (ObjNum 884 snap 288 seq_num 884) dirty exists 2024-09-10T18:06:37.882 INFO:tasks.rados.rados.0.smithi012.stdout:2848: left oid 2 (ObjNum 884 snap 288 seq_num 884) 2024-09-10T18:06:37.928 INFO:tasks.rados.rados.0.smithi012.stdout:2849: finishing copy_from racing read to smithi01278544-42 2024-09-10T18:06:37.934 INFO:tasks.rados.rados.0.smithi012.stdout:2849: finishing copy_from to smithi01278544-42 2024-09-10T18:06:37.934 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 1176 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:06:38.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:37 smithi012 ceph-mon[89611]: osdmap e656: 8 total, 8 up, 8 in 2024-09-10T18:06:38.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:37 smithi012 ceph-mon[89611]: osdmap e657: 8 total, 8 up, 8 in 2024-09-10T18:06:38.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:37 smithi012 ceph-mon[92029]: osdmap e656: 8 total, 8 up, 8 in 2024-09-10T18:06:38.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:37 smithi012 ceph-mon[92029]: osdmap e657: 8 total, 8 up, 8 in 2024-09-10T18:06:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:37 smithi089 ceph-mon[84132]: osdmap e656: 8 total, 8 up, 8 in 2024-09-10T18:06:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:37 smithi089 ceph-mon[84132]: osdmap e657: 8 total, 8 up, 8 in 2024-09-10T18:06:38.802 INFO:tasks.rados.rados.0.smithi012.stdout:2848: done (2 left) 2024-09-10T18:06:38.802 INFO:tasks.rados.rados.0.smithi012.stdout:2849: done (1 left) 2024-09-10T18:06:38.802 INFO:tasks.rados.rados.0.smithi012.stdout:2850: done (0 left) 2024-09-10T18:06:38.802 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 289 2024-09-10T18:06:38.803 INFO:tasks.rados.rados.0.smithi012.stdout:2851: seq_num 885 ranges {7331840=425984} 2024-09-10T18:06:38.845 INFO:tasks.rados.rados.0.smithi012.stdout:2851: writing smithi01278544-13 from 7331840 to 7757824 tid 1 2024-09-10T18:06:38.845 INFO:tasks.rados.rados.0.smithi012.stdout:2852: rollback oid 43 current snap is 289 2024-09-10T18:06:38.845 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 43 to 278 2024-09-10T18:06:38.845 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 30 current snap is 289 2024-09-10T18:06:38.845 INFO:tasks.rados.rados.0.smithi012.stdout:2853: seq_num 886 ranges {14663680=442368} 2024-09-10T18:06:38.871 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:38 smithi012 ceph-mon[89611]: pgmap v662: 121 pgs: 121 active+clean; 239 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 5.9 MiB/s wr, 4 op/s 2024-09-10T18:06:38.872 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:38 smithi012 ceph-mon[92029]: pgmap v662: 121 pgs: 121 active+clean; 239 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 5.9 MiB/s wr, 4 op/s 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2853: writing smithi01278544-30 from 14663680 to 15106048 tid 1 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2854: snap_create 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2851: finishing write tid 1 to smithi01278544-13 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2851: finishing write tid 2 to smithi01278544-13 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2852: finishing rollback tid 1 to smithi01278544-43 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 1950 (ObjNum 65 snap 0 seq_num 1767788116) dirty dne 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2851: finishing write tid 3 to smithi01278544-13 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2851: oid 13 updating version 0 to 1587 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2851: oid 13 updating version 1587 to 1588 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1588 (ObjNum 885 snap 289 seq_num 885) dirty exists 2024-09-10T18:06:38.928 INFO:tasks.rados.rados.0.smithi012.stdout:2851: left oid 13 (ObjNum 885 snap 289 seq_num 885) 2024-09-10T18:06:38.934 INFO:tasks.rados.rados.0.smithi012.stdout:2853: finishing write tid 1 to smithi01278544-30 2024-09-10T18:06:38.935 INFO:tasks.rados.rados.0.smithi012.stdout:2853: finishing write tid 2 to smithi01278544-30 2024-09-10T18:06:38.937 INFO:tasks.rados.rados.0.smithi012.stdout:2853: finishing write tid 3 to smithi01278544-30 2024-09-10T18:06:38.937 INFO:tasks.rados.rados.0.smithi012.stdout:2853: oid 30 updating version 0 to 1178 2024-09-10T18:06:38.937 INFO:tasks.rados.rados.0.smithi012.stdout:2853: oid 30 updating version 1178 to 1179 2024-09-10T18:06:38.937 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1179 (ObjNum 886 snap 289 seq_num 886) dirty exists 2024-09-10T18:06:38.937 INFO:tasks.rados.rados.0.smithi012.stdout:2853: left oid 30 (ObjNum 886 snap 289 seq_num 886) 2024-09-10T18:06:39.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:38 smithi089 ceph-mon[84132]: pgmap v662: 121 pgs: 121 active+clean; 239 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 5.9 MiB/s wr, 4 op/s 2024-09-10T18:06:39.376 INFO:teuthology.orchestra.run.smithi012.stdout:true 2024-09-10T18:06:39.808 INFO:tasks.rados.rados.0.smithi012.stdout:2851: done (3 left) 2024-09-10T18:06:39.809 INFO:tasks.rados.rados.0.smithi012.stdout:2852: done (2 left) 2024-09-10T18:06:39.809 INFO:tasks.rados.rados.0.smithi012.stdout:2853: done (1 left) 2024-09-10T18:06:39.809 INFO:tasks.rados.rados.0.smithi012.stdout:2854: done (0 left) 2024-09-10T18:06:39.809 INFO:tasks.rados.rados.0.smithi012.stdout:2855: snap_remove snap 273 2024-09-10T18:06:40.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:39 smithi012 ceph-mon[89611]: osdmap e658: 8 total, 8 up, 8 in 2024-09-10T18:06:40.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:39 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1750275137' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:40.029 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:39 smithi012 ceph-mon[92029]: osdmap e658: 8 total, 8 up, 8 in 2024-09-10T18:06:40.029 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:39 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1750275137' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:40.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -e sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-10T18:06:40.241 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:06:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:39 smithi089 ceph-mon[84132]: osdmap e658: 8 total, 8 up, 8 in 2024-09-10T18:06:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:39 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1750275137' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:40.812 INFO:tasks.rados.rados.0.smithi012.stdout:2855: done (0 left) 2024-09-10T18:06:40.812 INFO:tasks.rados.rados.0.smithi012.stdout:2856: setattr oid 40 current snap is 290 2024-09-10T18:06:40.814 INFO:tasks.rados.rados.0.smithi012.stdout:2857: read oid 41 snap 288 2024-09-10T18:06:40.814 INFO:tasks.rados.rados.0.smithi012.stdout:2857: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:06:40.814 INFO:tasks.rados.rados.0.smithi012.stdout:2858: snap_remove snap 275 2024-09-10T18:06:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:40 smithi012 ceph-mon[89611]: pgmap v665: 121 pgs: 121 active+clean; 241 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.2 MiB/s rd, 6.1 MiB/s wr, 14 op/s 2024-09-10T18:06:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:40 smithi012 ceph-mon[89611]: osdmap e659: 8 total, 8 up, 8 in 2024-09-10T18:06:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:40 smithi012 ceph-mon[92029]: pgmap v665: 121 pgs: 121 active+clean; 241 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.2 MiB/s rd, 6.1 MiB/s wr, 14 op/s 2024-09-10T18:06:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:40 smithi012 ceph-mon[92029]: osdmap e659: 8 total, 8 up, 8 in 2024-09-10T18:06:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:40 smithi089 ceph-mon[84132]: pgmap v665: 121 pgs: 121 active+clean; 241 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.2 MiB/s rd, 6.1 MiB/s wr, 14 op/s 2024-09-10T18:06:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:40 smithi089 ceph-mon[84132]: osdmap e659: 8 total, 8 up, 8 in 2024-09-10T18:06:41.812 INFO:tasks.rados.rados.0.smithi012.stdout:2858: done (2 left) 2024-09-10T18:06:41.812 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 290 2024-09-10T18:06:41.813 INFO:tasks.rados.rados.0.smithi012.stdout:2859: seq_num 887 ranges {2310144=458752} 2024-09-10T18:06:41.833 INFO:tasks.rados.rados.0.smithi012.stdout:2859: writing smithi01278544-22 from 2310144 to 2768896 tid 1 2024-09-10T18:06:41.833 INFO:tasks.rados.rados.0.smithi012.stdout:2860: rollback oid 19 current snap is 290 2024-09-10T18:06:41.833 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 19 to 283 2024-09-10T18:06:41.833 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2073 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:06:41.833 INFO:tasks.rados.rados.0.smithi012.stdout:2857: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:06:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:41 smithi012 ceph-mon[89611]: osdmap e660: 8 total, 8 up, 8 in 2024-09-10T18:06:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:41 smithi012 ceph-mon[89611]: pgmap v668: 121 pgs: 121 active+clean; 242 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 43 KiB/s rd, 430 KiB/s wr, 12 op/s 2024-09-10T18:06:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:41 smithi012 ceph-mon[89611]: osdmap e661: 8 total, 8 up, 8 in 2024-09-10T18:06:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:41 smithi012 ceph-mon[92029]: osdmap e660: 8 total, 8 up, 8 in 2024-09-10T18:06:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:41 smithi012 ceph-mon[92029]: pgmap v668: 121 pgs: 121 active+clean; 242 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 43 KiB/s rd, 430 KiB/s wr, 12 op/s 2024-09-10T18:06:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:41 smithi012 ceph-mon[92029]: osdmap e661: 8 total, 8 up, 8 in 2024-09-10T18:06:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:41 smithi089 ceph-mon[84132]: osdmap e660: 8 total, 8 up, 8 in 2024-09-10T18:06:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:41 smithi089 ceph-mon[84132]: pgmap v668: 121 pgs: 121 active+clean; 242 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 43 KiB/s rd, 430 KiB/s wr, 12 op/s 2024-09-10T18:06:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:41 smithi089 ceph-mon[84132]: osdmap e661: 8 total, 8 up, 8 in 2024-09-10T18:06:42.329 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph version 19.3.0-4858-gbad1f558 (bad1f558c327094897e4a32e99dd5cb4ae6ccd46) squid (dev)" 2024-09-10T18:06:42.715 INFO:tasks.rados.rados.0.smithi012.stdout:2859: finishing write tid 1 to smithi01278544-22 2024-09-10T18:06:42.715 INFO:tasks.rados.rados.0.smithi012.stdout:2859: finishing write tid 2 to smithi01278544-22 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2856: done (3 left) 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2857: done (2 left) 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 290 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2859: finishing write tid 3 to smithi01278544-22 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2859: oid 22 updating version 0 to 2096 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2859: oid 22 version 2096 is already newer than 2095 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2096 (ObjNum 887 snap 290 seq_num 887) dirty exists 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2859: left oid 22 (ObjNum 887 snap 290 seq_num 887) 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2860: finishing rollback tid 0 to smithi01278544-19 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2860: finishing rollback tid 1 to smithi01278544-19 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1201 (ObjNum 33 snap 0 seq_num 3556621758) dirty dne 2024-09-10T18:06:42.716 INFO:tasks.rados.rados.0.smithi012.stdout:2861: seq_num 888 ranges {14475264=475136} 2024-09-10T18:06:42.797 INFO:tasks.rados.rados.0.smithi012.stdout:2861: writing smithi01278544-37 from 14475264 to 14950400 tid 1 2024-09-10T18:06:42.797 INFO:tasks.rados.rados.0.smithi012.stdout:2859: done (2 left) 2024-09-10T18:06:42.797 INFO:tasks.rados.rados.0.smithi012.stdout:2860: done (1 left) 2024-09-10T18:06:42.797 INFO:tasks.rados.rados.0.smithi012.stdout:2862: snap_remove snap 286 2024-09-10T18:06:42.975 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:42 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2848190995' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:42.975 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:42 smithi012 ceph-mon[89611]: osdmap e662: 8 total, 8 up, 8 in 2024-09-10T18:06:42.975 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:42 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2848190995' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:42.975 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:42 smithi012 ceph-mon[92029]: osdmap e662: 8 total, 8 up, 8 in 2024-09-10T18:06:42.995 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T18:06:42.995 INFO:teuthology.task.print:**** done end upgrade, wait... 2024-09-10T18:06:42.996 DEBUG:teuthology.parallel:result is None 2024-09-10T18:06:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:42 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2848190995' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-10T18:06:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:42 smithi089 ceph-mon[84132]: osdmap e662: 8 total, 8 up, 8 in 2024-09-10T18:06:43.779 INFO:tasks.rados.rados.0.smithi012.stdout:2861: finishing write tid 1 to smithi01278544-37 2024-09-10T18:06:43.779 INFO:tasks.rados.rados.0.smithi012.stdout:2861: finishing write tid 2 to smithi01278544-37 2024-09-10T18:06:43.779 INFO:tasks.rados.rados.0.smithi012.stdout:2861: finishing write tid 3 to smithi01278544-37 2024-09-10T18:06:43.779 INFO:tasks.rados.rados.0.smithi012.stdout:2861: oid 37 updating version 0 to 1589 2024-09-10T18:06:43.779 INFO:tasks.rados.rados.0.smithi012.stdout:2861: oid 37 updating version 1589 to 1590 2024-09-10T18:06:43.779 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 1590 (ObjNum 888 snap 290 seq_num 888) dirty exists 2024-09-10T18:06:43.779 INFO:tasks.rados.rados.0.smithi012.stdout:2861: left oid 37 (ObjNum 888 snap 290 seq_num 888) 2024-09-10T18:06:43.780 INFO:tasks.rados.rados.0.smithi012.stdout:2861: done (1 left) 2024-09-10T18:06:43.780 INFO:tasks.rados.rados.0.smithi012.stdout:2862: done (0 left) 2024-09-10T18:06:43.780 INFO:tasks.rados.rados.0.smithi012.stdout:2863: read oid 23 snap -1 2024-09-10T18:06:43.780 INFO:tasks.rados.rados.0.smithi012.stdout:2863: expect deleted 2024-09-10T18:06:43.780 INFO:tasks.rados.rados.0.smithi012.stdout:2864: read oid 25 snap -1 2024-09-10T18:06:43.780 INFO:tasks.rados.rados.0.smithi012.stdout:2864: expect deleted 2024-09-10T18:06:43.780 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 290 2024-09-10T18:06:43.780 INFO:tasks.rados.rados.0.smithi012.stdout:2865: seq_num 889 ranges {0=491520} 2024-09-10T18:06:43.782 INFO:tasks.rados.rados.0.smithi012.stdout:2865: writing smithi01278544-11 from 0 to 491520 tid 1 2024-09-10T18:06:43.782 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 290 2024-09-10T18:06:43.782 INFO:tasks.rados.rados.0.smithi012.stdout:2866: seq_num 890 ranges {0=507904} 2024-09-10T18:06:43.786 INFO:tasks.rados.rados.0.smithi012.stdout:2866: writing smithi01278544-10 from 0 to 507904 tid 1 2024-09-10T18:06:43.786 INFO:tasks.rados.rados.0.smithi012.stdout:2867: snap_create 2024-09-10T18:06:43.795 INFO:tasks.rados.rados.0.smithi012.stdout:2865: finishing write tid 1 to smithi01278544-11 2024-09-10T18:06:43.796 INFO:tasks.rados.rados.0.smithi012.stdout:2865: finishing write tid 2 to smithi01278544-11 2024-09-10T18:06:43.796 INFO:tasks.rados.rados.0.smithi012.stdout:2866: finishing write tid 1 to smithi01278544-10 2024-09-10T18:06:43.797 INFO:tasks.rados.rados.0.smithi012.stdout:2866: finishing write tid 2 to smithi01278544-10 2024-09-10T18:06:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:2865: finishing write tid 3 to smithi01278544-11 2024-09-10T18:06:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:2865: oid 11 updating version 0 to 2103 2024-09-10T18:06:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:2865: oid 11 updating version 2103 to 2104 2024-09-10T18:06:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2104 (ObjNum 889 snap 290 seq_num 889) dirty exists 2024-09-10T18:06:43.799 INFO:tasks.rados.rados.0.smithi012.stdout:2865: left oid 11 (ObjNum 889 snap 290 seq_num 889) 2024-09-10T18:06:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:2866: finishing write tid 3 to smithi01278544-10 2024-09-10T18:06:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:2866: oid 10 updating version 0 to 2105 2024-09-10T18:06:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:2866: oid 10 updating version 2105 to 2106 2024-09-10T18:06:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2106 (ObjNum 890 snap 290 seq_num 890) dirty exists 2024-09-10T18:06:43.800 INFO:tasks.rados.rados.0.smithi012.stdout:2866: left oid 10 (ObjNum 890 snap 290 seq_num 890) 2024-09-10T18:06:44.773 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:06:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:06:44] "GET /metrics HTTP/1.1" 200 36353 "" "Prometheus/2.51.0" 2024-09-10T18:06:44.780 INFO:tasks.rados.rados.0.smithi012.stdout:2863: done (4 left) 2024-09-10T18:06:44.780 INFO:tasks.rados.rados.0.smithi012.stdout:2864: done (3 left) 2024-09-10T18:06:44.780 INFO:tasks.rados.rados.0.smithi012.stdout:2865: done (2 left) 2024-09-10T18:06:44.780 INFO:tasks.rados.rados.0.smithi012.stdout:2866: done (1 left) 2024-09-10T18:06:44.780 INFO:tasks.rados.rados.0.smithi012.stdout:2867: done (0 left) 2024-09-10T18:06:44.780 INFO:tasks.rados.rados.0.smithi012.stdout:2868: read oid 28 snap -1 2024-09-10T18:06:44.780 INFO:tasks.rados.rados.0.smithi012.stdout:2868: expect (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:06:44.780 INFO:tasks.rados.rados.0.smithi012.stdout:2869: snap_create 2024-09-10T18:06:44.790 INFO:tasks.rados.rados.0.smithi012.stdout:2868: expect (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:06:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:44 smithi012 ceph-mon[89611]: pgmap v671: 121 pgs: 121 active+clean; 256 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 3.9 MiB/s wr, 14 op/s 2024-09-10T18:06:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:44 smithi012 ceph-mon[89611]: osdmap e663: 8 total, 8 up, 8 in 2024-09-10T18:06:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:44 smithi012 ceph-mon[92029]: pgmap v671: 121 pgs: 121 active+clean; 256 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 3.9 MiB/s wr, 14 op/s 2024-09-10T18:06:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:44 smithi012 ceph-mon[92029]: osdmap e663: 8 total, 8 up, 8 in 2024-09-10T18:06:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:44 smithi089 ceph-mon[84132]: pgmap v671: 121 pgs: 121 active+clean; 256 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 3.9 MiB/s wr, 14 op/s 2024-09-10T18:06:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:44 smithi089 ceph-mon[84132]: osdmap e663: 8 total, 8 up, 8 in 2024-09-10T18:06:45.790 INFO:tasks.rados.rados.0.smithi012.stdout:2868: done (1 left) 2024-09-10T18:06:45.790 INFO:tasks.rados.rados.0.smithi012.stdout:2869: done (0 left) 2024-09-10T18:06:45.790 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 292 2024-09-10T18:06:45.790 INFO:tasks.rados.rados.0.smithi012.stdout:2870: seq_num 891 ranges {0=532480} 2024-09-10T18:06:45.793 INFO:tasks.rados.rados.0.smithi012.stdout:2870: writing smithi01278544-46 from 0 to 532480 tid 1 2024-09-10T18:06:45.793 INFO:tasks.rados.rados.0.smithi012.stdout:2871: rollback oid 30 current snap is 292 2024-09-10T18:06:45.793 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 288 2024-09-10T18:06:45.793 INFO:tasks.rados.rados.0.smithi012.stdout:2872: read oid 45 snap 271 2024-09-10T18:06:45.793 INFO:tasks.rados.rados.0.smithi012.stdout:2872: expect (ObjNum 792 snap 260 seq_num 792) 2024-09-10T18:06:45.794 INFO:tasks.rados.rados.0.smithi012.stdout:2873: read oid 27 snap -1 2024-09-10T18:06:45.794 INFO:tasks.rados.rados.0.smithi012.stdout:2873: expect deleted 2024-09-10T18:06:45.794 INFO:tasks.rados.rados.0.smithi012.stdout:2874: snap_remove snap 289 2024-09-10T18:06:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:45 smithi012 ceph-mon[89611]: osdmap e664: 8 total, 8 up, 8 in 2024-09-10T18:06:46.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:45 smithi012 ceph-mon[92029]: osdmap e664: 8 total, 8 up, 8 in 2024-09-10T18:06:46.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:45 smithi089 ceph-mon[84132]: osdmap e664: 8 total, 8 up, 8 in 2024-09-10T18:06:46.789 INFO:tasks.rados.rados.0.smithi012.stdout:2874: done (4 left) 2024-09-10T18:06:46.789 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 292 2024-09-10T18:06:46.789 INFO:tasks.rados.rados.0.smithi012.stdout:2875: seq_num 892 ranges {0=548864} 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2875: writing smithi01278544-19 from 0 to 548864 tid 1 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2876: rollback oid 31 current snap is 292 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 279 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2870: finishing write tid 1 to smithi01278544-46 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2870: finishing write tid 2 to smithi01278544-46 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2870: finishing write tid 3 to smithi01278544-46 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2870: oid 46 updating version 0 to 1613 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2870: oid 46 version 1613 is already newer than 1612 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1613 (ObjNum 891 snap 292 seq_num 891) dirty exists 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2870: left oid 46 (ObjNum 891 snap 292 seq_num 891) 2024-09-10T18:06:46.794 INFO:tasks.rados.rados.0.smithi012.stdout:2871: finishing rollback tid 0 to smithi01278544-30 2024-09-10T18:06:46.795 INFO:tasks.rados.rados.0.smithi012.stdout:2871: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:06:46.795 INFO:tasks.rados.rados.0.smithi012.stdout:2871: finishing rollback tid 2 to smithi01278544-30 2024-09-10T18:06:46.795 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1182 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:06:46.795 INFO:tasks.rados.rados.0.smithi012.stdout:2872: expect (ObjNum 792 snap 260 seq_num 792) 2024-09-10T18:06:46.944 INFO:tasks.rados.rados.0.smithi012.stdout:2876: finishing rollback tid 0 to smithi01278544-31 2024-09-10T18:06:46.944 INFO:tasks.rados.rados.0.smithi012.stdout:2876: finishing rollback tid 1 to smithi01278544-31 2024-09-10T18:06:46.944 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 1592 (ObjNum 65 snap 0 seq_num 1733584726) dirty dne 2024-09-10T18:06:46.944 INFO:tasks.rados.rados.0.smithi012.stdout:2875: finishing write tid 1 to smithi01278544-19 2024-09-10T18:06:46.944 INFO:tasks.rados.rados.0.smithi012.stdout:2875: finishing write tid 2 to smithi01278544-19 2024-09-10T18:06:46.944 INFO:tasks.rados.rados.0.smithi012.stdout:2875: finishing write tid 3 to smithi01278544-19 2024-09-10T18:06:46.944 INFO:tasks.rados.rados.0.smithi012.stdout:2875: oid 19 updating version 0 to 1204 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2875: oid 19 updating version 1204 to 1205 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1205 (ObjNum 892 snap 292 seq_num 892) dirty exists 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2875: left oid 19 (ObjNum 892 snap 292 seq_num 892) 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2870: done (5 left) 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2871: done (4 left) 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2872: done (3 left) 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2873: done (2 left) 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2875: done (1 left) 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2876: done (0 left) 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2877: read oid 32 snap -1 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2877: expect (ObjNum 840 snap 272 seq_num 840) 2024-09-10T18:06:46.945 INFO:tasks.rados.rados.0.smithi012.stdout:2878: setattr oid 43 current snap is 292 2024-09-10T18:06:46.949 INFO:tasks.rados.rados.0.smithi012.stdout:2879: read oid 47 snap -1 2024-09-10T18:06:46.949 INFO:tasks.rados.rados.0.smithi012.stdout:2879: expect deleted 2024-09-10T18:06:46.949 INFO:tasks.rados.rados.0.smithi012.stdout:2880: rollback oid 23 current snap is 292 2024-09-10T18:06:46.949 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 23 to 288 2024-09-10T18:06:46.950 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 292 2024-09-10T18:06:46.950 INFO:tasks.rados.rados.0.smithi012.stdout:2881: seq_num 893 ranges {8192=565248} 2024-09-10T18:06:46.950 INFO:tasks.rados.rados.0.smithi012.stdout:2881: writing smithi01278544-26 from 8192 to 573440 tid 1 2024-09-10T18:06:46.950 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 8 current snap is 292 2024-09-10T18:06:46.950 INFO:tasks.rados.rados.0.smithi012.stdout:2880: finishing rollback tid 1 to smithi01278544-23 2024-09-10T18:06:46.950 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 0 (ObjNum 33 snap 0 seq_num 3496774848) dirty dne 2024-09-10T18:06:46.950 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2092 (ObjNum 65 snap 0 seq_num 1767788116) dirty exists 2024-09-10T18:06:46.950 INFO:tasks.rados.rados.0.smithi012.stdout:2882: seq_num 894 ranges {155648=581632} 2024-09-10T18:06:46.953 INFO:tasks.rados.rados.0.smithi012.stdout:2882: writing smithi01278544-8 from 155648 to 737280 tid 1 2024-09-10T18:06:46.953 INFO:tasks.rados.rados.0.smithi012.stdout:2878: done (5 left) 2024-09-10T18:06:46.953 INFO:tasks.rados.rados.0.smithi012.stdout:2879: done (4 left) 2024-09-10T18:06:46.953 INFO:tasks.rados.rados.0.smithi012.stdout:2880: done (3 left) 2024-09-10T18:06:46.953 INFO:tasks.rados.rados.0.smithi012.stdout:2883: rollback oid 31 current snap is 292 2024-09-10T18:06:46.953 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 290 2024-09-10T18:06:46.953 INFO:tasks.rados.rados.0.smithi012.stdout:2884: rollback oid 11 current snap is 292 2024-09-10T18:06:46.954 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 271 2024-09-10T18:06:46.954 INFO:tasks.rados.rados.0.smithi012.stdout:2885: rmattr oid 42 current snap is 292 2024-09-10T18:06:46.954 INFO:tasks.rados.rados.0.smithi012.stdout:2886: copy_from oid 7 from oid 21 current snap is 292 2024-09-10T18:06:46.954 INFO:tasks.rados.rados.0.smithi012.stdout:2887: read oid 50 snap -1 2024-09-10T18:06:46.954 INFO:tasks.rados.rados.0.smithi012.stdout:2887: expect (ObjNum 869 snap 285 seq_num 869) 2024-09-10T18:06:46.954 INFO:tasks.rados.rados.0.smithi012.stdout:2888: copy_from oid 1 from oid 12 current snap is 292 2024-09-10T18:06:46.954 INFO:tasks.rados.rados.0.smithi012.stdout:2889: copy_from oid 30 from oid 3 current snap is 292 2024-09-10T18:06:46.954 INFO:tasks.rados.rados.0.smithi012.stdout:2890: snap_remove snap 291 2024-09-10T18:06:47.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:46 smithi089 ceph-mon[84132]: pgmap v674: 121 pgs: 121 active+clean; 256 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 3.6 MiB/s wr, 11 op/s 2024-09-10T18:06:47.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:46 smithi089 ceph-mon[84132]: osdmap e665: 8 total, 8 up, 8 in 2024-09-10T18:06:47.220 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:46 smithi012 ceph-mon[89611]: pgmap v674: 121 pgs: 121 active+clean; 256 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 3.6 MiB/s wr, 11 op/s 2024-09-10T18:06:47.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:46 smithi012 ceph-mon[89611]: osdmap e665: 8 total, 8 up, 8 in 2024-09-10T18:06:47.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:46 smithi012 ceph-mon[92029]: pgmap v674: 121 pgs: 121 active+clean; 256 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 3.6 MiB/s wr, 11 op/s 2024-09-10T18:06:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:46 smithi012 ceph-mon[92029]: osdmap e665: 8 total, 8 up, 8 in 2024-09-10T18:06:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:06:47.779 INFO:tasks.rados.rados.0.smithi012.stdout:2890: done (10 left) 2024-09-10T18:06:47.779 INFO:tasks.rados.rados.0.smithi012.stdout:2891: read oid 19 snap -1 2024-09-10T18:06:47.779 INFO:tasks.rados.rados.0.smithi012.stdout:2891: expect (ObjNum 892 snap 292 seq_num 892) 2024-09-10T18:06:47.779 INFO:tasks.rados.rados.0.smithi012.stdout:2892: rmattr oid 15 current snap is 292 2024-09-10T18:06:47.779 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 292 2024-09-10T18:06:47.779 INFO:tasks.rados.rados.0.smithi012.stdout:2893: seq_num 895 ranges {7757824=598016} 2024-09-10T18:06:47.826 INFO:tasks.rados.rados.0.smithi012.stdout:2893: writing smithi01278544-13 from 7757824 to 8355840 tid 1 2024-09-10T18:06:47.826 INFO:tasks.rados.rados.0.smithi012.stdout:2894: snap_remove snap 278 2024-09-10T18:06:48.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:47 smithi089 ceph-mon[84132]: osdmap e666: 8 total, 8 up, 8 in 2024-09-10T18:06:48.173 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:47 smithi089 ceph-mon[84132]: osdmap e667: 8 total, 8 up, 8 in 2024-09-10T18:06:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:47 smithi012 ceph-mon[89611]: osdmap e666: 8 total, 8 up, 8 in 2024-09-10T18:06:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:47 smithi012 ceph-mon[89611]: osdmap e667: 8 total, 8 up, 8 in 2024-09-10T18:06:48.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:47 smithi012 ceph-mon[92029]: osdmap e666: 8 total, 8 up, 8 in 2024-09-10T18:06:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:47 smithi012 ceph-mon[92029]: osdmap e667: 8 total, 8 up, 8 in 2024-09-10T18:06:48.813 INFO:tasks.rados.rados.0.smithi012.stdout:2877: expect (ObjNum 840 snap 272 seq_num 840) 2024-09-10T18:06:48.881 INFO:tasks.rados.rados.0.smithi012.stdout:2886: finishing copy_from to smithi01278544-7 2024-09-10T18:06:48.881 INFO:tasks.rados.rados.0.smithi012.stdout:2886: got expected ENOENT (src dne) 2024-09-10T18:06:48.881 INFO:tasks.rados.rados.0.smithi012.stdout:2887: expect (ObjNum 869 snap 285 seq_num 869) 2024-09-10T18:06:48.886 INFO:tasks.rados.rados.0.smithi012.stdout:2886: finishing copy_from racing read to smithi01278544-7 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2881: finishing write tid 1 to smithi01278544-26 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2882: finishing write tid 1 to smithi01278544-8 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2881: finishing write tid 2 to smithi01278544-26 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2877: done (13 left) 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2886: done (12 left) 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2887: done (11 left) 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2894: done (10 left) 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2895: read oid 32 snap -1 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2895: expect (ObjNum 840 snap 272 seq_num 840) 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2896: copy_from oid 35 from oid 33 current snap is 292 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2883: finishing rollback tid 1 to smithi01278544-31 2024-09-10T18:06:48.887 INFO:tasks.rados.rados.0.smithi012.stdout:2883: finishing rollback tid 2 to smithi01278544-31 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 1594 (ObjNum 65 snap 0 seq_num 1733584726) dirty exists 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2882: finishing write tid 2 to smithi01278544-8 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2881: finishing write tid 3 to smithi01278544-26 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2881: oid 26 updating version 0 to 1587 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2881: oid 26 updating version 1587 to 1588 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 1588 (ObjNum 893 snap 292 seq_num 893) dirty exists 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2881: left oid 26 (ObjNum 893 snap 292 seq_num 893) 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2882: finishing write tid 3 to smithi01278544-8 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2882: oid 8 updating version 0 to 1148 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2882: oid 8 version 1148 is already newer than 1147 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1148 (ObjNum 894 snap 292 seq_num 894) dirty exists 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:2882: left oid 8 (ObjNum 894 snap 292 seq_num 894) 2024-09-10T18:06:48.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2094 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2884: finishing rollback tid 0 to smithi01278544-11 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2881: done (11 left) 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2882: done (10 left) 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2883: done (9 left) 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2885: done (8 left) 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2897: delete oid 39 current snap is 292 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2884: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2115 (ObjNum 65 snap 0 seq_num 3497851840) dirty dne 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2888: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2888: finishing copy_from to smithi01278544-1 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1976 (ObjNum 849 snap 276 seq_num 849) dirty exists 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2889: finishing copy_from racing read to smithi01278544-30 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:2889: finishing copy_from to smithi01278544-30 2024-09-10T18:06:48.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 1609 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:06:48.890 INFO:tasks.rados.rados.0.smithi012.stdout:2891: expect (ObjNum 892 snap 292 seq_num 892) 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 1595 (ObjNum 762 snap 249 seq_num 762) dirty exists 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:2893: finishing write tid 1 to smithi01278544-13 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:2893: finishing write tid 2 to smithi01278544-13 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:2893: finishing write tid 3 to smithi01278544-13 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:2893: oid 13 updating version 0 to 1596 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:2893: oid 13 version 1596 is already newer than 1595 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 1596 (ObjNum 895 snap 292 seq_num 895) dirty exists 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:2893: left oid 13 (ObjNum 895 snap 292 seq_num 895) 2024-09-10T18:06:48.901 INFO:tasks.rados.rados.0.smithi012.stdout:2895: expect (ObjNum 840 snap 272 seq_num 840) 2024-09-10T18:06:48.956 INFO:tasks.rados.rados.0.smithi012.stdout:2896: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:06:48.956 INFO:tasks.rados.rados.0.smithi012.stdout:2896: finishing copy_from to smithi01278544-35 2024-09-10T18:06:48.956 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2012 (ObjNum 863 snap 282 seq_num 863) dirty exists 2024-09-10T18:06:48.956 INFO:tasks.rados.rados.0.smithi012.stdout:2884: done (8 left) 2024-09-10T18:06:48.956 INFO:tasks.rados.rados.0.smithi012.stdout:2888: done (7 left) 2024-09-10T18:06:48.956 INFO:tasks.rados.rados.0.smithi012.stdout:2889: done (6 left) 2024-09-10T18:06:48.956 INFO:tasks.rados.rados.0.smithi012.stdout:2891: done (5 left) 2024-09-10T18:06:48.957 INFO:tasks.rados.rados.0.smithi012.stdout:2892: done (4 left) 2024-09-10T18:06:48.957 INFO:tasks.rados.rados.0.smithi012.stdout:2893: done (3 left) 2024-09-10T18:06:48.957 INFO:tasks.rados.rados.0.smithi012.stdout:2895: done (2 left) 2024-09-10T18:06:48.957 INFO:tasks.rados.rados.0.smithi012.stdout:2896: done (1 left) 2024-09-10T18:06:48.957 INFO:tasks.rados.rados.0.smithi012.stdout:2897: done (0 left) 2024-09-10T18:06:48.957 INFO:tasks.rados.rados.0.smithi012.stdout:2898: snap_create 2024-09-10T18:06:49.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:48 smithi012 ceph-mon[89611]: pgmap v677: 121 pgs: 121 active+clean; 258 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 602 KiB/s wr, 6 op/s 2024-09-10T18:06:49.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:48 smithi012 ceph-mon[92029]: pgmap v677: 121 pgs: 121 active+clean; 258 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 602 KiB/s wr, 6 op/s 2024-09-10T18:06:49.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:48 smithi089 ceph-mon[84132]: pgmap v677: 121 pgs: 121 active+clean; 258 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 602 KiB/s wr, 6 op/s 2024-09-10T18:06:49.816 INFO:tasks.rados.rados.0.smithi012.stdout:2898: done (0 left) 2024-09-10T18:06:49.817 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 293 2024-09-10T18:06:49.817 INFO:tasks.rados.rados.0.smithi012.stdout:2899: seq_num 897 ranges {0=630784} 2024-09-10T18:06:49.820 INFO:tasks.rados.rados.0.smithi012.stdout:2899: writing smithi01278544-29 from 0 to 630784 tid 1 2024-09-10T18:06:49.820 INFO:tasks.rados.rados.0.smithi012.stdout:2900: read oid 15 snap -1 2024-09-10T18:06:49.820 INFO:tasks.rados.rados.0.smithi012.stdout:2900: expect (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:06:49.820 INFO:tasks.rados.rados.0.smithi012.stdout:2901: rmattr oid 11 current snap is 293 2024-09-10T18:06:49.820 INFO:tasks.rados.rados.0.smithi012.stdout:2901: done (2 left) 2024-09-10T18:06:49.820 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 293 2024-09-10T18:06:49.821 INFO:tasks.rados.rados.0.smithi012.stdout:2902: seq_num 898 ranges {2080768=647168} 2024-09-10T18:06:49.836 INFO:tasks.rados.rados.0.smithi012.stdout:2902: writing smithi01278544-32 from 2080768 to 2727936 tid 1 2024-09-10T18:06:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:2903: setattr oid 4 current snap is 293 2024-09-10T18:06:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:2899: finishing write tid 1 to smithi01278544-29 2024-09-10T18:06:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:2899: finishing write tid 2 to smithi01278544-29 2024-09-10T18:06:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:2899: finishing write tid 3 to smithi01278544-29 2024-09-10T18:06:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:2899: oid 29 updating version 0 to 1121 2024-09-10T18:06:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:2899: oid 29 version 1121 is already newer than 1120 2024-09-10T18:06:49.838 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1121 (ObjNum 897 snap 293 seq_num 897) dirty exists 2024-09-10T18:06:49.838 INFO:tasks.rados.rados.0.smithi012.stdout:2899: left oid 29 (ObjNum 897 snap 293 seq_num 897) 2024-09-10T18:06:49.838 INFO:tasks.rados.rados.0.smithi012.stdout:2900: expect (ObjNum 762 snap 249 seq_num 762) 2024-09-10T18:06:49.860 INFO:tasks.rados.rados.0.smithi012.stdout:2902: finishing write tid 1 to smithi01278544-32 2024-09-10T18:06:49.860 INFO:tasks.rados.rados.0.smithi012.stdout:2902: finishing write tid 2 to smithi01278544-32 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:2902: finishing write tid 3 to smithi01278544-32 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:2902: oid 32 updating version 0 to 2014 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:2902: oid 32 version 2014 is already newer than 2013 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2014 (ObjNum 898 snap 293 seq_num 898) dirty exists 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:2902: left oid 32 (ObjNum 898 snap 293 seq_num 898) 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:2899: done (3 left) 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:2900: done (2 left) 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:2902: done (1 left) 2024-09-10T18:06:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:2904: snap_remove snap 283 2024-09-10T18:06:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:49 smithi012 ceph-mon[89611]: osdmap e668: 8 total, 8 up, 8 in 2024-09-10T18:06:50.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:49 smithi012 ceph-mon[92029]: osdmap e668: 8 total, 8 up, 8 in 2024-09-10T18:06:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:49 smithi089 ceph-mon[84132]: osdmap e668: 8 total, 8 up, 8 in 2024-09-10T18:06:50.829 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 1597 (ObjNum 864 snap 282 seq_num 864) dirty exists 2024-09-10T18:06:50.829 INFO:tasks.rados.rados.0.smithi012.stdout:2903: done (1 left) 2024-09-10T18:06:50.829 INFO:tasks.rados.rados.0.smithi012.stdout:2904: done (0 left) 2024-09-10T18:06:50.829 INFO:tasks.rados.rados.0.smithi012.stdout:2905: snap_remove snap 290 2024-09-10T18:06:51.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:50 smithi012 ceph-mon[89611]: pgmap v680: 121 pgs: 121 active+clean; 279 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.6 MiB/s wr, 10 op/s 2024-09-10T18:06:51.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:50 smithi012 ceph-mon[89611]: osdmap e669: 8 total, 8 up, 8 in 2024-09-10T18:06:51.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:50 smithi012 ceph-mon[92029]: pgmap v680: 121 pgs: 121 active+clean; 279 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.6 MiB/s wr, 10 op/s 2024-09-10T18:06:51.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:50 smithi012 ceph-mon[92029]: osdmap e669: 8 total, 8 up, 8 in 2024-09-10T18:06:51.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:50 smithi089 ceph-mon[84132]: pgmap v680: 121 pgs: 121 active+clean; 279 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.6 MiB/s wr, 10 op/s 2024-09-10T18:06:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:50 smithi089 ceph-mon[84132]: osdmap e669: 8 total, 8 up, 8 in 2024-09-10T18:06:51.837 INFO:tasks.rados.rados.0.smithi012.stdout:2905: done (0 left) 2024-09-10T18:06:51.837 INFO:tasks.rados.rados.0.smithi012.stdout:2906: copy_from oid 32 from oid 23 current snap is 293 2024-09-10T18:06:51.837 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 293 2024-09-10T18:06:51.837 INFO:tasks.rados.rados.0.smithi012.stdout:2907: seq_num 899 ranges {532480=663552} 2024-09-10T18:06:51.845 INFO:tasks.rados.rados.0.smithi012.stdout:2907: writing smithi01278544-38 from 532480 to 1196032 tid 1 2024-09-10T18:06:51.845 INFO:tasks.rados.rados.0.smithi012.stdout:2908: snap_create 2024-09-10T18:06:51.845 INFO:tasks.rados.rados.0.smithi012.stdout:2906: finishing copy_from to smithi01278544-32 2024-09-10T18:06:51.845 INFO:tasks.rados.rados.0.smithi012.stdout:2906: got expected ENOENT (src dne) 2024-09-10T18:06:51.845 INFO:tasks.rados.rados.0.smithi012.stdout:2906: finishing copy_from racing read to smithi01278544-32 2024-09-10T18:06:51.851 INFO:tasks.rados.rados.0.smithi012.stdout:2907: finishing write tid 1 to smithi01278544-38 2024-09-10T18:06:51.851 INFO:tasks.rados.rados.0.smithi012.stdout:2907: finishing write tid 2 to smithi01278544-38 2024-09-10T18:06:51.852 INFO:tasks.rados.rados.0.smithi012.stdout:2907: finishing write tid 3 to smithi01278544-38 2024-09-10T18:06:51.852 INFO:tasks.rados.rados.0.smithi012.stdout:2907: oid 38 updating version 0 to 1978 2024-09-10T18:06:51.852 INFO:tasks.rados.rados.0.smithi012.stdout:2907: oid 38 version 1978 is already newer than 1977 2024-09-10T18:06:51.853 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1978 (ObjNum 899 snap 293 seq_num 899) dirty exists 2024-09-10T18:06:51.853 INFO:tasks.rados.rados.0.smithi012.stdout:2907: left oid 38 (ObjNum 899 snap 293 seq_num 899) 2024-09-10T18:06:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:51 smithi012 ceph-mon[89611]: osdmap e670: 8 total, 8 up, 8 in 2024-09-10T18:06:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:51 smithi012 ceph-mon[89611]: pgmap v683: 121 pgs: 121 active+clean; 280 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.1 MiB/s wr, 14 op/s 2024-09-10T18:06:52.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:51 smithi012 ceph-mon[92029]: osdmap e670: 8 total, 8 up, 8 in 2024-09-10T18:06:52.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:51 smithi012 ceph-mon[92029]: pgmap v683: 121 pgs: 121 active+clean; 280 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.1 MiB/s wr, 14 op/s 2024-09-10T18:06:52.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:51 smithi089 ceph-mon[84132]: osdmap e670: 8 total, 8 up, 8 in 2024-09-10T18:06:52.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:51 smithi089 ceph-mon[84132]: pgmap v683: 121 pgs: 121 active+clean; 280 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 6.1 MiB/s wr, 14 op/s 2024-09-10T18:06:52.779 INFO:tasks.rados.rados.0.smithi012.stdout:2906: done (2 left) 2024-09-10T18:06:52.779 INFO:tasks.rados.rados.0.smithi012.stdout:2907: done (1 left) 2024-09-10T18:06:52.779 INFO:tasks.rados.rados.0.smithi012.stdout:2908: done (0 left) 2024-09-10T18:06:52.779 INFO:tasks.rados.rados.0.smithi012.stdout:2909: snap_remove snap 288 2024-09-10T18:06:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:52 smithi012 ceph-mon[89611]: osdmap e671: 8 total, 8 up, 8 in 2024-09-10T18:06:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:52 smithi012 ceph-mon[89611]: osdmap e672: 8 total, 8 up, 8 in 2024-09-10T18:06:53.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:52 smithi012 ceph-mon[92029]: osdmap e671: 8 total, 8 up, 8 in 2024-09-10T18:06:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:52 smithi012 ceph-mon[92029]: osdmap e672: 8 total, 8 up, 8 in 2024-09-10T18:06:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:52 smithi089 ceph-mon[84132]: osdmap e671: 8 total, 8 up, 8 in 2024-09-10T18:06:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:52 smithi089 ceph-mon[84132]: osdmap e672: 8 total, 8 up, 8 in 2024-09-10T18:06:53.782 INFO:tasks.rados.rados.0.smithi012.stdout:2909: done (0 left) 2024-09-10T18:06:53.782 INFO:tasks.rados.rados.0.smithi012.stdout:2910: copy_from oid 16 from oid 21 current snap is 294 2024-09-10T18:06:53.782 INFO:tasks.rados.rados.0.smithi012.stdout:2911: rmattr oid 13 current snap is 294 2024-09-10T18:06:53.782 INFO:tasks.rados.rados.0.smithi012.stdout:2911: done (1 left) 2024-09-10T18:06:53.782 INFO:tasks.rados.rados.0.smithi012.stdout:2912: delete oid 33 current snap is 294 2024-09-10T18:06:53.788 INFO:tasks.rados.rados.0.smithi012.stdout:2910: finishing copy_from to smithi01278544-16 2024-09-10T18:06:53.788 INFO:tasks.rados.rados.0.smithi012.stdout:2910: got expected ENOENT (src dne) 2024-09-10T18:06:53.789 INFO:tasks.rados.rados.0.smithi012.stdout:2910: finishing copy_from racing read to smithi01278544-16 2024-09-10T18:06:53.794 INFO:tasks.rados.rados.0.smithi012.stdout:2910: done (1 left) 2024-09-10T18:06:53.794 INFO:tasks.rados.rados.0.smithi012.stdout:2912: done (0 left) 2024-09-10T18:06:53.794 INFO:tasks.rados.rados.0.smithi012.stdout:2913: snap_remove snap 279 2024-09-10T18:06:54.776 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:06:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:06:54] "GET /metrics HTTP/1.1" 200 36357 "" "Prometheus/2.51.0" 2024-09-10T18:06:54.788 INFO:tasks.rados.rados.0.smithi012.stdout:2913: done (0 left) 2024-09-10T18:06:54.788 INFO:tasks.rados.rados.0.smithi012.stdout:2914: rollback oid 38 current snap is 294 2024-09-10T18:06:54.788 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 38 to 293 2024-09-10T18:06:54.788 INFO:tasks.rados.rados.0.smithi012.stdout:2915: setattr oid 47 current snap is 294 2024-09-10T18:06:54.789 INFO:tasks.rados.rados.0.smithi012.stdout:2916: copy_from oid 15 from oid 33 current snap is 294 2024-09-10T18:06:54.790 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 294 2024-09-10T18:06:54.790 INFO:tasks.rados.rados.0.smithi012.stdout:2917: seq_num 901 ranges {925696=696320} 2024-09-10T18:06:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:2917: writing smithi01278544-35 from 925696 to 1622016 tid 1 2024-09-10T18:06:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:2918: copy_from oid 4 from oid 5 current snap is 294 2024-09-10T18:06:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:2916: finishing copy_from to smithi01278544-15 2024-09-10T18:06:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:2916: got expected ENOENT (src dne) 2024-09-10T18:06:54.801 INFO:tasks.rados.rados.0.smithi012.stdout:2916: finishing copy_from racing read to smithi01278544-15 2024-09-10T18:06:54.802 INFO:tasks.rados.rados.0.smithi012.stdout:2916: done (4 left) 2024-09-10T18:06:54.802 INFO:tasks.rados.rados.0.smithi012.stdout:2919: delete oid 6 current snap is 294 2024-09-10T18:06:54.804 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 2115 (ObjNum 33 snap 0 seq_num 3498147712) dirty exists 2024-09-10T18:06:54.805 INFO:tasks.rados.rados.0.smithi012.stdout:2914: finishing rollback tid 0 to smithi01278544-38 2024-09-10T18:06:54.807 INFO:tasks.rados.rados.0.smithi012.stdout:2914: finishing rollback tid 1 to smithi01278544-38 2024-09-10T18:06:54.811 INFO:tasks.rados.rados.0.smithi012.stdout:2918: finishing copy_from to smithi01278544-4 2024-09-10T18:06:54.811 INFO:tasks.rados.rados.0.smithi012.stdout:2918: got expected ENOENT (src dne) 2024-09-10T18:06:54.811 INFO:tasks.rados.rados.0.smithi012.stdout:2918: finishing copy_from racing read to smithi01278544-4 2024-09-10T18:06:54.811 INFO:tasks.rados.rados.0.smithi012.stdout:2915: done (4 left) 2024-09-10T18:06:54.812 INFO:tasks.rados.rados.0.smithi012.stdout:2918: done (3 left) 2024-09-10T18:06:54.812 INFO:tasks.rados.rados.0.smithi012.stdout:2919: done (2 left) 2024-09-10T18:06:54.812 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 294 2024-09-10T18:06:54.812 INFO:tasks.rados.rados.0.smithi012.stdout:2920: seq_num 903 ranges {2727936=729088} 2024-09-10T18:06:54.834 INFO:tasks.rados.rados.0.smithi012.stdout:2920: writing smithi01278544-32 from 2727936 to 3457024 tid 1 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2921: read oid 28 snap -1 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2921: expect (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2922: delete oid 21 current snap is 294 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2914: finishing rollback tid 2 to smithi01278544-38 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1981 (ObjNum 899 snap 293 seq_num 899) dirty exists 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2917: finishing write tid 1 to smithi01278544-35 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2917: finishing write tid 2 to smithi01278544-35 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2917: finishing write tid 3 to smithi01278544-35 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2917: oid 35 updating version 0 to 2016 2024-09-10T18:06:54.835 INFO:tasks.rados.rados.0.smithi012.stdout:2917: oid 35 version 2016 is already newer than 2015 2024-09-10T18:06:54.836 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2016 (ObjNum 901 snap 294 seq_num 901) dirty exists 2024-09-10T18:06:54.836 INFO:tasks.rados.rados.0.smithi012.stdout:2917: left oid 35 (ObjNum 901 snap 294 seq_num 901) 2024-09-10T18:06:54.837 INFO:tasks.rados.rados.0.smithi012.stdout:2914: done (4 left) 2024-09-10T18:06:54.837 INFO:tasks.rados.rados.0.smithi012.stdout:2917: done (3 left) 2024-09-10T18:06:54.837 INFO:tasks.rados.rados.0.smithi012.stdout:2922: done (2 left) 2024-09-10T18:06:54.837 INFO:tasks.rados.rados.0.smithi012.stdout:2923: read oid 37 snap -1 2024-09-10T18:06:54.837 INFO:tasks.rados.rados.0.smithi012.stdout:2923: expect (ObjNum 888 snap 290 seq_num 888) 2024-09-10T18:06:54.837 INFO:tasks.rados.rados.0.smithi012.stdout:2924: read oid 10 snap -1 2024-09-10T18:06:54.837 INFO:tasks.rados.rados.0.smithi012.stdout:2924: expect (ObjNum 890 snap 290 seq_num 890) 2024-09-10T18:06:54.838 INFO:tasks.rados.rados.0.smithi012.stdout:2925: rollback oid 8 current snap is 294 2024-09-10T18:06:54.838 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 8 to 271 2024-09-10T18:06:54.838 INFO:tasks.rados.rados.0.smithi012.stdout:2926: snap_remove snap 293 2024-09-10T18:06:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:54 smithi012 ceph-mon[89611]: pgmap v686: 121 pgs: 121 active+clean; 272 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 960 KiB/s wr, 29 op/s 2024-09-10T18:06:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:54 smithi012 ceph-mon[89611]: osdmap e673: 8 total, 8 up, 8 in 2024-09-10T18:06:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:54 smithi012 ceph-mon[92029]: pgmap v686: 121 pgs: 121 active+clean; 272 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 960 KiB/s wr, 29 op/s 2024-09-10T18:06:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:54 smithi012 ceph-mon[92029]: osdmap e673: 8 total, 8 up, 8 in 2024-09-10T18:06:55.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:54 smithi089 ceph-mon[84132]: pgmap v686: 121 pgs: 121 active+clean; 272 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 960 KiB/s wr, 29 op/s 2024-09-10T18:06:55.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:54 smithi089 ceph-mon[84132]: osdmap e673: 8 total, 8 up, 8 in 2024-09-10T18:06:55.794 INFO:tasks.rados.rados.0.smithi012.stdout:2920: finishing write tid 1 to smithi01278544-32 2024-09-10T18:06:55.794 INFO:tasks.rados.rados.0.smithi012.stdout:2920: finishing write tid 2 to smithi01278544-32 2024-09-10T18:06:55.794 INFO:tasks.rados.rados.0.smithi012.stdout:2921: expect (ObjNum 658 snap 214 seq_num 658) 2024-09-10T18:06:55.835 INFO:tasks.rados.rados.0.smithi012.stdout:2920: finishing write tid 3 to smithi01278544-32 2024-09-10T18:06:55.835 INFO:tasks.rados.rados.0.smithi012.stdout:2920: oid 32 updating version 0 to 2018 2024-09-10T18:06:55.835 INFO:tasks.rados.rados.0.smithi012.stdout:2920: oid 32 version 2018 is already newer than 2017 2024-09-10T18:06:55.835 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2018 (ObjNum 903 snap 294 seq_num 903) dirty exists 2024-09-10T18:06:55.835 INFO:tasks.rados.rados.0.smithi012.stdout:2920: left oid 32 (ObjNum 903 snap 294 seq_num 903) 2024-09-10T18:06:55.836 INFO:tasks.rados.rados.0.smithi012.stdout:2925: finishing rollback tid 0 to smithi01278544-8 2024-09-10T18:06:55.836 INFO:tasks.rados.rados.0.smithi012.stdout:2924: expect (ObjNum 890 snap 290 seq_num 890) 2024-09-10T18:06:55.848 INFO:tasks.rados.rados.0.smithi012.stdout:2925: finishing rollback tid 1 to smithi01278544-8 2024-09-10T18:06:55.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 1150 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:06:55.849 INFO:tasks.rados.rados.0.smithi012.stdout:2923: expect (ObjNum 888 snap 290 seq_num 888) 2024-09-10T18:06:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:55 smithi012 ceph-mon[89611]: osdmap e674: 8 total, 8 up, 8 in 2024-09-10T18:06:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:55 smithi012 ceph-mon[92029]: osdmap e674: 8 total, 8 up, 8 in 2024-09-10T18:06:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:55 smithi089 ceph-mon[84132]: osdmap e674: 8 total, 8 up, 8 in 2024-09-10T18:06:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:56 smithi012 ceph-mon[89611]: pgmap v689: 121 pgs: 121 active+clean; 273 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 976 KiB/s wr, 20 op/s 2024-09-10T18:06:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:56 smithi012 ceph-mon[89611]: osdmap e675: 8 total, 8 up, 8 in 2024-09-10T18:06:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:56 smithi012 ceph-mon[92029]: pgmap v689: 121 pgs: 121 active+clean; 273 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 976 KiB/s wr, 20 op/s 2024-09-10T18:06:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:56 smithi012 ceph-mon[92029]: osdmap e675: 8 total, 8 up, 8 in 2024-09-10T18:06:57.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:56 smithi089 ceph-mon[84132]: pgmap v689: 121 pgs: 121 active+clean; 273 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 976 KiB/s wr, 20 op/s 2024-09-10T18:06:57.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:56 smithi089 ceph-mon[84132]: osdmap e675: 8 total, 8 up, 8 in 2024-09-10T18:06:57.748 INFO:tasks.rados.rados.0.smithi012.stdout:2920: done (5 left) 2024-09-10T18:06:57.748 INFO:tasks.rados.rados.0.smithi012.stdout:2921: done (4 left) 2024-09-10T18:06:57.748 INFO:tasks.rados.rados.0.smithi012.stdout:2923: done (3 left) 2024-09-10T18:06:57.748 INFO:tasks.rados.rados.0.smithi012.stdout:2924: done (2 left) 2024-09-10T18:06:57.748 INFO:tasks.rados.rados.0.smithi012.stdout:2925: done (1 left) 2024-09-10T18:06:57.748 INFO:tasks.rados.rados.0.smithi012.stdout:2926: done (0 left) 2024-09-10T18:06:57.748 INFO:tasks.rados.rados.0.smithi012.stdout:2927: setattr oid 42 current snap is 294 2024-09-10T18:06:57.749 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 47 current snap is 294 2024-09-10T18:06:57.749 INFO:tasks.rados.rados.0.smithi012.stdout:2928: seq_num 905 ranges {0=761856} 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2928: writing smithi01278544-47 from 0 to 761856 tid 1 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2929: read oid 50 snap -1 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2929: expect (ObjNum 869 snap 285 seq_num 869) 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2930: read oid 23 snap 271 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2930: expect deleted 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2931: read oid 41 snap -1 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2931: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2932: copy_from oid 14 from oid 36 current snap is 294 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 294 2024-09-10T18:06:57.754 INFO:tasks.rados.rados.0.smithi012.stdout:2933: seq_num 906 ranges {630784=778240} 2024-09-10T18:06:57.762 INFO:tasks.rados.rados.0.smithi012.stdout:2933: writing smithi01278544-29 from 630784 to 1409024 tid 1 2024-09-10T18:06:57.762 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 294 2024-09-10T18:06:57.762 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2127 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:06:57.762 INFO:tasks.rados.rados.0.smithi012.stdout:2934: seq_num 907 ranges {14475264=794624} 2024-09-10T18:06:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2934: writing smithi01278544-3 from 14475264 to 15269888 tid 1 2024-09-10T18:06:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2927: done (7 left) 2024-09-10T18:06:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 294 2024-09-10T18:06:57.846 INFO:tasks.rados.rados.0.smithi012.stdout:2935: seq_num 908 ranges {0=409600,409600=401408} 2024-09-10T18:06:57.848 INFO:tasks.rados.rados.0.smithi012.stdout:2935: writing smithi01278544-6 from 0 to 409600 tid 1 2024-09-10T18:06:57.850 INFO:tasks.rados.rados.0.smithi012.stdout:2935: writing smithi01278544-6 from 409600 to 811008 tid 2 2024-09-10T18:06:57.850 INFO:tasks.rados.rados.0.smithi012.stdout:2936: snap_create 2024-09-10T18:06:57.851 INFO:tasks.rados.rados.0.smithi012.stdout:2929: expect (ObjNum 869 snap 285 seq_num 869) 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2928: finishing write tid 1 to smithi01278544-47 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2928: finishing write tid 2 to smithi01278544-47 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2928: finishing write tid 3 to smithi01278544-47 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2928: oid 47 updating version 0 to 2129 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2928: oid 47 version 2129 is already newer than 2128 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 2129 (ObjNum 905 snap 294 seq_num 905) dirty exists 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2928: left oid 47 (ObjNum 905 snap 294 seq_num 905) 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2932: finishing copy_from racing read to smithi01278544-14 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2932: finishing copy_from to smithi01278544-14 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 1586 (ObjNum 289 snap 0 seq_num 3012467045) dirty exists 2024-09-10T18:06:57.857 INFO:tasks.rados.rados.0.smithi012.stdout:2933: finishing write tid 1 to smithi01278544-29 2024-09-10T18:06:57.858 INFO:tasks.rados.rados.0.smithi012.stdout:2933: finishing write tid 2 to smithi01278544-29 2024-09-10T18:06:57.858 INFO:tasks.rados.rados.0.smithi012.stdout:2933: finishing write tid 3 to smithi01278544-29 2024-09-10T18:06:57.858 INFO:tasks.rados.rados.0.smithi012.stdout:2933: oid 29 updating version 0 to 1122 2024-09-10T18:06:57.858 INFO:tasks.rados.rados.0.smithi012.stdout:2933: oid 29 updating version 1122 to 1123 2024-09-10T18:06:57.858 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1123 (ObjNum 906 snap 294 seq_num 906) dirty exists 2024-09-10T18:06:57.858 INFO:tasks.rados.rados.0.smithi012.stdout:2933: left oid 29 (ObjNum 906 snap 294 seq_num 906) 2024-09-10T18:06:57.858 INFO:tasks.rados.rados.0.smithi012.stdout:2931: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:06:58.732 INFO:tasks.rados.rados.0.smithi012.stdout:2934: finishing write tid 1 to smithi01278544-3 2024-09-10T18:06:58.732 INFO:tasks.rados.rados.0.smithi012.stdout:2934: finishing write tid 2 to smithi01278544-3 2024-09-10T18:06:58.732 INFO:tasks.rados.rados.0.smithi012.stdout:2935: finishing write tid 1 to smithi01278544-6 2024-09-10T18:06:58.732 INFO:tasks.rados.rados.0.smithi012.stdout:2935: finishing write tid 2 to smithi01278544-6 2024-09-10T18:06:58.732 INFO:tasks.rados.rados.0.smithi012.stdout:2935: finishing write tid 3 to smithi01278544-6 2024-09-10T18:06:58.732 INFO:tasks.rados.rados.0.smithi012.stdout:2934: finishing write tid 3 to smithi01278544-3 2024-09-10T18:06:58.732 INFO:tasks.rados.rados.0.smithi012.stdout:2934: oid 3 updating version 0 to 1614 2024-09-10T18:06:58.733 INFO:tasks.rados.rados.0.smithi012.stdout:2934: oid 3 updating version 1614 to 1615 2024-09-10T18:06:58.733 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1615 (ObjNum 907 snap 294 seq_num 907) dirty exists 2024-09-10T18:06:58.733 INFO:tasks.rados.rados.0.smithi012.stdout:2934: left oid 3 (ObjNum 907 snap 294 seq_num 907) 2024-09-10T18:06:58.733 INFO:tasks.rados.rados.0.smithi012.stdout:2935: finishing write tid 4 to smithi01278544-6 2024-09-10T18:06:58.733 INFO:tasks.rados.rados.0.smithi012.stdout:2935: oid 6 updating version 0 to 1153 2024-09-10T18:06:58.733 INFO:tasks.rados.rados.0.smithi012.stdout:2935: oid 6 version 1153 is already newer than 1151 2024-09-10T18:06:58.733 INFO:tasks.rados.rados.0.smithi012.stdout:2935: oid 6 version 1153 is already newer than 1152 2024-09-10T18:06:58.733 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 1153 (ObjNum 908 snap 294 seq_num 908) dirty exists 2024-09-10T18:06:58.734 INFO:tasks.rados.rados.0.smithi012.stdout:2935: left oid 6 (ObjNum 908 snap 294 seq_num 908) 2024-09-10T18:06:58.797 INFO:tasks.rados.rados.0.smithi012.stdout:2928: done (8 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2929: done (7 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2930: done (6 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2931: done (5 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2932: done (4 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2933: done (3 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2934: done (2 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2935: done (1 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2936: done (0 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2937: rmattr oid 44 current snap is 295 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2937: done (0 left) 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2938: rmattr oid 50 current snap is 295 2024-09-10T18:06:58.798 INFO:tasks.rados.rados.0.smithi012.stdout:2938: done (0 left) 2024-09-10T18:06:58.799 INFO:tasks.rados.rados.0.smithi012.stdout:2939: read oid 45 snap -1 2024-09-10T18:06:58.799 INFO:tasks.rados.rados.0.smithi012.stdout:2939: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:06:58.799 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 295 2024-09-10T18:06:58.799 INFO:tasks.rados.rados.0.smithi012.stdout:2940: seq_num 909 ranges {14884864=425984,15310848=401408} 2024-09-10T18:06:58.882 INFO:tasks.rados.rados.0.smithi012.stdout:2940: writing smithi01278544-2 from 14884864 to 15310848 tid 1 2024-09-10T18:06:58.884 INFO:tasks.rados.rados.0.smithi012.stdout:2940: writing smithi01278544-2 from 15310848 to 15712256 tid 2 2024-09-10T18:06:58.884 INFO:tasks.rados.rados.0.smithi012.stdout:2941: rmattr oid 44 current snap is 295 2024-09-10T18:06:58.884 INFO:tasks.rados.rados.0.smithi012.stdout:2941: done (2 left) 2024-09-10T18:06:58.885 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 295 2024-09-10T18:06:58.885 INFO:tasks.rados.rados.0.smithi012.stdout:2942: seq_num 910 ranges {0=442368,442368=401408} 2024-09-10T18:06:58.886 INFO:tasks.rados.rados.0.smithi012.stdout:2942: writing smithi01278544-11 from 0 to 442368 tid 1 2024-09-10T18:06:58.889 INFO:tasks.rados.rados.0.smithi012.stdout:2942: writing smithi01278544-11 from 442368 to 843776 tid 2 2024-09-10T18:06:58.889 INFO:tasks.rados.rados.0.smithi012.stdout:2943: rmattr oid 38 current snap is 295 2024-09-10T18:06:58.889 INFO:tasks.rados.rados.0.smithi012.stdout:2943: done (3 left) 2024-09-10T18:06:58.889 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 295 2024-09-10T18:06:58.889 INFO:tasks.rados.rados.0.smithi012.stdout:2944: seq_num 911 ranges {573440=466944,1040384=401408} 2024-09-10T18:06:58.894 INFO:tasks.rados.rados.0.smithi012.stdout:2944: writing smithi01278544-26 from 573440 to 1040384 tid 1 2024-09-10T18:06:58.897 INFO:tasks.rados.rados.0.smithi012.stdout:2944: writing smithi01278544-26 from 1040384 to 1441792 tid 2 2024-09-10T18:06:58.897 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 295 2024-09-10T18:06:58.897 INFO:tasks.rados.rados.0.smithi012.stdout:2945: seq_num 912 ranges {0=483328,483328=401408} 2024-09-10T18:06:58.900 INFO:tasks.rados.rados.0.smithi012.stdout:2945: writing smithi01278544-18 from 0 to 483328 tid 1 2024-09-10T18:06:58.902 INFO:tasks.rados.rados.0.smithi012.stdout:2945: writing smithi01278544-18 from 483328 to 884736 tid 2 2024-09-10T18:06:58.902 INFO:tasks.rados.rados.0.smithi012.stdout:2946: delete oid 14 current snap is 295 2024-09-10T18:06:58.903 INFO:tasks.rados.rados.0.smithi012.stdout:2939: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:06:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:58 smithi012 ceph-mon[89611]: pgmap v691: 121 pgs: 121 active+clean; 268 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 506 KiB/s wr, 10 op/s 2024-09-10T18:06:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:58 smithi012 ceph-mon[89611]: osdmap e676: 8 total, 8 up, 8 in 2024-09-10T18:06:59.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:58 smithi012 ceph-mon[92029]: pgmap v691: 121 pgs: 121 active+clean; 268 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 506 KiB/s wr, 10 op/s 2024-09-10T18:06:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:58 smithi012 ceph-mon[92029]: osdmap e676: 8 total, 8 up, 8 in 2024-09-10T18:06:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:58 smithi089 ceph-mon[84132]: pgmap v691: 121 pgs: 121 active+clean; 268 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 506 KiB/s wr, 10 op/s 2024-09-10T18:06:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:58 smithi089 ceph-mon[84132]: osdmap e676: 8 total, 8 up, 8 in 2024-09-10T18:07:00.240 INFO:tasks.rados.rados.0.smithi012.stdout:2940: finishing write tid 1 to smithi01278544-2 2024-09-10T18:07:00.241 INFO:tasks.rados.rados.0.smithi012.stdout:2940: finishing write tid 2 to smithi01278544-2 2024-09-10T18:07:00.241 INFO:tasks.rados.rados.0.smithi012.stdout:2940: finishing write tid 3 to smithi01278544-2 2024-09-10T18:07:00.241 INFO:tasks.rados.rados.0.smithi012.stdout:2940: finishing write tid 4 to smithi01278544-2 2024-09-10T18:07:00.241 INFO:tasks.rados.rados.0.smithi012.stdout:2940: oid 2 updating version 0 to 1597 2024-09-10T18:07:00.241 INFO:tasks.rados.rados.0.smithi012.stdout:2940: oid 2 updating version 1597 to 1598 2024-09-10T18:07:00.242 INFO:tasks.rados.rados.0.smithi012.stdout:2940: oid 2 version 1598 is already newer than 1596 2024-09-10T18:07:00.242 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 1598 (ObjNum 909 snap 295 seq_num 909) dirty exists 2024-09-10T18:07:00.242 INFO:tasks.rados.rados.0.smithi012.stdout:2940: left oid 2 (ObjNum 909 snap 295 seq_num 909) 2024-09-10T18:07:00.242 INFO:tasks.rados.rados.0.smithi012.stdout:2942: finishing write tid 1 to smithi01278544-11 2024-09-10T18:07:00.242 INFO:tasks.rados.rados.0.smithi012.stdout:2942: finishing write tid 2 to smithi01278544-11 2024-09-10T18:07:00.243 INFO:tasks.rados.rados.0.smithi012.stdout:2942: finishing write tid 3 to smithi01278544-11 2024-09-10T18:07:00.243 INFO:tasks.rados.rados.0.smithi012.stdout:2942: finishing write tid 4 to smithi01278544-11 2024-09-10T18:07:00.243 INFO:tasks.rados.rados.0.smithi012.stdout:2942: oid 11 updating version 0 to 2156 2024-09-10T18:07:00.243 INFO:tasks.rados.rados.0.smithi012.stdout:2942: oid 11 updating version 2156 to 2158 2024-09-10T18:07:00.243 INFO:tasks.rados.rados.0.smithi012.stdout:2942: oid 11 version 2158 is already newer than 2157 2024-09-10T18:07:00.244 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2158 (ObjNum 910 snap 295 seq_num 910) dirty exists 2024-09-10T18:07:00.244 INFO:tasks.rados.rados.0.smithi012.stdout:2942: left oid 11 (ObjNum 910 snap 295 seq_num 910) 2024-09-10T18:07:00.244 INFO:tasks.rados.rados.0.smithi012.stdout:2944: finishing write tid 1 to smithi01278544-26 2024-09-10T18:07:00.244 INFO:tasks.rados.rados.0.smithi012.stdout:2944: finishing write tid 2 to smithi01278544-26 2024-09-10T18:07:00.244 INFO:tasks.rados.rados.0.smithi012.stdout:2944: finishing write tid 3 to smithi01278544-26 2024-09-10T18:07:00.244 INFO:tasks.rados.rados.0.smithi012.stdout:2944: finishing write tid 4 to smithi01278544-26 2024-09-10T18:07:00.245 INFO:tasks.rados.rados.0.smithi012.stdout:2944: oid 26 updating version 0 to 1589 2024-09-10T18:07:00.245 INFO:tasks.rados.rados.0.smithi012.stdout:2944: oid 26 updating version 1589 to 1591 2024-09-10T18:07:00.245 INFO:tasks.rados.rados.0.smithi012.stdout:2944: oid 26 version 1591 is already newer than 1590 2024-09-10T18:07:00.245 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 1591 (ObjNum 911 snap 295 seq_num 911) dirty exists 2024-09-10T18:07:00.245 INFO:tasks.rados.rados.0.smithi012.stdout:2944: left oid 26 (ObjNum 911 snap 295 seq_num 911) 2024-09-10T18:07:00.245 INFO:tasks.rados.rados.0.smithi012.stdout:2945: finishing write tid 1 to smithi01278544-18 2024-09-10T18:07:00.246 INFO:tasks.rados.rados.0.smithi012.stdout:2945: finishing write tid 2 to smithi01278544-18 2024-09-10T18:07:00.246 INFO:tasks.rados.rados.0.smithi012.stdout:2945: finishing write tid 3 to smithi01278544-18 2024-09-10T18:07:00.246 INFO:tasks.rados.rados.0.smithi012.stdout:2945: finishing write tid 4 to smithi01278544-18 2024-09-10T18:07:00.246 INFO:tasks.rados.rados.0.smithi012.stdout:2945: oid 18 updating version 0 to 1601 2024-09-10T18:07:00.246 INFO:tasks.rados.rados.0.smithi012.stdout:2945: oid 18 version 1601 is already newer than 1600 2024-09-10T18:07:00.246 INFO:tasks.rados.rados.0.smithi012.stdout:2945: oid 18 version 1601 is already newer than 1599 2024-09-10T18:07:00.247 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 1601 (ObjNum 912 snap 295 seq_num 912) dirty exists 2024-09-10T18:07:00.247 INFO:tasks.rados.rados.0.smithi012.stdout:2945: left oid 18 (ObjNum 912 snap 295 seq_num 912) 2024-09-10T18:07:00.251 INFO:tasks.rados.rados.0.smithi012.stdout:2939: done (5 left) 2024-09-10T18:07:00.251 INFO:tasks.rados.rados.0.smithi012.stdout:2940: done (4 left) 2024-09-10T18:07:00.251 INFO:tasks.rados.rados.0.smithi012.stdout:2942: done (3 left) 2024-09-10T18:07:00.251 INFO:tasks.rados.rados.0.smithi012.stdout:2944: done (2 left) 2024-09-10T18:07:00.251 INFO:tasks.rados.rados.0.smithi012.stdout:2945: done (1 left) 2024-09-10T18:07:00.251 INFO:tasks.rados.rados.0.smithi012.stdout:2946: done (0 left) 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2947: read oid 4 snap -1 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2947: expect (ObjNum 864 snap 282 seq_num 864) 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2948: rollback oid 41 current snap is 295 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 292 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2949: read oid 1 snap -1 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2949: expect (ObjNum 849 snap 276 seq_num 849) 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2950: rmattr oid 22 current snap is 295 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2950: done (3 left) 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2951: rmattr oid 38 current snap is 295 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2951: done (3 left) 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2952: copy_from oid 13 from oid 42 current snap is 295 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 295 2024-09-10T18:07:00.252 INFO:tasks.rados.rados.0.smithi012.stdout:2953: seq_num 914 ranges {0=516096,516096=401408} 2024-09-10T18:07:00.253 INFO:tasks.rados.rados.0.smithi012.stdout:2953: writing smithi01278544-21 from 0 to 516096 tid 1 2024-09-10T18:07:00.253 INFO:tasks.rados.rados.0.smithi012.stdout:2953: writing smithi01278544-21 from 516096 to 917504 tid 2 2024-09-10T18:07:00.253 INFO:tasks.rados.rados.0.smithi012.stdout:2954: read oid 34 snap -1 2024-09-10T18:07:00.253 INFO:tasks.rados.rados.0.smithi012.stdout:2954: expect (ObjNum 865 snap 282 seq_num 865) 2024-09-10T18:07:00.253 INFO:tasks.rados.rados.0.smithi012.stdout:2955: delete oid 50 current snap is 295 2024-09-10T18:07:00.253 INFO:tasks.rados.rados.0.smithi012.stdout:2955: done (6 left) 2024-09-10T18:07:00.254 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 295 2024-09-10T18:07:00.254 INFO:tasks.rados.rados.0.smithi012.stdout:2956: seq_num 916 ranges {1196032=548864,1744896=401408} 2024-09-10T18:07:00.263 INFO:tasks.rados.rados.0.smithi012.stdout:2956: writing smithi01278544-38 from 1196032 to 1744896 tid 1 2024-09-10T18:07:00.266 INFO:tasks.rados.rados.0.smithi012.stdout:2956: writing smithi01278544-38 from 1744896 to 2146304 tid 2 2024-09-10T18:07:00.266 INFO:tasks.rados.rados.0.smithi012.stdout:2954: expect (ObjNum 865 snap 282 seq_num 865) 2024-09-10T18:07:00.276 INFO:tasks.rados.rados.0.smithi012.stdout:2953: finishing write tid 1 to smithi01278544-21 2024-09-10T18:07:00.276 INFO:tasks.rados.rados.0.smithi012.stdout:2953: finishing write tid 2 to smithi01278544-21 2024-09-10T18:07:00.276 INFO:tasks.rados.rados.0.smithi012.stdout:2954: done (6 left) 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2957: copy_from oid 29 from oid 33 current snap is 295 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2953: finishing write tid 3 to smithi01278544-21 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2953: finishing write tid 4 to smithi01278544-21 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2953: oid 21 updating version 0 to 1217 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2953: oid 21 version 1217 is already newer than 1215 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2953: oid 21 version 1217 is already newer than 1216 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 1217 (ObjNum 914 snap 295 seq_num 914) dirty exists 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2953: left oid 21 (ObjNum 914 snap 295 seq_num 914) 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2953: done (6 left) 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2958: copy_from oid 8 from oid 40 current snap is 295 2024-09-10T18:07:00.277 INFO:tasks.rados.rados.0.smithi012.stdout:2959: snap_remove snap 294 2024-09-10T18:07:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:06:59 smithi012 ceph-mon[89611]: osdmap e677: 8 total, 8 up, 8 in 2024-09-10T18:07:00.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:06:59 smithi012 ceph-mon[92029]: osdmap e677: 8 total, 8 up, 8 in 2024-09-10T18:07:00.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:06:59 smithi089 ceph-mon[84132]: osdmap e677: 8 total, 8 up, 8 in 2024-09-10T18:07:00.813 INFO:tasks.rados.rados.0.smithi012.stdout:2959: done (7 left) 2024-09-10T18:07:00.814 INFO:tasks.rados.rados.0.smithi012.stdout:2960: copy_from oid 50 from oid 30 current snap is 295 2024-09-10T18:07:00.814 INFO:tasks.rados.rados.0.smithi012.stdout:2957: finishing copy_from to smithi01278544-29 2024-09-10T18:07:00.814 INFO:tasks.rados.rados.0.smithi012.stdout:2957: got expected ENOENT (src dne) 2024-09-10T18:07:00.814 INFO:tasks.rados.rados.0.smithi012.stdout:2957: finishing copy_from racing read to smithi01278544-29 2024-09-10T18:07:00.814 INFO:tasks.rados.rados.0.smithi012.stdout:2958: finishing copy_from racing read to smithi01278544-8 2024-09-10T18:07:00.814 INFO:tasks.rados.rados.0.smithi012.stdout:2958: finishing copy_from to smithi01278544-8 2024-09-10T18:07:00.814 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 2073 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:07:00.814 INFO:tasks.rados.rados.0.smithi012.stdout:2949: expect (ObjNum 849 snap 276 seq_num 849) 2024-09-10T18:07:01.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:00 smithi012 ceph-mon[92029]: pgmap v694: 121 pgs: 121 active+clean; 257 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 323 KiB/s wr, 10 op/s 2024-09-10T18:07:01.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:00 smithi012 ceph-mon[89611]: pgmap v694: 121 pgs: 121 active+clean; 257 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 323 KiB/s wr, 10 op/s 2024-09-10T18:07:01.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:00 smithi089 ceph-mon[84132]: pgmap v694: 121 pgs: 121 active+clean; 257 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 323 KiB/s wr, 10 op/s 2024-09-10T18:07:01.516 INFO:tasks.rados.rados.0.smithi012.stdout:2956: finishing write tid 1 to smithi01278544-38 2024-09-10T18:07:01.516 INFO:tasks.rados.rados.0.smithi012.stdout:2956: finishing write tid 2 to smithi01278544-38 2024-09-10T18:07:01.516 INFO:tasks.rados.rados.0.smithi012.stdout:2956: finishing write tid 3 to smithi01278544-38 2024-09-10T18:07:01.517 INFO:tasks.rados.rados.0.smithi012.stdout:2956: finishing write tid 4 to smithi01278544-38 2024-09-10T18:07:01.517 INFO:tasks.rados.rados.0.smithi012.stdout:2956: oid 38 updating version 0 to 1982 2024-09-10T18:07:01.517 INFO:tasks.rados.rados.0.smithi012.stdout:2956: oid 38 updating version 1982 to 1983 2024-09-10T18:07:01.517 INFO:tasks.rados.rados.0.smithi012.stdout:2956: oid 38 updating version 1983 to 1984 2024-09-10T18:07:01.517 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1984 (ObjNum 916 snap 295 seq_num 916) dirty exists 2024-09-10T18:07:01.517 INFO:tasks.rados.rados.0.smithi012.stdout:2956: left oid 38 (ObjNum 916 snap 295 seq_num 916) 2024-09-10T18:07:01.517 INFO:tasks.rados.rados.0.smithi012.stdout:2947: expect (ObjNum 864 snap 282 seq_num 864) 2024-09-10T18:07:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:01 smithi012 ceph-mon[89611]: osdmap e678: 8 total, 8 up, 8 in 2024-09-10T18:07:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:02.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:01 smithi012 ceph-mon[92029]: osdmap e678: 8 total, 8 up, 8 in 2024-09-10T18:07:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:02.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:01 smithi089 ceph-mon[84132]: osdmap e678: 8 total, 8 up, 8 in 2024-09-10T18:07:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:02.438 INFO:tasks.rados.rados.0.smithi012.stdout:2948: finishing rollback tid 0 to smithi01278544-41 2024-09-10T18:07:02.438 INFO:tasks.rados.rados.0.smithi012.stdout:2948: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:07:02.438 INFO:tasks.rados.rados.0.smithi012.stdout:2948: finishing rollback tid 2 to smithi01278544-41 2024-09-10T18:07:02.438 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 1600 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:07:02.438 INFO:tasks.rados.rados.0.smithi012.stdout:2952: finishing copy_from racing read to smithi01278544-13 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2952: finishing copy_from to smithi01278544-13 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 2127 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2960: finishing copy_from racing read to smithi01278544-50 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2960: finishing copy_from to smithi01278544-50 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 1609 (ObjNum 836 snap 270 seq_num 836) dirty exists 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2947: done (7 left) 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2948: done (6 left) 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2949: done (5 left) 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2952: done (4 left) 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2956: done (3 left) 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2957: done (2 left) 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2958: done (1 left) 2024-09-10T18:07:02.439 INFO:tasks.rados.rados.0.smithi012.stdout:2960: done (0 left) 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:2961: rmattr oid 4 current snap is 295 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:2962: rollback oid 13 current snap is 295 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 13 to 292 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:2963: copy_from oid 36 from oid 18 current snap is 295 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:2964: read oid 38 snap -1 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:2964: expect (ObjNum 916 snap 295 seq_num 916) 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:2965: setattr oid 42 current snap is 295 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 295 2024-09-10T18:07:02.440 INFO:tasks.rados.rados.0.smithi012.stdout:2966: seq_num 917 ranges {0=565248,565248=401408} 2024-09-10T18:07:02.443 INFO:tasks.rados.rados.0.smithi012.stdout:2966: writing smithi01278544-31 from 0 to 565248 tid 1 2024-09-10T18:07:02.446 INFO:tasks.rados.rados.0.smithi012.stdout:2966: writing smithi01278544-31 from 565248 to 966656 tid 2 2024-09-10T18:07:02.447 INFO:tasks.rados.rados.0.smithi012.stdout:2967: read oid 16 snap -1 2024-09-10T18:07:02.447 INFO:tasks.rados.rados.0.smithi012.stdout:2967: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:07:02.447 INFO:tasks.rados.rados.0.smithi012.stdout:2968: read oid 45 snap -1 2024-09-10T18:07:02.447 INFO:tasks.rados.rados.0.smithi012.stdout:2968: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:07:02.447 INFO:tasks.rados.rados.0.smithi012.stdout:2963: finishing copy_from racing read to smithi01278544-36 2024-09-10T18:07:02.448 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2135 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:07:02.448 INFO:tasks.rados.rados.0.smithi012.stdout:2965: done (7 left) 2024-09-10T18:07:02.448 INFO:tasks.rados.rados.0.smithi012.stdout:2969: rmattr oid 42 current snap is 295 2024-09-10T18:07:02.448 INFO:tasks.rados.rados.0.smithi012.stdout:2964: expect (ObjNum 916 snap 295 seq_num 916) 2024-09-10T18:07:02.551 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2128 (ObjNum 864 snap 282 seq_num 864) dirty exists 2024-09-10T18:07:02.551 INFO:tasks.rados.rados.0.smithi012.stdout:2962: finishing rollback tid 0 to smithi01278544-13 2024-09-10T18:07:02.551 INFO:tasks.rados.rados.0.smithi012.stdout:2963: finishing copy_from to smithi01278544-36 2024-09-10T18:07:02.551 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 1601 (ObjNum 912 snap 295 seq_num 912) dirty exists 2024-09-10T18:07:02.551 INFO:tasks.rados.rados.0.smithi012.stdout:2962: finishing rollback tid 1 to smithi01278544-13 2024-09-10T18:07:02.551 INFO:tasks.rados.rados.0.smithi012.stdout:2962: finishing rollback tid 2 to smithi01278544-13 2024-09-10T18:07:02.551 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 2131 (ObjNum 895 snap 292 seq_num 895) dirty exists 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2966: finishing write tid 1 to smithi01278544-31 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2966: finishing write tid 2 to smithi01278544-31 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2966: finishing write tid 3 to smithi01278544-31 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2966: finishing write tid 4 to smithi01278544-31 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2966: oid 31 updating version 0 to 2133 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2966: oid 31 updating version 2133 to 2134 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2966: oid 31 version 2134 is already newer than 2132 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2134 (ObjNum 917 snap 295 seq_num 917) dirty exists 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2966: left oid 31 (ObjNum 917 snap 295 seq_num 917) 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2961: done (7 left) 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2962: done (6 left) 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2963: done (5 left) 2024-09-10T18:07:02.552 INFO:tasks.rados.rados.0.smithi012.stdout:2964: done (4 left) 2024-09-10T18:07:02.553 INFO:tasks.rados.rados.0.smithi012.stdout:2966: done (3 left) 2024-09-10T18:07:02.553 INFO:tasks.rados.rados.0.smithi012.stdout:2970: read oid 24 snap 271 2024-09-10T18:07:02.553 INFO:tasks.rados.rados.0.smithi012.stdout:2970: expect (ObjNum -797884240 snap 22079 seq_num 3498123984) 2024-09-10T18:07:02.553 INFO:tasks.rados.rados.0.smithi012.stdout:2971: read oid 6 snap -1 2024-09-10T18:07:02.553 INFO:tasks.rados.rados.0.smithi012.stdout:2971: expect (ObjNum 908 snap 294 seq_num 908) 2024-09-10T18:07:02.553 INFO:tasks.rados.rados.0.smithi012.stdout:2972: rollback oid 3 current snap is 295 2024-09-10T18:07:02.553 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 3 to 271 2024-09-10T18:07:02.553 INFO:tasks.rados.rados.0.smithi012.stdout:2968: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:07:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:02 smithi012 ceph-mon[89611]: pgmap v696: 121 pgs: 121 active+clean; 272 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-09-10T18:07:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:02 smithi012 ceph-mon[89611]: osdmap e679: 8 total, 8 up, 8 in 2024-09-10T18:07:03.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:02 smithi012 ceph-mon[92029]: pgmap v696: 121 pgs: 121 active+clean; 272 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-09-10T18:07:03.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:02 smithi012 ceph-mon[92029]: osdmap e679: 8 total, 8 up, 8 in 2024-09-10T18:07:03.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:02 smithi089 ceph-mon[84132]: pgmap v696: 121 pgs: 121 active+clean; 272 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-09-10T18:07:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:02 smithi089 ceph-mon[84132]: osdmap e679: 8 total, 8 up, 8 in 2024-09-10T18:07:03.891 INFO:tasks.rados.rados.0.smithi012.stdout:2967: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:07:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:03 smithi012 ceph-mon[89611]: pgmap v698: 121 pgs: 121 active+clean; 293 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 7.0 MiB/s wr, 19 op/s 2024-09-10T18:07:04.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:03 smithi012 ceph-mon[92029]: pgmap v698: 121 pgs: 121 active+clean; 293 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 7.0 MiB/s wr, 19 op/s 2024-09-10T18:07:04.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:03 smithi089 ceph-mon[84132]: pgmap v698: 121 pgs: 121 active+clean; 293 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 7.0 MiB/s wr, 19 op/s 2024-09-10T18:07:04.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:07:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:07:04] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.51.0" 2024-09-10T18:07:05.227 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2136 (ObjNum 655 snap 214 seq_num 655) dirty exists 2024-09-10T18:07:05.228 INFO:tasks.rados.rados.0.smithi012.stdout:2970: expect (ObjNum -797884240 snap 22079 seq_num 3498123984) 2024-09-10T18:07:05.230 INFO:tasks.rados.rados.0.smithi012.stdout:2971: expect (ObjNum 908 snap 294 seq_num 908) 2024-09-10T18:07:05.252 INFO:tasks.rados.rados.0.smithi012.stdout:2972: finishing rollback tid 0 to smithi01278544-3 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2972: finishing rollback tid 1 to smithi01278544-3 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2972: finishing rollback tid 2 to smithi01278544-3 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 1618 (ObjNum 760 snap 248 seq_num 760) dirty exists 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2967: done (5 left) 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2968: done (4 left) 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2969: done (3 left) 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2970: done (2 left) 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2971: done (1 left) 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2972: done (0 left) 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2973: read oid 6 snap -1 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2973: expect (ObjNum 908 snap 294 seq_num 908) 2024-09-10T18:07:05.253 INFO:tasks.rados.rados.0.smithi012.stdout:2974: rollback oid 1 current snap is 295 2024-09-10T18:07:05.254 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 292 2024-09-10T18:07:05.254 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 8 current snap is 295 2024-09-10T18:07:05.254 INFO:tasks.rados.rados.0.smithi012.stdout:2975: seq_num 918 ranges {0=581632,581632=401408} 2024-09-10T18:07:05.256 INFO:tasks.rados.rados.0.smithi012.stdout:2975: writing smithi01278544-8 from 0 to 581632 tid 1 2024-09-10T18:07:05.258 INFO:tasks.rados.rados.0.smithi012.stdout:2975: writing smithi01278544-8 from 581632 to 983040 tid 2 2024-09-10T18:07:05.258 INFO:tasks.rados.rados.0.smithi012.stdout:2976: snap_remove snap 271 2024-09-10T18:07:06.161 INFO:tasks.rados.rados.0.smithi012.stdout:2973: expect (ObjNum 908 snap 294 seq_num 908) 2024-09-10T18:07:06.190 INFO:tasks.rados.rados.0.smithi012.stdout:2974: finishing rollback tid 0 to smithi01278544-1 2024-09-10T18:07:06.190 INFO:tasks.rados.rados.0.smithi012.stdout:2974: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:2974: finishing rollback tid 2 to smithi01278544-1 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1987 (ObjNum 849 snap 276 seq_num 849) dirty exists 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:2975: finishing write tid 1 to smithi01278544-8 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:2975: finishing write tid 2 to smithi01278544-8 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:2973: done (3 left) 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:2974: done (2 left) 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:2976: done (1 left) 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 295 2024-09-10T18:07:06.191 INFO:tasks.rados.rados.0.smithi012.stdout:2977: seq_num 919 ranges {1622016=598016,2220032=401408} 2024-09-10T18:07:06.202 INFO:tasks.rados.rados.0.smithi012.stdout:2977: writing smithi01278544-35 from 1622016 to 2220032 tid 1 2024-09-10T18:07:06.205 INFO:tasks.rados.rados.0.smithi012.stdout:2977: writing smithi01278544-35 from 2220032 to 2621440 tid 2 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2978: read oid 48 snap -1 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2978: expect (ObjNum 818 snap 266 seq_num 818) 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2979: read oid 45 snap -1 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2979: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2980: read oid 23 snap 292 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2980: expect deleted 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2981: read oid 24 snap 292 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2981: expect (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2982: read oid 26 snap -1 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2982: expect (ObjNum 911 snap 295 seq_num 911) 2024-09-10T18:07:06.206 INFO:tasks.rados.rados.0.smithi012.stdout:2983: read oid 19 snap -1 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2983: expect (ObjNum 892 snap 292 seq_num 892) 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2984: read oid 31 snap 292 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2984: expect (ObjNum -796930864 snap 22079 seq_num 3496655280) 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2985: read oid 40 snap -1 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2985: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2986: delete oid 37 current snap is 295 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2975: finishing write tid 3 to smithi01278544-8 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2975: finishing write tid 4 to smithi01278544-8 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2975: oid 8 updating version 0 to 2074 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2975: oid 8 updating version 2074 to 2076 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2975: oid 8 version 2076 is already newer than 2075 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 2076 (ObjNum 918 snap 295 seq_num 918) dirty exists 2024-09-10T18:07:06.207 INFO:tasks.rados.rados.0.smithi012.stdout:2975: left oid 8 (ObjNum 918 snap 295 seq_num 918) 2024-09-10T18:07:06.208 INFO:tasks.rados.rados.0.smithi012.stdout:2984: expect (ObjNum -796930864 snap 22079 seq_num 3496655280) 2024-09-10T18:07:06.208 INFO:tasks.rados.rados.0.smithi012.stdout:2977: finishing write tid 1 to smithi01278544-35 2024-09-10T18:07:06.209 INFO:tasks.rados.rados.0.smithi012.stdout:2977: finishing write tid 2 to smithi01278544-35 2024-09-10T18:07:06.211 INFO:tasks.rados.rados.0.smithi012.stdout:2977: finishing write tid 3 to smithi01278544-35 2024-09-10T18:07:06.211 INFO:tasks.rados.rados.0.smithi012.stdout:2977: finishing write tid 4 to smithi01278544-35 2024-09-10T18:07:06.211 INFO:tasks.rados.rados.0.smithi012.stdout:2977: oid 35 updating version 0 to 2021 2024-09-10T18:07:06.211 INFO:tasks.rados.rados.0.smithi012.stdout:2977: oid 35 version 2021 is already newer than 2020 2024-09-10T18:07:06.212 INFO:tasks.rados.rados.0.smithi012.stdout:2977: oid 35 version 2021 is already newer than 2019 2024-09-10T18:07:06.212 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2021 (ObjNum 919 snap 295 seq_num 919) dirty exists 2024-09-10T18:07:06.212 INFO:tasks.rados.rados.0.smithi012.stdout:2977: left oid 35 (ObjNum 919 snap 295 seq_num 919) 2024-09-10T18:07:06.212 INFO:tasks.rados.rados.0.smithi012.stdout:2975: done (10 left) 2024-09-10T18:07:06.213 INFO:tasks.rados.rados.0.smithi012.stdout:2977: done (9 left) 2024-09-10T18:07:06.213 INFO:tasks.rados.rados.0.smithi012.stdout:2984: done (8 left) 2024-09-10T18:07:06.213 INFO:tasks.rados.rados.0.smithi012.stdout:2986: done (7 left) 2024-09-10T18:07:06.213 INFO:tasks.rados.rados.0.smithi012.stdout:2987: snap_create 2024-09-10T18:07:06.221 INFO:tasks.rados.rados.0.smithi012.stdout:2983: expect (ObjNum 892 snap 292 seq_num 892) 2024-09-10T18:07:06.239 INFO:tasks.rados.rados.0.smithi012.stdout:2981: expect (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:07:06.304 INFO:tasks.rados.rados.0.smithi012.stdout:2978: expect (ObjNum 818 snap 266 seq_num 818) 2024-09-10T18:07:06.404 INFO:tasks.rados.rados.0.smithi012.stdout:2985: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:07:06.405 INFO:tasks.rados.rados.0.smithi012.stdout:2982: expect (ObjNum 911 snap 295 seq_num 911) 2024-09-10T18:07:06.457 INFO:tasks.rados.rados.0.smithi012.stdout:2979: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:07:06.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:06 smithi012 ceph-mon[89611]: pgmap v699: 121 pgs: 121 active+clean; 293 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 5.8 MiB/s wr, 16 op/s 2024-09-10T18:07:06.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:06 smithi012 ceph-mon[92029]: pgmap v699: 121 pgs: 121 active+clean; 293 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 5.8 MiB/s wr, 16 op/s 2024-09-10T18:07:06.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:06 smithi089 ceph-mon[84132]: pgmap v699: 121 pgs: 121 active+clean; 293 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 5.8 MiB/s wr, 16 op/s 2024-09-10T18:07:07.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:07 smithi012 ceph-mon[89611]: osdmap e680: 8 total, 8 up, 8 in 2024-09-10T18:07:07.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:07 smithi012 ceph-mon[92029]: osdmap e680: 8 total, 8 up, 8 in 2024-09-10T18:07:07.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:07 smithi089 ceph-mon[84132]: osdmap e680: 8 total, 8 up, 8 in 2024-09-10T18:07:07.796 INFO:tasks.rados.rados.0.smithi012.stdout:2978: done (7 left) 2024-09-10T18:07:07.797 INFO:tasks.rados.rados.0.smithi012.stdout:2979: done (6 left) 2024-09-10T18:07:07.797 INFO:tasks.rados.rados.0.smithi012.stdout:2980: done (5 left) 2024-09-10T18:07:07.797 INFO:tasks.rados.rados.0.smithi012.stdout:2981: done (4 left) 2024-09-10T18:07:07.797 INFO:tasks.rados.rados.0.smithi012.stdout:2982: done (3 left) 2024-09-10T18:07:07.797 INFO:tasks.rados.rados.0.smithi012.stdout:2983: done (2 left) 2024-09-10T18:07:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:2985: done (1 left) 2024-09-10T18:07:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:2987: done (0 left) 2024-09-10T18:07:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 296 2024-09-10T18:07:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:2988: seq_num 921 ranges {14311424=630784,14942208=401408} 2024-09-10T18:07:07.877 INFO:tasks.rados.rados.0.smithi012.stdout:2988: writing smithi01278544-45 from 14311424 to 14942208 tid 1 2024-09-10T18:07:07.881 INFO:tasks.rados.rados.0.smithi012.stdout:2988: writing smithi01278544-45 from 14942208 to 15343616 tid 2 2024-09-10T18:07:07.881 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 296 2024-09-10T18:07:07.881 INFO:tasks.rados.rados.0.smithi012.stdout:2989: seq_num 922 ranges {9994240=647168,10641408=401408} 2024-09-10T18:07:07.938 INFO:tasks.rados.rados.0.smithi012.stdout:2989: writing smithi01278544-1 from 9994240 to 10641408 tid 1 2024-09-10T18:07:07.941 INFO:tasks.rados.rados.0.smithi012.stdout:2989: writing smithi01278544-1 from 10641408 to 11042816 tid 2 2024-09-10T18:07:07.941 INFO:tasks.rados.rados.0.smithi012.stdout:2990: snap_remove snap 292 2024-09-10T18:07:08.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:08 smithi012 ceph-mon[89611]: pgmap v701: 121 pgs: 121 active+clean; 265 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 3.6 MiB/s wr, 27 op/s 2024-09-10T18:07:08.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:08 smithi012 ceph-mon[89611]: osdmap e681: 8 total, 8 up, 8 in 2024-09-10T18:07:08.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:08 smithi012 ceph-mon[89611]: osdmap e682: 8 total, 8 up, 8 in 2024-09-10T18:07:08.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:08 smithi012 ceph-mon[92029]: pgmap v701: 121 pgs: 121 active+clean; 265 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 3.6 MiB/s wr, 27 op/s 2024-09-10T18:07:08.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:08 smithi012 ceph-mon[92029]: osdmap e681: 8 total, 8 up, 8 in 2024-09-10T18:07:08.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:08 smithi012 ceph-mon[92029]: osdmap e682: 8 total, 8 up, 8 in 2024-09-10T18:07:08.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:08 smithi089 ceph-mon[84132]: pgmap v701: 121 pgs: 121 active+clean; 265 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 3.6 MiB/s wr, 27 op/s 2024-09-10T18:07:08.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:08 smithi089 ceph-mon[84132]: osdmap e681: 8 total, 8 up, 8 in 2024-09-10T18:07:08.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:08 smithi089 ceph-mon[84132]: osdmap e682: 8 total, 8 up, 8 in 2024-09-10T18:07:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2990: done (2 left) 2024-09-10T18:07:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2991: read oid 9 snap 295 2024-09-10T18:07:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2991: expect deleted 2024-09-10T18:07:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2992: rmattr oid 31 current snap is 296 2024-09-10T18:07:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2988: finishing write tid 1 to smithi01278544-45 2024-09-10T18:07:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2988: finishing write tid 2 to smithi01278544-45 2024-09-10T18:07:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2988: finishing write tid 3 to smithi01278544-45 2024-09-10T18:07:08.795 INFO:tasks.rados.rados.0.smithi012.stdout:2988: finishing write tid 4 to smithi01278544-45 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2988: oid 45 updating version 0 to 2147 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2988: oid 45 updating version 2147 to 2148 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2988: oid 45 version 2148 is already newer than 2146 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2148 (ObjNum 921 snap 296 seq_num 921) dirty exists 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2988: left oid 45 (ObjNum 921 snap 296 seq_num 921) 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2989: finishing write tid 1 to smithi01278544-1 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2989: finishing write tid 2 to smithi01278544-1 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2989: finishing write tid 3 to smithi01278544-1 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2989: finishing write tid 4 to smithi01278544-1 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2989: oid 1 updating version 0 to 1990 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2989: oid 1 version 1990 is already newer than 1988 2024-09-10T18:07:08.796 INFO:tasks.rados.rados.0.smithi012.stdout:2989: oid 1 version 1990 is already newer than 1989 2024-09-10T18:07:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 1990 (ObjNum 922 snap 296 seq_num 922) dirty exists 2024-09-10T18:07:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2989: left oid 1 (ObjNum 922 snap 296 seq_num 922) 2024-09-10T18:07:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2988: done (3 left) 2024-09-10T18:07:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2989: done (2 left) 2024-09-10T18:07:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2993: read oid 45 snap 295 2024-09-10T18:07:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2993: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:07:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 296 2024-09-10T18:07:08.797 INFO:tasks.rados.rados.0.smithi012.stdout:2994: seq_num 923 ranges {0=663552,663552=401408} 2024-09-10T18:07:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:2994: writing smithi01278544-17 from 0 to 663552 tid 1 2024-09-10T18:07:08.801 INFO:tasks.rados.rados.0.smithi012.stdout:2994: writing smithi01278544-17 from 663552 to 1064960 tid 2 2024-09-10T18:07:08.802 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 296 2024-09-10T18:07:08.802 INFO:tasks.rados.rados.0.smithi012.stdout:2995: seq_num 924 ranges {884736=679936,1564672=401408} 2024-09-10T18:07:08.812 INFO:tasks.rados.rados.0.smithi012.stdout:2995: writing smithi01278544-36 from 884736 to 1564672 tid 1 2024-09-10T18:07:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:2995: writing smithi01278544-36 from 1564672 to 1966080 tid 2 2024-09-10T18:07:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 296 2024-09-10T18:07:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:2996: seq_num 925 ranges {2768896=696320,3465216=401408} 2024-09-10T18:07:08.835 INFO:tasks.rados.rados.0.smithi012.stdout:2996: writing smithi01278544-22 from 2768896 to 3465216 tid 1 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2996: writing smithi01278544-22 from 3465216 to 3866624 tid 2 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2997: rollback oid 25 current snap is 296 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 25 to 295 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2136 (ObjNum 917 snap 295 seq_num 917) dirty exists 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2994: finishing write tid 1 to smithi01278544-17 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2994: finishing write tid 2 to smithi01278544-17 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2994: finishing write tid 3 to smithi01278544-17 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2991: done (6 left) 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2992: done (5 left) 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2998: rmattr oid 35 current snap is 296 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2998: done (5 left) 2024-09-10T18:07:08.839 INFO:tasks.rados.rados.0.smithi012.stdout:2999: setattr oid 46 current snap is 296 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2994: finishing write tid 4 to smithi01278544-17 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2994: oid 17 updating version 0 to 902 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2994: oid 17 version 902 is already newer than 901 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2994: oid 17 version 902 is already newer than 900 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 902 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2994: left oid 17 (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2995: finishing write tid 1 to smithi01278544-36 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2995: finishing write tid 2 to smithi01278544-36 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2995: finishing write tid 3 to smithi01278544-36 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2995: finishing write tid 4 to smithi01278544-36 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2995: oid 36 updating version 0 to 1604 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2995: oid 36 version 1604 is already newer than 1602 2024-09-10T18:07:08.840 INFO:tasks.rados.rados.0.smithi012.stdout:2995: oid 36 version 1604 is already newer than 1603 2024-09-10T18:07:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 1604 (ObjNum 924 snap 296 seq_num 924) dirty exists 2024-09-10T18:07:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2995: left oid 36 (ObjNum 924 snap 296 seq_num 924) 2024-09-10T18:07:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2994: done (5 left) 2024-09-10T18:07:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:2995: done (4 left) 2024-09-10T18:07:08.841 INFO:tasks.rados.rados.0.smithi012.stdout:3000: snap_create 2024-09-10T18:07:08.842 INFO:tasks.rados.rados.0.smithi012.stdout:2996: finishing write tid 1 to smithi01278544-22 2024-09-10T18:07:08.843 INFO:tasks.rados.rados.0.smithi012.stdout:2996: finishing write tid 2 to smithi01278544-22 2024-09-10T18:07:08.843 INFO:tasks.rados.rados.0.smithi012.stdout:2996: finishing write tid 3 to smithi01278544-22 2024-09-10T18:07:08.844 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1619 (ObjNum 891 snap 292 seq_num 891) dirty exists 2024-09-10T18:07:08.844 INFO:tasks.rados.rados.0.smithi012.stdout:2997: finishing rollback tid 1 to smithi01278544-25 2024-09-10T18:07:08.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 0 (ObjNum 385 snap 0 seq_num 3497386256) dirty dne 2024-09-10T18:07:08.849 INFO:tasks.rados.rados.0.smithi012.stdout:2996: finishing write tid 4 to smithi01278544-22 2024-09-10T18:07:08.849 INFO:tasks.rados.rados.0.smithi012.stdout:2996: oid 22 updating version 0 to 2173 2024-09-10T18:07:08.849 INFO:tasks.rados.rados.0.smithi012.stdout:2996: oid 22 updating version 2173 to 2174 2024-09-10T18:07:08.849 INFO:tasks.rados.rados.0.smithi012.stdout:2996: oid 22 version 2174 is already newer than 2172 2024-09-10T18:07:08.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2174 (ObjNum 925 snap 296 seq_num 925) dirty exists 2024-09-10T18:07:08.849 INFO:tasks.rados.rados.0.smithi012.stdout:2996: left oid 22 (ObjNum 925 snap 296 seq_num 925) 2024-09-10T18:07:08.867 INFO:tasks.rados.rados.0.smithi012.stdout:2993: expect (ObjNum 856 snap 278 seq_num 856) 2024-09-10T18:07:10.208 INFO:tasks.rados.rados.0.smithi012.stdout:2993: done (4 left) 2024-09-10T18:07:10.208 INFO:tasks.rados.rados.0.smithi012.stdout:2996: done (3 left) 2024-09-10T18:07:10.208 INFO:tasks.rados.rados.0.smithi012.stdout:2997: done (2 left) 2024-09-10T18:07:10.208 INFO:tasks.rados.rados.0.smithi012.stdout:2999: done (1 left) 2024-09-10T18:07:10.208 INFO:tasks.rados.rados.0.smithi012.stdout:3000: done (0 left) 2024-09-10T18:07:10.208 INFO:tasks.rados.rados.0.smithi012.stdout:3001: delete oid 42 current snap is 297 2024-09-10T18:07:10.214 INFO:tasks.rados.rados.0.smithi012.stdout:3001: done (0 left) 2024-09-10T18:07:10.214 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 297 2024-09-10T18:07:10.214 INFO:tasks.rados.rados.0.smithi012.stdout:3002: seq_num 927 ranges {1441792=729088,2170880=401408} 2024-09-10T18:07:10.226 INFO:tasks.rados.rados.0.smithi012.stdout:3002: writing smithi01278544-26 from 1441792 to 2170880 tid 1 2024-09-10T18:07:10.228 INFO:tasks.rados.rados.0.smithi012.stdout:3002: writing smithi01278544-26 from 2170880 to 2572288 tid 2 2024-09-10T18:07:10.228 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 297 2024-09-10T18:07:10.228 INFO:tasks.rados.rados.0.smithi012.stdout:3003: seq_num 928 ranges {0=745472,745472=401408} 2024-09-10T18:07:10.233 INFO:tasks.rados.rados.0.smithi012.stdout:3003: writing smithi01278544-42 from 0 to 745472 tid 1 2024-09-10T18:07:10.235 INFO:tasks.rados.rados.0.smithi012.stdout:3003: writing smithi01278544-42 from 745472 to 1146880 tid 2 2024-09-10T18:07:10.235 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 297 2024-09-10T18:07:10.235 INFO:tasks.rados.rados.0.smithi012.stdout:3002: finishing write tid 1 to smithi01278544-26 2024-09-10T18:07:10.235 INFO:tasks.rados.rados.0.smithi012.stdout:3004: seq_num 929 ranges {3866624=761856,4628480=401408} 2024-09-10T18:07:10.260 INFO:tasks.rados.rados.0.smithi012.stdout:3004: writing smithi01278544-22 from 3866624 to 4628480 tid 1 2024-09-10T18:07:10.263 INFO:tasks.rados.rados.0.smithi012.stdout:3004: writing smithi01278544-22 from 4628480 to 5029888 tid 2 2024-09-10T18:07:10.263 INFO:tasks.rados.rados.0.smithi012.stdout:3005: delete oid 44 current snap is 297 2024-09-10T18:07:10.263 INFO:tasks.rados.rados.0.smithi012.stdout:3002: finishing write tid 2 to smithi01278544-26 2024-09-10T18:07:10.263 INFO:tasks.rados.rados.0.smithi012.stdout:3003: finishing write tid 1 to smithi01278544-42 2024-09-10T18:07:10.263 INFO:tasks.rados.rados.0.smithi012.stdout:3002: finishing write tid 3 to smithi01278544-26 2024-09-10T18:07:10.263 INFO:tasks.rados.rados.0.smithi012.stdout:3003: finishing write tid 2 to smithi01278544-42 2024-09-10T18:07:10.263 INFO:tasks.rados.rados.0.smithi012.stdout:3003: finishing write tid 3 to smithi01278544-42 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3002: finishing write tid 4 to smithi01278544-26 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3002: oid 26 updating version 0 to 1605 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3002: oid 26 updating version 1605 to 1607 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3002: oid 26 version 1607 is already newer than 1606 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 1607 (ObjNum 927 snap 297 seq_num 927) dirty exists 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3002: left oid 26 (ObjNum 927 snap 297 seq_num 927) 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3003: finishing write tid 4 to smithi01278544-42 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3003: oid 42 updating version 0 to 2159 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3003: oid 42 version 2159 is already newer than 2158 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3003: oid 42 version 2159 is already newer than 2157 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2159 (ObjNum 928 snap 297 seq_num 928) dirty exists 2024-09-10T18:07:10.264 INFO:tasks.rados.rados.0.smithi012.stdout:3003: left oid 42 (ObjNum 928 snap 297 seq_num 928) 2024-09-10T18:07:10.266 INFO:tasks.rados.rados.0.smithi012.stdout:3002: done (3 left) 2024-09-10T18:07:10.266 INFO:tasks.rados.rados.0.smithi012.stdout:3003: done (2 left) 2024-09-10T18:07:10.266 INFO:tasks.rados.rados.0.smithi012.stdout:3005: done (1 left) 2024-09-10T18:07:10.266 INFO:tasks.rados.rados.0.smithi012.stdout:3006: read oid 18 snap -1 2024-09-10T18:07:10.266 INFO:tasks.rados.rados.0.smithi012.stdout:3006: expect (ObjNum 912 snap 295 seq_num 912) 2024-09-10T18:07:10.266 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 297 2024-09-10T18:07:10.267 INFO:tasks.rados.rados.0.smithi012.stdout:3007: seq_num 931 ranges {532480=802816,1335296=401408} 2024-09-10T18:07:10.277 INFO:tasks.rados.rados.0.smithi012.stdout:3007: writing smithi01278544-46 from 532480 to 1335296 tid 1 2024-09-10T18:07:10.277 INFO:tasks.rados.rados.0.smithi012.stdout:3007: writing smithi01278544-46 from 1335296 to 1736704 tid 2 2024-09-10T18:07:10.277 INFO:tasks.rados.rados.0.smithi012.stdout:3008: read oid 29 snap -1 2024-09-10T18:07:10.277 INFO:tasks.rados.rados.0.smithi012.stdout:3008: expect (ObjNum 906 snap 294 seq_num 906) 2024-09-10T18:07:10.277 INFO:tasks.rados.rados.0.smithi012.stdout:3009: read oid 34 snap -1 2024-09-10T18:07:10.277 INFO:tasks.rados.rados.0.smithi012.stdout:3009: expect (ObjNum 865 snap 282 seq_num 865) 2024-09-10T18:07:10.277 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 297 2024-09-10T18:07:10.277 INFO:tasks.rados.rados.0.smithi012.stdout:3010: seq_num 932 ranges {2146304=417792,2564096=663552,3227648=139264} 2024-09-10T18:07:10.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:09 smithi012 ceph-mon[89611]: osdmap e683: 8 total, 8 up, 8 in 2024-09-10T18:07:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:09 smithi012 ceph-mon[92029]: osdmap e683: 8 total, 8 up, 8 in 2024-09-10T18:07:10.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:09 smithi089 ceph-mon[84132]: osdmap e683: 8 total, 8 up, 8 in 2024-09-10T18:07:10.290 INFO:tasks.rados.rados.0.smithi012.stdout:3010: writing smithi01278544-38 from 2146304 to 2564096 tid 1 2024-09-10T18:07:10.293 INFO:tasks.rados.rados.0.smithi012.stdout:3010: writing smithi01278544-38 from 2564096 to 3227648 tid 2 2024-09-10T18:07:10.295 INFO:tasks.rados.rados.0.smithi012.stdout:3010: writing smithi01278544-38 from 3227648 to 3366912 tid 3 2024-09-10T18:07:10.295 INFO:tasks.rados.rados.0.smithi012.stdout:3011: snap_create 2024-09-10T18:07:10.295 INFO:tasks.rados.rados.0.smithi012.stdout:3004: finishing write tid 1 to smithi01278544-22 2024-09-10T18:07:10.295 INFO:tasks.rados.rados.0.smithi012.stdout:3004: finishing write tid 2 to smithi01278544-22 2024-09-10T18:07:10.295 INFO:tasks.rados.rados.0.smithi012.stdout:3004: finishing write tid 3 to smithi01278544-22 2024-09-10T18:07:10.295 INFO:tasks.rados.rados.0.smithi012.stdout:3006: expect (ObjNum 912 snap 295 seq_num 912) 2024-09-10T18:07:10.318 INFO:tasks.rados.rados.0.smithi012.stdout:3004: finishing write tid 4 to smithi01278544-22 2024-09-10T18:07:10.318 INFO:tasks.rados.rados.0.smithi012.stdout:3004: oid 22 updating version 0 to 2177 2024-09-10T18:07:10.319 INFO:tasks.rados.rados.0.smithi012.stdout:3004: oid 22 updating version 2177 to 2178 2024-09-10T18:07:10.319 INFO:tasks.rados.rados.0.smithi012.stdout:3004: oid 22 version 2178 is already newer than 2176 2024-09-10T18:07:10.319 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2178 (ObjNum 929 snap 297 seq_num 929) dirty exists 2024-09-10T18:07:10.319 INFO:tasks.rados.rados.0.smithi012.stdout:3004: left oid 22 (ObjNum 929 snap 297 seq_num 929) 2024-09-10T18:07:10.319 INFO:tasks.rados.rados.0.smithi012.stdout:3009: expect (ObjNum 865 snap 282 seq_num 865) 2024-09-10T18:07:10.323 INFO:tasks.rados.rados.0.smithi012.stdout:3007: finishing write tid 1 to smithi01278544-46 2024-09-10T18:07:10.324 INFO:tasks.rados.rados.0.smithi012.stdout:3007: finishing write tid 2 to smithi01278544-46 2024-09-10T18:07:10.324 INFO:tasks.rados.rados.0.smithi012.stdout:3007: finishing write tid 3 to smithi01278544-46 2024-09-10T18:07:10.324 INFO:tasks.rados.rados.0.smithi012.stdout:3008: expect (ObjNum 906 snap 294 seq_num 906) 2024-09-10T18:07:10.371 INFO:tasks.rados.rados.0.smithi012.stdout:3007: finishing write tid 4 to smithi01278544-46 2024-09-10T18:07:10.371 INFO:tasks.rados.rados.0.smithi012.stdout:3007: oid 46 updating version 0 to 1620 2024-09-10T18:07:10.371 INFO:tasks.rados.rados.0.smithi012.stdout:3007: oid 46 updating version 1620 to 1621 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3007: oid 46 updating version 1621 to 1622 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1622 (ObjNum 931 snap 297 seq_num 931) dirty exists 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3007: left oid 46 (ObjNum 931 snap 297 seq_num 931) 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: finishing write tid 1 to smithi01278544-38 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: finishing write tid 2 to smithi01278544-38 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: finishing write tid 3 to smithi01278544-38 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: finishing write tid 4 to smithi01278544-38 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: finishing write tid 5 to smithi01278544-38 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: oid 38 updating version 0 to 1994 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: oid 38 version 1994 is already newer than 1991 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: oid 38 version 1994 is already newer than 1992 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: oid 38 version 1994 is already newer than 1993 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1994 (ObjNum 932 snap 297 seq_num 932) dirty exists 2024-09-10T18:07:10.372 INFO:tasks.rados.rados.0.smithi012.stdout:3010: left oid 38 (ObjNum 932 snap 297 seq_num 932) 2024-09-10T18:07:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:3004: done (6 left) 2024-09-10T18:07:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:3006: done (5 left) 2024-09-10T18:07:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:3007: done (4 left) 2024-09-10T18:07:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:3008: done (3 left) 2024-09-10T18:07:10.807 INFO:tasks.rados.rados.0.smithi012.stdout:3009: done (2 left) 2024-09-10T18:07:10.808 INFO:tasks.rados.rados.0.smithi012.stdout:3010: done (1 left) 2024-09-10T18:07:10.808 INFO:tasks.rados.rados.0.smithi012.stdout:3011: done (0 left) 2024-09-10T18:07:10.808 INFO:tasks.rados.rados.0.smithi012.stdout:3012: snap_remove snap 295 2024-09-10T18:07:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:10 smithi012 ceph-mon[89611]: pgmap v705: 121 pgs: 121 active+clean; 246 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 976 KiB/s wr, 27 op/s 2024-09-10T18:07:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:10 smithi012 ceph-mon[89611]: osdmap e684: 8 total, 8 up, 8 in 2024-09-10T18:07:11.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:10 smithi012 ceph-mon[92029]: pgmap v705: 121 pgs: 121 active+clean; 246 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 976 KiB/s wr, 27 op/s 2024-09-10T18:07:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:10 smithi012 ceph-mon[92029]: osdmap e684: 8 total, 8 up, 8 in 2024-09-10T18:07:11.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:10 smithi089 ceph-mon[84132]: pgmap v705: 121 pgs: 121 active+clean; 246 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 976 KiB/s wr, 27 op/s 2024-09-10T18:07:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:10 smithi089 ceph-mon[84132]: osdmap e684: 8 total, 8 up, 8 in 2024-09-10T18:07:11.815 INFO:tasks.rados.rados.0.smithi012.stdout:3012: done (0 left) 2024-09-10T18:07:11.815 INFO:tasks.rados.rados.0.smithi012.stdout:3013: copy_from oid 49 from oid 17 current snap is 298 2024-09-10T18:07:11.815 INFO:tasks.rados.rados.0.smithi012.stdout:3014: snap_remove snap 296 2024-09-10T18:07:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:11 smithi012 ceph-mon[89611]: osdmap e685: 8 total, 8 up, 8 in 2024-09-10T18:07:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:11 smithi012 ceph-mon[92029]: osdmap e685: 8 total, 8 up, 8 in 2024-09-10T18:07:12.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:11 smithi089 ceph-mon[84132]: osdmap e685: 8 total, 8 up, 8 in 2024-09-10T18:07:12.821 INFO:tasks.rados.rados.0.smithi012.stdout:3014: done (1 left) 2024-09-10T18:07:12.821 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 298 2024-09-10T18:07:12.821 INFO:tasks.rados.rados.0.smithi012.stdout:3013: finishing copy_from racing read to smithi01278544-49 2024-09-10T18:07:12.822 INFO:tasks.rados.rados.0.smithi012.stdout:3013: finishing copy_from to smithi01278544-49 2024-09-10T18:07:12.822 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 902 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:07:12.822 INFO:tasks.rados.rados.0.smithi012.stdout:3015: seq_num 933 ranges {1458176=434176,1892352=548864,2441216=253952} 2024-09-10T18:07:12.832 INFO:tasks.rados.rados.0.smithi012.stdout:3015: writing smithi01278544-28 from 1458176 to 1892352 tid 1 2024-09-10T18:07:12.836 INFO:tasks.rados.rados.0.smithi012.stdout:3015: writing smithi01278544-28 from 1892352 to 2441216 tid 2 2024-09-10T18:07:12.838 INFO:tasks.rados.rados.0.smithi012.stdout:3015: writing smithi01278544-28 from 2441216 to 2695168 tid 3 2024-09-10T18:07:12.838 INFO:tasks.rados.rados.0.smithi012.stdout:3013: done (1 left) 2024-09-10T18:07:12.838 INFO:tasks.rados.rados.0.smithi012.stdout:3016: snap_remove snap 297 2024-09-10T18:07:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:12 smithi012 ceph-mon[89611]: pgmap v708: 121 pgs: 121 active+clean; 221 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.8 MiB/s rd, 774 KiB/s wr, 9 op/s 2024-09-10T18:07:13.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:12 smithi012 ceph-mon[89611]: osdmap e686: 8 total, 8 up, 8 in 2024-09-10T18:07:13.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:12 smithi012 ceph-mon[92029]: pgmap v708: 121 pgs: 121 active+clean; 221 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.8 MiB/s rd, 774 KiB/s wr, 9 op/s 2024-09-10T18:07:13.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:12 smithi012 ceph-mon[92029]: osdmap e686: 8 total, 8 up, 8 in 2024-09-10T18:07:13.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:12 smithi089 ceph-mon[84132]: pgmap v708: 121 pgs: 121 active+clean; 221 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 4.8 MiB/s rd, 774 KiB/s wr, 9 op/s 2024-09-10T18:07:13.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:12 smithi089 ceph-mon[84132]: osdmap e686: 8 total, 8 up, 8 in 2024-09-10T18:07:13.833 INFO:tasks.rados.rados.0.smithi012.stdout:3015: finishing write tid 1 to smithi01278544-28 2024-09-10T18:07:13.833 INFO:tasks.rados.rados.0.smithi012.stdout:3015: finishing write tid 2 to smithi01278544-28 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: finishing write tid 3 to smithi01278544-28 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: finishing write tid 4 to smithi01278544-28 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: finishing write tid 5 to smithi01278544-28 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: oid 28 updating version 0 to 1311 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: oid 28 updating version 1311 to 1314 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: oid 28 version 1314 is already newer than 1312 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: oid 28 version 1314 is already newer than 1313 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1314 (ObjNum 933 snap 298 seq_num 933) dirty exists 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: left oid 28 (ObjNum 933 snap 298 seq_num 933) 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3015: done (1 left) 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3016: done (0 left) 2024-09-10T18:07:13.834 INFO:tasks.rados.rados.0.smithi012.stdout:3017: delete oid 18 current snap is 298 2024-09-10T18:07:13.839 INFO:tasks.rados.rados.0.smithi012.stdout:3017: done (0 left) 2024-09-10T18:07:13.839 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 298 2024-09-10T18:07:13.839 INFO:tasks.rados.rados.0.smithi012.stdout:3018: seq_num 935 ranges {10674176=466944,11141120=720896,11862016=81920} 2024-09-10T18:07:13.900 INFO:tasks.rados.rados.0.smithi012.stdout:3018: writing smithi01278544-4 from 10674176 to 11141120 tid 1 2024-09-10T18:07:13.904 INFO:tasks.rados.rados.0.smithi012.stdout:3018: writing smithi01278544-4 from 11141120 to 11862016 tid 2 2024-09-10T18:07:13.904 INFO:tasks.rados.rados.0.smithi012.stdout:3018: writing smithi01278544-4 from 11862016 to 11943936 tid 3 2024-09-10T18:07:13.904 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 298 2024-09-10T18:07:13.904 INFO:tasks.rados.rados.0.smithi012.stdout:3018: finishing write tid 1 to smithi01278544-4 2024-09-10T18:07:13.905 INFO:tasks.rados.rados.0.smithi012.stdout:3019: seq_num 936 ranges {0=483328,483328=655360,1138688=147456} 2024-09-10T18:07:13.907 INFO:tasks.rados.rados.0.smithi012.stdout:3019: writing smithi01278544-40 from 0 to 483328 tid 1 2024-09-10T18:07:13.911 INFO:tasks.rados.rados.0.smithi012.stdout:3019: writing smithi01278544-40 from 483328 to 1138688 tid 2 2024-09-10T18:07:13.913 INFO:tasks.rados.rados.0.smithi012.stdout:3019: writing smithi01278544-40 from 1138688 to 1286144 tid 3 2024-09-10T18:07:13.913 INFO:tasks.rados.rados.0.smithi012.stdout:3020: copy_from oid 33 from oid 22 current snap is 298 2024-09-10T18:07:13.913 INFO:tasks.rados.rados.0.smithi012.stdout:3018: finishing write tid 2 to smithi01278544-4 2024-09-10T18:07:13.913 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 298 2024-09-10T18:07:13.913 INFO:tasks.rados.rados.0.smithi012.stdout:3021: seq_num 937 ranges {2572288=499712,3072000=532480,3604480=270336} 2024-09-10T18:07:13.930 INFO:tasks.rados.rados.0.smithi012.stdout:3021: writing smithi01278544-26 from 2572288 to 3072000 tid 1 2024-09-10T18:07:13.933 INFO:tasks.rados.rados.0.smithi012.stdout:3021: writing smithi01278544-26 from 3072000 to 3604480 tid 2 2024-09-10T18:07:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:3021: writing smithi01278544-26 from 3604480 to 3874816 tid 3 2024-09-10T18:07:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:3022: copy_from oid 43 from oid 49 current snap is 298 2024-09-10T18:07:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:3018: finishing write tid 3 to smithi01278544-4 2024-09-10T18:07:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:3018: finishing write tid 4 to smithi01278544-4 2024-09-10T18:07:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:3018: finishing write tid 5 to smithi01278544-4 2024-09-10T18:07:13.937 INFO:tasks.rados.rados.0.smithi012.stdout:3018: oid 4 updating version 0 to 2140 2024-09-10T18:07:13.938 INFO:tasks.rados.rados.0.smithi012.stdout:3018: oid 4 version 2140 is already newer than 2137 2024-09-10T18:07:13.938 INFO:tasks.rados.rados.0.smithi012.stdout:3018: oid 4 version 2140 is already newer than 2139 2024-09-10T18:07:13.938 INFO:tasks.rados.rados.0.smithi012.stdout:3018: oid 4 version 2140 is already newer than 2138 2024-09-10T18:07:13.938 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2140 (ObjNum 935 snap 298 seq_num 935) dirty exists 2024-09-10T18:07:13.938 INFO:tasks.rados.rados.0.smithi012.stdout:3018: left oid 4 (ObjNum 935 snap 298 seq_num 935) 2024-09-10T18:07:13.938 INFO:tasks.rados.rados.0.smithi012.stdout:3019: finishing write tid 1 to smithi01278544-40 2024-09-10T18:07:13.938 INFO:tasks.rados.rados.0.smithi012.stdout:3019: finishing write tid 2 to smithi01278544-40 2024-09-10T18:07:13.938 INFO:tasks.rados.rados.0.smithi012.stdout:3019: finishing write tid 3 to smithi01278544-40 2024-09-10T18:07:13.939 INFO:tasks.rados.rados.0.smithi012.stdout:3019: finishing write tid 4 to smithi01278544-40 2024-09-10T18:07:13.939 INFO:tasks.rados.rados.0.smithi012.stdout:3019: finishing write tid 5 to smithi01278544-40 2024-09-10T18:07:13.939 INFO:tasks.rados.rados.0.smithi012.stdout:3019: oid 40 updating version 0 to 2168 2024-09-10T18:07:13.940 INFO:tasks.rados.rados.0.smithi012.stdout:3019: oid 40 updating version 2168 to 2169 2024-09-10T18:07:13.940 INFO:tasks.rados.rados.0.smithi012.stdout:3019: oid 40 version 2169 is already newer than 2166 2024-09-10T18:07:13.940 INFO:tasks.rados.rados.0.smithi012.stdout:3019: oid 40 version 2169 is already newer than 2167 2024-09-10T18:07:13.940 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2169 (ObjNum 936 snap 298 seq_num 936) dirty exists 2024-09-10T18:07:13.940 INFO:tasks.rados.rados.0.smithi012.stdout:3019: left oid 40 (ObjNum 936 snap 298 seq_num 936) 2024-09-10T18:07:13.940 INFO:tasks.rados.rados.0.smithi012.stdout:3018: done (4 left) 2024-09-10T18:07:13.940 INFO:tasks.rados.rados.0.smithi012.stdout:3019: done (3 left) 2024-09-10T18:07:13.940 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 30 current snap is 298 2024-09-10T18:07:13.941 INFO:tasks.rados.rados.0.smithi012.stdout:3023: seq_num 938 ranges {14475264=516096,14991360=417792,15409152=385024} 2024-09-10T18:07:14.017 INFO:tasks.rados.rados.0.smithi012.stdout:3023: writing smithi01278544-30 from 14475264 to 14991360 tid 1 2024-09-10T18:07:14.019 INFO:tasks.rados.rados.0.smithi012.stdout:3023: writing smithi01278544-30 from 14991360 to 15409152 tid 2 2024-09-10T18:07:14.024 INFO:tasks.rados.rados.0.smithi012.stdout:3023: writing smithi01278544-30 from 15409152 to 15794176 tid 3 2024-09-10T18:07:14.024 INFO:tasks.rados.rados.0.smithi012.stdout:3024: read oid 32 snap -1 2024-09-10T18:07:14.024 INFO:tasks.rados.rados.0.smithi012.stdout:3024: expect (ObjNum 903 snap 294 seq_num 903) 2024-09-10T18:07:14.024 INFO:tasks.rados.rados.0.smithi012.stdout:3025: copy_from oid 23 from oid 39 current snap is 298 2024-09-10T18:07:14.024 INFO:tasks.rados.rados.0.smithi012.stdout:3021: finishing write tid 1 to smithi01278544-26 2024-09-10T18:07:14.024 INFO:tasks.rados.rados.0.smithi012.stdout:3021: finishing write tid 2 to smithi01278544-26 2024-09-10T18:07:14.024 INFO:tasks.rados.rados.0.smithi012.stdout:3021: finishing write tid 3 to smithi01278544-26 2024-09-10T18:07:14.024 INFO:tasks.rados.rados.0.smithi012.stdout:3021: finishing write tid 4 to smithi01278544-26 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3021: finishing write tid 5 to smithi01278544-26 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3021: oid 26 updating version 0 to 1610 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3021: oid 26 updating version 1610 to 1611 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3021: oid 26 version 1611 is already newer than 1609 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3021: oid 26 version 1611 is already newer than 1608 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 1611 (ObjNum 937 snap 298 seq_num 937) dirty exists 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3021: left oid 26 (ObjNum 937 snap 298 seq_num 937) 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3020: finishing copy_from racing read to smithi01278544-33 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3020: finishing copy_from to smithi01278544-33 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 2178 (ObjNum 929 snap 297 seq_num 929) dirty exists 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3022: finishing copy_from racing read to smithi01278544-43 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:3022: finishing copy_from to smithi01278544-43 2024-09-10T18:07:14.025 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 902 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3023: finishing write tid 1 to smithi01278544-30 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3020: done (5 left) 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3021: done (4 left) 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3022: done (3 left) 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3026: copy_from oid 11 from oid 20 current snap is 298 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3027: setattr oid 18 current snap is 298 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3025: finishing copy_from to smithi01278544-23 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3025: got expected ENOENT (src dne) 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3025: finishing copy_from racing read to smithi01278544-23 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3025: done (4 left) 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 298 2024-09-10T18:07:14.026 INFO:tasks.rados.rados.0.smithi012.stdout:3028: seq_num 939 ranges {90112=532480,622592=704512,1327104=98304} 2024-09-10T18:07:14.027 INFO:tasks.rados.rados.0.smithi012.stdout:3028: writing smithi01278544-34 from 90112 to 622592 tid 1 2024-09-10T18:07:14.031 INFO:tasks.rados.rados.0.smithi012.stdout:3028: writing smithi01278544-34 from 622592 to 1327104 tid 2 2024-09-10T18:07:14.032 INFO:tasks.rados.rados.0.smithi012.stdout:3028: writing smithi01278544-34 from 1327104 to 1425408 tid 3 2024-09-10T18:07:14.032 INFO:tasks.rados.rados.0.smithi012.stdout:3029: rmattr oid 37 current snap is 298 2024-09-10T18:07:14.032 INFO:tasks.rados.rados.0.smithi012.stdout:3029: done (5 left) 2024-09-10T18:07:14.032 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 298 2024-09-10T18:07:14.032 INFO:tasks.rados.rados.0.smithi012.stdout:3023: finishing write tid 2 to smithi01278544-30 2024-09-10T18:07:14.032 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 1603 (ObjNum 65 snap 0 seq_num 3496232416) dirty exists 2024-09-10T18:07:14.032 INFO:tasks.rados.rados.0.smithi012.stdout:3030: seq_num 940 ranges {0=548864,548864=589824,1138688=212992} 2024-09-10T18:07:14.035 INFO:tasks.rados.rados.0.smithi012.stdout:3030: writing smithi01278544-44 from 0 to 548864 tid 1 2024-09-10T18:07:14.039 INFO:tasks.rados.rados.0.smithi012.stdout:3030: writing smithi01278544-44 from 548864 to 1138688 tid 2 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3030: writing smithi01278544-44 from 1138688 to 1351680 tid 3 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3027: done (5 left) 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3031: rollback oid 41 current snap is 298 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3031: done (5 left) 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3032: delete oid 3 current snap is 298 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3023: finishing write tid 3 to smithi01278544-30 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3023: finishing write tid 4 to smithi01278544-30 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3028: finishing write tid 1 to smithi01278544-34 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3028: finishing write tid 2 to smithi01278544-34 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3028: finishing write tid 3 to smithi01278544-34 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3028: finishing write tid 4 to smithi01278544-34 2024-09-10T18:07:14.041 INFO:tasks.rados.rados.0.smithi012.stdout:3028: finishing write tid 5 to smithi01278544-34 2024-09-10T18:07:14.042 INFO:tasks.rados.rados.0.smithi012.stdout:3028: oid 34 updating version 0 to 1222 2024-09-10T18:07:14.042 INFO:tasks.rados.rados.0.smithi012.stdout:3028: oid 34 updating version 1222 to 1223 2024-09-10T18:07:14.042 INFO:tasks.rados.rados.0.smithi012.stdout:3028: oid 34 version 1223 is already newer than 1220 2024-09-10T18:07:14.042 INFO:tasks.rados.rados.0.smithi012.stdout:3028: oid 34 version 1223 is already newer than 1221 2024-09-10T18:07:14.042 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1223 (ObjNum 939 snap 298 seq_num 939) dirty exists 2024-09-10T18:07:14.042 INFO:tasks.rados.rados.0.smithi012.stdout:3028: left oid 34 (ObjNum 939 snap 298 seq_num 939) 2024-09-10T18:07:14.042 INFO:tasks.rados.rados.0.smithi012.stdout:3026: finishing copy_from racing read to smithi01278544-11 2024-09-10T18:07:14.042 INFO:tasks.rados.rados.0.smithi012.stdout:3030: finishing write tid 1 to smithi01278544-44 2024-09-10T18:07:14.046 INFO:tasks.rados.rados.0.smithi012.stdout:3024: expect (ObjNum 903 snap 294 seq_num 903) 2024-09-10T18:07:14.216 INFO:tasks.rados.rados.0.smithi012.stdout:3023: finishing write tid 5 to smithi01278544-30 2024-09-10T18:07:14.216 INFO:tasks.rados.rados.0.smithi012.stdout:3023: oid 30 updating version 0 to 2025 2024-09-10T18:07:14.216 INFO:tasks.rados.rados.0.smithi012.stdout:3023: oid 30 version 2025 is already newer than 2024 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3023: oid 30 version 2025 is already newer than 2023 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3023: oid 30 version 2025 is already newer than 2022 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2025 (ObjNum 938 snap 298 seq_num 938) dirty exists 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3023: left oid 30 (ObjNum 938 snap 298 seq_num 938) 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3026: finishing copy_from to smithi01278544-11 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2063 (ObjNum 850 snap 277 seq_num 850) dirty exists 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3030: finishing write tid 2 to smithi01278544-44 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3023: done (5 left) 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3024: done (4 left) 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3026: done (3 left) 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3028: done (2 left) 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3032: done (1 left) 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 298 2024-09-10T18:07:14.217 INFO:tasks.rados.rados.0.smithi012.stdout:3030: finishing write tid 3 to smithi01278544-44 2024-09-10T18:07:14.218 INFO:tasks.rados.rados.0.smithi012.stdout:3033: seq_num 942 ranges {507904=581632,1089536=761856,1851392=40960} 2024-09-10T18:07:14.221 INFO:tasks.rados.rados.0.smithi012.stdout:3033: writing smithi01278544-10 from 507904 to 1089536 tid 1 2024-09-10T18:07:14.225 INFO:tasks.rados.rados.0.smithi012.stdout:3033: writing smithi01278544-10 from 1089536 to 1851392 tid 2 2024-09-10T18:07:14.226 INFO:tasks.rados.rados.0.smithi012.stdout:3033: writing smithi01278544-10 from 1851392 to 1892352 tid 3 2024-09-10T18:07:14.226 INFO:tasks.rados.rados.0.smithi012.stdout:3034: delete oid 40 current snap is 298 2024-09-10T18:07:14.226 INFO:tasks.rados.rados.0.smithi012.stdout:3030: finishing write tid 4 to smithi01278544-44 2024-09-10T18:07:14.226 INFO:tasks.rados.rados.0.smithi012.stdout:3030: finishing write tid 5 to smithi01278544-44 2024-09-10T18:07:14.226 INFO:tasks.rados.rados.0.smithi012.stdout:3030: oid 44 updating version 0 to 1625 2024-09-10T18:07:14.226 INFO:tasks.rados.rados.0.smithi012.stdout:3030: oid 44 updating version 1625 to 1626 2024-09-10T18:07:14.226 INFO:tasks.rados.rados.0.smithi012.stdout:3030: oid 44 version 1626 is already newer than 1623 2024-09-10T18:07:14.227 INFO:tasks.rados.rados.0.smithi012.stdout:3030: oid 44 version 1626 is already newer than 1624 2024-09-10T18:07:14.227 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1626 (ObjNum 940 snap 298 seq_num 940) dirty exists 2024-09-10T18:07:14.227 INFO:tasks.rados.rados.0.smithi012.stdout:3030: left oid 44 (ObjNum 940 snap 298 seq_num 940) 2024-09-10T18:07:14.227 INFO:tasks.rados.rados.0.smithi012.stdout:3033: finishing write tid 1 to smithi01278544-10 2024-09-10T18:07:14.228 INFO:tasks.rados.rados.0.smithi012.stdout:3030: done (2 left) 2024-09-10T18:07:14.228 INFO:tasks.rados.rados.0.smithi012.stdout:3034: done (1 left) 2024-09-10T18:07:14.228 INFO:tasks.rados.rados.0.smithi012.stdout:3035: copy_from oid 35 from oid 30 current snap is 298 2024-09-10T18:07:14.228 INFO:tasks.rados.rados.0.smithi012.stdout:3036: copy_from oid 26 from oid 32 current snap is 298 2024-09-10T18:07:14.228 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 298 2024-09-10T18:07:14.229 INFO:tasks.rados.rados.0.smithi012.stdout:3037: seq_num 944 ranges {0=614400,614400=573440,1187840=229376} 2024-09-10T18:07:14.231 INFO:tasks.rados.rados.0.smithi012.stdout:3037: writing smithi01278544-40 from 0 to 614400 tid 1 2024-09-10T18:07:14.234 INFO:tasks.rados.rados.0.smithi012.stdout:3037: writing smithi01278544-40 from 614400 to 1187840 tid 2 2024-09-10T18:07:14.236 INFO:tasks.rados.rados.0.smithi012.stdout:3037: writing smithi01278544-40 from 1187840 to 1417216 tid 3 2024-09-10T18:07:14.236 INFO:tasks.rados.rados.0.smithi012.stdout:3038: rollback oid 13 current snap is 298 2024-09-10T18:07:14.236 INFO:tasks.rados.rados.0.smithi012.stdout:3038: done (4 left) 2024-09-10T18:07:14.236 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 298 2024-09-10T18:07:14.236 INFO:tasks.rados.rados.0.smithi012.stdout:3039: seq_num 945 ranges {1064960=630784,1695744=458752,2154496=344064} 2024-09-10T18:07:14.245 INFO:tasks.rados.rados.0.smithi012.stdout:3039: writing smithi01278544-49 from 1064960 to 1695744 tid 1 2024-09-10T18:07:14.248 INFO:tasks.rados.rados.0.smithi012.stdout:3039: writing smithi01278544-49 from 1695744 to 2154496 tid 2 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3039: writing smithi01278544-49 from 2154496 to 2498560 tid 3 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3040: read oid 11 snap -1 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3040: expect (ObjNum 850 snap 277 seq_num 850) 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3041: snap_create 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3033: finishing write tid 2 to smithi01278544-10 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3033: finishing write tid 3 to smithi01278544-10 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3033: finishing write tid 4 to smithi01278544-10 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3037: finishing write tid 1 to smithi01278544-40 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3033: finishing write tid 5 to smithi01278544-10 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3033: oid 10 updating version 0 to 2186 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3033: oid 10 version 2186 is already newer than 2184 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3033: oid 10 updating version 2186 to 2187 2024-09-10T18:07:14.251 INFO:tasks.rados.rados.0.smithi012.stdout:3033: oid 10 version 2187 is already newer than 2185 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2187 (ObjNum 942 snap 298 seq_num 942) dirty exists 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3033: left oid 10 (ObjNum 942 snap 298 seq_num 942) 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: finishing write tid 2 to smithi01278544-40 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: finishing write tid 3 to smithi01278544-40 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: finishing write tid 4 to smithi01278544-40 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: finishing write tid 5 to smithi01278544-40 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: oid 40 updating version 0 to 2182 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: oid 40 updating version 2182 to 2183 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: oid 40 version 2183 is already newer than 2181 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: oid 40 version 2183 is already newer than 2180 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2183 (ObjNum 944 snap 298 seq_num 944) dirty exists 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3037: left oid 40 (ObjNum 944 snap 298 seq_num 944) 2024-09-10T18:07:14.252 INFO:tasks.rados.rados.0.smithi012.stdout:3039: finishing write tid 1 to smithi01278544-49 2024-09-10T18:07:14.254 INFO:tasks.rados.rados.0.smithi012.stdout:3039: finishing write tid 2 to smithi01278544-49 2024-09-10T18:07:14.254 INFO:tasks.rados.rados.0.smithi012.stdout:3039: finishing write tid 3 to smithi01278544-49 2024-09-10T18:07:14.255 INFO:tasks.rados.rados.0.smithi012.stdout:3039: finishing write tid 4 to smithi01278544-49 2024-09-10T18:07:14.256 INFO:tasks.rados.rados.0.smithi012.stdout:3039: finishing write tid 5 to smithi01278544-49 2024-09-10T18:07:14.257 INFO:tasks.rados.rados.0.smithi012.stdout:3039: oid 49 updating version 0 to 1606 2024-09-10T18:07:14.257 INFO:tasks.rados.rados.0.smithi012.stdout:3039: oid 49 version 1606 is already newer than 1605 2024-09-10T18:07:14.257 INFO:tasks.rados.rados.0.smithi012.stdout:3039: oid 49 version 1606 is already newer than 1604 2024-09-10T18:07:14.257 INFO:tasks.rados.rados.0.smithi012.stdout:3039: oid 49 updating version 1606 to 1607 2024-09-10T18:07:14.257 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 1607 (ObjNum 945 snap 298 seq_num 945) dirty exists 2024-09-10T18:07:14.257 INFO:tasks.rados.rados.0.smithi012.stdout:3039: left oid 49 (ObjNum 945 snap 298 seq_num 945) 2024-09-10T18:07:14.274 INFO:tasks.rados.rados.0.smithi012.stdout:3040: expect (ObjNum 850 snap 277 seq_num 850) 2024-09-10T18:07:14.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:13 smithi012 ceph-mon[89611]: osdmap e687: 8 total, 8 up, 8 in 2024-09-10T18:07:14.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:13 smithi012 ceph-mon[89611]: pgmap v711: 121 pgs: 121 active+clean; 191 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2024-09-10T18:07:14.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:13 smithi012 ceph-mon[92029]: osdmap e687: 8 total, 8 up, 8 in 2024-09-10T18:07:14.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:13 smithi012 ceph-mon[92029]: pgmap v711: 121 pgs: 121 active+clean; 191 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2024-09-10T18:07:14.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:13 smithi089 ceph-mon[84132]: osdmap e687: 8 total, 8 up, 8 in 2024-09-10T18:07:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:13 smithi089 ceph-mon[84132]: pgmap v711: 121 pgs: 121 active+clean; 191 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2024-09-10T18:07:14.396 INFO:tasks.rados.rados.0.smithi012.stdout:3036: finishing copy_from racing read to smithi01278544-26 2024-09-10T18:07:14.396 INFO:tasks.rados.rados.0.smithi012.stdout:3036: finishing copy_from to smithi01278544-26 2024-09-10T18:07:14.396 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2018 (ObjNum 903 snap 294 seq_num 903) dirty exists 2024-09-10T18:07:14.396 INFO:tasks.rados.rados.0.smithi012.stdout:3035: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:07:14.396 INFO:tasks.rados.rados.0.smithi012.stdout:3035: finishing copy_from to smithi01278544-35 2024-09-10T18:07:14.396 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2025 (ObjNum 938 snap 298 seq_num 938) dirty exists 2024-09-10T18:07:14.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:07:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:07:14] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.51.0" 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:3033: done (6 left) 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:3035: done (5 left) 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:3036: done (4 left) 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:3037: done (3 left) 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:3039: done (2 left) 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:3040: done (1 left) 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:3041: done (0 left) 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 299 2024-09-10T18:07:14.838 INFO:tasks.rados.rados.0.smithi012.stdout:3042: seq_num 946 ranges {1425408=647168,2072576=745472,2818048=57344} 2024-09-10T18:07:14.849 INFO:tasks.rados.rados.0.smithi012.stdout:3042: writing smithi01278544-34 from 1425408 to 2072576 tid 1 2024-09-10T18:07:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3042: writing smithi01278544-34 from 2072576 to 2818048 tid 2 2024-09-10T18:07:14.854 INFO:tasks.rados.rados.0.smithi012.stdout:3042: writing smithi01278544-34 from 2818048 to 2875392 tid 3 2024-09-10T18:07:14.854 INFO:tasks.rados.rados.0.smithi012.stdout:3043: snap_create 2024-09-10T18:07:14.858 INFO:tasks.rados.rados.0.smithi012.stdout:3042: finishing write tid 1 to smithi01278544-34 2024-09-10T18:07:14.858 INFO:tasks.rados.rados.0.smithi012.stdout:3042: finishing write tid 2 to smithi01278544-34 2024-09-10T18:07:14.859 INFO:tasks.rados.rados.0.smithi012.stdout:3042: finishing write tid 3 to smithi01278544-34 2024-09-10T18:07:14.859 INFO:tasks.rados.rados.0.smithi012.stdout:3042: finishing write tid 4 to smithi01278544-34 2024-09-10T18:07:14.861 INFO:tasks.rados.rados.0.smithi012.stdout:3042: finishing write tid 5 to smithi01278544-34 2024-09-10T18:07:14.861 INFO:tasks.rados.rados.0.smithi012.stdout:3042: oid 34 updating version 0 to 1225 2024-09-10T18:07:14.861 INFO:tasks.rados.rados.0.smithi012.stdout:3042: oid 34 updating version 1225 to 1226 2024-09-10T18:07:14.861 INFO:tasks.rados.rados.0.smithi012.stdout:3042: oid 34 updating version 1226 to 1227 2024-09-10T18:07:14.861 INFO:tasks.rados.rados.0.smithi012.stdout:3042: oid 34 updating version 1227 to 1228 2024-09-10T18:07:14.861 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1228 (ObjNum 946 snap 299 seq_num 946) dirty exists 2024-09-10T18:07:14.861 INFO:tasks.rados.rados.0.smithi012.stdout:3042: left oid 34 (ObjNum 946 snap 299 seq_num 946) 2024-09-10T18:07:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:14 smithi012 ceph-mon[89611]: osdmap e688: 8 total, 8 up, 8 in 2024-09-10T18:07:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:14 smithi012 ceph-mon[92029]: osdmap e688: 8 total, 8 up, 8 in 2024-09-10T18:07:15.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:14 smithi089 ceph-mon[84132]: osdmap e688: 8 total, 8 up, 8 in 2024-09-10T18:07:15.843 INFO:tasks.rados.rados.0.smithi012.stdout:3042: done (1 left) 2024-09-10T18:07:15.843 INFO:tasks.rados.rados.0.smithi012.stdout:3043: done (0 left) 2024-09-10T18:07:15.843 INFO:tasks.rados.rados.0.smithi012.stdout:3044: delete oid 47 current snap is 300 2024-09-10T18:07:15.849 INFO:tasks.rados.rados.0.smithi012.stdout:3044: done (0 left) 2024-09-10T18:07:15.849 INFO:tasks.rados.rados.0.smithi012.stdout:3045: snap_create 2024-09-10T18:07:16.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:15 smithi089 ceph-mon[84132]: osdmap e689: 8 total, 8 up, 8 in 2024-09-10T18:07:16.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:15 smithi089 ceph-mon[84132]: pgmap v714: 121 pgs: 121 active+clean; 193 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 23 MiB/s rd, 3.1 MiB/s wr, 28 op/s 2024-09-10T18:07:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:15 smithi012 ceph-mon[92029]: osdmap e689: 8 total, 8 up, 8 in 2024-09-10T18:07:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:15 smithi012 ceph-mon[92029]: pgmap v714: 121 pgs: 121 active+clean; 193 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 23 MiB/s rd, 3.1 MiB/s wr, 28 op/s 2024-09-10T18:07:16.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:15 smithi012 ceph-mon[89611]: osdmap e689: 8 total, 8 up, 8 in 2024-09-10T18:07:16.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:15 smithi012 ceph-mon[89611]: pgmap v714: 121 pgs: 121 active+clean; 193 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 23 MiB/s rd, 3.1 MiB/s wr, 28 op/s 2024-09-10T18:07:16.846 INFO:tasks.rados.rados.0.smithi012.stdout:3045: done (0 left) 2024-09-10T18:07:16.847 INFO:tasks.rados.rados.0.smithi012.stdout:3046: read oid 39 snap -1 2024-09-10T18:07:16.847 INFO:tasks.rados.rados.0.smithi012.stdout:3046: expect deleted 2024-09-10T18:07:16.847 INFO:tasks.rados.rados.0.smithi012.stdout:3047: snap_create 2024-09-10T18:07:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:16 smithi012 ceph-mon[89611]: osdmap e690: 8 total, 8 up, 8 in 2024-09-10T18:07:17.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:16 smithi012 ceph-mon[92029]: osdmap e690: 8 total, 8 up, 8 in 2024-09-10T18:07:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:16 smithi089 ceph-mon[84132]: osdmap e690: 8 total, 8 up, 8 in 2024-09-10T18:07:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:17.785 INFO:tasks.rados.rados.0.smithi012.stdout:3046: done (1 left) 2024-09-10T18:07:17.785 INFO:tasks.rados.rados.0.smithi012.stdout:3047: done (0 left) 2024-09-10T18:07:17.785 INFO:tasks.rados.rados.0.smithi012.stdout:3048: delete oid 11 current snap is 302 2024-09-10T18:07:17.792 INFO:tasks.rados.rados.0.smithi012.stdout:3048: done (0 left) 2024-09-10T18:07:17.792 INFO:tasks.rados.rados.0.smithi012.stdout:3049: delete oid 18 current snap is 302 2024-09-10T18:07:17.795 INFO:tasks.rados.rados.0.smithi012.stdout:3049: done (0 left) 2024-09-10T18:07:17.795 INFO:tasks.rados.rados.0.smithi012.stdout:3050: read oid 38 snap -1 2024-09-10T18:07:17.795 INFO:tasks.rados.rados.0.smithi012.stdout:3050: expect (ObjNum 932 snap 297 seq_num 932) 2024-09-10T18:07:17.795 INFO:tasks.rados.rados.0.smithi012.stdout:3051: read oid 31 snap -1 2024-09-10T18:07:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:3051: expect (ObjNum 917 snap 295 seq_num 917) 2024-09-10T18:07:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:3052: read oid 40 snap -1 2024-09-10T18:07:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:3052: expect (ObjNum 944 snap 298 seq_num 944) 2024-09-10T18:07:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:3053: read oid 30 snap -1 2024-09-10T18:07:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:3053: expect (ObjNum 938 snap 298 seq_num 938) 2024-09-10T18:07:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 302 2024-09-10T18:07:17.796 INFO:tasks.rados.rados.0.smithi012.stdout:3054: seq_num 950 ranges {811008=720896,1531904=679936,2211840=122880} 2024-09-10T18:07:17.805 INFO:tasks.rados.rados.0.smithi012.stdout:3054: writing smithi01278544-6 from 811008 to 1531904 tid 1 2024-09-10T18:07:17.809 INFO:tasks.rados.rados.0.smithi012.stdout:3054: writing smithi01278544-6 from 1531904 to 2211840 tid 2 2024-09-10T18:07:17.811 INFO:tasks.rados.rados.0.smithi012.stdout:3054: writing smithi01278544-6 from 2211840 to 2334720 tid 3 2024-09-10T18:07:17.811 INFO:tasks.rados.rados.0.smithi012.stdout:3055: copy_from oid 15 from oid 13 current snap is 302 2024-09-10T18:07:17.811 INFO:tasks.rados.rados.0.smithi012.stdout:3051: expect (ObjNum 917 snap 295 seq_num 917) 2024-09-10T18:07:17.848 INFO:tasks.rados.rados.0.smithi012.stdout:3052: expect (ObjNum 944 snap 298 seq_num 944) 2024-09-10T18:07:17.893 INFO:tasks.rados.rados.0.smithi012.stdout:3054: finishing write tid 1 to smithi01278544-6 2024-09-10T18:07:17.893 INFO:tasks.rados.rados.0.smithi012.stdout:3051: done (5 left) 2024-09-10T18:07:17.893 INFO:tasks.rados.rados.0.smithi012.stdout:3052: done (4 left) 2024-09-10T18:07:17.893 INFO:tasks.rados.rados.0.smithi012.stdout:3056: setattr oid 25 current snap is 302 2024-09-10T18:07:17.893 INFO:tasks.rados.rados.0.smithi012.stdout:3054: finishing write tid 2 to smithi01278544-6 2024-09-10T18:07:17.893 INFO:tasks.rados.rados.0.smithi012.stdout:3050: expect (ObjNum 932 snap 297 seq_num 932) 2024-09-10T18:07:18.048 INFO:tasks.rados.rados.0.smithi012.stdout:3054: finishing write tid 3 to smithi01278544-6 2024-09-10T18:07:18.048 INFO:tasks.rados.rados.0.smithi012.stdout:3054: finishing write tid 4 to smithi01278544-6 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3054: finishing write tid 5 to smithi01278544-6 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3054: oid 6 updating version 0 to 2079 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3054: oid 6 version 2079 is already newer than 2078 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3054: oid 6 updating version 2079 to 2080 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3054: oid 6 version 2080 is already newer than 2077 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 2080 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3054: left oid 6 (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3055: finishing copy_from racing read to smithi01278544-15 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3055: finishing copy_from to smithi01278544-15 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2131 (ObjNum 895 snap 292 seq_num 895) dirty exists 2024-09-10T18:07:18.049 INFO:tasks.rados.rados.0.smithi012.stdout:3053: expect (ObjNum 938 snap 298 seq_num 938) 2024-09-10T18:07:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:17 smithi012 ceph-mon[89611]: osdmap e691: 8 total, 8 up, 8 in 2024-09-10T18:07:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:17 smithi012 ceph-mon[89611]: pgmap v717: 121 pgs: 121 active+clean; 189 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.8 MiB/s wr, 22 op/s 2024-09-10T18:07:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:17 smithi012 ceph-mon[89611]: osdmap e692: 8 total, 8 up, 8 in 2024-09-10T18:07:18.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:17 smithi012 ceph-mon[92029]: osdmap e691: 8 total, 8 up, 8 in 2024-09-10T18:07:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:17 smithi012 ceph-mon[92029]: pgmap v717: 121 pgs: 121 active+clean; 189 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.8 MiB/s wr, 22 op/s 2024-09-10T18:07:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:17 smithi012 ceph-mon[92029]: osdmap e692: 8 total, 8 up, 8 in 2024-09-10T18:07:18.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:17 smithi089 ceph-mon[84132]: osdmap e691: 8 total, 8 up, 8 in 2024-09-10T18:07:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:17 smithi089 ceph-mon[84132]: pgmap v717: 121 pgs: 121 active+clean; 189 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.8 MiB/s wr, 22 op/s 2024-09-10T18:07:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:17 smithi089 ceph-mon[84132]: osdmap e692: 8 total, 8 up, 8 in 2024-09-10T18:07:19.969 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 2190 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:07:19.969 INFO:tasks.rados.rados.0.smithi012.stdout:3050: done (4 left) 2024-09-10T18:07:19.969 INFO:tasks.rados.rados.0.smithi012.stdout:3053: done (3 left) 2024-09-10T18:07:19.969 INFO:tasks.rados.rados.0.smithi012.stdout:3054: done (2 left) 2024-09-10T18:07:19.970 INFO:tasks.rados.rados.0.smithi012.stdout:3055: done (1 left) 2024-09-10T18:07:19.970 INFO:tasks.rados.rados.0.smithi012.stdout:3056: done (0 left) 2024-09-10T18:07:19.970 INFO:tasks.rados.rados.0.smithi012.stdout:3057: read oid 7 snap 300 2024-09-10T18:07:19.970 INFO:tasks.rados.rados.0.smithi012.stdout:3057: expect (ObjNum 853 snap 277 seq_num 853) 2024-09-10T18:07:19.970 INFO:tasks.rados.rados.0.smithi012.stdout:3058: copy_from oid 31 from oid 22 current snap is 302 2024-09-10T18:07:19.970 INFO:tasks.rados.rados.0.smithi012.stdout:3059: setattr oid 44 current snap is 302 2024-09-10T18:07:19.970 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 302 2024-09-10T18:07:19.970 INFO:tasks.rados.rados.0.smithi012.stdout:3060: seq_num 951 ranges {8355840=737280,9093120=614400,9707520=188416} 2024-09-10T18:07:20.021 INFO:tasks.rados.rados.0.smithi012.stdout:3060: writing smithi01278544-15 from 8355840 to 9093120 tid 1 2024-09-10T18:07:20.025 INFO:tasks.rados.rados.0.smithi012.stdout:3060: writing smithi01278544-15 from 9093120 to 9707520 tid 2 2024-09-10T18:07:20.026 INFO:tasks.rados.rados.0.smithi012.stdout:3060: writing smithi01278544-15 from 9707520 to 9895936 tid 3 2024-09-10T18:07:20.026 INFO:tasks.rados.rados.0.smithi012.stdout:3061: copy_from oid 25 from oid 2 current snap is 302 2024-09-10T18:07:20.026 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1628 (ObjNum 940 snap 298 seq_num 940) dirty exists 2024-09-10T18:07:20.027 INFO:tasks.rados.rados.0.smithi012.stdout:3059: done (4 left) 2024-09-10T18:07:20.027 INFO:tasks.rados.rados.0.smithi012.stdout:3062: copy_from oid 5 from oid 19 current snap is 302 2024-09-10T18:07:20.027 INFO:tasks.rados.rados.0.smithi012.stdout:3058: finishing copy_from racing read to smithi01278544-31 2024-09-10T18:07:20.027 INFO:tasks.rados.rados.0.smithi012.stdout:3058: finishing copy_from to smithi01278544-31 2024-09-10T18:07:20.027 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2178 (ObjNum 929 snap 297 seq_num 929) dirty exists 2024-09-10T18:07:20.027 INFO:tasks.rados.rados.0.smithi012.stdout:3057: expect (ObjNum 853 snap 277 seq_num 853) 2024-09-10T18:07:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:20 smithi012 ceph-mon[89611]: pgmap v719: 121 pgs: 121 active+clean; 204 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 9.8 MiB/s wr, 25 op/s 2024-09-10T18:07:20.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:20 smithi012 ceph-mon[92029]: pgmap v719: 121 pgs: 121 active+clean; 204 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 9.8 MiB/s wr, 25 op/s 2024-09-10T18:07:20.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:20 smithi089 ceph-mon[84132]: pgmap v719: 121 pgs: 121 active+clean; 204 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 9.8 MiB/s wr, 25 op/s 2024-09-10T18:07:20.923 INFO:tasks.rados.rados.0.smithi012.stdout:3060: finishing write tid 1 to smithi01278544-15 2024-09-10T18:07:20.923 INFO:tasks.rados.rados.0.smithi012.stdout:3060: finishing write tid 2 to smithi01278544-15 2024-09-10T18:07:20.923 INFO:tasks.rados.rados.0.smithi012.stdout:3060: finishing write tid 3 to smithi01278544-15 2024-09-10T18:07:20.923 INFO:tasks.rados.rados.0.smithi012.stdout:3060: finishing write tid 4 to smithi01278544-15 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3062: finishing copy_from racing read to smithi01278544-5 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3062: finishing copy_from to smithi01278544-5 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 1205 (ObjNum 892 snap 292 seq_num 892) dirty exists 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3060: finishing write tid 5 to smithi01278544-15 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3060: oid 15 updating version 0 to 2132 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3060: oid 15 updating version 2132 to 2134 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3060: oid 15 version 2134 is already newer than 2133 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3060: oid 15 updating version 2134 to 2135 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2135 (ObjNum 951 snap 302 seq_num 951) dirty exists 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3060: left oid 15 (ObjNum 951 snap 302 seq_num 951) 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3061: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3057: done (4 left) 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3058: done (3 left) 2024-09-10T18:07:20.924 INFO:tasks.rados.rados.0.smithi012.stdout:3060: done (2 left) 2024-09-10T18:07:20.925 INFO:tasks.rados.rados.0.smithi012.stdout:3062: done (1 left) 2024-09-10T18:07:20.925 INFO:tasks.rados.rados.0.smithi012.stdout:3063: delete oid 45 current snap is 302 2024-09-10T18:07:20.925 INFO:tasks.rados.rados.0.smithi012.stdout:3061: finishing copy_from to smithi01278544-25 2024-09-10T18:07:20.925 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 1598 (ObjNum 909 snap 295 seq_num 909) dirty exists 2024-09-10T18:07:20.928 INFO:tasks.rados.rados.0.smithi012.stdout:3061: done (1 left) 2024-09-10T18:07:20.928 INFO:tasks.rados.rados.0.smithi012.stdout:3063: done (0 left) 2024-09-10T18:07:20.928 INFO:tasks.rados.rados.0.smithi012.stdout:3064: read oid 24 snap -1 2024-09-10T18:07:20.928 INFO:tasks.rados.rados.0.smithi012.stdout:3064: expect (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:07:20.928 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 302 2024-09-10T18:07:20.928 INFO:tasks.rados.rados.0.smithi012.stdout:3065: seq_num 953 ranges {0=770048,770048=786432,1556480=16384} 2024-09-10T18:07:20.932 INFO:tasks.rados.rados.0.smithi012.stdout:3065: writing smithi01278544-45 from 0 to 770048 tid 1 2024-09-10T18:07:20.937 INFO:tasks.rados.rados.0.smithi012.stdout:3065: writing smithi01278544-45 from 770048 to 1556480 tid 2 2024-09-10T18:07:20.937 INFO:tasks.rados.rados.0.smithi012.stdout:3065: writing smithi01278544-45 from 1556480 to 1572864 tid 3 2024-09-10T18:07:20.938 INFO:tasks.rados.rados.0.smithi012.stdout:3066: copy_from oid 31 from oid 43 current snap is 302 2024-09-10T18:07:20.938 INFO:tasks.rados.rados.0.smithi012.stdout:3065: finishing write tid 1 to smithi01278544-45 2024-09-10T18:07:20.938 INFO:tasks.rados.rados.0.smithi012.stdout:3067: read oid 39 snap -1 2024-09-10T18:07:20.938 INFO:tasks.rados.rados.0.smithi012.stdout:3067: expect deleted 2024-09-10T18:07:20.938 INFO:tasks.rados.rados.0.smithi012.stdout:3068: delete oid 22 current snap is 302 2024-09-10T18:07:20.938 INFO:tasks.rados.rados.0.smithi012.stdout:3064: expect (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:07:20.997 INFO:tasks.rados.rados.0.smithi012.stdout:3065: finishing write tid 2 to smithi01278544-45 2024-09-10T18:07:20.997 INFO:tasks.rados.rados.0.smithi012.stdout:3065: finishing write tid 3 to smithi01278544-45 2024-09-10T18:07:20.997 INFO:tasks.rados.rados.0.smithi012.stdout:3065: finishing write tid 4 to smithi01278544-45 2024-09-10T18:07:20.997 INFO:tasks.rados.rados.0.smithi012.stdout:3064: done (4 left) 2024-09-10T18:07:20.997 INFO:tasks.rados.rados.0.smithi012.stdout:3067: done (3 left) 2024-09-10T18:07:20.997 INFO:tasks.rados.rados.0.smithi012.stdout:3068: done (2 left) 2024-09-10T18:07:20.997 INFO:tasks.rados.rados.0.smithi012.stdout:3069: snap_create 2024-09-10T18:07:20.997 INFO:tasks.rados.rados.0.smithi012.stdout:3065: finishing write tid 5 to smithi01278544-45 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:3065: oid 45 updating version 0 to 2189 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:3065: oid 45 version 2189 is already newer than 2186 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:3065: oid 45 version 2189 is already newer than 2187 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:3065: oid 45 version 2189 is already newer than 2188 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2189 (ObjNum 953 snap 302 seq_num 953) dirty exists 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:3065: left oid 45 (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:3066: finishing copy_from racing read to smithi01278544-31 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:3066: finishing copy_from to smithi01278544-31 2024-09-10T18:07:20.998 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 902 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:07:21.158 INFO:tasks.rados.rados.0.smithi012.stdout:3065: done (2 left) 2024-09-10T18:07:21.158 INFO:tasks.rados.rados.0.smithi012.stdout:3066: done (1 left) 2024-09-10T18:07:21.158 INFO:tasks.rados.rados.0.smithi012.stdout:3069: done (0 left) 2024-09-10T18:07:21.158 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 303 2024-09-10T18:07:21.158 INFO:tasks.rados.rados.0.smithi012.stdout:3070: seq_num 955 ranges {1146880=802816,1949696=557056,2506752=245760} 2024-09-10T18:07:21.168 INFO:tasks.rados.rados.0.smithi012.stdout:3070: writing smithi01278544-42 from 1146880 to 1949696 tid 1 2024-09-10T18:07:21.172 INFO:tasks.rados.rados.0.smithi012.stdout:3070: writing smithi01278544-42 from 1949696 to 2506752 tid 2 2024-09-10T18:07:21.176 INFO:tasks.rados.rados.0.smithi012.stdout:3070: writing smithi01278544-42 from 2506752 to 2752512 tid 3 2024-09-10T18:07:21.176 INFO:tasks.rados.rados.0.smithi012.stdout:3071: read oid 13 snap -1 2024-09-10T18:07:21.176 INFO:tasks.rados.rados.0.smithi012.stdout:3071: expect (ObjNum 895 snap 292 seq_num 895) 2024-09-10T18:07:21.176 INFO:tasks.rados.rados.0.smithi012.stdout:3072: copy_from oid 10 from oid 18 current snap is 303 2024-09-10T18:07:21.177 INFO:tasks.rados.rados.0.smithi012.stdout:3073: read oid 31 snap -1 2024-09-10T18:07:21.177 INFO:tasks.rados.rados.0.smithi012.stdout:3073: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:21.177 INFO:tasks.rados.rados.0.smithi012.stdout:3074: read oid 32 snap 300 2024-09-10T18:07:21.177 INFO:tasks.rados.rados.0.smithi012.stdout:3074: expect (ObjNum 903 snap 294 seq_num 903) 2024-09-10T18:07:21.177 INFO:tasks.rados.rados.0.smithi012.stdout:3075: copy_from oid 46 from oid 9 current snap is 303 2024-09-10T18:07:21.177 INFO:tasks.rados.rados.0.smithi012.stdout:3076: rollback oid 49 current snap is 303 2024-09-10T18:07:21.178 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 49 to 300 2024-09-10T18:07:21.178 INFO:tasks.rados.rados.0.smithi012.stdout:3077: read oid 27 snap -1 2024-09-10T18:07:21.178 INFO:tasks.rados.rados.0.smithi012.stdout:3077: expect deleted 2024-09-10T18:07:21.178 INFO:tasks.rados.rados.0.smithi012.stdout:3078: read oid 36 snap -1 2024-09-10T18:07:21.178 INFO:tasks.rados.rados.0.smithi012.stdout:3078: expect (ObjNum 924 snap 296 seq_num 924) 2024-09-10T18:07:21.178 INFO:tasks.rados.rados.0.smithi012.stdout:3079: read oid 17 snap -1 2024-09-10T18:07:21.178 INFO:tasks.rados.rados.0.smithi012.stdout:3079: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:21.179 INFO:tasks.rados.rados.0.smithi012.stdout:3080: read oid 7 snap -1 2024-09-10T18:07:21.179 INFO:tasks.rados.rados.0.smithi012.stdout:3080: expect (ObjNum 853 snap 277 seq_num 853) 2024-09-10T18:07:21.179 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 303 2024-09-10T18:07:21.179 INFO:tasks.rados.rados.0.smithi012.stdout:3081: seq_num 956 ranges {3366912=417792,3784704=434176,4218880=770048} 2024-09-10T18:07:21.196 INFO:tasks.rados.rados.0.smithi012.stdout:3081: writing smithi01278544-38 from 3366912 to 3784704 tid 1 2024-09-10T18:07:21.198 INFO:tasks.rados.rados.0.smithi012.stdout:3081: writing smithi01278544-38 from 3784704 to 4218880 tid 2 2024-09-10T18:07:21.204 INFO:tasks.rados.rados.0.smithi012.stdout:3081: writing smithi01278544-38 from 4218880 to 4988928 tid 3 2024-09-10T18:07:21.204 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 303 2024-09-10T18:07:21.204 INFO:tasks.rados.rados.0.smithi012.stdout:3082: seq_num 957 ranges {0=434176,434176=720896,1155072=483328} 2024-09-10T18:07:21.206 INFO:tasks.rados.rados.0.smithi012.stdout:3082: writing smithi01278544-23 from 0 to 434176 tid 1 2024-09-10T18:07:21.212 INFO:tasks.rados.rados.0.smithi012.stdout:3082: writing smithi01278544-23 from 434176 to 1155072 tid 2 2024-09-10T18:07:21.216 INFO:tasks.rados.rados.0.smithi012.stdout:3082: writing smithi01278544-23 from 1155072 to 1638400 tid 3 2024-09-10T18:07:21.216 INFO:tasks.rados.rados.0.smithi012.stdout:3083: read oid 45 snap 301 2024-09-10T18:07:21.216 INFO:tasks.rados.rados.0.smithi012.stdout:3083: expect (ObjNum 921 snap 296 seq_num 921) 2024-09-10T18:07:21.216 INFO:tasks.rados.rados.0.smithi012.stdout:3084: read oid 41 snap 300 2024-09-10T18:07:21.216 INFO:tasks.rados.rados.0.smithi012.stdout:3084: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:07:21.227 INFO:tasks.rados.rados.0.smithi012.stdout:3085: delete oid 21 current snap is 303 2024-09-10T18:07:21.227 INFO:tasks.rados.rados.0.smithi012.stdout:3070: finishing write tid 1 to smithi01278544-42 2024-09-10T18:07:21.227 INFO:tasks.rados.rados.0.smithi012.stdout:3070: finishing write tid 2 to smithi01278544-42 2024-09-10T18:07:21.227 INFO:tasks.rados.rados.0.smithi012.stdout:3070: finishing write tid 3 to smithi01278544-42 2024-09-10T18:07:21.227 INFO:tasks.rados.rados.0.smithi012.stdout:3075: finishing copy_from to smithi01278544-46 2024-09-10T18:07:21.227 INFO:tasks.rados.rados.0.smithi012.stdout:3075: got expected ENOENT (src dne) 2024-09-10T18:07:21.227 INFO:tasks.rados.rados.0.smithi012.stdout:3070: finishing write tid 4 to smithi01278544-42 2024-09-10T18:07:21.227 INFO:tasks.rados.rados.0.smithi012.stdout:3075: finishing copy_from racing read to smithi01278544-46 2024-09-10T18:07:21.228 INFO:tasks.rados.rados.0.smithi012.stdout:3070: finishing write tid 5 to smithi01278544-42 2024-09-10T18:07:21.228 INFO:tasks.rados.rados.0.smithi012.stdout:3070: oid 42 updating version 0 to 2190 2024-09-10T18:07:21.228 INFO:tasks.rados.rados.0.smithi012.stdout:3070: oid 42 updating version 2190 to 2191 2024-09-10T18:07:21.228 INFO:tasks.rados.rados.0.smithi012.stdout:3070: oid 42 updating version 2191 to 2192 2024-09-10T18:07:21.228 INFO:tasks.rados.rados.0.smithi012.stdout:3070: oid 42 updating version 2192 to 2193 2024-09-10T18:07:21.228 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2193 (ObjNum 955 snap 303 seq_num 955) dirty exists 2024-09-10T18:07:21.228 INFO:tasks.rados.rados.0.smithi012.stdout:3070: left oid 42 (ObjNum 955 snap 303 seq_num 955) 2024-09-10T18:07:21.228 INFO:tasks.rados.rados.0.smithi012.stdout:3079: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:21.265 INFO:tasks.rados.rados.0.smithi012.stdout:3076: finishing rollback tid 0 to smithi01278544-49 2024-09-10T18:07:21.265 INFO:tasks.rados.rados.0.smithi012.stdout:3076: finishing rollback tid 1 to smithi01278544-49 2024-09-10T18:07:21.265 INFO:tasks.rados.rados.0.smithi012.stdout:3076: finishing rollback tid 2 to smithi01278544-49 2024-09-10T18:07:21.265 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 2138 (ObjNum 945 snap 298 seq_num 945) dirty exists 2024-09-10T18:07:21.266 INFO:tasks.rados.rados.0.smithi012.stdout:3072: finishing copy_from to smithi01278544-10 2024-09-10T18:07:21.266 INFO:tasks.rados.rados.0.smithi012.stdout:3072: got expected ENOENT (src dne) 2024-09-10T18:07:21.266 INFO:tasks.rados.rados.0.smithi012.stdout:3072: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:07:21.266 INFO:tasks.rados.rados.0.smithi012.stdout:3081: finishing write tid 1 to smithi01278544-38 2024-09-10T18:07:21.266 INFO:tasks.rados.rados.0.smithi012.stdout:3081: finishing write tid 2 to smithi01278544-38 2024-09-10T18:07:21.266 INFO:tasks.rados.rados.0.smithi012.stdout:3081: finishing write tid 3 to smithi01278544-38 2024-09-10T18:07:21.266 INFO:tasks.rados.rados.0.smithi012.stdout:3078: expect (ObjNum 924 snap 296 seq_num 924) 2024-09-10T18:07:21.338 INFO:tasks.rados.rados.0.smithi012.stdout:3081: finishing write tid 4 to smithi01278544-38 2024-09-10T18:07:21.338 INFO:tasks.rados.rados.0.smithi012.stdout:3081: finishing write tid 5 to smithi01278544-38 2024-09-10T18:07:21.338 INFO:tasks.rados.rados.0.smithi012.stdout:3081: oid 38 updating version 0 to 1996 2024-09-10T18:07:21.338 INFO:tasks.rados.rados.0.smithi012.stdout:3081: oid 38 updating version 1996 to 1997 2024-09-10T18:07:21.338 INFO:tasks.rados.rados.0.smithi012.stdout:3081: oid 38 version 1997 is already newer than 1995 2024-09-10T18:07:21.338 INFO:tasks.rados.rados.0.smithi012.stdout:3081: oid 38 updating version 1997 to 1998 2024-09-10T18:07:21.339 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 1998 (ObjNum 956 snap 303 seq_num 956) dirty exists 2024-09-10T18:07:21.339 INFO:tasks.rados.rados.0.smithi012.stdout:3081: left oid 38 (ObjNum 956 snap 303 seq_num 956) 2024-09-10T18:07:21.339 INFO:tasks.rados.rados.0.smithi012.stdout:3082: finishing write tid 1 to smithi01278544-23 2024-09-10T18:07:21.339 INFO:tasks.rados.rados.0.smithi012.stdout:3074: expect (ObjNum 903 snap 294 seq_num 903) 2024-09-10T18:07:21.507 INFO:tasks.rados.rados.0.smithi012.stdout:3082: finishing write tid 2 to smithi01278544-23 2024-09-10T18:07:21.507 INFO:tasks.rados.rados.0.smithi012.stdout:3071: expect (ObjNum 895 snap 292 seq_num 895) 2024-09-10T18:07:22.261 INFO:tasks.rados.rados.0.smithi012.stdout:3082: finishing write tid 3 to smithi01278544-23 2024-09-10T18:07:22.261 INFO:tasks.rados.rados.0.smithi012.stdout:3082: finishing write tid 4 to smithi01278544-23 2024-09-10T18:07:22.262 INFO:tasks.rados.rados.0.smithi012.stdout:3073: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:22.289 INFO:tasks.rados.rados.0.smithi012.stdout:3082: finishing write tid 5 to smithi01278544-23 2024-09-10T18:07:22.289 INFO:tasks.rados.rados.0.smithi012.stdout:3082: oid 23 updating version 0 to 1229 2024-09-10T18:07:22.289 INFO:tasks.rados.rados.0.smithi012.stdout:3082: oid 23 updating version 1229 to 1231 2024-09-10T18:07:22.289 INFO:tasks.rados.rados.0.smithi012.stdout:3082: oid 23 updating version 1231 to 1232 2024-09-10T18:07:22.289 INFO:tasks.rados.rados.0.smithi012.stdout:3082: oid 23 version 1232 is already newer than 1230 2024-09-10T18:07:22.290 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 1232 (ObjNum 957 snap 303 seq_num 957) dirty exists 2024-09-10T18:07:22.290 INFO:tasks.rados.rados.0.smithi012.stdout:3082: left oid 23 (ObjNum 957 snap 303 seq_num 957) 2024-09-10T18:07:22.290 INFO:tasks.rados.rados.0.smithi012.stdout:3080: expect (ObjNum 853 snap 277 seq_num 853) 2024-09-10T18:07:22.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:22 smithi012 ceph-mon[89611]: pgmap v720: 121 pgs: 121 active+clean; 217 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 8.7 MiB/s wr, 14 op/s 2024-09-10T18:07:22.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:22 smithi012 ceph-mon[89611]: osdmap e693: 8 total, 8 up, 8 in 2024-09-10T18:07:22.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:22 smithi012 ceph-mon[92029]: pgmap v720: 121 pgs: 121 active+clean; 217 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 8.7 MiB/s wr, 14 op/s 2024-09-10T18:07:22.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:22 smithi012 ceph-mon[92029]: osdmap e693: 8 total, 8 up, 8 in 2024-09-10T18:07:22.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:22 smithi089 ceph-mon[84132]: pgmap v720: 121 pgs: 121 active+clean; 217 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 8.7 MiB/s wr, 14 op/s 2024-09-10T18:07:22.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:22 smithi089 ceph-mon[84132]: osdmap e693: 8 total, 8 up, 8 in 2024-09-10T18:07:23.186 INFO:tasks.rados.rados.0.smithi012.stdout:3084: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:07:24.061 INFO:tasks.rados.rados.0.smithi012.stdout:3083: expect (ObjNum 921 snap 296 seq_num 921) 2024-09-10T18:07:24.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:23 smithi012 ceph-mon[89611]: osdmap e694: 8 total, 8 up, 8 in 2024-09-10T18:07:24.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:23 smithi012 ceph-mon[92029]: osdmap e694: 8 total, 8 up, 8 in 2024-09-10T18:07:24.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:23 smithi089 ceph-mon[84132]: osdmap e694: 8 total, 8 up, 8 in 2024-09-10T18:07:24.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:07:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:07:24] "GET /metrics HTTP/1.1" 200 36356 "" "Prometheus/2.51.0" 2024-09-10T18:07:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:24 smithi012 ceph-mon[89611]: pgmap v723: 121 pgs: 121 active+clean; 235 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 8.6 MiB/s wr, 19 op/s 2024-09-10T18:07:25.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:24 smithi012 ceph-mon[92029]: pgmap v723: 121 pgs: 121 active+clean; 235 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 8.6 MiB/s wr, 19 op/s 2024-09-10T18:07:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:24 smithi089 ceph-mon[84132]: pgmap v723: 121 pgs: 121 active+clean; 235 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 8.6 MiB/s wr, 19 op/s 2024-09-10T18:07:25.660 INFO:tasks.rados.rados.0.smithi012.stdout:3070: done (15 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3071: done (14 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3072: done (13 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3073: done (12 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3074: done (11 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3075: done (10 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3076: done (9 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3077: done (8 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3078: done (7 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3079: done (6 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3080: done (5 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3081: done (4 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3082: done (3 left) 2024-09-10T18:07:25.661 INFO:tasks.rados.rados.0.smithi012.stdout:3083: done (2 left) 2024-09-10T18:07:25.662 INFO:tasks.rados.rados.0.smithi012.stdout:3084: done (1 left) 2024-09-10T18:07:25.662 INFO:tasks.rados.rados.0.smithi012.stdout:3085: done (0 left) 2024-09-10T18:07:25.662 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 303 2024-09-10T18:07:25.662 INFO:tasks.rados.rados.0.smithi012.stdout:3086: seq_num 959 ranges {9994240=466944,10461184=540672,11001856=557056,11558912=106496} 2024-09-10T18:07:25.717 INFO:tasks.rados.rados.0.smithi012.stdout:3086: writing smithi01278544-12 from 9994240 to 10461184 tid 1 2024-09-10T18:07:25.719 INFO:tasks.rados.rados.0.smithi012.stdout:3086: writing smithi01278544-12 from 10461184 to 11001856 tid 2 2024-09-10T18:07:25.722 INFO:tasks.rados.rados.0.smithi012.stdout:3086: writing smithi01278544-12 from 11001856 to 11558912 tid 3 2024-09-10T18:07:25.723 INFO:tasks.rados.rados.0.smithi012.stdout:3086: writing smithi01278544-12 from 11558912 to 11665408 tid 4 2024-09-10T18:07:25.723 INFO:tasks.rados.rados.0.smithi012.stdout:3087: rollback oid 35 current snap is 303 2024-09-10T18:07:25.723 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 35 to 299 2024-09-10T18:07:25.724 INFO:tasks.rados.rados.0.smithi012.stdout:3086: finishing write tid 1 to smithi01278544-12 2024-09-10T18:07:25.724 INFO:tasks.rados.rados.0.smithi012.stdout:3086: finishing write tid 2 to smithi01278544-12 2024-09-10T18:07:25.724 INFO:tasks.rados.rados.0.smithi012.stdout:3088: setattr oid 30 current snap is 303 2024-09-10T18:07:25.725 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 303 2024-09-10T18:07:25.725 INFO:tasks.rados.rados.0.smithi012.stdout:3089: seq_num 960 ranges {548864=483328,1032192=425984,1458176=761856,2220032=16384} 2024-09-10T18:07:25.731 INFO:tasks.rados.rados.0.smithi012.stdout:3089: writing smithi01278544-19 from 548864 to 1032192 tid 1 2024-09-10T18:07:25.734 INFO:tasks.rados.rados.0.smithi012.stdout:3089: writing smithi01278544-19 from 1032192 to 1458176 tid 2 2024-09-10T18:07:25.740 INFO:tasks.rados.rados.0.smithi012.stdout:3089: writing smithi01278544-19 from 1458176 to 2220032 tid 3 2024-09-10T18:07:25.740 INFO:tasks.rados.rados.0.smithi012.stdout:3089: writing smithi01278544-19 from 2220032 to 2236416 tid 4 2024-09-10T18:07:25.740 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 303 2024-09-10T18:07:25.740 INFO:tasks.rados.rados.0.smithi012.stdout:3086: finishing write tid 3 to smithi01278544-12 2024-09-10T18:07:25.740 INFO:tasks.rados.rados.0.smithi012.stdout:3086: finishing write tid 4 to smithi01278544-12 2024-09-10T18:07:25.740 INFO:tasks.rados.rados.0.smithi012.stdout:3086: finishing write tid 5 to smithi01278544-12 2024-09-10T18:07:25.740 INFO:tasks.rados.rados.0.smithi012.stdout:3087: finishing rollback tid 0 to smithi01278544-35 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3087: finishing rollback tid 1 to smithi01278544-35 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3086: finishing write tid 6 to smithi01278544-12 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3086: oid 12 updating version 0 to 2196 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3086: oid 12 updating version 2196 to 2198 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3086: oid 12 updating version 2198 to 2199 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3086: oid 12 version 2199 is already newer than 2195 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3086: oid 12 version 2199 is already newer than 2197 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2199 (ObjNum 959 snap 303 seq_num 959) dirty exists 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3086: left oid 12 (ObjNum 959 snap 303 seq_num 959) 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:3087: finishing rollback tid 2 to smithi01278544-35 2024-09-10T18:07:25.741 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2028 (ObjNum 938 snap 298 seq_num 938) dirty exists 2024-09-10T18:07:25.742 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2029 (ObjNum 938 snap 298 seq_num 938) dirty exists 2024-09-10T18:07:25.742 INFO:tasks.rados.rados.0.smithi012.stdout:3089: finishing write tid 1 to smithi01278544-19 2024-09-10T18:07:25.742 INFO:tasks.rados.rados.0.smithi012.stdout:3089: finishing write tid 2 to smithi01278544-19 2024-09-10T18:07:25.742 INFO:tasks.rados.rados.0.smithi012.stdout:3090: seq_num 961 ranges {0=499712,499712=712704,1212416=491520} 2024-09-10T18:07:25.742 INFO:tasks.rados.rados.0.smithi012.stdout:3090: writing smithi01278544-11 from 0 to 499712 tid 1 2024-09-10T18:07:25.746 INFO:tasks.rados.rados.0.smithi012.stdout:3090: writing smithi01278544-11 from 499712 to 1212416 tid 2 2024-09-10T18:07:25.749 INFO:tasks.rados.rados.0.smithi012.stdout:3090: writing smithi01278544-11 from 1212416 to 1703936 tid 3 2024-09-10T18:07:25.749 INFO:tasks.rados.rados.0.smithi012.stdout:3086: done (4 left) 2024-09-10T18:07:25.749 INFO:tasks.rados.rados.0.smithi012.stdout:3087: done (3 left) 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3088: done (2 left) 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3091: delete oid 15 current snap is 303 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: finishing write tid 3 to smithi01278544-19 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: finishing write tid 4 to smithi01278544-19 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: finishing write tid 5 to smithi01278544-19 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: finishing write tid 6 to smithi01278544-19 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: oid 19 updating version 0 to 1239 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: oid 19 updating version 1239 to 1240 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: oid 19 version 1240 is already newer than 1236 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: oid 19 version 1240 is already newer than 1237 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:3089: oid 19 version 1240 is already newer than 1238 2024-09-10T18:07:25.750 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1240 (ObjNum 960 snap 303 seq_num 960) dirty exists 2024-09-10T18:07:25.751 INFO:tasks.rados.rados.0.smithi012.stdout:3089: left oid 19 (ObjNum 960 snap 303 seq_num 960) 2024-09-10T18:07:25.751 INFO:tasks.rados.rados.0.smithi012.stdout:3090: finishing write tid 1 to smithi01278544-11 2024-09-10T18:07:25.751 INFO:tasks.rados.rados.0.smithi012.stdout:3090: finishing write tid 2 to smithi01278544-11 2024-09-10T18:07:25.752 INFO:tasks.rados.rados.0.smithi012.stdout:3089: done (2 left) 2024-09-10T18:07:25.752 INFO:tasks.rados.rados.0.smithi012.stdout:3091: done (1 left) 2024-09-10T18:07:25.752 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 303 2024-09-10T18:07:25.752 INFO:tasks.rados.rados.0.smithi012.stdout:3092: seq_num 963 ranges {1892352=532480,2424832=475136,2899968=532480,3432448=196608} 2024-09-10T18:07:25.765 INFO:tasks.rados.rados.0.smithi012.stdout:3092: writing smithi01278544-10 from 1892352 to 2424832 tid 1 2024-09-10T18:07:25.768 INFO:tasks.rados.rados.0.smithi012.stdout:3092: writing smithi01278544-10 from 2424832 to 2899968 tid 2 2024-09-10T18:07:25.770 INFO:tasks.rados.rados.0.smithi012.stdout:3092: writing smithi01278544-10 from 2899968 to 3432448 tid 3 2024-09-10T18:07:25.772 INFO:tasks.rados.rados.0.smithi012.stdout:3092: writing smithi01278544-10 from 3432448 to 3629056 tid 4 2024-09-10T18:07:25.772 INFO:tasks.rados.rados.0.smithi012.stdout:3093: snap_create 2024-09-10T18:07:25.772 INFO:tasks.rados.rados.0.smithi012.stdout:3090: finishing write tid 3 to smithi01278544-11 2024-09-10T18:07:25.772 INFO:tasks.rados.rados.0.smithi012.stdout:3090: finishing write tid 4 to smithi01278544-11 2024-09-10T18:07:25.772 INFO:tasks.rados.rados.0.smithi012.stdout:3090: finishing write tid 5 to smithi01278544-11 2024-09-10T18:07:25.772 INFO:tasks.rados.rados.0.smithi012.stdout:3090: oid 11 updating version 0 to 2203 2024-09-10T18:07:25.772 INFO:tasks.rados.rados.0.smithi012.stdout:3090: oid 11 version 2203 is already newer than 2201 2024-09-10T18:07:25.772 INFO:tasks.rados.rados.0.smithi012.stdout:3090: oid 11 version 2203 is already newer than 2202 2024-09-10T18:07:25.773 INFO:tasks.rados.rados.0.smithi012.stdout:3090: oid 11 version 2203 is already newer than 2200 2024-09-10T18:07:25.773 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2203 (ObjNum 961 snap 303 seq_num 961) dirty exists 2024-09-10T18:07:25.773 INFO:tasks.rados.rados.0.smithi012.stdout:3090: left oid 11 (ObjNum 961 snap 303 seq_num 961) 2024-09-10T18:07:25.773 INFO:tasks.rados.rados.0.smithi012.stdout:3092: finishing write tid 1 to smithi01278544-10 2024-09-10T18:07:25.773 INFO:tasks.rados.rados.0.smithi012.stdout:3092: finishing write tid 2 to smithi01278544-10 2024-09-10T18:07:25.776 INFO:tasks.rados.rados.0.smithi012.stdout:3092: finishing write tid 3 to smithi01278544-10 2024-09-10T18:07:25.776 INFO:tasks.rados.rados.0.smithi012.stdout:3092: finishing write tid 4 to smithi01278544-10 2024-09-10T18:07:25.776 INFO:tasks.rados.rados.0.smithi012.stdout:3092: finishing write tid 5 to smithi01278544-10 2024-09-10T18:07:25.777 INFO:tasks.rados.rados.0.smithi012.stdout:3092: finishing write tid 6 to smithi01278544-10 2024-09-10T18:07:25.777 INFO:tasks.rados.rados.0.smithi012.stdout:3092: oid 10 updating version 0 to 2209 2024-09-10T18:07:25.777 INFO:tasks.rados.rados.0.smithi012.stdout:3092: oid 10 version 2209 is already newer than 2207 2024-09-10T18:07:25.778 INFO:tasks.rados.rados.0.smithi012.stdout:3092: oid 10 version 2209 is already newer than 2208 2024-09-10T18:07:25.778 INFO:tasks.rados.rados.0.smithi012.stdout:3092: oid 10 version 2209 is already newer than 2206 2024-09-10T18:07:25.778 INFO:tasks.rados.rados.0.smithi012.stdout:3092: oid 10 version 2209 is already newer than 2205 2024-09-10T18:07:25.778 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2209 (ObjNum 963 snap 303 seq_num 963) dirty exists 2024-09-10T18:07:25.778 INFO:tasks.rados.rados.0.smithi012.stdout:3092: left oid 10 (ObjNum 963 snap 303 seq_num 963) 2024-09-10T18:07:25.796 INFO:tasks.rados.rados.0.smithi012.stdout:3090: done (2 left) 2024-09-10T18:07:25.796 INFO:tasks.rados.rados.0.smithi012.stdout:3092: done (1 left) 2024-09-10T18:07:25.796 INFO:tasks.rados.rados.0.smithi012.stdout:3093: done (0 left) 2024-09-10T18:07:25.797 INFO:tasks.rados.rados.0.smithi012.stdout:3094: read oid 2 snap 301 2024-09-10T18:07:25.797 INFO:tasks.rados.rados.0.smithi012.stdout:3094: expect (ObjNum 909 snap 295 seq_num 909) 2024-09-10T18:07:25.797 INFO:tasks.rados.rados.0.smithi012.stdout:3095: rmattr oid 14 current snap is 304 2024-09-10T18:07:25.797 INFO:tasks.rados.rados.0.smithi012.stdout:3095: done (1 left) 2024-09-10T18:07:25.797 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 304 2024-09-10T18:07:25.797 INFO:tasks.rados.rados.0.smithi012.stdout:3096: seq_num 964 ranges {1409024=548864,1957888=761856,2719744=442368} 2024-09-10T18:07:25.806 INFO:tasks.rados.rados.0.smithi012.stdout:3096: writing smithi01278544-29 from 1409024 to 1957888 tid 1 2024-09-10T18:07:25.811 INFO:tasks.rados.rados.0.smithi012.stdout:3096: writing smithi01278544-29 from 1957888 to 2719744 tid 2 2024-09-10T18:07:25.814 INFO:tasks.rados.rados.0.smithi012.stdout:3096: writing smithi01278544-29 from 2719744 to 3162112 tid 3 2024-09-10T18:07:25.814 INFO:tasks.rados.rados.0.smithi012.stdout:3097: snap_create 2024-09-10T18:07:25.815 INFO:tasks.rados.rados.0.smithi012.stdout:3096: finishing write tid 1 to smithi01278544-29 2024-09-10T18:07:25.817 INFO:tasks.rados.rados.0.smithi012.stdout:3096: finishing write tid 2 to smithi01278544-29 2024-09-10T18:07:25.817 INFO:tasks.rados.rados.0.smithi012.stdout:3096: finishing write tid 3 to smithi01278544-29 2024-09-10T18:07:25.817 INFO:tasks.rados.rados.0.smithi012.stdout:3096: finishing write tid 4 to smithi01278544-29 2024-09-10T18:07:25.817 INFO:tasks.rados.rados.0.smithi012.stdout:3096: finishing write tid 5 to smithi01278544-29 2024-09-10T18:07:25.818 INFO:tasks.rados.rados.0.smithi012.stdout:3096: oid 29 updating version 0 to 1126 2024-09-10T18:07:25.818 INFO:tasks.rados.rados.0.smithi012.stdout:3096: oid 29 updating version 1126 to 1127 2024-09-10T18:07:25.818 INFO:tasks.rados.rados.0.smithi012.stdout:3096: oid 29 version 1127 is already newer than 1125 2024-09-10T18:07:25.818 INFO:tasks.rados.rados.0.smithi012.stdout:3096: oid 29 version 1127 is already newer than 1124 2024-09-10T18:07:25.818 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1127 (ObjNum 964 snap 304 seq_num 964) dirty exists 2024-09-10T18:07:25.818 INFO:tasks.rados.rados.0.smithi012.stdout:3096: left oid 29 (ObjNum 964 snap 304 seq_num 964) 2024-09-10T18:07:25.872 INFO:tasks.rados.rados.0.smithi012.stdout:3094: expect (ObjNum 909 snap 295 seq_num 909) 2024-09-10T18:07:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:25 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:07:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:25 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:07:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:25 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:07:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[89611]: pgmap v724: 121 pgs: 121 active+clean; 238 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 7.5 MiB/s wr, 18 op/s 2024-09-10T18:07:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[89611]: osdmap e695: 8 total, 8 up, 8 in 2024-09-10T18:07:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:07:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:07:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:07:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[92029]: pgmap v724: 121 pgs: 121 active+clean; 238 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 7.5 MiB/s wr, 18 op/s 2024-09-10T18:07:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[92029]: osdmap e695: 8 total, 8 up, 8 in 2024-09-10T18:07:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:07:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:07:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:07:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:26 smithi089 ceph-mon[84132]: pgmap v724: 121 pgs: 121 active+clean; 238 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 7.5 MiB/s wr, 18 op/s 2024-09-10T18:07:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:26 smithi089 ceph-mon[84132]: osdmap e695: 8 total, 8 up, 8 in 2024-09-10T18:07:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:26 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:07:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:26 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:07:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:26 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:07:28.060 INFO:tasks.rados.rados.0.smithi012.stdout:3094: done (2 left) 2024-09-10T18:07:28.060 INFO:tasks.rados.rados.0.smithi012.stdout:3096: done (1 left) 2024-09-10T18:07:28.061 INFO:tasks.rados.rados.0.smithi012.stdout:3097: done (0 left) 2024-09-10T18:07:28.061 INFO:tasks.rados.rados.0.smithi012.stdout:3098: copy_from oid 19 from oid 27 current snap is 305 2024-09-10T18:07:28.061 INFO:tasks.rados.rados.0.smithi012.stdout:3099: snap_remove snap 302 2024-09-10T18:07:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:27 smithi012 ceph-mon[89611]: osdmap e696: 8 total, 8 up, 8 in 2024-09-10T18:07:28.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:27 smithi012 ceph-mon[92029]: osdmap e696: 8 total, 8 up, 8 in 2024-09-10T18:07:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:27 smithi089 ceph-mon[84132]: osdmap e696: 8 total, 8 up, 8 in 2024-09-10T18:07:28.819 INFO:tasks.rados.rados.0.smithi012.stdout:3099: done (1 left) 2024-09-10T18:07:28.819 INFO:tasks.rados.rados.0.smithi012.stdout:3100: read oid 21 snap 299 2024-09-10T18:07:28.819 INFO:tasks.rados.rados.0.smithi012.stdout:3100: expect (ObjNum 914 snap 295 seq_num 914) 2024-09-10T18:07:28.819 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 305 2024-09-10T18:07:28.819 INFO:tasks.rados.rados.0.smithi012.stdout:3101: seq_num 965 ranges {10878976=565248,11444224=647168,12091392=548864,12640256=8192} 2024-09-10T18:07:28.882 INFO:tasks.rados.rados.0.smithi012.stdout:3101: writing smithi01278544-7 from 10878976 to 11444224 tid 1 2024-09-10T18:07:28.886 INFO:tasks.rados.rados.0.smithi012.stdout:3101: writing smithi01278544-7 from 11444224 to 12091392 tid 2 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3101: writing smithi01278544-7 from 12091392 to 12640256 tid 3 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3101: writing smithi01278544-7 from 12640256 to 12648448 tid 4 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3102: read oid 38 snap 301 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3102: expect (ObjNum 932 snap 297 seq_num 932) 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3103: delete oid 1 current snap is 305 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3098: finishing copy_from to smithi01278544-19 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3098: got expected ENOENT (src dne) 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3098: finishing copy_from racing read to smithi01278544-19 2024-09-10T18:07:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3100: expect (ObjNum 914 snap 295 seq_num 914) 2024-09-10T18:07:28.918 INFO:tasks.rados.rados.0.smithi012.stdout:3101: finishing write tid 1 to smithi01278544-7 2024-09-10T18:07:28.918 INFO:tasks.rados.rados.0.smithi012.stdout:3101: finishing write tid 2 to smithi01278544-7 2024-09-10T18:07:28.918 INFO:tasks.rados.rados.0.smithi012.stdout:3101: finishing write tid 3 to smithi01278544-7 2024-09-10T18:07:28.918 INFO:tasks.rados.rados.0.smithi012.stdout:3101: finishing write tid 4 to smithi01278544-7 2024-09-10T18:07:28.918 INFO:tasks.rados.rados.0.smithi012.stdout:3101: finishing write tid 5 to smithi01278544-7 2024-09-10T18:07:28.918 INFO:tasks.rados.rados.0.smithi012.stdout:3101: finishing write tid 6 to smithi01278544-7 2024-09-10T18:07:28.919 INFO:tasks.rados.rados.0.smithi012.stdout:3101: oid 7 updating version 0 to 1123 2024-09-10T18:07:28.919 INFO:tasks.rados.rados.0.smithi012.stdout:3101: oid 7 updating version 1123 to 1124 2024-09-10T18:07:28.919 INFO:tasks.rados.rados.0.smithi012.stdout:3101: oid 7 updating version 1124 to 1127 2024-09-10T18:07:28.919 INFO:tasks.rados.rados.0.smithi012.stdout:3101: oid 7 version 1127 is already newer than 1125 2024-09-10T18:07:28.919 INFO:tasks.rados.rados.0.smithi012.stdout:3101: oid 7 version 1127 is already newer than 1126 2024-09-10T18:07:28.919 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1127 (ObjNum 965 snap 305 seq_num 965) dirty exists 2024-09-10T18:07:28.919 INFO:tasks.rados.rados.0.smithi012.stdout:3101: left oid 7 (ObjNum 965 snap 305 seq_num 965) 2024-09-10T18:07:28.919 INFO:tasks.rados.rados.0.smithi012.stdout:3102: expect (ObjNum 932 snap 297 seq_num 932) 2024-09-10T18:07:29.072 INFO:tasks.rados.rados.0.smithi012.stdout:3098: done (4 left) 2024-09-10T18:07:29.072 INFO:tasks.rados.rados.0.smithi012.stdout:3100: done (3 left) 2024-09-10T18:07:29.072 INFO:tasks.rados.rados.0.smithi012.stdout:3101: done (2 left) 2024-09-10T18:07:29.073 INFO:tasks.rados.rados.0.smithi012.stdout:3102: done (1 left) 2024-09-10T18:07:29.073 INFO:tasks.rados.rados.0.smithi012.stdout:3103: done (0 left) 2024-09-10T18:07:29.073 INFO:tasks.rados.rados.0.smithi012.stdout:3104: read oid 27 snap -1 2024-09-10T18:07:29.073 INFO:tasks.rados.rados.0.smithi012.stdout:3104: expect deleted 2024-09-10T18:07:29.073 INFO:tasks.rados.rados.0.smithi012.stdout:3105: snap_remove snap 301 2024-09-10T18:07:29.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:28 smithi012 ceph-mon[89611]: pgmap v727: 121 pgs: 121 active+clean; 246 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 32 MiB/s rd, 5.2 MiB/s wr, 24 op/s 2024-09-10T18:07:29.185 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:28 smithi012 ceph-mon[92029]: pgmap v727: 121 pgs: 121 active+clean; 246 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 32 MiB/s rd, 5.2 MiB/s wr, 24 op/s 2024-09-10T18:07:29.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:28 smithi089 ceph-mon[84132]: pgmap v727: 121 pgs: 121 active+clean; 246 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 32 MiB/s rd, 5.2 MiB/s wr, 24 op/s 2024-09-10T18:07:29.824 INFO:tasks.rados.rados.0.smithi012.stdout:3105: done (1 left) 2024-09-10T18:07:29.824 INFO:tasks.rados.rados.0.smithi012.stdout:3106: snap_remove snap 300 2024-09-10T18:07:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:29 smithi012 ceph-mon[89611]: osdmap e697: 8 total, 8 up, 8 in 2024-09-10T18:07:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:29 smithi012 ceph-mon[89611]: pgmap v729: 121 pgs: 121 active+clean; 246 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 2.6 MiB/s wr, 16 op/s 2024-09-10T18:07:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:29 smithi012 ceph-mon[92029]: osdmap e697: 8 total, 8 up, 8 in 2024-09-10T18:07:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:29 smithi012 ceph-mon[92029]: pgmap v729: 121 pgs: 121 active+clean; 246 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 2.6 MiB/s wr, 16 op/s 2024-09-10T18:07:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:29 smithi089 ceph-mon[84132]: osdmap e697: 8 total, 8 up, 8 in 2024-09-10T18:07:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:29 smithi089 ceph-mon[84132]: pgmap v729: 121 pgs: 121 active+clean; 246 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 2.6 MiB/s wr, 16 op/s 2024-09-10T18:07:30.832 INFO:tasks.rados.rados.0.smithi012.stdout:3106: done (1 left) 2024-09-10T18:07:30.832 INFO:tasks.rados.rados.0.smithi012.stdout:3107: snap_create 2024-09-10T18:07:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:30 smithi012 ceph-mon[89611]: osdmap e698: 8 total, 8 up, 8 in 2024-09-10T18:07:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:30 smithi012 ceph-mon[92029]: osdmap e698: 8 total, 8 up, 8 in 2024-09-10T18:07:31.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:30 smithi089 ceph-mon[84132]: osdmap e698: 8 total, 8 up, 8 in 2024-09-10T18:07:31.838 INFO:tasks.rados.rados.0.smithi012.stdout:3104: done (1 left) 2024-09-10T18:07:31.838 INFO:tasks.rados.rados.0.smithi012.stdout:3107: done (0 left) 2024-09-10T18:07:31.839 INFO:tasks.rados.rados.0.smithi012.stdout:3108: delete oid 7 current snap is 306 2024-09-10T18:07:31.847 INFO:tasks.rados.rados.0.smithi012.stdout:3108: done (0 left) 2024-09-10T18:07:31.847 INFO:tasks.rados.rados.0.smithi012.stdout:3109: setattr oid 17 current snap is 306 2024-09-10T18:07:31.849 INFO:tasks.rados.rados.0.smithi012.stdout:3110: snap_remove snap 298 2024-09-10T18:07:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:31 smithi012 ceph-mon[89611]: osdmap e699: 8 total, 8 up, 8 in 2024-09-10T18:07:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:31 smithi012 ceph-mon[89611]: pgmap v732: 121 pgs: 121 active+clean; 236 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-10T18:07:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:31 smithi012 ceph-mon[92029]: osdmap e699: 8 total, 8 up, 8 in 2024-09-10T18:07:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:31 smithi012 ceph-mon[92029]: pgmap v732: 121 pgs: 121 active+clean; 236 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-10T18:07:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:32.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:31 smithi089 ceph-mon[84132]: osdmap e699: 8 total, 8 up, 8 in 2024-09-10T18:07:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:31 smithi089 ceph-mon[84132]: pgmap v732: 121 pgs: 121 active+clean; 236 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-10T18:07:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:32.856 INFO:tasks.rados.rados.0.smithi012.stdout:3110: done (1 left) 2024-09-10T18:07:32.856 INFO:tasks.rados.rados.0.smithi012.stdout:3111: snap_create 2024-09-10T18:07:32.856 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 1206 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:07:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:32 smithi012 ceph-mon[89611]: osdmap e700: 8 total, 8 up, 8 in 2024-09-10T18:07:33.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:32 smithi012 ceph-mon[92029]: osdmap e700: 8 total, 8 up, 8 in 2024-09-10T18:07:33.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:32 smithi089 ceph-mon[84132]: osdmap e700: 8 total, 8 up, 8 in 2024-09-10T18:07:33.853 INFO:tasks.rados.rados.0.smithi012.stdout:3109: done (1 left) 2024-09-10T18:07:33.853 INFO:tasks.rados.rados.0.smithi012.stdout:3111: done (0 left) 2024-09-10T18:07:33.854 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 307 2024-09-10T18:07:33.854 INFO:tasks.rados.rados.0.smithi012.stdout:3112: seq_num 968 ranges {1736704=614400,2351104=745472,3096576=458752} 2024-09-10T18:07:33.866 INFO:tasks.rados.rados.0.smithi012.stdout:3112: writing smithi01278544-46 from 1736704 to 2351104 tid 1 2024-09-10T18:07:33.870 INFO:tasks.rados.rados.0.smithi012.stdout:3112: writing smithi01278544-46 from 2351104 to 3096576 tid 2 2024-09-10T18:07:33.874 INFO:tasks.rados.rados.0.smithi012.stdout:3112: writing smithi01278544-46 from 3096576 to 3555328 tid 3 2024-09-10T18:07:33.874 INFO:tasks.rados.rados.0.smithi012.stdout:3113: read oid 11 snap -1 2024-09-10T18:07:33.874 INFO:tasks.rados.rados.0.smithi012.stdout:3113: expect (ObjNum 961 snap 303 seq_num 961) 2024-09-10T18:07:33.874 INFO:tasks.rados.rados.0.smithi012.stdout:3114: setattr oid 38 current snap is 307 2024-09-10T18:07:33.876 INFO:tasks.rados.rados.0.smithi012.stdout:3115: snap_remove snap 305 2024-09-10T18:07:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:33 smithi012 ceph-mon[89611]: osdmap e701: 8 total, 8 up, 8 in 2024-09-10T18:07:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:33 smithi012 ceph-mon[89611]: pgmap v735: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 432 KiB/s wr, 4 op/s 2024-09-10T18:07:34.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:33 smithi012 ceph-mon[92029]: osdmap e701: 8 total, 8 up, 8 in 2024-09-10T18:07:34.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:33 smithi012 ceph-mon[92029]: pgmap v735: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 432 KiB/s wr, 4 op/s 2024-09-10T18:07:34.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:33 smithi089 ceph-mon[84132]: osdmap e701: 8 total, 8 up, 8 in 2024-09-10T18:07:34.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:33 smithi089 ceph-mon[84132]: pgmap v735: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 432 KiB/s wr, 4 op/s 2024-09-10T18:07:34.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:07:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:07:34] "GET /metrics HTTP/1.1" 200 36356 "" "Prometheus/2.51.0" 2024-09-10T18:07:34.858 INFO:tasks.rados.rados.0.smithi012.stdout:3115: done (3 left) 2024-09-10T18:07:34.858 INFO:tasks.rados.rados.0.smithi012.stdout:3116: snap_remove snap 306 2024-09-10T18:07:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:34 smithi012 ceph-mon[89611]: osdmap e702: 8 total, 8 up, 8 in 2024-09-10T18:07:35.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:34 smithi012 ceph-mon[92029]: osdmap e702: 8 total, 8 up, 8 in 2024-09-10T18:07:35.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:34 smithi089 ceph-mon[84132]: osdmap e702: 8 total, 8 up, 8 in 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3116: done (3 left) 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3117: snap_create 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3112: finishing write tid 1 to smithi01278544-46 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3112: finishing write tid 2 to smithi01278544-46 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3112: finishing write tid 3 to smithi01278544-46 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3112: finishing write tid 4 to smithi01278544-46 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 2000 (ObjNum 956 snap 303 seq_num 956) dirty exists 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3112: finishing write tid 5 to smithi01278544-46 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3112: oid 46 updating version 0 to 1631 2024-09-10T18:07:35.871 INFO:tasks.rados.rados.0.smithi012.stdout:3112: oid 46 version 1631 is already newer than 1630 2024-09-10T18:07:35.872 INFO:tasks.rados.rados.0.smithi012.stdout:3112: oid 46 version 1631 is already newer than 1629 2024-09-10T18:07:35.872 INFO:tasks.rados.rados.0.smithi012.stdout:3112: oid 46 updating version 1631 to 1632 2024-09-10T18:07:35.872 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 1632 (ObjNum 968 snap 307 seq_num 968) dirty exists 2024-09-10T18:07:35.872 INFO:tasks.rados.rados.0.smithi012.stdout:3112: left oid 46 (ObjNum 968 snap 307 seq_num 968) 2024-09-10T18:07:35.872 INFO:tasks.rados.rados.0.smithi012.stdout:3113: expect (ObjNum 961 snap 303 seq_num 961) 2024-09-10T18:07:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:35 smithi012 ceph-mon[89611]: osdmap e703: 8 total, 8 up, 8 in 2024-09-10T18:07:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:35 smithi012 ceph-mon[89611]: pgmap v738: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.1 MiB/s rd, 432 KiB/s wr, 9 op/s 2024-09-10T18:07:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:35 smithi012 ceph-mon[92029]: osdmap e703: 8 total, 8 up, 8 in 2024-09-10T18:07:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:35 smithi012 ceph-mon[92029]: pgmap v738: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.1 MiB/s rd, 432 KiB/s wr, 9 op/s 2024-09-10T18:07:36.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:35 smithi089 ceph-mon[84132]: osdmap e703: 8 total, 8 up, 8 in 2024-09-10T18:07:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:35 smithi089 ceph-mon[84132]: pgmap v738: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.1 MiB/s rd, 432 KiB/s wr, 9 op/s 2024-09-10T18:07:36.869 INFO:tasks.rados.rados.0.smithi012.stdout:3112: done (3 left) 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3113: done (2 left) 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3114: done (1 left) 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3117: done (0 left) 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3118: rmattr oid 20 current snap is 308 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3119: rollback oid 4 current snap is 308 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 299 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3120: rmattr oid 41 current snap is 308 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3121: read oid 27 snap 304 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3121: expect deleted 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3122: read oid 21 snap 299 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:3122: expect (ObjNum 914 snap 295 seq_num 914) 2024-09-10T18:07:36.870 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 308 2024-09-10T18:07:36.871 INFO:tasks.rados.rados.0.smithi012.stdout:3123: seq_num 969 ranges {2752512=638976,3391488=630784,4022272=532480,4554752=40960} 2024-09-10T18:07:36.888 INFO:tasks.rados.rados.0.smithi012.stdout:3123: writing smithi01278544-42 from 2752512 to 3391488 tid 1 2024-09-10T18:07:36.892 INFO:tasks.rados.rados.0.smithi012.stdout:3123: writing smithi01278544-42 from 3391488 to 4022272 tid 2 2024-09-10T18:07:36.895 INFO:tasks.rados.rados.0.smithi012.stdout:3123: writing smithi01278544-42 from 4022272 to 4554752 tid 3 2024-09-10T18:07:36.896 INFO:tasks.rados.rados.0.smithi012.stdout:3123: writing smithi01278544-42 from 4554752 to 4595712 tid 4 2024-09-10T18:07:36.896 INFO:tasks.rados.rados.0.smithi012.stdout:3124: delete oid 44 current snap is 308 2024-09-10T18:07:36.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2239 (ObjNum 850 snap 277 seq_num 850) dirty exists 2024-09-10T18:07:36.896 INFO:tasks.rados.rados.0.smithi012.stdout:3119: finishing rollback tid 0 to smithi01278544-4 2024-09-10T18:07:36.896 INFO:tasks.rados.rados.0.smithi012.stdout:3119: finishing rollback tid 1 to smithi01278544-4 2024-09-10T18:07:36.896 INFO:tasks.rados.rados.0.smithi012.stdout:3119: finishing rollback tid 2 to smithi01278544-4 2024-09-10T18:07:36.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2181 (ObjNum 935 snap 298 seq_num 935) dirty exists 2024-09-10T18:07:36.896 INFO:tasks.rados.rados.0.smithi012.stdout:3122: expect (ObjNum 914 snap 295 seq_num 914) 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 2182 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3123: finishing write tid 1 to smithi01278544-42 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3123: finishing write tid 2 to smithi01278544-42 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3123: finishing write tid 3 to smithi01278544-42 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3118: done (6 left) 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3119: done (5 left) 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3120: done (4 left) 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3121: done (3 left) 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3122: done (2 left) 2024-09-10T18:07:36.922 INFO:tasks.rados.rados.0.smithi012.stdout:3124: done (1 left) 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3125: rmattr oid 10 current snap is 308 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3125: done (1 left) 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3126: rollback oid 16 current snap is 308 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 304 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3123: finishing write tid 4 to smithi01278544-42 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3123: finishing write tid 5 to smithi01278544-42 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3123: finishing write tid 6 to smithi01278544-42 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3123: oid 42 updating version 0 to 2211 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3123: oid 42 version 2211 is already newer than 2209 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3123: oid 42 version 2211 is already newer than 2207 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3123: oid 42 version 2211 is already newer than 2208 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:3123: oid 42 version 2211 is already newer than 2210 2024-09-10T18:07:36.923 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2211 (ObjNum 969 snap 308 seq_num 969) dirty exists 2024-09-10T18:07:36.924 INFO:tasks.rados.rados.0.smithi012.stdout:3123: left oid 42 (ObjNum 969 snap 308 seq_num 969) 2024-09-10T18:07:36.924 INFO:tasks.rados.rados.0.smithi012.stdout:3123: done (1 left) 2024-09-10T18:07:36.924 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 308 2024-09-10T18:07:36.924 INFO:tasks.rados.rados.0.smithi012.stdout:3127: seq_num 971 ranges {0=671744,671744=802816,1474560=401408} 2024-09-10T18:07:36.925 INFO:tasks.rados.rados.0.smithi012.stdout:3127: writing smithi01278544-27 from 0 to 671744 tid 1 2024-09-10T18:07:36.931 INFO:tasks.rados.rados.0.smithi012.stdout:3127: writing smithi01278544-27 from 671744 to 1474560 tid 2 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3127: writing smithi01278544-27 from 1474560 to 1875968 tid 3 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3128: read oid 8 snap 304 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3128: expect (ObjNum 918 snap 295 seq_num 918) 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3129: copy_from oid 43 from oid 4 current snap is 308 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3126: finishing rollback tid 0 to smithi01278544-16 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 308 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3127: finishing write tid 1 to smithi01278544-27 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3126: finishing rollback tid 1 to smithi01278544-16 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3126: finishing rollback tid 2 to smithi01278544-16 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 2083 (ObjNum 856 snap 278 seq_num 856) dirty exists 2024-09-10T18:07:36.934 INFO:tasks.rados.rados.0.smithi012.stdout:3130: seq_num 972 ranges {0=688128,688128=688128,1376256=516096} 2024-09-10T18:07:36.937 INFO:tasks.rados.rados.0.smithi012.stdout:3130: writing smithi01278544-39 from 0 to 688128 tid 1 2024-09-10T18:07:36.942 INFO:tasks.rados.rados.0.smithi012.stdout:3130: writing smithi01278544-39 from 688128 to 1376256 tid 2 2024-09-10T18:07:36.945 INFO:tasks.rados.rados.0.smithi012.stdout:3130: writing smithi01278544-39 from 1376256 to 1892352 tid 3 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3126: done (4 left) 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3131: rollback oid 37 current snap is 308 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 37 to 299 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3127: finishing write tid 2 to smithi01278544-27 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3127: finishing write tid 3 to smithi01278544-27 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3127: finishing write tid 4 to smithi01278544-27 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 308 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3127: finishing write tid 5 to smithi01278544-27 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3127: oid 27 updating version 0 to 1634 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3127: oid 27 updating version 1634 to 1636 2024-09-10T18:07:36.946 INFO:tasks.rados.rados.0.smithi012.stdout:3127: oid 27 version 1636 is already newer than 1635 2024-09-10T18:07:36.947 INFO:tasks.rados.rados.0.smithi012.stdout:3127: oid 27 updating version 1636 to 1637 2024-09-10T18:07:36.947 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 1637 (ObjNum 971 snap 308 seq_num 971) dirty exists 2024-09-10T18:07:36.947 INFO:tasks.rados.rados.0.smithi012.stdout:3127: left oid 27 (ObjNum 971 snap 308 seq_num 971) 2024-09-10T18:07:36.947 INFO:tasks.rados.rados.0.smithi012.stdout:3128: expect (ObjNum 918 snap 295 seq_num 918) 2024-09-10T18:07:36.975 INFO:tasks.rados.rados.0.smithi012.stdout:3130: finishing write tid 1 to smithi01278544-39 2024-09-10T18:07:36.975 INFO:tasks.rados.rados.0.smithi012.stdout:3132: seq_num 973 ranges {3653632=704512,4358144=573440,4931584=507904,5439488=122880} 2024-09-10T18:07:36.999 INFO:tasks.rados.rados.0.smithi012.stdout:3132: writing smithi01278544-20 from 3653632 to 4358144 tid 1 2024-09-10T18:07:37.002 INFO:tasks.rados.rados.0.smithi012.stdout:3132: writing smithi01278544-20 from 4358144 to 4931584 tid 2 2024-09-10T18:07:37.004 INFO:tasks.rados.rados.0.smithi012.stdout:3132: writing smithi01278544-20 from 4931584 to 5439488 tid 3 2024-09-10T18:07:37.006 INFO:tasks.rados.rados.0.smithi012.stdout:3132: writing smithi01278544-20 from 5439488 to 5562368 tid 4 2024-09-10T18:07:37.006 INFO:tasks.rados.rados.0.smithi012.stdout:3127: done (5 left) 2024-09-10T18:07:37.006 INFO:tasks.rados.rados.0.smithi012.stdout:3128: done (4 left) 2024-09-10T18:07:37.006 INFO:tasks.rados.rados.0.smithi012.stdout:3133: snap_create 2024-09-10T18:07:37.006 INFO:tasks.rados.rados.0.smithi012.stdout:3131: finishing rollback tid 1 to smithi01278544-37 2024-09-10T18:07:37.006 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 0 (ObjNum 33 snap 0 seq_num 3496509136) dirty dne 2024-09-10T18:07:37.006 INFO:tasks.rados.rados.0.smithi012.stdout:3130: finishing write tid 2 to smithi01278544-39 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3130: finishing write tid 3 to smithi01278544-39 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3130: finishing write tid 4 to smithi01278544-39 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3130: finishing write tid 5 to smithi01278544-39 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3130: oid 39 updating version 0 to 2241 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3130: oid 39 updating version 2241 to 2243 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3130: oid 39 version 2243 is already newer than 2240 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3130: oid 39 version 2243 is already newer than 2242 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2243 (ObjNum 972 snap 308 seq_num 972) dirty exists 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3130: left oid 39 (ObjNum 972 snap 308 seq_num 972) 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3129: finishing copy_from racing read to smithi01278544-43 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3129: finishing copy_from to smithi01278544-43 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2181 (ObjNum 935 snap 298 seq_num 935) dirty exists 2024-09-10T18:07:37.007 INFO:tasks.rados.rados.0.smithi012.stdout:3132: finishing write tid 1 to smithi01278544-20 2024-09-10T18:07:37.008 INFO:tasks.rados.rados.0.smithi012.stdout:3132: finishing write tid 2 to smithi01278544-20 2024-09-10T18:07:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:3132: finishing write tid 3 to smithi01278544-20 2024-09-10T18:07:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:3132: finishing write tid 4 to smithi01278544-20 2024-09-10T18:07:37.010 INFO:tasks.rados.rados.0.smithi012.stdout:3132: finishing write tid 5 to smithi01278544-20 2024-09-10T18:07:37.012 INFO:tasks.rados.rados.0.smithi012.stdout:3132: finishing write tid 6 to smithi01278544-20 2024-09-10T18:07:37.012 INFO:tasks.rados.rados.0.smithi012.stdout:3132: oid 20 updating version 0 to 2245 2024-09-10T18:07:37.013 INFO:tasks.rados.rados.0.smithi012.stdout:3132: oid 20 updating version 2245 to 2246 2024-09-10T18:07:37.013 INFO:tasks.rados.rados.0.smithi012.stdout:3132: oid 20 updating version 2246 to 2247 2024-09-10T18:07:37.013 INFO:tasks.rados.rados.0.smithi012.stdout:3132: oid 20 version 2247 is already newer than 2244 2024-09-10T18:07:37.013 INFO:tasks.rados.rados.0.smithi012.stdout:3132: oid 20 updating version 2247 to 2248 2024-09-10T18:07:37.013 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2248 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:07:37.013 INFO:tasks.rados.rados.0.smithi012.stdout:3132: left oid 20 (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:07:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:36 smithi012 ceph-mon[89611]: osdmap e704: 8 total, 8 up, 8 in 2024-09-10T18:07:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:36 smithi012 ceph-mon[92029]: osdmap e704: 8 total, 8 up, 8 in 2024-09-10T18:07:37.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:36 smithi089 ceph-mon[84132]: osdmap e704: 8 total, 8 up, 8 in 2024-09-10T18:07:37.792 INFO:tasks.rados.rados.0.smithi012.stdout:3129: done (4 left) 2024-09-10T18:07:37.792 INFO:tasks.rados.rados.0.smithi012.stdout:3130: done (3 left) 2024-09-10T18:07:37.792 INFO:tasks.rados.rados.0.smithi012.stdout:3131: done (2 left) 2024-09-10T18:07:37.792 INFO:tasks.rados.rados.0.smithi012.stdout:3132: done (1 left) 2024-09-10T18:07:37.792 INFO:tasks.rados.rados.0.smithi012.stdout:3133: done (0 left) 2024-09-10T18:07:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:3134: rmattr oid 26 current snap is 309 2024-09-10T18:07:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:3134: done (0 left) 2024-09-10T18:07:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:3135: rollback oid 26 current snap is 309 2024-09-10T18:07:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 26 to 303 2024-09-10T18:07:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 309 2024-09-10T18:07:37.793 INFO:tasks.rados.rados.0.smithi012.stdout:3136: seq_num 974 ranges {0=720896,720896=507904,1228800=671744,1900544=24576} 2024-09-10T18:07:37.796 INFO:tasks.rados.rados.0.smithi012.stdout:3136: writing smithi01278544-9 from 0 to 720896 tid 1 2024-09-10T18:07:37.799 INFO:tasks.rados.rados.0.smithi012.stdout:3136: writing smithi01278544-9 from 720896 to 1228800 tid 2 2024-09-10T18:07:37.803 INFO:tasks.rados.rados.0.smithi012.stdout:3136: writing smithi01278544-9 from 1228800 to 1900544 tid 3 2024-09-10T18:07:37.803 INFO:tasks.rados.rados.0.smithi012.stdout:3136: writing smithi01278544-9 from 1900544 to 1925120 tid 4 2024-09-10T18:07:37.803 INFO:tasks.rados.rados.0.smithi012.stdout:3137: snap_remove snap 304 2024-09-10T18:07:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:37 smithi012 ceph-mon[89611]: osdmap e705: 8 total, 8 up, 8 in 2024-09-10T18:07:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:37 smithi012 ceph-mon[89611]: pgmap v741: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 444 KiB/s wr, 9 op/s 2024-09-10T18:07:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:37 smithi012 ceph-mon[89611]: osdmap e706: 8 total, 8 up, 8 in 2024-09-10T18:07:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:37 smithi012 ceph-mon[92029]: osdmap e705: 8 total, 8 up, 8 in 2024-09-10T18:07:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:37 smithi012 ceph-mon[92029]: pgmap v741: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 444 KiB/s wr, 9 op/s 2024-09-10T18:07:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:37 smithi012 ceph-mon[92029]: osdmap e706: 8 total, 8 up, 8 in 2024-09-10T18:07:38.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:37 smithi089 ceph-mon[84132]: osdmap e705: 8 total, 8 up, 8 in 2024-09-10T18:07:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:37 smithi089 ceph-mon[84132]: pgmap v741: 121 pgs: 121 active+clean; 238 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 444 KiB/s wr, 9 op/s 2024-09-10T18:07:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:37 smithi089 ceph-mon[84132]: osdmap e706: 8 total, 8 up, 8 in 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3137: done (2 left) 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3138: setattr oid 5 current snap is 309 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3135: finishing rollback tid 0 to smithi01278544-26 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3135: finishing rollback tid 1 to smithi01278544-26 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3135: finishing rollback tid 2 to smithi01278544-26 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2021 (ObjNum 903 snap 294 seq_num 903) dirty exists 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3136: finishing write tid 1 to smithi01278544-9 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3136: finishing write tid 2 to smithi01278544-9 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3136: finishing write tid 3 to smithi01278544-9 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3136: finishing write tid 4 to smithi01278544-9 2024-09-10T18:07:38.793 INFO:tasks.rados.rados.0.smithi012.stdout:3136: finishing write tid 5 to smithi01278544-9 2024-09-10T18:07:38.794 INFO:tasks.rados.rados.0.smithi012.stdout:3136: finishing write tid 6 to smithi01278544-9 2024-09-10T18:07:38.794 INFO:tasks.rados.rados.0.smithi012.stdout:3136: oid 9 updating version 0 to 2005 2024-09-10T18:07:38.794 INFO:tasks.rados.rados.0.smithi012.stdout:3136: oid 9 version 2005 is already newer than 2004 2024-09-10T18:07:38.794 INFO:tasks.rados.rados.0.smithi012.stdout:3136: oid 9 version 2005 is already newer than 2002 2024-09-10T18:07:38.794 INFO:tasks.rados.rados.0.smithi012.stdout:3136: oid 9 version 2005 is already newer than 2001 2024-09-10T18:07:38.794 INFO:tasks.rados.rados.0.smithi012.stdout:3136: oid 9 version 2005 is already newer than 2003 2024-09-10T18:07:38.794 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 2005 (ObjNum 974 snap 309 seq_num 974) dirty exists 2024-09-10T18:07:38.794 INFO:tasks.rados.rados.0.smithi012.stdout:3136: left oid 9 (ObjNum 974 snap 309 seq_num 974) 2024-09-10T18:07:38.795 INFO:tasks.rados.rados.0.smithi012.stdout:3135: done (2 left) 2024-09-10T18:07:38.795 INFO:tasks.rados.rados.0.smithi012.stdout:3136: done (1 left) 2024-09-10T18:07:38.795 INFO:tasks.rados.rados.0.smithi012.stdout:3139: read oid 43 snap -1 2024-09-10T18:07:38.795 INFO:tasks.rados.rados.0.smithi012.stdout:3139: expect (ObjNum 935 snap 298 seq_num 935) 2024-09-10T18:07:38.795 INFO:tasks.rados.rados.0.smithi012.stdout:3140: snap_create 2024-09-10T18:07:38.801 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 1207 (ObjNum 892 snap 292 seq_num 892) dirty exists 2024-09-10T18:07:38.846 INFO:tasks.rados.rados.0.smithi012.stdout:3139: expect (ObjNum 935 snap 298 seq_num 935) 2024-09-10T18:07:39.972 INFO:tasks.rados.rados.0.smithi012.stdout:3138: done (2 left) 2024-09-10T18:07:39.972 INFO:tasks.rados.rados.0.smithi012.stdout:3139: done (1 left) 2024-09-10T18:07:39.972 INFO:tasks.rados.rados.0.smithi012.stdout:3140: done (0 left) 2024-09-10T18:07:39.972 INFO:tasks.rados.rados.0.smithi012.stdout:3141: delete oid 30 current snap is 310 2024-09-10T18:07:39.980 INFO:tasks.rados.rados.0.smithi012.stdout:3141: done (0 left) 2024-09-10T18:07:39.980 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 310 2024-09-10T18:07:39.980 INFO:tasks.rados.rados.0.smithi012.stdout:3142: seq_num 976 ranges {11943936=753664,12697600=671744,13369344=532480} 2024-09-10T18:07:40.050 INFO:tasks.rados.rados.0.smithi012.stdout:3142: writing smithi01278544-4 from 11943936 to 12697600 tid 1 2024-09-10T18:07:40.054 INFO:tasks.rados.rados.0.smithi012.stdout:3142: writing smithi01278544-4 from 12697600 to 13369344 tid 2 2024-09-10T18:07:40.058 INFO:tasks.rados.rados.0.smithi012.stdout:3142: writing smithi01278544-4 from 13369344 to 13901824 tid 3 2024-09-10T18:07:40.058 INFO:tasks.rados.rados.0.smithi012.stdout:3143: rmattr oid 39 current snap is 310 2024-09-10T18:07:40.058 INFO:tasks.rados.rados.0.smithi012.stdout:3143: done (1 left) 2024-09-10T18:07:40.058 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 310 2024-09-10T18:07:40.058 INFO:tasks.rados.rados.0.smithi012.stdout:3142: finishing write tid 1 to smithi01278544-4 2024-09-10T18:07:40.058 INFO:tasks.rados.rados.0.smithi012.stdout:3142: finishing write tid 2 to smithi01278544-4 2024-09-10T18:07:40.058 INFO:tasks.rados.rados.0.smithi012.stdout:3144: seq_num 977 ranges {3457024=770048,4227072=557056,4784128=491520,5275648=155648} 2024-09-10T18:07:40.080 INFO:tasks.rados.rados.0.smithi012.stdout:3144: writing smithi01278544-32 from 3457024 to 4227072 tid 1 2024-09-10T18:07:40.083 INFO:tasks.rados.rados.0.smithi012.stdout:3144: writing smithi01278544-32 from 4227072 to 4784128 tid 2 2024-09-10T18:07:40.086 INFO:tasks.rados.rados.0.smithi012.stdout:3144: writing smithi01278544-32 from 4784128 to 5275648 tid 3 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3144: writing smithi01278544-32 from 5275648 to 5431296 tid 4 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3145: delete oid 50 current snap is 310 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3142: finishing write tid 3 to smithi01278544-4 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3142: finishing write tid 4 to smithi01278544-4 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3142: finishing write tid 5 to smithi01278544-4 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3142: oid 4 updating version 0 to 2185 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3142: oid 4 version 2185 is already newer than 2184 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3142: oid 4 version 2185 is already newer than 2183 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:3142: oid 4 updating version 2185 to 2186 2024-09-10T18:07:40.088 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2186 (ObjNum 976 snap 310 seq_num 976) dirty exists 2024-09-10T18:07:40.089 INFO:tasks.rados.rados.0.smithi012.stdout:3142: left oid 4 (ObjNum 976 snap 310 seq_num 976) 2024-09-10T18:07:40.089 INFO:tasks.rados.rados.0.smithi012.stdout:3144: finishing write tid 1 to smithi01278544-32 2024-09-10T18:07:40.089 INFO:tasks.rados.rados.0.smithi012.stdout:3144: finishing write tid 2 to smithi01278544-32 2024-09-10T18:07:40.091 INFO:tasks.rados.rados.0.smithi012.stdout:3144: finishing write tid 3 to smithi01278544-32 2024-09-10T18:07:40.091 INFO:tasks.rados.rados.0.smithi012.stdout:3142: done (2 left) 2024-09-10T18:07:40.091 INFO:tasks.rados.rados.0.smithi012.stdout:3145: done (1 left) 2024-09-10T18:07:40.092 INFO:tasks.rados.rados.0.smithi012.stdout:3146: copy_from oid 35 from oid 7 current snap is 310 2024-09-10T18:07:40.092 INFO:tasks.rados.rados.0.smithi012.stdout:3147: rmattr oid 43 current snap is 310 2024-09-10T18:07:40.092 INFO:tasks.rados.rados.0.smithi012.stdout:3148: snap_remove snap 303 2024-09-10T18:07:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:39 smithi012 ceph-mon[89611]: osdmap e707: 8 total, 8 up, 8 in 2024-09-10T18:07:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:39 smithi012 ceph-mon[92029]: osdmap e707: 8 total, 8 up, 8 in 2024-09-10T18:07:40.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:39 smithi089 ceph-mon[84132]: osdmap e707: 8 total, 8 up, 8 in 2024-09-10T18:07:40.805 INFO:tasks.rados.rados.0.smithi012.stdout:3148: done (3 left) 2024-09-10T18:07:40.805 INFO:tasks.rados.rados.0.smithi012.stdout:3149: setattr oid 34 current snap is 310 2024-09-10T18:07:40.808 INFO:tasks.rados.rados.0.smithi012.stdout:3144: finishing write tid 4 to smithi01278544-32 2024-09-10T18:07:40.808 INFO:tasks.rados.rados.0.smithi012.stdout:3144: finishing write tid 5 to smithi01278544-32 2024-09-10T18:07:40.808 INFO:tasks.rados.rados.0.smithi012.stdout:3144: finishing write tid 6 to smithi01278544-32 2024-09-10T18:07:40.808 INFO:tasks.rados.rados.0.smithi012.stdout:3144: oid 32 updating version 0 to 2033 2024-09-10T18:07:40.808 INFO:tasks.rados.rados.0.smithi012.stdout:3144: oid 32 version 2033 is already newer than 2032 2024-09-10T18:07:40.808 INFO:tasks.rados.rados.0.smithi012.stdout:3144: oid 32 version 2033 is already newer than 2031 2024-09-10T18:07:40.808 INFO:tasks.rados.rados.0.smithi012.stdout:3144: oid 32 updating version 2033 to 2035 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3144: oid 32 version 2035 is already newer than 2034 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2035 (ObjNum 977 snap 310 seq_num 977) dirty exists 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3144: left oid 32 (ObjNum 977 snap 310 seq_num 977) 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3146: finishing copy_from to smithi01278544-35 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3146: got expected ENOENT (src dne) 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3146: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2219 (ObjNum 935 snap 298 seq_num 935) dirty exists 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3144: done (3 left) 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3146: done (2 left) 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3147: done (1 left) 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3150: copy_from oid 3 from oid 9 current snap is 310 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3151: read oid 44 snap -1 2024-09-10T18:07:40.809 INFO:tasks.rados.rados.0.smithi012.stdout:3151: expect deleted 2024-09-10T18:07:40.810 INFO:tasks.rados.rados.0.smithi012.stdout:3152: read oid 49 snap 307 2024-09-10T18:07:40.810 INFO:tasks.rados.rados.0.smithi012.stdout:3152: expect (ObjNum 945 snap 298 seq_num 945) 2024-09-10T18:07:40.810 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 310 2024-09-10T18:07:40.810 INFO:tasks.rados.rados.0.smithi012.stdout:3153: seq_num 979 ranges {3162112=802816,3964928=729088,4694016=458752,5152768=16384} 2024-09-10T18:07:40.831 INFO:tasks.rados.rados.0.smithi012.stdout:3153: writing smithi01278544-29 from 3162112 to 3964928 tid 1 2024-09-10T18:07:40.835 INFO:tasks.rados.rados.0.smithi012.stdout:3153: writing smithi01278544-29 from 3964928 to 4694016 tid 2 2024-09-10T18:07:40.838 INFO:tasks.rados.rados.0.smithi012.stdout:3153: writing smithi01278544-29 from 4694016 to 5152768 tid 3 2024-09-10T18:07:40.838 INFO:tasks.rados.rados.0.smithi012.stdout:3153: writing smithi01278544-29 from 5152768 to 5169152 tid 4 2024-09-10T18:07:40.838 INFO:tasks.rados.rados.0.smithi012.stdout:3154: snap_remove snap 308 2024-09-10T18:07:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:40 smithi012 ceph-mon[89611]: pgmap v744: 121 pgs: 121 active+clean; 240 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 914 KiB/s wr, 10 op/s 2024-09-10T18:07:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:40 smithi012 ceph-mon[89611]: osdmap e708: 8 total, 8 up, 8 in 2024-09-10T18:07:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:40 smithi012 ceph-mon[92029]: pgmap v744: 121 pgs: 121 active+clean; 240 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 914 KiB/s wr, 10 op/s 2024-09-10T18:07:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:40 smithi012 ceph-mon[92029]: osdmap e708: 8 total, 8 up, 8 in 2024-09-10T18:07:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:40 smithi089 ceph-mon[84132]: pgmap v744: 121 pgs: 121 active+clean; 240 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 914 KiB/s wr, 10 op/s 2024-09-10T18:07:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:40 smithi089 ceph-mon[84132]: osdmap e708: 8 total, 8 up, 8 in 2024-09-10T18:07:41.812 INFO:tasks.rados.rados.0.smithi012.stdout:3154: done (5 left) 2024-09-10T18:07:41.812 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 310 2024-09-10T18:07:41.812 INFO:tasks.rados.rados.0.smithi012.stdout:3155: seq_num 980 ranges {5029888=417792,5447680=614400,6062080=663552,6725632=327680} 2024-09-10T18:07:41.842 INFO:tasks.rados.rados.0.smithi012.stdout:3155: writing smithi01278544-33 from 5029888 to 5447680 tid 1 2024-09-10T18:07:41.845 INFO:tasks.rados.rados.0.smithi012.stdout:3155: writing smithi01278544-33 from 5447680 to 6062080 tid 2 2024-09-10T18:07:41.849 INFO:tasks.rados.rados.0.smithi012.stdout:3155: writing smithi01278544-33 from 6062080 to 6725632 tid 3 2024-09-10T18:07:41.851 INFO:tasks.rados.rados.0.smithi012.stdout:3155: writing smithi01278544-33 from 6725632 to 7053312 tid 4 2024-09-10T18:07:41.852 INFO:tasks.rados.rados.0.smithi012.stdout:3156: snap_create 2024-09-10T18:07:41.852 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1260 (ObjNum 946 snap 299 seq_num 946) dirty exists 2024-09-10T18:07:41.852 INFO:tasks.rados.rados.0.smithi012.stdout:3150: finishing copy_from racing read to smithi01278544-3 2024-09-10T18:07:41.852 INFO:tasks.rados.rados.0.smithi012.stdout:3152: expect (ObjNum 945 snap 298 seq_num 945) 2024-09-10T18:07:41.937 INFO:tasks.rados.rados.0.smithi012.stdout:3150: finishing copy_from to smithi01278544-3 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 2005 (ObjNum 974 snap 309 seq_num 974) dirty exists 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: finishing write tid 1 to smithi01278544-29 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: finishing write tid 2 to smithi01278544-29 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: finishing write tid 3 to smithi01278544-29 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: finishing write tid 4 to smithi01278544-29 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: finishing write tid 5 to smithi01278544-29 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: finishing write tid 6 to smithi01278544-29 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: oid 29 updating version 0 to 1130 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: oid 29 updating version 1130 to 1131 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: oid 29 updating version 1131 to 1132 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: oid 29 version 1132 is already newer than 1128 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:3153: oid 29 version 1132 is already newer than 1129 2024-09-10T18:07:41.938 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1132 (ObjNum 979 snap 310 seq_num 979) dirty exists 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3153: left oid 29 (ObjNum 979 snap 310 seq_num 979) 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: finishing write tid 1 to smithi01278544-33 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: finishing write tid 2 to smithi01278544-33 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: finishing write tid 3 to smithi01278544-33 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: finishing write tid 4 to smithi01278544-33 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: finishing write tid 5 to smithi01278544-33 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: finishing write tid 6 to smithi01278544-33 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: oid 33 updating version 0 to 2229 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: oid 33 updating version 2229 to 2230 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: oid 33 version 2230 is already newer than 2228 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: oid 33 version 2230 is already newer than 2227 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: oid 33 updating version 2230 to 2231 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 2231 (ObjNum 980 snap 310 seq_num 980) dirty exists 2024-09-10T18:07:41.939 INFO:tasks.rados.rados.0.smithi012.stdout:3155: left oid 33 (ObjNum 980 snap 310 seq_num 980) 2024-09-10T18:07:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:41 smithi012 ceph-mon[92029]: osdmap e709: 8 total, 8 up, 8 in 2024-09-10T18:07:42.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:41 smithi012 ceph-mon[89611]: osdmap e709: 8 total, 8 up, 8 in 2024-09-10T18:07:42.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:41 smithi089 ceph-mon[84132]: osdmap e709: 8 total, 8 up, 8 in 2024-09-10T18:07:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:3149: done (6 left) 2024-09-10T18:07:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:3150: done (5 left) 2024-09-10T18:07:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:3151: done (4 left) 2024-09-10T18:07:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:3152: done (3 left) 2024-09-10T18:07:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:3153: done (2 left) 2024-09-10T18:07:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:3155: done (1 left) 2024-09-10T18:07:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:3156: done (0 left) 2024-09-10T18:07:42.791 INFO:tasks.rados.rados.0.smithi012.stdout:3157: read oid 3 snap -1 2024-09-10T18:07:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:3157: expect (ObjNum 974 snap 309 seq_num 974) 2024-09-10T18:07:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 311 2024-09-10T18:07:42.792 INFO:tasks.rados.rados.0.smithi012.stdout:3158: seq_num 981 ranges {0=434176,434176=540672,974848=466944,1441792=524288,1966080=73728} 2024-09-10T18:07:42.793 INFO:tasks.rados.rados.0.smithi012.stdout:3158: writing smithi01278544-22 from 0 to 434176 tid 1 2024-09-10T18:07:42.796 INFO:tasks.rados.rados.0.smithi012.stdout:3158: writing smithi01278544-22 from 434176 to 974848 tid 2 2024-09-10T18:07:42.799 INFO:tasks.rados.rados.0.smithi012.stdout:3158: writing smithi01278544-22 from 974848 to 1441792 tid 3 2024-09-10T18:07:42.802 INFO:tasks.rados.rados.0.smithi012.stdout:3158: writing smithi01278544-22 from 1441792 to 1966080 tid 4 2024-09-10T18:07:42.803 INFO:tasks.rados.rados.0.smithi012.stdout:3158: writing smithi01278544-22 from 1966080 to 2039808 tid 5 2024-09-10T18:07:42.803 INFO:tasks.rados.rados.0.smithi012.stdout:3159: read oid 37 snap -1 2024-09-10T18:07:42.803 INFO:tasks.rados.rados.0.smithi012.stdout:3159: expect deleted 2024-09-10T18:07:42.803 INFO:tasks.rados.rados.0.smithi012.stdout:3160: read oid 40 snap -1 2024-09-10T18:07:42.803 INFO:tasks.rados.rados.0.smithi012.stdout:3160: expect (ObjNum 944 snap 298 seq_num 944) 2024-09-10T18:07:42.803 INFO:tasks.rados.rados.0.smithi012.stdout:3161: snap_remove snap 299 2024-09-10T18:07:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:42 smithi012 ceph-mon[89611]: pgmap v747: 121 pgs: 121 active+clean; 242 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 948 KiB/s wr, 18 op/s 2024-09-10T18:07:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:42 smithi012 ceph-mon[89611]: osdmap e710: 8 total, 8 up, 8 in 2024-09-10T18:07:43.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:42 smithi012 ceph-mon[89611]: osdmap e711: 8 total, 8 up, 8 in 2024-09-10T18:07:43.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:42 smithi012 ceph-mon[92029]: pgmap v747: 121 pgs: 121 active+clean; 242 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 948 KiB/s wr, 18 op/s 2024-09-10T18:07:43.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:42 smithi012 ceph-mon[92029]: osdmap e710: 8 total, 8 up, 8 in 2024-09-10T18:07:43.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:42 smithi012 ceph-mon[92029]: osdmap e711: 8 total, 8 up, 8 in 2024-09-10T18:07:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:42 smithi089 ceph-mon[84132]: pgmap v747: 121 pgs: 121 active+clean; 242 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 948 KiB/s wr, 18 op/s 2024-09-10T18:07:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:42 smithi089 ceph-mon[84132]: osdmap e710: 8 total, 8 up, 8 in 2024-09-10T18:07:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:42 smithi089 ceph-mon[84132]: osdmap e711: 8 total, 8 up, 8 in 2024-09-10T18:07:43.794 INFO:tasks.rados.rados.0.smithi012.stdout:3161: done (4 left) 2024-09-10T18:07:43.794 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 311 2024-09-10T18:07:43.794 INFO:tasks.rados.rados.0.smithi012.stdout:3158: finishing write tid 1 to smithi01278544-22 2024-09-10T18:07:43.794 INFO:tasks.rados.rados.0.smithi012.stdout:3162: seq_num 982 ranges {15712256=450560,16162816=425984,16588800=679936,17268736=466944,17735680=32768} 2024-09-10T18:07:43.884 INFO:tasks.rados.rados.0.smithi012.stdout:3162: writing smithi01278544-2 from 15712256 to 16162816 tid 1 2024-09-10T18:07:43.886 INFO:tasks.rados.rados.0.smithi012.stdout:3162: writing smithi01278544-2 from 16162816 to 16588800 tid 2 2024-09-10T18:07:43.889 INFO:tasks.rados.rados.0.smithi012.stdout:3162: writing smithi01278544-2 from 16588800 to 17268736 tid 3 2024-09-10T18:07:43.892 INFO:tasks.rados.rados.0.smithi012.stdout:3162: writing smithi01278544-2 from 17268736 to 17735680 tid 4 2024-09-10T18:07:43.893 INFO:tasks.rados.rados.0.smithi012.stdout:3162: writing smithi01278544-2 from 17735680 to 17768448 tid 5 2024-09-10T18:07:43.893 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 311 2024-09-10T18:07:43.893 INFO:tasks.rados.rados.0.smithi012.stdout:3163: seq_num 983 ranges {3629056=466944,4096000=712704,4808704=434176,5242880=458752} 2024-09-10T18:07:43.915 INFO:tasks.rados.rados.0.smithi012.stdout:3163: writing smithi01278544-10 from 3629056 to 4096000 tid 1 2024-09-10T18:07:43.918 INFO:tasks.rados.rados.0.smithi012.stdout:3163: writing smithi01278544-10 from 4096000 to 4808704 tid 2 2024-09-10T18:07:43.921 INFO:tasks.rados.rados.0.smithi012.stdout:3163: writing smithi01278544-10 from 4808704 to 5242880 tid 3 2024-09-10T18:07:43.923 INFO:tasks.rados.rados.0.smithi012.stdout:3163: writing smithi01278544-10 from 5242880 to 5701632 tid 4 2024-09-10T18:07:43.924 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 311 2024-09-10T18:07:43.924 INFO:tasks.rados.rados.0.smithi012.stdout:3164: seq_num 984 ranges {0=483328,483328=598016,1081344=647168,1728512=360448} 2024-09-10T18:07:43.926 INFO:tasks.rados.rados.0.smithi012.stdout:3164: writing smithi01278544-18 from 0 to 483328 tid 1 2024-09-10T18:07:43.929 INFO:tasks.rados.rados.0.smithi012.stdout:3164: writing smithi01278544-18 from 483328 to 1081344 tid 2 2024-09-10T18:07:43.933 INFO:tasks.rados.rados.0.smithi012.stdout:3164: writing smithi01278544-18 from 1081344 to 1728512 tid 3 2024-09-10T18:07:43.935 INFO:tasks.rados.rados.0.smithi012.stdout:3164: writing smithi01278544-18 from 1728512 to 2088960 tid 4 2024-09-10T18:07:43.935 INFO:tasks.rados.rados.0.smithi012.stdout:3165: snap_remove snap 310 2024-09-10T18:07:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:07:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:07:44] "GET /metrics HTTP/1.1" 200 36356 "" "Prometheus/2.51.0" 2024-09-10T18:07:44.815 INFO:tasks.rados.rados.0.smithi012.stdout:3165: done (7 left) 2024-09-10T18:07:44.815 INFO:tasks.rados.rados.0.smithi012.stdout:3166: snap_remove snap 307 2024-09-10T18:07:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:44 smithi012 ceph-mon[89611]: pgmap v750: 121 pgs: 121 active+clean; 266 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 6.5 MiB/s wr, 31 op/s 2024-09-10T18:07:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:44 smithi012 ceph-mon[89611]: osdmap e712: 8 total, 8 up, 8 in 2024-09-10T18:07:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:44 smithi012 ceph-mon[92029]: pgmap v750: 121 pgs: 121 active+clean; 266 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 6.5 MiB/s wr, 31 op/s 2024-09-10T18:07:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:44 smithi012 ceph-mon[92029]: osdmap e712: 8 total, 8 up, 8 in 2024-09-10T18:07:45.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:44 smithi089 ceph-mon[84132]: pgmap v750: 121 pgs: 121 active+clean; 266 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 6.5 MiB/s wr, 31 op/s 2024-09-10T18:07:45.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:44 smithi089 ceph-mon[84132]: osdmap e712: 8 total, 8 up, 8 in 2024-09-10T18:07:45.821 INFO:tasks.rados.rados.0.smithi012.stdout:3166: done (7 left) 2024-09-10T18:07:45.821 INFO:tasks.rados.rados.0.smithi012.stdout:3167: snap_remove snap 309 2024-09-10T18:07:46.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:45 smithi089 ceph-mon[84132]: osdmap e713: 8 total, 8 up, 8 in 2024-09-10T18:07:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:45 smithi012 ceph-mon[89611]: osdmap e713: 8 total, 8 up, 8 in 2024-09-10T18:07:46.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:45 smithi012 ceph-mon[92029]: osdmap e713: 8 total, 8 up, 8 in 2024-09-10T18:07:46.826 INFO:tasks.rados.rados.0.smithi012.stdout:3167: done (7 left) 2024-09-10T18:07:46.826 INFO:tasks.rados.rados.0.smithi012.stdout:3168: read oid 31 snap -1 2024-09-10T18:07:46.826 INFO:tasks.rados.rados.0.smithi012.stdout:3168: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:46.827 INFO:tasks.rados.rados.0.smithi012.stdout:3169: read oid 48 snap -1 2024-09-10T18:07:46.827 INFO:tasks.rados.rados.0.smithi012.stdout:3169: expect (ObjNum 818 snap 266 seq_num 818) 2024-09-10T18:07:46.827 INFO:tasks.rados.rados.0.smithi012.stdout:3170: setattr oid 1 current snap is 311 2024-09-10T18:07:46.827 INFO:tasks.rados.rados.0.smithi012.stdout:3158: finishing write tid 2 to smithi01278544-22 2024-09-10T18:07:46.827 INFO:tasks.rados.rados.0.smithi012.stdout:3157: expect (ObjNum 974 snap 309 seq_num 974) 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: finishing write tid 3 to smithi01278544-22 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: finishing write tid 4 to smithi01278544-22 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: finishing write tid 5 to smithi01278544-22 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: finishing write tid 6 to smithi01278544-22 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: finishing write tid 7 to smithi01278544-22 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: oid 22 updating version 0 to 2256 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: oid 22 version 2256 is already newer than 2253 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: oid 22 version 2256 is already newer than 2255 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: oid 22 updating version 2256 to 2258 2024-09-10T18:07:46.883 INFO:tasks.rados.rados.0.smithi012.stdout:3158: oid 22 version 2258 is already newer than 2257 2024-09-10T18:07:46.884 INFO:tasks.rados.rados.0.smithi012.stdout:3158: oid 22 version 2258 is already newer than 2254 2024-09-10T18:07:46.884 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2258 (ObjNum 981 snap 311 seq_num 981) dirty exists 2024-09-10T18:07:46.884 INFO:tasks.rados.rados.0.smithi012.stdout:3158: left oid 22 (ObjNum 981 snap 311 seq_num 981) 2024-09-10T18:07:46.884 INFO:tasks.rados.rados.0.smithi012.stdout:3160: expect (ObjNum 944 snap 298 seq_num 944) 2024-09-10T18:07:46.922 INFO:tasks.rados.rados.0.smithi012.stdout:3162: finishing write tid 1 to smithi01278544-2 2024-09-10T18:07:46.923 INFO:tasks.rados.rados.0.smithi012.stdout:3162: finishing write tid 2 to smithi01278544-2 2024-09-10T18:07:46.923 INFO:tasks.rados.rados.0.smithi012.stdout:3162: finishing write tid 3 to smithi01278544-2 2024-09-10T18:07:46.923 INFO:tasks.rados.rados.0.smithi012.stdout:3162: finishing write tid 4 to smithi01278544-2 2024-09-10T18:07:46.923 INFO:tasks.rados.rados.0.smithi012.stdout:3157: done (9 left) 2024-09-10T18:07:46.924 INFO:tasks.rados.rados.0.smithi012.stdout:3158: done (8 left) 2024-09-10T18:07:46.924 INFO:tasks.rados.rados.0.smithi012.stdout:3159: done (7 left) 2024-09-10T18:07:46.924 INFO:tasks.rados.rados.0.smithi012.stdout:3160: done (6 left) 2024-09-10T18:07:46.924 INFO:tasks.rados.rados.0.smithi012.stdout:3171: setattr oid 20 current snap is 311 2024-09-10T18:07:46.924 INFO:tasks.rados.rados.0.smithi012.stdout:3162: finishing write tid 5 to smithi01278544-2 2024-09-10T18:07:46.924 INFO:tasks.rados.rados.0.smithi012.stdout:3162: finishing write tid 6 to smithi01278544-2 2024-09-10T18:07:46.925 INFO:tasks.rados.rados.0.smithi012.stdout:3162: finishing write tid 7 to smithi01278544-2 2024-09-10T18:07:46.925 INFO:tasks.rados.rados.0.smithi012.stdout:3162: oid 2 updating version 0 to 2145 2024-09-10T18:07:46.925 INFO:tasks.rados.rados.0.smithi012.stdout:3162: oid 2 version 2145 is already newer than 2144 2024-09-10T18:07:46.925 INFO:tasks.rados.rados.0.smithi012.stdout:3162: oid 2 version 2145 is already newer than 2140 2024-09-10T18:07:46.925 INFO:tasks.rados.rados.0.smithi012.stdout:3162: oid 2 version 2145 is already newer than 2141 2024-09-10T18:07:46.926 INFO:tasks.rados.rados.0.smithi012.stdout:3162: oid 2 version 2145 is already newer than 2143 2024-09-10T18:07:46.926 INFO:tasks.rados.rados.0.smithi012.stdout:3162: oid 2 version 2145 is already newer than 2142 2024-09-10T18:07:46.926 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2145 (ObjNum 982 snap 311 seq_num 982) dirty exists 2024-09-10T18:07:46.926 INFO:tasks.rados.rados.0.smithi012.stdout:3162: left oid 2 (ObjNum 982 snap 311 seq_num 982) 2024-09-10T18:07:46.926 INFO:tasks.rados.rados.0.smithi012.stdout:3163: finishing write tid 1 to smithi01278544-10 2024-09-10T18:07:46.927 INFO:tasks.rados.rados.0.smithi012.stdout:3163: finishing write tid 2 to smithi01278544-10 2024-09-10T18:07:46.927 INFO:tasks.rados.rados.0.smithi012.stdout:3163: finishing write tid 3 to smithi01278544-10 2024-09-10T18:07:46.927 INFO:tasks.rados.rados.0.smithi012.stdout:3163: finishing write tid 4 to smithi01278544-10 2024-09-10T18:07:46.927 INFO:tasks.rados.rados.0.smithi012.stdout:3163: finishing write tid 5 to smithi01278544-10 2024-09-10T18:07:46.927 INFO:tasks.rados.rados.0.smithi012.stdout:3164: finishing write tid 1 to smithi01278544-18 2024-09-10T18:07:46.928 INFO:tasks.rados.rados.0.smithi012.stdout:3163: finishing write tid 6 to smithi01278544-10 2024-09-10T18:07:46.928 INFO:tasks.rados.rados.0.smithi012.stdout:3163: oid 10 updating version 0 to 2273 2024-09-10T18:07:46.928 INFO:tasks.rados.rados.0.smithi012.stdout:3163: oid 10 version 2273 is already newer than 2271 2024-09-10T18:07:46.928 INFO:tasks.rados.rados.0.smithi012.stdout:3163: oid 10 version 2273 is already newer than 2272 2024-09-10T18:07:46.929 INFO:tasks.rados.rados.0.smithi012.stdout:3163: oid 10 version 2273 is already newer than 2270 2024-09-10T18:07:46.929 INFO:tasks.rados.rados.0.smithi012.stdout:3163: oid 10 updating version 2273 to 2274 2024-09-10T18:07:46.929 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2274 (ObjNum 983 snap 311 seq_num 983) dirty exists 2024-09-10T18:07:46.929 INFO:tasks.rados.rados.0.smithi012.stdout:3163: left oid 10 (ObjNum 983 snap 311 seq_num 983) 2024-09-10T18:07:46.929 INFO:tasks.rados.rados.0.smithi012.stdout:3164: finishing write tid 2 to smithi01278544-18 2024-09-10T18:07:46.929 INFO:tasks.rados.rados.0.smithi012.stdout:3164: finishing write tid 3 to smithi01278544-18 2024-09-10T18:07:46.930 INFO:tasks.rados.rados.0.smithi012.stdout:3164: finishing write tid 4 to smithi01278544-18 2024-09-10T18:07:46.930 INFO:tasks.rados.rados.0.smithi012.stdout:3164: finishing write tid 5 to smithi01278544-18 2024-09-10T18:07:46.930 INFO:tasks.rados.rados.0.smithi012.stdout:3164: finishing write tid 6 to smithi01278544-18 2024-09-10T18:07:46.930 INFO:tasks.rados.rados.0.smithi012.stdout:3164: oid 18 updating version 0 to 2150 2024-09-10T18:07:46.930 INFO:tasks.rados.rados.0.smithi012.stdout:3164: oid 18 version 2150 is already newer than 2147 2024-09-10T18:07:46.930 INFO:tasks.rados.rados.0.smithi012.stdout:3164: oid 18 version 2150 is already newer than 2146 2024-09-10T18:07:46.931 INFO:tasks.rados.rados.0.smithi012.stdout:3164: oid 18 version 2150 is already newer than 2149 2024-09-10T18:07:46.931 INFO:tasks.rados.rados.0.smithi012.stdout:3164: oid 18 version 2150 is already newer than 2148 2024-09-10T18:07:46.931 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 2150 (ObjNum 984 snap 311 seq_num 984) dirty exists 2024-09-10T18:07:46.931 INFO:tasks.rados.rados.0.smithi012.stdout:3164: left oid 18 (ObjNum 984 snap 311 seq_num 984) 2024-09-10T18:07:46.931 INFO:tasks.rados.rados.0.smithi012.stdout:3168: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:46.953 INFO:tasks.rados.rados.0.smithi012.stdout:3169: expect (ObjNum 818 snap 266 seq_num 818) 2024-09-10T18:07:47.051 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2006 (ObjNum 65 snap 0 seq_num 1449094496) dirty exists 2024-09-10T18:07:47.051 INFO:tasks.rados.rados.0.smithi012.stdout:3162: done (6 left) 2024-09-10T18:07:47.051 INFO:tasks.rados.rados.0.smithi012.stdout:3163: done (5 left) 2024-09-10T18:07:47.051 INFO:tasks.rados.rados.0.smithi012.stdout:3164: done (4 left) 2024-09-10T18:07:47.051 INFO:tasks.rados.rados.0.smithi012.stdout:3168: done (3 left) 2024-09-10T18:07:47.051 INFO:tasks.rados.rados.0.smithi012.stdout:3169: done (2 left) 2024-09-10T18:07:47.051 INFO:tasks.rados.rados.0.smithi012.stdout:3170: done (1 left) 2024-09-10T18:07:47.051 INFO:tasks.rados.rados.0.smithi012.stdout:3172: snap_create 2024-09-10T18:07:47.054 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2283 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:07:47.203 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:46 smithi089 ceph-mon[84132]: pgmap v753: 121 pgs: 121 active+clean; 269 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 24 op/s 2024-09-10T18:07:47.203 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:46 smithi089 ceph-mon[84132]: osdmap e714: 8 total, 8 up, 8 in 2024-09-10T18:07:47.203 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:46 smithi012 ceph-mon[89611]: pgmap v753: 121 pgs: 121 active+clean; 269 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 24 op/s 2024-09-10T18:07:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:46 smithi012 ceph-mon[89611]: osdmap e714: 8 total, 8 up, 8 in 2024-09-10T18:07:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:46 smithi012 ceph-mon[92029]: pgmap v753: 121 pgs: 121 active+clean; 269 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 7.0 MiB/s wr, 24 op/s 2024-09-10T18:07:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:46 smithi012 ceph-mon[92029]: osdmap e714: 8 total, 8 up, 8 in 2024-09-10T18:07:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:07:47.792 INFO:tasks.rados.rados.0.smithi012.stdout:3171: done (1 left) 2024-09-10T18:07:47.792 INFO:tasks.rados.rados.0.smithi012.stdout:3172: done (0 left) 2024-09-10T18:07:47.792 INFO:tasks.rados.rados.0.smithi012.stdout:3173: snap_create 2024-09-10T18:07:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:47 smithi012 ceph-mon[89611]: osdmap e715: 8 total, 8 up, 8 in 2024-09-10T18:07:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:47 smithi012 ceph-mon[89611]: pgmap v756: 121 pgs: 121 active+clean; 237 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-09-10T18:07:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:47 smithi012 ceph-mon[89611]: osdmap e716: 8 total, 8 up, 8 in 2024-09-10T18:07:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:47 smithi012 ceph-mon[92029]: osdmap e715: 8 total, 8 up, 8 in 2024-09-10T18:07:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:47 smithi012 ceph-mon[92029]: pgmap v756: 121 pgs: 121 active+clean; 237 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-09-10T18:07:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:47 smithi012 ceph-mon[92029]: osdmap e716: 8 total, 8 up, 8 in 2024-09-10T18:07:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:47 smithi089 ceph-mon[84132]: osdmap e715: 8 total, 8 up, 8 in 2024-09-10T18:07:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:47 smithi089 ceph-mon[84132]: pgmap v756: 121 pgs: 121 active+clean; 237 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-09-10T18:07:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:47 smithi089 ceph-mon[84132]: osdmap e716: 8 total, 8 up, 8 in 2024-09-10T18:07:48.793 INFO:tasks.rados.rados.0.smithi012.stdout:3173: done (0 left) 2024-09-10T18:07:48.794 INFO:tasks.rados.rados.0.smithi012.stdout:3174: read oid 11 snap -1 2024-09-10T18:07:48.794 INFO:tasks.rados.rados.0.smithi012.stdout:3174: expect (ObjNum 961 snap 303 seq_num 961) 2024-09-10T18:07:48.794 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 313 2024-09-10T18:07:48.794 INFO:tasks.rados.rados.0.smithi012.stdout:3175: seq_num 985 ranges {2695168=499712,3194880=483328,3678208=450560,4128768=581632,4710400=90112} 2024-09-10T18:07:48.811 INFO:tasks.rados.rados.0.smithi012.stdout:3175: writing smithi01278544-28 from 2695168 to 3194880 tid 1 2024-09-10T18:07:48.814 INFO:tasks.rados.rados.0.smithi012.stdout:3175: writing smithi01278544-28 from 3194880 to 3678208 tid 2 2024-09-10T18:07:48.817 INFO:tasks.rados.rados.0.smithi012.stdout:3175: writing smithi01278544-28 from 3678208 to 4128768 tid 3 2024-09-10T18:07:48.820 INFO:tasks.rados.rados.0.smithi012.stdout:3175: writing smithi01278544-28 from 4128768 to 4710400 tid 4 2024-09-10T18:07:48.821 INFO:tasks.rados.rados.0.smithi012.stdout:3175: writing smithi01278544-28 from 4710400 to 4800512 tid 5 2024-09-10T18:07:48.821 INFO:tasks.rados.rados.0.smithi012.stdout:3176: delete oid 46 current snap is 313 2024-09-10T18:07:48.821 INFO:tasks.rados.rados.0.smithi012.stdout:3174: expect (ObjNum 961 snap 303 seq_num 961) 2024-09-10T18:07:48.870 INFO:tasks.rados.rados.0.smithi012.stdout:3175: finishing write tid 1 to smithi01278544-28 2024-09-10T18:07:48.870 INFO:tasks.rados.rados.0.smithi012.stdout:3175: finishing write tid 2 to smithi01278544-28 2024-09-10T18:07:48.870 INFO:tasks.rados.rados.0.smithi012.stdout:3175: finishing write tid 3 to smithi01278544-28 2024-09-10T18:07:48.870 INFO:tasks.rados.rados.0.smithi012.stdout:3175: finishing write tid 4 to smithi01278544-28 2024-09-10T18:07:48.870 INFO:tasks.rados.rados.0.smithi012.stdout:3175: finishing write tid 5 to smithi01278544-28 2024-09-10T18:07:48.871 INFO:tasks.rados.rados.0.smithi012.stdout:3175: finishing write tid 6 to smithi01278544-28 2024-09-10T18:07:48.871 INFO:tasks.rados.rados.0.smithi012.stdout:3175: finishing write tid 7 to smithi01278544-28 2024-09-10T18:07:48.871 INFO:tasks.rados.rados.0.smithi012.stdout:3175: oid 28 updating version 0 to 1319 2024-09-10T18:07:48.871 INFO:tasks.rados.rados.0.smithi012.stdout:3175: oid 28 version 1319 is already newer than 1316 2024-09-10T18:07:48.871 INFO:tasks.rados.rados.0.smithi012.stdout:3175: oid 28 version 1319 is already newer than 1317 2024-09-10T18:07:48.871 INFO:tasks.rados.rados.0.smithi012.stdout:3175: oid 28 version 1319 is already newer than 1318 2024-09-10T18:07:48.872 INFO:tasks.rados.rados.0.smithi012.stdout:3175: oid 28 version 1319 is already newer than 1315 2024-09-10T18:07:48.872 INFO:tasks.rados.rados.0.smithi012.stdout:3175: oid 28 updating version 1319 to 1320 2024-09-10T18:07:48.872 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1320 (ObjNum 985 snap 313 seq_num 985) dirty exists 2024-09-10T18:07:48.872 INFO:tasks.rados.rados.0.smithi012.stdout:3175: left oid 28 (ObjNum 985 snap 313 seq_num 985) 2024-09-10T18:07:48.872 INFO:tasks.rados.rados.0.smithi012.stdout:3174: done (2 left) 2024-09-10T18:07:48.873 INFO:tasks.rados.rados.0.smithi012.stdout:3175: done (1 left) 2024-09-10T18:07:48.873 INFO:tasks.rados.rados.0.smithi012.stdout:3176: done (0 left) 2024-09-10T18:07:48.873 INFO:tasks.rados.rados.0.smithi012.stdout:3177: read oid 9 snap -1 2024-09-10T18:07:48.873 INFO:tasks.rados.rados.0.smithi012.stdout:3177: expect (ObjNum 974 snap 309 seq_num 974) 2024-09-10T18:07:48.873 INFO:tasks.rados.rados.0.smithi012.stdout:3178: rollback oid 49 current snap is 313 2024-09-10T18:07:48.873 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 49 to 311 2024-09-10T18:07:48.874 INFO:tasks.rados.rados.0.smithi012.stdout:3179: rmattr oid 38 current snap is 313 2024-09-10T18:07:48.874 INFO:tasks.rados.rados.0.smithi012.stdout:3180: read oid 41 snap -1 2024-09-10T18:07:48.874 INFO:tasks.rados.rados.0.smithi012.stdout:3180: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:07:48.874 INFO:tasks.rados.rados.0.smithi012.stdout:3181: setattr oid 20 current snap is 313 2024-09-10T18:07:48.874 INFO:tasks.rados.rados.0.smithi012.stdout:3182: snap_create 2024-09-10T18:07:48.876 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2285 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:07:48.876 INFO:tasks.rados.rados.0.smithi012.stdout:3178: finishing rollback tid 0 to smithi01278544-49 2024-09-10T18:07:48.876 INFO:tasks.rados.rados.0.smithi012.stdout:3178: finishing rollback tid 1 to smithi01278544-49 2024-09-10T18:07:48.876 INFO:tasks.rados.rados.0.smithi012.stdout:3178: finishing rollback tid 2 to smithi01278544-49 2024-09-10T18:07:48.876 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 2153 (ObjNum 945 snap 298 seq_num 945) dirty exists 2024-09-10T18:07:48.877 INFO:tasks.rados.rados.0.smithi012.stdout:3177: expect (ObjNum 974 snap 309 seq_num 974) 2024-09-10T18:07:48.935 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 2007 (ObjNum 956 snap 303 seq_num 956) dirty exists 2024-09-10T18:07:48.935 INFO:tasks.rados.rados.0.smithi012.stdout:3180: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:07:49.808 INFO:tasks.rados.rados.0.smithi012.stdout:3177: done (5 left) 2024-09-10T18:07:49.809 INFO:tasks.rados.rados.0.smithi012.stdout:3178: done (4 left) 2024-09-10T18:07:49.809 INFO:tasks.rados.rados.0.smithi012.stdout:3179: done (3 left) 2024-09-10T18:07:49.809 INFO:tasks.rados.rados.0.smithi012.stdout:3180: done (2 left) 2024-09-10T18:07:49.809 INFO:tasks.rados.rados.0.smithi012.stdout:3181: done (1 left) 2024-09-10T18:07:49.809 INFO:tasks.rados.rados.0.smithi012.stdout:3182: done (0 left) 2024-09-10T18:07:49.809 INFO:tasks.rados.rados.0.smithi012.stdout:3183: snap_create 2024-09-10T18:07:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:49 smithi012 ceph-mon[89611]: osdmap e717: 8 total, 8 up, 8 in 2024-09-10T18:07:50.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:49 smithi012 ceph-mon[92029]: osdmap e717: 8 total, 8 up, 8 in 2024-09-10T18:07:50.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:49 smithi089 ceph-mon[84132]: osdmap e717: 8 total, 8 up, 8 in 2024-09-10T18:07:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:3183: done (0 left) 2024-09-10T18:07:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:3184: read oid 29 snap -1 2024-09-10T18:07:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:3184: expect (ObjNum 979 snap 310 seq_num 979) 2024-09-10T18:07:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:3185: read oid 23 snap 312 2024-09-10T18:07:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:3185: expect (ObjNum 957 snap 303 seq_num 957) 2024-09-10T18:07:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 315 2024-09-10T18:07:50.806 INFO:tasks.rados.rados.0.smithi012.stdout:3186: seq_num 987 ranges {0=532480,532480=647168,1179648=417792,1597440=409600,2007040=131072} 2024-09-10T18:07:50.809 INFO:tasks.rados.rados.0.smithi012.stdout:3186: writing smithi01278544-1 from 0 to 532480 tid 1 2024-09-10T18:07:50.813 INFO:tasks.rados.rados.0.smithi012.stdout:3186: writing smithi01278544-1 from 532480 to 1179648 tid 2 2024-09-10T18:07:50.816 INFO:tasks.rados.rados.0.smithi012.stdout:3186: writing smithi01278544-1 from 1179648 to 1597440 tid 3 2024-09-10T18:07:50.819 INFO:tasks.rados.rados.0.smithi012.stdout:3186: writing smithi01278544-1 from 1597440 to 2007040 tid 4 2024-09-10T18:07:50.820 INFO:tasks.rados.rados.0.smithi012.stdout:3186: writing smithi01278544-1 from 2007040 to 2138112 tid 5 2024-09-10T18:07:50.820 INFO:tasks.rados.rados.0.smithi012.stdout:3187: delete oid 37 current snap is 315 2024-09-10T18:07:50.820 INFO:tasks.rados.rados.0.smithi012.stdout:3185: expect (ObjNum 957 snap 303 seq_num 957) 2024-09-10T18:07:50.867 INFO:tasks.rados.rados.0.smithi012.stdout:3186: finishing write tid 1 to smithi01278544-1 2024-09-10T18:07:50.867 INFO:tasks.rados.rados.0.smithi012.stdout:3186: finishing write tid 2 to smithi01278544-1 2024-09-10T18:07:50.867 INFO:tasks.rados.rados.0.smithi012.stdout:3186: finishing write tid 3 to smithi01278544-1 2024-09-10T18:07:50.867 INFO:tasks.rados.rados.0.smithi012.stdout:3186: finishing write tid 4 to smithi01278544-1 2024-09-10T18:07:50.867 INFO:tasks.rados.rados.0.smithi012.stdout:3186: finishing write tid 5 to smithi01278544-1 2024-09-10T18:07:50.867 INFO:tasks.rados.rados.0.smithi012.stdout:3185: done (3 left) 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3187: done (2 left) 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 315 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3186: finishing write tid 6 to smithi01278544-1 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3186: finishing write tid 7 to smithi01278544-1 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3186: oid 1 updating version 0 to 2013 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3186: oid 1 version 2013 is already newer than 2011 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3186: oid 1 version 2013 is already newer than 2008 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3186: oid 1 version 2013 is already newer than 2009 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3186: oid 1 version 2013 is already newer than 2012 2024-09-10T18:07:50.868 INFO:tasks.rados.rados.0.smithi012.stdout:3186: oid 1 version 2013 is already newer than 2010 2024-09-10T18:07:50.869 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2013 (ObjNum 987 snap 315 seq_num 987) dirty exists 2024-09-10T18:07:50.869 INFO:tasks.rados.rados.0.smithi012.stdout:3186: left oid 1 (ObjNum 987 snap 315 seq_num 987) 2024-09-10T18:07:50.869 INFO:tasks.rados.rados.0.smithi012.stdout:3184: expect (ObjNum 979 snap 310 seq_num 979) 2024-09-10T18:07:51.087 INFO:tasks.rados.rados.0.smithi012.stdout:3188: seq_num 989 ranges {548864=573440,1122304=466944,1589248=434176,2023424=638976,2662400=65536} 2024-09-10T18:07:51.093 INFO:tasks.rados.rados.0.smithi012.stdout:3188: writing smithi01278544-5 from 548864 to 1122304 tid 1 2024-09-10T18:07:51.096 INFO:tasks.rados.rados.0.smithi012.stdout:3188: writing smithi01278544-5 from 1122304 to 1589248 tid 2 2024-09-10T18:07:51.098 INFO:tasks.rados.rados.0.smithi012.stdout:3188: writing smithi01278544-5 from 1589248 to 2023424 tid 3 2024-09-10T18:07:51.102 INFO:tasks.rados.rados.0.smithi012.stdout:3188: writing smithi01278544-5 from 2023424 to 2662400 tid 4 2024-09-10T18:07:51.103 INFO:tasks.rados.rados.0.smithi012.stdout:3188: writing smithi01278544-5 from 2662400 to 2727936 tid 5 2024-09-10T18:07:51.103 INFO:tasks.rados.rados.0.smithi012.stdout:3184: done (2 left) 2024-09-10T18:07:51.103 INFO:tasks.rados.rados.0.smithi012.stdout:3186: done (1 left) 2024-09-10T18:07:51.103 INFO:tasks.rados.rados.0.smithi012.stdout:3189: snap_create 2024-09-10T18:07:51.103 INFO:tasks.rados.rados.0.smithi012.stdout:3188: finishing write tid 1 to smithi01278544-5 2024-09-10T18:07:51.103 INFO:tasks.rados.rados.0.smithi012.stdout:3188: finishing write tid 2 to smithi01278544-5 2024-09-10T18:07:51.103 INFO:tasks.rados.rados.0.smithi012.stdout:3188: finishing write tid 3 to smithi01278544-5 2024-09-10T18:07:51.106 INFO:tasks.rados.rados.0.smithi012.stdout:3188: finishing write tid 4 to smithi01278544-5 2024-09-10T18:07:51.106 INFO:tasks.rados.rados.0.smithi012.stdout:3188: finishing write tid 5 to smithi01278544-5 2024-09-10T18:07:51.106 INFO:tasks.rados.rados.0.smithi012.stdout:3188: finishing write tid 6 to smithi01278544-5 2024-09-10T18:07:51.107 INFO:tasks.rados.rados.0.smithi012.stdout:3188: finishing write tid 7 to smithi01278544-5 2024-09-10T18:07:51.107 INFO:tasks.rados.rados.0.smithi012.stdout:3188: oid 5 updating version 0 to 1209 2024-09-10T18:07:51.108 INFO:tasks.rados.rados.0.smithi012.stdout:3188: oid 5 updating version 1209 to 1213 2024-09-10T18:07:51.108 INFO:tasks.rados.rados.0.smithi012.stdout:3188: oid 5 version 1213 is already newer than 1212 2024-09-10T18:07:51.108 INFO:tasks.rados.rados.0.smithi012.stdout:3188: oid 5 version 1213 is already newer than 1211 2024-09-10T18:07:51.108 INFO:tasks.rados.rados.0.smithi012.stdout:3188: oid 5 version 1213 is already newer than 1208 2024-09-10T18:07:51.108 INFO:tasks.rados.rados.0.smithi012.stdout:3188: oid 5 version 1213 is already newer than 1210 2024-09-10T18:07:51.108 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 1213 (ObjNum 989 snap 315 seq_num 989) dirty exists 2024-09-10T18:07:51.108 INFO:tasks.rados.rados.0.smithi012.stdout:3188: left oid 5 (ObjNum 989 snap 315 seq_num 989) 2024-09-10T18:07:51.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:50 smithi012 ceph-mon[92029]: pgmap v759: 121 pgs: 121 active+clean; 211 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-09-10T18:07:51.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:50 smithi012 ceph-mon[92029]: osdmap e718: 8 total, 8 up, 8 in 2024-09-10T18:07:51.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:50 smithi012 ceph-mon[89611]: pgmap v759: 121 pgs: 121 active+clean; 211 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-09-10T18:07:51.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:50 smithi012 ceph-mon[89611]: osdmap e718: 8 total, 8 up, 8 in 2024-09-10T18:07:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:50 smithi089 ceph-mon[84132]: pgmap v759: 121 pgs: 121 active+clean; 211 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.5 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-09-10T18:07:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:50 smithi089 ceph-mon[84132]: osdmap e718: 8 total, 8 up, 8 in 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3188: done (1 left) 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3189: done (0 left) 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3190: read oid 24 snap -1 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3190: expect (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3191: copy_from oid 15 from oid 16 current snap is 316 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3192: copy_from oid 44 from oid 5 current snap is 316 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3193: read oid 17 snap -1 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3193: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:51.815 INFO:tasks.rados.rados.0.smithi012.stdout:3194: read oid 45 snap -1 2024-09-10T18:07:51.816 INFO:tasks.rados.rados.0.smithi012.stdout:3194: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:07:51.816 INFO:tasks.rados.rados.0.smithi012.stdout:3195: setattr oid 26 current snap is 316 2024-09-10T18:07:51.816 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 316 2024-09-10T18:07:51.816 INFO:tasks.rados.rados.0.smithi012.stdout:3196: seq_num 990 ranges {0=589824,589824=753664,1343488=638976,1982464=212992} 2024-09-10T18:07:51.821 INFO:tasks.rados.rados.0.smithi012.stdout:3196: writing smithi01278544-21 from 0 to 589824 tid 1 2024-09-10T18:07:51.826 INFO:tasks.rados.rados.0.smithi012.stdout:3196: writing smithi01278544-21 from 589824 to 1343488 tid 2 2024-09-10T18:07:51.830 INFO:tasks.rados.rados.0.smithi012.stdout:3196: writing smithi01278544-21 from 1343488 to 1982464 tid 3 2024-09-10T18:07:51.832 INFO:tasks.rados.rados.0.smithi012.stdout:3196: writing smithi01278544-21 from 1982464 to 2195456 tid 4 2024-09-10T18:07:51.832 INFO:tasks.rados.rados.0.smithi012.stdout:3197: read oid 9 snap -1 2024-09-10T18:07:51.832 INFO:tasks.rados.rados.0.smithi012.stdout:3197: expect (ObjNum 974 snap 309 seq_num 974) 2024-09-10T18:07:51.833 INFO:tasks.rados.rados.0.smithi012.stdout:3198: rollback oid 6 current snap is 316 2024-09-10T18:07:51.833 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 6 to 312 2024-09-10T18:07:51.833 INFO:tasks.rados.rados.0.smithi012.stdout:3199: delete oid 8 current snap is 316 2024-09-10T18:07:51.833 INFO:tasks.rados.rados.0.smithi012.stdout:3194: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:07:51.883 INFO:tasks.rados.rados.0.smithi012.stdout:3196: finishing write tid 1 to smithi01278544-21 2024-09-10T18:07:51.883 INFO:tasks.rados.rados.0.smithi012.stdout:3196: finishing write tid 2 to smithi01278544-21 2024-09-10T18:07:51.883 INFO:tasks.rados.rados.0.smithi012.stdout:3193: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:07:51.914 INFO:tasks.rados.rados.0.smithi012.stdout:3190: expect (ObjNum 843 snap 274 seq_num 843) 2024-09-10T18:07:51.970 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2022 (ObjNum 903 snap 294 seq_num 903) dirty exists 2024-09-10T18:07:51.970 INFO:tasks.rados.rados.0.smithi012.stdout:3192: finishing copy_from racing read to smithi01278544-44 2024-09-10T18:07:51.971 INFO:tasks.rados.rados.0.smithi012.stdout:3192: finishing copy_from to smithi01278544-44 2024-09-10T18:07:51.971 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 1213 (ObjNum 989 snap 315 seq_num 989) dirty exists 2024-09-10T18:07:51.971 INFO:tasks.rados.rados.0.smithi012.stdout:3197: expect (ObjNum 974 snap 309 seq_num 974) 2024-09-10T18:07:52.021 INFO:tasks.rados.rados.0.smithi012.stdout:3196: finishing write tid 3 to smithi01278544-21 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: finishing write tid 4 to smithi01278544-21 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: finishing write tid 5 to smithi01278544-21 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3198: finishing rollback tid 0 to smithi01278544-6 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: finishing write tid 6 to smithi01278544-21 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: oid 21 updating version 0 to 1277 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: oid 21 version 1277 is already newer than 1276 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: oid 21 version 1277 is already newer than 1275 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: oid 21 version 1277 is already newer than 1274 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: oid 21 version 1277 is already newer than 1273 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 1277 (ObjNum 990 snap 316 seq_num 990) dirty exists 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3196: left oid 21 (ObjNum 990 snap 316 seq_num 990) 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3198: finishing rollback tid 1 to smithi01278544-6 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:3198: finishing rollback tid 2 to smithi01278544-6 2024-09-10T18:07:52.022 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 2086 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3191: finishing copy_from racing read to smithi01278544-15 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3191: finishing copy_from to smithi01278544-15 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2083 (ObjNum 856 snap 278 seq_num 856) dirty exists 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3190: done (9 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3191: done (8 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3192: done (7 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3193: done (6 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3194: done (5 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3195: done (4 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3196: done (3 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3197: done (2 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3198: done (1 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3199: done (0 left) 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 316 2024-09-10T18:07:52.023 INFO:tasks.rados.rados.0.smithi012.stdout:3200: seq_num 992 ranges {14311424=622592,14934016=524288,15458304=606208,16064512=475136} 2024-09-10T18:07:52.102 INFO:tasks.rados.rados.0.smithi012.stdout:3200: writing smithi01278544-15 from 14311424 to 14934016 tid 1 2024-09-10T18:07:52.105 INFO:tasks.rados.rados.0.smithi012.stdout:3200: writing smithi01278544-15 from 14934016 to 15458304 tid 2 2024-09-10T18:07:52.108 INFO:tasks.rados.rados.0.smithi012.stdout:3200: writing smithi01278544-15 from 15458304 to 16064512 tid 3 2024-09-10T18:07:52.111 INFO:tasks.rados.rados.0.smithi012.stdout:3200: writing smithi01278544-15 from 16064512 to 16539648 tid 4 2024-09-10T18:07:52.112 INFO:tasks.rados.rados.0.smithi012.stdout:3201: rollback oid 31 current snap is 316 2024-09-10T18:07:52.112 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 314 2024-09-10T18:07:52.112 INFO:tasks.rados.rados.0.smithi012.stdout:3200: finishing write tid 1 to smithi01278544-15 2024-09-10T18:07:52.112 INFO:tasks.rados.rados.0.smithi012.stdout:3200: finishing write tid 2 to smithi01278544-15 2024-09-10T18:07:52.112 INFO:tasks.rados.rados.0.smithi012.stdout:3202: read oid 43 snap -1 2024-09-10T18:07:52.112 INFO:tasks.rados.rados.0.smithi012.stdout:3202: expect (ObjNum 935 snap 298 seq_num 935) 2024-09-10T18:07:52.112 INFO:tasks.rados.rados.0.smithi012.stdout:3203: setattr oid 6 current snap is 316 2024-09-10T18:07:52.112 INFO:tasks.rados.rados.0.smithi012.stdout:3204: snap_remove snap 312 2024-09-10T18:07:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:51 smithi012 ceph-mon[89611]: osdmap e719: 8 total, 8 up, 8 in 2024-09-10T18:07:52.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:51 smithi012 ceph-mon[92029]: osdmap e719: 8 total, 8 up, 8 in 2024-09-10T18:07:52.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:51 smithi089 ceph-mon[84132]: osdmap e719: 8 total, 8 up, 8 in 2024-09-10T18:07:52.798 INFO:tasks.rados.rados.0.smithi012.stdout:3204: done (4 left) 2024-09-10T18:07:52.799 INFO:tasks.rados.rados.0.smithi012.stdout:3205: snap_remove snap 313 2024-09-10T18:07:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:52 smithi012 ceph-mon[89611]: pgmap v762: 121 pgs: 121 active+clean; 211 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T18:07:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:52 smithi012 ceph-mon[89611]: osdmap e720: 8 total, 8 up, 8 in 2024-09-10T18:07:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:52 smithi012 ceph-mon[89611]: osdmap e721: 8 total, 8 up, 8 in 2024-09-10T18:07:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:52 smithi012 ceph-mon[92029]: pgmap v762: 121 pgs: 121 active+clean; 211 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T18:07:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:52 smithi012 ceph-mon[92029]: osdmap e720: 8 total, 8 up, 8 in 2024-09-10T18:07:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:52 smithi012 ceph-mon[92029]: osdmap e721: 8 total, 8 up, 8 in 2024-09-10T18:07:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:52 smithi089 ceph-mon[84132]: pgmap v762: 121 pgs: 121 active+clean; 211 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T18:07:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:52 smithi089 ceph-mon[84132]: osdmap e720: 8 total, 8 up, 8 in 2024-09-10T18:07:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:52 smithi089 ceph-mon[84132]: osdmap e721: 8 total, 8 up, 8 in 2024-09-10T18:07:53.801 INFO:tasks.rados.rados.0.smithi012.stdout:3205: done (4 left) 2024-09-10T18:07:53.801 INFO:tasks.rados.rados.0.smithi012.stdout:3206: copy_from oid 1 from oid 49 current snap is 316 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3200: finishing write tid 3 to smithi01278544-15 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3201: finishing rollback tid 0 to smithi01278544-31 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3201: finishing rollback tid 1 to smithi01278544-31 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 2088 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3200: finishing write tid 4 to smithi01278544-15 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3201: finishing rollback tid 2 to smithi01278544-31 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2189 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3200: finishing write tid 5 to smithi01278544-15 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3201: done (4 left) 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3203: done (3 left) 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3207: snap_create 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3200: finishing write tid 6 to smithi01278544-15 2024-09-10T18:07:53.802 INFO:tasks.rados.rados.0.smithi012.stdout:3200: oid 15 updating version 0 to 2157 2024-09-10T18:07:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:3200: oid 15 version 2157 is already newer than 2156 2024-09-10T18:07:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:3200: oid 15 version 2157 is already newer than 2155 2024-09-10T18:07:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:3200: oid 15 updating version 2157 to 2158 2024-09-10T18:07:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:3200: oid 15 version 2158 is already newer than 2154 2024-09-10T18:07:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2158 (ObjNum 992 snap 316 seq_num 992) dirty exists 2024-09-10T18:07:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:3200: left oid 15 (ObjNum 992 snap 316 seq_num 992) 2024-09-10T18:07:53.803 INFO:tasks.rados.rados.0.smithi012.stdout:3202: expect (ObjNum 935 snap 298 seq_num 935) 2024-09-10T18:07:54.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:07:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:07:54] "GET /metrics HTTP/1.1" 200 36357 "" "Prometheus/2.51.0" 2024-09-10T18:07:54.936 INFO:tasks.rados.rados.0.smithi012.stdout:3206: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:07:54.936 INFO:tasks.rados.rados.0.smithi012.stdout:3206: finishing copy_from to smithi01278544-1 2024-09-10T18:07:54.936 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2153 (ObjNum 945 snap 298 seq_num 945) dirty exists 2024-09-10T18:07:54.936 INFO:tasks.rados.rados.0.smithi012.stdout:3200: done (3 left) 2024-09-10T18:07:54.936 INFO:tasks.rados.rados.0.smithi012.stdout:3202: done (2 left) 2024-09-10T18:07:54.936 INFO:tasks.rados.rados.0.smithi012.stdout:3206: done (1 left) 2024-09-10T18:07:54.936 INFO:tasks.rados.rados.0.smithi012.stdout:3207: done (0 left) 2024-09-10T18:07:54.936 INFO:tasks.rados.rados.0.smithi012.stdout:3208: snap_create 2024-09-10T18:07:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:54 smithi012 ceph-mon[89611]: pgmap v765: 121 pgs: 121 active+clean; 200 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 666 KiB/s wr, 22 op/s 2024-09-10T18:07:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:54 smithi012 ceph-mon[89611]: osdmap e722: 8 total, 8 up, 8 in 2024-09-10T18:07:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:54 smithi012 ceph-mon[92029]: pgmap v765: 121 pgs: 121 active+clean; 200 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 666 KiB/s wr, 22 op/s 2024-09-10T18:07:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:54 smithi012 ceph-mon[92029]: osdmap e722: 8 total, 8 up, 8 in 2024-09-10T18:07:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:54 smithi089 ceph-mon[84132]: pgmap v765: 121 pgs: 121 active+clean; 200 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 666 KiB/s wr, 22 op/s 2024-09-10T18:07:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:54 smithi089 ceph-mon[84132]: osdmap e722: 8 total, 8 up, 8 in 2024-09-10T18:07:55.813 INFO:tasks.rados.rados.0.smithi012.stdout:3208: done (0 left) 2024-09-10T18:07:55.814 INFO:tasks.rados.rados.0.smithi012.stdout:3209: copy_from oid 38 from oid 6 current snap is 318 2024-09-10T18:07:55.814 INFO:tasks.rados.rados.0.smithi012.stdout:3210: setattr oid 26 current snap is 318 2024-09-10T18:07:55.814 INFO:tasks.rados.rados.0.smithi012.stdout:3211: snap_create 2024-09-10T18:07:55.821 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2023 (ObjNum 903 snap 294 seq_num 903) dirty exists 2024-09-10T18:07:55.829 INFO:tasks.rados.rados.0.smithi012.stdout:3209: finishing copy_from racing read to smithi01278544-38 2024-09-10T18:07:55.830 INFO:tasks.rados.rados.0.smithi012.stdout:3209: finishing copy_from to smithi01278544-38 2024-09-10T18:07:55.830 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 2088 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-09-10T18:07:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:55 smithi012 ceph-mon[89611]: osdmap e723: 8 total, 8 up, 8 in 2024-09-10T18:07:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:55 smithi012 ceph-mon[92029]: osdmap e723: 8 total, 8 up, 8 in 2024-09-10T18:07:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:55 smithi089 ceph-mon[84132]: osdmap e723: 8 total, 8 up, 8 in 2024-09-10T18:07:56.817 INFO:tasks.rados.rados.0.smithi012.stdout:3209: done (2 left) 2024-09-10T18:07:56.817 INFO:tasks.rados.rados.0.smithi012.stdout:3210: done (1 left) 2024-09-10T18:07:56.817 INFO:tasks.rados.rados.0.smithi012.stdout:3211: done (0 left) 2024-09-10T18:07:56.817 INFO:tasks.rados.rados.0.smithi012.stdout:3212: delete oid 34 current snap is 319 2024-09-10T18:07:56.821 INFO:tasks.rados.rados.0.smithi012.stdout:3212: done (0 left) 2024-09-10T18:07:56.822 INFO:tasks.rados.rados.0.smithi012.stdout:3213: rmattr oid 6 current snap is 319 2024-09-10T18:07:56.822 INFO:tasks.rados.rados.0.smithi012.stdout:3214: read oid 37 snap -1 2024-09-10T18:07:56.822 INFO:tasks.rados.rados.0.smithi012.stdout:3214: expect deleted 2024-09-10T18:07:56.822 INFO:tasks.rados.rados.0.smithi012.stdout:3215: delete oid 32 current snap is 319 2024-09-10T18:07:56.825 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 2089 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-09-10T18:07:56.827 INFO:tasks.rados.rados.0.smithi012.stdout:3213: done (2 left) 2024-09-10T18:07:56.827 INFO:tasks.rados.rados.0.smithi012.stdout:3214: done (1 left) 2024-09-10T18:07:56.827 INFO:tasks.rados.rados.0.smithi012.stdout:3215: done (0 left) 2024-09-10T18:07:56.827 INFO:tasks.rados.rados.0.smithi012.stdout:3216: rollback oid 23 current snap is 319 2024-09-10T18:07:56.828 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 23 to 314 2024-09-10T18:07:56.828 INFO:tasks.rados.rados.0.smithi012.stdout:3217: read oid 4 snap 314 2024-09-10T18:07:56.828 INFO:tasks.rados.rados.0.smithi012.stdout:3217: expect (ObjNum 976 snap 310 seq_num 976) 2024-09-10T18:07:56.828 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 319 2024-09-10T18:07:56.828 INFO:tasks.rados.rados.0.smithi012.stdout:3218: seq_num 995 ranges {15794176=671744,16465920=573440,17039360=778240,17817600=253952} 2024-09-10T18:07:56.918 INFO:tasks.rados.rados.0.smithi012.stdout:3218: writing smithi01278544-35 from 15794176 to 16465920 tid 1 2024-09-10T18:07:56.921 INFO:tasks.rados.rados.0.smithi012.stdout:3218: writing smithi01278544-35 from 16465920 to 17039360 tid 2 2024-09-10T18:07:56.925 INFO:tasks.rados.rados.0.smithi012.stdout:3218: writing smithi01278544-35 from 17039360 to 17817600 tid 3 2024-09-10T18:07:56.927 INFO:tasks.rados.rados.0.smithi012.stdout:3218: writing smithi01278544-35 from 17817600 to 18071552 tid 4 2024-09-10T18:07:56.928 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 319 2024-09-10T18:07:56.928 INFO:tasks.rados.rados.0.smithi012.stdout:3216: finishing rollback tid 0 to smithi01278544-23 2024-09-10T18:07:56.928 INFO:tasks.rados.rados.0.smithi012.stdout:3216: finishing rollback tid 1 to smithi01278544-23 2024-09-10T18:07:56.929 INFO:tasks.rados.rados.0.smithi012.stdout:3216: finishing rollback tid 2 to smithi01278544-23 2024-09-10T18:07:56.929 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 1283 (ObjNum 957 snap 303 seq_num 957) dirty exists 2024-09-10T18:07:56.929 INFO:tasks.rados.rados.0.smithi012.stdout:3217: expect (ObjNum 976 snap 310 seq_num 976) 2024-09-10T18:07:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:56 smithi012 ceph-mon[89611]: pgmap v768: 121 pgs: 121 active+clean; 222 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 6.1 MiB/s wr, 31 op/s 2024-09-10T18:07:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:56 smithi012 ceph-mon[89611]: osdmap e724: 8 total, 8 up, 8 in 2024-09-10T18:07:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:56 smithi012 ceph-mon[92029]: pgmap v768: 121 pgs: 121 active+clean; 222 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 6.1 MiB/s wr, 31 op/s 2024-09-10T18:07:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:56 smithi012 ceph-mon[92029]: osdmap e724: 8 total, 8 up, 8 in 2024-09-10T18:07:57.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:56 smithi089 ceph-mon[84132]: pgmap v768: 121 pgs: 121 active+clean; 222 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 6.1 MiB/s wr, 31 op/s 2024-09-10T18:07:57.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:56 smithi089 ceph-mon[84132]: osdmap e724: 8 total, 8 up, 8 in 2024-09-10T18:07:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:57 smithi012 ceph-mon[89611]: osdmap e725: 8 total, 8 up, 8 in 2024-09-10T18:07:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:57 smithi012 ceph-mon[89611]: osdmap e726: 8 total, 8 up, 8 in 2024-09-10T18:07:58.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:57 smithi012 ceph-mon[92029]: osdmap e725: 8 total, 8 up, 8 in 2024-09-10T18:07:58.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:57 smithi012 ceph-mon[92029]: osdmap e726: 8 total, 8 up, 8 in 2024-09-10T18:07:58.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:57 smithi089 ceph-mon[84132]: osdmap e725: 8 total, 8 up, 8 in 2024-09-10T18:07:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:57 smithi089 ceph-mon[84132]: osdmap e726: 8 total, 8 up, 8 in 2024-09-10T18:07:58.301 INFO:tasks.rados.rados.0.smithi012.stdout:3218: finishing write tid 1 to smithi01278544-35 2024-09-10T18:07:58.301 INFO:tasks.rados.rados.0.smithi012.stdout:3218: finishing write tid 2 to smithi01278544-35 2024-09-10T18:07:58.301 INFO:tasks.rados.rados.0.smithi012.stdout:3218: finishing write tid 3 to smithi01278544-35 2024-09-10T18:07:58.301 INFO:tasks.rados.rados.0.smithi012.stdout:3218: finishing write tid 4 to smithi01278544-35 2024-09-10T18:07:58.301 INFO:tasks.rados.rados.0.smithi012.stdout:3218: finishing write tid 5 to smithi01278544-35 2024-09-10T18:07:58.301 INFO:tasks.rados.rados.0.smithi012.stdout:3218: finishing write tid 6 to smithi01278544-35 2024-09-10T18:07:58.302 INFO:tasks.rados.rados.0.smithi012.stdout:3218: oid 35 updating version 0 to 2041 2024-09-10T18:07:58.302 INFO:tasks.rados.rados.0.smithi012.stdout:3218: oid 35 version 2041 is already newer than 2039 2024-09-10T18:07:58.302 INFO:tasks.rados.rados.0.smithi012.stdout:3218: oid 35 version 2041 is already newer than 2038 2024-09-10T18:07:58.302 INFO:tasks.rados.rados.0.smithi012.stdout:3218: oid 35 version 2041 is already newer than 2037 2024-09-10T18:07:58.302 INFO:tasks.rados.rados.0.smithi012.stdout:3218: oid 35 version 2041 is already newer than 2040 2024-09-10T18:07:58.302 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2041 (ObjNum 995 snap 319 seq_num 995) dirty exists 2024-09-10T18:07:58.302 INFO:tasks.rados.rados.0.smithi012.stdout:3218: left oid 35 (ObjNum 995 snap 319 seq_num 995) 2024-09-10T18:07:58.302 INFO:tasks.rados.rados.0.smithi012.stdout:3219: seq_num 996 ranges {2195456=688128,2883584=507904,3391488=581632,3973120=516096} 2024-09-10T18:07:58.316 INFO:tasks.rados.rados.0.smithi012.stdout:3219: writing smithi01278544-21 from 2195456 to 2883584 tid 1 2024-09-10T18:07:58.319 INFO:tasks.rados.rados.0.smithi012.stdout:3219: writing smithi01278544-21 from 2883584 to 3391488 tid 2 2024-09-10T18:07:58.323 INFO:tasks.rados.rados.0.smithi012.stdout:3219: writing smithi01278544-21 from 3391488 to 3973120 tid 3 2024-09-10T18:07:58.326 INFO:tasks.rados.rados.0.smithi012.stdout:3219: writing smithi01278544-21 from 3973120 to 4489216 tid 4 2024-09-10T18:07:58.326 INFO:tasks.rados.rados.0.smithi012.stdout:3216: done (3 left) 2024-09-10T18:07:58.327 INFO:tasks.rados.rados.0.smithi012.stdout:3217: done (2 left) 2024-09-10T18:07:58.327 INFO:tasks.rados.rados.0.smithi012.stdout:3218: done (1 left) 2024-09-10T18:07:58.327 INFO:tasks.rados.rados.0.smithi012.stdout:3220: delete oid 48 current snap is 319 2024-09-10T18:07:58.327 INFO:tasks.rados.rados.0.smithi012.stdout:3219: finishing write tid 1 to smithi01278544-21 2024-09-10T18:07:58.327 INFO:tasks.rados.rados.0.smithi012.stdout:3219: finishing write tid 2 to smithi01278544-21 2024-09-10T18:07:58.327 INFO:tasks.rados.rados.0.smithi012.stdout:3219: finishing write tid 3 to smithi01278544-21 2024-09-10T18:07:58.329 INFO:tasks.rados.rados.0.smithi012.stdout:3219: finishing write tid 4 to smithi01278544-21 2024-09-10T18:07:58.329 INFO:tasks.rados.rados.0.smithi012.stdout:3220: done (1 left) 2024-09-10T18:07:58.329 INFO:tasks.rados.rados.0.smithi012.stdout:3221: delete oid 10 current snap is 319 2024-09-10T18:07:58.329 INFO:tasks.rados.rados.0.smithi012.stdout:3219: finishing write tid 5 to smithi01278544-21 2024-09-10T18:07:58.330 INFO:tasks.rados.rados.0.smithi012.stdout:3219: finishing write tid 6 to smithi01278544-21 2024-09-10T18:07:58.330 INFO:tasks.rados.rados.0.smithi012.stdout:3219: oid 21 updating version 0 to 1286 2024-09-10T18:07:58.331 INFO:tasks.rados.rados.0.smithi012.stdout:3219: oid 21 updating version 1286 to 1287 2024-09-10T18:07:58.331 INFO:tasks.rados.rados.0.smithi012.stdout:3219: oid 21 version 1287 is already newer than 1285 2024-09-10T18:07:58.331 INFO:tasks.rados.rados.0.smithi012.stdout:3219: oid 21 updating version 1287 to 1288 2024-09-10T18:07:58.331 INFO:tasks.rados.rados.0.smithi012.stdout:3219: oid 21 updating version 1288 to 1289 2024-09-10T18:07:58.331 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 1289 (ObjNum 996 snap 319 seq_num 996) dirty exists 2024-09-10T18:07:58.331 INFO:tasks.rados.rados.0.smithi012.stdout:3219: left oid 21 (ObjNum 996 snap 319 seq_num 996) 2024-09-10T18:07:58.332 INFO:tasks.rados.rados.0.smithi012.stdout:3219: done (1 left) 2024-09-10T18:07:58.332 INFO:tasks.rados.rados.0.smithi012.stdout:3221: done (0 left) 2024-09-10T18:07:58.332 INFO:tasks.rados.rados.0.smithi012.stdout:3222: rmattr oid 49 current snap is 319 2024-09-10T18:07:58.332 INFO:tasks.rados.rados.0.smithi012.stdout:3222: done (0 left) 2024-09-10T18:07:58.332 INFO:tasks.rados.rados.0.smithi012.stdout:3223: snap_remove snap 318 2024-09-10T18:07:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:3223: done (0 left) 2024-09-10T18:07:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:3224: rmattr oid 50 current snap is 319 2024-09-10T18:07:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:3224: done (0 left) 2024-09-10T18:07:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 319 2024-09-10T18:07:58.829 INFO:tasks.rados.rados.0.smithi012.stdout:3225: seq_num 999 ranges {2727936=737280,3465216=565248,4030464=761856,4792320=278528} 2024-09-10T18:07:58.848 INFO:tasks.rados.rados.0.smithi012.stdout:3225: writing smithi01278544-44 from 2727936 to 3465216 tid 1 2024-09-10T18:07:58.851 INFO:tasks.rados.rados.0.smithi012.stdout:3225: writing smithi01278544-44 from 3465216 to 4030464 tid 2 2024-09-10T18:07:58.855 INFO:tasks.rados.rados.0.smithi012.stdout:3225: writing smithi01278544-44 from 4030464 to 4792320 tid 3 2024-09-10T18:07:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:3225: writing smithi01278544-44 from 4792320 to 5070848 tid 4 2024-09-10T18:07:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:3226: rollback oid 4 current snap is 319 2024-09-10T18:07:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 314 2024-09-10T18:07:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:3225: finishing write tid 1 to smithi01278544-44 2024-09-10T18:07:58.859 INFO:tasks.rados.rados.0.smithi012.stdout:3227: read oid 2 snap -1 2024-09-10T18:07:58.859 INFO:tasks.rados.rados.0.smithi012.stdout:3227: expect (ObjNum 982 snap 311 seq_num 982) 2024-09-10T18:07:58.859 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 319 2024-09-10T18:07:58.859 INFO:tasks.rados.rados.0.smithi012.stdout:3228: seq_num 1000 ranges {1925120=753664,2678784=442368,3121152=565248,3686400=458752,4145152=139264} 2024-09-10T18:07:58.872 INFO:tasks.rados.rados.0.smithi012.stdout:3228: writing smithi01278544-9 from 1925120 to 2678784 tid 1 2024-09-10T18:07:58.875 INFO:tasks.rados.rados.0.smithi012.stdout:3228: writing smithi01278544-9 from 2678784 to 3121152 tid 2 2024-09-10T18:07:58.878 INFO:tasks.rados.rados.0.smithi012.stdout:3228: writing smithi01278544-9 from 3121152 to 3686400 tid 3 2024-09-10T18:07:58.881 INFO:tasks.rados.rados.0.smithi012.stdout:3228: writing smithi01278544-9 from 3686400 to 4145152 tid 4 2024-09-10T18:07:58.882 INFO:tasks.rados.rados.0.smithi012.stdout:3228: writing smithi01278544-9 from 4145152 to 4284416 tid 5 2024-09-10T18:07:58.882 INFO:tasks.rados.rados.0.smithi012.stdout:3229: read oid 15 snap -1 2024-09-10T18:07:58.882 INFO:tasks.rados.rados.0.smithi012.stdout:3229: expect (ObjNum 992 snap 316 seq_num 992) 2024-09-10T18:07:58.882 INFO:tasks.rados.rados.0.smithi012.stdout:3230: read oid 22 snap -1 2024-09-10T18:07:58.882 INFO:tasks.rados.rados.0.smithi012.stdout:3230: expect (ObjNum 981 snap 311 seq_num 981) 2024-09-10T18:07:58.917 INFO:tasks.rados.rados.0.smithi012.stdout:3231: copy_from oid 5 from oid 26 current snap is 319 2024-09-10T18:07:58.917 INFO:tasks.rados.rados.0.smithi012.stdout:3225: finishing write tid 2 to smithi01278544-44 2024-09-10T18:07:58.917 INFO:tasks.rados.rados.0.smithi012.stdout:3226: finishing rollback tid 0 to smithi01278544-4 2024-09-10T18:07:58.917 INFO:tasks.rados.rados.0.smithi012.stdout:3225: finishing write tid 3 to smithi01278544-44 2024-09-10T18:07:58.917 INFO:tasks.rados.rados.0.smithi012.stdout:3225: finishing write tid 4 to smithi01278544-44 2024-09-10T18:07:58.917 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 319 2024-09-10T18:07:58.917 INFO:tasks.rados.rados.0.smithi012.stdout:3226: finishing rollback tid 1 to smithi01278544-4 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3225: finishing write tid 5 to smithi01278544-44 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3226: finishing rollback tid 2 to smithi01278544-4 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2192 (ObjNum 976 snap 310 seq_num 976) dirty exists 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3225: finishing write tid 6 to smithi01278544-44 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3225: oid 44 updating version 0 to 2010 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3225: oid 44 version 2010 is already newer than 2007 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3225: oid 44 version 2010 is already newer than 2008 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3225: oid 44 version 2010 is already newer than 2009 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3225: oid 44 updating version 2010 to 2011 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2011 (ObjNum 999 snap 319 seq_num 999) dirty exists 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3225: left oid 44 (ObjNum 999 snap 319 seq_num 999) 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3228: finishing write tid 1 to smithi01278544-9 2024-09-10T18:07:58.918 INFO:tasks.rados.rados.0.smithi012.stdout:3232: seq_num 1001 ranges {1892352=770048,2662400=729088,3391488=770048,4161536=106496} 2024-09-10T18:07:58.930 INFO:tasks.rados.rados.0.smithi012.stdout:3232: writing smithi01278544-39 from 1892352 to 2662400 tid 1 2024-09-10T18:07:58.935 INFO:tasks.rados.rados.0.smithi012.stdout:3232: writing smithi01278544-39 from 2662400 to 3391488 tid 2 2024-09-10T18:07:58.940 INFO:tasks.rados.rados.0.smithi012.stdout:3232: writing smithi01278544-39 from 3391488 to 4161536 tid 3 2024-09-10T18:07:58.941 INFO:tasks.rados.rados.0.smithi012.stdout:3232: writing smithi01278544-39 from 4161536 to 4268032 tid 4 2024-09-10T18:07:58.941 INFO:tasks.rados.rados.0.smithi012.stdout:3225: done (7 left) 2024-09-10T18:07:58.941 INFO:tasks.rados.rados.0.smithi012.stdout:3226: done (6 left) 2024-09-10T18:07:58.941 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 319 2024-09-10T18:07:58.941 INFO:tasks.rados.rados.0.smithi012.stdout:3228: finishing write tid 2 to smithi01278544-9 2024-09-10T18:07:58.941 INFO:tasks.rados.rados.0.smithi012.stdout:3228: finishing write tid 3 to smithi01278544-9 2024-09-10T18:07:58.941 INFO:tasks.rados.rados.0.smithi012.stdout:3228: finishing write tid 4 to smithi01278544-9 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: finishing write tid 5 to smithi01278544-9 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: finishing write tid 6 to smithi01278544-9 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: finishing write tid 7 to smithi01278544-9 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: oid 9 updating version 0 to 2160 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: oid 9 version 2160 is already newer than 2159 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: oid 9 version 2160 is already newer than 2157 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: oid 9 version 2160 is already newer than 2155 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: oid 9 version 2160 is already newer than 2158 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: oid 9 version 2160 is already newer than 2156 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 2160 (ObjNum 1000 snap 319 seq_num 1000) dirty exists 2024-09-10T18:07:58.942 INFO:tasks.rados.rados.0.smithi012.stdout:3228: left oid 9 (ObjNum 1000 snap 319 seq_num 1000) 2024-09-10T18:07:58.943 INFO:tasks.rados.rados.0.smithi012.stdout:3230: expect (ObjNum 981 snap 311 seq_num 981) 2024-09-10T18:07:58.997 INFO:tasks.rados.rados.0.smithi012.stdout:3232: finishing write tid 1 to smithi01278544-39 2024-09-10T18:07:58.997 INFO:tasks.rados.rados.0.smithi012.stdout:3232: finishing write tid 2 to smithi01278544-39 2024-09-10T18:07:58.997 INFO:tasks.rados.rados.0.smithi012.stdout:3232: finishing write tid 3 to smithi01278544-39 2024-09-10T18:07:58.997 INFO:tasks.rados.rados.0.smithi012.stdout:3232: finishing write tid 4 to smithi01278544-39 2024-09-10T18:07:58.997 INFO:tasks.rados.rados.0.smithi012.stdout:3232: finishing write tid 5 to smithi01278544-39 2024-09-10T18:07:58.998 INFO:tasks.rados.rados.0.smithi012.stdout:3233: seq_num 1002 ranges {2088960=786432,2875392=614400,3489792=581632,4071424=409600} 2024-09-10T18:07:59.013 INFO:tasks.rados.rados.0.smithi012.stdout:3233: writing smithi01278544-18 from 2088960 to 2875392 tid 1 2024-09-10T18:07:59.017 INFO:tasks.rados.rados.0.smithi012.stdout:3233: writing smithi01278544-18 from 2875392 to 3489792 tid 2 2024-09-10T18:07:59.019 INFO:tasks.rados.rados.0.smithi012.stdout:3233: writing smithi01278544-18 from 3489792 to 4071424 tid 3 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3233: writing smithi01278544-18 from 4071424 to 4481024 tid 4 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3228: done (6 left) 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3230: done (5 left) 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 319 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3232: finishing write tid 6 to smithi01278544-39 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3232: oid 39 updating version 0 to 2294 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3232: oid 39 updating version 2294 to 2297 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3232: oid 39 version 2297 is already newer than 2296 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3232: oid 39 version 2297 is already newer than 2293 2024-09-10T18:07:59.022 INFO:tasks.rados.rados.0.smithi012.stdout:3232: oid 39 version 2297 is already newer than 2295 2024-09-10T18:07:59.023 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2297 (ObjNum 1001 snap 319 seq_num 1001) dirty exists 2024-09-10T18:07:59.023 INFO:tasks.rados.rados.0.smithi012.stdout:3232: left oid 39 (ObjNum 1001 snap 319 seq_num 1001) 2024-09-10T18:07:59.023 INFO:tasks.rados.rados.0.smithi012.stdout:3227: expect (ObjNum 982 snap 311 seq_num 982) 2024-09-10T18:07:59.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:58 smithi012 ceph-mon[89611]: pgmap v771: 121 pgs: 121 active+clean; 224 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-09-10T18:07:59.185 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:58 smithi012 ceph-mon[92029]: pgmap v771: 121 pgs: 121 active+clean; 224 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-09-10T18:07:59.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:58 smithi089 ceph-mon[84132]: pgmap v771: 121 pgs: 121 active+clean; 224 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-09-10T18:08:00.225 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:59 smithi089 ceph-mon[84132]: osdmap e727: 8 total, 8 up, 8 in 2024-09-10T18:08:00.226 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:07:59 smithi089 ceph-mon[84132]: pgmap v774: 121 pgs: 121 active+clean; 231 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2024-09-10T18:08:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:59 smithi012 ceph-mon[89611]: osdmap e727: 8 total, 8 up, 8 in 2024-09-10T18:08:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:07:59 smithi012 ceph-mon[89611]: pgmap v774: 121 pgs: 121 active+clean; 231 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2024-09-10T18:08:00.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:59 smithi012 ceph-mon[92029]: osdmap e727: 8 total, 8 up, 8 in 2024-09-10T18:08:00.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:07:59 smithi012 ceph-mon[92029]: pgmap v774: 121 pgs: 121 active+clean; 231 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2024-09-10T18:08:00.536 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:08:00 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=infra.usagestats t=2024-09-10T18:08:00.223520544Z level=info msg="Usage stats are ready to report" 2024-09-10T18:08:01.495 INFO:tasks.rados.rados.0.smithi012.stdout:3231: finishing copy_from racing read to smithi01278544-5 2024-09-10T18:08:01.495 INFO:tasks.rados.rados.0.smithi012.stdout:3231: finishing copy_from to smithi01278544-5 2024-09-10T18:08:01.495 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 2023 (ObjNum 903 snap 294 seq_num 903) dirty exists 2024-09-10T18:08:01.495 INFO:tasks.rados.rados.0.smithi012.stdout:3234: seq_num 1003 ranges {0=802816,802816=499712,1302528=737280,2039808=368640} 2024-09-10T18:08:01.499 INFO:tasks.rados.rados.0.smithi012.stdout:3234: writing smithi01278544-50 from 0 to 802816 tid 1 2024-09-10T18:08:01.502 INFO:tasks.rados.rados.0.smithi012.stdout:3234: writing smithi01278544-50 from 802816 to 1302528 tid 2 2024-09-10T18:08:01.507 INFO:tasks.rados.rados.0.smithi012.stdout:3234: writing smithi01278544-50 from 1302528 to 2039808 tid 3 2024-09-10T18:08:01.509 INFO:tasks.rados.rados.0.smithi012.stdout:3234: writing smithi01278544-50 from 2039808 to 2408448 tid 4 2024-09-10T18:08:01.509 INFO:tasks.rados.rados.0.smithi012.stdout:3227: done (5 left) 2024-09-10T18:08:01.510 INFO:tasks.rados.rados.0.smithi012.stdout:3231: done (4 left) 2024-09-10T18:08:01.510 INFO:tasks.rados.rados.0.smithi012.stdout:3232: done (3 left) 2024-09-10T18:08:01.510 INFO:tasks.rados.rados.0.smithi012.stdout:3235: snap_remove snap 316 2024-09-10T18:08:02.164 INFO:tasks.rados.rados.0.smithi012.stdout:3235: done (3 left) 2024-09-10T18:08:02.165 INFO:tasks.rados.rados.0.smithi012.stdout:3236: snap_remove snap 317 2024-09-10T18:08:02.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:02 smithi012 ceph-mon[89611]: pgmap v775: 121 pgs: 121 active+clean; 236 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 33 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2024-09-10T18:08:02.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:02.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:02 smithi012 ceph-mon[92029]: pgmap v775: 121 pgs: 121 active+clean; 236 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 33 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2024-09-10T18:08:02.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:02.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:02 smithi089 ceph-mon[84132]: pgmap v775: 121 pgs: 121 active+clean; 236 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 33 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2024-09-10T18:08:02.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:02.797 INFO:tasks.rados.rados.0.smithi012.stdout:3236: done (3 left) 2024-09-10T18:08:02.798 INFO:tasks.rados.rados.0.smithi012.stdout:3237: rollback oid 34 current snap is 319 2024-09-10T18:08:02.798 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 34 to 315 2024-09-10T18:08:02.798 INFO:tasks.rados.rados.0.smithi012.stdout:3238: rollback oid 10 current snap is 319 2024-09-10T18:08:02.798 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 311 2024-09-10T18:08:02.798 INFO:tasks.rados.rados.0.smithi012.stdout:3229: expect (ObjNum 992 snap 316 seq_num 992) 2024-09-10T18:08:03.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:03 smithi012 ceph-mon[89611]: osdmap e728: 8 total, 8 up, 8 in 2024-09-10T18:08:03.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:03 smithi012 ceph-mon[89611]: osdmap e729: 8 total, 8 up, 8 in 2024-09-10T18:08:03.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:03 smithi012 ceph-mon[92029]: osdmap e728: 8 total, 8 up, 8 in 2024-09-10T18:08:03.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:03 smithi012 ceph-mon[92029]: osdmap e729: 8 total, 8 up, 8 in 2024-09-10T18:08:03.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:03 smithi089 ceph-mon[84132]: osdmap e728: 8 total, 8 up, 8 in 2024-09-10T18:08:03.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:03 smithi089 ceph-mon[84132]: osdmap e729: 8 total, 8 up, 8 in 2024-09-10T18:08:04.435 INFO:tasks.rados.rados.0.smithi012.stdout:3233: finishing write tid 1 to smithi01278544-18 2024-09-10T18:08:04.435 INFO:tasks.rados.rados.0.smithi012.stdout:3233: finishing write tid 2 to smithi01278544-18 2024-09-10T18:08:04.435 INFO:tasks.rados.rados.0.smithi012.stdout:3233: finishing write tid 3 to smithi01278544-18 2024-09-10T18:08:04.435 INFO:tasks.rados.rados.0.smithi012.stdout:3233: finishing write tid 4 to smithi01278544-18 2024-09-10T18:08:04.435 INFO:tasks.rados.rados.0.smithi012.stdout:3233: finishing write tid 5 to smithi01278544-18 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3233: finishing write tid 6 to smithi01278544-18 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3233: oid 18 updating version 0 to 2159 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3233: oid 18 updating version 2159 to 2162 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3233: oid 18 version 2162 is already newer than 2160 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3233: oid 18 version 2162 is already newer than 2161 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3233: oid 18 updating version 2162 to 2163 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 2163 (ObjNum 1002 snap 319 seq_num 1002) dirty exists 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3233: left oid 18 (ObjNum 1002 snap 319 seq_num 1002) 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3234: finishing write tid 1 to smithi01278544-50 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3234: finishing write tid 2 to smithi01278544-50 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3234: finishing write tid 3 to smithi01278544-50 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3234: finishing write tid 4 to smithi01278544-50 2024-09-10T18:08:04.436 INFO:tasks.rados.rados.0.smithi012.stdout:3229: done (4 left) 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3233: done (3 left) 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3239: read oid 19 snap -1 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3239: expect (ObjNum 960 snap 303 seq_num 960) 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 319 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3234: finishing write tid 5 to smithi01278544-50 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3240: seq_num 1004 ranges {0=16384} 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3240: writing smithi01278544-32 from 0 to 16384 tid 1 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3241: delete oid 48 current snap is 319 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3234: finishing write tid 6 to smithi01278544-50 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3234: oid 50 updating version 0 to 1611 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3234: oid 50 updating version 1611 to 1612 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3234: oid 50 updating version 1612 to 1613 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3234: oid 50 updating version 1613 to 1615 2024-09-10T18:08:04.437 INFO:tasks.rados.rados.0.smithi012.stdout:3234: oid 50 version 1615 is already newer than 1614 2024-09-10T18:08:04.438 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 1615 (ObjNum 1003 snap 319 seq_num 1003) dirty exists 2024-09-10T18:08:04.438 INFO:tasks.rados.rados.0.smithi012.stdout:3234: left oid 50 (ObjNum 1003 snap 319 seq_num 1003) 2024-09-10T18:08:04.438 INFO:tasks.rados.rados.0.smithi012.stdout:3238: finishing rollback tid 1 to smithi01278544-10 2024-09-10T18:08:04.438 INFO:tasks.rados.rados.0.smithi012.stdout:3238: finishing rollback tid 2 to smithi01278544-10 2024-09-10T18:08:04.438 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2303 (ObjNum 983 snap 311 seq_num 983) dirty exists 2024-09-10T18:08:04.438 INFO:tasks.rados.rados.0.smithi012.stdout:3237: finishing rollback tid 1 to smithi01278544-34 2024-09-10T18:08:04.438 INFO:tasks.rados.rados.0.smithi012.stdout:3237: finishing rollback tid 2 to smithi01278544-34 2024-09-10T18:08:04.438 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 1303 (ObjNum 946 snap 299 seq_num 946) dirty exists 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3234: done (5 left) 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3237: done (4 left) 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3238: done (3 left) 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3241: done (2 left) 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3242: rollback oid 21 current snap is 319 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 314 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3243: rollback oid 16 current snap is 319 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 315 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3244: read oid 20 snap 311 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3244: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3245: read oid 35 snap -1 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3245: expect (ObjNum 995 snap 319 seq_num 995) 2024-09-10T18:08:04.440 INFO:tasks.rados.rados.0.smithi012.stdout:3246: read oid 11 snap -1 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:3246: expect (ObjNum 961 snap 303 seq_num 961) 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:3247: read oid 22 snap -1 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:3247: expect (ObjNum 981 snap 311 seq_num 981) 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:3248: read oid 39 snap -1 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:3248: expect (ObjNum 1001 snap 319 seq_num 1001) 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:3249: copy_from oid 27 from oid 18 current snap is 319 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:3240: finishing write tid 1 to smithi01278544-32 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 319 2024-09-10T18:08:04.441 INFO:tasks.rados.rados.0.smithi012.stdout:3250: seq_num 1006 ranges {2129920=49152} 2024-09-10T18:08:04.450 INFO:tasks.rados.rados.0.smithi012.stdout:3250: writing smithi01278544-24 from 2129920 to 2179072 tid 1 2024-09-10T18:08:04.450 INFO:tasks.rados.rados.0.smithi012.stdout:3251: snap_create 2024-09-10T18:08:04.450 INFO:tasks.rados.rados.0.smithi012.stdout:3240: finishing write tid 2 to smithi01278544-32 2024-09-10T18:08:04.451 INFO:tasks.rados.rados.0.smithi012.stdout:3239: expect (ObjNum 960 snap 303 seq_num 960) 2024-09-10T18:08:04.523 INFO:tasks.rados.rados.0.smithi012.stdout:3243: finishing rollback tid 0 to smithi01278544-16 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3243: finishing rollback tid 1 to smithi01278544-16 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3250: finishing write tid 1 to smithi01278544-24 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3243: finishing rollback tid 2 to smithi01278544-16 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 2092 (ObjNum 856 snap 278 seq_num 856) dirty exists 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3242: finishing rollback tid 0 to smithi01278544-21 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3242: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 1311 (ObjNum 81 snap 0 seq_num 1) dirty dne 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3250: finishing write tid 2 to smithi01278544-24 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3250: finishing write tid 3 to smithi01278544-24 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3250: oid 24 updating version 0 to 2024 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:3250: oid 24 updating version 2024 to 2025 2024-09-10T18:08:04.524 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 2025 (ObjNum 1006 snap 319 seq_num 1006) dirty exists 2024-09-10T18:08:04.525 INFO:tasks.rados.rados.0.smithi012.stdout:3250: left oid 24 (ObjNum 1006 snap 319 seq_num 1006) 2024-09-10T18:08:04.525 INFO:tasks.rados.rados.0.smithi012.stdout:3249: finishing copy_from racing read to smithi01278544-27 2024-09-10T18:08:04.525 INFO:tasks.rados.rados.0.smithi012.stdout:3249: finishing copy_from to smithi01278544-27 2024-09-10T18:08:04.525 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 2163 (ObjNum 1002 snap 319 seq_num 1002) dirty exists 2024-09-10T18:08:04.525 INFO:tasks.rados.rados.0.smithi012.stdout:3244: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:08:04.758 INFO:tasks.rados.rados.0.smithi012.stdout:3246: expect (ObjNum 961 snap 303 seq_num 961) 2024-09-10T18:08:04.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:08:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:08:04] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.51.0" 2024-09-10T18:08:04.804 INFO:tasks.rados.rados.0.smithi012.stdout:3247: expect (ObjNum 981 snap 311 seq_num 981) 2024-09-10T18:08:04.858 INFO:tasks.rados.rados.0.smithi012.stdout:3248: expect (ObjNum 1001 snap 319 seq_num 1001) 2024-09-10T18:08:05.001 INFO:tasks.rados.rados.0.smithi012.stdout:3240: finishing write tid 3 to smithi01278544-32 2024-09-10T18:08:05.001 INFO:tasks.rados.rados.0.smithi012.stdout:3240: oid 32 updating version 0 to 2042 2024-09-10T18:08:05.001 INFO:tasks.rados.rados.0.smithi012.stdout:3240: oid 32 updating version 2042 to 2043 2024-09-10T18:08:05.001 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2043 (ObjNum 1004 snap 319 seq_num 1004) dirty exists 2024-09-10T18:08:05.001 INFO:tasks.rados.rados.0.smithi012.stdout:3240: left oid 32 (ObjNum 1004 snap 319 seq_num 1004) 2024-09-10T18:08:05.001 INFO:tasks.rados.rados.0.smithi012.stdout:3245: expect (ObjNum 995 snap 319 seq_num 995) 2024-09-10T18:08:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:04 smithi012 ceph-mon[89611]: pgmap v778: 121 pgs: 121 active+clean; 243 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 27 MiB/s rd, 3.6 MiB/s wr, 15 op/s 2024-09-10T18:08:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:04 smithi012 ceph-mon[92029]: pgmap v778: 121 pgs: 121 active+clean; 243 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 27 MiB/s rd, 3.6 MiB/s wr, 15 op/s 2024-09-10T18:08:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:04 smithi089 ceph-mon[84132]: pgmap v778: 121 pgs: 121 active+clean; 243 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 27 MiB/s rd, 3.6 MiB/s wr, 15 op/s 2024-09-10T18:08:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:05 smithi012 ceph-mon[89611]: osdmap e730: 8 total, 8 up, 8 in 2024-09-10T18:08:06.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:05 smithi012 ceph-mon[92029]: osdmap e730: 8 total, 8 up, 8 in 2024-09-10T18:08:06.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:05 smithi089 ceph-mon[84132]: osdmap e730: 8 total, 8 up, 8 in 2024-09-10T18:08:07.241 INFO:tasks.rados.rados.0.smithi012.stdout:3239: done (11 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3240: done (10 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3242: done (9 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3243: done (8 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3244: done (7 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3245: done (6 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3246: done (5 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3247: done (4 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3248: done (3 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3249: done (2 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3250: done (1 left) 2024-09-10T18:08:07.242 INFO:tasks.rados.rados.0.smithi012.stdout:3251: done (0 left) 2024-09-10T18:08:07.243 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 320 2024-09-10T18:08:07.243 INFO:tasks.rados.rados.0.smithi012.stdout:3252: seq_num 1007 ranges {3457024=65536} 2024-09-10T18:08:07.260 INFO:tasks.rados.rados.0.smithi012.stdout:3252: writing smithi01278544-5 from 3457024 to 3522560 tid 1 2024-09-10T18:08:07.260 INFO:tasks.rados.rados.0.smithi012.stdout:3253: delete oid 35 current snap is 320 2024-09-10T18:08:07.264 INFO:tasks.rados.rados.0.smithi012.stdout:3252: finishing write tid 1 to smithi01278544-5 2024-09-10T18:08:07.265 INFO:tasks.rados.rados.0.smithi012.stdout:3252: finishing write tid 2 to smithi01278544-5 2024-09-10T18:08:07.267 INFO:tasks.rados.rados.0.smithi012.stdout:3253: done (1 left) 2024-09-10T18:08:07.267 INFO:tasks.rados.rados.0.smithi012.stdout:3254: rmattr oid 45 current snap is 320 2024-09-10T18:08:07.267 INFO:tasks.rados.rados.0.smithi012.stdout:3254: done (1 left) 2024-09-10T18:08:07.267 INFO:tasks.rados.rados.0.smithi012.stdout:3255: read oid 42 snap -1 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3255: expect (ObjNum 969 snap 308 seq_num 969) 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3256: read oid 46 snap -1 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3256: expect deleted 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3257: copy_from oid 25 from oid 1 current snap is 320 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3258: rmattr oid 30 current snap is 320 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3258: done (4 left) 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3259: read oid 14 snap 315 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3259: expect deleted 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3260: copy_from oid 38 from oid 47 current snap is 320 2024-09-10T18:08:07.268 INFO:tasks.rados.rados.0.smithi012.stdout:3261: snap_create 2024-09-10T18:08:07.269 INFO:tasks.rados.rados.0.smithi012.stdout:3252: finishing write tid 3 to smithi01278544-5 2024-09-10T18:08:07.269 INFO:tasks.rados.rados.0.smithi012.stdout:3252: oid 5 updating version 0 to 2025 2024-09-10T18:08:07.269 INFO:tasks.rados.rados.0.smithi012.stdout:3252: oid 5 version 2025 is already newer than 2024 2024-09-10T18:08:07.269 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 2025 (ObjNum 1007 snap 320 seq_num 1007) dirty exists 2024-09-10T18:08:07.269 INFO:tasks.rados.rados.0.smithi012.stdout:3252: left oid 5 (ObjNum 1007 snap 320 seq_num 1007) 2024-09-10T18:08:07.282 INFO:tasks.rados.rados.0.smithi012.stdout:3257: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:08:07.283 INFO:tasks.rados.rados.0.smithi012.stdout:3255: expect (ObjNum 969 snap 308 seq_num 969) 2024-09-10T18:08:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:06 smithi012 ceph-mon[89611]: pgmap v780: 121 pgs: 121 active+clean; 245 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 24 MiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-10T18:08:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:06 smithi012 ceph-mon[92029]: pgmap v780: 121 pgs: 121 active+clean; 245 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 24 MiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-10T18:08:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:06 smithi089 ceph-mon[84132]: pgmap v780: 121 pgs: 121 active+clean; 245 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 24 MiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-10T18:08:07.467 INFO:tasks.rados.rados.0.smithi012.stdout:3260: finishing copy_from to smithi01278544-38 2024-09-10T18:08:07.467 INFO:tasks.rados.rados.0.smithi012.stdout:3260: got expected ENOENT (src dne) 2024-09-10T18:08:07.467 INFO:tasks.rados.rados.0.smithi012.stdout:3260: finishing copy_from racing read to smithi01278544-38 2024-09-10T18:08:07.468 INFO:tasks.rados.rados.0.smithi012.stdout:3257: finishing copy_from to smithi01278544-25 2024-09-10T18:08:07.468 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 2153 (ObjNum 945 snap 298 seq_num 945) dirty exists 2024-09-10T18:08:07.797 INFO:tasks.rados.rados.0.smithi012.stdout:3252: done (6 left) 2024-09-10T18:08:07.797 INFO:tasks.rados.rados.0.smithi012.stdout:3255: done (5 left) 2024-09-10T18:08:07.797 INFO:tasks.rados.rados.0.smithi012.stdout:3256: done (4 left) 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3257: done (3 left) 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3259: done (2 left) 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3260: done (1 left) 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3261: done (0 left) 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3262: rollback oid 9 current snap is 321 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 314 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3263: copy_from oid 11 from oid 31 current snap is 321 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3264: read oid 13 snap -1 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3264: expect (ObjNum 895 snap 292 seq_num 895) 2024-09-10T18:08:07.798 INFO:tasks.rados.rados.0.smithi012.stdout:3265: snap_create 2024-09-10T18:08:07.802 INFO:tasks.rados.rados.0.smithi012.stdout:3262: finishing rollback tid 0 to smithi01278544-9 2024-09-10T18:08:07.802 INFO:tasks.rados.rados.0.smithi012.stdout:3262: finishing rollback tid 1 to smithi01278544-9 2024-09-10T18:08:07.802 INFO:tasks.rados.rados.0.smithi012.stdout:3262: finishing rollback tid 2 to smithi01278544-9 2024-09-10T18:08:07.802 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 2163 (ObjNum 974 snap 309 seq_num 974) dirty exists 2024-09-10T18:08:07.828 INFO:tasks.rados.rados.0.smithi012.stdout:3264: expect (ObjNum 895 snap 292 seq_num 895) 2024-09-10T18:08:08.583 INFO:tasks.rados.rados.0.smithi012.stdout:3263: finishing copy_from racing read to smithi01278544-11 2024-09-10T18:08:08.583 INFO:tasks.rados.rados.0.smithi012.stdout:3263: finishing copy_from to smithi01278544-11 2024-09-10T18:08:08.583 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2189 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:3262: done (3 left) 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:3263: done (2 left) 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:3264: done (1 left) 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:3265: done (0 left) 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:3266: rollback oid 20 current snap is 322 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 315 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:3267: rmattr oid 23 current snap is 322 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:3267: done (1 left) 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:3268: rollback oid 31 current snap is 322 2024-09-10T18:08:08.799 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 31 to 319 2024-09-10T18:08:08.800 INFO:tasks.rados.rados.0.smithi012.stdout:3269: delete oid 39 current snap is 322 2024-09-10T18:08:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:3268: finishing rollback tid 0 to smithi01278544-31 2024-09-10T18:08:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:3268: finishing rollback tid 1 to smithi01278544-31 2024-09-10T18:08:08.803 INFO:tasks.rados.rados.0.smithi012.stdout:3268: finishing rollback tid 2 to smithi01278544-31 2024-09-10T18:08:08.804 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2195 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:08:08.812 INFO:tasks.rados.rados.0.smithi012.stdout:3266: finishing rollback tid 0 to smithi01278544-20 2024-09-10T18:08:08.814 INFO:tasks.rados.rados.0.smithi012.stdout:3266: finishing rollback tid 1 to smithi01278544-20 2024-09-10T18:08:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:3266: finishing rollback tid 2 to smithi01278544-20 2024-09-10T18:08:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2315 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:08:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:3266: done (2 left) 2024-09-10T18:08:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:3268: done (1 left) 2024-09-10T18:08:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:3269: done (0 left) 2024-09-10T18:08:08.815 INFO:tasks.rados.rados.0.smithi012.stdout:3270: delete oid 22 current snap is 322 2024-09-10T18:08:08.818 INFO:tasks.rados.rados.0.smithi012.stdout:3270: done (0 left) 2024-09-10T18:08:08.819 INFO:tasks.rados.rados.0.smithi012.stdout:3271: snap_remove snap 320 2024-09-10T18:08:09.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:08 smithi012 ceph-mon[89611]: pgmap v781: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-09-10T18:08:09.386 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:08 smithi012 ceph-mon[89611]: osdmap e731: 8 total, 8 up, 8 in 2024-09-10T18:08:09.387 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:08 smithi012 ceph-mon[92029]: pgmap v781: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-09-10T18:08:09.387 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:08 smithi012 ceph-mon[92029]: osdmap e731: 8 total, 8 up, 8 in 2024-09-10T18:08:09.387 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:08 smithi089 ceph-mon[84132]: pgmap v781: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 8.5 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-09-10T18:08:09.387 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:08 smithi089 ceph-mon[84132]: osdmap e731: 8 total, 8 up, 8 in 2024-09-10T18:08:09.813 INFO:tasks.rados.rados.0.smithi012.stdout:3271: done (0 left) 2024-09-10T18:08:09.814 INFO:tasks.rados.rados.0.smithi012.stdout:3272: delete oid 17 current snap is 322 2024-09-10T18:08:09.820 INFO:tasks.rados.rados.0.smithi012.stdout:3272: done (0 left) 2024-09-10T18:08:09.820 INFO:tasks.rados.rados.0.smithi012.stdout:3273: snap_create 2024-09-10T18:08:10.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:09 smithi012 ceph-mon[89611]: osdmap e732: 8 total, 8 up, 8 in 2024-09-10T18:08:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:09 smithi012 ceph-mon[92029]: osdmap e732: 8 total, 8 up, 8 in 2024-09-10T18:08:10.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:09 smithi089 ceph-mon[84132]: osdmap e732: 8 total, 8 up, 8 in 2024-09-10T18:08:10.815 INFO:tasks.rados.rados.0.smithi012.stdout:3273: done (0 left) 2024-09-10T18:08:10.815 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 8 current snap is 323 2024-09-10T18:08:10.815 INFO:tasks.rados.rados.0.smithi012.stdout:3274: seq_num 1012 ranges {0=155648} 2024-09-10T18:08:10.815 INFO:tasks.rados.rados.0.smithi012.stdout:3274: writing smithi01278544-8 from 0 to 155648 tid 1 2024-09-10T18:08:10.815 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 323 2024-09-10T18:08:10.816 INFO:tasks.rados.rados.0.smithi012.stdout:3275: seq_num 1013 ranges {5169152=172032} 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:3275: writing smithi01278544-29 from 5169152 to 5341184 tid 1 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:3276: copy_from oid 12 from oid 17 current snap is 323 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:3274: finishing write tid 1 to smithi01278544-8 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:3274: finishing write tid 2 to smithi01278544-8 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:3274: finishing write tid 3 to smithi01278544-8 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:3274: oid 8 updating version 0 to 2094 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:3274: oid 8 version 2094 is already newer than 2093 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 2094 (ObjNum 1012 snap 323 seq_num 1012) dirty exists 2024-09-10T18:08:10.846 INFO:tasks.rados.rados.0.smithi012.stdout:3274: left oid 8 (ObjNum 1012 snap 323 seq_num 1012) 2024-09-10T18:08:10.847 INFO:tasks.rados.rados.0.smithi012.stdout:3274: done (2 left) 2024-09-10T18:08:10.847 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 323 2024-09-10T18:08:10.847 INFO:tasks.rados.rados.0.smithi012.stdout:3277: seq_num 1014 ranges {0=188416} 2024-09-10T18:08:10.847 INFO:tasks.rados.rados.0.smithi012.stdout:3277: writing smithi01278544-22 from 0 to 188416 tid 1 2024-09-10T18:08:10.847 INFO:tasks.rados.rados.0.smithi012.stdout:3278: snap_remove snap 315 2024-09-10T18:08:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:10 smithi012 ceph-mon[89611]: pgmap v784: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-09-10T18:08:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:10 smithi012 ceph-mon[89611]: osdmap e733: 8 total, 8 up, 8 in 2024-09-10T18:08:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:10 smithi012 ceph-mon[92029]: pgmap v784: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-09-10T18:08:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:10 smithi012 ceph-mon[92029]: osdmap e733: 8 total, 8 up, 8 in 2024-09-10T18:08:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:10 smithi089 ceph-mon[84132]: pgmap v784: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-09-10T18:08:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:10 smithi089 ceph-mon[84132]: osdmap e733: 8 total, 8 up, 8 in 2024-09-10T18:08:11.845 INFO:tasks.rados.rados.0.smithi012.stdout:3278: done (3 left) 2024-09-10T18:08:11.845 INFO:tasks.rados.rados.0.smithi012.stdout:3279: rollback oid 40 current snap is 323 2024-09-10T18:08:11.846 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 40 to 322 2024-09-10T18:08:11.846 INFO:tasks.rados.rados.0.smithi012.stdout:3275: finishing write tid 1 to smithi01278544-29 2024-09-10T18:08:11.846 INFO:tasks.rados.rados.0.smithi012.stdout:3275: finishing write tid 2 to smithi01278544-29 2024-09-10T18:08:11.846 INFO:tasks.rados.rados.0.smithi012.stdout:3275: finishing write tid 3 to smithi01278544-29 2024-09-10T18:08:11.846 INFO:tasks.rados.rados.0.smithi012.stdout:3275: oid 29 updating version 0 to 1133 2024-09-10T18:08:11.847 INFO:tasks.rados.rados.0.smithi012.stdout:3275: oid 29 updating version 1133 to 1134 2024-09-10T18:08:11.847 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1134 (ObjNum 1013 snap 323 seq_num 1013) dirty exists 2024-09-10T18:08:11.847 INFO:tasks.rados.rados.0.smithi012.stdout:3275: left oid 29 (ObjNum 1013 snap 323 seq_num 1013) 2024-09-10T18:08:11.847 INFO:tasks.rados.rados.0.smithi012.stdout:3276: finishing copy_from to smithi01278544-12 2024-09-10T18:08:11.847 INFO:tasks.rados.rados.0.smithi012.stdout:3276: got expected ENOENT (src dne) 2024-09-10T18:08:11.847 INFO:tasks.rados.rados.0.smithi012.stdout:3276: finishing copy_from racing read to smithi01278544-12 2024-09-10T18:08:11.848 INFO:tasks.rados.rados.0.smithi012.stdout:3277: finishing write tid 1 to smithi01278544-22 2024-09-10T18:08:11.848 INFO:tasks.rados.rados.0.smithi012.stdout:3277: finishing write tid 2 to smithi01278544-22 2024-09-10T18:08:11.848 INFO:tasks.rados.rados.0.smithi012.stdout:3277: finishing write tid 3 to smithi01278544-22 2024-09-10T18:08:11.848 INFO:tasks.rados.rados.0.smithi012.stdout:3277: oid 22 updating version 0 to 2328 2024-09-10T18:08:11.848 INFO:tasks.rados.rados.0.smithi012.stdout:3277: oid 22 updating version 2328 to 2329 2024-09-10T18:08:11.848 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2329 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:08:11.849 INFO:tasks.rados.rados.0.smithi012.stdout:3277: left oid 22 (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:08:11.849 INFO:tasks.rados.rados.0.smithi012.stdout:3275: done (3 left) 2024-09-10T18:08:11.849 INFO:tasks.rados.rados.0.smithi012.stdout:3276: done (2 left) 2024-09-10T18:08:11.849 INFO:tasks.rados.rados.0.smithi012.stdout:3277: done (1 left) 2024-09-10T18:08:11.849 INFO:tasks.rados.rados.0.smithi012.stdout:3280: snap_remove snap 314 2024-09-10T18:08:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:11 smithi012 ceph-mon[89611]: osdmap e734: 8 total, 8 up, 8 in 2024-09-10T18:08:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:11 smithi012 ceph-mon[89611]: pgmap v787: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 19 MiB/s rd, 32 KiB/s wr, 6 op/s 2024-09-10T18:08:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:11 smithi012 ceph-mon[92029]: osdmap e734: 8 total, 8 up, 8 in 2024-09-10T18:08:12.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:11 smithi012 ceph-mon[92029]: pgmap v787: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 19 MiB/s rd, 32 KiB/s wr, 6 op/s 2024-09-10T18:08:12.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:11 smithi089 ceph-mon[84132]: osdmap e734: 8 total, 8 up, 8 in 2024-09-10T18:08:12.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:11 smithi089 ceph-mon[84132]: pgmap v787: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 19 MiB/s rd, 32 KiB/s wr, 6 op/s 2024-09-10T18:08:12.802 INFO:tasks.rados.rados.0.smithi012.stdout:3280: done (1 left) 2024-09-10T18:08:12.802 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 323 2024-09-10T18:08:12.802 INFO:tasks.rados.rados.0.smithi012.stdout:3279: finishing rollback tid 0 to smithi01278544-40 2024-09-10T18:08:12.802 INFO:tasks.rados.rados.0.smithi012.stdout:3279: finishing rollback tid 1 to smithi01278544-40 2024-09-10T18:08:12.803 INFO:tasks.rados.rados.0.smithi012.stdout:3279: finishing rollback tid 2 to smithi01278544-40 2024-09-10T18:08:12.803 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2255 (ObjNum 944 snap 298 seq_num 944) dirty exists 2024-09-10T18:08:12.803 INFO:tasks.rados.rados.0.smithi012.stdout:3281: seq_num 1015 ranges {1925120=204800} 2024-09-10T18:08:12.815 INFO:tasks.rados.rados.0.smithi012.stdout:3281: writing smithi01278544-9 from 1925120 to 2129920 tid 1 2024-09-10T18:08:12.815 INFO:tasks.rados.rados.0.smithi012.stdout:3279: done (1 left) 2024-09-10T18:08:12.815 INFO:tasks.rados.rados.0.smithi012.stdout:3282: snap_create 2024-09-10T18:08:12.828 INFO:tasks.rados.rados.0.smithi012.stdout:3281: finishing write tid 1 to smithi01278544-9 2024-09-10T18:08:12.828 INFO:tasks.rados.rados.0.smithi012.stdout:3281: finishing write tid 2 to smithi01278544-9 2024-09-10T18:08:12.830 INFO:tasks.rados.rados.0.smithi012.stdout:3281: finishing write tid 3 to smithi01278544-9 2024-09-10T18:08:12.830 INFO:tasks.rados.rados.0.smithi012.stdout:3281: oid 9 updating version 0 to 2165 2024-09-10T18:08:12.830 INFO:tasks.rados.rados.0.smithi012.stdout:3281: oid 9 version 2165 is already newer than 2164 2024-09-10T18:08:12.830 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 2165 (ObjNum 1015 snap 323 seq_num 1015) dirty exists 2024-09-10T18:08:12.830 INFO:tasks.rados.rados.0.smithi012.stdout:3281: left oid 9 (ObjNum 1015 snap 323 seq_num 1015) 2024-09-10T18:08:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:12 smithi012 ceph-mon[89611]: osdmap e735: 8 total, 8 up, 8 in 2024-09-10T18:08:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:12 smithi012 ceph-mon[89611]: osdmap e736: 8 total, 8 up, 8 in 2024-09-10T18:08:13.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:12 smithi012 ceph-mon[92029]: osdmap e735: 8 total, 8 up, 8 in 2024-09-10T18:08:13.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:12 smithi012 ceph-mon[92029]: osdmap e736: 8 total, 8 up, 8 in 2024-09-10T18:08:13.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:12 smithi089 ceph-mon[84132]: osdmap e735: 8 total, 8 up, 8 in 2024-09-10T18:08:13.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:12 smithi089 ceph-mon[84132]: osdmap e736: 8 total, 8 up, 8 in 2024-09-10T18:08:13.804 INFO:tasks.rados.rados.0.smithi012.stdout:3281: done (1 left) 2024-09-10T18:08:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:3282: done (0 left) 2024-09-10T18:08:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:3283: read oid 31 snap -1 2024-09-10T18:08:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:3283: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:08:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:3284: read oid 45 snap -1 2024-09-10T18:08:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:3284: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:08:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:3285: read oid 38 snap 321 2024-09-10T18:08:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:3285: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:08:13.805 INFO:tasks.rados.rados.0.smithi012.stdout:3286: delete oid 48 current snap is 324 2024-09-10T18:08:13.813 INFO:tasks.rados.rados.0.smithi012.stdout:3283: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:08:13.845 INFO:tasks.rados.rados.0.smithi012.stdout:3284: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:08:13.887 INFO:tasks.rados.rados.0.smithi012.stdout:3285: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:08:13.964 INFO:tasks.rados.rados.0.smithi012.stdout:3283: done (3 left) 2024-09-10T18:08:13.964 INFO:tasks.rados.rados.0.smithi012.stdout:3284: done (2 left) 2024-09-10T18:08:13.964 INFO:tasks.rados.rados.0.smithi012.stdout:3285: done (1 left) 2024-09-10T18:08:13.964 INFO:tasks.rados.rados.0.smithi012.stdout:3286: done (0 left) 2024-09-10T18:08:13.965 INFO:tasks.rados.rados.0.smithi012.stdout:3287: rollback oid 1 current snap is 324 2024-09-10T18:08:13.965 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 311 2024-09-10T18:08:13.965 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 324 2024-09-10T18:08:13.965 INFO:tasks.rados.rados.0.smithi012.stdout:3288: seq_num 1017 ranges {0=237568} 2024-09-10T18:08:13.966 INFO:tasks.rados.rados.0.smithi012.stdout:3288: writing smithi01278544-21 from 0 to 237568 tid 1 2024-09-10T18:08:13.966 INFO:tasks.rados.rados.0.smithi012.stdout:3289: snap_create 2024-09-10T18:08:13.967 INFO:tasks.rados.rados.0.smithi012.stdout:3287: finishing rollback tid 0 to smithi01278544-1 2024-09-10T18:08:13.970 INFO:tasks.rados.rados.0.smithi012.stdout:3287: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:08:13.972 INFO:tasks.rados.rados.0.smithi012.stdout:3287: finishing rollback tid 2 to smithi01278544-1 2024-09-10T18:08:13.972 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2168 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:08:13.972 INFO:tasks.rados.rados.0.smithi012.stdout:3288: finishing write tid 1 to smithi01278544-21 2024-09-10T18:08:13.972 INFO:tasks.rados.rados.0.smithi012.stdout:3288: finishing write tid 2 to smithi01278544-21 2024-09-10T18:08:13.973 INFO:tasks.rados.rados.0.smithi012.stdout:3288: finishing write tid 3 to smithi01278544-21 2024-09-10T18:08:13.973 INFO:tasks.rados.rados.0.smithi012.stdout:3288: oid 21 updating version 0 to 1321 2024-09-10T18:08:13.973 INFO:tasks.rados.rados.0.smithi012.stdout:3288: oid 21 version 1321 is already newer than 1320 2024-09-10T18:08:13.973 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 1321 (ObjNum 1017 snap 324 seq_num 1017) dirty exists 2024-09-10T18:08:13.973 INFO:tasks.rados.rados.0.smithi012.stdout:3288: left oid 21 (ObjNum 1017 snap 324 seq_num 1017) 2024-09-10T18:08:14.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:08:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:08:14] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.51.0" 2024-09-10T18:08:14.840 INFO:tasks.rados.rados.0.smithi012.stdout:3287: done (2 left) 2024-09-10T18:08:14.841 INFO:tasks.rados.rados.0.smithi012.stdout:3288: done (1 left) 2024-09-10T18:08:14.841 INFO:tasks.rados.rados.0.smithi012.stdout:3289: done (0 left) 2024-09-10T18:08:14.841 INFO:tasks.rados.rados.0.smithi012.stdout:3290: rollback oid 16 current snap is 325 2024-09-10T18:08:14.841 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 311 2024-09-10T18:08:14.841 INFO:tasks.rados.rados.0.smithi012.stdout:3291: setattr oid 43 current snap is 325 2024-09-10T18:08:14.842 INFO:tasks.rados.rados.0.smithi012.stdout:3292: delete oid 40 current snap is 325 2024-09-10T18:08:14.851 INFO:tasks.rados.rados.0.smithi012.stdout:3290: finishing rollback tid 0 to smithi01278544-16 2024-09-10T18:08:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3290: finishing rollback tid 1 to smithi01278544-16 2024-09-10T18:08:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3290: finishing rollback tid 2 to smithi01278544-16 2024-09-10T18:08:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 2097 (ObjNum 856 snap 278 seq_num 856) dirty exists 2024-09-10T18:08:14.854 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2259 (ObjNum 935 snap 298 seq_num 935) dirty exists 2024-09-10T18:08:14.854 INFO:tasks.rados.rados.0.smithi012.stdout:3290: done (2 left) 2024-09-10T18:08:14.854 INFO:tasks.rados.rados.0.smithi012.stdout:3291: done (1 left) 2024-09-10T18:08:14.854 INFO:tasks.rados.rados.0.smithi012.stdout:3292: done (0 left) 2024-09-10T18:08:14.854 INFO:tasks.rados.rados.0.smithi012.stdout:3293: copy_from oid 13 from oid 10 current snap is 325 2024-09-10T18:08:14.855 INFO:tasks.rados.rados.0.smithi012.stdout:3294: setattr oid 22 current snap is 325 2024-09-10T18:08:14.856 INFO:tasks.rados.rados.0.smithi012.stdout:3295: copy_from oid 50 from oid 32 current snap is 325 2024-09-10T18:08:14.856 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 325 2024-09-10T18:08:14.856 INFO:tasks.rados.rados.0.smithi012.stdout:3296: seq_num 1019 ranges {13901824=270336} 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:3296: writing smithi01278544-4 from 13901824 to 14172160 tid 1 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:3297: snap_create 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:3295: finishing copy_from racing read to smithi01278544-50 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:3295: finishing copy_from to smithi01278544-50 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2043 (ObjNum 1004 snap 319 seq_num 1004) dirty exists 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2355 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:3293: finishing copy_from racing read to smithi01278544-13 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:3293: finishing copy_from to smithi01278544-13 2024-09-10T18:08:14.935 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 2303 (ObjNum 983 snap 311 seq_num 983) dirty exists 2024-09-10T18:08:14.938 INFO:tasks.rados.rados.0.smithi012.stdout:3296: finishing write tid 1 to smithi01278544-4 2024-09-10T18:08:14.938 INFO:tasks.rados.rados.0.smithi012.stdout:3296: finishing write tid 2 to smithi01278544-4 2024-09-10T18:08:14.939 INFO:tasks.rados.rados.0.smithi012.stdout:3296: finishing write tid 3 to smithi01278544-4 2024-09-10T18:08:14.939 INFO:tasks.rados.rados.0.smithi012.stdout:3296: oid 4 updating version 0 to 2304 2024-09-10T18:08:14.939 INFO:tasks.rados.rados.0.smithi012.stdout:3296: oid 4 updating version 2304 to 2305 2024-09-10T18:08:14.939 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2305 (ObjNum 1019 snap 325 seq_num 1019) dirty exists 2024-09-10T18:08:14.939 INFO:tasks.rados.rados.0.smithi012.stdout:3296: left oid 4 (ObjNum 1019 snap 325 seq_num 1019) 2024-09-10T18:08:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:14 smithi012 ceph-mon[92029]: pgmap v790: 121 pgs: 121 active+clean; 260 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 1012 KiB/s wr, 8 op/s 2024-09-10T18:08:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:14 smithi012 ceph-mon[92029]: osdmap e737: 8 total, 8 up, 8 in 2024-09-10T18:08:15.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:14 smithi012 ceph-mon[89611]: pgmap v790: 121 pgs: 121 active+clean; 260 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 1012 KiB/s wr, 8 op/s 2024-09-10T18:08:15.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:14 smithi012 ceph-mon[89611]: osdmap e737: 8 total, 8 up, 8 in 2024-09-10T18:08:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:14 smithi089 ceph-mon[84132]: pgmap v790: 121 pgs: 121 active+clean; 260 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 1012 KiB/s wr, 8 op/s 2024-09-10T18:08:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:14 smithi089 ceph-mon[84132]: osdmap e737: 8 total, 8 up, 8 in 2024-09-10T18:08:15.848 INFO:tasks.rados.rados.0.smithi012.stdout:3293: done (4 left) 2024-09-10T18:08:15.848 INFO:tasks.rados.rados.0.smithi012.stdout:3294: done (3 left) 2024-09-10T18:08:15.848 INFO:tasks.rados.rados.0.smithi012.stdout:3295: done (2 left) 2024-09-10T18:08:15.849 INFO:tasks.rados.rados.0.smithi012.stdout:3296: done (1 left) 2024-09-10T18:08:15.849 INFO:tasks.rados.rados.0.smithi012.stdout:3297: done (0 left) 2024-09-10T18:08:15.849 INFO:tasks.rados.rados.0.smithi012.stdout:3298: read oid 10 snap -1 2024-09-10T18:08:15.849 INFO:tasks.rados.rados.0.smithi012.stdout:3298: expect (ObjNum 983 snap 311 seq_num 983) 2024-09-10T18:08:15.849 INFO:tasks.rados.rados.0.smithi012.stdout:3299: snap_create 2024-09-10T18:08:15.871 INFO:tasks.rados.rados.0.smithi012.stdout:3298: expect (ObjNum 983 snap 311 seq_num 983) 2024-09-10T18:08:16.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:15 smithi089 ceph-mon[84132]: osdmap e738: 8 total, 8 up, 8 in 2024-09-10T18:08:16.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:15 smithi089 ceph-mon[84132]: pgmap v793: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-09-10T18:08:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:15 smithi012 ceph-mon[92029]: osdmap e738: 8 total, 8 up, 8 in 2024-09-10T18:08:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:15 smithi012 ceph-mon[92029]: pgmap v793: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-09-10T18:08:16.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:15 smithi012 ceph-mon[89611]: osdmap e738: 8 total, 8 up, 8 in 2024-09-10T18:08:16.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:15 smithi012 ceph-mon[89611]: pgmap v793: 121 pgs: 121 active+clean; 256 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-09-10T18:08:16.848 INFO:tasks.rados.rados.0.smithi012.stdout:3298: done (1 left) 2024-09-10T18:08:16.848 INFO:tasks.rados.rados.0.smithi012.stdout:3299: done (0 left) 2024-09-10T18:08:16.848 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 327 2024-09-10T18:08:16.849 INFO:tasks.rados.rados.0.smithi012.stdout:3300: seq_num 1020 ranges {4595712=286720} 2024-09-10T18:08:16.875 INFO:tasks.rados.rados.0.smithi012.stdout:3300: writing smithi01278544-42 from 4595712 to 4882432 tid 1 2024-09-10T18:08:16.875 INFO:tasks.rados.rados.0.smithi012.stdout:3301: setattr oid 12 current snap is 327 2024-09-10T18:08:16.877 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 327 2024-09-10T18:08:16.877 INFO:tasks.rados.rados.0.smithi012.stdout:3302: seq_num 1021 ranges {2498560=303104} 2024-09-10T18:08:16.893 INFO:tasks.rados.rados.0.smithi012.stdout:3302: writing smithi01278544-25 from 2498560 to 2801664 tid 1 2024-09-10T18:08:16.893 INFO:tasks.rados.rados.0.smithi012.stdout:3303: read oid 23 snap -1 2024-09-10T18:08:16.893 INFO:tasks.rados.rados.0.smithi012.stdout:3303: expect (ObjNum 957 snap 303 seq_num 957) 2024-09-10T18:08:16.893 INFO:tasks.rados.rados.0.smithi012.stdout:3304: delete oid 17 current snap is 327 2024-09-10T18:08:16.893 INFO:tasks.rados.rados.0.smithi012.stdout:3300: finishing write tid 1 to smithi01278544-42 2024-09-10T18:08:16.893 INFO:tasks.rados.rados.0.smithi012.stdout:3300: finishing write tid 2 to smithi01278544-42 2024-09-10T18:08:16.894 INFO:tasks.rados.rados.0.smithi012.stdout:3300: finishing write tid 3 to smithi01278544-42 2024-09-10T18:08:16.894 INFO:tasks.rados.rados.0.smithi012.stdout:3300: oid 42 updating version 0 to 2264 2024-09-10T18:08:16.894 INFO:tasks.rados.rados.0.smithi012.stdout:3300: oid 42 version 2264 is already newer than 2263 2024-09-10T18:08:16.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2264 (ObjNum 1020 snap 327 seq_num 1020) dirty exists 2024-09-10T18:08:16.894 INFO:tasks.rados.rados.0.smithi012.stdout:3300: left oid 42 (ObjNum 1020 snap 327 seq_num 1020) 2024-09-10T18:08:16.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2357 (ObjNum 959 snap 303 seq_num 959) dirty exists 2024-09-10T18:08:16.897 INFO:tasks.rados.rados.0.smithi012.stdout:3302: finishing write tid 1 to smithi01278544-25 2024-09-10T18:08:16.897 INFO:tasks.rados.rados.0.smithi012.stdout:3302: finishing write tid 2 to smithi01278544-25 2024-09-10T18:08:16.898 INFO:tasks.rados.rados.0.smithi012.stdout:3300: done (4 left) 2024-09-10T18:08:16.898 INFO:tasks.rados.rados.0.smithi012.stdout:3301: done (3 left) 2024-09-10T18:08:16.898 INFO:tasks.rados.rados.0.smithi012.stdout:3304: done (2 left) 2024-09-10T18:08:16.898 INFO:tasks.rados.rados.0.smithi012.stdout:3305: setattr oid 46 current snap is 327 2024-09-10T18:08:16.899 INFO:tasks.rados.rados.0.smithi012.stdout:3306: delete oid 33 current snap is 327 2024-09-10T18:08:16.899 INFO:tasks.rados.rados.0.smithi012.stdout:3302: finishing write tid 3 to smithi01278544-25 2024-09-10T18:08:16.899 INFO:tasks.rados.rados.0.smithi012.stdout:3302: oid 25 updating version 0 to 2359 2024-09-10T18:08:16.899 INFO:tasks.rados.rados.0.smithi012.stdout:3302: oid 25 updating version 2359 to 2360 2024-09-10T18:08:16.899 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 2360 (ObjNum 1021 snap 327 seq_num 1021) dirty exists 2024-09-10T18:08:16.899 INFO:tasks.rados.rados.0.smithi012.stdout:3302: left oid 25 (ObjNum 1021 snap 327 seq_num 1021) 2024-09-10T18:08:16.899 INFO:tasks.rados.rados.0.smithi012.stdout:3303: expect (ObjNum 957 snap 303 seq_num 957) 2024-09-10T18:08:16.943 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 2164 (ObjNum 33 snap 0 seq_num 3496638208) dirty exists 2024-09-10T18:08:16.943 INFO:tasks.rados.rados.0.smithi012.stdout:3302: done (3 left) 2024-09-10T18:08:16.944 INFO:tasks.rados.rados.0.smithi012.stdout:3303: done (2 left) 2024-09-10T18:08:16.944 INFO:tasks.rados.rados.0.smithi012.stdout:3305: done (1 left) 2024-09-10T18:08:16.944 INFO:tasks.rados.rados.0.smithi012.stdout:3306: done (0 left) 2024-09-10T18:08:16.944 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 327 2024-09-10T18:08:16.944 INFO:tasks.rados.rados.0.smithi012.stdout:3307: seq_num 1024 ranges {11665408=352256} 2024-09-10T18:08:17.009 INFO:tasks.rados.rados.0.smithi012.stdout:3307: writing smithi01278544-12 from 11665408 to 12017664 tid 1 2024-09-10T18:08:17.009 INFO:tasks.rados.rados.0.smithi012.stdout:3308: snap_remove snap 324 2024-09-10T18:08:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:16 smithi012 ceph-mon[89611]: osdmap e739: 8 total, 8 up, 8 in 2024-09-10T18:08:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:16 smithi012 ceph-mon[92029]: osdmap e739: 8 total, 8 up, 8 in 2024-09-10T18:08:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:16 smithi089 ceph-mon[84132]: osdmap e739: 8 total, 8 up, 8 in 2024-09-10T18:08:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:17.809 INFO:tasks.rados.rados.0.smithi012.stdout:3308: done (1 left) 2024-09-10T18:08:17.809 INFO:tasks.rados.rados.0.smithi012.stdout:3309: copy_from oid 28 from oid 33 current snap is 327 2024-09-10T18:08:17.809 INFO:tasks.rados.rados.0.smithi012.stdout:3310: rollback oid 2 current snap is 327 2024-09-10T18:08:17.809 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 2 to 321 2024-09-10T18:08:17.809 INFO:tasks.rados.rados.0.smithi012.stdout:3311: snap_create 2024-09-10T18:08:17.810 INFO:tasks.rados.rados.0.smithi012.stdout:3307: finishing write tid 1 to smithi01278544-12 2024-09-10T18:08:17.810 INFO:tasks.rados.rados.0.smithi012.stdout:3307: finishing write tid 2 to smithi01278544-12 2024-09-10T18:08:17.810 INFO:tasks.rados.rados.0.smithi012.stdout:3307: finishing write tid 3 to smithi01278544-12 2024-09-10T18:08:17.810 INFO:tasks.rados.rados.0.smithi012.stdout:3307: oid 12 updating version 0 to 2362 2024-09-10T18:08:17.810 INFO:tasks.rados.rados.0.smithi012.stdout:3307: oid 12 version 2362 is already newer than 2361 2024-09-10T18:08:17.810 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2362 (ObjNum 1024 snap 327 seq_num 1024) dirty exists 2024-09-10T18:08:17.810 INFO:tasks.rados.rados.0.smithi012.stdout:3307: left oid 12 (ObjNum 1024 snap 327 seq_num 1024) 2024-09-10T18:08:17.821 INFO:tasks.rados.rados.0.smithi012.stdout:3309: finishing copy_from to smithi01278544-28 2024-09-10T18:08:17.821 INFO:tasks.rados.rados.0.smithi012.stdout:3309: got expected ENOENT (src dne) 2024-09-10T18:08:17.821 INFO:tasks.rados.rados.0.smithi012.stdout:3309: finishing copy_from racing read to smithi01278544-28 2024-09-10T18:08:17.822 INFO:tasks.rados.rados.0.smithi012.stdout:3310: finishing rollback tid 0 to smithi01278544-2 2024-09-10T18:08:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:3310: finishing rollback tid 1 to smithi01278544-2 2024-09-10T18:08:17.825 INFO:tasks.rados.rados.0.smithi012.stdout:3310: finishing rollback tid 2 to smithi01278544-2 2024-09-10T18:08:17.825 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2166 (ObjNum 982 snap 311 seq_num 982) dirty exists 2024-09-10T18:08:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:17 smithi012 ceph-mon[89611]: osdmap e740: 8 total, 8 up, 8 in 2024-09-10T18:08:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:17 smithi012 ceph-mon[89611]: pgmap v796: 121 pgs: 121 active+clean; 262 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2024-09-10T18:08:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:17 smithi012 ceph-mon[89611]: osdmap e741: 8 total, 8 up, 8 in 2024-09-10T18:08:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:17 smithi012 ceph-mon[92029]: osdmap e740: 8 total, 8 up, 8 in 2024-09-10T18:08:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:17 smithi012 ceph-mon[92029]: pgmap v796: 121 pgs: 121 active+clean; 262 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2024-09-10T18:08:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:17 smithi012 ceph-mon[92029]: osdmap e741: 8 total, 8 up, 8 in 2024-09-10T18:08:18.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:17 smithi089 ceph-mon[84132]: osdmap e740: 8 total, 8 up, 8 in 2024-09-10T18:08:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:17 smithi089 ceph-mon[84132]: pgmap v796: 121 pgs: 121 active+clean; 262 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2024-09-10T18:08:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:17 smithi089 ceph-mon[84132]: osdmap e741: 8 total, 8 up, 8 in 2024-09-10T18:08:18.812 INFO:tasks.rados.rados.0.smithi012.stdout:3307: done (3 left) 2024-09-10T18:08:18.812 INFO:tasks.rados.rados.0.smithi012.stdout:3309: done (2 left) 2024-09-10T18:08:18.812 INFO:tasks.rados.rados.0.smithi012.stdout:3310: done (1 left) 2024-09-10T18:08:18.812 INFO:tasks.rados.rados.0.smithi012.stdout:3311: done (0 left) 2024-09-10T18:08:18.813 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 328 2024-09-10T18:08:18.813 INFO:tasks.rados.rados.0.smithi012.stdout:3312: seq_num 1025 ranges {14172160=368640} 2024-09-10T18:08:18.891 INFO:tasks.rados.rados.0.smithi012.stdout:3312: writing smithi01278544-4 from 14172160 to 14540800 tid 1 2024-09-10T18:08:18.891 INFO:tasks.rados.rados.0.smithi012.stdout:3313: snap_remove snap 325 2024-09-10T18:08:19.818 INFO:tasks.rados.rados.0.smithi012.stdout:3313: done (1 left) 2024-09-10T18:08:19.818 INFO:tasks.rados.rados.0.smithi012.stdout:3314: snap_remove snap 319 2024-09-10T18:08:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:19 smithi012 ceph-mon[89611]: osdmap e742: 8 total, 8 up, 8 in 2024-09-10T18:08:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:19 smithi012 ceph-mon[92029]: osdmap e742: 8 total, 8 up, 8 in 2024-09-10T18:08:20.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:19 smithi089 ceph-mon[84132]: osdmap e742: 8 total, 8 up, 8 in 2024-09-10T18:08:20.822 INFO:tasks.rados.rados.0.smithi012.stdout:3314: done (1 left) 2024-09-10T18:08:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:3315: delete oid 26 current snap is 328 2024-09-10T18:08:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:3312: finishing write tid 1 to smithi01278544-4 2024-09-10T18:08:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:3312: finishing write tid 2 to smithi01278544-4 2024-09-10T18:08:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:3312: finishing write tid 3 to smithi01278544-4 2024-09-10T18:08:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:3312: oid 4 updating version 0 to 2306 2024-09-10T18:08:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:3312: oid 4 updating version 2306 to 2307 2024-09-10T18:08:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2307 (ObjNum 1025 snap 328 seq_num 1025) dirty exists 2024-09-10T18:08:20.823 INFO:tasks.rados.rados.0.smithi012.stdout:3312: left oid 4 (ObjNum 1025 snap 328 seq_num 1025) 2024-09-10T18:08:20.829 INFO:tasks.rados.rados.0.smithi012.stdout:3312: done (1 left) 2024-09-10T18:08:20.829 INFO:tasks.rados.rados.0.smithi012.stdout:3315: done (0 left) 2024-09-10T18:08:20.829 INFO:tasks.rados.rados.0.smithi012.stdout:3316: snap_remove snap 322 2024-09-10T18:08:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:20 smithi012 ceph-mon[89611]: pgmap v799: 121 pgs: 121 active+clean; 262 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2024-09-10T18:08:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:20 smithi012 ceph-mon[89611]: osdmap e743: 8 total, 8 up, 8 in 2024-09-10T18:08:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:20 smithi012 ceph-mon[92029]: pgmap v799: 121 pgs: 121 active+clean; 262 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2024-09-10T18:08:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:20 smithi012 ceph-mon[92029]: osdmap e743: 8 total, 8 up, 8 in 2024-09-10T18:08:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:20 smithi089 ceph-mon[84132]: pgmap v799: 121 pgs: 121 active+clean; 262 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 7.6 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2024-09-10T18:08:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:20 smithi089 ceph-mon[84132]: osdmap e743: 8 total, 8 up, 8 in 2024-09-10T18:08:21.843 INFO:tasks.rados.rados.0.smithi012.stdout:3316: done (0 left) 2024-09-10T18:08:21.843 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 328 2024-09-10T18:08:21.843 INFO:tasks.rados.rados.0.smithi012.stdout:3317: seq_num 1027 ranges {16384=409600} 2024-09-10T18:08:21.843 INFO:tasks.rados.rados.0.smithi012.stdout:3317: writing smithi01278544-50 from 16384 to 425984 tid 1 2024-09-10T18:08:21.843 INFO:tasks.rados.rados.0.smithi012.stdout:3318: delete oid 42 current snap is 328 2024-09-10T18:08:21.851 INFO:tasks.rados.rados.0.smithi012.stdout:3317: finishing write tid 1 to smithi01278544-50 2024-09-10T18:08:21.851 INFO:tasks.rados.rados.0.smithi012.stdout:3317: finishing write tid 2 to smithi01278544-50 2024-09-10T18:08:21.853 INFO:tasks.rados.rados.0.smithi012.stdout:3317: finishing write tid 3 to smithi01278544-50 2024-09-10T18:08:21.853 INFO:tasks.rados.rados.0.smithi012.stdout:3317: oid 50 updating version 0 to 2044 2024-09-10T18:08:21.853 INFO:tasks.rados.rados.0.smithi012.stdout:3317: oid 50 updating version 2044 to 2045 2024-09-10T18:08:21.853 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2045 (ObjNum 1027 snap 328 seq_num 1027) dirty exists 2024-09-10T18:08:21.853 INFO:tasks.rados.rados.0.smithi012.stdout:3317: left oid 50 (ObjNum 1027 snap 328 seq_num 1027) 2024-09-10T18:08:21.856 INFO:tasks.rados.rados.0.smithi012.stdout:3317: done (1 left) 2024-09-10T18:08:21.856 INFO:tasks.rados.rados.0.smithi012.stdout:3318: done (0 left) 2024-09-10T18:08:21.856 INFO:tasks.rados.rados.0.smithi012.stdout:3319: snap_create 2024-09-10T18:08:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:21 smithi012 ceph-mon[89611]: osdmap e744: 8 total, 8 up, 8 in 2024-09-10T18:08:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:21 smithi012 ceph-mon[89611]: pgmap v802: 121 pgs: 121 active+clean; 262 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.7 MiB/s rd, 90 KiB/s wr, 2 op/s 2024-09-10T18:08:22.285 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:08:21 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:08:21.850+0000 7f1ca0b7a640 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 186 after trimming was started 2024-09-10T18:08:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:21 smithi012 ceph-mon[92029]: osdmap e744: 8 total, 8 up, 8 in 2024-09-10T18:08:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:21 smithi012 ceph-mon[92029]: pgmap v802: 121 pgs: 121 active+clean; 262 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.7 MiB/s rd, 90 KiB/s wr, 2 op/s 2024-09-10T18:08:22.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:21 smithi089 ceph-mon[84132]: osdmap e744: 8 total, 8 up, 8 in 2024-09-10T18:08:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:21 smithi089 ceph-mon[84132]: pgmap v802: 121 pgs: 121 active+clean; 262 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.7 MiB/s rd, 90 KiB/s wr, 2 op/s 2024-09-10T18:08:22.807 INFO:tasks.rados.rados.0.smithi012.stdout:3319: done (0 left) 2024-09-10T18:08:22.808 INFO:tasks.rados.rados.0.smithi012.stdout:3320: snap_create 2024-09-10T18:08:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:22 smithi012 ceph-mon[89611]: osdmap e745: 8 total, 8 up, 8 in 2024-09-10T18:08:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:22 smithi012 ceph-mon[89611]: osdmap e746: 8 total, 8 up, 8 in 2024-09-10T18:08:23.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:22 smithi012 ceph-mon[92029]: osdmap e745: 8 total, 8 up, 8 in 2024-09-10T18:08:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:22 smithi012 ceph-mon[92029]: osdmap e746: 8 total, 8 up, 8 in 2024-09-10T18:08:23.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:22 smithi089 ceph-mon[84132]: osdmap e745: 8 total, 8 up, 8 in 2024-09-10T18:08:23.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:22 smithi089 ceph-mon[84132]: osdmap e746: 8 total, 8 up, 8 in 2024-09-10T18:08:23.809 INFO:tasks.rados.rados.0.smithi012.stdout:3320: done (0 left) 2024-09-10T18:08:23.809 INFO:tasks.rados.rados.0.smithi012.stdout:3321: rollback oid 11 current snap is 330 2024-09-10T18:08:23.809 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 326 2024-09-10T18:08:23.809 INFO:tasks.rados.rados.0.smithi012.stdout:3322: rollback oid 32 current snap is 330 2024-09-10T18:08:23.809 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 32 to 323 2024-09-10T18:08:23.810 INFO:tasks.rados.rados.0.smithi012.stdout:3323: delete oid 15 current snap is 330 2024-09-10T18:08:23.819 INFO:tasks.rados.rados.0.smithi012.stdout:3322: finishing rollback tid 0 to smithi01278544-32 2024-09-10T18:08:23.819 INFO:tasks.rados.rados.0.smithi012.stdout:3322: finishing rollback tid 1 to smithi01278544-32 2024-09-10T18:08:23.819 INFO:tasks.rados.rados.0.smithi012.stdout:3322: finishing rollback tid 2 to smithi01278544-32 2024-09-10T18:08:23.819 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2047 (ObjNum 1004 snap 319 seq_num 1004) dirty exists 2024-09-10T18:08:23.820 INFO:tasks.rados.rados.0.smithi012.stdout:3321: finishing rollback tid 0 to smithi01278544-11 2024-09-10T18:08:23.820 INFO:tasks.rados.rados.0.smithi012.stdout:3322: done (2 left) 2024-09-10T18:08:23.820 INFO:tasks.rados.rados.0.smithi012.stdout:3323: done (1 left) 2024-09-10T18:08:23.821 INFO:tasks.rados.rados.0.smithi012.stdout:3324: rollback oid 21 current snap is 330 2024-09-10T18:08:23.821 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 329 2024-09-10T18:08:23.821 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 330 2024-09-10T18:08:23.821 INFO:tasks.rados.rados.0.smithi012.stdout:3325: seq_num 1030 ranges {0=458752} 2024-09-10T18:08:23.823 INFO:tasks.rados.rados.0.smithi012.stdout:3325: writing smithi01278544-17 from 0 to 458752 tid 1 2024-09-10T18:08:23.823 INFO:tasks.rados.rados.0.smithi012.stdout:3326: snap_create 2024-09-10T18:08:23.823 INFO:tasks.rados.rados.0.smithi012.stdout:3321: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:08:23.823 INFO:tasks.rados.rados.0.smithi012.stdout:3321: finishing rollback tid 2 to smithi01278544-11 2024-09-10T18:08:23.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2392 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:08:23.824 INFO:tasks.rados.rados.0.smithi012.stdout:3324: finishing rollback tid 0 to smithi01278544-21 2024-09-10T18:08:23.824 INFO:tasks.rados.rados.0.smithi012.stdout:3324: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:08:23.825 INFO:tasks.rados.rados.0.smithi012.stdout:3324: finishing rollback tid 2 to smithi01278544-21 2024-09-10T18:08:23.825 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 1325 (ObjNum 1017 snap 324 seq_num 1017) dirty exists 2024-09-10T18:08:23.826 INFO:tasks.rados.rados.0.smithi012.stdout:3325: finishing write tid 1 to smithi01278544-17 2024-09-10T18:08:23.826 INFO:tasks.rados.rados.0.smithi012.stdout:3325: finishing write tid 2 to smithi01278544-17 2024-09-10T18:08:23.829 INFO:tasks.rados.rados.0.smithi012.stdout:3325: finishing write tid 3 to smithi01278544-17 2024-09-10T18:08:23.829 INFO:tasks.rados.rados.0.smithi012.stdout:3325: oid 17 updating version 0 to 2027 2024-09-10T18:08:23.829 INFO:tasks.rados.rados.0.smithi012.stdout:3325: oid 17 updating version 2027 to 2028 2024-09-10T18:08:23.829 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2028 (ObjNum 1030 snap 330 seq_num 1030) dirty exists 2024-09-10T18:08:23.829 INFO:tasks.rados.rados.0.smithi012.stdout:3325: left oid 17 (ObjNum 1030 snap 330 seq_num 1030) 2024-09-10T18:08:24.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:08:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:08:24] "GET /metrics HTTP/1.1" 200 36356 "" "Prometheus/2.51.0" 2024-09-10T18:08:24.821 INFO:tasks.rados.rados.0.smithi012.stdout:3321: done (3 left) 2024-09-10T18:08:24.821 INFO:tasks.rados.rados.0.smithi012.stdout:3324: done (2 left) 2024-09-10T18:08:24.821 INFO:tasks.rados.rados.0.smithi012.stdout:3325: done (1 left) 2024-09-10T18:08:24.822 INFO:tasks.rados.rados.0.smithi012.stdout:3326: done (0 left) 2024-09-10T18:08:24.822 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 331 2024-09-10T18:08:24.822 INFO:tasks.rados.rados.0.smithi012.stdout:3327: seq_num 1031 ranges {5701632=475136} 2024-09-10T18:08:24.855 INFO:tasks.rados.rados.0.smithi012.stdout:3327: writing smithi01278544-13 from 5701632 to 6176768 tid 1 2024-09-10T18:08:24.855 INFO:tasks.rados.rados.0.smithi012.stdout:3328: rollback oid 30 current snap is 331 2024-09-10T18:08:24.855 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 321 2024-09-10T18:08:24.855 INFO:tasks.rados.rados.0.smithi012.stdout:3329: snap_create 2024-09-10T18:08:24.856 INFO:tasks.rados.rados.0.smithi012.stdout:3328: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:08:24.856 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 0 (ObjNum 33 snap 0 seq_num 3496553280) dirty dne 2024-09-10T18:08:24.859 INFO:tasks.rados.rados.0.smithi012.stdout:3327: finishing write tid 1 to smithi01278544-13 2024-09-10T18:08:24.859 INFO:tasks.rados.rados.0.smithi012.stdout:3327: finishing write tid 2 to smithi01278544-13 2024-09-10T18:08:24.861 INFO:tasks.rados.rados.0.smithi012.stdout:3327: finishing write tid 3 to smithi01278544-13 2024-09-10T18:08:24.861 INFO:tasks.rados.rados.0.smithi012.stdout:3327: oid 13 updating version 0 to 2309 2024-09-10T18:08:24.861 INFO:tasks.rados.rados.0.smithi012.stdout:3327: oid 13 version 2309 is already newer than 2308 2024-09-10T18:08:24.861 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 2309 (ObjNum 1031 snap 331 seq_num 1031) dirty exists 2024-09-10T18:08:24.861 INFO:tasks.rados.rados.0.smithi012.stdout:3327: left oid 13 (ObjNum 1031 snap 331 seq_num 1031) 2024-09-10T18:08:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:24 smithi012 ceph-mon[89611]: pgmap v805: 121 pgs: 121 active+clean; 261 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 320 KiB/s wr, 10 op/s 2024-09-10T18:08:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:24 smithi012 ceph-mon[89611]: osdmap e747: 8 total, 8 up, 8 in 2024-09-10T18:08:25.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:24 smithi012 ceph-mon[92029]: pgmap v805: 121 pgs: 121 active+clean; 261 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 320 KiB/s wr, 10 op/s 2024-09-10T18:08:25.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:24 smithi012 ceph-mon[92029]: osdmap e747: 8 total, 8 up, 8 in 2024-09-10T18:08:25.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:24 smithi089 ceph-mon[84132]: pgmap v805: 121 pgs: 121 active+clean; 261 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 320 KiB/s wr, 10 op/s 2024-09-10T18:08:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:24 smithi089 ceph-mon[84132]: osdmap e747: 8 total, 8 up, 8 in 2024-09-10T18:08:25.823 INFO:tasks.rados.rados.0.smithi012.stdout:3327: done (2 left) 2024-09-10T18:08:25.823 INFO:tasks.rados.rados.0.smithi012.stdout:3328: done (1 left) 2024-09-10T18:08:25.823 INFO:tasks.rados.rados.0.smithi012.stdout:3329: done (0 left) 2024-09-10T18:08:25.823 INFO:tasks.rados.rados.0.smithi012.stdout:3330: read oid 41 snap -1 2024-09-10T18:08:25.823 INFO:tasks.rados.rados.0.smithi012.stdout:3330: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:08:25.823 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 332 2024-09-10T18:08:25.824 INFO:tasks.rados.rados.0.smithi012.stdout:3331: seq_num 1032 ranges {2334720=491520} 2024-09-10T18:08:25.838 INFO:tasks.rados.rados.0.smithi012.stdout:3331: writing smithi01278544-38 from 2334720 to 2826240 tid 1 2024-09-10T18:08:25.839 INFO:tasks.rados.rados.0.smithi012.stdout:3332: rmattr oid 47 current snap is 332 2024-09-10T18:08:25.839 INFO:tasks.rados.rados.0.smithi012.stdout:3332: done (2 left) 2024-09-10T18:08:25.839 INFO:tasks.rados.rados.0.smithi012.stdout:3333: read oid 21 snap -1 2024-09-10T18:08:25.839 INFO:tasks.rados.rados.0.smithi012.stdout:3333: expect (ObjNum 1017 snap 324 seq_num 1017) 2024-09-10T18:08:25.839 INFO:tasks.rados.rados.0.smithi012.stdout:3334: snap_create 2024-09-10T18:08:25.847 INFO:tasks.rados.rados.0.smithi012.stdout:3333: expect (ObjNum 1017 snap 324 seq_num 1017) 2024-09-10T18:08:25.855 INFO:tasks.rados.rados.0.smithi012.stdout:3331: finishing write tid 1 to smithi01278544-38 2024-09-10T18:08:25.855 INFO:tasks.rados.rados.0.smithi012.stdout:3331: finishing write tid 2 to smithi01278544-38 2024-09-10T18:08:25.855 INFO:tasks.rados.rados.0.smithi012.stdout:3331: finishing write tid 3 to smithi01278544-38 2024-09-10T18:08:25.856 INFO:tasks.rados.rados.0.smithi012.stdout:3331: oid 38 updating version 0 to 2169 2024-09-10T18:08:25.856 INFO:tasks.rados.rados.0.smithi012.stdout:3331: oid 38 updating version 2169 to 2170 2024-09-10T18:08:25.856 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 2170 (ObjNum 1032 snap 332 seq_num 1032) dirty exists 2024-09-10T18:08:25.856 INFO:tasks.rados.rados.0.smithi012.stdout:3331: left oid 38 (ObjNum 1032 snap 332 seq_num 1032) 2024-09-10T18:08:25.862 INFO:tasks.rados.rados.0.smithi012.stdout:3330: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:08:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:25 smithi012 ceph-mon[89611]: osdmap e748: 8 total, 8 up, 8 in 2024-09-10T18:08:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:25 smithi012 ceph-mon[92029]: osdmap e748: 8 total, 8 up, 8 in 2024-09-10T18:08:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:25 smithi089 ceph-mon[84132]: osdmap e748: 8 total, 8 up, 8 in 2024-09-10T18:08:26.828 INFO:tasks.rados.rados.0.smithi012.stdout:3330: done (3 left) 2024-09-10T18:08:26.828 INFO:tasks.rados.rados.0.smithi012.stdout:3331: done (2 left) 2024-09-10T18:08:26.828 INFO:tasks.rados.rados.0.smithi012.stdout:3333: done (1 left) 2024-09-10T18:08:26.828 INFO:tasks.rados.rados.0.smithi012.stdout:3334: done (0 left) 2024-09-10T18:08:26.828 INFO:tasks.rados.rados.0.smithi012.stdout:3335: snap_remove snap 331 2024-09-10T18:08:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[89611]: pgmap v808: 121 pgs: 121 active+clean; 259 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 342 KiB/s wr, 10 op/s 2024-09-10T18:08:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[89611]: osdmap e749: 8 total, 8 up, 8 in 2024-09-10T18:08:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:08:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[92029]: pgmap v808: 121 pgs: 121 active+clean; 259 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 342 KiB/s wr, 10 op/s 2024-09-10T18:08:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[92029]: osdmap e749: 8 total, 8 up, 8 in 2024-09-10T18:08:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:08:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:26 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:26 smithi089 ceph-mon[84132]: pgmap v808: 121 pgs: 121 active+clean; 259 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 342 KiB/s wr, 10 op/s 2024-09-10T18:08:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:26 smithi089 ceph-mon[84132]: osdmap e749: 8 total, 8 up, 8 in 2024-09-10T18:08:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:26 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:08:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:26 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:26 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:27.809 INFO:tasks.rados.rados.0.smithi012.stdout:3335: done (0 left) 2024-09-10T18:08:27.809 INFO:tasks.rados.rados.0.smithi012.stdout:3336: snap_create 2024-09-10T18:08:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[89611]: osdmap e750: 8 total, 8 up, 8 in 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[89611]: pgmap v811: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 175 KiB/s rd, 328 KiB/s wr, 5 op/s 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[89611]: osdmap e751: 8 total, 8 up, 8 in 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[92029]: osdmap e750: 8 total, 8 up, 8 in 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:08:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:28.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[92029]: pgmap v811: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 175 KiB/s rd, 328 KiB/s wr, 5 op/s 2024-09-10T18:08:28.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:27 smithi012 ceph-mon[92029]: osdmap e751: 8 total, 8 up, 8 in 2024-09-10T18:08:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:27 smithi089 ceph-mon[84132]: osdmap e750: 8 total, 8 up, 8 in 2024-09-10T18:08:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:08:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:08:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:08:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:27 smithi089 ceph-mon[84132]: pgmap v811: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 175 KiB/s rd, 328 KiB/s wr, 5 op/s 2024-09-10T18:08:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:27 smithi089 ceph-mon[84132]: osdmap e751: 8 total, 8 up, 8 in 2024-09-10T18:08:28.810 INFO:tasks.rados.rados.0.smithi012.stdout:3336: done (0 left) 2024-09-10T18:08:28.810 INFO:tasks.rados.rados.0.smithi012.stdout:3337: read oid 23 snap -1 2024-09-10T18:08:28.810 INFO:tasks.rados.rados.0.smithi012.stdout:3337: expect (ObjNum 957 snap 303 seq_num 957) 2024-09-10T18:08:28.810 INFO:tasks.rados.rados.0.smithi012.stdout:3338: delete oid 46 current snap is 334 2024-09-10T18:08:28.816 INFO:tasks.rados.rados.0.smithi012.stdout:3338: done (1 left) 2024-09-10T18:08:28.816 INFO:tasks.rados.rados.0.smithi012.stdout:3339: rmattr oid 46 current snap is 334 2024-09-10T18:08:28.816 INFO:tasks.rados.rados.0.smithi012.stdout:3339: done (1 left) 2024-09-10T18:08:28.816 INFO:tasks.rados.rados.0.smithi012.stdout:3340: rmattr oid 38 current snap is 334 2024-09-10T18:08:28.816 INFO:tasks.rados.rados.0.smithi012.stdout:3341: read oid 39 snap 311 2024-09-10T18:08:28.817 INFO:tasks.rados.rados.0.smithi012.stdout:3341: expect (ObjNum 972 snap 308 seq_num 972) 2024-09-10T18:08:28.817 INFO:tasks.rados.rados.0.smithi012.stdout:3342: read oid 25 snap 311 2024-09-10T18:08:28.817 INFO:tasks.rados.rados.0.smithi012.stdout:3342: expect (ObjNum 909 snap 295 seq_num 909) 2024-09-10T18:08:28.817 INFO:tasks.rados.rados.0.smithi012.stdout:3343: rollback oid 41 current snap is 334 2024-09-10T18:08:28.817 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 311 2024-09-10T18:08:28.817 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 334 2024-09-10T18:08:28.817 INFO:tasks.rados.rados.0.smithi012.stdout:3344: seq_num 1034 ranges {12017664=524288} 2024-09-10T18:08:28.886 INFO:tasks.rados.rados.0.smithi012.stdout:3344: writing smithi01278544-12 from 12017664 to 12541952 tid 1 2024-09-10T18:08:28.886 INFO:tasks.rados.rados.0.smithi012.stdout:3345: snap_create 2024-09-10T18:08:28.886 INFO:tasks.rados.rados.0.smithi012.stdout:3337: expect (ObjNum 957 snap 303 seq_num 957) 2024-09-10T18:08:28.930 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 2171 (ObjNum 1032 snap 332 seq_num 1032) dirty exists 2024-09-10T18:08:28.930 INFO:tasks.rados.rados.0.smithi012.stdout:3343: finishing rollback tid 0 to smithi01278544-41 2024-09-10T18:08:28.930 INFO:tasks.rados.rados.0.smithi012.stdout:3343: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:08:28.930 INFO:tasks.rados.rados.0.smithi012.stdout:3341: expect (ObjNum 972 snap 308 seq_num 972) 2024-09-10T18:08:28.979 INFO:tasks.rados.rados.0.smithi012.stdout:3343: finishing rollback tid 2 to smithi01278544-41 2024-09-10T18:08:28.980 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 2312 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:08:28.980 INFO:tasks.rados.rados.0.smithi012.stdout:3342: expect (ObjNum 909 snap 295 seq_num 909) 2024-09-10T18:08:30.086 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:29 smithi012 ceph-mon[89611]: osdmap e752: 8 total, 8 up, 8 in 2024-09-10T18:08:30.087 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:29 smithi012 ceph-mon[92029]: osdmap e752: 8 total, 8 up, 8 in 2024-09-10T18:08:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:29 smithi089 ceph-mon[84132]: osdmap e752: 8 total, 8 up, 8 in 2024-09-10T18:08:31.141 INFO:tasks.rados.rados.0.smithi012.stdout:3344: finishing write tid 1 to smithi01278544-12 2024-09-10T18:08:31.141 INFO:tasks.rados.rados.0.smithi012.stdout:3344: finishing write tid 2 to smithi01278544-12 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3344: finishing write tid 3 to smithi01278544-12 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3344: oid 12 updating version 0 to 2394 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3344: oid 12 updating version 2394 to 2395 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2395 (ObjNum 1034 snap 334 seq_num 1034) dirty exists 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3344: left oid 12 (ObjNum 1034 snap 334 seq_num 1034) 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3337: done (6 left) 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3340: done (5 left) 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3341: done (4 left) 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3342: done (3 left) 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3343: done (2 left) 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3344: done (1 left) 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3345: done (0 left) 2024-09-10T18:08:31.142 INFO:tasks.rados.rados.0.smithi012.stdout:3346: delete oid 49 current snap is 335 2024-09-10T18:08:31.144 INFO:tasks.rados.rados.0.smithi012.stdout:3346: done (0 left) 2024-09-10T18:08:31.144 INFO:tasks.rados.rados.0.smithi012.stdout:3347: snap_remove snap 311 2024-09-10T18:08:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:30 smithi012 ceph-mon[89611]: pgmap v814: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 175 KiB/s rd, 336 KiB/s wr, 5 op/s 2024-09-10T18:08:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:30 smithi012 ceph-mon[89611]: osdmap e753: 8 total, 8 up, 8 in 2024-09-10T18:08:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:30 smithi012 ceph-mon[92029]: pgmap v814: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 175 KiB/s rd, 336 KiB/s wr, 5 op/s 2024-09-10T18:08:31.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:30 smithi012 ceph-mon[92029]: osdmap e753: 8 total, 8 up, 8 in 2024-09-10T18:08:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:30 smithi089 ceph-mon[84132]: pgmap v814: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 175 KiB/s rd, 336 KiB/s wr, 5 op/s 2024-09-10T18:08:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:30 smithi089 ceph-mon[84132]: osdmap e753: 8 total, 8 up, 8 in 2024-09-10T18:08:31.824 INFO:tasks.rados.rados.0.smithi012.stdout:3347: done (0 left) 2024-09-10T18:08:31.824 INFO:tasks.rados.rados.0.smithi012.stdout:3348: rollback oid 20 current snap is 335 2024-09-10T18:08:31.824 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 326 2024-09-10T18:08:31.824 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 335 2024-09-10T18:08:31.824 INFO:tasks.rados.rados.0.smithi012.stdout:3349: seq_num 1036 ranges {5701632=557056} 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:3349: writing smithi01278544-10 from 5701632 to 6258688 tid 1 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:3350: copy_from oid 24 from oid 49 current snap is 335 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:3348: finishing rollback tid 0 to smithi01278544-20 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:3348: finishing rollback tid 1 to smithi01278544-20 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:3348: finishing rollback tid 2 to smithi01278544-20 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2403 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:3348: done (2 left) 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:3351: rollback oid 22 current snap is 335 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 22 to 323 2024-09-10T18:08:31.861 INFO:tasks.rados.rados.0.smithi012.stdout:3352: snap_remove snap 333 2024-09-10T18:08:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:32.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:32.810 INFO:tasks.rados.rados.0.smithi012.stdout:3352: done (3 left) 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3353: delete oid 30 current snap is 335 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3350: finishing copy_from to smithi01278544-24 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3350: got expected ENOENT (src dne) 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3350: finishing copy_from racing read to smithi01278544-24 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3349: finishing write tid 1 to smithi01278544-10 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3349: finishing write tid 2 to smithi01278544-10 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3351: finishing rollback tid 0 to smithi01278544-22 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3351: finishing rollback tid 1 to smithi01278544-22 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3349: finishing write tid 3 to smithi01278544-10 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3349: oid 10 updating version 0 to 2415 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3349: oid 10 updating version 2415 to 2416 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2416 (ObjNum 1036 snap 335 seq_num 1036) dirty exists 2024-09-10T18:08:32.811 INFO:tasks.rados.rados.0.smithi012.stdout:3349: left oid 10 (ObjNum 1036 snap 335 seq_num 1036) 2024-09-10T18:08:32.812 INFO:tasks.rados.rados.0.smithi012.stdout:3351: finishing rollback tid 2 to smithi01278544-22 2024-09-10T18:08:32.812 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2420 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:3349: done (3 left) 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:3350: done (2 left) 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:3351: done (1 left) 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:3353: done (0 left) 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:3354: read oid 27 snap -1 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:3354: expect (ObjNum 1002 snap 319 seq_num 1002) 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:3355: copy_from oid 25 from oid 17 current snap is 335 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 335 2024-09-10T18:08:32.816 INFO:tasks.rados.rados.0.smithi012.stdout:3356: seq_num 1038 ranges {2236416=589824} 2024-09-10T18:08:32.832 INFO:tasks.rados.rados.0.smithi012.stdout:3356: writing smithi01278544-19 from 2236416 to 2826240 tid 1 2024-09-10T18:08:32.832 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 335 2024-09-10T18:08:32.832 INFO:tasks.rados.rados.0.smithi012.stdout:3357: seq_num 1039 ranges {0=606208} 2024-09-10T18:08:32.836 INFO:tasks.rados.rados.0.smithi012.stdout:3357: writing smithi01278544-42 from 0 to 606208 tid 1 2024-09-10T18:08:32.836 INFO:tasks.rados.rados.0.smithi012.stdout:3358: rollback oid 10 current snap is 335 2024-09-10T18:08:32.836 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 323 2024-09-10T18:08:32.836 INFO:tasks.rados.rados.0.smithi012.stdout:3359: read oid 26 snap -1 2024-09-10T18:08:32.836 INFO:tasks.rados.rados.0.smithi012.stdout:3359: expect deleted 2024-09-10T18:08:32.836 INFO:tasks.rados.rados.0.smithi012.stdout:3360: delete oid 5 current snap is 335 2024-09-10T18:08:32.837 INFO:tasks.rados.rados.0.smithi012.stdout:3355: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:08:32.838 INFO:tasks.rados.rados.0.smithi012.stdout:3356: finishing write tid 1 to smithi01278544-19 2024-09-10T18:08:32.838 INFO:tasks.rados.rados.0.smithi012.stdout:3356: finishing write tid 2 to smithi01278544-19 2024-09-10T18:08:32.840 INFO:tasks.rados.rados.0.smithi012.stdout:3356: finishing write tid 3 to smithi01278544-19 2024-09-10T18:08:32.840 INFO:tasks.rados.rados.0.smithi012.stdout:3356: oid 19 updating version 0 to 1332 2024-09-10T18:08:32.840 INFO:tasks.rados.rados.0.smithi012.stdout:3356: oid 19 version 1332 is already newer than 1331 2024-09-10T18:08:32.840 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1332 (ObjNum 1038 snap 335 seq_num 1038) dirty exists 2024-09-10T18:08:32.840 INFO:tasks.rados.rados.0.smithi012.stdout:3356: left oid 19 (ObjNum 1038 snap 335 seq_num 1038) 2024-09-10T18:08:32.841 INFO:tasks.rados.rados.0.smithi012.stdout:3355: finishing copy_from to smithi01278544-25 2024-09-10T18:08:32.841 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 2028 (ObjNum 1030 snap 330 seq_num 1030) dirty exists 2024-09-10T18:08:32.842 INFO:tasks.rados.rados.0.smithi012.stdout:3355: done (6 left) 2024-09-10T18:08:32.842 INFO:tasks.rados.rados.0.smithi012.stdout:3356: done (5 left) 2024-09-10T18:08:32.842 INFO:tasks.rados.rados.0.smithi012.stdout:3359: done (4 left) 2024-09-10T18:08:32.842 INFO:tasks.rados.rados.0.smithi012.stdout:3360: done (3 left) 2024-09-10T18:08:32.843 INFO:tasks.rados.rados.0.smithi012.stdout:3361: rollback oid 37 current snap is 335 2024-09-10T18:08:32.843 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 37 to 327 2024-09-10T18:08:32.843 INFO:tasks.rados.rados.0.smithi012.stdout:3357: finishing write tid 1 to smithi01278544-42 2024-09-10T18:08:32.843 INFO:tasks.rados.rados.0.smithi012.stdout:3362: delete oid 36 current snap is 335 2024-09-10T18:08:32.843 INFO:tasks.rados.rados.0.smithi012.stdout:3357: finishing write tid 2 to smithi01278544-42 2024-09-10T18:08:32.844 INFO:tasks.rados.rados.0.smithi012.stdout:3357: finishing write tid 3 to smithi01278544-42 2024-09-10T18:08:32.844 INFO:tasks.rados.rados.0.smithi012.stdout:3357: oid 42 updating version 0 to 2306 2024-09-10T18:08:32.845 INFO:tasks.rados.rados.0.smithi012.stdout:3357: oid 42 version 2306 is already newer than 2305 2024-09-10T18:08:32.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2306 (ObjNum 1039 snap 335 seq_num 1039) dirty exists 2024-09-10T18:08:32.845 INFO:tasks.rados.rados.0.smithi012.stdout:3357: left oid 42 (ObjNum 1039 snap 335 seq_num 1039) 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3358: finishing rollback tid 0 to smithi01278544-10 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3358: finishing rollback tid 1 to smithi01278544-10 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3361: finishing rollback tid 1 to smithi01278544-37 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 0 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3358: finishing rollback tid 2 to smithi01278544-10 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2433 (ObjNum 983 snap 311 seq_num 983) dirty exists 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3357: done (4 left) 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3358: done (3 left) 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3361: done (2 left) 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3362: done (1 left) 2024-09-10T18:08:32.846 INFO:tasks.rados.rados.0.smithi012.stdout:3363: setattr oid 20 current snap is 335 2024-09-10T18:08:32.847 INFO:tasks.rados.rados.0.smithi012.stdout:3364: setattr oid 33 current snap is 335 2024-09-10T18:08:32.848 INFO:tasks.rados.rados.0.smithi012.stdout:3354: expect (ObjNum 1002 snap 319 seq_num 1002) 2024-09-10T18:08:33.000 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2434 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:08:33.001 INFO:tasks.rados.rados.0.smithi012.stdout:3354: done (2 left) 2024-09-10T18:08:33.001 INFO:tasks.rados.rados.0.smithi012.stdout:3363: done (1 left) 2024-09-10T18:08:33.001 INFO:tasks.rados.rados.0.smithi012.stdout:3365: read oid 49 snap -1 2024-09-10T18:08:33.001 INFO:tasks.rados.rados.0.smithi012.stdout:3365: expect deleted 2024-09-10T18:08:33.001 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 335 2024-09-10T18:08:33.001 INFO:tasks.rados.rados.0.smithi012.stdout:3366: seq_num 1042 ranges {458752=655360} 2024-09-10T18:08:33.006 INFO:tasks.rados.rados.0.smithi012.stdout:3366: writing smithi01278544-25 from 458752 to 1114112 tid 1 2024-09-10T18:08:33.007 INFO:tasks.rados.rados.0.smithi012.stdout:3367: read oid 7 snap -1 2024-09-10T18:08:33.007 INFO:tasks.rados.rados.0.smithi012.stdout:3367: expect deleted 2024-09-10T18:08:33.007 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 4 current snap is 335 2024-09-10T18:08:33.007 INFO:tasks.rados.rados.0.smithi012.stdout:3368: seq_num 1043 ranges {14540800=671744} 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:3368: writing smithi01278544-4 from 14540800 to 15212544 tid 1 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:3369: snap_create 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 2307 (ObjNum 65 snap 0 seq_num 3491042128) dirty exists 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:3366: finishing write tid 1 to smithi01278544-25 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:3366: finishing write tid 2 to smithi01278544-25 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:3366: finishing write tid 3 to smithi01278544-25 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:3366: oid 25 updating version 0 to 2436 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:3366: oid 25 version 2436 is already newer than 2435 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 2436 (ObjNum 1042 snap 335 seq_num 1042) dirty exists 2024-09-10T18:08:33.090 INFO:tasks.rados.rados.0.smithi012.stdout:3366: left oid 25 (ObjNum 1042 snap 335 seq_num 1042) 2024-09-10T18:08:33.093 INFO:tasks.rados.rados.0.smithi012.stdout:3368: finishing write tid 1 to smithi01278544-4 2024-09-10T18:08:33.093 INFO:tasks.rados.rados.0.smithi012.stdout:3368: finishing write tid 2 to smithi01278544-4 2024-09-10T18:08:33.094 INFO:tasks.rados.rados.0.smithi012.stdout:3368: finishing write tid 3 to smithi01278544-4 2024-09-10T18:08:33.095 INFO:tasks.rados.rados.0.smithi012.stdout:3368: oid 4 updating version 0 to 2314 2024-09-10T18:08:33.095 INFO:tasks.rados.rados.0.smithi012.stdout:3368: oid 4 version 2314 is already newer than 2313 2024-09-10T18:08:33.095 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2314 (ObjNum 1043 snap 335 seq_num 1043) dirty exists 2024-09-10T18:08:33.095 INFO:tasks.rados.rados.0.smithi012.stdout:3368: left oid 4 (ObjNum 1043 snap 335 seq_num 1043) 2024-09-10T18:08:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:32 smithi012 ceph-mon[89611]: pgmap v816: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.8 MiB/s rd, 112 KiB/s wr, 2 op/s 2024-09-10T18:08:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:32 smithi012 ceph-mon[89611]: osdmap e754: 8 total, 8 up, 8 in 2024-09-10T18:08:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:32 smithi012 ceph-mon[89611]: osdmap e755: 8 total, 8 up, 8 in 2024-09-10T18:08:33.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:32 smithi012 ceph-mon[92029]: pgmap v816: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.8 MiB/s rd, 112 KiB/s wr, 2 op/s 2024-09-10T18:08:33.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:32 smithi012 ceph-mon[92029]: osdmap e754: 8 total, 8 up, 8 in 2024-09-10T18:08:33.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:32 smithi012 ceph-mon[92029]: osdmap e755: 8 total, 8 up, 8 in 2024-09-10T18:08:33.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:32 smithi089 ceph-mon[84132]: pgmap v816: 121 pgs: 121 active+clean; 260 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 6.8 MiB/s rd, 112 KiB/s wr, 2 op/s 2024-09-10T18:08:33.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:32 smithi089 ceph-mon[84132]: osdmap e754: 8 total, 8 up, 8 in 2024-09-10T18:08:33.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:32 smithi089 ceph-mon[84132]: osdmap e755: 8 total, 8 up, 8 in 2024-09-10T18:08:33.830 INFO:tasks.rados.rados.0.smithi012.stdout:3364: done (5 left) 2024-09-10T18:08:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3365: done (4 left) 2024-09-10T18:08:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3366: done (3 left) 2024-09-10T18:08:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3367: done (2 left) 2024-09-10T18:08:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3368: done (1 left) 2024-09-10T18:08:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3369: done (0 left) 2024-09-10T18:08:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 336 2024-09-10T18:08:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3370: seq_num 1044 ranges {11943936=688128} 2024-09-10T18:08:33.899 INFO:tasks.rados.rados.0.smithi012.stdout:3370: writing smithi01278544-43 from 11943936 to 12632064 tid 1 2024-09-10T18:08:33.899 INFO:tasks.rados.rados.0.smithi012.stdout:3371: setattr oid 29 current snap is 336 2024-09-10T18:08:33.900 INFO:tasks.rados.rados.0.smithi012.stdout:3372: snap_create 2024-09-10T18:08:33.906 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1135 (ObjNum 1013 snap 323 seq_num 1013) dirty exists 2024-09-10T18:08:33.907 INFO:tasks.rados.rados.0.smithi012.stdout:3370: finishing write tid 1 to smithi01278544-43 2024-09-10T18:08:33.908 INFO:tasks.rados.rados.0.smithi012.stdout:3370: finishing write tid 2 to smithi01278544-43 2024-09-10T18:08:33.909 INFO:tasks.rados.rados.0.smithi012.stdout:3370: finishing write tid 3 to smithi01278544-43 2024-09-10T18:08:33.909 INFO:tasks.rados.rados.0.smithi012.stdout:3370: oid 43 updating version 0 to 2310 2024-09-10T18:08:33.909 INFO:tasks.rados.rados.0.smithi012.stdout:3370: oid 43 version 2310 is already newer than 2309 2024-09-10T18:08:33.909 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2310 (ObjNum 1044 snap 336 seq_num 1044) dirty exists 2024-09-10T18:08:33.909 INFO:tasks.rados.rados.0.smithi012.stdout:3370: left oid 43 (ObjNum 1044 snap 336 seq_num 1044) 2024-09-10T18:08:34.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:08:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:08:34] "GET /metrics HTTP/1.1" 200 36353 "" "Prometheus/2.51.0" 2024-09-10T18:08:34.835 INFO:tasks.rados.rados.0.smithi012.stdout:3370: done (2 left) 2024-09-10T18:08:34.836 INFO:tasks.rados.rados.0.smithi012.stdout:3371: done (1 left) 2024-09-10T18:08:34.836 INFO:tasks.rados.rados.0.smithi012.stdout:3372: done (0 left) 2024-09-10T18:08:34.836 INFO:tasks.rados.rados.0.smithi012.stdout:3373: snap_create 2024-09-10T18:08:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:34 smithi012 ceph-mon[89611]: pgmap v819: 121 pgs: 121 active+clean; 236 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 119 KiB/s wr, 5 op/s 2024-09-10T18:08:35.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:34 smithi012 ceph-mon[89611]: osdmap e756: 8 total, 8 up, 8 in 2024-09-10T18:08:35.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:34 smithi012 ceph-mon[92029]: pgmap v819: 121 pgs: 121 active+clean; 236 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 119 KiB/s wr, 5 op/s 2024-09-10T18:08:35.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:34 smithi012 ceph-mon[92029]: osdmap e756: 8 total, 8 up, 8 in 2024-09-10T18:08:35.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:34 smithi089 ceph-mon[84132]: pgmap v819: 121 pgs: 121 active+clean; 236 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 20 MiB/s rd, 119 KiB/s wr, 5 op/s 2024-09-10T18:08:35.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:34 smithi089 ceph-mon[84132]: osdmap e756: 8 total, 8 up, 8 in 2024-09-10T18:08:35.844 INFO:tasks.rados.rados.0.smithi012.stdout:3373: done (0 left) 2024-09-10T18:08:35.845 INFO:tasks.rados.rados.0.smithi012.stdout:3374: delete oid 2 current snap is 338 2024-09-10T18:08:35.849 INFO:tasks.rados.rados.0.smithi012.stdout:3374: done (0 left) 2024-09-10T18:08:35.849 INFO:tasks.rados.rados.0.smithi012.stdout:3375: snap_remove snap 329 2024-09-10T18:08:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:35 smithi012 ceph-mon[89611]: osdmap e757: 8 total, 8 up, 8 in 2024-09-10T18:08:36.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:35 smithi012 ceph-mon[89611]: pgmap v822: 121 pgs: 121 active+clean; 227 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 128 KiB/s wr, 6 op/s 2024-09-10T18:08:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:35 smithi012 ceph-mon[92029]: osdmap e757: 8 total, 8 up, 8 in 2024-09-10T18:08:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:35 smithi012 ceph-mon[92029]: pgmap v822: 121 pgs: 121 active+clean; 227 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 128 KiB/s wr, 6 op/s 2024-09-10T18:08:36.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:35 smithi089 ceph-mon[84132]: osdmap e757: 8 total, 8 up, 8 in 2024-09-10T18:08:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:35 smithi089 ceph-mon[84132]: pgmap v822: 121 pgs: 121 active+clean; 227 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 128 KiB/s wr, 6 op/s 2024-09-10T18:08:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:3375: done (0 left) 2024-09-10T18:08:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 338 2024-09-10T18:08:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:3376: seq_num 1046 ranges {0=729088} 2024-09-10T18:08:36.856 INFO:tasks.rados.rados.0.smithi012.stdout:3376: writing smithi01278544-15 from 0 to 729088 tid 1 2024-09-10T18:08:36.861 INFO:tasks.rados.rados.0.smithi012.stdout:3377: read oid 39 snap -1 2024-09-10T18:08:36.861 INFO:tasks.rados.rados.0.smithi012.stdout:3377: expect deleted 2024-09-10T18:08:36.861 INFO:tasks.rados.rados.0.smithi012.stdout:3378: rollback oid 17 current snap is 338 2024-09-10T18:08:36.861 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 17 to 336 2024-09-10T18:08:36.861 INFO:tasks.rados.rados.0.smithi012.stdout:3379: read oid 19 snap -1 2024-09-10T18:08:36.862 INFO:tasks.rados.rados.0.smithi012.stdout:3379: expect (ObjNum 1038 snap 335 seq_num 1038) 2024-09-10T18:08:36.862 INFO:tasks.rados.rados.0.smithi012.stdout:3380: rollback oid 24 current snap is 338 2024-09-10T18:08:36.862 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 24 to 326 2024-09-10T18:08:36.862 INFO:tasks.rados.rados.0.smithi012.stdout:3381: copy_from oid 10 from oid 32 current snap is 338 2024-09-10T18:08:36.862 INFO:tasks.rados.rados.0.smithi012.stdout:3382: copy_from oid 27 from oid 30 current snap is 338 2024-09-10T18:08:36.862 INFO:tasks.rados.rados.0.smithi012.stdout:3383: delete oid 37 current snap is 338 2024-09-10T18:08:36.865 INFO:tasks.rados.rados.0.smithi012.stdout:3378: finishing rollback tid 0 to smithi01278544-17 2024-09-10T18:08:36.867 INFO:tasks.rados.rados.0.smithi012.stdout:3377: done (7 left) 2024-09-10T18:08:36.867 INFO:tasks.rados.rados.0.smithi012.stdout:3383: done (6 left) 2024-09-10T18:08:36.867 INFO:tasks.rados.rados.0.smithi012.stdout:3384: read oid 28 snap -1 2024-09-10T18:08:36.867 INFO:tasks.rados.rados.0.smithi012.stdout:3384: expect (ObjNum 985 snap 313 seq_num 985) 2024-09-10T18:08:36.867 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 338 2024-09-10T18:08:36.867 INFO:tasks.rados.rados.0.smithi012.stdout:3385: seq_num 1048 ranges {0=761856} 2024-09-10T18:08:36.872 INFO:tasks.rados.rados.0.smithi012.stdout:3385: writing smithi01278544-26 from 0 to 761856 tid 1 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3386: rmattr oid 49 current snap is 338 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3386: done (8 left) 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3387: delete oid 47 current snap is 338 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3376: finishing write tid 1 to smithi01278544-15 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3378: finishing rollback tid 1 to smithi01278544-17 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3376: finishing write tid 2 to smithi01278544-15 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3382: finishing copy_from to smithi01278544-27 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3382: got expected ENOENT (src dne) 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3378: finishing rollback tid 2 to smithi01278544-17 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2032 (ObjNum 1030 snap 330 seq_num 1030) dirty exists 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3380: finishing rollback tid 0 to smithi01278544-24 2024-09-10T18:08:36.873 INFO:tasks.rados.rados.0.smithi012.stdout:3382: finishing copy_from racing read to smithi01278544-27 2024-09-10T18:08:36.874 INFO:tasks.rados.rados.0.smithi012.stdout:3380: finishing rollback tid 1 to smithi01278544-24 2024-09-10T18:08:36.874 INFO:tasks.rados.rados.0.smithi012.stdout:3380: finishing rollback tid 2 to smithi01278544-24 2024-09-10T18:08:36.874 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 2030 (ObjNum 1006 snap 319 seq_num 1006) dirty exists 2024-09-10T18:08:36.874 INFO:tasks.rados.rados.0.smithi012.stdout:3376: finishing write tid 3 to smithi01278544-15 2024-09-10T18:08:36.874 INFO:tasks.rados.rados.0.smithi012.stdout:3376: oid 15 updating version 0 to 2171 2024-09-10T18:08:36.874 INFO:tasks.rados.rados.0.smithi012.stdout:3376: oid 15 version 2171 is already newer than 2170 2024-09-10T18:08:36.874 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2171 (ObjNum 1046 snap 338 seq_num 1046) dirty exists 2024-09-10T18:08:36.874 INFO:tasks.rados.rados.0.smithi012.stdout:3376: left oid 15 (ObjNum 1046 snap 338 seq_num 1046) 2024-09-10T18:08:36.876 INFO:tasks.rados.rados.0.smithi012.stdout:3379: expect (ObjNum 1038 snap 335 seq_num 1038) 2024-09-10T18:08:36.999 INFO:tasks.rados.rados.0.smithi012.stdout:3381: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3381: finishing copy_from to smithi01278544-10 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2047 (ObjNum 1004 snap 319 seq_num 1004) dirty exists 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3385: finishing write tid 1 to smithi01278544-26 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3376: done (8 left) 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3378: done (7 left) 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3379: done (6 left) 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3380: done (5 left) 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3381: done (4 left) 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3382: done (3 left) 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3387: done (2 left) 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3388: rmattr oid 8 current snap is 338 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3388: done (2 left) 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3389: copy_from oid 11 from oid 12 current snap is 338 2024-09-10T18:08:37.000 INFO:tasks.rados.rados.0.smithi012.stdout:3385: finishing write tid 2 to smithi01278544-26 2024-09-10T18:08:37.001 INFO:tasks.rados.rados.0.smithi012.stdout:3385: finishing write tid 3 to smithi01278544-26 2024-09-10T18:08:37.001 INFO:tasks.rados.rados.0.smithi012.stdout:3385: oid 26 updating version 0 to 2032 2024-09-10T18:08:37.001 INFO:tasks.rados.rados.0.smithi012.stdout:3385: oid 26 version 2032 is already newer than 2031 2024-09-10T18:08:37.001 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2032 (ObjNum 1048 snap 338 seq_num 1048) dirty exists 2024-09-10T18:08:37.001 INFO:tasks.rados.rados.0.smithi012.stdout:3385: left oid 26 (ObjNum 1048 snap 338 seq_num 1048) 2024-09-10T18:08:37.001 INFO:tasks.rados.rados.0.smithi012.stdout:3384: expect (ObjNum 985 snap 313 seq_num 985) 2024-09-10T18:08:37.193 INFO:tasks.rados.rados.0.smithi012.stdout:3389: finishing copy_from racing read to smithi01278544-11 2024-09-10T18:08:37.193 INFO:tasks.rados.rados.0.smithi012.stdout:3389: finishing copy_from to smithi01278544-11 2024-09-10T18:08:37.193 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2395 (ObjNum 1034 snap 334 seq_num 1034) dirty exists 2024-09-10T18:08:37.193 INFO:tasks.rados.rados.0.smithi012.stdout:3384: done (2 left) 2024-09-10T18:08:37.194 INFO:tasks.rados.rados.0.smithi012.stdout:3385: done (1 left) 2024-09-10T18:08:37.194 INFO:tasks.rados.rados.0.smithi012.stdout:3389: done (0 left) 2024-09-10T18:08:37.194 INFO:tasks.rados.rados.0.smithi012.stdout:3390: rollback oid 41 current snap is 338 2024-09-10T18:08:37.194 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 41 to 323 2024-09-10T18:08:37.194 INFO:tasks.rados.rados.0.smithi012.stdout:3391: delete oid 2 current snap is 338 2024-09-10T18:08:37.195 INFO:tasks.rados.rados.0.smithi012.stdout:3391: done (1 left) 2024-09-10T18:08:37.195 INFO:tasks.rados.rados.0.smithi012.stdout:3392: read oid 7 snap 332 2024-09-10T18:08:37.195 INFO:tasks.rados.rados.0.smithi012.stdout:3392: expect deleted 2024-09-10T18:08:37.195 INFO:tasks.rados.rados.0.smithi012.stdout:3393: setattr oid 18 current snap is 338 2024-09-10T18:08:37.197 INFO:tasks.rados.rados.0.smithi012.stdout:3392: done (2 left) 2024-09-10T18:08:37.197 INFO:tasks.rados.rados.0.smithi012.stdout:3394: snap_create 2024-09-10T18:08:37.199 INFO:tasks.rados.rados.0.smithi012.stdout:3390: finishing rollback tid 0 to smithi01278544-41 2024-09-10T18:08:37.199 INFO:tasks.rados.rados.0.smithi012.stdout:3390: finishing rollback tid 1 to smithi01278544-41 2024-09-10T18:08:37.200 INFO:tasks.rados.rados.0.smithi012.stdout:3390: finishing rollback tid 2 to smithi01278544-41 2024-09-10T18:08:37.200 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 2317 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:08:37.200 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 2172 (ObjNum 1002 snap 319 seq_num 1002) dirty exists 2024-09-10T18:08:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:36 smithi012 ceph-mon[89611]: osdmap e758: 8 total, 8 up, 8 in 2024-09-10T18:08:37.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:36 smithi012 ceph-mon[92029]: osdmap e758: 8 total, 8 up, 8 in 2024-09-10T18:08:37.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:36 smithi089 ceph-mon[84132]: osdmap e758: 8 total, 8 up, 8 in 2024-09-10T18:08:37.814 INFO:tasks.rados.rados.0.smithi012.stdout:3390: done (2 left) 2024-09-10T18:08:37.814 INFO:tasks.rados.rados.0.smithi012.stdout:3393: done (1 left) 2024-09-10T18:08:37.814 INFO:tasks.rados.rados.0.smithi012.stdout:3394: done (0 left) 2024-09-10T18:08:37.814 INFO:tasks.rados.rados.0.smithi012.stdout:3395: rmattr oid 41 current snap is 339 2024-09-10T18:08:37.815 INFO:tasks.rados.rados.0.smithi012.stdout:3396: read oid 24 snap -1 2024-09-10T18:08:37.815 INFO:tasks.rados.rados.0.smithi012.stdout:3396: expect (ObjNum 1006 snap 319 seq_num 1006) 2024-09-10T18:08:37.815 INFO:tasks.rados.rados.0.smithi012.stdout:3397: snap_remove snap 326 2024-09-10T18:08:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:37 smithi012 ceph-mon[89611]: osdmap e759: 8 total, 8 up, 8 in 2024-09-10T18:08:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:37 smithi012 ceph-mon[89611]: pgmap v825: 121 pgs: 121 active+clean; 205 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2024-09-10T18:08:38.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:37 smithi012 ceph-mon[89611]: osdmap e760: 8 total, 8 up, 8 in 2024-09-10T18:08:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:37 smithi012 ceph-mon[92029]: osdmap e759: 8 total, 8 up, 8 in 2024-09-10T18:08:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:37 smithi012 ceph-mon[92029]: pgmap v825: 121 pgs: 121 active+clean; 205 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2024-09-10T18:08:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:37 smithi012 ceph-mon[92029]: osdmap e760: 8 total, 8 up, 8 in 2024-09-10T18:08:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:37 smithi089 ceph-mon[84132]: osdmap e759: 8 total, 8 up, 8 in 2024-09-10T18:08:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:37 smithi089 ceph-mon[84132]: pgmap v825: 121 pgs: 121 active+clean; 205 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2024-09-10T18:08:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:37 smithi089 ceph-mon[84132]: osdmap e760: 8 total, 8 up, 8 in 2024-09-10T18:08:38.811 INFO:tasks.rados.rados.0.smithi012.stdout:3397: done (2 left) 2024-09-10T18:08:38.812 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 339 2024-09-10T18:08:38.812 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 41 v 2318 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:08:38.812 INFO:tasks.rados.rados.0.smithi012.stdout:3398: seq_num 1051 ranges {12541952=409600,12951552=401408} 2024-09-10T18:08:38.883 INFO:tasks.rados.rados.0.smithi012.stdout:3398: writing smithi01278544-11 from 12541952 to 12951552 tid 1 2024-09-10T18:08:38.886 INFO:tasks.rados.rados.0.smithi012.stdout:3398: writing smithi01278544-11 from 12951552 to 13352960 tid 2 2024-09-10T18:08:38.886 INFO:tasks.rados.rados.0.smithi012.stdout:3395: done (2 left) 2024-09-10T18:08:38.886 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 339 2024-09-10T18:08:38.886 INFO:tasks.rados.rados.0.smithi012.stdout:3399: seq_num 1052 ranges {458752=425984,884736=401408} 2024-09-10T18:08:38.890 INFO:tasks.rados.rados.0.smithi012.stdout:3399: writing smithi01278544-17 from 458752 to 884736 tid 1 2024-09-10T18:08:38.893 INFO:tasks.rados.rados.0.smithi012.stdout:3399: writing smithi01278544-17 from 884736 to 1286144 tid 2 2024-09-10T18:08:38.893 INFO:tasks.rados.rados.0.smithi012.stdout:3400: read oid 39 snap 334 2024-09-10T18:08:38.893 INFO:tasks.rados.rados.0.smithi012.stdout:3400: expect deleted 2024-09-10T18:08:38.893 INFO:tasks.rados.rados.0.smithi012.stdout:3401: snap_create 2024-09-10T18:08:38.893 INFO:tasks.rados.rados.0.smithi012.stdout:3396: expect (ObjNum 1006 snap 319 seq_num 1006) 2024-09-10T18:08:38.985 INFO:tasks.rados.rados.0.smithi012.stdout:3398: finishing write tid 1 to smithi01278544-11 2024-09-10T18:08:38.985 INFO:tasks.rados.rados.0.smithi012.stdout:3398: finishing write tid 2 to smithi01278544-11 2024-09-10T18:08:38.985 INFO:tasks.rados.rados.0.smithi012.stdout:3398: finishing write tid 3 to smithi01278544-11 2024-09-10T18:08:38.985 INFO:tasks.rados.rados.0.smithi012.stdout:3398: finishing write tid 4 to smithi01278544-11 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3398: oid 11 updating version 0 to 2468 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3398: oid 11 version 2468 is already newer than 2466 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3398: oid 11 version 2468 is already newer than 2467 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2468 (ObjNum 1051 snap 339 seq_num 1051) dirty exists 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3398: left oid 11 (ObjNum 1051 snap 339 seq_num 1051) 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3399: finishing write tid 1 to smithi01278544-17 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3399: finishing write tid 2 to smithi01278544-17 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3399: finishing write tid 3 to smithi01278544-17 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3399: finishing write tid 4 to smithi01278544-17 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3399: oid 17 updating version 0 to 2033 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3399: oid 17 updating version 2033 to 2035 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3399: oid 17 version 2035 is already newer than 2034 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2035 (ObjNum 1052 snap 339 seq_num 1052) dirty exists 2024-09-10T18:08:38.986 INFO:tasks.rados.rados.0.smithi012.stdout:3399: left oid 17 (ObjNum 1052 snap 339 seq_num 1052) 2024-09-10T18:08:39.819 INFO:tasks.rados.rados.0.smithi012.stdout:3396: done (4 left) 2024-09-10T18:08:39.820 INFO:tasks.rados.rados.0.smithi012.stdout:3398: done (3 left) 2024-09-10T18:08:39.820 INFO:tasks.rados.rados.0.smithi012.stdout:3399: done (2 left) 2024-09-10T18:08:39.820 INFO:tasks.rados.rados.0.smithi012.stdout:3400: done (1 left) 2024-09-10T18:08:39.820 INFO:tasks.rados.rados.0.smithi012.stdout:3401: done (0 left) 2024-09-10T18:08:39.820 INFO:tasks.rados.rados.0.smithi012.stdout:3402: rollback oid 22 current snap is 340 2024-09-10T18:08:39.820 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 22 to 336 2024-09-10T18:08:39.820 INFO:tasks.rados.rados.0.smithi012.stdout:3403: snap_remove snap 323 2024-09-10T18:08:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:39 smithi012 ceph-mon[89611]: osdmap e761: 8 total, 8 up, 8 in 2024-09-10T18:08:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:39 smithi012 ceph-mon[92029]: osdmap e761: 8 total, 8 up, 8 in 2024-09-10T18:08:40.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:39 smithi089 ceph-mon[84132]: osdmap e761: 8 total, 8 up, 8 in 2024-09-10T18:08:40.825 INFO:tasks.rados.rados.0.smithi012.stdout:3403: done (1 left) 2024-09-10T18:08:40.825 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 340 2024-09-10T18:08:40.825 INFO:tasks.rados.rados.0.smithi012.stdout:3404: seq_num 1053 ranges {425984=442368,868352=401408} 2024-09-10T18:08:40.830 INFO:tasks.rados.rados.0.smithi012.stdout:3404: writing smithi01278544-50 from 425984 to 868352 tid 1 2024-09-10T18:08:40.833 INFO:tasks.rados.rados.0.smithi012.stdout:3404: writing smithi01278544-50 from 868352 to 1269760 tid 2 2024-09-10T18:08:40.834 INFO:tasks.rados.rados.0.smithi012.stdout:3405: delete oid 17 current snap is 340 2024-09-10T18:08:40.834 INFO:tasks.rados.rados.0.smithi012.stdout:3402: finishing rollback tid 0 to smithi01278544-22 2024-09-10T18:08:40.834 INFO:tasks.rados.rados.0.smithi012.stdout:3402: finishing rollback tid 1 to smithi01278544-22 2024-09-10T18:08:40.834 INFO:tasks.rados.rados.0.smithi012.stdout:3402: finishing rollback tid 2 to smithi01278544-22 2024-09-10T18:08:40.834 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2472 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:08:40.841 INFO:tasks.rados.rados.0.smithi012.stdout:3404: finishing write tid 1 to smithi01278544-50 2024-09-10T18:08:40.842 INFO:tasks.rados.rados.0.smithi012.stdout:3402: done (2 left) 2024-09-10T18:08:40.842 INFO:tasks.rados.rados.0.smithi012.stdout:3405: done (1 left) 2024-09-10T18:08:40.842 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 14 current snap is 340 2024-09-10T18:08:40.842 INFO:tasks.rados.rados.0.smithi012.stdout:3406: seq_num 1055 ranges {0=475136,475136=401408} 2024-09-10T18:08:40.845 INFO:tasks.rados.rados.0.smithi012.stdout:3406: writing smithi01278544-14 from 0 to 475136 tid 1 2024-09-10T18:08:40.848 INFO:tasks.rados.rados.0.smithi012.stdout:3406: writing smithi01278544-14 from 475136 to 876544 tid 2 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3407: read oid 44 snap -1 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3407: expect (ObjNum 999 snap 319 seq_num 999) 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3408: setattr oid 33 current snap is 340 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3404: finishing write tid 2 to smithi01278544-50 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3404: finishing write tid 3 to smithi01278544-50 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3404: finishing write tid 4 to smithi01278544-50 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3404: oid 50 updating version 0 to 2046 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3404: oid 50 updating version 2046 to 2048 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:3404: oid 50 version 2048 is already newer than 2047 2024-09-10T18:08:40.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2048 (ObjNum 1053 snap 340 seq_num 1053) dirty exists 2024-09-10T18:08:40.850 INFO:tasks.rados.rados.0.smithi012.stdout:3404: left oid 50 (ObjNum 1053 snap 340 seq_num 1053) 2024-09-10T18:08:40.850 INFO:tasks.rados.rados.0.smithi012.stdout:3404: done (3 left) 2024-09-10T18:08:40.851 INFO:tasks.rados.rados.0.smithi012.stdout:3409: delete oid 36 current snap is 340 2024-09-10T18:08:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:3406: finishing write tid 1 to smithi01278544-14 2024-09-10T18:08:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:3406: finishing write tid 2 to smithi01278544-14 2024-09-10T18:08:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:3409: done (3 left) 2024-09-10T18:08:40.853 INFO:tasks.rados.rados.0.smithi012.stdout:3410: delete oid 3 current snap is 340 2024-09-10T18:08:40.854 INFO:tasks.rados.rados.0.smithi012.stdout:3406: finishing write tid 3 to smithi01278544-14 2024-09-10T18:08:40.858 INFO:tasks.rados.rados.0.smithi012.stdout:3406: finishing write tid 4 to smithi01278544-14 2024-09-10T18:08:40.858 INFO:tasks.rados.rados.0.smithi012.stdout:3406: oid 14 updating version 0 to 2330 2024-09-10T18:08:40.858 INFO:tasks.rados.rados.0.smithi012.stdout:3406: oid 14 version 2330 is already newer than 2328 2024-09-10T18:08:40.858 INFO:tasks.rados.rados.0.smithi012.stdout:3406: oid 14 version 2330 is already newer than 2329 2024-09-10T18:08:40.858 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 2330 (ObjNum 1055 snap 340 seq_num 1055) dirty exists 2024-09-10T18:08:40.858 INFO:tasks.rados.rados.0.smithi012.stdout:3406: left oid 14 (ObjNum 1055 snap 340 seq_num 1055) 2024-09-10T18:08:40.859 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 2332 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:08:40.876 INFO:tasks.rados.rados.0.smithi012.stdout:3407: expect (ObjNum 999 snap 319 seq_num 999) 2024-09-10T18:08:41.066 INFO:tasks.rados.rados.0.smithi012.stdout:3406: done (3 left) 2024-09-10T18:08:41.066 INFO:tasks.rados.rados.0.smithi012.stdout:3407: done (2 left) 2024-09-10T18:08:41.067 INFO:tasks.rados.rados.0.smithi012.stdout:3408: done (1 left) 2024-09-10T18:08:41.067 INFO:tasks.rados.rados.0.smithi012.stdout:3410: done (0 left) 2024-09-10T18:08:41.067 INFO:tasks.rados.rados.0.smithi012.stdout:3411: snap_create 2024-09-10T18:08:41.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:40 smithi012 ceph-mon[89611]: pgmap v828: 121 pgs: 121 active+clean; 206 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2024-09-10T18:08:41.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:40 smithi012 ceph-mon[89611]: osdmap e762: 8 total, 8 up, 8 in 2024-09-10T18:08:41.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:40 smithi012 ceph-mon[92029]: pgmap v828: 121 pgs: 121 active+clean; 206 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2024-09-10T18:08:41.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:40 smithi012 ceph-mon[92029]: osdmap e762: 8 total, 8 up, 8 in 2024-09-10T18:08:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:40 smithi089 ceph-mon[84132]: pgmap v828: 121 pgs: 121 active+clean; 206 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2024-09-10T18:08:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:40 smithi089 ceph-mon[84132]: osdmap e762: 8 total, 8 up, 8 in 2024-09-10T18:08:41.832 INFO:tasks.rados.rados.0.smithi012.stdout:3411: done (0 left) 2024-09-10T18:08:41.832 INFO:tasks.rados.rados.0.smithi012.stdout:3412: snap_remove snap 336 2024-09-10T18:08:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:41 smithi012 ceph-mon[89611]: osdmap e763: 8 total, 8 up, 8 in 2024-09-10T18:08:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:41 smithi012 ceph-mon[92029]: osdmap e763: 8 total, 8 up, 8 in 2024-09-10T18:08:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:41 smithi089 ceph-mon[84132]: osdmap e763: 8 total, 8 up, 8 in 2024-09-10T18:08:42.815 INFO:tasks.rados.rados.0.smithi012.stdout:3412: done (0 left) 2024-09-10T18:08:42.815 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 341 2024-09-10T18:08:42.815 INFO:tasks.rados.rados.0.smithi012.stdout:3413: seq_num 1058 ranges {0=524288,524288=401408} 2024-09-10T18:08:42.818 INFO:tasks.rados.rados.0.smithi012.stdout:3413: writing smithi01278544-7 from 0 to 524288 tid 1 2024-09-10T18:08:42.821 INFO:tasks.rados.rados.0.smithi012.stdout:3413: writing smithi01278544-7 from 524288 to 925696 tid 2 2024-09-10T18:08:42.821 INFO:tasks.rados.rados.0.smithi012.stdout:3414: snap_remove snap 340 2024-09-10T18:08:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:42 smithi012 ceph-mon[89611]: pgmap v831: 121 pgs: 121 active+clean; 207 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.0 MiB/s rd, 566 KiB/s wr, 15 op/s 2024-09-10T18:08:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:42 smithi012 ceph-mon[89611]: osdmap e764: 8 total, 8 up, 8 in 2024-09-10T18:08:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:42 smithi012 ceph-mon[89611]: osdmap e765: 8 total, 8 up, 8 in 2024-09-10T18:08:43.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:42 smithi012 ceph-mon[92029]: pgmap v831: 121 pgs: 121 active+clean; 207 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.0 MiB/s rd, 566 KiB/s wr, 15 op/s 2024-09-10T18:08:43.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:42 smithi012 ceph-mon[92029]: osdmap e764: 8 total, 8 up, 8 in 2024-09-10T18:08:43.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:42 smithi012 ceph-mon[92029]: osdmap e765: 8 total, 8 up, 8 in 2024-09-10T18:08:43.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:42 smithi089 ceph-mon[84132]: pgmap v831: 121 pgs: 121 active+clean; 207 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.0 MiB/s rd, 566 KiB/s wr, 15 op/s 2024-09-10T18:08:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:42 smithi089 ceph-mon[84132]: osdmap e764: 8 total, 8 up, 8 in 2024-09-10T18:08:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:42 smithi089 ceph-mon[84132]: osdmap e765: 8 total, 8 up, 8 in 2024-09-10T18:08:43.815 INFO:tasks.rados.rados.0.smithi012.stdout:3413: finishing write tid 1 to smithi01278544-7 2024-09-10T18:08:43.815 INFO:tasks.rados.rados.0.smithi012.stdout:3413: finishing write tid 2 to smithi01278544-7 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3413: finishing write tid 3 to smithi01278544-7 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3413: finishing write tid 4 to smithi01278544-7 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3413: oid 7 updating version 0 to 1131 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3413: oid 7 version 1131 is already newer than 1129 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3413: oid 7 version 1131 is already newer than 1130 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1131 (ObjNum 1058 snap 341 seq_num 1058) dirty exists 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3413: left oid 7 (ObjNum 1058 snap 341 seq_num 1058) 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3413: done (1 left) 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3414: done (0 left) 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 341 2024-09-10T18:08:43.816 INFO:tasks.rados.rados.0.smithi012.stdout:3415: seq_num 1059 ranges {4800512=540672,5341184=401408} 2024-09-10T18:08:43.844 INFO:tasks.rados.rados.0.smithi012.stdout:3415: writing smithi01278544-28 from 4800512 to 5341184 tid 1 2024-09-10T18:08:43.847 INFO:tasks.rados.rados.0.smithi012.stdout:3415: writing smithi01278544-28 from 5341184 to 5742592 tid 2 2024-09-10T18:08:43.847 INFO:tasks.rados.rados.0.smithi012.stdout:3416: read oid 38 snap 337 2024-09-10T18:08:43.847 INFO:tasks.rados.rados.0.smithi012.stdout:3416: expect (ObjNum 1032 snap 332 seq_num 1032) 2024-09-10T18:08:43.847 INFO:tasks.rados.rados.0.smithi012.stdout:3417: read oid 34 snap 327 2024-09-10T18:08:43.847 INFO:tasks.rados.rados.0.smithi012.stdout:3417: expect (ObjNum 946 snap 299 seq_num 946) 2024-09-10T18:08:43.848 INFO:tasks.rados.rados.0.smithi012.stdout:3418: delete oid 12 current snap is 341 2024-09-10T18:08:43.854 INFO:tasks.rados.rados.0.smithi012.stdout:3415: finishing write tid 1 to smithi01278544-28 2024-09-10T18:08:43.854 INFO:tasks.rados.rados.0.smithi012.stdout:3415: finishing write tid 2 to smithi01278544-28 2024-09-10T18:08:43.855 INFO:tasks.rados.rados.0.smithi012.stdout:3415: finishing write tid 3 to smithi01278544-28 2024-09-10T18:08:43.855 INFO:tasks.rados.rados.0.smithi012.stdout:3418: done (3 left) 2024-09-10T18:08:43.856 INFO:tasks.rados.rados.0.smithi012.stdout:3419: snap_create 2024-09-10T18:08:43.857 INFO:tasks.rados.rados.0.smithi012.stdout:3415: finishing write tid 4 to smithi01278544-28 2024-09-10T18:08:43.857 INFO:tasks.rados.rados.0.smithi012.stdout:3415: oid 28 updating version 0 to 1323 2024-09-10T18:08:43.857 INFO:tasks.rados.rados.0.smithi012.stdout:3415: oid 28 version 1323 is already newer than 1322 2024-09-10T18:08:43.857 INFO:tasks.rados.rados.0.smithi012.stdout:3415: oid 28 version 1323 is already newer than 1321 2024-09-10T18:08:43.858 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1323 (ObjNum 1059 snap 341 seq_num 1059) dirty exists 2024-09-10T18:08:43.858 INFO:tasks.rados.rados.0.smithi012.stdout:3415: left oid 28 (ObjNum 1059 snap 341 seq_num 1059) 2024-09-10T18:08:43.864 INFO:tasks.rados.rados.0.smithi012.stdout:3417: expect (ObjNum 946 snap 299 seq_num 946) 2024-09-10T18:08:43.970 INFO:tasks.rados.rados.0.smithi012.stdout:3416: expect (ObjNum 1032 snap 332 seq_num 1032) 2024-09-10T18:08:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:08:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:08:44] "GET /metrics HTTP/1.1" 200 36353 "" "Prometheus/2.51.0" 2024-09-10T18:08:44.840 INFO:tasks.rados.rados.0.smithi012.stdout:3415: done (3 left) 2024-09-10T18:08:44.840 INFO:tasks.rados.rados.0.smithi012.stdout:3416: done (2 left) 2024-09-10T18:08:44.840 INFO:tasks.rados.rados.0.smithi012.stdout:3417: done (1 left) 2024-09-10T18:08:44.840 INFO:tasks.rados.rados.0.smithi012.stdout:3419: done (0 left) 2024-09-10T18:08:44.840 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 342 2024-09-10T18:08:44.840 INFO:tasks.rados.rados.0.smithi012.stdout:3420: seq_num 1061 ranges {2826240=573440,3399680=401408} 2024-09-10T18:08:44.861 INFO:tasks.rados.rados.0.smithi012.stdout:3420: writing smithi01278544-19 from 2826240 to 3399680 tid 1 2024-09-10T18:08:44.861 INFO:tasks.rados.rados.0.smithi012.stdout:3420: writing smithi01278544-19 from 3399680 to 3801088 tid 2 2024-09-10T18:08:44.861 INFO:tasks.rados.rados.0.smithi012.stdout:3421: copy_from oid 20 from oid 49 current snap is 342 2024-09-10T18:08:44.861 INFO:tasks.rados.rados.0.smithi012.stdout:3422: snap_remove snap 330 2024-09-10T18:08:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:44 smithi012 ceph-mon[89611]: pgmap v834: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 4.0 MiB/s wr, 24 op/s 2024-09-10T18:08:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:44 smithi012 ceph-mon[89611]: osdmap e766: 8 total, 8 up, 8 in 2024-09-10T18:08:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:44 smithi012 ceph-mon[92029]: pgmap v834: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 4.0 MiB/s wr, 24 op/s 2024-09-10T18:08:45.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:44 smithi012 ceph-mon[92029]: osdmap e766: 8 total, 8 up, 8 in 2024-09-10T18:08:45.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:44 smithi089 ceph-mon[84132]: pgmap v834: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 4.0 MiB/s wr, 24 op/s 2024-09-10T18:08:45.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:44 smithi089 ceph-mon[84132]: osdmap e766: 8 total, 8 up, 8 in 2024-09-10T18:08:45.849 INFO:tasks.rados.rados.0.smithi012.stdout:3422: done (2 left) 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3423: rollback oid 39 current snap is 342 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 338 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3424: copy_from oid 34 from oid 13 current snap is 342 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3420: finishing write tid 1 to smithi01278544-19 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3420: finishing write tid 2 to smithi01278544-19 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3421: finishing copy_from to smithi01278544-20 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3421: got expected ENOENT (src dne) 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3420: finishing write tid 3 to smithi01278544-19 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3421: finishing copy_from racing read to smithi01278544-20 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3420: finishing write tid 4 to smithi01278544-19 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3420: oid 19 updating version 0 to 1344 2024-09-10T18:08:45.850 INFO:tasks.rados.rados.0.smithi012.stdout:3420: oid 19 updating version 1344 to 1345 2024-09-10T18:08:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:3420: oid 19 updating version 1345 to 1346 2024-09-10T18:08:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1346 (ObjNum 1061 snap 342 seq_num 1061) dirty exists 2024-09-10T18:08:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:3420: left oid 19 (ObjNum 1061 snap 342 seq_num 1061) 2024-09-10T18:08:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:3420: done (3 left) 2024-09-10T18:08:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:3421: done (2 left) 2024-09-10T18:08:45.851 INFO:tasks.rados.rados.0.smithi012.stdout:3425: delete oid 40 current snap is 342 2024-09-10T18:08:45.856 INFO:tasks.rados.rados.0.smithi012.stdout:3425: done (2 left) 2024-09-10T18:08:45.857 INFO:tasks.rados.rados.0.smithi012.stdout:3426: rollback oid 4 current snap is 342 2024-09-10T18:08:45.857 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 4 to 332 2024-09-10T18:08:45.857 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 342 2024-09-10T18:08:45.857 INFO:tasks.rados.rados.0.smithi012.stdout:3427: seq_num 1063 ranges {2179072=606208,2785280=401408} 2024-09-10T18:08:45.873 INFO:tasks.rados.rados.0.smithi012.stdout:3427: writing smithi01278544-24 from 2179072 to 2785280 tid 1 2024-09-10T18:08:45.877 INFO:tasks.rados.rados.0.smithi012.stdout:3427: writing smithi01278544-24 from 2785280 to 3186688 tid 2 2024-09-10T18:08:45.877 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 342 2024-09-10T18:08:45.877 INFO:tasks.rados.rados.0.smithi012.stdout:3423: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:08:45.877 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2317 (ObjNum 177 snap 0 seq_num 1) dirty dne 2024-09-10T18:08:45.877 INFO:tasks.rados.rados.0.smithi012.stdout:3428: seq_num 1064 ranges {5070848=622592,5693440=401408} 2024-09-10T18:08:45.908 INFO:tasks.rados.rados.0.smithi012.stdout:3428: writing smithi01278544-44 from 5070848 to 5693440 tid 1 2024-09-10T18:08:45.910 INFO:tasks.rados.rados.0.smithi012.stdout:3428: writing smithi01278544-44 from 5693440 to 6094848 tid 2 2024-09-10T18:08:45.911 INFO:tasks.rados.rados.0.smithi012.stdout:3423: done (4 left) 2024-09-10T18:08:45.911 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 35 current snap is 342 2024-09-10T18:08:45.911 INFO:tasks.rados.rados.0.smithi012.stdout:3426: finishing rollback tid 0 to smithi01278544-4 2024-09-10T18:08:45.911 INFO:tasks.rados.rados.0.smithi012.stdout:3426: finishing rollback tid 1 to smithi01278544-4 2024-09-10T18:08:45.911 INFO:tasks.rados.rados.0.smithi012.stdout:3426: finishing rollback tid 2 to smithi01278544-4 2024-09-10T18:08:45.911 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2321 (ObjNum 1025 snap 328 seq_num 1025) dirty exists 2024-09-10T18:08:45.911 INFO:tasks.rados.rados.0.smithi012.stdout:3429: seq_num 1065 ranges {0=638976,638976=401408} 2024-09-10T18:08:45.914 INFO:tasks.rados.rados.0.smithi012.stdout:3429: writing smithi01278544-35 from 0 to 638976 tid 1 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3429: writing smithi01278544-35 from 638976 to 1040384 tid 2 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3426: done (4 left) 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 342 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3427: finishing write tid 1 to smithi01278544-24 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3427: finishing write tid 2 to smithi01278544-24 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3427: finishing write tid 3 to smithi01278544-24 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3427: finishing write tid 4 to smithi01278544-24 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3427: oid 24 updating version 0 to 2034 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3427: oid 24 version 2034 is already newer than 2033 2024-09-10T18:08:45.917 INFO:tasks.rados.rados.0.smithi012.stdout:3427: oid 24 updating version 2034 to 2035 2024-09-10T18:08:45.918 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 2035 (ObjNum 1063 snap 342 seq_num 1063) dirty exists 2024-09-10T18:08:45.918 INFO:tasks.rados.rados.0.smithi012.stdout:3427: left oid 24 (ObjNum 1063 snap 342 seq_num 1063) 2024-09-10T18:08:45.918 INFO:tasks.rados.rados.0.smithi012.stdout:3424: finishing copy_from racing read to smithi01278544-34 2024-09-10T18:08:45.918 INFO:tasks.rados.rados.0.smithi012.stdout:3424: finishing copy_from to smithi01278544-34 2024-09-10T18:08:45.918 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 2309 (ObjNum 1031 snap 331 seq_num 1031) dirty exists 2024-09-10T18:08:45.918 INFO:tasks.rados.rados.0.smithi012.stdout:3428: finishing write tid 1 to smithi01278544-44 2024-09-10T18:08:45.918 INFO:tasks.rados.rados.0.smithi012.stdout:3430: seq_num 1066 ranges {1572864=663552,2236416=401408} 2024-09-10T18:08:45.928 INFO:tasks.rados.rados.0.smithi012.stdout:3430: writing smithi01278544-45 from 1572864 to 2236416 tid 1 2024-09-10T18:08:45.931 INFO:tasks.rados.rados.0.smithi012.stdout:3430: writing smithi01278544-45 from 2236416 to 2637824 tid 2 2024-09-10T18:08:45.931 INFO:tasks.rados.rados.0.smithi012.stdout:3424: done (4 left) 2024-09-10T18:08:45.931 INFO:tasks.rados.rados.0.smithi012.stdout:3427: done (3 left) 2024-09-10T18:08:45.931 INFO:tasks.rados.rados.0.smithi012.stdout:3431: delete oid 9 current snap is 342 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3428: finishing write tid 2 to smithi01278544-44 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3428: finishing write tid 3 to smithi01278544-44 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3428: finishing write tid 4 to smithi01278544-44 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3428: oid 44 updating version 0 to 2169 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3428: oid 44 version 2169 is already newer than 2168 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3428: oid 44 version 2169 is already newer than 2167 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2169 (ObjNum 1064 snap 342 seq_num 1064) dirty exists 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3428: left oid 44 (ObjNum 1064 snap 342 seq_num 1064) 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3429: finishing write tid 1 to smithi01278544-35 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3429: finishing write tid 2 to smithi01278544-35 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3429: finishing write tid 3 to smithi01278544-35 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3429: finishing write tid 4 to smithi01278544-35 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3429: oid 35 updating version 0 to 2049 2024-09-10T18:08:45.932 INFO:tasks.rados.rados.0.smithi012.stdout:3429: oid 35 updating version 2049 to 2050 2024-09-10T18:08:45.933 INFO:tasks.rados.rados.0.smithi012.stdout:3429: oid 35 version 2050 is already newer than 2048 2024-09-10T18:08:45.933 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2050 (ObjNum 1065 snap 342 seq_num 1065) dirty exists 2024-09-10T18:08:45.933 INFO:tasks.rados.rados.0.smithi012.stdout:3429: left oid 35 (ObjNum 1065 snap 342 seq_num 1065) 2024-09-10T18:08:45.933 INFO:tasks.rados.rados.0.smithi012.stdout:3428: done (3 left) 2024-09-10T18:08:45.933 INFO:tasks.rados.rados.0.smithi012.stdout:3429: done (2 left) 2024-09-10T18:08:45.933 INFO:tasks.rados.rados.0.smithi012.stdout:3431: done (1 left) 2024-09-10T18:08:45.933 INFO:tasks.rados.rados.0.smithi012.stdout:3432: delete oid 1 current snap is 342 2024-09-10T18:08:45.935 INFO:tasks.rados.rados.0.smithi012.stdout:3430: finishing write tid 1 to smithi01278544-45 2024-09-10T18:08:45.935 INFO:tasks.rados.rados.0.smithi012.stdout:3430: finishing write tid 2 to smithi01278544-45 2024-09-10T18:08:45.935 INFO:tasks.rados.rados.0.smithi012.stdout:3430: finishing write tid 3 to smithi01278544-45 2024-09-10T18:08:45.936 INFO:tasks.rados.rados.0.smithi012.stdout:3432: done (1 left) 2024-09-10T18:08:45.936 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 342 2024-09-10T18:08:45.936 INFO:tasks.rados.rados.0.smithi012.stdout:3433: seq_num 1069 ranges {0=712704,712704=401408} 2024-09-10T18:08:45.940 INFO:tasks.rados.rados.0.smithi012.stdout:3433: writing smithi01278544-2 from 0 to 712704 tid 1 2024-09-10T18:08:45.944 INFO:tasks.rados.rados.0.smithi012.stdout:3433: writing smithi01278544-2 from 712704 to 1114112 tid 2 2024-09-10T18:08:45.944 INFO:tasks.rados.rados.0.smithi012.stdout:3434: snap_create 2024-09-10T18:08:45.944 INFO:tasks.rados.rados.0.smithi012.stdout:3430: finishing write tid 4 to smithi01278544-45 2024-09-10T18:08:45.944 INFO:tasks.rados.rados.0.smithi012.stdout:3430: oid 45 updating version 0 to 2340 2024-09-10T18:08:45.945 INFO:tasks.rados.rados.0.smithi012.stdout:3430: oid 45 version 2340 is already newer than 2339 2024-09-10T18:08:45.945 INFO:tasks.rados.rados.0.smithi012.stdout:3430: oid 45 updating version 2340 to 2341 2024-09-10T18:08:45.945 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2341 (ObjNum 1066 snap 342 seq_num 1066) dirty exists 2024-09-10T18:08:45.945 INFO:tasks.rados.rados.0.smithi012.stdout:3430: left oid 45 (ObjNum 1066 snap 342 seq_num 1066) 2024-09-10T18:08:45.945 INFO:tasks.rados.rados.0.smithi012.stdout:3433: finishing write tid 1 to smithi01278544-2 2024-09-10T18:08:45.946 INFO:tasks.rados.rados.0.smithi012.stdout:3433: finishing write tid 2 to smithi01278544-2 2024-09-10T18:08:45.946 INFO:tasks.rados.rados.0.smithi012.stdout:3433: finishing write tid 3 to smithi01278544-2 2024-09-10T18:08:45.947 INFO:tasks.rados.rados.0.smithi012.stdout:3433: finishing write tid 4 to smithi01278544-2 2024-09-10T18:08:45.947 INFO:tasks.rados.rados.0.smithi012.stdout:3433: oid 2 updating version 0 to 2173 2024-09-10T18:08:45.947 INFO:tasks.rados.rados.0.smithi012.stdout:3433: oid 2 updating version 2173 to 2175 2024-09-10T18:08:45.947 INFO:tasks.rados.rados.0.smithi012.stdout:3433: oid 2 version 2175 is already newer than 2174 2024-09-10T18:08:45.947 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2175 (ObjNum 1069 snap 342 seq_num 1069) dirty exists 2024-09-10T18:08:45.947 INFO:tasks.rados.rados.0.smithi012.stdout:3433: left oid 2 (ObjNum 1069 snap 342 seq_num 1069) 2024-09-10T18:08:46.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:45 smithi089 ceph-mon[84132]: osdmap e767: 8 total, 8 up, 8 in 2024-09-10T18:08:46.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:45 smithi089 ceph-mon[84132]: pgmap v837: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-09-10T18:08:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:45 smithi012 ceph-mon[89611]: osdmap e767: 8 total, 8 up, 8 in 2024-09-10T18:08:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:45 smithi012 ceph-mon[89611]: pgmap v837: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-09-10T18:08:46.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:45 smithi012 ceph-mon[92029]: osdmap e767: 8 total, 8 up, 8 in 2024-09-10T18:08:46.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:45 smithi012 ceph-mon[92029]: pgmap v837: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-09-10T18:08:46.851 INFO:tasks.rados.rados.0.smithi012.stdout:3430: done (2 left) 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:3433: done (1 left) 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:3434: done (0 left) 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:3435: read oid 25 snap -1 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:3435: expect (ObjNum 1042 snap 335 seq_num 1042) 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:3436: rollback oid 21 current snap is 343 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 342 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:3437: read oid 35 snap 334 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:3437: expect deleted 2024-09-10T18:08:46.852 INFO:tasks.rados.rados.0.smithi012.stdout:3438: snap_create 2024-09-10T18:08:46.860 INFO:tasks.rados.rados.0.smithi012.stdout:3436: finishing rollback tid 0 to smithi01278544-21 2024-09-10T18:08:46.860 INFO:tasks.rados.rados.0.smithi012.stdout:3436: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:08:46.861 INFO:tasks.rados.rados.0.smithi012.stdout:3436: finishing rollback tid 2 to smithi01278544-21 2024-09-10T18:08:46.861 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 2312 (ObjNum 1017 snap 324 seq_num 1017) dirty exists 2024-09-10T18:08:46.861 INFO:tasks.rados.rados.0.smithi012.stdout:3435: expect (ObjNum 1042 snap 335 seq_num 1042) 2024-09-10T18:08:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:46 smithi012 ceph-mon[89611]: osdmap e768: 8 total, 8 up, 8 in 2024-09-10T18:08:47.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:46 smithi012 ceph-mon[92029]: osdmap e768: 8 total, 8 up, 8 in 2024-09-10T18:08:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:47.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:46 smithi089 ceph-mon[84132]: osdmap e768: 8 total, 8 up, 8 in 2024-09-10T18:08:47.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:08:47.819 INFO:tasks.rados.rados.0.smithi012.stdout:3435: done (3 left) 2024-09-10T18:08:47.819 INFO:tasks.rados.rados.0.smithi012.stdout:3436: done (2 left) 2024-09-10T18:08:47.819 INFO:tasks.rados.rados.0.smithi012.stdout:3437: done (1 left) 2024-09-10T18:08:47.819 INFO:tasks.rados.rados.0.smithi012.stdout:3438: done (0 left) 2024-09-10T18:08:47.819 INFO:tasks.rados.rados.0.smithi012.stdout:3439: setattr oid 4 current snap is 344 2024-09-10T18:08:47.820 INFO:tasks.rados.rados.0.smithi012.stdout:3440: setattr oid 39 current snap is 344 2024-09-10T18:08:47.822 INFO:tasks.rados.rados.0.smithi012.stdout:3441: snap_create 2024-09-10T18:08:47.825 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2322 (ObjNum 1025 snap 328 seq_num 1025) dirty exists 2024-09-10T18:08:47.829 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2506 (ObjNum 49 snap 0 seq_num 1784894064) dirty exists 2024-09-10T18:08:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:47 smithi012 ceph-mon[89611]: osdmap e769: 8 total, 8 up, 8 in 2024-09-10T18:08:48.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:47 smithi012 ceph-mon[89611]: pgmap v840: 121 pgs: 121 active+clean; 232 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 6 op/s 2024-09-10T18:08:48.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:47 smithi012 ceph-mon[89611]: osdmap e770: 8 total, 8 up, 8 in 2024-09-10T18:08:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:47 smithi012 ceph-mon[92029]: osdmap e769: 8 total, 8 up, 8 in 2024-09-10T18:08:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:47 smithi012 ceph-mon[92029]: pgmap v840: 121 pgs: 121 active+clean; 232 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 6 op/s 2024-09-10T18:08:48.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:47 smithi012 ceph-mon[92029]: osdmap e770: 8 total, 8 up, 8 in 2024-09-10T18:08:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:47 smithi089 ceph-mon[84132]: osdmap e769: 8 total, 8 up, 8 in 2024-09-10T18:08:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:47 smithi089 ceph-mon[84132]: pgmap v840: 121 pgs: 121 active+clean; 232 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 6 op/s 2024-09-10T18:08:48.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:47 smithi089 ceph-mon[84132]: osdmap e770: 8 total, 8 up, 8 in 2024-09-10T18:08:48.816 INFO:tasks.rados.rados.0.smithi012.stdout:3439: done (2 left) 2024-09-10T18:08:48.817 INFO:tasks.rados.rados.0.smithi012.stdout:3440: done (1 left) 2024-09-10T18:08:48.817 INFO:tasks.rados.rados.0.smithi012.stdout:3441: done (0 left) 2024-09-10T18:08:48.817 INFO:tasks.rados.rados.0.smithi012.stdout:3442: rollback oid 29 current snap is 345 2024-09-10T18:08:48.817 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 29 to 328 2024-09-10T18:08:48.817 INFO:tasks.rados.rados.0.smithi012.stdout:3443: rollback oid 14 current snap is 345 2024-09-10T18:08:48.817 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 14 to 334 2024-09-10T18:08:48.817 INFO:tasks.rados.rados.0.smithi012.stdout:3444: snap_remove snap 321 2024-09-10T18:08:49.825 INFO:tasks.rados.rados.0.smithi012.stdout:3443: finishing rollback tid 0 to smithi01278544-14 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3443: finishing rollback tid 1 to smithi01278544-14 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 2344 (ObjNum 177 snap 0 seq_num 1) dirty dne 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3442: finishing rollback tid 0 to smithi01278544-29 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3442: finishing rollback tid 1 to smithi01278544-29 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3442: finishing rollback tid 2 to smithi01278544-29 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1138 (ObjNum 1013 snap 323 seq_num 1013) dirty exists 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3442: done (2 left) 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3443: done (1 left) 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3444: done (0 left) 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3445: rmattr oid 49 current snap is 345 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:3445: done (0 left) 2024-09-10T18:08:49.826 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 42 current snap is 345 2024-09-10T18:08:49.827 INFO:tasks.rados.rados.0.smithi012.stdout:3446: seq_num 1070 ranges {606208=729088,1335296=401408} 2024-09-10T18:08:49.833 INFO:tasks.rados.rados.0.smithi012.stdout:3446: writing smithi01278544-42 from 606208 to 1335296 tid 1 2024-09-10T18:08:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:3446: writing smithi01278544-42 from 1335296 to 1736704 tid 2 2024-09-10T18:08:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:3447: read oid 17 snap -1 2024-09-10T18:08:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:3447: expect deleted 2024-09-10T18:08:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:3448: copy_from oid 44 from oid 39 current snap is 345 2024-09-10T18:08:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 345 2024-09-10T18:08:49.837 INFO:tasks.rados.rados.0.smithi012.stdout:3449: seq_num 1071 ranges {16384=745472,761856=401408} 2024-09-10T18:08:49.842 INFO:tasks.rados.rados.0.smithi012.stdout:3449: writing smithi01278544-10 from 16384 to 761856 tid 1 2024-09-10T18:08:49.845 INFO:tasks.rados.rados.0.smithi012.stdout:3449: writing smithi01278544-10 from 761856 to 1163264 tid 2 2024-09-10T18:08:49.846 INFO:tasks.rados.rados.0.smithi012.stdout:3447: done (3 left) 2024-09-10T18:08:49.846 INFO:tasks.rados.rados.0.smithi012.stdout:3450: copy_from oid 40 from oid 47 current snap is 345 2024-09-10T18:08:49.846 INFO:tasks.rados.rados.0.smithi012.stdout:3451: read oid 34 snap -1 2024-09-10T18:08:49.846 INFO:tasks.rados.rados.0.smithi012.stdout:3451: expect (ObjNum 1031 snap 331 seq_num 1031) 2024-09-10T18:08:49.846 INFO:tasks.rados.rados.0.smithi012.stdout:3452: setattr oid 19 current snap is 345 2024-09-10T18:08:49.846 INFO:tasks.rados.rados.0.smithi012.stdout:3448: finishing copy_from racing read to smithi01278544-44 2024-09-10T18:08:49.849 INFO:tasks.rados.rados.0.smithi012.stdout:3448: finishing copy_from to smithi01278544-44 2024-09-10T18:08:49.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2506 (ObjNum 129 snap 0 seq_num 3497352984) dirty exists 2024-09-10T18:08:49.849 INFO:tasks.rados.rados.0.smithi012.stdout:3446: finishing write tid 1 to smithi01278544-42 2024-09-10T18:08:49.849 INFO:tasks.rados.rados.0.smithi012.stdout:3446: finishing write tid 2 to smithi01278544-42 2024-09-10T18:08:49.850 INFO:tasks.rados.rados.0.smithi012.stdout:3448: done (5 left) 2024-09-10T18:08:49.850 INFO:tasks.rados.rados.0.smithi012.stdout:3453: delete oid 7 current snap is 345 2024-09-10T18:08:49.852 INFO:tasks.rados.rados.0.smithi012.stdout:3449: finishing write tid 1 to smithi01278544-10 2024-09-10T18:08:49.854 INFO:tasks.rados.rados.0.smithi012.stdout:3449: finishing write tid 2 to smithi01278544-10 2024-09-10T18:08:49.855 INFO:tasks.rados.rados.0.smithi012.stdout:3449: finishing write tid 3 to smithi01278544-10 2024-09-10T18:08:49.860 INFO:tasks.rados.rados.0.smithi012.stdout:3453: done (5 left) 2024-09-10T18:08:49.860 INFO:tasks.rados.rados.0.smithi012.stdout:3454: read oid 43 snap -1 2024-09-10T18:08:49.860 INFO:tasks.rados.rados.0.smithi012.stdout:3454: expect (ObjNum 1044 snap 336 seq_num 1044) 2024-09-10T18:08:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 345 2024-09-10T18:08:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:3455: seq_num 1073 ranges {4481024=778240,5259264=401408} 2024-09-10T18:08:49.890 INFO:tasks.rados.rados.0.smithi012.stdout:3455: writing smithi01278544-18 from 4481024 to 5259264 tid 1 2024-09-10T18:08:49.892 INFO:tasks.rados.rados.0.smithi012.stdout:3455: writing smithi01278544-18 from 5259264 to 5660672 tid 2 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3456: setattr oid 39 current snap is 345 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3446: finishing write tid 3 to smithi01278544-42 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3450: finishing copy_from to smithi01278544-40 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3450: got expected ENOENT (src dne) 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3450: finishing copy_from racing read to smithi01278544-40 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3446: finishing write tid 4 to smithi01278544-42 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3446: oid 42 updating version 0 to 2352 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3446: oid 42 version 2352 is already newer than 2350 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3446: oid 42 version 2352 is already newer than 2351 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 42 v 2352 (ObjNum 1070 snap 345 seq_num 1070) dirty exists 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3446: left oid 42 (ObjNum 1070 snap 345 seq_num 1070) 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3449: finishing write tid 4 to smithi01278544-10 2024-09-10T18:08:49.893 INFO:tasks.rados.rados.0.smithi012.stdout:3449: oid 10 updating version 0 to 2516 2024-09-10T18:08:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:3449: oid 10 updating version 2516 to 2517 2024-09-10T18:08:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:3449: oid 10 updating version 2517 to 2518 2024-09-10T18:08:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2518 (ObjNum 1071 snap 345 seq_num 1071) dirty exists 2024-09-10T18:08:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:3449: left oid 10 (ObjNum 1071 snap 345 seq_num 1071) 2024-09-10T18:08:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:3451: expect (ObjNum 1031 snap 331 seq_num 1031) 2024-09-10T18:08:50.249 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 2313 (ObjNum 1061 snap 342 seq_num 1061) dirty exists 2024-09-10T18:08:50.274 INFO:tasks.rados.rados.0.smithi012.stdout:3455: finishing write tid 1 to smithi01278544-18 2024-09-10T18:08:50.274 INFO:tasks.rados.rados.0.smithi012.stdout:3455: finishing write tid 2 to smithi01278544-18 2024-09-10T18:08:50.275 INFO:tasks.rados.rados.0.smithi012.stdout:3455: finishing write tid 3 to smithi01278544-18 2024-09-10T18:08:50.275 INFO:tasks.rados.rados.0.smithi012.stdout:3455: finishing write tid 4 to smithi01278544-18 2024-09-10T18:08:50.275 INFO:tasks.rados.rados.0.smithi012.stdout:3455: oid 18 updating version 0 to 2176 2024-09-10T18:08:50.275 INFO:tasks.rados.rados.0.smithi012.stdout:3455: oid 18 updating version 2176 to 2177 2024-09-10T18:08:50.275 INFO:tasks.rados.rados.0.smithi012.stdout:3455: oid 18 updating version 2177 to 2178 2024-09-10T18:08:50.275 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 2178 (ObjNum 1073 snap 345 seq_num 1073) dirty exists 2024-09-10T18:08:50.275 INFO:tasks.rados.rados.0.smithi012.stdout:3455: left oid 18 (ObjNum 1073 snap 345 seq_num 1073) 2024-09-10T18:08:50.275 INFO:tasks.rados.rados.0.smithi012.stdout:3454: expect (ObjNum 1044 snap 336 seq_num 1044) 2024-09-10T18:08:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:49 smithi012 ceph-mon[89611]: osdmap e771: 8 total, 8 up, 8 in 2024-09-10T18:08:50.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:49 smithi012 ceph-mon[92029]: osdmap e771: 8 total, 8 up, 8 in 2024-09-10T18:08:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:49 smithi089 ceph-mon[84132]: osdmap e771: 8 total, 8 up, 8 in 2024-09-10T18:08:51.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:50 smithi012 ceph-mon[89611]: pgmap v843: 121 pgs: 121 active+clean; 234 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-09-10T18:08:51.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:50 smithi012 ceph-mon[89611]: osdmap e772: 8 total, 8 up, 8 in 2024-09-10T18:08:51.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:50 smithi012 ceph-mon[92029]: pgmap v843: 121 pgs: 121 active+clean; 234 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-09-10T18:08:51.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:50 smithi012 ceph-mon[92029]: osdmap e772: 8 total, 8 up, 8 in 2024-09-10T18:08:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:50 smithi089 ceph-mon[84132]: pgmap v843: 121 pgs: 121 active+clean; 234 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-09-10T18:08:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:50 smithi089 ceph-mon[84132]: osdmap e772: 8 total, 8 up, 8 in 2024-09-10T18:08:51.589 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2526 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:08:51.589 INFO:tasks.rados.rados.0.smithi012.stdout:3446: done (7 left) 2024-09-10T18:08:51.589 INFO:tasks.rados.rados.0.smithi012.stdout:3449: done (6 left) 2024-09-10T18:08:51.589 INFO:tasks.rados.rados.0.smithi012.stdout:3450: done (5 left) 2024-09-10T18:08:51.590 INFO:tasks.rados.rados.0.smithi012.stdout:3451: done (4 left) 2024-09-10T18:08:51.590 INFO:tasks.rados.rados.0.smithi012.stdout:3452: done (3 left) 2024-09-10T18:08:51.590 INFO:tasks.rados.rados.0.smithi012.stdout:3454: done (2 left) 2024-09-10T18:08:51.590 INFO:tasks.rados.rados.0.smithi012.stdout:3455: done (1 left) 2024-09-10T18:08:51.590 INFO:tasks.rados.rados.0.smithi012.stdout:3456: done (0 left) 2024-09-10T18:08:51.590 INFO:tasks.rados.rados.0.smithi012.stdout:3457: snap_create 2024-09-10T18:08:51.829 INFO:tasks.rados.rados.0.smithi012.stdout:3457: done (0 left) 2024-09-10T18:08:51.830 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 346 2024-09-10T18:08:51.830 INFO:tasks.rados.rados.0.smithi012.stdout:3458: seq_num 1074 ranges {0=794624,794624=401408} 2024-09-10T18:08:51.833 INFO:tasks.rados.rados.0.smithi012.stdout:3458: writing smithi01278544-1 from 0 to 794624 tid 1 2024-09-10T18:08:51.836 INFO:tasks.rados.rados.0.smithi012.stdout:3458: writing smithi01278544-1 from 794624 to 1196032 tid 2 2024-09-10T18:08:51.836 INFO:tasks.rados.rados.0.smithi012.stdout:3459: copy_from oid 2 from oid 33 current snap is 346 2024-09-10T18:08:51.836 INFO:tasks.rados.rados.0.smithi012.stdout:3460: read oid 31 snap -1 2024-09-10T18:08:51.837 INFO:tasks.rados.rados.0.smithi012.stdout:3460: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:08:51.837 INFO:tasks.rados.rados.0.smithi012.stdout:3461: delete oid 46 current snap is 346 2024-09-10T18:08:51.842 INFO:tasks.rados.rados.0.smithi012.stdout:3458: finishing write tid 1 to smithi01278544-1 2024-09-10T18:08:51.842 INFO:tasks.rados.rados.0.smithi012.stdout:3458: finishing write tid 2 to smithi01278544-1 2024-09-10T18:08:51.842 INFO:tasks.rados.rados.0.smithi012.stdout:3461: done (3 left) 2024-09-10T18:08:51.842 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 17 current snap is 346 2024-09-10T18:08:51.842 INFO:tasks.rados.rados.0.smithi012.stdout:3462: seq_num 1076 ranges {0=425984,425984=548864,974848=253952} 2024-09-10T18:08:51.845 INFO:tasks.rados.rados.0.smithi012.stdout:3462: writing smithi01278544-17 from 0 to 425984 tid 1 2024-09-10T18:08:51.848 INFO:tasks.rados.rados.0.smithi012.stdout:3462: writing smithi01278544-17 from 425984 to 974848 tid 2 2024-09-10T18:08:51.850 INFO:tasks.rados.rados.0.smithi012.stdout:3462: writing smithi01278544-17 from 974848 to 1228800 tid 3 2024-09-10T18:08:51.850 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 346 2024-09-10T18:08:51.850 INFO:tasks.rados.rados.0.smithi012.stdout:3460: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:08:51.879 INFO:tasks.rados.rados.0.smithi012.stdout:3458: finishing write tid 3 to smithi01278544-1 2024-09-10T18:08:51.879 INFO:tasks.rados.rados.0.smithi012.stdout:3458: finishing write tid 4 to smithi01278544-1 2024-09-10T18:08:51.879 INFO:tasks.rados.rados.0.smithi012.stdout:3458: oid 1 updating version 0 to 2176 2024-09-10T18:08:51.879 INFO:tasks.rados.rados.0.smithi012.stdout:3458: oid 1 version 2176 is already newer than 2175 2024-09-10T18:08:51.879 INFO:tasks.rados.rados.0.smithi012.stdout:3458: oid 1 version 2176 is already newer than 2174 2024-09-10T18:08:51.879 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2176 (ObjNum 1074 snap 346 seq_num 1074) dirty exists 2024-09-10T18:08:51.879 INFO:tasks.rados.rados.0.smithi012.stdout:3458: left oid 1 (ObjNum 1074 snap 346 seq_num 1074) 2024-09-10T18:08:51.880 INFO:tasks.rados.rados.0.smithi012.stdout:3459: finishing copy_from racing read to smithi01278544-2 2024-09-10T18:08:51.880 INFO:tasks.rados.rados.0.smithi012.stdout:3459: finishing copy_from to smithi01278544-2 2024-09-10T18:08:51.880 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2332 (ObjNum 33 snap 0 seq_num 3497705040) dirty exists 2024-09-10T18:08:51.880 INFO:tasks.rados.rados.0.smithi012.stdout:3462: finishing write tid 1 to smithi01278544-17 2024-09-10T18:08:51.880 INFO:tasks.rados.rados.0.smithi012.stdout:3462: finishing write tid 2 to smithi01278544-17 2024-09-10T18:08:51.880 INFO:tasks.rados.rados.0.smithi012.stdout:3462: finishing write tid 3 to smithi01278544-17 2024-09-10T18:08:51.880 INFO:tasks.rados.rados.0.smithi012.stdout:3463: seq_num 1077 ranges {13352960=442368,13795328=434176,14229504=368640} 2024-09-10T18:08:51.953 INFO:tasks.rados.rados.0.smithi012.stdout:3463: writing smithi01278544-11 from 13352960 to 13795328 tid 1 2024-09-10T18:08:51.956 INFO:tasks.rados.rados.0.smithi012.stdout:3463: writing smithi01278544-11 from 13795328 to 14229504 tid 2 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:3463: writing smithi01278544-11 from 14229504 to 14598144 tid 3 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:3458: done (4 left) 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:3459: done (3 left) 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:3460: done (2 left) 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:3464: rollback oid 36 current snap is 346 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 334 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:3462: finishing write tid 4 to smithi01278544-17 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:3462: finishing write tid 5 to smithi01278544-17 2024-09-10T18:08:51.959 INFO:tasks.rados.rados.0.smithi012.stdout:3462: oid 17 updating version 0 to 2040 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:3462: oid 17 version 2040 is already newer than 2038 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:3462: oid 17 version 2040 is already newer than 2039 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:3462: oid 17 version 2040 is already newer than 2037 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2040 (ObjNum 1076 snap 346 seq_num 1076) dirty exists 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:3462: left oid 17 (ObjNum 1076 snap 346 seq_num 1076) 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:3462: done (2 left) 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:3465: rollback oid 32 current snap is 346 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 32 to 338 2024-09-10T18:08:51.960 INFO:tasks.rados.rados.0.smithi012.stdout:3466: delete oid 47 current snap is 346 2024-09-10T18:08:51.961 INFO:tasks.rados.rados.0.smithi012.stdout:3464: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:08:51.962 INFO:tasks.rados.rados.0.smithi012.stdout:3466: done (3 left) 2024-09-10T18:08:51.962 INFO:tasks.rados.rados.0.smithi012.stdout:3467: delete oid 3 current snap is 346 2024-09-10T18:08:51.962 INFO:tasks.rados.rados.0.smithi012.stdout:3464: finishing rollback tid 2 to smithi01278544-36 2024-09-10T18:08:51.962 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 2037 (ObjNum 924 snap 296 seq_num 924) dirty exists 2024-09-10T18:08:51.963 INFO:tasks.rados.rados.0.smithi012.stdout:3465: finishing rollback tid 0 to smithi01278544-32 2024-09-10T18:08:51.964 INFO:tasks.rados.rados.0.smithi012.stdout:3465: finishing rollback tid 1 to smithi01278544-32 2024-09-10T18:08:51.964 INFO:tasks.rados.rados.0.smithi012.stdout:3465: finishing rollback tid 2 to smithi01278544-32 2024-09-10T18:08:51.964 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2053 (ObjNum 1004 snap 319 seq_num 1004) dirty exists 2024-09-10T18:08:51.965 INFO:tasks.rados.rados.0.smithi012.stdout:3464: done (3 left) 2024-09-10T18:08:51.965 INFO:tasks.rados.rados.0.smithi012.stdout:3465: done (2 left) 2024-09-10T18:08:51.965 INFO:tasks.rados.rados.0.smithi012.stdout:3467: done (1 left) 2024-09-10T18:08:51.965 INFO:tasks.rados.rados.0.smithi012.stdout:3468: rmattr oid 39 current snap is 346 2024-09-10T18:08:51.965 INFO:tasks.rados.rados.0.smithi012.stdout:3469: read oid 47 snap -1 2024-09-10T18:08:51.965 INFO:tasks.rados.rados.0.smithi012.stdout:3469: expect deleted 2024-09-10T18:08:51.965 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 346 2024-09-10T18:08:51.965 INFO:tasks.rados.rados.0.smithi012.stdout:3470: seq_num 1080 ranges {4481024=491520,4972544=540672,5513216=262144} 2024-09-10T18:08:51.992 INFO:tasks.rados.rados.0.smithi012.stdout:3470: writing smithi01278544-27 from 4481024 to 4972544 tid 1 2024-09-10T18:08:51.995 INFO:tasks.rados.rados.0.smithi012.stdout:3470: writing smithi01278544-27 from 4972544 to 5513216 tid 2 2024-09-10T18:08:51.997 INFO:tasks.rados.rados.0.smithi012.stdout:3470: writing smithi01278544-27 from 5513216 to 5775360 tid 3 2024-09-10T18:08:51.997 INFO:tasks.rados.rados.0.smithi012.stdout:3471: copy_from oid 30 from oid 20 current snap is 346 2024-09-10T18:08:51.997 INFO:tasks.rados.rados.0.smithi012.stdout:3463: finishing write tid 1 to smithi01278544-11 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3463: finishing write tid 2 to smithi01278544-11 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3463: finishing write tid 3 to smithi01278544-11 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3463: finishing write tid 4 to smithi01278544-11 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3469: done (4 left) 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3472: read oid 28 snap -1 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3472: expect (ObjNum 1059 snap 341 seq_num 1059) 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3473: read oid 36 snap -1 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3473: expect (ObjNum 924 snap 296 seq_num 924) 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3474: copy_from oid 43 from oid 4 current snap is 346 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3463: finishing write tid 5 to smithi01278544-11 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3463: oid 11 updating version 0 to 2530 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3463: oid 11 updating version 2530 to 2531 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3463: oid 11 version 2531 is already newer than 2528 2024-09-10T18:08:51.998 INFO:tasks.rados.rados.0.smithi012.stdout:3463: oid 11 version 2531 is already newer than 2529 2024-09-10T18:08:51.999 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2531 (ObjNum 1077 snap 346 seq_num 1077) dirty exists 2024-09-10T18:08:51.999 INFO:tasks.rados.rados.0.smithi012.stdout:3463: left oid 11 (ObjNum 1077 snap 346 seq_num 1077) 2024-09-10T18:08:51.999 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2533 (ObjNum 65 snap 0 seq_num 1618172515) dirty exists 2024-09-10T18:08:51.999 INFO:tasks.rados.rados.0.smithi012.stdout:3463: done (6 left) 2024-09-10T18:08:51.999 INFO:tasks.rados.rados.0.smithi012.stdout:3468: done (5 left) 2024-09-10T18:08:51.999 INFO:tasks.rados.rados.0.smithi012.stdout:3475: delete oid 32 current snap is 346 2024-09-10T18:08:51.999 INFO:tasks.rados.rados.0.smithi012.stdout:3470: finishing write tid 1 to smithi01278544-27 2024-09-10T18:08:52.000 INFO:tasks.rados.rados.0.smithi012.stdout:3470: finishing write tid 2 to smithi01278544-27 2024-09-10T18:08:52.004 INFO:tasks.rados.rados.0.smithi012.stdout:3470: finishing write tid 3 to smithi01278544-27 2024-09-10T18:08:52.004 INFO:tasks.rados.rados.0.smithi012.stdout:3470: finishing write tid 4 to smithi01278544-27 2024-09-10T18:08:52.006 INFO:tasks.rados.rados.0.smithi012.stdout:3475: done (5 left) 2024-09-10T18:08:52.006 INFO:tasks.rados.rados.0.smithi012.stdout:3476: snap_create 2024-09-10T18:08:52.007 INFO:tasks.rados.rados.0.smithi012.stdout:3470: finishing write tid 5 to smithi01278544-27 2024-09-10T18:08:52.007 INFO:tasks.rados.rados.0.smithi012.stdout:3470: oid 27 updating version 0 to 2509 2024-09-10T18:08:52.007 INFO:tasks.rados.rados.0.smithi012.stdout:3470: oid 27 updating version 2509 to 2510 2024-09-10T18:08:52.007 INFO:tasks.rados.rados.0.smithi012.stdout:3470: oid 27 version 2510 is already newer than 2507 2024-09-10T18:08:52.007 INFO:tasks.rados.rados.0.smithi012.stdout:3470: oid 27 version 2510 is already newer than 2508 2024-09-10T18:08:52.007 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 2510 (ObjNum 1080 snap 346 seq_num 1080) dirty exists 2024-09-10T18:08:52.008 INFO:tasks.rados.rados.0.smithi012.stdout:3470: left oid 27 (ObjNum 1080 snap 346 seq_num 1080) 2024-09-10T18:08:52.013 INFO:tasks.rados.rados.0.smithi012.stdout:3473: expect (ObjNum 924 snap 296 seq_num 924) 2024-09-10T18:08:52.085 INFO:tasks.rados.rados.0.smithi012.stdout:3472: expect (ObjNum 1059 snap 341 seq_num 1059) 2024-09-10T18:08:52.382 INFO:tasks.rados.rados.0.smithi012.stdout:3471: finishing copy_from racing read to smithi01278544-30 2024-09-10T18:08:52.382 INFO:tasks.rados.rados.0.smithi012.stdout:3471: finishing copy_from to smithi01278544-30 2024-09-10T18:08:52.382 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2434 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:08:52.382 INFO:tasks.rados.rados.0.smithi012.stdout:3474: finishing copy_from racing read to smithi01278544-43 2024-09-10T18:08:52.382 INFO:tasks.rados.rados.0.smithi012.stdout:3474: finishing copy_from to smithi01278544-43 2024-09-10T18:08:52.382 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2322 (ObjNum 1025 snap 328 seq_num 1025) dirty exists 2024-09-10T18:08:52.819 INFO:tasks.rados.rados.0.smithi012.stdout:3470: done (5 left) 2024-09-10T18:08:52.819 INFO:tasks.rados.rados.0.smithi012.stdout:3471: done (4 left) 2024-09-10T18:08:52.819 INFO:tasks.rados.rados.0.smithi012.stdout:3472: done (3 left) 2024-09-10T18:08:52.819 INFO:tasks.rados.rados.0.smithi012.stdout:3473: done (2 left) 2024-09-10T18:08:52.819 INFO:tasks.rados.rados.0.smithi012.stdout:3474: done (1 left) 2024-09-10T18:08:52.819 INFO:tasks.rados.rados.0.smithi012.stdout:3476: done (0 left) 2024-09-10T18:08:52.820 INFO:tasks.rados.rados.0.smithi012.stdout:3477: read oid 47 snap 335 2024-09-10T18:08:52.820 INFO:tasks.rados.rados.0.smithi012.stdout:3477: expect deleted 2024-09-10T18:08:52.820 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 347 2024-09-10T18:08:52.820 INFO:tasks.rados.rados.0.smithi012.stdout:3478: seq_num 1082 ranges {1966080=524288,2490368=704512,3194880=98304} 2024-09-10T18:08:52.833 INFO:tasks.rados.rados.0.smithi012.stdout:3478: writing smithi01278544-36 from 1966080 to 2490368 tid 1 2024-09-10T18:08:52.837 INFO:tasks.rados.rados.0.smithi012.stdout:3478: writing smithi01278544-36 from 2490368 to 3194880 tid 2 2024-09-10T18:08:52.840 INFO:tasks.rados.rados.0.smithi012.stdout:3478: writing smithi01278544-36 from 3194880 to 3293184 tid 3 2024-09-10T18:08:52.840 INFO:tasks.rados.rados.0.smithi012.stdout:3479: snap_remove snap 334 2024-09-10T18:08:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:52 smithi012 ceph-mon[89611]: pgmap v845: 121 pgs: 121 active+clean; 228 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-09-10T18:08:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:52 smithi012 ceph-mon[89611]: osdmap e773: 8 total, 8 up, 8 in 2024-09-10T18:08:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:52 smithi012 ceph-mon[89611]: osdmap e774: 8 total, 8 up, 8 in 2024-09-10T18:08:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:52 smithi012 ceph-mon[92029]: pgmap v845: 121 pgs: 121 active+clean; 228 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-09-10T18:08:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:52 smithi012 ceph-mon[92029]: osdmap e773: 8 total, 8 up, 8 in 2024-09-10T18:08:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:52 smithi012 ceph-mon[92029]: osdmap e774: 8 total, 8 up, 8 in 2024-09-10T18:08:53.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:52 smithi089 ceph-mon[84132]: pgmap v845: 121 pgs: 121 active+clean; 228 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2024-09-10T18:08:53.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:52 smithi089 ceph-mon[84132]: osdmap e773: 8 total, 8 up, 8 in 2024-09-10T18:08:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:52 smithi089 ceph-mon[84132]: osdmap e774: 8 total, 8 up, 8 in 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3479: done (2 left) 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3480: delete oid 3 current snap is 347 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: finishing write tid 1 to smithi01278544-36 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: finishing write tid 2 to smithi01278544-36 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: finishing write tid 3 to smithi01278544-36 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: finishing write tid 4 to smithi01278544-36 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: finishing write tid 5 to smithi01278544-36 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: oid 36 updating version 0 to 2039 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: oid 36 updating version 2039 to 2040 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: oid 36 version 2040 is already newer than 2038 2024-09-10T18:08:53.844 INFO:tasks.rados.rados.0.smithi012.stdout:3478: oid 36 updating version 2040 to 2041 2024-09-10T18:08:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 2041 (ObjNum 1082 snap 347 seq_num 1082) dirty exists 2024-09-10T18:08:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:3478: left oid 36 (ObjNum 1082 snap 347 seq_num 1082) 2024-09-10T18:08:53.854 INFO:tasks.rados.rados.0.smithi012.stdout:3477: done (2 left) 2024-09-10T18:08:53.854 INFO:tasks.rados.rados.0.smithi012.stdout:3478: done (1 left) 2024-09-10T18:08:53.854 INFO:tasks.rados.rados.0.smithi012.stdout:3480: done (0 left) 2024-09-10T18:08:53.854 INFO:tasks.rados.rados.0.smithi012.stdout:3481: setattr oid 47 current snap is 347 2024-09-10T18:08:53.859 INFO:tasks.rados.rados.0.smithi012.stdout:3482: read oid 49 snap -1 2024-09-10T18:08:53.859 INFO:tasks.rados.rados.0.smithi012.stdout:3482: expect deleted 2024-09-10T18:08:53.859 INFO:tasks.rados.rados.0.smithi012.stdout:3483: copy_from oid 8 from oid 22 current snap is 347 2024-09-10T18:08:53.859 INFO:tasks.rados.rados.0.smithi012.stdout:3484: read oid 14 snap -1 2024-09-10T18:08:53.859 INFO:tasks.rados.rados.0.smithi012.stdout:3484: expect deleted 2024-09-10T18:08:53.859 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 23 current snap is 347 2024-09-10T18:08:53.860 INFO:tasks.rados.rados.0.smithi012.stdout:3485: seq_num 1084 ranges {1638400=557056,2195456=475136,2670592=327680} 2024-09-10T18:08:53.872 INFO:tasks.rados.rados.0.smithi012.stdout:3485: writing smithi01278544-23 from 1638400 to 2195456 tid 1 2024-09-10T18:08:53.875 INFO:tasks.rados.rados.0.smithi012.stdout:3485: writing smithi01278544-23 from 2195456 to 2670592 tid 2 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:3485: writing smithi01278544-23 from 2670592 to 2998272 tid 3 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:3486: read oid 38 snap -1 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:3486: expect (ObjNum 1032 snap 332 seq_num 1032) 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 2366 (ObjNum 33 snap 0 seq_num 3496553280) dirty exists 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:3483: finishing copy_from racing read to smithi01278544-8 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:3483: finishing copy_from to smithi01278544-8 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 2472 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:3481: done (5 left) 2024-09-10T18:08:53.878 INFO:tasks.rados.rados.0.smithi012.stdout:3482: done (4 left) 2024-09-10T18:08:53.879 INFO:tasks.rados.rados.0.smithi012.stdout:3483: done (3 left) 2024-09-10T18:08:53.879 INFO:tasks.rados.rados.0.smithi012.stdout:3484: done (2 left) 2024-09-10T18:08:53.879 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 39 current snap is 347 2024-09-10T18:08:53.879 INFO:tasks.rados.rados.0.smithi012.stdout:3487: seq_num 1085 ranges {0=581632,581632=761856,1343488=40960} 2024-09-10T18:08:53.881 INFO:tasks.rados.rados.0.smithi012.stdout:3487: writing smithi01278544-39 from 0 to 581632 tid 1 2024-09-10T18:08:53.886 INFO:tasks.rados.rados.0.smithi012.stdout:3487: writing smithi01278544-39 from 581632 to 1343488 tid 2 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3487: writing smithi01278544-39 from 1343488 to 1384448 tid 3 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3488: rollback oid 20 current snap is 347 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 339 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3485: finishing write tid 1 to smithi01278544-23 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3485: finishing write tid 2 to smithi01278544-23 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3485: finishing write tid 3 to smithi01278544-23 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3489: read oid 33 snap -1 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3489: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 6 current snap is 347 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3487: finishing write tid 1 to smithi01278544-39 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3485: finishing write tid 4 to smithi01278544-23 2024-09-10T18:08:53.888 INFO:tasks.rados.rados.0.smithi012.stdout:3490: seq_num 1086 ranges {2334720=598016,2932736=647168,3579904=155648} 2024-09-10T18:08:53.903 INFO:tasks.rados.rados.0.smithi012.stdout:3490: writing smithi01278544-6 from 2334720 to 2932736 tid 1 2024-09-10T18:08:53.907 INFO:tasks.rados.rados.0.smithi012.stdout:3490: writing smithi01278544-6 from 2932736 to 3579904 tid 2 2024-09-10T18:08:53.908 INFO:tasks.rados.rados.0.smithi012.stdout:3490: writing smithi01278544-6 from 3579904 to 3735552 tid 3 2024-09-10T18:08:53.908 INFO:tasks.rados.rados.0.smithi012.stdout:3491: delete oid 7 current snap is 347 2024-09-10T18:08:53.908 INFO:tasks.rados.rados.0.smithi012.stdout:3486: expect (ObjNum 1032 snap 332 seq_num 1032) 2024-09-10T18:08:54.036 INFO:tasks.rados.rados.0.smithi012.stdout:3489: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:08:54.042 INFO:tasks.rados.rados.0.smithi012.stdout:3485: finishing write tid 5 to smithi01278544-23 2024-09-10T18:08:54.042 INFO:tasks.rados.rados.0.smithi012.stdout:3485: oid 23 updating version 0 to 2317 2024-09-10T18:08:54.042 INFO:tasks.rados.rados.0.smithi012.stdout:3485: oid 23 version 2317 is already newer than 2314 2024-09-10T18:08:54.042 INFO:tasks.rados.rados.0.smithi012.stdout:3485: oid 23 version 2317 is already newer than 2316 2024-09-10T18:08:54.042 INFO:tasks.rados.rados.0.smithi012.stdout:3485: oid 23 version 2317 is already newer than 2315 2024-09-10T18:08:54.042 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 2317 (ObjNum 1084 snap 347 seq_num 1084) dirty exists 2024-09-10T18:08:54.042 INFO:tasks.rados.rados.0.smithi012.stdout:3485: left oid 23 (ObjNum 1084 snap 347 seq_num 1084) 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3487: finishing write tid 2 to smithi01278544-39 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3487: finishing write tid 3 to smithi01278544-39 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3487: finishing write tid 4 to smithi01278544-39 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3488: finishing rollback tid 0 to smithi01278544-20 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3485: done (6 left) 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3486: done (5 left) 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3489: done (4 left) 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3491: done (3 left) 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3492: rollback oid 36 current snap is 347 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 36 to 341 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3488: finishing rollback tid 1 to smithi01278544-20 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3487: finishing write tid 5 to smithi01278544-39 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3487: oid 39 updating version 0 to 2548 2024-09-10T18:08:54.043 INFO:tasks.rados.rados.0.smithi012.stdout:3487: oid 39 updating version 2548 to 2549 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3487: oid 39 updating version 2549 to 2550 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3487: oid 39 version 2550 is already newer than 2547 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2550 (ObjNum 1085 snap 347 seq_num 1085) dirty exists 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3487: left oid 39 (ObjNum 1085 snap 347 seq_num 1085) 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3488: finishing rollback tid 2 to smithi01278544-20 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2554 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3490: finishing write tid 1 to smithi01278544-6 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3490: finishing write tid 2 to smithi01278544-6 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3490: finishing write tid 3 to smithi01278544-6 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3487: done (3 left) 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3488: done (2 left) 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3493: setattr oid 2 current snap is 347 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3490: finishing write tid 4 to smithi01278544-6 2024-09-10T18:08:54.044 INFO:tasks.rados.rados.0.smithi012.stdout:3490: finishing write tid 5 to smithi01278544-6 2024-09-10T18:08:54.045 INFO:tasks.rados.rados.0.smithi012.stdout:3490: oid 6 updating version 0 to 2476 2024-09-10T18:08:54.045 INFO:tasks.rados.rados.0.smithi012.stdout:3490: oid 6 version 2476 is already newer than 2475 2024-09-10T18:08:54.045 INFO:tasks.rados.rados.0.smithi012.stdout:3490: oid 6 version 2476 is already newer than 2473 2024-09-10T18:08:54.045 INFO:tasks.rados.rados.0.smithi012.stdout:3490: oid 6 version 2476 is already newer than 2474 2024-09-10T18:08:54.045 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 2476 (ObjNum 1086 snap 347 seq_num 1086) dirty exists 2024-09-10T18:08:54.045 INFO:tasks.rados.rados.0.smithi012.stdout:3490: left oid 6 (ObjNum 1086 snap 347 seq_num 1086) 2024-09-10T18:08:54.046 INFO:tasks.rados.rados.0.smithi012.stdout:3490: done (2 left) 2024-09-10T18:08:54.046 INFO:tasks.rados.rados.0.smithi012.stdout:3494: read oid 21 snap -1 2024-09-10T18:08:54.046 INFO:tasks.rados.rados.0.smithi012.stdout:3494: expect (ObjNum 1017 snap 324 seq_num 1017) 2024-09-10T18:08:54.046 INFO:tasks.rados.rados.0.smithi012.stdout:3495: read oid 20 snap -1 2024-09-10T18:08:54.046 INFO:tasks.rados.rados.0.smithi012.stdout:3495: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:08:54.046 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 347 2024-09-10T18:08:54.046 INFO:tasks.rados.rados.0.smithi012.stdout:3496: seq_num 1088 ranges {1269760=630784,1900544=466944,2367488=335872} 2024-09-10T18:08:54.053 INFO:tasks.rados.rados.0.smithi012.stdout:3496: writing smithi01278544-50 from 1269760 to 1900544 tid 1 2024-09-10T18:08:54.056 INFO:tasks.rados.rados.0.smithi012.stdout:3496: writing smithi01278544-50 from 1900544 to 2367488 tid 2 2024-09-10T18:08:54.058 INFO:tasks.rados.rados.0.smithi012.stdout:3496: writing smithi01278544-50 from 2367488 to 2703360 tid 3 2024-09-10T18:08:54.058 INFO:tasks.rados.rados.0.smithi012.stdout:3492: finishing rollback tid 0 to smithi01278544-36 2024-09-10T18:08:54.058 INFO:tasks.rados.rados.0.smithi012.stdout:3492: finishing rollback tid 1 to smithi01278544-36 2024-09-10T18:08:54.058 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 2043 (ObjNum -1094738720 snap 32708 seq_num 304) dirty dne 2024-09-10T18:08:54.058 INFO:tasks.rados.rados.0.smithi012.stdout:3494: expect (ObjNum 1017 snap 324 seq_num 1017) 2024-09-10T18:08:54.067 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2333 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:08:54.067 INFO:tasks.rados.rados.0.smithi012.stdout:3496: finishing write tid 1 to smithi01278544-50 2024-09-10T18:08:54.067 INFO:tasks.rados.rados.0.smithi012.stdout:3496: finishing write tid 2 to smithi01278544-50 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3496: finishing write tid 3 to smithi01278544-50 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3496: finishing write tid 4 to smithi01278544-50 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3496: finishing write tid 5 to smithi01278544-50 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3496: oid 50 updating version 0 to 2050 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3496: oid 50 updating version 2050 to 2051 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3496: oid 50 version 2051 is already newer than 2049 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3496: oid 50 updating version 2051 to 2052 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2052 (ObjNum 1088 snap 347 seq_num 1088) dirty exists 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3496: left oid 50 (ObjNum 1088 snap 347 seq_num 1088) 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3497: read oid 17 snap -1 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3497: expect (ObjNum 1076 snap 346 seq_num 1076) 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3492: done (5 left) 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3493: done (4 left) 2024-09-10T18:08:54.068 INFO:tasks.rados.rados.0.smithi012.stdout:3494: done (3 left) 2024-09-10T18:08:54.069 INFO:tasks.rados.rados.0.smithi012.stdout:3496: done (2 left) 2024-09-10T18:08:54.069 INFO:tasks.rados.rados.0.smithi012.stdout:3498: snap_create 2024-09-10T18:08:54.069 INFO:tasks.rados.rados.0.smithi012.stdout:3495: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:08:54.304 INFO:tasks.rados.rados.0.smithi012.stdout:3497: expect (ObjNum 1076 snap 346 seq_num 1076) 2024-09-10T18:08:54.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:08:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:08:54] "GET /metrics HTTP/1.1" 200 36356 "" "Prometheus/2.51.0" 2024-09-10T18:08:54.841 INFO:tasks.rados.rados.0.smithi012.stdout:3495: done (2 left) 2024-09-10T18:08:54.841 INFO:tasks.rados.rados.0.smithi012.stdout:3497: done (1 left) 2024-09-10T18:08:54.841 INFO:tasks.rados.rados.0.smithi012.stdout:3498: done (0 left) 2024-09-10T18:08:54.841 INFO:tasks.rados.rados.0.smithi012.stdout:3499: snap_create 2024-09-10T18:08:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:54 smithi012 ceph-mon[89611]: pgmap v848: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2024-09-10T18:08:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:54 smithi012 ceph-mon[89611]: osdmap e775: 8 total, 8 up, 8 in 2024-09-10T18:08:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:54 smithi012 ceph-mon[92029]: pgmap v848: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2024-09-10T18:08:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:54 smithi012 ceph-mon[92029]: osdmap e775: 8 total, 8 up, 8 in 2024-09-10T18:08:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:54 smithi089 ceph-mon[84132]: pgmap v848: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2024-09-10T18:08:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:54 smithi089 ceph-mon[84132]: osdmap e775: 8 total, 8 up, 8 in 2024-09-10T18:08:55.841 INFO:tasks.rados.rados.0.smithi012.stdout:3499: done (0 left) 2024-09-10T18:08:55.841 INFO:tasks.rados.rados.0.smithi012.stdout:3500: snap_remove snap 337 2024-09-10T18:08:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:55 smithi012 ceph-mon[89611]: osdmap e776: 8 total, 8 up, 8 in 2024-09-10T18:08:56.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:55 smithi012 ceph-mon[89611]: pgmap v851: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 35 op/s 2024-09-10T18:08:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:55 smithi012 ceph-mon[92029]: osdmap e776: 8 total, 8 up, 8 in 2024-09-10T18:08:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:55 smithi012 ceph-mon[92029]: pgmap v851: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 35 op/s 2024-09-10T18:08:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:55 smithi089 ceph-mon[84132]: osdmap e776: 8 total, 8 up, 8 in 2024-09-10T18:08:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:55 smithi089 ceph-mon[84132]: pgmap v851: 121 pgs: 121 active+clean; 222 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 35 op/s 2024-09-10T18:08:56.847 INFO:tasks.rados.rados.0.smithi012.stdout:3500: done (0 left) 2024-09-10T18:08:56.847 INFO:tasks.rados.rados.0.smithi012.stdout:3501: rmattr oid 50 current snap is 349 2024-09-10T18:08:56.848 INFO:tasks.rados.rados.0.smithi012.stdout:3501: done (0 left) 2024-09-10T18:08:56.848 INFO:tasks.rados.rados.0.smithi012.stdout:3502: read oid 21 snap 335 2024-09-10T18:08:56.848 INFO:tasks.rados.rados.0.smithi012.stdout:3502: expect (ObjNum 1017 snap 324 seq_num 1017) 2024-09-10T18:08:56.848 INFO:tasks.rados.rados.0.smithi012.stdout:3503: read oid 37 snap -1 2024-09-10T18:08:56.848 INFO:tasks.rados.rados.0.smithi012.stdout:3503: expect deleted 2024-09-10T18:08:56.848 INFO:tasks.rados.rados.0.smithi012.stdout:3504: rollback oid 26 current snap is 349 2024-09-10T18:08:56.848 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 26 to 327 2024-09-10T18:08:56.849 INFO:tasks.rados.rados.0.smithi012.stdout:3505: delete oid 47 current snap is 349 2024-09-10T18:08:56.855 INFO:tasks.rados.rados.0.smithi012.stdout:3504: finishing rollback tid 0 to smithi01278544-26 2024-09-10T18:08:56.856 INFO:tasks.rados.rados.0.smithi012.stdout:3504: finishing rollback tid 1 to smithi01278544-26 2024-09-10T18:08:56.856 INFO:tasks.rados.rados.0.smithi012.stdout:3504: finishing rollback tid 2 to smithi01278544-26 2024-09-10T18:08:56.857 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2046 (ObjNum 903 snap 294 seq_num 903) dirty exists 2024-09-10T18:08:56.861 INFO:tasks.rados.rados.0.smithi012.stdout:3502: expect (ObjNum 1017 snap 324 seq_num 1017) 2024-09-10T18:08:56.870 INFO:tasks.rados.rados.0.smithi012.stdout:3502: done (3 left) 2024-09-10T18:08:56.870 INFO:tasks.rados.rados.0.smithi012.stdout:3503: done (2 left) 2024-09-10T18:08:56.870 INFO:tasks.rados.rados.0.smithi012.stdout:3504: done (1 left) 2024-09-10T18:08:56.871 INFO:tasks.rados.rados.0.smithi012.stdout:3505: done (0 left) 2024-09-10T18:08:56.871 INFO:tasks.rados.rados.0.smithi012.stdout:3506: setattr oid 14 current snap is 349 2024-09-10T18:08:56.872 INFO:tasks.rados.rados.0.smithi012.stdout:3507: rollback oid 7 current snap is 349 2024-09-10T18:08:56.872 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 7 to 348 2024-09-10T18:08:56.872 INFO:tasks.rados.rados.0.smithi012.stdout:3508: snap_remove snap 346 2024-09-10T18:08:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:56 smithi012 ceph-mon[89611]: osdmap e777: 8 total, 8 up, 8 in 2024-09-10T18:08:57.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:56 smithi012 ceph-mon[92029]: osdmap e777: 8 total, 8 up, 8 in 2024-09-10T18:08:57.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:56 smithi089 ceph-mon[84132]: osdmap e777: 8 total, 8 up, 8 in 2024-09-10T18:08:57.819 INFO:tasks.rados.rados.0.smithi012.stdout:3508: done (2 left) 2024-09-10T18:08:57.819 INFO:tasks.rados.rados.0.smithi012.stdout:3509: read oid 39 snap -1 2024-09-10T18:08:57.819 INFO:tasks.rados.rados.0.smithi012.stdout:3509: expect (ObjNum 1085 snap 347 seq_num 1085) 2024-09-10T18:08:57.819 INFO:tasks.rados.rados.0.smithi012.stdout:3510: copy_from oid 15 from oid 41 current snap is 349 2024-09-10T18:08:57.819 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 349 2024-09-10T18:08:57.819 INFO:tasks.rados.rados.0.smithi012.stdout:3511: seq_num 1090 ranges {237568=663552,901120=630784,1531904=172032} 2024-09-10T18:08:57.825 INFO:tasks.rados.rados.0.smithi012.stdout:3511: writing smithi01278544-21 from 237568 to 901120 tid 1 2024-09-10T18:08:57.829 INFO:tasks.rados.rados.0.smithi012.stdout:3511: writing smithi01278544-21 from 901120 to 1531904 tid 2 2024-09-10T18:08:57.830 INFO:tasks.rados.rados.0.smithi012.stdout:3511: writing smithi01278544-21 from 1531904 to 1703936 tid 3 2024-09-10T18:08:57.830 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 349 2024-09-10T18:08:57.830 INFO:tasks.rados.rados.0.smithi012.stdout:3512: seq_num 1091 ranges {2637824=679936,3317760=516096,3833856=286720} 2024-09-10T18:08:57.849 INFO:tasks.rados.rados.0.smithi012.stdout:3512: writing smithi01278544-45 from 2637824 to 3317760 tid 1 2024-09-10T18:08:57.852 INFO:tasks.rados.rados.0.smithi012.stdout:3512: writing smithi01278544-45 from 3317760 to 3833856 tid 2 2024-09-10T18:08:57.854 INFO:tasks.rados.rados.0.smithi012.stdout:3512: writing smithi01278544-45 from 3833856 to 4120576 tid 3 2024-09-10T18:08:57.854 INFO:tasks.rados.rados.0.smithi012.stdout:3513: rollback oid 30 current snap is 349 2024-09-10T18:08:57.854 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 348 2024-09-10T18:08:57.855 INFO:tasks.rados.rados.0.smithi012.stdout:3507: finishing rollback tid 1 to smithi01278544-7 2024-09-10T18:08:57.855 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1132 (ObjNum 113 snap 0 seq_num 3496901040) dirty dne 2024-09-10T18:08:57.855 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 2377 (ObjNum 33 snap 0 seq_num 3497084096) dirty exists 2024-09-10T18:08:57.855 INFO:tasks.rados.rados.0.smithi012.stdout:3511: finishing write tid 1 to smithi01278544-21 2024-09-10T18:08:57.855 INFO:tasks.rados.rados.0.smithi012.stdout:3511: finishing write tid 2 to smithi01278544-21 2024-09-10T18:08:57.855 INFO:tasks.rados.rados.0.smithi012.stdout:3511: finishing write tid 3 to smithi01278544-21 2024-09-10T18:08:57.855 INFO:tasks.rados.rados.0.smithi012.stdout:3509: expect (ObjNum 1085 snap 347 seq_num 1085) 2024-09-10T18:08:57.897 INFO:tasks.rados.rados.0.smithi012.stdout:3511: finishing write tid 4 to smithi01278544-21 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3511: finishing write tid 5 to smithi01278544-21 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3511: oid 21 updating version 0 to 2318 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3511: oid 21 updating version 2318 to 2320 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3511: oid 21 updating version 2320 to 2321 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3511: oid 21 version 2321 is already newer than 2319 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 2321 (ObjNum 1090 snap 349 seq_num 1090) dirty exists 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3511: left oid 21 (ObjNum 1090 snap 349 seq_num 1090) 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3512: finishing write tid 1 to smithi01278544-45 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3512: finishing write tid 2 to smithi01278544-45 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3512: finishing write tid 3 to smithi01278544-45 2024-09-10T18:08:57.898 INFO:tasks.rados.rados.0.smithi012.stdout:3506: done (6 left) 2024-09-10T18:08:57.899 INFO:tasks.rados.rados.0.smithi012.stdout:3507: done (5 left) 2024-09-10T18:08:57.899 INFO:tasks.rados.rados.0.smithi012.stdout:3509: done (4 left) 2024-09-10T18:08:57.899 INFO:tasks.rados.rados.0.smithi012.stdout:3511: done (3 left) 2024-09-10T18:08:57.899 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 349 2024-09-10T18:08:57.899 INFO:tasks.rados.rados.0.smithi012.stdout:3512: finishing write tid 4 to smithi01278544-45 2024-09-10T18:08:57.899 INFO:tasks.rados.rados.0.smithi012.stdout:3514: seq_num 1092 ranges {0=696320,696320=802816} 2024-09-10T18:08:57.901 INFO:tasks.rados.rados.0.smithi012.stdout:3514: writing smithi01278544-7 from 0 to 696320 tid 1 2024-09-10T18:08:57.906 INFO:tasks.rados.rados.0.smithi012.stdout:3514: writing smithi01278544-7 from 696320 to 1499136 tid 2 2024-09-10T18:08:57.906 INFO:tasks.rados.rados.0.smithi012.stdout:3515: read oid 20 snap 348 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3515: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3516: copy_from oid 2 from oid 13 current snap is 349 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3513: finishing rollback tid 0 to smithi01278544-30 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3513: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3513: finishing rollback tid 2 to smithi01278544-30 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2437 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3512: finishing write tid 5 to smithi01278544-45 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3512: oid 45 updating version 0 to 2381 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3512: oid 45 version 2381 is already newer than 2380 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3512: oid 45 version 2381 is already newer than 2379 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3512: oid 45 updating version 2381 to 2382 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2382 (ObjNum 1091 snap 349 seq_num 1091) dirty exists 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3512: left oid 45 (ObjNum 1091 snap 349 seq_num 1091) 2024-09-10T18:08:57.907 INFO:tasks.rados.rados.0.smithi012.stdout:3510: finishing copy_from racing read to smithi01278544-15 2024-09-10T18:08:57.908 INFO:tasks.rados.rados.0.smithi012.stdout:3510: finishing copy_from to smithi01278544-15 2024-09-10T18:08:57.908 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2318 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:08:57.908 INFO:tasks.rados.rados.0.smithi012.stdout:3514: finishing write tid 1 to smithi01278544-7 2024-09-10T18:08:57.908 INFO:tasks.rados.rados.0.smithi012.stdout:3510: done (5 left) 2024-09-10T18:08:57.908 INFO:tasks.rados.rados.0.smithi012.stdout:3512: done (4 left) 2024-09-10T18:08:57.908 INFO:tasks.rados.rados.0.smithi012.stdout:3513: done (3 left) 2024-09-10T18:08:57.908 INFO:tasks.rados.rados.0.smithi012.stdout:3517: snap_create 2024-09-10T18:08:57.912 INFO:tasks.rados.rados.0.smithi012.stdout:3514: finishing write tid 2 to smithi01278544-7 2024-09-10T18:08:57.912 INFO:tasks.rados.rados.0.smithi012.stdout:3514: finishing write tid 3 to smithi01278544-7 2024-09-10T18:08:57.912 INFO:tasks.rados.rados.0.smithi012.stdout:3514: finishing write tid 4 to smithi01278544-7 2024-09-10T18:08:57.912 INFO:tasks.rados.rados.0.smithi012.stdout:3514: oid 7 updating version 0 to 1133 2024-09-10T18:08:57.913 INFO:tasks.rados.rados.0.smithi012.stdout:3514: oid 7 updating version 1133 to 1134 2024-09-10T18:08:57.913 INFO:tasks.rados.rados.0.smithi012.stdout:3514: oid 7 updating version 1134 to 1135 2024-09-10T18:08:57.913 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 1135 (ObjNum 1092 snap 349 seq_num 1092) dirty exists 2024-09-10T18:08:57.913 INFO:tasks.rados.rados.0.smithi012.stdout:3514: left oid 7 (ObjNum 1092 snap 349 seq_num 1092) 2024-09-10T18:08:57.932 INFO:tasks.rados.rados.0.smithi012.stdout:3515: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:08:58.168 INFO:tasks.rados.rados.0.smithi012.stdout:3516: finishing copy_from racing read to smithi01278544-2 2024-09-10T18:08:58.169 INFO:tasks.rados.rados.0.smithi012.stdout:3516: finishing copy_from to smithi01278544-2 2024-09-10T18:08:58.169 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2309 (ObjNum 1031 snap 331 seq_num 1031) dirty exists 2024-09-10T18:08:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:57 smithi012 ceph-mon[89611]: osdmap e778: 8 total, 8 up, 8 in 2024-09-10T18:08:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:57 smithi012 ceph-mon[89611]: pgmap v854: 121 pgs: 121 active+clean; 244 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 6.0 MiB/s wr, 31 op/s 2024-09-10T18:08:58.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:57 smithi012 ceph-mon[89611]: osdmap e779: 8 total, 8 up, 8 in 2024-09-10T18:08:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:57 smithi012 ceph-mon[92029]: osdmap e778: 8 total, 8 up, 8 in 2024-09-10T18:08:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:57 smithi012 ceph-mon[92029]: pgmap v854: 121 pgs: 121 active+clean; 244 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 6.0 MiB/s wr, 31 op/s 2024-09-10T18:08:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:57 smithi012 ceph-mon[92029]: osdmap e779: 8 total, 8 up, 8 in 2024-09-10T18:08:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:57 smithi089 ceph-mon[84132]: osdmap e778: 8 total, 8 up, 8 in 2024-09-10T18:08:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:57 smithi089 ceph-mon[84132]: pgmap v854: 121 pgs: 121 active+clean; 244 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 6.0 MiB/s wr, 31 op/s 2024-09-10T18:08:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:57 smithi089 ceph-mon[84132]: osdmap e779: 8 total, 8 up, 8 in 2024-09-10T18:08:58.863 INFO:tasks.rados.rados.0.smithi012.stdout:3514: done (3 left) 2024-09-10T18:08:58.863 INFO:tasks.rados.rados.0.smithi012.stdout:3515: done (2 left) 2024-09-10T18:08:58.863 INFO:tasks.rados.rados.0.smithi012.stdout:3516: done (1 left) 2024-09-10T18:08:58.863 INFO:tasks.rados.rados.0.smithi012.stdout:3517: done (0 left) 2024-09-10T18:08:58.864 INFO:tasks.rados.rados.0.smithi012.stdout:3518: setattr oid 45 current snap is 350 2024-09-10T18:08:58.864 INFO:tasks.rados.rados.0.smithi012.stdout:3519: copy_from oid 23 from oid 3 current snap is 350 2024-09-10T18:08:58.865 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 350 2024-09-10T18:08:58.865 INFO:tasks.rados.rados.0.smithi012.stdout:3520: seq_num 1093 ranges {3457024=712704,4169728=688128,4857856=114688} 2024-09-10T18:08:58.887 INFO:tasks.rados.rados.0.smithi012.stdout:3520: writing smithi01278544-26 from 3457024 to 4169728 tid 1 2024-09-10T18:08:58.891 INFO:tasks.rados.rados.0.smithi012.stdout:3520: writing smithi01278544-26 from 4169728 to 4857856 tid 2 2024-09-10T18:08:58.892 INFO:tasks.rados.rados.0.smithi012.stdout:3520: writing smithi01278544-26 from 4857856 to 4972544 tid 3 2024-09-10T18:08:58.892 INFO:tasks.rados.rados.0.smithi012.stdout:3521: snap_create 2024-09-10T18:08:58.892 INFO:tasks.rados.rados.0.smithi012.stdout:3519: finishing copy_from to smithi01278544-23 2024-09-10T18:08:58.892 INFO:tasks.rados.rados.0.smithi012.stdout:3519: got expected ENOENT (src dne) 2024-09-10T18:08:58.892 INFO:tasks.rados.rados.0.smithi012.stdout:3519: finishing copy_from racing read to smithi01278544-23 2024-09-10T18:08:58.892 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2384 (ObjNum 1091 snap 349 seq_num 1091) dirty exists 2024-09-10T18:08:58.896 INFO:tasks.rados.rados.0.smithi012.stdout:3520: finishing write tid 1 to smithi01278544-26 2024-09-10T18:08:58.896 INFO:tasks.rados.rados.0.smithi012.stdout:3520: finishing write tid 2 to smithi01278544-26 2024-09-10T18:08:58.897 INFO:tasks.rados.rados.0.smithi012.stdout:3520: finishing write tid 3 to smithi01278544-26 2024-09-10T18:08:58.897 INFO:tasks.rados.rados.0.smithi012.stdout:3520: finishing write tid 4 to smithi01278544-26 2024-09-10T18:08:58.899 INFO:tasks.rados.rados.0.smithi012.stdout:3520: finishing write tid 5 to smithi01278544-26 2024-09-10T18:08:58.899 INFO:tasks.rados.rados.0.smithi012.stdout:3520: oid 26 updating version 0 to 2049 2024-09-10T18:08:58.899 INFO:tasks.rados.rados.0.smithi012.stdout:3520: oid 26 version 2049 is already newer than 2048 2024-09-10T18:08:58.900 INFO:tasks.rados.rados.0.smithi012.stdout:3520: oid 26 updating version 2049 to 2050 2024-09-10T18:08:58.900 INFO:tasks.rados.rados.0.smithi012.stdout:3520: oid 26 version 2050 is already newer than 2047 2024-09-10T18:08:58.900 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2050 (ObjNum 1093 snap 350 seq_num 1093) dirty exists 2024-09-10T18:08:58.900 INFO:tasks.rados.rados.0.smithi012.stdout:3520: left oid 26 (ObjNum 1093 snap 350 seq_num 1093) 2024-09-10T18:08:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:3518: done (3 left) 2024-09-10T18:08:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:3519: done (2 left) 2024-09-10T18:08:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:3520: done (1 left) 2024-09-10T18:08:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:3521: done (0 left) 2024-09-10T18:08:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:3522: copy_from oid 47 from oid 22 current snap is 351 2024-09-10T18:08:59.869 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 351 2024-09-10T18:08:59.870 INFO:tasks.rados.rados.0.smithi012.stdout:3523: seq_num 1094 ranges {0=729088,729088=573440,1302528=229376} 2024-09-10T18:08:59.873 INFO:tasks.rados.rados.0.smithi012.stdout:3523: writing smithi01278544-49 from 0 to 729088 tid 1 2024-09-10T18:08:59.876 INFO:tasks.rados.rados.0.smithi012.stdout:3523: writing smithi01278544-49 from 729088 to 1302528 tid 2 2024-09-10T18:08:59.878 INFO:tasks.rados.rados.0.smithi012.stdout:3523: writing smithi01278544-49 from 1302528 to 1531904 tid 3 2024-09-10T18:08:59.878 INFO:tasks.rados.rados.0.smithi012.stdout:3524: snap_remove snap 335 2024-09-10T18:09:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:59 smithi012 ceph-mon[89611]: osdmap e780: 8 total, 8 up, 8 in 2024-09-10T18:09:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:08:59 smithi012 ceph-mon[89611]: pgmap v857: 121 pgs: 121 active+clean; 244 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.4 MiB/s wr, 23 op/s 2024-09-10T18:09:00.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:59 smithi012 ceph-mon[92029]: osdmap e780: 8 total, 8 up, 8 in 2024-09-10T18:09:00.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:08:59 smithi012 ceph-mon[92029]: pgmap v857: 121 pgs: 121 active+clean; 244 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.4 MiB/s wr, 23 op/s 2024-09-10T18:09:00.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:59 smithi089 ceph-mon[84132]: osdmap e780: 8 total, 8 up, 8 in 2024-09-10T18:09:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:08:59 smithi089 ceph-mon[84132]: pgmap v857: 121 pgs: 121 active+clean; 244 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 5.4 MiB/s wr, 23 op/s 2024-09-10T18:09:00.880 INFO:tasks.rados.rados.0.smithi012.stdout:3522: finishing copy_from racing read to smithi01278544-47 2024-09-10T18:09:00.880 INFO:tasks.rados.rados.0.smithi012.stdout:3522: finishing copy_from to smithi01278544-47 2024-09-10T18:09:00.880 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 2472 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:09:00.880 INFO:tasks.rados.rados.0.smithi012.stdout:3523: finishing write tid 1 to smithi01278544-49 2024-09-10T18:09:00.881 INFO:tasks.rados.rados.0.smithi012.stdout:3523: finishing write tid 2 to smithi01278544-49 2024-09-10T18:09:00.881 INFO:tasks.rados.rados.0.smithi012.stdout:3523: finishing write tid 3 to smithi01278544-49 2024-09-10T18:09:00.881 INFO:tasks.rados.rados.0.smithi012.stdout:3523: finishing write tid 4 to smithi01278544-49 2024-09-10T18:09:00.881 INFO:tasks.rados.rados.0.smithi012.stdout:3523: finishing write tid 5 to smithi01278544-49 2024-09-10T18:09:00.881 INFO:tasks.rados.rados.0.smithi012.stdout:3523: oid 49 updating version 0 to 2336 2024-09-10T18:09:00.882 INFO:tasks.rados.rados.0.smithi012.stdout:3523: oid 49 version 2336 is already newer than 2335 2024-09-10T18:09:00.882 INFO:tasks.rados.rados.0.smithi012.stdout:3523: oid 49 updating version 2336 to 2337 2024-09-10T18:09:00.882 INFO:tasks.rados.rados.0.smithi012.stdout:3523: oid 49 version 2337 is already newer than 2334 2024-09-10T18:09:00.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 2337 (ObjNum 1094 snap 351 seq_num 1094) dirty exists 2024-09-10T18:09:00.882 INFO:tasks.rados.rados.0.smithi012.stdout:3523: left oid 49 (ObjNum 1094 snap 351 seq_num 1094) 2024-09-10T18:09:00.882 INFO:tasks.rados.rados.0.smithi012.stdout:3522: done (2 left) 2024-09-10T18:09:00.882 INFO:tasks.rados.rados.0.smithi012.stdout:3523: done (1 left) 2024-09-10T18:09:00.883 INFO:tasks.rados.rados.0.smithi012.stdout:3524: done (0 left) 2024-09-10T18:09:00.883 INFO:tasks.rados.rados.0.smithi012.stdout:3525: rmattr oid 9 current snap is 351 2024-09-10T18:09:00.883 INFO:tasks.rados.rados.0.smithi012.stdout:3525: done (0 left) 2024-09-10T18:09:00.883 INFO:tasks.rados.rados.0.smithi012.stdout:3526: delete oid 11 current snap is 351 2024-09-10T18:09:00.892 INFO:tasks.rados.rados.0.smithi012.stdout:3526: done (0 left) 2024-09-10T18:09:00.892 INFO:tasks.rados.rados.0.smithi012.stdout:3527: rollback oid 27 current snap is 351 2024-09-10T18:09:00.893 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 27 to 345 2024-09-10T18:09:00.893 INFO:tasks.rados.rados.0.smithi012.stdout:3528: snap_remove snap 327 2024-09-10T18:09:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:00 smithi012 ceph-mon[89611]: osdmap e781: 8 total, 8 up, 8 in 2024-09-10T18:09:01.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:00 smithi012 ceph-mon[92029]: osdmap e781: 8 total, 8 up, 8 in 2024-09-10T18:09:01.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:00 smithi089 ceph-mon[84132]: osdmap e781: 8 total, 8 up, 8 in 2024-09-10T18:09:01.887 INFO:tasks.rados.rados.0.smithi012.stdout:3528: done (1 left) 2024-09-10T18:09:01.887 INFO:tasks.rados.rados.0.smithi012.stdout:3529: snap_remove snap 341 2024-09-10T18:09:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:01 smithi012 ceph-mon[89611]: osdmap e782: 8 total, 8 up, 8 in 2024-09-10T18:09:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:01 smithi012 ceph-mon[89611]: pgmap v860: 121 pgs: 121 active+clean; 261 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 4 op/s 2024-09-10T18:09:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:01 smithi012 ceph-mon[92029]: osdmap e782: 8 total, 8 up, 8 in 2024-09-10T18:09:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:01 smithi012 ceph-mon[92029]: pgmap v860: 121 pgs: 121 active+clean; 261 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 4 op/s 2024-09-10T18:09:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:02.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:01 smithi089 ceph-mon[84132]: osdmap e782: 8 total, 8 up, 8 in 2024-09-10T18:09:02.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:01 smithi089 ceph-mon[84132]: pgmap v860: 121 pgs: 121 active+clean; 261 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 4 op/s 2024-09-10T18:09:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:02.818 INFO:tasks.rados.rados.0.smithi012.stdout:3529: done (1 left) 2024-09-10T18:09:02.818 INFO:tasks.rados.rados.0.smithi012.stdout:3530: setattr oid 11 current snap is 351 2024-09-10T18:09:02.818 INFO:tasks.rados.rados.0.smithi012.stdout:3527: finishing rollback tid 0 to smithi01278544-27 2024-09-10T18:09:02.818 INFO:tasks.rados.rados.0.smithi012.stdout:3527: finishing rollback tid 1 to smithi01278544-27 2024-09-10T18:09:02.818 INFO:tasks.rados.rados.0.smithi012.stdout:3527: finishing rollback tid 2 to smithi01278544-27 2024-09-10T18:09:02.818 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 2513 (ObjNum 1002 snap 319 seq_num 1002) dirty exists 2024-09-10T18:09:02.819 INFO:tasks.rados.rados.0.smithi012.stdout:3527: done (1 left) 2024-09-10T18:09:02.820 INFO:tasks.rados.rados.0.smithi012.stdout:3531: delete oid 34 current snap is 351 2024-09-10T18:09:02.835 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2593 (ObjNum 177 snap 0 seq_num 0) dirty exists 2024-09-10T18:09:02.837 INFO:tasks.rados.rados.0.smithi012.stdout:3530: done (1 left) 2024-09-10T18:09:02.837 INFO:tasks.rados.rados.0.smithi012.stdout:3531: done (0 left) 2024-09-10T18:09:02.837 INFO:tasks.rados.rados.0.smithi012.stdout:3532: read oid 23 snap -1 2024-09-10T18:09:02.837 INFO:tasks.rados.rados.0.smithi012.stdout:3532: expect (ObjNum 1084 snap 347 seq_num 1084) 2024-09-10T18:09:02.837 INFO:tasks.rados.rados.0.smithi012.stdout:3533: rollback oid 39 current snap is 351 2024-09-10T18:09:02.837 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 350 2024-09-10T18:09:02.838 INFO:tasks.rados.rados.0.smithi012.stdout:3534: read oid 29 snap -1 2024-09-10T18:09:02.838 INFO:tasks.rados.rados.0.smithi012.stdout:3534: expect (ObjNum 1013 snap 323 seq_num 1013) 2024-09-10T18:09:02.838 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 351 2024-09-10T18:09:02.838 INFO:tasks.rados.rados.0.smithi012.stdout:3535: seq_num 1097 ranges {0=778240,778240=671744,1449984=131072} 2024-09-10T18:09:02.842 INFO:tasks.rados.rados.0.smithi012.stdout:3535: writing smithi01278544-5 from 0 to 778240 tid 1 2024-09-10T18:09:02.847 INFO:tasks.rados.rados.0.smithi012.stdout:3535: writing smithi01278544-5 from 778240 to 1449984 tid 2 2024-09-10T18:09:02.849 INFO:tasks.rados.rados.0.smithi012.stdout:3535: writing smithi01278544-5 from 1449984 to 1581056 tid 3 2024-09-10T18:09:02.849 INFO:tasks.rados.rados.0.smithi012.stdout:3536: rollback oid 10 current snap is 351 2024-09-10T18:09:02.849 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 344 2024-09-10T18:09:02.849 INFO:tasks.rados.rados.0.smithi012.stdout:3533: finishing rollback tid 0 to smithi01278544-39 2024-09-10T18:09:02.849 INFO:tasks.rados.rados.0.smithi012.stdout:3533: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:09:02.849 INFO:tasks.rados.rados.0.smithi012.stdout:3533: finishing rollback tid 2 to smithi01278544-39 2024-09-10T18:09:02.849 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2603 (ObjNum 1085 snap 347 seq_num 1085) dirty exists 2024-09-10T18:09:02.850 INFO:tasks.rados.rados.0.smithi012.stdout:3533: done (4 left) 2024-09-10T18:09:02.850 INFO:tasks.rados.rados.0.smithi012.stdout:3537: copy_from oid 7 from oid 33 current snap is 351 2024-09-10T18:09:02.850 INFO:tasks.rados.rados.0.smithi012.stdout:3538: read oid 3 snap -1 2024-09-10T18:09:02.850 INFO:tasks.rados.rados.0.smithi012.stdout:3538: expect deleted 2024-09-10T18:09:02.850 INFO:tasks.rados.rados.0.smithi012.stdout:3539: copy_from oid 19 from oid 28 current snap is 351 2024-09-10T18:09:02.850 INFO:tasks.rados.rados.0.smithi012.stdout:3540: snap_remove snap 342 2024-09-10T18:09:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:02 smithi012 ceph-mon[89611]: osdmap e783: 8 total, 8 up, 8 in 2024-09-10T18:09:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:02 smithi012 ceph-mon[89611]: osdmap e784: 8 total, 8 up, 8 in 2024-09-10T18:09:03.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:02 smithi012 ceph-mon[92029]: osdmap e783: 8 total, 8 up, 8 in 2024-09-10T18:09:03.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:02 smithi012 ceph-mon[92029]: osdmap e784: 8 total, 8 up, 8 in 2024-09-10T18:09:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:02 smithi089 ceph-mon[84132]: osdmap e783: 8 total, 8 up, 8 in 2024-09-10T18:09:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:02 smithi089 ceph-mon[84132]: osdmap e784: 8 total, 8 up, 8 in 2024-09-10T18:09:03.822 INFO:tasks.rados.rados.0.smithi012.stdout:3540: done (7 left) 2024-09-10T18:09:03.822 INFO:tasks.rados.rados.0.smithi012.stdout:3541: rollback oid 6 current snap is 351 2024-09-10T18:09:03.822 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 6 to 339 2024-09-10T18:09:03.822 INFO:tasks.rados.rados.0.smithi012.stdout:3536: finishing rollback tid 0 to smithi01278544-10 2024-09-10T18:09:03.822 INFO:tasks.rados.rados.0.smithi012.stdout:3536: finishing rollback tid 1 to smithi01278544-10 2024-09-10T18:09:03.822 INFO:tasks.rados.rados.0.smithi012.stdout:3536: finishing rollback tid 2 to smithi01278544-10 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2607 (ObjNum 1004 snap 319 seq_num 1004) dirty exists 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: finishing write tid 1 to smithi01278544-5 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: finishing write tid 2 to smithi01278544-5 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: finishing write tid 3 to smithi01278544-5 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: finishing write tid 4 to smithi01278544-5 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3537: finishing copy_from racing read to smithi01278544-7 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: finishing write tid 5 to smithi01278544-5 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: oid 5 updating version 0 to 2042 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: oid 5 version 2042 is already newer than 2041 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: oid 5 updating version 2042 to 2044 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: oid 5 version 2044 is already newer than 2043 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 2044 (ObjNum 1097 snap 351 seq_num 1097) dirty exists 2024-09-10T18:09:03.823 INFO:tasks.rados.rados.0.smithi012.stdout:3535: left oid 5 (ObjNum 1097 snap 351 seq_num 1097) 2024-09-10T18:09:03.824 INFO:tasks.rados.rados.0.smithi012.stdout:3537: finishing copy_from to smithi01278544-7 2024-09-10T18:09:03.824 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 2332 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:09:03.824 INFO:tasks.rados.rados.0.smithi012.stdout:3532: expect (ObjNum 1084 snap 347 seq_num 1084) 2024-09-10T18:09:03.937 INFO:tasks.rados.rados.0.smithi012.stdout:3534: expect (ObjNum 1013 snap 323 seq_num 1013) 2024-09-10T18:09:04.246 INFO:tasks.rados.rados.0.smithi012.stdout:3539: finishing copy_from racing read to smithi01278544-19 2024-09-10T18:09:04.246 INFO:tasks.rados.rados.0.smithi012.stdout:3539: finishing copy_from to smithi01278544-19 2024-09-10T18:09:04.246 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 1323 (ObjNum 1059 snap 341 seq_num 1059) dirty exists 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3532: done (7 left) 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3534: done (6 left) 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3535: done (5 left) 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3536: done (4 left) 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3537: done (3 left) 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3538: done (2 left) 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3539: done (1 left) 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3542: copy_from oid 25 from oid 12 current snap is 351 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3541: finishing rollback tid 0 to smithi01278544-6 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3541: finishing rollback tid 1 to smithi01278544-6 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3541: finishing rollback tid 2 to smithi01278544-6 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 2479 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3541: done (1 left) 2024-09-10T18:09:04.247 INFO:tasks.rados.rados.0.smithi012.stdout:3543: snap_remove snap 345 2024-09-10T18:09:04.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:09:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:09:04] "GET /metrics HTTP/1.1" 200 36357 "" "Prometheus/2.51.0" 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3542: finishing copy_from to smithi01278544-25 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3542: got expected ENOENT (src dne) 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3542: finishing copy_from racing read to smithi01278544-25 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3542: done (1 left) 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3543: done (0 left) 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3544: rmattr oid 21 current snap is 351 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3544: done (0 left) 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3545: read oid 25 snap -1 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3545: expect (ObjNum 1042 snap 335 seq_num 1042) 2024-09-10T18:09:04.893 INFO:tasks.rados.rados.0.smithi012.stdout:3546: read oid 19 snap -1 2024-09-10T18:09:04.894 INFO:tasks.rados.rados.0.smithi012.stdout:3546: expect (ObjNum 1059 snap 341 seq_num 1059) 2024-09-10T18:09:04.894 INFO:tasks.rados.rados.0.smithi012.stdout:3547: rmattr oid 36 current snap is 351 2024-09-10T18:09:04.894 INFO:tasks.rados.rados.0.smithi012.stdout:3547: done (2 left) 2024-09-10T18:09:04.894 INFO:tasks.rados.rados.0.smithi012.stdout:3548: read oid 26 snap -1 2024-09-10T18:09:04.894 INFO:tasks.rados.rados.0.smithi012.stdout:3548: expect (ObjNum 1093 snap 350 seq_num 1093) 2024-09-10T18:09:04.894 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 351 2024-09-10T18:09:04.894 INFO:tasks.rados.rados.0.smithi012.stdout:3549: seq_num 1098 ranges {0=794624,794624=557056,1351680=245760} 2024-09-10T18:09:04.898 INFO:tasks.rados.rados.0.smithi012.stdout:3549: writing smithi01278544-40 from 0 to 794624 tid 1 2024-09-10T18:09:04.902 INFO:tasks.rados.rados.0.smithi012.stdout:3549: writing smithi01278544-40 from 794624 to 1351680 tid 2 2024-09-10T18:09:04.905 INFO:tasks.rados.rados.0.smithi012.stdout:3549: writing smithi01278544-40 from 1351680 to 1597440 tid 3 2024-09-10T18:09:04.905 INFO:tasks.rados.rados.0.smithi012.stdout:3550: setattr oid 38 current snap is 351 2024-09-10T18:09:04.908 INFO:tasks.rados.rados.0.smithi012.stdout:3551: read oid 47 snap -1 2024-09-10T18:09:04.908 INFO:tasks.rados.rados.0.smithi012.stdout:3551: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:09:04.908 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 1 current snap is 351 2024-09-10T18:09:04.908 INFO:tasks.rados.rados.0.smithi012.stdout:3552: seq_num 1099 ranges {1196032=409600,1605632=442368,2048000=720896,2768896=40960} 2024-09-10T18:09:04.917 INFO:tasks.rados.rados.0.smithi012.stdout:3552: writing smithi01278544-1 from 1196032 to 1605632 tid 1 2024-09-10T18:09:04.920 INFO:tasks.rados.rados.0.smithi012.stdout:3552: writing smithi01278544-1 from 1605632 to 2048000 tid 2 2024-09-10T18:09:04.925 INFO:tasks.rados.rados.0.smithi012.stdout:3552: writing smithi01278544-1 from 2048000 to 2768896 tid 3 2024-09-10T18:09:04.925 INFO:tasks.rados.rados.0.smithi012.stdout:3552: writing smithi01278544-1 from 2768896 to 2809856 tid 4 2024-09-10T18:09:04.926 INFO:tasks.rados.rados.0.smithi012.stdout:3553: snap_create 2024-09-10T18:09:04.926 INFO:tasks.rados.rados.0.smithi012.stdout:3545: expect (ObjNum 1042 snap 335 seq_num 1042) 2024-09-10T18:09:04.968 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 2177 (ObjNum 1032 snap 332 seq_num 1032) dirty exists 2024-09-10T18:09:04.968 INFO:tasks.rados.rados.0.smithi012.stdout:3552: finishing write tid 1 to smithi01278544-1 2024-09-10T18:09:04.968 INFO:tasks.rados.rados.0.smithi012.stdout:3549: finishing write tid 1 to smithi01278544-40 2024-09-10T18:09:04.968 INFO:tasks.rados.rados.0.smithi012.stdout:3552: finishing write tid 2 to smithi01278544-1 2024-09-10T18:09:04.968 INFO:tasks.rados.rados.0.smithi012.stdout:3548: expect (ObjNum 1093 snap 350 seq_num 1093) 2024-09-10T18:09:05.236 INFO:tasks.rados.rados.0.smithi012.stdout:3552: finishing write tid 3 to smithi01278544-1 2024-09-10T18:09:05.236 INFO:tasks.rados.rados.0.smithi012.stdout:3552: finishing write tid 4 to smithi01278544-1 2024-09-10T18:09:05.237 INFO:tasks.rados.rados.0.smithi012.stdout:3552: finishing write tid 5 to smithi01278544-1 2024-09-10T18:09:05.237 INFO:tasks.rados.rados.0.smithi012.stdout:3546: expect (ObjNum 1059 snap 341 seq_num 1059) 2024-09-10T18:09:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:04 smithi012 ceph-mon[89611]: pgmap v863: 121 pgs: 121 active+clean; 263 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-09-10T18:09:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:04 smithi012 ceph-mon[89611]: osdmap e785: 8 total, 8 up, 8 in 2024-09-10T18:09:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:04 smithi012 ceph-mon[92029]: pgmap v863: 121 pgs: 121 active+clean; 263 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-09-10T18:09:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:04 smithi012 ceph-mon[92029]: osdmap e785: 8 total, 8 up, 8 in 2024-09-10T18:09:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:04 smithi089 ceph-mon[84132]: pgmap v863: 121 pgs: 121 active+clean; 263 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-09-10T18:09:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:04 smithi089 ceph-mon[84132]: osdmap e785: 8 total, 8 up, 8 in 2024-09-10T18:09:05.533 INFO:tasks.rados.rados.0.smithi012.stdout:3549: finishing write tid 2 to smithi01278544-40 2024-09-10T18:09:05.533 INFO:tasks.rados.rados.0.smithi012.stdout:3551: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:09:05.538 INFO:tasks.rados.rados.0.smithi012.stdout:3549: finishing write tid 3 to smithi01278544-40 2024-09-10T18:09:05.538 INFO:tasks.rados.rados.0.smithi012.stdout:3549: finishing write tid 4 to smithi01278544-40 2024-09-10T18:09:05.538 INFO:tasks.rados.rados.0.smithi012.stdout:3552: finishing write tid 6 to smithi01278544-1 2024-09-10T18:09:05.538 INFO:tasks.rados.rados.0.smithi012.stdout:3552: oid 1 updating version 0 to 2181 2024-09-10T18:09:05.539 INFO:tasks.rados.rados.0.smithi012.stdout:3552: oid 1 version 2181 is already newer than 2179 2024-09-10T18:09:05.539 INFO:tasks.rados.rados.0.smithi012.stdout:3552: oid 1 updating version 2181 to 2182 2024-09-10T18:09:05.539 INFO:tasks.rados.rados.0.smithi012.stdout:3552: oid 1 version 2182 is already newer than 2178 2024-09-10T18:09:05.539 INFO:tasks.rados.rados.0.smithi012.stdout:3552: oid 1 version 2182 is already newer than 2180 2024-09-10T18:09:05.539 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2182 (ObjNum 1099 snap 351 seq_num 1099) dirty exists 2024-09-10T18:09:05.539 INFO:tasks.rados.rados.0.smithi012.stdout:3552: left oid 1 (ObjNum 1099 snap 351 seq_num 1099) 2024-09-10T18:09:05.539 INFO:tasks.rados.rados.0.smithi012.stdout:3549: finishing write tid 5 to smithi01278544-40 2024-09-10T18:09:05.539 INFO:tasks.rados.rados.0.smithi012.stdout:3549: oid 40 updating version 0 to 2473 2024-09-10T18:09:05.540 INFO:tasks.rados.rados.0.smithi012.stdout:3549: oid 40 updating version 2473 to 2474 2024-09-10T18:09:05.540 INFO:tasks.rados.rados.0.smithi012.stdout:3549: oid 40 updating version 2474 to 2476 2024-09-10T18:09:05.540 INFO:tasks.rados.rados.0.smithi012.stdout:3549: oid 40 version 2476 is already newer than 2475 2024-09-10T18:09:05.540 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2476 (ObjNum 1098 snap 351 seq_num 1098) dirty exists 2024-09-10T18:09:05.540 INFO:tasks.rados.rados.0.smithi012.stdout:3549: left oid 40 (ObjNum 1098 snap 351 seq_num 1098) 2024-09-10T18:09:05.898 INFO:tasks.rados.rados.0.smithi012.stdout:3545: done (7 left) 2024-09-10T18:09:05.898 INFO:tasks.rados.rados.0.smithi012.stdout:3546: done (6 left) 2024-09-10T18:09:05.899 INFO:tasks.rados.rados.0.smithi012.stdout:3548: done (5 left) 2024-09-10T18:09:05.899 INFO:tasks.rados.rados.0.smithi012.stdout:3549: done (4 left) 2024-09-10T18:09:05.899 INFO:tasks.rados.rados.0.smithi012.stdout:3550: done (3 left) 2024-09-10T18:09:05.899 INFO:tasks.rados.rados.0.smithi012.stdout:3551: done (2 left) 2024-09-10T18:09:05.899 INFO:tasks.rados.rados.0.smithi012.stdout:3552: done (1 left) 2024-09-10T18:09:05.899 INFO:tasks.rados.rados.0.smithi012.stdout:3553: done (0 left) 2024-09-10T18:09:05.899 INFO:tasks.rados.rados.0.smithi012.stdout:3554: setattr oid 16 current snap is 352 2024-09-10T18:09:05.900 INFO:tasks.rados.rados.0.smithi012.stdout:3555: read oid 45 snap -1 2024-09-10T18:09:05.900 INFO:tasks.rados.rados.0.smithi012.stdout:3555: expect (ObjNum 1091 snap 349 seq_num 1091) 2024-09-10T18:09:05.900 INFO:tasks.rados.rados.0.smithi012.stdout:3556: rmattr oid 43 current snap is 352 2024-09-10T18:09:05.900 INFO:tasks.rados.rados.0.smithi012.stdout:3557: rmattr oid 1 current snap is 352 2024-09-10T18:09:05.900 INFO:tasks.rados.rados.0.smithi012.stdout:3557: done (3 left) 2024-09-10T18:09:05.900 INFO:tasks.rados.rados.0.smithi012.stdout:3558: snap_create 2024-09-10T18:09:05.910 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 2480 (ObjNum 856 snap 278 seq_num 856) dirty exists 2024-09-10T18:09:05.917 INFO:tasks.rados.rados.0.smithi012.stdout:3555: expect (ObjNum 1091 snap 349 seq_num 1091) 2024-09-10T18:09:06.097 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2477 (ObjNum 1025 snap 328 seq_num 1025) dirty exists 2024-09-10T18:09:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:05 smithi012 ceph-mon[89611]: osdmap e786: 8 total, 8 up, 8 in 2024-09-10T18:09:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:05 smithi012 ceph-mon[89611]: pgmap v866: 121 pgs: 121 active+clean; 265 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.2 MiB/s rd, 1.8 MiB/s wr, 21 op/s 2024-09-10T18:09:06.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:05 smithi012 ceph-mon[92029]: osdmap e786: 8 total, 8 up, 8 in 2024-09-10T18:09:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:05 smithi012 ceph-mon[92029]: pgmap v866: 121 pgs: 121 active+clean; 265 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.2 MiB/s rd, 1.8 MiB/s wr, 21 op/s 2024-09-10T18:09:06.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:05 smithi089 ceph-mon[84132]: osdmap e786: 8 total, 8 up, 8 in 2024-09-10T18:09:06.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:05 smithi089 ceph-mon[84132]: pgmap v866: 121 pgs: 121 active+clean; 265 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 5.2 MiB/s rd, 1.8 MiB/s wr, 21 op/s 2024-09-10T18:09:06.906 INFO:tasks.rados.rados.0.smithi012.stdout:3554: done (3 left) 2024-09-10T18:09:06.906 INFO:tasks.rados.rados.0.smithi012.stdout:3555: done (2 left) 2024-09-10T18:09:06.906 INFO:tasks.rados.rados.0.smithi012.stdout:3556: done (1 left) 2024-09-10T18:09:06.906 INFO:tasks.rados.rados.0.smithi012.stdout:3558: done (0 left) 2024-09-10T18:09:06.906 INFO:tasks.rados.rados.0.smithi012.stdout:3559: snap_remove snap 328 2024-09-10T18:09:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:06 smithi012 ceph-mon[89611]: osdmap e787: 8 total, 8 up, 8 in 2024-09-10T18:09:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:06 smithi012 ceph-mon[92029]: osdmap e787: 8 total, 8 up, 8 in 2024-09-10T18:09:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:06 smithi089 ceph-mon[84132]: osdmap e787: 8 total, 8 up, 8 in 2024-09-10T18:09:07.823 INFO:tasks.rados.rados.0.smithi012.stdout:3559: done (0 left) 2024-09-10T18:09:07.823 INFO:tasks.rados.rados.0.smithi012.stdout:3560: snap_remove snap 339 2024-09-10T18:09:08.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:07 smithi012 ceph-mon[92029]: osdmap e788: 8 total, 8 up, 8 in 2024-09-10T18:09:08.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:07 smithi012 ceph-mon[92029]: pgmap v869: 121 pgs: 121 active+clean; 267 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2024-09-10T18:09:08.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:07 smithi012 ceph-mon[92029]: osdmap e789: 8 total, 8 up, 8 in 2024-09-10T18:09:08.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:07 smithi012 ceph-mon[89611]: osdmap e788: 8 total, 8 up, 8 in 2024-09-10T18:09:08.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:07 smithi012 ceph-mon[89611]: pgmap v869: 121 pgs: 121 active+clean; 267 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2024-09-10T18:09:08.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:07 smithi012 ceph-mon[89611]: osdmap e789: 8 total, 8 up, 8 in 2024-09-10T18:09:08.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:07 smithi089 ceph-mon[84132]: osdmap e788: 8 total, 8 up, 8 in 2024-09-10T18:09:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:07 smithi089 ceph-mon[84132]: pgmap v869: 121 pgs: 121 active+clean; 267 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 14 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2024-09-10T18:09:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:07 smithi089 ceph-mon[84132]: osdmap e789: 8 total, 8 up, 8 in 2024-09-10T18:09:08.823 INFO:tasks.rados.rados.0.smithi012.stdout:3560: done (0 left) 2024-09-10T18:09:08.823 INFO:tasks.rados.rados.0.smithi012.stdout:3561: snap_create 2024-09-10T18:09:09.828 INFO:tasks.rados.rados.0.smithi012.stdout:3561: done (0 left) 2024-09-10T18:09:09.829 INFO:tasks.rados.rados.0.smithi012.stdout:3562: read oid 36 snap 352 2024-09-10T18:09:09.829 INFO:tasks.rados.rados.0.smithi012.stdout:3562: expect deleted 2024-09-10T18:09:09.829 INFO:tasks.rados.rados.0.smithi012.stdout:3563: setattr oid 19 current snap is 354 2024-09-10T18:09:09.830 INFO:tasks.rados.rados.0.smithi012.stdout:3562: done (1 left) 2024-09-10T18:09:09.830 INFO:tasks.rados.rados.0.smithi012.stdout:3564: copy_from oid 35 from oid 25 current snap is 354 2024-09-10T18:09:09.830 INFO:tasks.rados.rados.0.smithi012.stdout:3565: snap_remove snap 347 2024-09-10T18:09:10.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:09 smithi012 ceph-mon[92029]: osdmap e790: 8 total, 8 up, 8 in 2024-09-10T18:09:10.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:09 smithi012 ceph-mon[89611]: osdmap e790: 8 total, 8 up, 8 in 2024-09-10T18:09:10.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:09 smithi089 ceph-mon[84132]: osdmap e790: 8 total, 8 up, 8 in 2024-09-10T18:09:10.837 INFO:tasks.rados.rados.0.smithi012.stdout:3565: done (2 left) 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:3566: rmattr oid 12 current snap is 354 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:3566: done (2 left) 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:3567: rollback oid 1 current snap is 354 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 338 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 2323 (ObjNum 1059 snap 341 seq_num 1059) dirty exists 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:3564: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:3564: finishing copy_from to smithi01278544-35 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2436 (ObjNum 1042 snap 335 seq_num 1042) dirty exists 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:3563: done (2 left) 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:3564: done (1 left) 2024-09-10T18:09:10.838 INFO:tasks.rados.rados.0.smithi012.stdout:3568: snap_remove snap 351 2024-09-10T18:09:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:10 smithi012 ceph-mon[89611]: pgmap v872: 121 pgs: 121 active+clean; 269 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.1 MiB/s wr, 35 op/s 2024-09-10T18:09:11.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:10 smithi012 ceph-mon[89611]: osdmap e791: 8 total, 8 up, 8 in 2024-09-10T18:09:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:10 smithi012 ceph-mon[92029]: pgmap v872: 121 pgs: 121 active+clean; 269 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.1 MiB/s wr, 35 op/s 2024-09-10T18:09:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:10 smithi012 ceph-mon[92029]: osdmap e791: 8 total, 8 up, 8 in 2024-09-10T18:09:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:10 smithi089 ceph-mon[84132]: pgmap v872: 121 pgs: 121 active+clean; 269 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 2.1 MiB/s wr, 35 op/s 2024-09-10T18:09:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:10 smithi089 ceph-mon[84132]: osdmap e791: 8 total, 8 up, 8 in 2024-09-10T18:09:11.852 INFO:tasks.rados.rados.0.smithi012.stdout:3568: done (1 left) 2024-09-10T18:09:11.852 INFO:tasks.rados.rados.0.smithi012.stdout:3569: snap_remove snap 343 2024-09-10T18:09:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:11 smithi012 ceph-mon[89611]: osdmap e792: 8 total, 8 up, 8 in 2024-09-10T18:09:12.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:11 smithi012 ceph-mon[89611]: pgmap v875: 121 pgs: 121 active+clean; 252 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 394 KiB/s wr, 7 op/s 2024-09-10T18:09:12.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:11 smithi012 ceph-mon[92029]: osdmap e792: 8 total, 8 up, 8 in 2024-09-10T18:09:12.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:11 smithi012 ceph-mon[92029]: pgmap v875: 121 pgs: 121 active+clean; 252 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 394 KiB/s wr, 7 op/s 2024-09-10T18:09:12.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:11 smithi089 ceph-mon[84132]: osdmap e792: 8 total, 8 up, 8 in 2024-09-10T18:09:12.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:11 smithi089 ceph-mon[84132]: pgmap v875: 121 pgs: 121 active+clean; 252 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 394 KiB/s wr, 7 op/s 2024-09-10T18:09:12.824 INFO:tasks.rados.rados.0.smithi012.stdout:3569: done (1 left) 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3570: copy_from oid 31 from oid 46 current snap is 354 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3567: finishing rollback tid 0 to smithi01278544-1 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3567: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3567: finishing rollback tid 2 to smithi01278544-1 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2185 (ObjNum 81 snap 0 seq_num 1951687024) dirty exists 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3567: done (1 left) 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3571: read oid 12 snap -1 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3571: expect deleted 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3572: rollback oid 45 current snap is 354 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 45 to 338 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3573: rmattr oid 8 current snap is 354 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:3573: done (3 left) 2024-09-10T18:09:12.825 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 16 current snap is 354 2024-09-10T18:09:12.826 INFO:tasks.rados.rados.0.smithi012.stdout:3574: seq_num 1100 ranges {14311424=425984,14737408=729088,15466496=475136} 2024-09-10T18:09:12.906 INFO:tasks.rados.rados.0.smithi012.stdout:3574: writing smithi01278544-16 from 14311424 to 14737408 tid 1 2024-09-10T18:09:12.912 INFO:tasks.rados.rados.0.smithi012.stdout:3574: writing smithi01278544-16 from 14737408 to 15466496 tid 2 2024-09-10T18:09:12.914 INFO:tasks.rados.rados.0.smithi012.stdout:3574: writing smithi01278544-16 from 15466496 to 15941632 tid 3 2024-09-10T18:09:12.914 INFO:tasks.rados.rados.0.smithi012.stdout:3575: setattr oid 30 current snap is 354 2024-09-10T18:09:12.915 INFO:tasks.rados.rados.0.smithi012.stdout:3570: finishing copy_from to smithi01278544-31 2024-09-10T18:09:12.915 INFO:tasks.rados.rados.0.smithi012.stdout:3570: got expected ENOENT (src dne) 2024-09-10T18:09:12.915 INFO:tasks.rados.rados.0.smithi012.stdout:3570: finishing copy_from racing read to smithi01278544-31 2024-09-10T18:09:12.915 INFO:tasks.rados.rados.0.smithi012.stdout:3572: finishing rollback tid 0 to smithi01278544-45 2024-09-10T18:09:12.915 INFO:tasks.rados.rados.0.smithi012.stdout:3572: finishing rollback tid 1 to smithi01278544-45 2024-09-10T18:09:12.915 INFO:tasks.rados.rados.0.smithi012.stdout:3572: finishing rollback tid 2 to smithi01278544-45 2024-09-10T18:09:12.915 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2480 (ObjNum 953 snap 302 seq_num 953) dirty exists 2024-09-10T18:09:12.915 INFO:tasks.rados.rados.0.smithi012.stdout:3574: finishing write tid 1 to smithi01278544-16 2024-09-10T18:09:12.916 INFO:tasks.rados.rados.0.smithi012.stdout:3570: done (4 left) 2024-09-10T18:09:12.916 INFO:tasks.rados.rados.0.smithi012.stdout:3571: done (3 left) 2024-09-10T18:09:12.916 INFO:tasks.rados.rados.0.smithi012.stdout:3572: done (2 left) 2024-09-10T18:09:12.916 INFO:tasks.rados.rados.0.smithi012.stdout:3576: read oid 29 snap -1 2024-09-10T18:09:12.916 INFO:tasks.rados.rados.0.smithi012.stdout:3576: expect (ObjNum 1013 snap 323 seq_num 1013) 2024-09-10T18:09:12.916 INFO:tasks.rados.rados.0.smithi012.stdout:3577: delete oid 38 current snap is 354 2024-09-10T18:09:12.919 INFO:tasks.rados.rados.0.smithi012.stdout:3574: finishing write tid 2 to smithi01278544-16 2024-09-10T18:09:12.921 INFO:tasks.rados.rados.0.smithi012.stdout:3574: finishing write tid 3 to smithi01278544-16 2024-09-10T18:09:12.921 INFO:tasks.rados.rados.0.smithi012.stdout:3577: done (3 left) 2024-09-10T18:09:12.921 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 354 2024-09-10T18:09:12.921 INFO:tasks.rados.rados.0.smithi012.stdout:3578: seq_num 1102 ranges {2703360=458752,3162112=491520,3653632=491520,4145152=221184} 2024-09-10T18:09:12.939 INFO:tasks.rados.rados.0.smithi012.stdout:3578: writing smithi01278544-50 from 2703360 to 3162112 tid 1 2024-09-10T18:09:12.942 INFO:tasks.rados.rados.0.smithi012.stdout:3578: writing smithi01278544-50 from 3162112 to 3653632 tid 2 2024-09-10T18:09:12.945 INFO:tasks.rados.rados.0.smithi012.stdout:3578: writing smithi01278544-50 from 3653632 to 4145152 tid 3 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3578: writing smithi01278544-50 from 4145152 to 4366336 tid 4 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3579: rollback oid 22 current snap is 354 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 22 to 352 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2438 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3574: finishing write tid 4 to smithi01278544-16 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3574: finishing write tid 5 to smithi01278544-16 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3574: oid 16 updating version 0 to 2484 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3574: oid 16 version 2484 is already newer than 2482 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3574: oid 16 version 2484 is already newer than 2481 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3574: oid 16 version 2484 is already newer than 2483 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 2484 (ObjNum 1100 snap 354 seq_num 1100) dirty exists 2024-09-10T18:09:12.947 INFO:tasks.rados.rados.0.smithi012.stdout:3574: left oid 16 (ObjNum 1100 snap 354 seq_num 1100) 2024-09-10T18:09:12.948 INFO:tasks.rados.rados.0.smithi012.stdout:3576: expect (ObjNum 1013 snap 323 seq_num 1013) 2024-09-10T18:09:13.257 INFO:tasks.rados.rados.0.smithi012.stdout:3578: finishing write tid 1 to smithi01278544-50 2024-09-10T18:09:13.257 INFO:tasks.rados.rados.0.smithi012.stdout:3578: finishing write tid 2 to smithi01278544-50 2024-09-10T18:09:13.257 INFO:tasks.rados.rados.0.smithi012.stdout:3578: finishing write tid 3 to smithi01278544-50 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: finishing write tid 4 to smithi01278544-50 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: finishing write tid 5 to smithi01278544-50 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: finishing write tid 6 to smithi01278544-50 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: oid 50 updating version 0 to 2056 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: oid 50 updating version 2056 to 2057 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: oid 50 version 2057 is already newer than 2055 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: oid 50 version 2057 is already newer than 2054 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: oid 50 version 2057 is already newer than 2053 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2057 (ObjNum 1102 snap 354 seq_num 1102) dirty exists 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3578: left oid 50 (ObjNum 1102 snap 354 seq_num 1102) 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3579: finishing rollback tid 0 to smithi01278544-22 2024-09-10T18:09:13.258 INFO:tasks.rados.rados.0.smithi012.stdout:3579: finishing rollback tid 1 to smithi01278544-22 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:3579: finishing rollback tid 2 to smithi01278544-22 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2659 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:3574: done (4 left) 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:3575: done (3 left) 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:3576: done (2 left) 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:3578: done (1 left) 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:3579: done (0 left) 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 354 2024-09-10T18:09:13.259 INFO:tasks.rados.rados.0.smithi012.stdout:3580: seq_num 1103 ranges {4972544=475136,5447680=425984,5873664=696320,6569984=81920} 2024-09-10T18:09:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:12 smithi012 ceph-mon[89611]: osdmap e793: 8 total, 8 up, 8 in 2024-09-10T18:09:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:12 smithi012 ceph-mon[89611]: osdmap e794: 8 total, 8 up, 8 in 2024-09-10T18:09:13.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:12 smithi012 ceph-mon[92029]: osdmap e793: 8 total, 8 up, 8 in 2024-09-10T18:09:13.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:12 smithi012 ceph-mon[92029]: osdmap e794: 8 total, 8 up, 8 in 2024-09-10T18:09:13.286 INFO:tasks.rados.rados.0.smithi012.stdout:3580: writing smithi01278544-26 from 4972544 to 5447680 tid 1 2024-09-10T18:09:13.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:12 smithi089 ceph-mon[84132]: osdmap e793: 8 total, 8 up, 8 in 2024-09-10T18:09:13.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:12 smithi089 ceph-mon[84132]: osdmap e794: 8 total, 8 up, 8 in 2024-09-10T18:09:13.288 INFO:tasks.rados.rados.0.smithi012.stdout:3580: writing smithi01278544-26 from 5447680 to 5873664 tid 2 2024-09-10T18:09:13.292 INFO:tasks.rados.rados.0.smithi012.stdout:3580: writing smithi01278544-26 from 5873664 to 6569984 tid 3 2024-09-10T18:09:13.293 INFO:tasks.rados.rados.0.smithi012.stdout:3580: writing smithi01278544-26 from 6569984 to 6651904 tid 4 2024-09-10T18:09:13.293 INFO:tasks.rados.rados.0.smithi012.stdout:3581: read oid 7 snap -1 2024-09-10T18:09:13.293 INFO:tasks.rados.rados.0.smithi012.stdout:3581: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:09:13.293 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 3 current snap is 354 2024-09-10T18:09:13.293 INFO:tasks.rados.rados.0.smithi012.stdout:3582: seq_num 1104 ranges {0=499712,499712=712704,1212416=491520} 2024-09-10T18:09:13.295 INFO:tasks.rados.rados.0.smithi012.stdout:3582: writing smithi01278544-3 from 0 to 499712 tid 1 2024-09-10T18:09:13.299 INFO:tasks.rados.rados.0.smithi012.stdout:3582: writing smithi01278544-3 from 499712 to 1212416 tid 2 2024-09-10T18:09:13.302 INFO:tasks.rados.rados.0.smithi012.stdout:3582: writing smithi01278544-3 from 1212416 to 1703936 tid 3 2024-09-10T18:09:13.302 INFO:tasks.rados.rados.0.smithi012.stdout:3583: snap_create 2024-09-10T18:09:13.302 INFO:tasks.rados.rados.0.smithi012.stdout:3580: finishing write tid 1 to smithi01278544-26 2024-09-10T18:09:13.303 INFO:tasks.rados.rados.0.smithi012.stdout:3580: finishing write tid 2 to smithi01278544-26 2024-09-10T18:09:13.303 INFO:tasks.rados.rados.0.smithi012.stdout:3581: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: finishing write tid 3 to smithi01278544-26 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: finishing write tid 4 to smithi01278544-26 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: finishing write tid 5 to smithi01278544-26 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3582: finishing write tid 1 to smithi01278544-3 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: finishing write tid 6 to smithi01278544-26 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: oid 26 updating version 0 to 2052 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: oid 26 updating version 2052 to 2053 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: oid 26 updating version 2053 to 2055 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: oid 26 version 2055 is already newer than 2054 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: oid 26 version 2055 is already newer than 2051 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2055 (ObjNum 1103 snap 354 seq_num 1103) dirty exists 2024-09-10T18:09:13.308 INFO:tasks.rados.rados.0.smithi012.stdout:3580: left oid 26 (ObjNum 1103 snap 354 seq_num 1103) 2024-09-10T18:09:13.309 INFO:tasks.rados.rados.0.smithi012.stdout:3582: finishing write tid 2 to smithi01278544-3 2024-09-10T18:09:13.309 INFO:tasks.rados.rados.0.smithi012.stdout:3582: finishing write tid 3 to smithi01278544-3 2024-09-10T18:09:13.309 INFO:tasks.rados.rados.0.smithi012.stdout:3582: finishing write tid 4 to smithi01278544-3 2024-09-10T18:09:13.309 INFO:tasks.rados.rados.0.smithi012.stdout:3582: finishing write tid 5 to smithi01278544-3 2024-09-10T18:09:13.309 INFO:tasks.rados.rados.0.smithi012.stdout:3582: oid 3 updating version 0 to 2515 2024-09-10T18:09:13.309 INFO:tasks.rados.rados.0.smithi012.stdout:3582: oid 3 updating version 2515 to 2517 2024-09-10T18:09:13.309 INFO:tasks.rados.rados.0.smithi012.stdout:3582: oid 3 version 2517 is already newer than 2514 2024-09-10T18:09:13.310 INFO:tasks.rados.rados.0.smithi012.stdout:3582: oid 3 version 2517 is already newer than 2516 2024-09-10T18:09:13.310 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 3 v 2517 (ObjNum 1104 snap 354 seq_num 1104) dirty exists 2024-09-10T18:09:13.310 INFO:tasks.rados.rados.0.smithi012.stdout:3582: left oid 3 (ObjNum 1104 snap 354 seq_num 1104) 2024-09-10T18:09:13.858 INFO:tasks.rados.rados.0.smithi012.stdout:3580: done (3 left) 2024-09-10T18:09:13.858 INFO:tasks.rados.rados.0.smithi012.stdout:3581: done (2 left) 2024-09-10T18:09:13.858 INFO:tasks.rados.rados.0.smithi012.stdout:3582: done (1 left) 2024-09-10T18:09:13.858 INFO:tasks.rados.rados.0.smithi012.stdout:3583: done (0 left) 2024-09-10T18:09:13.858 INFO:tasks.rados.rados.0.smithi012.stdout:3584: read oid 22 snap -1 2024-09-10T18:09:13.858 INFO:tasks.rados.rados.0.smithi012.stdout:3584: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:09:13.859 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 355 2024-09-10T18:09:13.859 INFO:tasks.rados.rados.0.smithi012.stdout:3585: seq_num 1105 ranges {6176768=516096,6692864=598016,7290880=606208} 2024-09-10T18:09:13.894 INFO:tasks.rados.rados.0.smithi012.stdout:3585: writing smithi01278544-2 from 6176768 to 6692864 tid 1 2024-09-10T18:09:13.897 INFO:tasks.rados.rados.0.smithi012.stdout:3585: writing smithi01278544-2 from 6692864 to 7290880 tid 2 2024-09-10T18:09:13.901 INFO:tasks.rados.rados.0.smithi012.stdout:3585: writing smithi01278544-2 from 7290880 to 7897088 tid 3 2024-09-10T18:09:13.901 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 355 2024-09-10T18:09:13.901 INFO:tasks.rados.rados.0.smithi012.stdout:3586: seq_num 1106 ranges {0=532480,532480=483328,1015808=475136,1490944=245760} 2024-09-10T18:09:13.903 INFO:tasks.rados.rados.0.smithi012.stdout:3586: writing smithi01278544-44 from 0 to 532480 tid 1 2024-09-10T18:09:13.906 INFO:tasks.rados.rados.0.smithi012.stdout:3586: writing smithi01278544-44 from 532480 to 1015808 tid 2 2024-09-10T18:09:13.909 INFO:tasks.rados.rados.0.smithi012.stdout:3586: writing smithi01278544-44 from 1015808 to 1490944 tid 3 2024-09-10T18:09:13.911 INFO:tasks.rados.rados.0.smithi012.stdout:3586: writing smithi01278544-44 from 1490944 to 1736704 tid 4 2024-09-10T18:09:13.911 INFO:tasks.rados.rados.0.smithi012.stdout:3587: copy_from oid 50 from oid 29 current snap is 355 2024-09-10T18:09:13.911 INFO:tasks.rados.rados.0.smithi012.stdout:3584: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:09:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:3585: finishing write tid 1 to smithi01278544-2 2024-09-10T18:09:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:3585: finishing write tid 2 to smithi01278544-2 2024-09-10T18:09:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:3585: finishing write tid 3 to smithi01278544-2 2024-09-10T18:09:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:3585: finishing write tid 4 to smithi01278544-2 2024-09-10T18:09:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:3585: finishing write tid 5 to smithi01278544-2 2024-09-10T18:09:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:3585: oid 2 updating version 0 to 2340 2024-09-10T18:09:13.920 INFO:tasks.rados.rados.0.smithi012.stdout:3585: oid 2 version 2340 is already newer than 2339 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3585: oid 2 updating version 2340 to 2341 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3585: oid 2 version 2341 is already newer than 2338 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2341 (ObjNum 1105 snap 355 seq_num 1105) dirty exists 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3585: left oid 2 (ObjNum 1105 snap 355 seq_num 1105) 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3586: finishing write tid 1 to smithi01278544-44 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3586: finishing write tid 2 to smithi01278544-44 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3586: finishing write tid 3 to smithi01278544-44 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3586: finishing write tid 4 to smithi01278544-44 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3586: finishing write tid 5 to smithi01278544-44 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3586: finishing write tid 6 to smithi01278544-44 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3586: oid 44 updating version 0 to 2522 2024-09-10T18:09:13.921 INFO:tasks.rados.rados.0.smithi012.stdout:3586: oid 44 version 2522 is already newer than 2519 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3586: oid 44 version 2522 is already newer than 2518 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3586: oid 44 version 2522 is already newer than 2521 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3586: oid 44 version 2522 is already newer than 2520 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2522 (ObjNum 1106 snap 355 seq_num 1106) dirty exists 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3586: left oid 44 (ObjNum 1106 snap 355 seq_num 1106) 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3584: done (3 left) 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3585: done (2 left) 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3586: done (1 left) 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3588: read oid 48 snap 349 2024-09-10T18:09:13.922 INFO:tasks.rados.rados.0.smithi012.stdout:3588: expect deleted 2024-09-10T18:09:13.923 INFO:tasks.rados.rados.0.smithi012.stdout:3589: copy_from oid 46 from oid 13 current snap is 355 2024-09-10T18:09:13.923 INFO:tasks.rados.rados.0.smithi012.stdout:3590: snap_create 2024-09-10T18:09:13.930 INFO:tasks.rados.rados.0.smithi012.stdout:3587: finishing copy_from racing read to smithi01278544-50 2024-09-10T18:09:13.934 INFO:tasks.rados.rados.0.smithi012.stdout:3587: finishing copy_from to smithi01278544-50 2024-09-10T18:09:13.934 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 1138 (ObjNum 1013 snap 323 seq_num 1013) dirty exists 2024-09-10T18:09:13.947 INFO:tasks.rados.rados.0.smithi012.stdout:3589: finishing copy_from racing read to smithi01278544-46 2024-09-10T18:09:13.950 INFO:tasks.rados.rados.0.smithi012.stdout:3589: finishing copy_from to smithi01278544-46 2024-09-10T18:09:13.950 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 2309 (ObjNum 1031 snap 331 seq_num 1031) dirty exists 2024-09-10T18:09:14.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:13 smithi012 ceph-mon[89611]: pgmap v878: 121 pgs: 121 active+clean; 253 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 272 KiB/s wr, 5 op/s 2024-09-10T18:09:14.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:13 smithi012 ceph-mon[92029]: pgmap v878: 121 pgs: 121 active+clean; 253 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 272 KiB/s wr, 5 op/s 2024-09-10T18:09:14.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:13 smithi089 ceph-mon[84132]: pgmap v878: 121 pgs: 121 active+clean; 253 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 272 KiB/s wr, 5 op/s 2024-09-10T18:09:14.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:09:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:09:14] "GET /metrics HTTP/1.1" 200 36357 "" "Prometheus/2.51.0" 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:3587: done (3 left) 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:3588: done (2 left) 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:3589: done (1 left) 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:3590: done (0 left) 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:3591: rollback oid 40 current snap is 356 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 40 to 338 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:3592: read oid 10 snap -1 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:3592: expect (ObjNum 1004 snap 319 seq_num 1004) 2024-09-10T18:09:14.866 INFO:tasks.rados.rados.0.smithi012.stdout:3593: rollback oid 39 current snap is 356 2024-09-10T18:09:14.867 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 352 2024-09-10T18:09:14.867 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 356 2024-09-10T18:09:14.867 INFO:tasks.rados.rados.0.smithi012.stdout:3594: seq_num 1107 ranges {5341184=548864,5890048=770048,6660096=434176} 2024-09-10T18:09:14.898 INFO:tasks.rados.rados.0.smithi012.stdout:3594: writing smithi01278544-50 from 5341184 to 5890048 tid 1 2024-09-10T18:09:14.902 INFO:tasks.rados.rados.0.smithi012.stdout:3594: writing smithi01278544-50 from 5890048 to 6660096 tid 2 2024-09-10T18:09:14.905 INFO:tasks.rados.rados.0.smithi012.stdout:3594: writing smithi01278544-50 from 6660096 to 7094272 tid 3 2024-09-10T18:09:14.906 INFO:tasks.rados.rados.0.smithi012.stdout:3595: read oid 22 snap -1 2024-09-10T18:09:14.906 INFO:tasks.rados.rados.0.smithi012.stdout:3595: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:09:14.906 INFO:tasks.rados.rados.0.smithi012.stdout:3596: snap_create 2024-09-10T18:09:14.906 INFO:tasks.rados.rados.0.smithi012.stdout:3591: finishing rollback tid 0 to smithi01278544-40 2024-09-10T18:09:14.906 INFO:tasks.rados.rados.0.smithi012.stdout:3591: finishing rollback tid 1 to smithi01278544-40 2024-09-10T18:09:14.906 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2482 (ObjNum 97 snap 0 seq_num 3421816607) dirty dne 2024-09-10T18:09:14.906 INFO:tasks.rados.rados.0.smithi012.stdout:3592: expect (ObjNum 1004 snap 319 seq_num 1004) 2024-09-10T18:09:14.906 INFO:tasks.rados.rados.0.smithi012.stdout:3593: finishing rollback tid 0 to smithi01278544-39 2024-09-10T18:09:14.907 INFO:tasks.rados.rados.0.smithi012.stdout:3593: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:09:14.907 INFO:tasks.rados.rados.0.smithi012.stdout:3593: finishing rollback tid 2 to smithi01278544-39 2024-09-10T18:09:14.907 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2663 (ObjNum 1085 snap 347 seq_num 1085) dirty exists 2024-09-10T18:09:14.907 INFO:tasks.rados.rados.0.smithi012.stdout:3594: finishing write tid 1 to smithi01278544-50 2024-09-10T18:09:14.907 INFO:tasks.rados.rados.0.smithi012.stdout:3594: finishing write tid 2 to smithi01278544-50 2024-09-10T18:09:14.908 INFO:tasks.rados.rados.0.smithi012.stdout:3594: finishing write tid 3 to smithi01278544-50 2024-09-10T18:09:14.908 INFO:tasks.rados.rados.0.smithi012.stdout:3594: finishing write tid 4 to smithi01278544-50 2024-09-10T18:09:14.908 INFO:tasks.rados.rados.0.smithi012.stdout:3595: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:09:14.913 INFO:tasks.rados.rados.0.smithi012.stdout:3594: finishing write tid 5 to smithi01278544-50 2024-09-10T18:09:14.914 INFO:tasks.rados.rados.0.smithi012.stdout:3594: oid 50 updating version 0 to 2060 2024-09-10T18:09:14.914 INFO:tasks.rados.rados.0.smithi012.stdout:3594: oid 50 version 2060 is already newer than 2059 2024-09-10T18:09:14.914 INFO:tasks.rados.rados.0.smithi012.stdout:3594: oid 50 updating version 2060 to 2061 2024-09-10T18:09:14.914 INFO:tasks.rados.rados.0.smithi012.stdout:3594: oid 50 version 2061 is already newer than 2058 2024-09-10T18:09:14.914 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2061 (ObjNum 1107 snap 356 seq_num 1107) dirty exists 2024-09-10T18:09:14.914 INFO:tasks.rados.rados.0.smithi012.stdout:3594: left oid 50 (ObjNum 1107 snap 356 seq_num 1107) 2024-09-10T18:09:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:14 smithi012 ceph-mon[89611]: osdmap e795: 8 total, 8 up, 8 in 2024-09-10T18:09:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:14 smithi012 ceph-mon[92029]: osdmap e795: 8 total, 8 up, 8 in 2024-09-10T18:09:15.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:14 smithi089 ceph-mon[84132]: osdmap e795: 8 total, 8 up, 8 in 2024-09-10T18:09:15.873 INFO:tasks.rados.rados.0.smithi012.stdout:3591: done (5 left) 2024-09-10T18:09:15.873 INFO:tasks.rados.rados.0.smithi012.stdout:3592: done (4 left) 2024-09-10T18:09:15.873 INFO:tasks.rados.rados.0.smithi012.stdout:3593: done (3 left) 2024-09-10T18:09:15.873 INFO:tasks.rados.rados.0.smithi012.stdout:3594: done (2 left) 2024-09-10T18:09:15.873 INFO:tasks.rados.rados.0.smithi012.stdout:3595: done (1 left) 2024-09-10T18:09:15.873 INFO:tasks.rados.rados.0.smithi012.stdout:3596: done (0 left) 2024-09-10T18:09:15.873 INFO:tasks.rados.rados.0.smithi012.stdout:3597: snap_remove snap 353 2024-09-10T18:09:16.188 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:15 smithi089 ceph-mon[84132]: osdmap e796: 8 total, 8 up, 8 in 2024-09-10T18:09:16.188 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:15 smithi089 ceph-mon[84132]: pgmap v881: 121 pgs: 121 active+clean; 255 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 692 KiB/s wr, 7 op/s 2024-09-10T18:09:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:15 smithi012 ceph-mon[89611]: osdmap e796: 8 total, 8 up, 8 in 2024-09-10T18:09:16.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:15 smithi012 ceph-mon[89611]: pgmap v881: 121 pgs: 121 active+clean; 255 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 692 KiB/s wr, 7 op/s 2024-09-10T18:09:16.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:15 smithi012 ceph-mon[92029]: osdmap e796: 8 total, 8 up, 8 in 2024-09-10T18:09:16.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:15 smithi012 ceph-mon[92029]: pgmap v881: 121 pgs: 121 active+clean; 255 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 692 KiB/s wr, 7 op/s 2024-09-10T18:09:16.872 INFO:tasks.rados.rados.0.smithi012.stdout:3597: done (0 left) 2024-09-10T18:09:16.872 INFO:tasks.rados.rados.0.smithi012.stdout:3598: setattr oid 44 current snap is 357 2024-09-10T18:09:16.874 INFO:tasks.rados.rados.0.smithi012.stdout:3599: copy_from oid 35 from oid 34 current snap is 357 2024-09-10T18:09:16.874 INFO:tasks.rados.rados.0.smithi012.stdout:3600: read oid 22 snap -1 2024-09-10T18:09:16.874 INFO:tasks.rados.rados.0.smithi012.stdout:3600: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:09:16.874 INFO:tasks.rados.rados.0.smithi012.stdout:3601: snap_remove snap 352 2024-09-10T18:09:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:16 smithi012 ceph-mon[89611]: osdmap e797: 8 total, 8 up, 8 in 2024-09-10T18:09:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:17.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:16 smithi012 ceph-mon[92029]: osdmap e797: 8 total, 8 up, 8 in 2024-09-10T18:09:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:16 smithi089 ceph-mon[84132]: osdmap e797: 8 total, 8 up, 8 in 2024-09-10T18:09:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:3599: finishing copy_from to smithi01278544-35 2024-09-10T18:09:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:3599: got expected ENOENT (src dne) 2024-09-10T18:09:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:3599: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:09:17.823 INFO:tasks.rados.rados.0.smithi012.stdout:3600: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:09:17.831 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2523 (ObjNum 1106 snap 355 seq_num 1106) dirty exists 2024-09-10T18:09:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:3598: done (3 left) 2024-09-10T18:09:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:3599: done (2 left) 2024-09-10T18:09:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:3600: done (1 left) 2024-09-10T18:09:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:3601: done (0 left) 2024-09-10T18:09:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:3602: rollback oid 50 current snap is 357 2024-09-10T18:09:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 50 to 332 2024-09-10T18:09:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 357 2024-09-10T18:09:17.832 INFO:tasks.rados.rados.0.smithi012.stdout:3603: seq_num 1108 ranges {5742592=565248,6307840=647168,6955008=483328,7438336=73728} 2024-09-10T18:09:17.867 INFO:tasks.rados.rados.0.smithi012.stdout:3603: writing smithi01278544-19 from 5742592 to 6307840 tid 1 2024-09-10T18:09:17.871 INFO:tasks.rados.rados.0.smithi012.stdout:3603: writing smithi01278544-19 from 6307840 to 6955008 tid 2 2024-09-10T18:09:17.874 INFO:tasks.rados.rados.0.smithi012.stdout:3603: writing smithi01278544-19 from 6955008 to 7438336 tid 3 2024-09-10T18:09:17.875 INFO:tasks.rados.rados.0.smithi012.stdout:3603: writing smithi01278544-19 from 7438336 to 7512064 tid 4 2024-09-10T18:09:17.875 INFO:tasks.rados.rados.0.smithi012.stdout:3604: snap_remove snap 350 2024-09-10T18:09:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:17 smithi012 ceph-mon[89611]: osdmap e798: 8 total, 8 up, 8 in 2024-09-10T18:09:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:17 smithi012 ceph-mon[89611]: pgmap v884: 121 pgs: 121 active+clean; 274 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 22 op/s 2024-09-10T18:09:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:17 smithi012 ceph-mon[89611]: osdmap e799: 8 total, 8 up, 8 in 2024-09-10T18:09:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:17 smithi012 ceph-mon[92029]: osdmap e798: 8 total, 8 up, 8 in 2024-09-10T18:09:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:17 smithi012 ceph-mon[92029]: pgmap v884: 121 pgs: 121 active+clean; 274 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 22 op/s 2024-09-10T18:09:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:17 smithi012 ceph-mon[92029]: osdmap e799: 8 total, 8 up, 8 in 2024-09-10T18:09:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:17 smithi089 ceph-mon[84132]: osdmap e798: 8 total, 8 up, 8 in 2024-09-10T18:09:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:17 smithi089 ceph-mon[84132]: pgmap v884: 121 pgs: 121 active+clean; 274 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 22 op/s 2024-09-10T18:09:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:17 smithi089 ceph-mon[84132]: osdmap e799: 8 total, 8 up, 8 in 2024-09-10T18:09:18.886 INFO:tasks.rados.rados.0.smithi012.stdout:3604: done (2 left) 2024-09-10T18:09:18.887 INFO:tasks.rados.rados.0.smithi012.stdout:3605: read oid 17 snap -1 2024-09-10T18:09:18.887 INFO:tasks.rados.rados.0.smithi012.stdout:3605: expect (ObjNum 1076 snap 346 seq_num 1076) 2024-09-10T18:09:18.887 INFO:tasks.rados.rados.0.smithi012.stdout:3606: setattr oid 2 current snap is 357 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3602: finishing rollback tid 0 to smithi01278544-50 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3602: finishing rollback tid 1 to smithi01278544-50 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3602: finishing rollback tid 2 to smithi01278544-50 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2064 (ObjNum 1027 snap 328 seq_num 1027) dirty exists 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3603: finishing write tid 1 to smithi01278544-19 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3603: finishing write tid 2 to smithi01278544-19 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3603: finishing write tid 3 to smithi01278544-19 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3603: finishing write tid 4 to smithi01278544-19 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3603: finishing write tid 5 to smithi01278544-19 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3603: finishing write tid 6 to smithi01278544-19 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3603: oid 19 updating version 0 to 2327 2024-09-10T18:09:18.888 INFO:tasks.rados.rados.0.smithi012.stdout:3603: oid 19 version 2327 is already newer than 2326 2024-09-10T18:09:18.889 INFO:tasks.rados.rados.0.smithi012.stdout:3603: oid 19 updating version 2327 to 2328 2024-09-10T18:09:18.889 INFO:tasks.rados.rados.0.smithi012.stdout:3603: oid 19 version 2328 is already newer than 2324 2024-09-10T18:09:18.889 INFO:tasks.rados.rados.0.smithi012.stdout:3603: oid 19 version 2328 is already newer than 2325 2024-09-10T18:09:18.889 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 2328 (ObjNum 1108 snap 357 seq_num 1108) dirty exists 2024-09-10T18:09:18.889 INFO:tasks.rados.rados.0.smithi012.stdout:3603: left oid 19 (ObjNum 1108 snap 357 seq_num 1108) 2024-09-10T18:09:18.889 INFO:tasks.rados.rados.0.smithi012.stdout:3602: done (3 left) 2024-09-10T18:09:18.889 INFO:tasks.rados.rados.0.smithi012.stdout:3603: done (2 left) 2024-09-10T18:09:18.890 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 357 2024-09-10T18:09:18.890 INFO:tasks.rados.rados.0.smithi012.stdout:3607: seq_num 1109 ranges {1531904=581632,2113536=532480,2646016=647168,3293184=24576} 2024-09-10T18:09:18.902 INFO:tasks.rados.rados.0.smithi012.stdout:3607: writing smithi01278544-49 from 1531904 to 2113536 tid 1 2024-09-10T18:09:18.905 INFO:tasks.rados.rados.0.smithi012.stdout:3607: writing smithi01278544-49 from 2113536 to 2646016 tid 2 2024-09-10T18:09:18.909 INFO:tasks.rados.rados.0.smithi012.stdout:3607: writing smithi01278544-49 from 2646016 to 3293184 tid 3 2024-09-10T18:09:18.910 INFO:tasks.rados.rados.0.smithi012.stdout:3607: writing smithi01278544-49 from 3293184 to 3317760 tid 4 2024-09-10T18:09:18.910 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 357 2024-09-10T18:09:18.910 INFO:tasks.rados.rados.0.smithi012.stdout:3608: seq_num 1110 ranges {5742592=598016,6340608=466944,6807552=450560,7258112=286720} 2024-09-10T18:09:18.944 INFO:tasks.rados.rados.0.smithi012.stdout:3608: writing smithi01278544-28 from 5742592 to 6340608 tid 1 2024-09-10T18:09:18.947 INFO:tasks.rados.rados.0.smithi012.stdout:3608: writing smithi01278544-28 from 6340608 to 6807552 tid 2 2024-09-10T18:09:18.949 INFO:tasks.rados.rados.0.smithi012.stdout:3608: writing smithi01278544-28 from 6807552 to 7258112 tid 3 2024-09-10T18:09:18.951 INFO:tasks.rados.rados.0.smithi012.stdout:3608: writing smithi01278544-28 from 7258112 to 7544832 tid 4 2024-09-10T18:09:18.951 INFO:tasks.rados.rados.0.smithi012.stdout:3609: copy_from oid 36 from oid 5 current snap is 357 2024-09-10T18:09:18.951 INFO:tasks.rados.rados.0.smithi012.stdout:3605: expect (ObjNum 1076 snap 346 seq_num 1076) 2024-09-10T18:09:18.984 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2342 (ObjNum 1105 snap 355 seq_num 1105) dirty exists 2024-09-10T18:09:18.985 INFO:tasks.rados.rados.0.smithi012.stdout:3607: finishing write tid 1 to smithi01278544-49 2024-09-10T18:09:18.985 INFO:tasks.rados.rados.0.smithi012.stdout:3607: finishing write tid 2 to smithi01278544-49 2024-09-10T18:09:18.985 INFO:tasks.rados.rados.0.smithi012.stdout:3605: done (4 left) 2024-09-10T18:09:18.985 INFO:tasks.rados.rados.0.smithi012.stdout:3606: done (3 left) 2024-09-10T18:09:18.985 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 357 2024-09-10T18:09:18.985 INFO:tasks.rados.rados.0.smithi012.stdout:3607: finishing write tid 3 to smithi01278544-49 2024-09-10T18:09:18.985 INFO:tasks.rados.rados.0.smithi012.stdout:3610: seq_num 1111 ranges {1114112=614400,1728512=753664,2482176=450560} 2024-09-10T18:09:18.994 INFO:tasks.rados.rados.0.smithi012.stdout:3610: writing smithi01278544-25 from 1114112 to 1728512 tid 1 2024-09-10T18:09:18.998 INFO:tasks.rados.rados.0.smithi012.stdout:3610: writing smithi01278544-25 from 1728512 to 2482176 tid 2 2024-09-10T18:09:19.001 INFO:tasks.rados.rados.0.smithi012.stdout:3610: writing smithi01278544-25 from 2482176 to 2932736 tid 3 2024-09-10T18:09:19.001 INFO:tasks.rados.rados.0.smithi012.stdout:3611: copy_from oid 40 from oid 26 current snap is 357 2024-09-10T18:09:19.001 INFO:tasks.rados.rados.0.smithi012.stdout:3607: finishing write tid 4 to smithi01278544-49 2024-09-10T18:09:19.001 INFO:tasks.rados.rados.0.smithi012.stdout:3607: finishing write tid 5 to smithi01278544-49 2024-09-10T18:09:19.001 INFO:tasks.rados.rados.0.smithi012.stdout:3607: finishing write tid 6 to smithi01278544-49 2024-09-10T18:09:19.001 INFO:tasks.rados.rados.0.smithi012.stdout:3607: oid 49 updating version 0 to 2347 2024-09-10T18:09:19.001 INFO:tasks.rados.rados.0.smithi012.stdout:3607: oid 49 version 2347 is already newer than 2343 2024-09-10T18:09:19.001 INFO:tasks.rados.rados.0.smithi012.stdout:3607: oid 49 version 2347 is already newer than 2346 2024-09-10T18:09:19.002 INFO:tasks.rados.rados.0.smithi012.stdout:3607: oid 49 version 2347 is already newer than 2345 2024-09-10T18:09:19.002 INFO:tasks.rados.rados.0.smithi012.stdout:3607: oid 49 version 2347 is already newer than 2344 2024-09-10T18:09:19.002 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 2347 (ObjNum 1109 snap 357 seq_num 1109) dirty exists 2024-09-10T18:09:19.002 INFO:tasks.rados.rados.0.smithi012.stdout:3607: left oid 49 (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:09:19.002 INFO:tasks.rados.rados.0.smithi012.stdout:3608: finishing write tid 1 to smithi01278544-28 2024-09-10T18:09:19.002 INFO:tasks.rados.rados.0.smithi012.stdout:3608: finishing write tid 2 to smithi01278544-28 2024-09-10T18:09:19.002 INFO:tasks.rados.rados.0.smithi012.stdout:3607: done (4 left) 2024-09-10T18:09:19.002 INFO:tasks.rados.rados.0.smithi012.stdout:3612: snap_remove snap 332 2024-09-10T18:09:19.895 INFO:tasks.rados.rados.0.smithi012.stdout:3612: done (4 left) 2024-09-10T18:09:19.895 INFO:tasks.rados.rados.0.smithi012.stdout:3613: rollback oid 16 current snap is 357 2024-09-10T18:09:19.895 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 16 to 354 2024-09-10T18:09:19.895 INFO:tasks.rados.rados.0.smithi012.stdout:3608: finishing write tid 3 to smithi01278544-28 2024-09-10T18:09:19.895 INFO:tasks.rados.rados.0.smithi012.stdout:3608: finishing write tid 4 to smithi01278544-28 2024-09-10T18:09:19.895 INFO:tasks.rados.rados.0.smithi012.stdout:3608: finishing write tid 5 to smithi01278544-28 2024-09-10T18:09:19.895 INFO:tasks.rados.rados.0.smithi012.stdout:3608: finishing write tid 6 to smithi01278544-28 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3608: oid 28 updating version 0 to 1328 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3608: oid 28 version 1328 is already newer than 1324 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3608: oid 28 version 1328 is already newer than 1326 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3608: oid 28 version 1328 is already newer than 1327 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3608: oid 28 version 1328 is already newer than 1325 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1328 (ObjNum 1110 snap 357 seq_num 1110) dirty exists 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3608: left oid 28 (ObjNum 1110 snap 357 seq_num 1110) 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3609: finishing copy_from racing read to smithi01278544-36 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3609: finishing copy_from to smithi01278544-36 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 2044 (ObjNum 1097 snap 351 seq_num 1097) dirty exists 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3610: finishing write tid 1 to smithi01278544-25 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3610: finishing write tid 2 to smithi01278544-25 2024-09-10T18:09:19.896 INFO:tasks.rados.rados.0.smithi012.stdout:3610: finishing write tid 3 to smithi01278544-25 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3610: finishing write tid 4 to smithi01278544-25 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3610: finishing write tid 5 to smithi01278544-25 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3610: oid 25 updating version 0 to 2684 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3610: oid 25 version 2684 is already newer than 2682 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3610: oid 25 version 2684 is already newer than 2683 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3610: oid 25 version 2684 is already newer than 2681 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 2684 (ObjNum 1111 snap 357 seq_num 1111) dirty exists 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3610: left oid 25 (ObjNum 1111 snap 357 seq_num 1111) 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3611: finishing copy_from racing read to smithi01278544-40 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3611: finishing copy_from to smithi01278544-40 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2055 (ObjNum 1103 snap 354 seq_num 1103) dirty exists 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3608: done (4 left) 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3609: done (3 left) 2024-09-10T18:09:19.897 INFO:tasks.rados.rados.0.smithi012.stdout:3610: done (2 left) 2024-09-10T18:09:19.898 INFO:tasks.rados.rados.0.smithi012.stdout:3611: done (1 left) 2024-09-10T18:09:19.898 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 357 2024-09-10T18:09:19.898 INFO:tasks.rados.rados.0.smithi012.stdout:3614: seq_num 1112 ranges {0=630784,630784=638976,1269760=466944,1736704=98304} 2024-09-10T18:09:19.898 INFO:tasks.rados.rados.0.smithi012.stdout:3614: writing smithi01278544-33 from 0 to 630784 tid 1 2024-09-10T18:09:19.903 INFO:tasks.rados.rados.0.smithi012.stdout:3614: writing smithi01278544-33 from 630784 to 1269760 tid 2 2024-09-10T18:09:19.906 INFO:tasks.rados.rados.0.smithi012.stdout:3614: writing smithi01278544-33 from 1269760 to 1736704 tid 3 2024-09-10T18:09:19.907 INFO:tasks.rados.rados.0.smithi012.stdout:3614: writing smithi01278544-33 from 1736704 to 1835008 tid 4 2024-09-10T18:09:19.907 INFO:tasks.rados.rados.0.smithi012.stdout:3615: read oid 7 snap 349 2024-09-10T18:09:19.907 INFO:tasks.rados.rados.0.smithi012.stdout:3615: expect (ObjNum 1092 snap 349 seq_num 1092) 2024-09-10T18:09:19.907 INFO:tasks.rados.rados.0.smithi012.stdout:3616: snap_remove snap 338 2024-09-10T18:09:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:19 smithi012 ceph-mon[89611]: osdmap e800: 8 total, 8 up, 8 in 2024-09-10T18:09:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:19 smithi012 ceph-mon[89611]: pgmap v887: 121 pgs: 121 active+clean; 274 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 26 op/s 2024-09-10T18:09:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:19 smithi012 ceph-mon[92029]: osdmap e800: 8 total, 8 up, 8 in 2024-09-10T18:09:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:19 smithi012 ceph-mon[92029]: pgmap v887: 121 pgs: 121 active+clean; 274 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 26 op/s 2024-09-10T18:09:20.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:19 smithi089 ceph-mon[84132]: osdmap e800: 8 total, 8 up, 8 in 2024-09-10T18:09:20.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:19 smithi089 ceph-mon[84132]: pgmap v887: 121 pgs: 121 active+clean; 274 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 26 op/s 2024-09-10T18:09:20.895 INFO:tasks.rados.rados.0.smithi012.stdout:3616: done (3 left) 2024-09-10T18:09:20.895 INFO:tasks.rados.rados.0.smithi012.stdout:3617: copy_from oid 17 from oid 31 current snap is 357 2024-09-10T18:09:20.895 INFO:tasks.rados.rados.0.smithi012.stdout:3618: snap_remove snap 348 2024-09-10T18:09:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:20 smithi012 ceph-mon[89611]: osdmap e801: 8 total, 8 up, 8 in 2024-09-10T18:09:21.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:20 smithi012 ceph-mon[92029]: osdmap e801: 8 total, 8 up, 8 in 2024-09-10T18:09:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:20 smithi089 ceph-mon[84132]: osdmap e801: 8 total, 8 up, 8 in 2024-09-10T18:09:21.900 INFO:tasks.rados.rados.0.smithi012.stdout:3618: done (4 left) 2024-09-10T18:09:21.900 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 357 2024-09-10T18:09:21.900 INFO:tasks.rados.rados.0.smithi012.stdout:3619: seq_num 1113 ranges {7512064=647168,8159232=524288,8683520=622592,9306112=57344} 2024-09-10T18:09:21.945 INFO:tasks.rados.rados.0.smithi012.stdout:3619: writing smithi01278544-19 from 7512064 to 8159232 tid 1 2024-09-10T18:09:21.948 INFO:tasks.rados.rados.0.smithi012.stdout:3619: writing smithi01278544-19 from 8159232 to 8683520 tid 2 2024-09-10T18:09:21.952 INFO:tasks.rados.rados.0.smithi012.stdout:3619: writing smithi01278544-19 from 8683520 to 9306112 tid 3 2024-09-10T18:09:21.953 INFO:tasks.rados.rados.0.smithi012.stdout:3619: writing smithi01278544-19 from 9306112 to 9363456 tid 4 2024-09-10T18:09:21.953 INFO:tasks.rados.rados.0.smithi012.stdout:3613: finishing rollback tid 0 to smithi01278544-16 2024-09-10T18:09:21.953 INFO:tasks.rados.rados.0.smithi012.stdout:3613: finishing rollback tid 1 to smithi01278544-16 2024-09-10T18:09:21.953 INFO:tasks.rados.rados.0.smithi012.stdout:3613: finishing rollback tid 2 to smithi01278544-16 2024-09-10T18:09:21.953 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 2487 (ObjNum 1100 snap 354 seq_num 1100) dirty exists 2024-09-10T18:09:21.953 INFO:tasks.rados.rados.0.smithi012.stdout:3614: finishing write tid 1 to smithi01278544-33 2024-09-10T18:09:21.954 INFO:tasks.rados.rados.0.smithi012.stdout:3613: done (4 left) 2024-09-10T18:09:21.954 INFO:tasks.rados.rados.0.smithi012.stdout:3620: snap_create 2024-09-10T18:09:21.954 INFO:tasks.rados.rados.0.smithi012.stdout:3614: finishing write tid 2 to smithi01278544-33 2024-09-10T18:09:21.954 INFO:tasks.rados.rados.0.smithi012.stdout:3614: finishing write tid 3 to smithi01278544-33 2024-09-10T18:09:21.954 INFO:tasks.rados.rados.0.smithi012.stdout:3614: finishing write tid 4 to smithi01278544-33 2024-09-10T18:09:21.954 INFO:tasks.rados.rados.0.smithi012.stdout:3614: finishing write tid 5 to smithi01278544-33 2024-09-10T18:09:21.954 INFO:tasks.rados.rados.0.smithi012.stdout:3615: expect (ObjNum 1092 snap 349 seq_num 1092) 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:3614: finishing write tid 6 to smithi01278544-33 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:3614: oid 33 updating version 0 to 2485 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:3614: oid 33 updating version 2485 to 2486 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:3614: oid 33 version 2486 is already newer than 2483 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:3614: oid 33 version 2486 is already newer than 2484 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:3614: oid 33 updating version 2486 to 2487 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 2487 (ObjNum 1112 snap 357 seq_num 1112) dirty exists 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:3614: left oid 33 (ObjNum 1112 snap 357 seq_num 1112) 2024-09-10T18:09:21.994 INFO:tasks.rados.rados.0.smithi012.stdout:3617: finishing copy_from racing read to smithi01278544-17 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3617: finishing copy_from to smithi01278544-17 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2195 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: finishing write tid 1 to smithi01278544-19 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: finishing write tid 2 to smithi01278544-19 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: finishing write tid 3 to smithi01278544-19 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: finishing write tid 4 to smithi01278544-19 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: finishing write tid 5 to smithi01278544-19 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: finishing write tid 6 to smithi01278544-19 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: oid 19 updating version 0 to 2332 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: oid 19 updating version 2332 to 2333 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: oid 19 version 2333 is already newer than 2331 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: oid 19 version 2333 is already newer than 2329 2024-09-10T18:09:21.995 INFO:tasks.rados.rados.0.smithi012.stdout:3619: oid 19 version 2333 is already newer than 2330 2024-09-10T18:09:21.996 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 2333 (ObjNum 1113 snap 357 seq_num 1113) dirty exists 2024-09-10T18:09:21.996 INFO:tasks.rados.rados.0.smithi012.stdout:3619: left oid 19 (ObjNum 1113 snap 357 seq_num 1113) 2024-09-10T18:09:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:21 smithi012 ceph-mon[89611]: osdmap e802: 8 total, 8 up, 8 in 2024-09-10T18:09:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:21 smithi012 ceph-mon[89611]: pgmap v890: 121 pgs: 121 active+clean; 253 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 901 KiB/s rd, 846 KiB/s wr, 14 op/s 2024-09-10T18:09:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:21 smithi012 ceph-mon[92029]: osdmap e802: 8 total, 8 up, 8 in 2024-09-10T18:09:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:21 smithi012 ceph-mon[92029]: pgmap v890: 121 pgs: 121 active+clean; 253 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 901 KiB/s rd, 846 KiB/s wr, 14 op/s 2024-09-10T18:09:22.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:21 smithi089 ceph-mon[84132]: osdmap e802: 8 total, 8 up, 8 in 2024-09-10T18:09:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:21 smithi089 ceph-mon[84132]: pgmap v890: 121 pgs: 121 active+clean; 253 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 901 KiB/s rd, 846 KiB/s wr, 14 op/s 2024-09-10T18:09:22.827 INFO:tasks.rados.rados.0.smithi012.stdout:3614: done (4 left) 2024-09-10T18:09:22.827 INFO:tasks.rados.rados.0.smithi012.stdout:3615: done (3 left) 2024-09-10T18:09:22.827 INFO:tasks.rados.rados.0.smithi012.stdout:3617: done (2 left) 2024-09-10T18:09:22.827 INFO:tasks.rados.rados.0.smithi012.stdout:3619: done (1 left) 2024-09-10T18:09:22.827 INFO:tasks.rados.rados.0.smithi012.stdout:3620: done (0 left) 2024-09-10T18:09:22.827 INFO:tasks.rados.rados.0.smithi012.stdout:3621: snap_remove snap 357 2024-09-10T18:09:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:22 smithi012 ceph-mon[89611]: osdmap e803: 8 total, 8 up, 8 in 2024-09-10T18:09:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:22 smithi012 ceph-mon[89611]: osdmap e804: 8 total, 8 up, 8 in 2024-09-10T18:09:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:22 smithi012 ceph-mon[92029]: osdmap e803: 8 total, 8 up, 8 in 2024-09-10T18:09:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:22 smithi012 ceph-mon[92029]: osdmap e804: 8 total, 8 up, 8 in 2024-09-10T18:09:23.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:22 smithi089 ceph-mon[84132]: osdmap e803: 8 total, 8 up, 8 in 2024-09-10T18:09:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:22 smithi089 ceph-mon[84132]: osdmap e804: 8 total, 8 up, 8 in 2024-09-10T18:09:23.829 INFO:tasks.rados.rados.0.smithi012.stdout:3621: done (0 left) 2024-09-10T18:09:23.829 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 358 2024-09-10T18:09:23.829 INFO:tasks.rados.rados.0.smithi012.stdout:3622: seq_num 1114 ranges {5562368=663552,6225920=802816,7028736=401408} 2024-09-10T18:09:23.863 INFO:tasks.rados.rados.0.smithi012.stdout:3622: writing smithi01278544-20 from 5562368 to 6225920 tid 1 2024-09-10T18:09:23.867 INFO:tasks.rados.rados.0.smithi012.stdout:3622: writing smithi01278544-20 from 6225920 to 7028736 tid 2 2024-09-10T18:09:23.870 INFO:tasks.rados.rados.0.smithi012.stdout:3622: writing smithi01278544-20 from 7028736 to 7430144 tid 3 2024-09-10T18:09:23.870 INFO:tasks.rados.rados.0.smithi012.stdout:3623: read oid 45 snap -1 2024-09-10T18:09:23.870 INFO:tasks.rados.rados.0.smithi012.stdout:3623: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:09:23.870 INFO:tasks.rados.rados.0.smithi012.stdout:3624: snap_remove snap 356 2024-09-10T18:09:24.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:09:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:09:24] "GET /metrics HTTP/1.1" 200 36356 "" "Prometheus/2.51.0" 2024-09-10T18:09:24.836 INFO:tasks.rados.rados.0.smithi012.stdout:3624: done (2 left) 2024-09-10T18:09:24.837 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 358 2024-09-10T18:09:24.837 INFO:tasks.rados.rados.0.smithi012.stdout:3625: seq_num 1115 ranges {188416=679936,868352=688128,1556480=516096} 2024-09-10T18:09:24.842 INFO:tasks.rados.rados.0.smithi012.stdout:3625: writing smithi01278544-22 from 188416 to 868352 tid 1 2024-09-10T18:09:24.847 INFO:tasks.rados.rados.0.smithi012.stdout:3625: writing smithi01278544-22 from 868352 to 1556480 tid 2 2024-09-10T18:09:24.851 INFO:tasks.rados.rados.0.smithi012.stdout:3625: writing smithi01278544-22 from 1556480 to 2072576 tid 3 2024-09-10T18:09:24.851 INFO:tasks.rados.rados.0.smithi012.stdout:3623: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:09:24.895 INFO:tasks.rados.rados.0.smithi012.stdout:3622: finishing write tid 1 to smithi01278544-20 2024-09-10T18:09:24.895 INFO:tasks.rados.rados.0.smithi012.stdout:3622: finishing write tid 2 to smithi01278544-20 2024-09-10T18:09:24.895 INFO:tasks.rados.rados.0.smithi012.stdout:3622: finishing write tid 3 to smithi01278544-20 2024-09-10T18:09:24.895 INFO:tasks.rados.rados.0.smithi012.stdout:3622: finishing write tid 4 to smithi01278544-20 2024-09-10T18:09:24.895 INFO:tasks.rados.rados.0.smithi012.stdout:3623: done (2 left) 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3626: setattr oid 44 current snap is 358 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3622: finishing write tid 5 to smithi01278544-20 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3622: oid 20 updating version 0 to 2723 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3622: oid 20 version 2723 is already newer than 2720 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3622: oid 20 version 2723 is already newer than 2721 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3622: oid 20 version 2723 is already newer than 2722 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2723 (ObjNum 1114 snap 358 seq_num 1114) dirty exists 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3622: left oid 20 (ObjNum 1114 snap 358 seq_num 1114) 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3625: finishing write tid 1 to smithi01278544-22 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3625: finishing write tid 2 to smithi01278544-22 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3625: finishing write tid 3 to smithi01278544-22 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3625: finishing write tid 4 to smithi01278544-22 2024-09-10T18:09:24.896 INFO:tasks.rados.rados.0.smithi012.stdout:3625: finishing write tid 5 to smithi01278544-22 2024-09-10T18:09:24.897 INFO:tasks.rados.rados.0.smithi012.stdout:3625: oid 22 updating version 0 to 2732 2024-09-10T18:09:24.897 INFO:tasks.rados.rados.0.smithi012.stdout:3625: oid 22 version 2732 is already newer than 2731 2024-09-10T18:09:24.897 INFO:tasks.rados.rados.0.smithi012.stdout:3625: oid 22 version 2732 is already newer than 2725 2024-09-10T18:09:24.897 INFO:tasks.rados.rados.0.smithi012.stdout:3625: oid 22 version 2732 is already newer than 2730 2024-09-10T18:09:24.897 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2732 (ObjNum 1115 snap 358 seq_num 1115) dirty exists 2024-09-10T18:09:24.897 INFO:tasks.rados.rados.0.smithi012.stdout:3625: left oid 22 (ObjNum 1115 snap 358 seq_num 1115) 2024-09-10T18:09:24.897 INFO:tasks.rados.rados.0.smithi012.stdout:3622: done (2 left) 2024-09-10T18:09:24.897 INFO:tasks.rados.rados.0.smithi012.stdout:3625: done (1 left) 2024-09-10T18:09:24.898 INFO:tasks.rados.rados.0.smithi012.stdout:3627: snap_create 2024-09-10T18:09:24.900 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2524 (ObjNum 1106 snap 355 seq_num 1106) dirty exists 2024-09-10T18:09:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:24 smithi012 ceph-mon[89611]: pgmap v893: 121 pgs: 121 active+clean; 239 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-09-10T18:09:25.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:24 smithi012 ceph-mon[89611]: osdmap e805: 8 total, 8 up, 8 in 2024-09-10T18:09:25.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:24 smithi012 ceph-mon[92029]: pgmap v893: 121 pgs: 121 active+clean; 239 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-09-10T18:09:25.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:24 smithi012 ceph-mon[92029]: osdmap e805: 8 total, 8 up, 8 in 2024-09-10T18:09:25.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:24 smithi089 ceph-mon[84132]: pgmap v893: 121 pgs: 121 active+clean; 239 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-09-10T18:09:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:24 smithi089 ceph-mon[84132]: osdmap e805: 8 total, 8 up, 8 in 2024-09-10T18:09:25.842 INFO:tasks.rados.rados.0.smithi012.stdout:3626: done (1 left) 2024-09-10T18:09:25.842 INFO:tasks.rados.rados.0.smithi012.stdout:3627: done (0 left) 2024-09-10T18:09:25.842 INFO:tasks.rados.rados.0.smithi012.stdout:3628: delete oid 11 current snap is 359 2024-09-10T18:09:25.848 INFO:tasks.rados.rados.0.smithi012.stdout:3628: done (0 left) 2024-09-10T18:09:25.848 INFO:tasks.rados.rados.0.smithi012.stdout:3629: snap_remove snap 349 2024-09-10T18:09:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:25 smithi012 ceph-mon[89611]: osdmap e806: 8 total, 8 up, 8 in 2024-09-10T18:09:26.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:25 smithi012 ceph-mon[92029]: osdmap e806: 8 total, 8 up, 8 in 2024-09-10T18:09:26.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:25 smithi089 ceph-mon[84132]: osdmap e806: 8 total, 8 up, 8 in 2024-09-10T18:09:26.845 INFO:tasks.rados.rados.0.smithi012.stdout:3629: done (0 left) 2024-09-10T18:09:26.845 INFO:tasks.rados.rados.0.smithi012.stdout:3630: read oid 26 snap -1 2024-09-10T18:09:26.845 INFO:tasks.rados.rados.0.smithi012.stdout:3630: expect (ObjNum 1103 snap 354 seq_num 1103) 2024-09-10T18:09:26.845 INFO:tasks.rados.rados.0.smithi012.stdout:3631: read oid 1 snap 358 2024-09-10T18:09:26.845 INFO:tasks.rados.rados.0.smithi012.stdout:3631: expect (ObjNum -796927232 snap 22079 seq_num 3496314288) 2024-09-10T18:09:26.845 INFO:tasks.rados.rados.0.smithi012.stdout:3632: snap_create 2024-09-10T18:09:26.852 INFO:tasks.rados.rados.0.smithi012.stdout:3631: expect (ObjNum -796927232 snap 22079 seq_num 3496314288) 2024-09-10T18:09:26.891 INFO:tasks.rados.rados.0.smithi012.stdout:3630: expect (ObjNum 1103 snap 354 seq_num 1103) 2024-09-10T18:09:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:26 smithi012 ceph-mon[89611]: pgmap v896: 121 pgs: 121 active+clean; 239 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-09-10T18:09:27.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:26 smithi012 ceph-mon[89611]: osdmap e807: 8 total, 8 up, 8 in 2024-09-10T18:09:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:26 smithi012 ceph-mon[92029]: pgmap v896: 121 pgs: 121 active+clean; 239 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-09-10T18:09:27.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:26 smithi012 ceph-mon[92029]: osdmap e807: 8 total, 8 up, 8 in 2024-09-10T18:09:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:26 smithi089 ceph-mon[84132]: pgmap v896: 121 pgs: 121 active+clean; 239 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-09-10T18:09:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:26 smithi089 ceph-mon[84132]: osdmap e807: 8 total, 8 up, 8 in 2024-09-10T18:09:27.828 INFO:tasks.rados.rados.0.smithi012.stdout:3630: done (2 left) 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:3631: done (1 left) 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:3632: done (0 left) 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:3633: rollback oid 39 current snap is 360 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 344 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:3634: rmattr oid 17 current snap is 360 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:3634: done (1 left) 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:3635: rollback oid 14 current snap is 360 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 14 to 359 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 360 2024-09-10T18:09:27.829 INFO:tasks.rados.rados.0.smithi012.stdout:3636: seq_num 1117 ranges {7544832=712704,8257536=458752,8716288=655360,9371648=90112} 2024-09-10T18:09:27.874 INFO:tasks.rados.rados.0.smithi012.stdout:3636: writing smithi01278544-28 from 7544832 to 8257536 tid 1 2024-09-10T18:09:27.876 INFO:tasks.rados.rados.0.smithi012.stdout:3636: writing smithi01278544-28 from 8257536 to 8716288 tid 2 2024-09-10T18:09:27.880 INFO:tasks.rados.rados.0.smithi012.stdout:3636: writing smithi01278544-28 from 8716288 to 9371648 tid 3 2024-09-10T18:09:27.881 INFO:tasks.rados.rados.0.smithi012.stdout:3636: writing smithi01278544-28 from 9371648 to 9461760 tid 4 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3637: read oid 21 snap -1 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3637: expect (ObjNum 1090 snap 349 seq_num 1090) 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3638: delete oid 34 current snap is 360 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3635: finishing rollback tid 0 to smithi01278544-14 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3635: finishing rollback tid 1 to smithi01278544-14 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3635: finishing rollback tid 2 to smithi01278544-14 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 2511 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3633: finishing rollback tid 0 to smithi01278544-39 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3633: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3633: finishing rollback tid 2 to smithi01278544-39 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2750 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:09:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3636: finishing write tid 1 to smithi01278544-28 2024-09-10T18:09:27.883 INFO:tasks.rados.rados.0.smithi012.stdout:3636: finishing write tid 2 to smithi01278544-28 2024-09-10T18:09:27.885 INFO:tasks.rados.rados.0.smithi012.stdout:3636: finishing write tid 3 to smithi01278544-28 2024-09-10T18:09:27.885 INFO:tasks.rados.rados.0.smithi012.stdout:3636: finishing write tid 4 to smithi01278544-28 2024-09-10T18:09:27.885 INFO:tasks.rados.rados.0.smithi012.stdout:3636: finishing write tid 5 to smithi01278544-28 2024-09-10T18:09:27.887 INFO:tasks.rados.rados.0.smithi012.stdout:3636: finishing write tid 6 to smithi01278544-28 2024-09-10T18:09:27.887 INFO:tasks.rados.rados.0.smithi012.stdout:3636: oid 28 updating version 0 to 1330 2024-09-10T18:09:27.887 INFO:tasks.rados.rados.0.smithi012.stdout:3636: oid 28 updating version 1330 to 1332 2024-09-10T18:09:27.888 INFO:tasks.rados.rados.0.smithi012.stdout:3636: oid 28 version 1332 is already newer than 1331 2024-09-10T18:09:27.888 INFO:tasks.rados.rados.0.smithi012.stdout:3636: oid 28 version 1332 is already newer than 1329 2024-09-10T18:09:27.888 INFO:tasks.rados.rados.0.smithi012.stdout:3636: oid 28 updating version 1332 to 1333 2024-09-10T18:09:27.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1333 (ObjNum 1117 snap 360 seq_num 1117) dirty exists 2024-09-10T18:09:27.888 INFO:tasks.rados.rados.0.smithi012.stdout:3636: left oid 28 (ObjNum 1117 snap 360 seq_num 1117) 2024-09-10T18:09:27.889 INFO:tasks.rados.rados.0.smithi012.stdout:3637: expect (ObjNum 1090 snap 349 seq_num 1090) 2024-09-10T18:09:27.937 INFO:tasks.rados.rados.0.smithi012.stdout:3633: done (4 left) 2024-09-10T18:09:27.937 INFO:tasks.rados.rados.0.smithi012.stdout:3635: done (3 left) 2024-09-10T18:09:27.938 INFO:tasks.rados.rados.0.smithi012.stdout:3636: done (2 left) 2024-09-10T18:09:27.938 INFO:tasks.rados.rados.0.smithi012.stdout:3637: done (1 left) 2024-09-10T18:09:27.938 INFO:tasks.rados.rados.0.smithi012.stdout:3638: done (0 left) 2024-09-10T18:09:27.938 INFO:tasks.rados.rados.0.smithi012.stdout:3639: delete oid 50 current snap is 360 2024-09-10T18:09:27.939 INFO:tasks.rados.rados.0.smithi012.stdout:3639: done (0 left) 2024-09-10T18:09:27.939 INFO:tasks.rados.rados.0.smithi012.stdout:3640: snap_create 2024-09-10T18:09:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: osdmap e808: 8 total, 8 up, 8 in 2024-09-10T18:09:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:09:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: pgmap v899: 121 pgs: 121 active+clean; 241 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-09-10T18:09:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:09:28.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:09:28.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[89611]: osdmap e809: 8 total, 8 up, 8 in 2024-09-10T18:09:28.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: osdmap e808: 8 total, 8 up, 8 in 2024-09-10T18:09:28.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:09:28.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: pgmap v899: 121 pgs: 121 active+clean; 241 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-09-10T18:09:28.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:09:28.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:09:28.287 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.288 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:27 smithi012 ceph-mon[92029]: osdmap e809: 8 total, 8 up, 8 in 2024-09-10T18:09:28.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: osdmap e808: 8 total, 8 up, 8 in 2024-09-10T18:09:28.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:09:28.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: pgmap v899: 121 pgs: 121 active+clean; 241 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-09-10T18:09:28.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:09:28.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:09:28.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:09:28.289 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:27 smithi089 ceph-mon[84132]: osdmap e809: 8 total, 8 up, 8 in 2024-09-10T18:09:28.867 INFO:tasks.rados.rados.0.smithi012.stdout:3640: done (0 left) 2024-09-10T18:09:28.868 INFO:tasks.rados.rados.0.smithi012.stdout:3641: copy_from oid 50 from oid 35 current snap is 361 2024-09-10T18:09:28.868 INFO:tasks.rados.rados.0.smithi012.stdout:3642: snap_create 2024-09-10T18:09:28.877 INFO:tasks.rados.rados.0.smithi012.stdout:3641: finishing copy_from racing read to smithi01278544-50 2024-09-10T18:09:28.877 INFO:tasks.rados.rados.0.smithi012.stdout:3641: finishing copy_from to smithi01278544-50 2024-09-10T18:09:28.877 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2436 (ObjNum 1042 snap 335 seq_num 1042) dirty exists 2024-09-10T18:09:29.874 INFO:tasks.rados.rados.0.smithi012.stdout:3641: done (1 left) 2024-09-10T18:09:29.874 INFO:tasks.rados.rados.0.smithi012.stdout:3642: done (0 left) 2024-09-10T18:09:29.874 INFO:tasks.rados.rados.0.smithi012.stdout:3643: read oid 23 snap -1 2024-09-10T18:09:29.874 INFO:tasks.rados.rados.0.smithi012.stdout:3643: expect (ObjNum 1084 snap 347 seq_num 1084) 2024-09-10T18:09:29.874 INFO:tasks.rados.rados.0.smithi012.stdout:3644: read oid 45 snap -1 2024-09-10T18:09:29.874 INFO:tasks.rados.rados.0.smithi012.stdout:3644: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:09:29.874 INFO:tasks.rados.rados.0.smithi012.stdout:3645: snap_create 2024-09-10T18:09:29.883 INFO:tasks.rados.rados.0.smithi012.stdout:3644: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:09:29.925 INFO:tasks.rados.rados.0.smithi012.stdout:3643: expect (ObjNum 1084 snap 347 seq_num 1084) 2024-09-10T18:09:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:29 smithi012 ceph-mon[89611]: osdmap e810: 8 total, 8 up, 8 in 2024-09-10T18:09:30.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:29 smithi012 ceph-mon[89611]: pgmap v902: 121 pgs: 121 active+clean; 242 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-09-10T18:09:30.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:29 smithi012 ceph-mon[92029]: osdmap e810: 8 total, 8 up, 8 in 2024-09-10T18:09:30.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:29 smithi012 ceph-mon[92029]: pgmap v902: 121 pgs: 121 active+clean; 242 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-09-10T18:09:30.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:29 smithi089 ceph-mon[84132]: osdmap e810: 8 total, 8 up, 8 in 2024-09-10T18:09:30.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:29 smithi089 ceph-mon[84132]: pgmap v902: 121 pgs: 121 active+clean; 242 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-09-10T18:09:30.876 INFO:tasks.rados.rados.0.smithi012.stdout:3643: done (2 left) 2024-09-10T18:09:30.877 INFO:tasks.rados.rados.0.smithi012.stdout:3644: done (1 left) 2024-09-10T18:09:30.877 INFO:tasks.rados.rados.0.smithi012.stdout:3645: done (0 left) 2024-09-10T18:09:30.877 INFO:tasks.rados.rados.0.smithi012.stdout:3646: read oid 40 snap -1 2024-09-10T18:09:30.877 INFO:tasks.rados.rados.0.smithi012.stdout:3646: expect (ObjNum 1103 snap 354 seq_num 1103) 2024-09-10T18:09:30.877 INFO:tasks.rados.rados.0.smithi012.stdout:3647: delete oid 23 current snap is 363 2024-09-10T18:09:30.883 INFO:tasks.rados.rados.0.smithi012.stdout:3647: done (1 left) 2024-09-10T18:09:30.883 INFO:tasks.rados.rados.0.smithi012.stdout:3648: read oid 48 snap -1 2024-09-10T18:09:30.883 INFO:tasks.rados.rados.0.smithi012.stdout:3648: expect deleted 2024-09-10T18:09:30.883 INFO:tasks.rados.rados.0.smithi012.stdout:3649: snap_create 2024-09-10T18:09:30.904 INFO:tasks.rados.rados.0.smithi012.stdout:3646: expect (ObjNum 1103 snap 354 seq_num 1103) 2024-09-10T18:09:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:30 smithi012 ceph-mon[89611]: osdmap e811: 8 total, 8 up, 8 in 2024-09-10T18:09:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:30 smithi012 ceph-mon[92029]: osdmap e811: 8 total, 8 up, 8 in 2024-09-10T18:09:31.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:30 smithi089 ceph-mon[84132]: osdmap e811: 8 total, 8 up, 8 in 2024-09-10T18:09:31.898 INFO:tasks.rados.rados.0.smithi012.stdout:3646: done (2 left) 2024-09-10T18:09:31.898 INFO:tasks.rados.rados.0.smithi012.stdout:3648: done (1 left) 2024-09-10T18:09:31.899 INFO:tasks.rados.rados.0.smithi012.stdout:3649: done (0 left) 2024-09-10T18:09:31.899 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 364 2024-09-10T18:09:31.899 INFO:tasks.rados.rados.0.smithi012.stdout:3650: seq_num 1121 ranges {0=778240,778240=442368,1220608=638976,1859584=122880} 2024-09-10T18:09:31.902 INFO:tasks.rados.rados.0.smithi012.stdout:3650: writing smithi01278544-34 from 0 to 778240 tid 1 2024-09-10T18:09:31.905 INFO:tasks.rados.rados.0.smithi012.stdout:3650: writing smithi01278544-34 from 778240 to 1220608 tid 2 2024-09-10T18:09:31.909 INFO:tasks.rados.rados.0.smithi012.stdout:3650: writing smithi01278544-34 from 1220608 to 1859584 tid 3 2024-09-10T18:09:31.910 INFO:tasks.rados.rados.0.smithi012.stdout:3650: writing smithi01278544-34 from 1859584 to 1982464 tid 4 2024-09-10T18:09:31.911 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 364 2024-09-10T18:09:31.911 INFO:tasks.rados.rados.0.smithi012.stdout:3650: finishing write tid 1 to smithi01278544-34 2024-09-10T18:09:31.911 INFO:tasks.rados.rados.0.smithi012.stdout:3650: finishing write tid 2 to smithi01278544-34 2024-09-10T18:09:31.911 INFO:tasks.rados.rados.0.smithi012.stdout:3651: seq_num 1122 ranges {1703936=794624,2498560=729088,3227648=475136} 2024-09-10T18:09:31.924 INFO:tasks.rados.rados.0.smithi012.stdout:3651: writing smithi01278544-21 from 1703936 to 2498560 tid 1 2024-09-10T18:09:31.928 INFO:tasks.rados.rados.0.smithi012.stdout:3651: writing smithi01278544-21 from 2498560 to 3227648 tid 2 2024-09-10T18:09:31.932 INFO:tasks.rados.rados.0.smithi012.stdout:3651: writing smithi01278544-21 from 3227648 to 3702784 tid 3 2024-09-10T18:09:31.932 INFO:tasks.rados.rados.0.smithi012.stdout:3652: read oid 36 snap 344 2024-09-10T18:09:31.932 INFO:tasks.rados.rados.0.smithi012.stdout:3652: expect deleted 2024-09-10T18:09:31.932 INFO:tasks.rados.rados.0.smithi012.stdout:3653: rollback oid 20 current snap is 364 2024-09-10T18:09:31.932 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 20 to 354 2024-09-10T18:09:31.932 INFO:tasks.rados.rados.0.smithi012.stdout:3650: finishing write tid 3 to smithi01278544-34 2024-09-10T18:09:31.932 INFO:tasks.rados.rados.0.smithi012.stdout:3650: finishing write tid 4 to smithi01278544-34 2024-09-10T18:09:31.932 INFO:tasks.rados.rados.0.smithi012.stdout:3650: finishing write tid 5 to smithi01278544-34 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3650: finishing write tid 6 to smithi01278544-34 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3650: oid 34 updating version 0 to 2337 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3650: oid 34 updating version 2337 to 2338 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3650: oid 34 version 2338 is already newer than 2336 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3650: oid 34 version 2338 is already newer than 2335 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3650: oid 34 updating version 2338 to 2339 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 2339 (ObjNum 1121 snap 364 seq_num 1121) dirty exists 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3650: left oid 34 (ObjNum 1121 snap 364 seq_num 1121) 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3651: finishing write tid 1 to smithi01278544-21 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3651: finishing write tid 2 to smithi01278544-21 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3650: done (3 left) 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3654: copy_from oid 1 from oid 38 current snap is 364 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3655: read oid 14 snap 344 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3655: expect (ObjNum 1055 snap 340 seq_num 1055) 2024-09-10T18:09:31.933 INFO:tasks.rados.rados.0.smithi012.stdout:3656: rollback oid 46 current snap is 364 2024-09-10T18:09:31.934 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 362 2024-09-10T18:09:31.934 INFO:tasks.rados.rados.0.smithi012.stdout:3657: snap_create 2024-09-10T18:09:31.934 INFO:tasks.rados.rados.0.smithi012.stdout:3654: finishing copy_from to smithi01278544-1 2024-09-10T18:09:31.934 INFO:tasks.rados.rados.0.smithi012.stdout:3654: got expected ENOENT (src dne) 2024-09-10T18:09:31.934 INFO:tasks.rados.rados.0.smithi012.stdout:3654: finishing copy_from racing read to smithi01278544-1 2024-09-10T18:09:31.935 INFO:tasks.rados.rados.0.smithi012.stdout:3651: finishing write tid 3 to smithi01278544-21 2024-09-10T18:09:31.937 INFO:tasks.rados.rados.0.smithi012.stdout:3651: finishing write tid 4 to smithi01278544-21 2024-09-10T18:09:31.938 INFO:tasks.rados.rados.0.smithi012.stdout:3655: expect (ObjNum 1055 snap 340 seq_num 1055) 2024-09-10T18:09:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:3651: finishing write tid 5 to smithi01278544-21 2024-09-10T18:09:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:3651: oid 21 updating version 0 to 2342 2024-09-10T18:09:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:3651: oid 21 version 2342 is already newer than 2341 2024-09-10T18:09:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:3651: oid 21 updating version 2342 to 2343 2024-09-10T18:09:31.961 INFO:tasks.rados.rados.0.smithi012.stdout:3651: oid 21 version 2343 is already newer than 2340 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 2343 (ObjNum 1122 snap 364 seq_num 1122) dirty exists 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:3651: left oid 21 (ObjNum 1122 snap 364 seq_num 1122) 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:3656: finishing rollback tid 0 to smithi01278544-46 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:3656: finishing rollback tid 1 to smithi01278544-46 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:3653: finishing rollback tid 0 to smithi01278544-20 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:3653: finishing rollback tid 1 to smithi01278544-20 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:3653: finishing rollback tid 2 to smithi01278544-20 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2754 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:3656: finishing rollback tid 2 to smithi01278544-46 2024-09-10T18:09:31.962 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 2527 (ObjNum 1031 snap 331 seq_num 1031) dirty exists 2024-09-10T18:09:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:31 smithi012 ceph-mon[89611]: osdmap e812: 8 total, 8 up, 8 in 2024-09-10T18:09:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:31 smithi012 ceph-mon[89611]: pgmap v905: 121 pgs: 121 active+clean; 242 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 468 KiB/s wr, 3 op/s 2024-09-10T18:09:32.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:31 smithi012 ceph-mon[92029]: osdmap e812: 8 total, 8 up, 8 in 2024-09-10T18:09:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:31 smithi012 ceph-mon[92029]: pgmap v905: 121 pgs: 121 active+clean; 242 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 468 KiB/s wr, 3 op/s 2024-09-10T18:09:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:32.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:31 smithi089 ceph-mon[84132]: osdmap e812: 8 total, 8 up, 8 in 2024-09-10T18:09:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:31 smithi089 ceph-mon[84132]: pgmap v905: 121 pgs: 121 active+clean; 242 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 468 KiB/s wr, 3 op/s 2024-09-10T18:09:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:32.829 INFO:tasks.rados.rados.0.smithi012.stdout:3651: done (6 left) 2024-09-10T18:09:32.829 INFO:tasks.rados.rados.0.smithi012.stdout:3652: done (5 left) 2024-09-10T18:09:32.830 INFO:tasks.rados.rados.0.smithi012.stdout:3653: done (4 left) 2024-09-10T18:09:32.830 INFO:tasks.rados.rados.0.smithi012.stdout:3654: done (3 left) 2024-09-10T18:09:32.830 INFO:tasks.rados.rados.0.smithi012.stdout:3655: done (2 left) 2024-09-10T18:09:32.830 INFO:tasks.rados.rados.0.smithi012.stdout:3656: done (1 left) 2024-09-10T18:09:32.830 INFO:tasks.rados.rados.0.smithi012.stdout:3657: done (0 left) 2024-09-10T18:09:32.830 INFO:tasks.rados.rados.0.smithi012.stdout:3658: copy_from oid 7 from oid 45 current snap is 365 2024-09-10T18:09:32.830 INFO:tasks.rados.rados.0.smithi012.stdout:3659: snap_remove snap 362 2024-09-10T18:09:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:32 smithi012 ceph-mon[89611]: osdmap e813: 8 total, 8 up, 8 in 2024-09-10T18:09:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:32 smithi012 ceph-mon[89611]: osdmap e814: 8 total, 8 up, 8 in 2024-09-10T18:09:33.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:32 smithi012 ceph-mon[92029]: osdmap e813: 8 total, 8 up, 8 in 2024-09-10T18:09:33.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:32 smithi012 ceph-mon[92029]: osdmap e814: 8 total, 8 up, 8 in 2024-09-10T18:09:33.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:32 smithi089 ceph-mon[84132]: osdmap e813: 8 total, 8 up, 8 in 2024-09-10T18:09:33.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:32 smithi089 ceph-mon[84132]: osdmap e814: 8 total, 8 up, 8 in 2024-09-10T18:09:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3659: done (1 left) 2024-09-10T18:09:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3660: read oid 16 snap 355 2024-09-10T18:09:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3660: expect (ObjNum 1100 snap 354 seq_num 1100) 2024-09-10T18:09:33.831 INFO:tasks.rados.rados.0.smithi012.stdout:3661: rollback oid 10 current snap is 365 2024-09-10T18:09:33.832 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 354 2024-09-10T18:09:33.832 INFO:tasks.rados.rados.0.smithi012.stdout:3658: finishing copy_from racing read to smithi01278544-7 2024-09-10T18:09:33.832 INFO:tasks.rados.rados.0.smithi012.stdout:3658: finishing copy_from to smithi01278544-7 2024-09-10T18:09:33.832 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 2480 (ObjNum 953 snap 302 seq_num 953) dirty exists 2024-09-10T18:09:33.832 INFO:tasks.rados.rados.0.smithi012.stdout:3658: done (2 left) 2024-09-10T18:09:33.832 INFO:tasks.rados.rados.0.smithi012.stdout:3662: snap_remove snap 359 2024-09-10T18:09:34.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:09:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:09:34] "GET /metrics HTTP/1.1" 200 36360 "" "Prometheus/2.51.0" 2024-09-10T18:09:34.835 INFO:tasks.rados.rados.0.smithi012.stdout:3662: done (2 left) 2024-09-10T18:09:34.835 INFO:tasks.rados.rados.0.smithi012.stdout:3663: rmattr oid 17 current snap is 365 2024-09-10T18:09:34.835 INFO:tasks.rados.rados.0.smithi012.stdout:3663: done (2 left) 2024-09-10T18:09:34.835 INFO:tasks.rados.rados.0.smithi012.stdout:3664: copy_from oid 32 from oid 27 current snap is 365 2024-09-10T18:09:34.835 INFO:tasks.rados.rados.0.smithi012.stdout:3665: setattr oid 4 current snap is 365 2024-09-10T18:09:34.835 INFO:tasks.rados.rados.0.smithi012.stdout:3661: finishing rollback tid 0 to smithi01278544-10 2024-09-10T18:09:34.835 INFO:tasks.rados.rados.0.smithi012.stdout:3661: finishing rollback tid 1 to smithi01278544-10 2024-09-10T18:09:34.836 INFO:tasks.rados.rados.0.smithi012.stdout:3661: finishing rollback tid 2 to smithi01278544-10 2024-09-10T18:09:34.836 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2758 (ObjNum 1004 snap 319 seq_num 1004) dirty exists 2024-09-10T18:09:34.836 INFO:tasks.rados.rados.0.smithi012.stdout:3660: expect (ObjNum 1100 snap 354 seq_num 1100) 2024-09-10T18:09:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:34 smithi012 ceph-mon[89611]: pgmap v908: 121 pgs: 121 active+clean; 236 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 9.3 MiB/s rd, 272 KiB/s wr, 5 op/s 2024-09-10T18:09:35.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:34 smithi012 ceph-mon[89611]: osdmap e815: 8 total, 8 up, 8 in 2024-09-10T18:09:35.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:34 smithi012 ceph-mon[92029]: pgmap v908: 121 pgs: 121 active+clean; 236 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 9.3 MiB/s rd, 272 KiB/s wr, 5 op/s 2024-09-10T18:09:35.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:34 smithi012 ceph-mon[92029]: osdmap e815: 8 total, 8 up, 8 in 2024-09-10T18:09:35.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:34 smithi089 ceph-mon[84132]: pgmap v908: 121 pgs: 121 active+clean; 236 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 9.3 MiB/s rd, 272 KiB/s wr, 5 op/s 2024-09-10T18:09:35.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:34 smithi089 ceph-mon[84132]: osdmap e815: 8 total, 8 up, 8 in 2024-09-10T18:09:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:35 smithi012 ceph-mon[89611]: osdmap e816: 8 total, 8 up, 8 in 2024-09-10T18:09:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:35 smithi012 ceph-mon[89611]: pgmap v911: 121 pgs: 121 active+clean; 236 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 272 KiB/s wr, 6 op/s 2024-09-10T18:09:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:35 smithi012 ceph-mon[92029]: osdmap e816: 8 total, 8 up, 8 in 2024-09-10T18:09:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:35 smithi012 ceph-mon[92029]: pgmap v911: 121 pgs: 121 active+clean; 236 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 272 KiB/s wr, 6 op/s 2024-09-10T18:09:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:35 smithi089 ceph-mon[84132]: osdmap e816: 8 total, 8 up, 8 in 2024-09-10T18:09:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:35 smithi089 ceph-mon[84132]: pgmap v911: 121 pgs: 121 active+clean; 236 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 272 KiB/s wr, 6 op/s 2024-09-10T18:09:36.456 INFO:tasks.rados.rados.0.smithi012.stdout:3664: finishing copy_from racing read to smithi01278544-32 2024-09-10T18:09:36.456 INFO:tasks.rados.rados.0.smithi012.stdout:3664: finishing copy_from to smithi01278544-32 2024-09-10T18:09:36.456 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2513 (ObjNum 1002 snap 319 seq_num 1002) dirty exists 2024-09-10T18:09:36.457 INFO:tasks.rados.rados.0.smithi012.stdout:3660: done (3 left) 2024-09-10T18:09:36.457 INFO:tasks.rados.rados.0.smithi012.stdout:3661: done (2 left) 2024-09-10T18:09:36.457 INFO:tasks.rados.rados.0.smithi012.stdout:3664: done (1 left) 2024-09-10T18:09:36.457 INFO:tasks.rados.rados.0.smithi012.stdout:3666: delete oid 42 current snap is 365 2024-09-10T18:09:36.459 INFO:tasks.rados.rados.0.smithi012.stdout:3666: done (1 left) 2024-09-10T18:09:36.459 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 365 2024-09-10T18:09:36.459 INFO:tasks.rados.rados.0.smithi012.stdout:3667: seq_num 1124 ranges {4481024=434176,4915200=499712,5414912=409600,5824512=663552,6488064=32768} 2024-09-10T18:09:36.486 INFO:tasks.rados.rados.0.smithi012.stdout:3667: writing smithi01278544-27 from 4481024 to 4915200 tid 1 2024-09-10T18:09:36.489 INFO:tasks.rados.rados.0.smithi012.stdout:3667: writing smithi01278544-27 from 4915200 to 5414912 tid 2 2024-09-10T18:09:36.491 INFO:tasks.rados.rados.0.smithi012.stdout:3667: writing smithi01278544-27 from 5414912 to 5824512 tid 3 2024-09-10T18:09:36.495 INFO:tasks.rados.rados.0.smithi012.stdout:3667: writing smithi01278544-27 from 5824512 to 6488064 tid 4 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3667: writing smithi01278544-27 from 6488064 to 6520832 tid 5 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3668: copy_from oid 8 from oid 36 current snap is 365 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 4 v 2323 (ObjNum 1025 snap 328 seq_num 1025) dirty exists 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3667: finishing write tid 1 to smithi01278544-27 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3667: finishing write tid 2 to smithi01278544-27 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3667: finishing write tid 3 to smithi01278544-27 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3665: done (2 left) 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3669: copy_from oid 46 from oid 11 current snap is 365 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3670: rollback oid 9 current snap is 365 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 9 to 361 2024-09-10T18:09:36.496 INFO:tasks.rados.rados.0.smithi012.stdout:3671: snap_remove snap 363 2024-09-10T18:09:36.849 INFO:tasks.rados.rados.0.smithi012.stdout:3671: done (4 left) 2024-09-10T18:09:36.849 INFO:tasks.rados.rados.0.smithi012.stdout:3672: snap_create 2024-09-10T18:09:36.849 INFO:tasks.rados.rados.0.smithi012.stdout:3670: finishing rollback tid 1 to smithi01278544-9 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 0 (ObjNum 49 snap 0 seq_num 3497819024) dirty dne 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: finishing write tid 4 to smithi01278544-27 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: finishing write tid 5 to smithi01278544-27 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: finishing write tid 6 to smithi01278544-27 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: finishing write tid 7 to smithi01278544-27 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: oid 27 updating version 0 to 2530 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: oid 27 updating version 2530 to 2531 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: oid 27 updating version 2531 to 2533 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: oid 27 version 2533 is already newer than 2528 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: oid 27 version 2533 is already newer than 2532 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: oid 27 version 2533 is already newer than 2529 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 2533 (ObjNum 1124 snap 365 seq_num 1124) dirty exists 2024-09-10T18:09:36.850 INFO:tasks.rados.rados.0.smithi012.stdout:3667: left oid 27 (ObjNum 1124 snap 365 seq_num 1124) 2024-09-10T18:09:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:3669: finishing copy_from to smithi01278544-46 2024-09-10T18:09:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:3669: got expected ENOENT (src dne) 2024-09-10T18:09:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:3669: finishing copy_from racing read to smithi01278544-46 2024-09-10T18:09:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:3668: finishing copy_from racing read to smithi01278544-8 2024-09-10T18:09:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:3668: finishing copy_from to smithi01278544-8 2024-09-10T18:09:36.851 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 2044 (ObjNum 1097 snap 351 seq_num 1097) dirty exists 2024-09-10T18:09:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:3667: done (4 left) 2024-09-10T18:09:37.831 INFO:tasks.rados.rados.0.smithi012.stdout:3668: done (3 left) 2024-09-10T18:09:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:3669: done (2 left) 2024-09-10T18:09:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:3670: done (1 left) 2024-09-10T18:09:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:3672: done (0 left) 2024-09-10T18:09:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:3673: setattr oid 5 current snap is 366 2024-09-10T18:09:37.832 INFO:tasks.rados.rados.0.smithi012.stdout:3674: snap_remove snap 361 2024-09-10T18:09:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:37 smithi012 ceph-mon[89611]: osdmap e817: 8 total, 8 up, 8 in 2024-09-10T18:09:38.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:37 smithi012 ceph-mon[89611]: pgmap v913: 121 pgs: 121 active+clean; 243 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-10T18:09:38.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:37 smithi012 ceph-mon[89611]: osdmap e818: 8 total, 8 up, 8 in 2024-09-10T18:09:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:37 smithi012 ceph-mon[92029]: osdmap e817: 8 total, 8 up, 8 in 2024-09-10T18:09:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:37 smithi012 ceph-mon[92029]: pgmap v913: 121 pgs: 121 active+clean; 243 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-10T18:09:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:37 smithi012 ceph-mon[92029]: osdmap e818: 8 total, 8 up, 8 in 2024-09-10T18:09:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:37 smithi089 ceph-mon[84132]: osdmap e817: 8 total, 8 up, 8 in 2024-09-10T18:09:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:37 smithi089 ceph-mon[84132]: pgmap v913: 121 pgs: 121 active+clean; 243 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-10T18:09:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:37 smithi089 ceph-mon[84132]: osdmap e818: 8 total, 8 up, 8 in 2024-09-10T18:09:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:3674: done (1 left) 2024-09-10T18:09:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 366 2024-09-10T18:09:38.833 INFO:tasks.rados.rados.0.smithi012.stdout:3675: seq_num 1125 ranges {1581056=450560,2031616=786432,2818048=614400,3432448=204800} 2024-09-10T18:09:38.845 INFO:tasks.rados.rados.0.smithi012.stdout:3675: writing smithi01278544-36 from 1581056 to 2031616 tid 1 2024-09-10T18:09:38.850 INFO:tasks.rados.rados.0.smithi012.stdout:3675: writing smithi01278544-36 from 2031616 to 2818048 tid 2 2024-09-10T18:09:38.853 INFO:tasks.rados.rados.0.smithi012.stdout:3675: writing smithi01278544-36 from 2818048 to 3432448 tid 3 2024-09-10T18:09:38.855 INFO:tasks.rados.rados.0.smithi012.stdout:3675: writing smithi01278544-36 from 3432448 to 3637248 tid 4 2024-09-10T18:09:38.855 INFO:tasks.rados.rados.0.smithi012.stdout:3676: setattr oid 31 current snap is 366 2024-09-10T18:09:38.855 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 2196 (ObjNum 1097 snap 351 seq_num 1097) dirty exists 2024-09-10T18:09:38.855 INFO:tasks.rados.rados.0.smithi012.stdout:3675: finishing write tid 1 to smithi01278544-36 2024-09-10T18:09:38.856 INFO:tasks.rados.rados.0.smithi012.stdout:3675: finishing write tid 2 to smithi01278544-36 2024-09-10T18:09:38.857 INFO:tasks.rados.rados.0.smithi012.stdout:3673: done (2 left) 2024-09-10T18:09:38.857 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 366 2024-09-10T18:09:38.857 INFO:tasks.rados.rados.0.smithi012.stdout:3677: seq_num 1126 ranges {6651904=466944,7118848=720896,7839744=778240,8617984=106496} 2024-09-10T18:09:38.896 INFO:tasks.rados.rados.0.smithi012.stdout:3677: writing smithi01278544-26 from 6651904 to 7118848 tid 1 2024-09-10T18:09:38.900 INFO:tasks.rados.rados.0.smithi012.stdout:3677: writing smithi01278544-26 from 7118848 to 7839744 tid 2 2024-09-10T18:09:38.904 INFO:tasks.rados.rados.0.smithi012.stdout:3677: writing smithi01278544-26 from 7839744 to 8617984 tid 3 2024-09-10T18:09:38.905 INFO:tasks.rados.rados.0.smithi012.stdout:3677: writing smithi01278544-26 from 8617984 to 8724480 tid 4 2024-09-10T18:09:38.905 INFO:tasks.rados.rados.0.smithi012.stdout:3678: snap_create 2024-09-10T18:09:38.905 INFO:tasks.rados.rados.0.smithi012.stdout:3675: finishing write tid 3 to smithi01278544-36 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: finishing write tid 4 to smithi01278544-36 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: finishing write tid 5 to smithi01278544-36 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: finishing write tid 6 to smithi01278544-36 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: oid 36 updating version 0 to 2058 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: oid 36 version 2058 is already newer than 2056 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: oid 36 version 2058 is already newer than 2057 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: oid 36 updating version 2058 to 2060 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: oid 36 version 2060 is already newer than 2059 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 2060 (ObjNum 1125 snap 366 seq_num 1125) dirty exists 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3675: left oid 36 (ObjNum 1125 snap 366 seq_num 1125) 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2324 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3677: finishing write tid 1 to smithi01278544-26 2024-09-10T18:09:38.906 INFO:tasks.rados.rados.0.smithi012.stdout:3677: finishing write tid 2 to smithi01278544-26 2024-09-10T18:09:38.909 INFO:tasks.rados.rados.0.smithi012.stdout:3677: finishing write tid 3 to smithi01278544-26 2024-09-10T18:09:38.909 INFO:tasks.rados.rados.0.smithi012.stdout:3677: finishing write tid 4 to smithi01278544-26 2024-09-10T18:09:38.909 INFO:tasks.rados.rados.0.smithi012.stdout:3677: finishing write tid 5 to smithi01278544-26 2024-09-10T18:09:38.910 INFO:tasks.rados.rados.0.smithi012.stdout:3677: finishing write tid 6 to smithi01278544-26 2024-09-10T18:09:38.911 INFO:tasks.rados.rados.0.smithi012.stdout:3677: oid 26 updating version 0 to 2062 2024-09-10T18:09:38.911 INFO:tasks.rados.rados.0.smithi012.stdout:3677: oid 26 updating version 2062 to 2064 2024-09-10T18:09:38.911 INFO:tasks.rados.rados.0.smithi012.stdout:3677: oid 26 updating version 2064 to 2065 2024-09-10T18:09:38.911 INFO:tasks.rados.rados.0.smithi012.stdout:3677: oid 26 version 2065 is already newer than 2061 2024-09-10T18:09:38.911 INFO:tasks.rados.rados.0.smithi012.stdout:3677: oid 26 version 2065 is already newer than 2063 2024-09-10T18:09:38.911 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2065 (ObjNum 1126 snap 366 seq_num 1126) dirty exists 2024-09-10T18:09:38.911 INFO:tasks.rados.rados.0.smithi012.stdout:3677: left oid 26 (ObjNum 1126 snap 366 seq_num 1126) 2024-09-10T18:09:39.839 INFO:tasks.rados.rados.0.smithi012.stdout:3675: done (3 left) 2024-09-10T18:09:39.839 INFO:tasks.rados.rados.0.smithi012.stdout:3676: done (2 left) 2024-09-10T18:09:39.839 INFO:tasks.rados.rados.0.smithi012.stdout:3677: done (1 left) 2024-09-10T18:09:39.839 INFO:tasks.rados.rados.0.smithi012.stdout:3678: done (0 left) 2024-09-10T18:09:39.839 INFO:tasks.rados.rados.0.smithi012.stdout:3679: rollback oid 46 current snap is 367 2024-09-10T18:09:39.839 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 46 to 355 2024-09-10T18:09:39.840 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 367 2024-09-10T18:09:39.840 INFO:tasks.rados.rados.0.smithi012.stdout:3680: seq_num 1127 ranges {0=483328,483328=598016,1081344=581632,1662976=425984} 2024-09-10T18:09:39.841 INFO:tasks.rados.rados.0.smithi012.stdout:3680: writing smithi01278544-48 from 0 to 483328 tid 1 2024-09-10T18:09:39.845 INFO:tasks.rados.rados.0.smithi012.stdout:3680: writing smithi01278544-48 from 483328 to 1081344 tid 2 2024-09-10T18:09:39.849 INFO:tasks.rados.rados.0.smithi012.stdout:3680: writing smithi01278544-48 from 1081344 to 1662976 tid 3 2024-09-10T18:09:39.851 INFO:tasks.rados.rados.0.smithi012.stdout:3680: writing smithi01278544-48 from 1662976 to 2088960 tid 4 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:3681: read oid 33 snap -1 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:3681: expect (ObjNum 1112 snap 357 seq_num 1112) 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:3682: snap_create 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:3679: finishing rollback tid 0 to smithi01278544-46 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:3679: finishing rollback tid 1 to smithi01278544-46 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:3679: finishing rollback tid 2 to smithi01278544-46 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 2536 (ObjNum 1031 snap 331 seq_num 1031) dirty exists 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:3680: finishing write tid 1 to smithi01278544-48 2024-09-10T18:09:39.852 INFO:tasks.rados.rados.0.smithi012.stdout:3680: finishing write tid 2 to smithi01278544-48 2024-09-10T18:09:39.854 INFO:tasks.rados.rados.0.smithi012.stdout:3680: finishing write tid 3 to smithi01278544-48 2024-09-10T18:09:39.855 INFO:tasks.rados.rados.0.smithi012.stdout:3680: finishing write tid 4 to smithi01278544-48 2024-09-10T18:09:39.855 INFO:tasks.rados.rados.0.smithi012.stdout:3680: finishing write tid 5 to smithi01278544-48 2024-09-10T18:09:39.859 INFO:tasks.rados.rados.0.smithi012.stdout:3680: finishing write tid 6 to smithi01278544-48 2024-09-10T18:09:39.859 INFO:tasks.rados.rados.0.smithi012.stdout:3680: oid 48 updating version 0 to 2189 2024-09-10T18:09:39.859 INFO:tasks.rados.rados.0.smithi012.stdout:3680: oid 48 version 2189 is already newer than 2188 2024-09-10T18:09:39.859 INFO:tasks.rados.rados.0.smithi012.stdout:3680: oid 48 version 2189 is already newer than 2187 2024-09-10T18:09:39.859 INFO:tasks.rados.rados.0.smithi012.stdout:3680: oid 48 updating version 2189 to 2190 2024-09-10T18:09:39.859 INFO:tasks.rados.rados.0.smithi012.stdout:3680: oid 48 updating version 2190 to 2191 2024-09-10T18:09:39.859 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 2191 (ObjNum 1127 snap 367 seq_num 1127) dirty exists 2024-09-10T18:09:39.859 INFO:tasks.rados.rados.0.smithi012.stdout:3680: left oid 48 (ObjNum 1127 snap 367 seq_num 1127) 2024-09-10T18:09:39.861 INFO:tasks.rados.rados.0.smithi012.stdout:3681: expect (ObjNum 1112 snap 357 seq_num 1112) 2024-09-10T18:09:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:39 smithi012 ceph-mon[89611]: osdmap e819: 8 total, 8 up, 8 in 2024-09-10T18:09:40.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:39 smithi012 ceph-mon[92029]: osdmap e819: 8 total, 8 up, 8 in 2024-09-10T18:09:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:39 smithi089 ceph-mon[84132]: osdmap e819: 8 total, 8 up, 8 in 2024-09-10T18:09:40.847 INFO:tasks.rados.rados.0.smithi012.stdout:3679: done (3 left) 2024-09-10T18:09:40.847 INFO:tasks.rados.rados.0.smithi012.stdout:3680: done (2 left) 2024-09-10T18:09:40.847 INFO:tasks.rados.rados.0.smithi012.stdout:3681: done (1 left) 2024-09-10T18:09:40.848 INFO:tasks.rados.rados.0.smithi012.stdout:3682: done (0 left) 2024-09-10T18:09:40.848 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 22 current snap is 368 2024-09-10T18:09:40.848 INFO:tasks.rados.rados.0.smithi012.stdout:3683: seq_num 1128 ranges {2072576=499712,2572288=483328,3055616=786432,3842048=335872} 2024-09-10T18:09:40.861 INFO:tasks.rados.rados.0.smithi012.stdout:3683: writing smithi01278544-22 from 2072576 to 2572288 tid 1 2024-09-10T18:09:40.864 INFO:tasks.rados.rados.0.smithi012.stdout:3683: writing smithi01278544-22 from 2572288 to 3055616 tid 2 2024-09-10T18:09:40.868 INFO:tasks.rados.rados.0.smithi012.stdout:3683: writing smithi01278544-22 from 3055616 to 3842048 tid 3 2024-09-10T18:09:40.870 INFO:tasks.rados.rados.0.smithi012.stdout:3683: writing smithi01278544-22 from 3842048 to 4177920 tid 4 2024-09-10T18:09:40.870 INFO:tasks.rados.rados.0.smithi012.stdout:3684: read oid 32 snap -1 2024-09-10T18:09:40.870 INFO:tasks.rados.rados.0.smithi012.stdout:3684: expect (ObjNum 1002 snap 319 seq_num 1002) 2024-09-10T18:09:40.870 INFO:tasks.rados.rados.0.smithi012.stdout:3685: rmattr oid 7 current snap is 368 2024-09-10T18:09:40.870 INFO:tasks.rados.rados.0.smithi012.stdout:3685: done (2 left) 2024-09-10T18:09:40.870 INFO:tasks.rados.rados.0.smithi012.stdout:3686: snap_remove snap 360 2024-09-10T18:09:41.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:40 smithi012 ceph-mon[89611]: pgmap v916: 121 pgs: 121 active+clean; 248 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 8 op/s 2024-09-10T18:09:41.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:40 smithi012 ceph-mon[89611]: osdmap e820: 8 total, 8 up, 8 in 2024-09-10T18:09:41.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:40 smithi012 ceph-mon[92029]: pgmap v916: 121 pgs: 121 active+clean; 248 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 8 op/s 2024-09-10T18:09:41.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:40 smithi012 ceph-mon[92029]: osdmap e820: 8 total, 8 up, 8 in 2024-09-10T18:09:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:40 smithi089 ceph-mon[84132]: pgmap v916: 121 pgs: 121 active+clean; 248 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 8 op/s 2024-09-10T18:09:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:40 smithi089 ceph-mon[84132]: osdmap e820: 8 total, 8 up, 8 in 2024-09-10T18:09:41.865 INFO:tasks.rados.rados.0.smithi012.stdout:3686: done (2 left) 2024-09-10T18:09:41.865 INFO:tasks.rados.rados.0.smithi012.stdout:3687: snap_remove snap 366 2024-09-10T18:09:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:41 smithi012 ceph-mon[89611]: osdmap e821: 8 total, 8 up, 8 in 2024-09-10T18:09:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:41 smithi012 ceph-mon[89611]: pgmap v919: 121 pgs: 121 active+clean; 248 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 15 op/s 2024-09-10T18:09:42.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:41 smithi012 ceph-mon[92029]: osdmap e821: 8 total, 8 up, 8 in 2024-09-10T18:09:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:41 smithi012 ceph-mon[92029]: pgmap v919: 121 pgs: 121 active+clean; 248 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 15 op/s 2024-09-10T18:09:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:41 smithi089 ceph-mon[84132]: osdmap e821: 8 total, 8 up, 8 in 2024-09-10T18:09:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:41 smithi089 ceph-mon[84132]: pgmap v919: 121 pgs: 121 active+clean; 248 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 15 op/s 2024-09-10T18:09:42.834 INFO:tasks.rados.rados.0.smithi012.stdout:3687: done (2 left) 2024-09-10T18:09:42.834 INFO:tasks.rados.rados.0.smithi012.stdout:3688: copy_from oid 10 from oid 45 current snap is 368 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: finishing write tid 1 to smithi01278544-22 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: finishing write tid 2 to smithi01278544-22 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: finishing write tid 3 to smithi01278544-22 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: finishing write tid 4 to smithi01278544-22 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: finishing write tid 5 to smithi01278544-22 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: finishing write tid 6 to smithi01278544-22 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: oid 22 updating version 0 to 2777 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: oid 22 updating version 2777 to 2780 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: oid 22 version 2780 is already newer than 2778 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: oid 22 version 2780 is already newer than 2779 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: oid 22 version 2780 is already newer than 2776 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2780 (ObjNum 1128 snap 368 seq_num 1128) dirty exists 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3683: left oid 22 (ObjNum 1128 snap 368 seq_num 1128) 2024-09-10T18:09:42.835 INFO:tasks.rados.rados.0.smithi012.stdout:3684: expect (ObjNum 1002 snap 319 seq_num 1002) 2024-09-10T18:09:42.989 INFO:tasks.rados.rados.0.smithi012.stdout:3688: finishing copy_from racing read to smithi01278544-10 2024-09-10T18:09:42.989 INFO:tasks.rados.rados.0.smithi012.stdout:3688: finishing copy_from to smithi01278544-10 2024-09-10T18:09:42.990 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2480 (ObjNum 953 snap 302 seq_num 953) dirty exists 2024-09-10T18:09:42.990 INFO:tasks.rados.rados.0.smithi012.stdout:3683: done (2 left) 2024-09-10T18:09:42.990 INFO:tasks.rados.rados.0.smithi012.stdout:3684: done (1 left) 2024-09-10T18:09:42.990 INFO:tasks.rados.rados.0.smithi012.stdout:3688: done (0 left) 2024-09-10T18:09:42.990 INFO:tasks.rados.rados.0.smithi012.stdout:3689: setattr oid 20 current snap is 368 2024-09-10T18:09:42.991 INFO:tasks.rados.rados.0.smithi012.stdout:3690: delete oid 37 current snap is 368 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3690: done (1 left) 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3691: rollback oid 21 current snap is 368 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 21 to 364 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3692: read oid 49 snap -1 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3692: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3693: read oid 2 snap 365 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3693: expect (ObjNum 1105 snap 355 seq_num 1105) 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3694: read oid 45 snap -1 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3694: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:09:42.995 INFO:tasks.rados.rados.0.smithi012.stdout:3695: read oid 8 snap -1 2024-09-10T18:09:42.996 INFO:tasks.rados.rados.0.smithi012.stdout:3695: expect (ObjNum 1097 snap 351 seq_num 1097) 2024-09-10T18:09:42.996 INFO:tasks.rados.rados.0.smithi012.stdout:3696: snap_create 2024-09-10T18:09:42.998 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2792 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:09:43.001 INFO:tasks.rados.rados.0.smithi012.stdout:3694: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:09:43.043 INFO:tasks.rados.rados.0.smithi012.stdout:3691: finishing rollback tid 0 to smithi01278544-21 2024-09-10T18:09:43.044 INFO:tasks.rados.rados.0.smithi012.stdout:3695: expect (ObjNum 1097 snap 351 seq_num 1097) 2024-09-10T18:09:43.085 INFO:tasks.rados.rados.0.smithi012.stdout:3691: finishing rollback tid 1 to smithi01278544-21 2024-09-10T18:09:43.085 INFO:tasks.rados.rados.0.smithi012.stdout:3691: finishing rollback tid 2 to smithi01278544-21 2024-09-10T18:09:43.085 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 2346 (ObjNum 1122 snap 364 seq_num 1122) dirty exists 2024-09-10T18:09:43.085 INFO:tasks.rados.rados.0.smithi012.stdout:3692: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:09:43.197 INFO:tasks.rados.rados.0.smithi012.stdout:3693: expect (ObjNum 1105 snap 355 seq_num 1105) 2024-09-10T18:09:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:42 smithi012 ceph-mon[89611]: osdmap e822: 8 total, 8 up, 8 in 2024-09-10T18:09:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:42 smithi012 ceph-mon[89611]: osdmap e823: 8 total, 8 up, 8 in 2024-09-10T18:09:43.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:42 smithi012 ceph-mon[92029]: osdmap e822: 8 total, 8 up, 8 in 2024-09-10T18:09:43.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:42 smithi012 ceph-mon[92029]: osdmap e823: 8 total, 8 up, 8 in 2024-09-10T18:09:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:42 smithi089 ceph-mon[84132]: osdmap e822: 8 total, 8 up, 8 in 2024-09-10T18:09:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:42 smithi089 ceph-mon[84132]: osdmap e823: 8 total, 8 up, 8 in 2024-09-10T18:09:43.862 INFO:tasks.rados.rados.0.smithi012.stdout:3689: done (6 left) 2024-09-10T18:09:43.863 INFO:tasks.rados.rados.0.smithi012.stdout:3691: done (5 left) 2024-09-10T18:09:43.863 INFO:tasks.rados.rados.0.smithi012.stdout:3692: done (4 left) 2024-09-10T18:09:43.863 INFO:tasks.rados.rados.0.smithi012.stdout:3693: done (3 left) 2024-09-10T18:09:43.863 INFO:tasks.rados.rados.0.smithi012.stdout:3694: done (2 left) 2024-09-10T18:09:43.863 INFO:tasks.rados.rados.0.smithi012.stdout:3695: done (1 left) 2024-09-10T18:09:43.863 INFO:tasks.rados.rados.0.smithi012.stdout:3696: done (0 left) 2024-09-10T18:09:43.863 INFO:tasks.rados.rados.0.smithi012.stdout:3697: setattr oid 34 current snap is 369 2024-09-10T18:09:43.863 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 25 current snap is 369 2024-09-10T18:09:43.864 INFO:tasks.rados.rados.0.smithi012.stdout:3698: seq_num 1130 ranges {2932736=532480,3465216=655360,4120576=753664,4874240=196608} 2024-09-10T18:09:43.882 INFO:tasks.rados.rados.0.smithi012.stdout:3698: writing smithi01278544-25 from 2932736 to 3465216 tid 1 2024-09-10T18:09:43.886 INFO:tasks.rados.rados.0.smithi012.stdout:3698: writing smithi01278544-25 from 3465216 to 4120576 tid 2 2024-09-10T18:09:43.890 INFO:tasks.rados.rados.0.smithi012.stdout:3698: writing smithi01278544-25 from 4120576 to 4874240 tid 3 2024-09-10T18:09:43.891 INFO:tasks.rados.rados.0.smithi012.stdout:3698: writing smithi01278544-25 from 4874240 to 5070848 tid 4 2024-09-10T18:09:43.891 INFO:tasks.rados.rados.0.smithi012.stdout:3699: delete oid 35 current snap is 369 2024-09-10T18:09:43.891 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 2347 (ObjNum 1121 snap 364 seq_num 1121) dirty exists 2024-09-10T18:09:43.891 INFO:tasks.rados.rados.0.smithi012.stdout:3698: finishing write tid 1 to smithi01278544-25 2024-09-10T18:09:43.891 INFO:tasks.rados.rados.0.smithi012.stdout:3698: finishing write tid 2 to smithi01278544-25 2024-09-10T18:09:43.893 INFO:tasks.rados.rados.0.smithi012.stdout:3697: done (2 left) 2024-09-10T18:09:43.893 INFO:tasks.rados.rados.0.smithi012.stdout:3699: done (1 left) 2024-09-10T18:09:43.894 INFO:tasks.rados.rados.0.smithi012.stdout:3700: snap_remove snap 355 2024-09-10T18:09:44.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:43 smithi012 ceph-mon[89611]: pgmap v922: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-09-10T18:09:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:43 smithi012 ceph-mon[92029]: pgmap v922: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-09-10T18:09:44.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:43 smithi089 ceph-mon[84132]: pgmap v922: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-09-10T18:09:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:09:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:09:44] "GET /metrics HTTP/1.1" 200 36360 "" "Prometheus/2.51.0" 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3700: done (1 left) 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3701: rollback oid 35 current snap is 369 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 35 to 344 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3698: finishing write tid 3 to smithi01278544-25 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3698: finishing write tid 4 to smithi01278544-25 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3698: finishing write tid 5 to smithi01278544-25 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3698: finishing write tid 6 to smithi01278544-25 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3698: oid 25 updating version 0 to 2796 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3698: oid 25 version 2796 is already newer than 2795 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3698: oid 25 updating version 2796 to 2798 2024-09-10T18:09:44.869 INFO:tasks.rados.rados.0.smithi012.stdout:3698: oid 25 version 2798 is already newer than 2794 2024-09-10T18:09:44.870 INFO:tasks.rados.rados.0.smithi012.stdout:3698: oid 25 version 2798 is already newer than 2797 2024-09-10T18:09:44.870 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 2798 (ObjNum 1130 snap 369 seq_num 1130) dirty exists 2024-09-10T18:09:44.870 INFO:tasks.rados.rados.0.smithi012.stdout:3698: left oid 25 (ObjNum 1130 snap 369 seq_num 1130) 2024-09-10T18:09:44.870 INFO:tasks.rados.rados.0.smithi012.stdout:3698: done (1 left) 2024-09-10T18:09:44.870 INFO:tasks.rados.rados.0.smithi012.stdout:3702: setattr oid 17 current snap is 369 2024-09-10T18:09:44.872 INFO:tasks.rados.rados.0.smithi012.stdout:3703: setattr oid 34 current snap is 369 2024-09-10T18:09:44.875 INFO:tasks.rados.rados.0.smithi012.stdout:3704: snap_create 2024-09-10T18:09:44.883 INFO:tasks.rados.rados.0.smithi012.stdout:3701: finishing rollback tid 1 to smithi01278544-35 2024-09-10T18:09:44.883 INFO:tasks.rados.rados.0.smithi012.stdout:3701: finishing rollback tid 2 to smithi01278544-35 2024-09-10T18:09:44.883 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2516 (ObjNum 1065 snap 342 seq_num 1065) dirty exists 2024-09-10T18:09:44.884 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2197 (ObjNum 923 snap 296 seq_num 923) dirty exists 2024-09-10T18:09:44.887 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 2348 (ObjNum 1121 snap 364 seq_num 1121) dirty exists 2024-09-10T18:09:45.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:44 smithi012 ceph-mon[89611]: osdmap e824: 8 total, 8 up, 8 in 2024-09-10T18:09:45.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:44 smithi012 ceph-mon[92029]: osdmap e824: 8 total, 8 up, 8 in 2024-09-10T18:09:45.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:44 smithi089 ceph-mon[84132]: osdmap e824: 8 total, 8 up, 8 in 2024-09-10T18:09:45.875 INFO:tasks.rados.rados.0.smithi012.stdout:3701: done (3 left) 2024-09-10T18:09:45.876 INFO:tasks.rados.rados.0.smithi012.stdout:3702: done (2 left) 2024-09-10T18:09:45.876 INFO:tasks.rados.rados.0.smithi012.stdout:3703: done (1 left) 2024-09-10T18:09:45.876 INFO:tasks.rados.rados.0.smithi012.stdout:3704: done (0 left) 2024-09-10T18:09:45.876 INFO:tasks.rados.rados.0.smithi012.stdout:3705: snap_create 2024-09-10T18:09:46.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:45 smithi089 ceph-mon[84132]: osdmap e825: 8 total, 8 up, 8 in 2024-09-10T18:09:46.187 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:45 smithi089 ceph-mon[84132]: pgmap v925: 121 pgs: 121 active+clean; 257 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2024-09-10T18:09:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:45 smithi012 ceph-mon[89611]: osdmap e825: 8 total, 8 up, 8 in 2024-09-10T18:09:46.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:45 smithi012 ceph-mon[89611]: pgmap v925: 121 pgs: 121 active+clean; 257 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2024-09-10T18:09:46.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:45 smithi012 ceph-mon[92029]: osdmap e825: 8 total, 8 up, 8 in 2024-09-10T18:09:46.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:45 smithi012 ceph-mon[92029]: pgmap v925: 121 pgs: 121 active+clean; 257 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2024-09-10T18:09:46.880 INFO:tasks.rados.rados.0.smithi012.stdout:3705: done (0 left) 2024-09-10T18:09:46.881 INFO:tasks.rados.rados.0.smithi012.stdout:3706: read oid 39 snap 358 2024-09-10T18:09:46.881 INFO:tasks.rados.rados.0.smithi012.stdout:3706: expect (ObjNum 1085 snap 347 seq_num 1085) 2024-09-10T18:09:46.881 INFO:tasks.rados.rados.0.smithi012.stdout:3707: snap_remove snap 354 2024-09-10T18:09:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:46 smithi012 ceph-mon[89611]: osdmap e826: 8 total, 8 up, 8 in 2024-09-10T18:09:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:46 smithi012 ceph-mon[92029]: osdmap e826: 8 total, 8 up, 8 in 2024-09-10T18:09:47.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:47.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:46 smithi089 ceph-mon[84132]: osdmap e826: 8 total, 8 up, 8 in 2024-09-10T18:09:47.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:09:47.837 INFO:tasks.rados.rados.0.smithi012.stdout:3706: expect (ObjNum 1085 snap 347 seq_num 1085) 2024-09-10T18:09:47.889 INFO:tasks.rados.rados.0.smithi012.stdout:3706: done (1 left) 2024-09-10T18:09:47.889 INFO:tasks.rados.rados.0.smithi012.stdout:3707: done (0 left) 2024-09-10T18:09:47.889 INFO:tasks.rados.rados.0.smithi012.stdout:3708: rollback oid 47 current snap is 371 2024-09-10T18:09:47.889 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 358 2024-09-10T18:09:47.890 INFO:tasks.rados.rados.0.smithi012.stdout:3709: snap_remove snap 367 2024-09-10T18:09:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:47 smithi012 ceph-mon[89611]: osdmap e827: 8 total, 8 up, 8 in 2024-09-10T18:09:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:47 smithi012 ceph-mon[89611]: pgmap v928: 121 pgs: 121 active+clean; 256 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-09-10T18:09:48.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:47 smithi012 ceph-mon[89611]: osdmap e828: 8 total, 8 up, 8 in 2024-09-10T18:09:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:47 smithi012 ceph-mon[92029]: osdmap e827: 8 total, 8 up, 8 in 2024-09-10T18:09:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:47 smithi012 ceph-mon[92029]: pgmap v928: 121 pgs: 121 active+clean; 256 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-09-10T18:09:48.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:47 smithi012 ceph-mon[92029]: osdmap e828: 8 total, 8 up, 8 in 2024-09-10T18:09:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:47 smithi089 ceph-mon[84132]: osdmap e827: 8 total, 8 up, 8 in 2024-09-10T18:09:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:47 smithi089 ceph-mon[84132]: pgmap v928: 121 pgs: 121 active+clean; 256 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 10 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-09-10T18:09:48.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:47 smithi089 ceph-mon[84132]: osdmap e828: 8 total, 8 up, 8 in 2024-09-10T18:09:48.891 INFO:tasks.rados.rados.0.smithi012.stdout:3709: done (1 left) 2024-09-10T18:09:48.891 INFO:tasks.rados.rados.0.smithi012.stdout:3710: snap_create 2024-09-10T18:09:48.892 INFO:tasks.rados.rados.0.smithi012.stdout:3708: finishing rollback tid 0 to smithi01278544-47 2024-09-10T18:09:48.892 INFO:tasks.rados.rados.0.smithi012.stdout:3708: finishing rollback tid 1 to smithi01278544-47 2024-09-10T18:09:48.892 INFO:tasks.rados.rados.0.smithi012.stdout:3708: finishing rollback tid 2 to smithi01278544-47 2024-09-10T18:09:48.892 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 2541 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:09:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:3708: done (1 left) 2024-09-10T18:09:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:3710: done (0 left) 2024-09-10T18:09:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:3711: rmattr oid 2 current snap is 372 2024-09-10T18:09:49.896 INFO:tasks.rados.rados.0.smithi012.stdout:3712: delete oid 31 current snap is 372 2024-09-10T18:09:49.901 INFO:tasks.rados.rados.0.smithi012.stdout:3712: done (1 left) 2024-09-10T18:09:49.901 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 372 2024-09-10T18:09:49.901 INFO:tasks.rados.rados.0.smithi012.stdout:3713: seq_num 1133 ranges {1572864=581632,2154496=753664,2908160=573440,3481600=278528} 2024-09-10T18:09:49.913 INFO:tasks.rados.rados.0.smithi012.stdout:3713: writing smithi01278544-10 from 1572864 to 2154496 tid 1 2024-09-10T18:09:49.917 INFO:tasks.rados.rados.0.smithi012.stdout:3713: writing smithi01278544-10 from 2154496 to 2908160 tid 2 2024-09-10T18:09:49.920 INFO:tasks.rados.rados.0.smithi012.stdout:3713: writing smithi01278544-10 from 2908160 to 3481600 tid 3 2024-09-10T18:09:49.922 INFO:tasks.rados.rados.0.smithi012.stdout:3713: writing smithi01278544-10 from 3481600 to 3760128 tid 4 2024-09-10T18:09:49.922 INFO:tasks.rados.rados.0.smithi012.stdout:3714: read oid 24 snap 371 2024-09-10T18:09:49.922 INFO:tasks.rados.rados.0.smithi012.stdout:3714: expect (ObjNum 1063 snap 342 seq_num 1063) 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3715: read oid 23 snap -1 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3715: expect deleted 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3716: read oid 49 snap -1 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3716: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2348 (ObjNum 1105 snap 355 seq_num 1105) dirty exists 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3713: finishing write tid 1 to smithi01278544-10 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3717: read oid 7 snap -1 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3717: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3711: done (5 left) 2024-09-10T18:09:49.923 INFO:tasks.rados.rados.0.smithi012.stdout:3718: setattr oid 14 current snap is 372 2024-09-10T18:09:49.924 INFO:tasks.rados.rados.0.smithi012.stdout:3715: done (5 left) 2024-09-10T18:09:49.924 INFO:tasks.rados.rados.0.smithi012.stdout:3719: read oid 34 snap -1 2024-09-10T18:09:49.924 INFO:tasks.rados.rados.0.smithi012.stdout:3719: expect (ObjNum 1121 snap 364 seq_num 1121) 2024-09-10T18:09:49.924 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 372 2024-09-10T18:09:49.924 INFO:tasks.rados.rados.0.smithi012.stdout:3720: seq_num 1134 ranges {0=598016,598016=638976,1236992=737280,1974272=229376} 2024-09-10T18:09:49.927 INFO:tasks.rados.rados.0.smithi012.stdout:3720: writing smithi01278544-11 from 0 to 598016 tid 1 2024-09-10T18:09:49.931 INFO:tasks.rados.rados.0.smithi012.stdout:3720: writing smithi01278544-11 from 598016 to 1236992 tid 2 2024-09-10T18:09:49.936 INFO:tasks.rados.rados.0.smithi012.stdout:3720: writing smithi01278544-11 from 1236992 to 1974272 tid 3 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:3720: writing smithi01278544-11 from 1974272 to 2203648 tid 4 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:3721: read oid 16 snap -1 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:3721: expect (ObjNum 1100 snap 354 seq_num 1100) 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:3722: delete oid 8 current snap is 372 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:3713: finishing write tid 2 to smithi01278544-10 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:3713: finishing write tid 3 to smithi01278544-10 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:3713: finishing write tid 4 to smithi01278544-10 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 2545 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:09:49.938 INFO:tasks.rados.rados.0.smithi012.stdout:3719: expect (ObjNum 1121 snap 364 seq_num 1121) 2024-09-10T18:09:50.003 INFO:tasks.rados.rados.0.smithi012.stdout:3713: finishing write tid 5 to smithi01278544-10 2024-09-10T18:09:50.003 INFO:tasks.rados.rados.0.smithi012.stdout:3720: finishing write tid 1 to smithi01278544-11 2024-09-10T18:09:50.003 INFO:tasks.rados.rados.0.smithi012.stdout:3716: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:09:50.115 INFO:tasks.rados.rados.0.smithi012.stdout:3717: expect (ObjNum 953 snap 302 seq_num 953) 2024-09-10T18:09:50.161 INFO:tasks.rados.rados.0.smithi012.stdout:3720: finishing write tid 2 to smithi01278544-11 2024-09-10T18:09:50.161 INFO:tasks.rados.rados.0.smithi012.stdout:3720: finishing write tid 3 to smithi01278544-11 2024-09-10T18:09:50.161 INFO:tasks.rados.rados.0.smithi012.stdout:3713: finishing write tid 6 to smithi01278544-10 2024-09-10T18:09:50.161 INFO:tasks.rados.rados.0.smithi012.stdout:3713: oid 10 updating version 0 to 2832 2024-09-10T18:09:50.161 INFO:tasks.rados.rados.0.smithi012.stdout:3713: oid 10 updating version 2832 to 2835 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3713: oid 10 version 2835 is already newer than 2833 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3713: oid 10 updating version 2835 to 2836 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3713: oid 10 version 2836 is already newer than 2834 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2836 (ObjNum 1133 snap 372 seq_num 1133) dirty exists 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3713: left oid 10 (ObjNum 1133 snap 372 seq_num 1133) 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3720: finishing write tid 4 to smithi01278544-11 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3713: done (8 left) 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3716: done (7 left) 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3717: done (6 left) 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3718: done (5 left) 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3719: done (4 left) 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3722: done (3 left) 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3723: snap_create 2024-09-10T18:09:50.162 INFO:tasks.rados.rados.0.smithi012.stdout:3720: finishing write tid 5 to smithi01278544-11 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:3720: finishing write tid 6 to smithi01278544-11 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:3720: oid 11 updating version 0 to 2838 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:3720: oid 11 updating version 2838 to 2840 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:3720: oid 11 version 2840 is already newer than 2837 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:3720: oid 11 updating version 2840 to 2841 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:3720: oid 11 version 2841 is already newer than 2839 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2841 (ObjNum 1134 snap 372 seq_num 1134) dirty exists 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:3720: left oid 11 (ObjNum 1134 snap 372 seq_num 1134) 2024-09-10T18:09:50.163 INFO:tasks.rados.rados.0.smithi012.stdout:3714: expect (ObjNum 1063 snap 342 seq_num 1063) 2024-09-10T18:09:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:49 smithi012 ceph-mon[89611]: osdmap e829: 8 total, 8 up, 8 in 2024-09-10T18:09:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:49 smithi012 ceph-mon[89611]: pgmap v931: 121 pgs: 121 active+clean; 257 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 906 KiB/s wr, 20 op/s 2024-09-10T18:09:50.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:49 smithi012 ceph-mon[92029]: osdmap e829: 8 total, 8 up, 8 in 2024-09-10T18:09:50.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:49 smithi012 ceph-mon[92029]: pgmap v931: 121 pgs: 121 active+clean; 257 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 906 KiB/s wr, 20 op/s 2024-09-10T18:09:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:49 smithi089 ceph-mon[84132]: osdmap e829: 8 total, 8 up, 8 in 2024-09-10T18:09:50.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:49 smithi089 ceph-mon[84132]: pgmap v931: 121 pgs: 121 active+clean; 257 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.3 MiB/s rd, 906 KiB/s wr, 20 op/s 2024-09-10T18:09:50.310 INFO:tasks.rados.rados.0.smithi012.stdout:3721: expect (ObjNum 1100 snap 354 seq_num 1100) 2024-09-10T18:09:51.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:50 smithi012 ceph-mon[89611]: osdmap e830: 8 total, 8 up, 8 in 2024-09-10T18:09:51.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:50 smithi012 ceph-mon[92029]: osdmap e830: 8 total, 8 up, 8 in 2024-09-10T18:09:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:50 smithi089 ceph-mon[84132]: osdmap e830: 8 total, 8 up, 8 in 2024-09-10T18:09:51.928 INFO:tasks.rados.rados.0.smithi012.stdout:3714: done (3 left) 2024-09-10T18:09:51.928 INFO:tasks.rados.rados.0.smithi012.stdout:3720: done (2 left) 2024-09-10T18:09:51.928 INFO:tasks.rados.rados.0.smithi012.stdout:3721: done (1 left) 2024-09-10T18:09:51.928 INFO:tasks.rados.rados.0.smithi012.stdout:3723: done (0 left) 2024-09-10T18:09:51.928 INFO:tasks.rados.rados.0.smithi012.stdout:3724: snap_remove snap 365 2024-09-10T18:09:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:51 smithi012 ceph-mon[89611]: osdmap e831: 8 total, 8 up, 8 in 2024-09-10T18:09:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:51 smithi012 ceph-mon[89611]: pgmap v934: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 0 B/s wr, 3 op/s 2024-09-10T18:09:52.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:51 smithi012 ceph-mon[92029]: osdmap e831: 8 total, 8 up, 8 in 2024-09-10T18:09:52.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:51 smithi012 ceph-mon[92029]: pgmap v934: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 0 B/s wr, 3 op/s 2024-09-10T18:09:52.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:51 smithi089 ceph-mon[84132]: osdmap e831: 8 total, 8 up, 8 in 2024-09-10T18:09:52.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:51 smithi089 ceph-mon[84132]: pgmap v934: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 0 B/s wr, 3 op/s 2024-09-10T18:09:52.839 INFO:tasks.rados.rados.0.smithi012.stdout:3724: done (0 left) 2024-09-10T18:09:52.839 INFO:tasks.rados.rados.0.smithi012.stdout:3725: setattr oid 30 current snap is 373 2024-09-10T18:09:52.842 INFO:tasks.rados.rados.0.smithi012.stdout:3726: rollback oid 24 current snap is 373 2024-09-10T18:09:52.843 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 24 to 364 2024-09-10T18:09:52.843 INFO:tasks.rados.rados.0.smithi012.stdout:3727: read oid 37 snap -1 2024-09-10T18:09:52.843 INFO:tasks.rados.rados.0.smithi012.stdout:3727: expect deleted 2024-09-10T18:09:52.843 INFO:tasks.rados.rados.0.smithi012.stdout:3728: snap_remove snap 372 2024-09-10T18:09:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:3728: done (3 left) 2024-09-10T18:09:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:3729: copy_from oid 17 from oid 39 current snap is 373 2024-09-10T18:09:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:3730: snap_create 2024-09-10T18:09:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:3726: finishing rollback tid 0 to smithi01278544-24 2024-09-10T18:09:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:3726: finishing rollback tid 1 to smithi01278544-24 2024-09-10T18:09:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:3726: finishing rollback tid 2 to smithi01278544-24 2024-09-10T18:09:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 2068 (ObjNum 1063 snap 342 seq_num 1063) dirty exists 2024-09-10T18:09:53.845 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2517 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:09:53.850 INFO:tasks.rados.rados.0.smithi012.stdout:3729: finishing copy_from racing read to smithi01278544-17 2024-09-10T18:09:53.851 INFO:tasks.rados.rados.0.smithi012.stdout:3729: finishing copy_from to smithi01278544-17 2024-09-10T18:09:53.852 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2750 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:09:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:53 smithi012 ceph-mon[89611]: osdmap e832: 8 total, 8 up, 8 in 2024-09-10T18:09:54.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:53 smithi012 ceph-mon[92029]: osdmap e832: 8 total, 8 up, 8 in 2024-09-10T18:09:54.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:53 smithi089 ceph-mon[84132]: osdmap e832: 8 total, 8 up, 8 in 2024-09-10T18:09:54.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:09:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:09:54] "GET /metrics HTTP/1.1" 200 36355 "" "Prometheus/2.51.0" 2024-09-10T18:09:54.846 INFO:tasks.rados.rados.0.smithi012.stdout:3725: done (4 left) 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:3726: done (3 left) 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:3727: done (2 left) 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:3729: done (1 left) 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:3730: done (0 left) 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:3731: rollback oid 15 current snap is 374 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 15 to 373 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:3732: read oid 2 snap -1 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:3732: expect (ObjNum 1105 snap 355 seq_num 1105) 2024-09-10T18:09:54.847 INFO:tasks.rados.rados.0.smithi012.stdout:3733: setattr oid 21 current snap is 374 2024-09-10T18:09:54.848 INFO:tasks.rados.rados.0.smithi012.stdout:3734: delete oid 25 current snap is 374 2024-09-10T18:09:54.854 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 2349 (ObjNum 1122 snap 364 seq_num 1122) dirty exists 2024-09-10T18:09:54.857 INFO:tasks.rados.rados.0.smithi012.stdout:3733: done (3 left) 2024-09-10T18:09:54.857 INFO:tasks.rados.rados.0.smithi012.stdout:3734: done (2 left) 2024-09-10T18:09:54.857 INFO:tasks.rados.rados.0.smithi012.stdout:3735: setattr oid 14 current snap is 374 2024-09-10T18:09:54.857 INFO:tasks.rados.rados.0.smithi012.stdout:3731: finishing rollback tid 0 to smithi01278544-15 2024-09-10T18:09:54.859 INFO:tasks.rados.rados.0.smithi012.stdout:3736: rollback oid 6 current snap is 374 2024-09-10T18:09:54.859 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 6 to 369 2024-09-10T18:09:54.859 INFO:tasks.rados.rados.0.smithi012.stdout:3737: snap_create 2024-09-10T18:09:54.864 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 2551 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-09-10T18:09:54.864 INFO:tasks.rados.rados.0.smithi012.stdout:3736: finishing rollback tid 0 to smithi01278544-6 2024-09-10T18:09:54.865 INFO:tasks.rados.rados.0.smithi012.stdout:3736: finishing rollback tid 1 to smithi01278544-6 2024-09-10T18:09:54.865 INFO:tasks.rados.rados.0.smithi012.stdout:3736: finishing rollback tid 2 to smithi01278544-6 2024-09-10T18:09:54.865 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 6 v 2491 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-09-10T18:09:54.887 INFO:tasks.rados.rados.0.smithi012.stdout:3731: finishing rollback tid 1 to smithi01278544-15 2024-09-10T18:09:54.887 INFO:tasks.rados.rados.0.smithi012.stdout:3731: finishing rollback tid 2 to smithi01278544-15 2024-09-10T18:09:54.887 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2351 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:09:54.894 INFO:tasks.rados.rados.0.smithi012.stdout:3732: expect (ObjNum 1105 snap 355 seq_num 1105) 2024-09-10T18:09:55.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:54 smithi012 ceph-mon[89611]: pgmap v936: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 1010 KiB/s wr, 20 op/s 2024-09-10T18:09:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:54 smithi012 ceph-mon[89611]: osdmap e833: 8 total, 8 up, 8 in 2024-09-10T18:09:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:54 smithi012 ceph-mon[92029]: pgmap v936: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 1010 KiB/s wr, 20 op/s 2024-09-10T18:09:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:54 smithi012 ceph-mon[92029]: osdmap e833: 8 total, 8 up, 8 in 2024-09-10T18:09:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:54 smithi089 ceph-mon[84132]: pgmap v936: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 1010 KiB/s wr, 20 op/s 2024-09-10T18:09:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:54 smithi089 ceph-mon[84132]: osdmap e833: 8 total, 8 up, 8 in 2024-09-10T18:09:55.858 INFO:tasks.rados.rados.0.smithi012.stdout:3731: done (4 left) 2024-09-10T18:09:55.858 INFO:tasks.rados.rados.0.smithi012.stdout:3732: done (3 left) 2024-09-10T18:09:55.858 INFO:tasks.rados.rados.0.smithi012.stdout:3735: done (2 left) 2024-09-10T18:09:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:3736: done (1 left) 2024-09-10T18:09:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:3737: done (0 left) 2024-09-10T18:09:55.859 INFO:tasks.rados.rados.0.smithi012.stdout:3738: delete oid 4 current snap is 375 2024-09-10T18:09:55.863 INFO:tasks.rados.rados.0.smithi012.stdout:3738: done (0 left) 2024-09-10T18:09:55.863 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 375 2024-09-10T18:09:55.863 INFO:tasks.rados.rados.0.smithi012.stdout:3739: seq_num 1138 ranges {1572864=663552,2236416=581632,2818048=712704,3530752=311296} 2024-09-10T18:09:55.875 INFO:tasks.rados.rados.0.smithi012.stdout:3739: writing smithi01278544-7 from 1572864 to 2236416 tid 1 2024-09-10T18:09:55.878 INFO:tasks.rados.rados.0.smithi012.stdout:3739: writing smithi01278544-7 from 2236416 to 2818048 tid 2 2024-09-10T18:09:55.882 INFO:tasks.rados.rados.0.smithi012.stdout:3739: writing smithi01278544-7 from 2818048 to 3530752 tid 3 2024-09-10T18:09:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:3739: writing smithi01278544-7 from 3530752 to 3842048 tid 4 2024-09-10T18:09:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 375 2024-09-10T18:09:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:3739: finishing write tid 1 to smithi01278544-7 2024-09-10T18:09:55.884 INFO:tasks.rados.rados.0.smithi012.stdout:3740: seq_num 1139 ranges {1736704=679936,2416640=458752,2875392=524288,3399680=540672,3940352=81920} 2024-09-10T18:09:55.897 INFO:tasks.rados.rados.0.smithi012.stdout:3740: writing smithi01278544-44 from 1736704 to 2416640 tid 1 2024-09-10T18:09:55.900 INFO:tasks.rados.rados.0.smithi012.stdout:3740: writing smithi01278544-44 from 2416640 to 2875392 tid 2 2024-09-10T18:09:55.903 INFO:tasks.rados.rados.0.smithi012.stdout:3740: writing smithi01278544-44 from 2875392 to 3399680 tid 3 2024-09-10T18:09:55.906 INFO:tasks.rados.rados.0.smithi012.stdout:3740: writing smithi01278544-44 from 3399680 to 3940352 tid 4 2024-09-10T18:09:55.907 INFO:tasks.rados.rados.0.smithi012.stdout:3740: writing smithi01278544-44 from 3940352 to 4022272 tid 5 2024-09-10T18:09:55.907 INFO:tasks.rados.rados.0.smithi012.stdout:3741: snap_remove snap 369 2024-09-10T18:09:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:55 smithi012 ceph-mon[89611]: osdmap e834: 8 total, 8 up, 8 in 2024-09-10T18:09:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:55 smithi012 ceph-mon[89611]: pgmap v939: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 22 MiB/s rd, 1013 KiB/s wr, 20 op/s 2024-09-10T18:09:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:55 smithi012 ceph-mon[92029]: osdmap e834: 8 total, 8 up, 8 in 2024-09-10T18:09:56.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:55 smithi012 ceph-mon[92029]: pgmap v939: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 22 MiB/s rd, 1013 KiB/s wr, 20 op/s 2024-09-10T18:09:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:55 smithi089 ceph-mon[84132]: osdmap e834: 8 total, 8 up, 8 in 2024-09-10T18:09:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:55 smithi089 ceph-mon[84132]: pgmap v939: 121 pgs: 121 active+clean; 255 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 22 MiB/s rd, 1013 KiB/s wr, 20 op/s 2024-09-10T18:09:56.865 INFO:tasks.rados.rados.0.smithi012.stdout:3741: done (2 left) 2024-09-10T18:09:56.865 INFO:tasks.rados.rados.0.smithi012.stdout:3742: snap_create 2024-09-10T18:09:56.865 INFO:tasks.rados.rados.0.smithi012.stdout:3739: finishing write tid 2 to smithi01278544-7 2024-09-10T18:09:56.865 INFO:tasks.rados.rados.0.smithi012.stdout:3739: finishing write tid 3 to smithi01278544-7 2024-09-10T18:09:56.865 INFO:tasks.rados.rados.0.smithi012.stdout:3739: finishing write tid 4 to smithi01278544-7 2024-09-10T18:09:56.865 INFO:tasks.rados.rados.0.smithi012.stdout:3739: finishing write tid 5 to smithi01278544-7 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3739: finishing write tid 6 to smithi01278544-7 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3739: oid 7 updating version 0 to 2483 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3739: oid 7 updating version 2483 to 2484 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3739: oid 7 version 2484 is already newer than 2482 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3739: oid 7 updating version 2484 to 2485 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3739: oid 7 version 2485 is already newer than 2481 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 2485 (ObjNum 1138 snap 375 seq_num 1138) dirty exists 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3739: left oid 7 (ObjNum 1138 snap 375 seq_num 1138) 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3740: finishing write tid 1 to smithi01278544-44 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3740: finishing write tid 2 to smithi01278544-44 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3740: finishing write tid 3 to smithi01278544-44 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3740: finishing write tid 4 to smithi01278544-44 2024-09-10T18:09:56.866 INFO:tasks.rados.rados.0.smithi012.stdout:3740: finishing write tid 5 to smithi01278544-44 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: finishing write tid 6 to smithi01278544-44 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: finishing write tid 7 to smithi01278544-44 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: oid 44 updating version 0 to 2542 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: oid 44 version 2542 is already newer than 2540 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: oid 44 version 2542 is already newer than 2539 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: oid 44 version 2542 is already newer than 2541 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: oid 44 version 2542 is already newer than 2538 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: oid 44 version 2542 is already newer than 2537 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2542 (ObjNum 1139 snap 375 seq_num 1139) dirty exists 2024-09-10T18:09:56.867 INFO:tasks.rados.rados.0.smithi012.stdout:3740: left oid 44 (ObjNum 1139 snap 375 seq_num 1139) 2024-09-10T18:09:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:56 smithi012 ceph-mon[89611]: osdmap e835: 8 total, 8 up, 8 in 2024-09-10T18:09:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:56 smithi012 ceph-mon[92029]: osdmap e835: 8 total, 8 up, 8 in 2024-09-10T18:09:57.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:56 smithi089 ceph-mon[84132]: osdmap e835: 8 total, 8 up, 8 in 2024-09-10T18:09:57.840 INFO:tasks.rados.rados.0.smithi012.stdout:3739: done (2 left) 2024-09-10T18:09:57.840 INFO:tasks.rados.rados.0.smithi012.stdout:3740: done (1 left) 2024-09-10T18:09:57.840 INFO:tasks.rados.rados.0.smithi012.stdout:3742: done (0 left) 2024-09-10T18:09:57.840 INFO:tasks.rados.rados.0.smithi012.stdout:3743: snap_remove snap 374 2024-09-10T18:09:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:57 smithi012 ceph-mon[89611]: osdmap e836: 8 total, 8 up, 8 in 2024-09-10T18:09:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:57 smithi012 ceph-mon[89611]: pgmap v942: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2024-09-10T18:09:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:57 smithi012 ceph-mon[89611]: osdmap e837: 8 total, 8 up, 8 in 2024-09-10T18:09:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:57 smithi012 ceph-mon[92029]: osdmap e836: 8 total, 8 up, 8 in 2024-09-10T18:09:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:57 smithi012 ceph-mon[92029]: pgmap v942: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2024-09-10T18:09:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:57 smithi012 ceph-mon[92029]: osdmap e837: 8 total, 8 up, 8 in 2024-09-10T18:09:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:57 smithi089 ceph-mon[84132]: osdmap e836: 8 total, 8 up, 8 in 2024-09-10T18:09:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:57 smithi089 ceph-mon[84132]: pgmap v942: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2024-09-10T18:09:58.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:57 smithi089 ceph-mon[84132]: osdmap e837: 8 total, 8 up, 8 in 2024-09-10T18:09:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:3743: done (0 left) 2024-09-10T18:09:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:3744: rollback oid 37 current snap is 376 2024-09-10T18:09:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 37 to 368 2024-09-10T18:09:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 376 2024-09-10T18:09:58.843 INFO:tasks.rados.rados.0.smithi012.stdout:3745: seq_num 1140 ranges {3637248=696320,4333568=745472,5079040=729088,5808128=131072} 2024-09-10T18:09:58.866 INFO:tasks.rados.rados.0.smithi012.stdout:3745: writing smithi01278544-36 from 3637248 to 4333568 tid 1 2024-09-10T18:09:58.871 INFO:tasks.rados.rados.0.smithi012.stdout:3745: writing smithi01278544-36 from 4333568 to 5079040 tid 2 2024-09-10T18:09:58.875 INFO:tasks.rados.rados.0.smithi012.stdout:3745: writing smithi01278544-36 from 5079040 to 5808128 tid 3 2024-09-10T18:09:58.876 INFO:tasks.rados.rados.0.smithi012.stdout:3745: writing smithi01278544-36 from 5808128 to 5939200 tid 4 2024-09-10T18:09:58.876 INFO:tasks.rados.rados.0.smithi012.stdout:3746: read oid 21 snap -1 2024-09-10T18:09:58.876 INFO:tasks.rados.rados.0.smithi012.stdout:3746: expect (ObjNum 1122 snap 364 seq_num 1122) 2024-09-10T18:09:58.876 INFO:tasks.rados.rados.0.smithi012.stdout:3747: read oid 18 snap -1 2024-09-10T18:09:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:3747: expect (ObjNum 1073 snap 345 seq_num 1073) 2024-09-10T18:09:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:3748: read oid 28 snap -1 2024-09-10T18:09:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:3748: expect (ObjNum 1117 snap 360 seq_num 1117) 2024-09-10T18:09:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 376 2024-09-10T18:09:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:3744: finishing rollback tid 1 to smithi01278544-37 2024-09-10T18:09:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-10T18:09:58.877 INFO:tasks.rados.rados.0.smithi012.stdout:3749: seq_num 1141 ranges {5341184=712704,6053888=679936,6733824=540672,7274496=385024} 2024-09-10T18:09:58.910 INFO:tasks.rados.rados.0.smithi012.stdout:3749: writing smithi01278544-29 from 5341184 to 6053888 tid 1 2024-09-10T18:09:58.914 INFO:tasks.rados.rados.0.smithi012.stdout:3749: writing smithi01278544-29 from 6053888 to 6733824 tid 2 2024-09-10T18:09:58.917 INFO:tasks.rados.rados.0.smithi012.stdout:3749: writing smithi01278544-29 from 6733824 to 7274496 tid 3 2024-09-10T18:09:58.920 INFO:tasks.rados.rados.0.smithi012.stdout:3749: writing smithi01278544-29 from 7274496 to 7659520 tid 4 2024-09-10T18:09:58.920 INFO:tasks.rados.rados.0.smithi012.stdout:3744: done (5 left) 2024-09-10T18:09:58.920 INFO:tasks.rados.rados.0.smithi012.stdout:3750: rollback oid 24 current snap is 376 2024-09-10T18:09:58.920 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 24 to 344 2024-09-10T18:09:58.920 INFO:tasks.rados.rados.0.smithi012.stdout:3745: finishing write tid 1 to smithi01278544-36 2024-09-10T18:09:58.921 INFO:tasks.rados.rados.0.smithi012.stdout:3745: finishing write tid 2 to smithi01278544-36 2024-09-10T18:09:58.921 INFO:tasks.rados.rados.0.smithi012.stdout:3745: finishing write tid 3 to smithi01278544-36 2024-09-10T18:09:58.921 INFO:tasks.rados.rados.0.smithi012.stdout:3745: finishing write tid 4 to smithi01278544-36 2024-09-10T18:09:58.921 INFO:tasks.rados.rados.0.smithi012.stdout:3746: expect (ObjNum 1122 snap 364 seq_num 1122) 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:3745: finishing write tid 5 to smithi01278544-36 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:3745: finishing write tid 6 to smithi01278544-36 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:3745: oid 36 updating version 0 to 2073 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:3745: oid 36 version 2073 is already newer than 2069 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:3745: oid 36 version 2073 is already newer than 2070 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:3745: oid 36 version 2073 is already newer than 2071 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:3745: oid 36 version 2073 is already newer than 2072 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 2073 (ObjNum 1140 snap 376 seq_num 1140) dirty exists 2024-09-10T18:09:59.054 INFO:tasks.rados.rados.0.smithi012.stdout:3745: left oid 36 (ObjNum 1140 snap 376 seq_num 1140) 2024-09-10T18:09:59.055 INFO:tasks.rados.rados.0.smithi012.stdout:3747: expect (ObjNum 1073 snap 345 seq_num 1073) 2024-09-10T18:09:59.312 INFO:tasks.rados.rados.0.smithi012.stdout:3749: finishing write tid 1 to smithi01278544-29 2024-09-10T18:09:59.312 INFO:tasks.rados.rados.0.smithi012.stdout:3748: expect (ObjNum 1117 snap 360 seq_num 1117) 2024-09-10T18:09:59.926 INFO:tasks.rados.rados.0.smithi012.stdout:3749: finishing write tid 2 to smithi01278544-29 2024-09-10T18:09:59.926 INFO:tasks.rados.rados.0.smithi012.stdout:3745: done (5 left) 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3746: done (4 left) 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3747: done (3 left) 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3748: done (2 left) 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3751: setattr oid 26 current snap is 376 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: finishing write tid 3 to smithi01278544-29 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: finishing write tid 4 to smithi01278544-29 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: finishing write tid 5 to smithi01278544-29 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: finishing write tid 6 to smithi01278544-29 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: oid 29 updating version 0 to 1143 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: oid 29 version 1143 is already newer than 1140 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: oid 29 version 1143 is already newer than 1142 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: oid 29 version 1143 is already newer than 1141 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:3749: oid 29 version 1143 is already newer than 1139 2024-09-10T18:09:59.927 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1143 (ObjNum 1141 snap 376 seq_num 1141) dirty exists 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:3749: left oid 29 (ObjNum 1141 snap 376 seq_num 1141) 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:3750: finishing rollback tid 0 to smithi01278544-24 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:3750: finishing rollback tid 1 to smithi01278544-24 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:3750: finishing rollback tid 2 to smithi01278544-24 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 2076 (ObjNum 1063 snap 342 seq_num 1063) dirty exists 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:3749: done (2 left) 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:3750: done (1 left) 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:3752: rollback oid 23 current snap is 376 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 23 to 373 2024-09-10T18:09:59.928 INFO:tasks.rados.rados.0.smithi012.stdout:3753: snap_remove snap 375 2024-09-10T18:10:00.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:09:59 smithi012 ceph-mon[89611]: osdmap e838: 8 total, 8 up, 8 in 2024-09-10T18:10:00.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:09:59 smithi012 ceph-mon[92029]: osdmap e838: 8 total, 8 up, 8 in 2024-09-10T18:10:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:09:59 smithi089 ceph-mon[84132]: osdmap e838: 8 total, 8 up, 8 in 2024-09-10T18:10:00.852 INFO:tasks.rados.rados.0.smithi012.stdout:3753: done (2 left) 2024-09-10T18:10:00.852 INFO:tasks.rados.rados.0.smithi012.stdout:3754: read oid 22 snap 371 2024-09-10T18:10:00.853 INFO:tasks.rados.rados.0.smithi012.stdout:3754: expect (ObjNum 1128 snap 368 seq_num 1128) 2024-09-10T18:10:00.853 INFO:tasks.rados.rados.0.smithi012.stdout:3755: snap_remove snap 344 2024-09-10T18:10:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:00 smithi012 ceph-mon[89611]: pgmap v945: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 1.1 MiB/s wr, 14 op/s 2024-09-10T18:10:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:00 smithi012 ceph-mon[89611]: overall HEALTH_OK 2024-09-10T18:10:01.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:00 smithi012 ceph-mon[92029]: pgmap v945: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 1.1 MiB/s wr, 14 op/s 2024-09-10T18:10:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:00 smithi012 ceph-mon[92029]: overall HEALTH_OK 2024-09-10T18:10:01.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:00 smithi089 ceph-mon[84132]: pgmap v945: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 1.1 MiB/s wr, 14 op/s 2024-09-10T18:10:01.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:00 smithi089 ceph-mon[84132]: overall HEALTH_OK 2024-09-10T18:10:01.861 INFO:tasks.rados.rados.0.smithi012.stdout:3755: done (3 left) 2024-09-10T18:10:01.861 INFO:tasks.rados.rados.0.smithi012.stdout:3756: read oid 28 snap 370 2024-09-10T18:10:01.861 INFO:tasks.rados.rados.0.smithi012.stdout:3756: expect (ObjNum 1117 snap 360 seq_num 1117) 2024-09-10T18:10:01.861 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 376 2024-09-10T18:10:01.861 INFO:tasks.rados.rados.0.smithi012.stdout:3757: seq_num 1142 ranges {1982464=729088,2711552=565248,3276800=696320,3973120=344064} 2024-09-10T18:10:01.877 INFO:tasks.rados.rados.0.smithi012.stdout:3757: writing smithi01278544-34 from 1982464 to 2711552 tid 1 2024-09-10T18:10:01.881 INFO:tasks.rados.rados.0.smithi012.stdout:3757: writing smithi01278544-34 from 2711552 to 3276800 tid 2 2024-09-10T18:10:01.887 INFO:tasks.rados.rados.0.smithi012.stdout:3757: writing smithi01278544-34 from 3276800 to 3973120 tid 3 2024-09-10T18:10:01.889 INFO:tasks.rados.rados.0.smithi012.stdout:3757: writing smithi01278544-34 from 3973120 to 4317184 tid 4 2024-09-10T18:10:01.890 INFO:tasks.rados.rados.0.smithi012.stdout:3752: finishing rollback tid 1 to smithi01278544-23 2024-09-10T18:10:01.890 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 2334 (ObjNum 33 snap 0 seq_num 3497747456) dirty dne 2024-09-10T18:10:01.890 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2077 (ObjNum 1126 snap 366 seq_num 1126) dirty exists 2024-09-10T18:10:01.890 INFO:tasks.rados.rados.0.smithi012.stdout:3754: expect (ObjNum 1128 snap 368 seq_num 1128) 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: finishing write tid 1 to smithi01278544-34 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: finishing write tid 2 to smithi01278544-34 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: finishing write tid 3 to smithi01278544-34 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: finishing write tid 4 to smithi01278544-34 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: finishing write tid 5 to smithi01278544-34 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: finishing write tid 6 to smithi01278544-34 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: oid 34 updating version 0 to 2350 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: oid 34 updating version 2350 to 2353 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: oid 34 updating version 2353 to 2354 2024-09-10T18:10:02.045 INFO:tasks.rados.rados.0.smithi012.stdout:3757: oid 34 version 2354 is already newer than 2352 2024-09-10T18:10:02.046 INFO:tasks.rados.rados.0.smithi012.stdout:3757: oid 34 version 2354 is already newer than 2351 2024-09-10T18:10:02.046 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 2354 (ObjNum 1142 snap 376 seq_num 1142) dirty exists 2024-09-10T18:10:02.046 INFO:tasks.rados.rados.0.smithi012.stdout:3757: left oid 34 (ObjNum 1142 snap 376 seq_num 1142) 2024-09-10T18:10:02.046 INFO:tasks.rados.rados.0.smithi012.stdout:3756: expect (ObjNum 1117 snap 360 seq_num 1117) 2024-09-10T18:10:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:01 smithi012 ceph-mon[89611]: osdmap e839: 8 total, 8 up, 8 in 2024-09-10T18:10:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:01 smithi012 ceph-mon[89611]: pgmap v947: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 3.8 MiB/s rd, 522 KiB/s wr, 2 op/s 2024-09-10T18:10:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:01 smithi012 ceph-mon[92029]: osdmap e839: 8 total, 8 up, 8 in 2024-09-10T18:10:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:01 smithi012 ceph-mon[92029]: pgmap v947: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 3.8 MiB/s rd, 522 KiB/s wr, 2 op/s 2024-09-10T18:10:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:02.285 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:10:01 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:10:01.899+0000 7f8679e5b640 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 19c after trimming was started 2024-09-10T18:10:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:01 smithi089 ceph-mon[84132]: osdmap e839: 8 total, 8 up, 8 in 2024-09-10T18:10:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:01 smithi089 ceph-mon[84132]: pgmap v947: 121 pgs: 121 active+clean; 260 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 3.8 MiB/s rd, 522 KiB/s wr, 2 op/s 2024-09-10T18:10:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:02.656 INFO:tasks.rados.rados.0.smithi012.stdout:3751: done (4 left) 2024-09-10T18:10:02.656 INFO:tasks.rados.rados.0.smithi012.stdout:3752: done (3 left) 2024-09-10T18:10:02.656 INFO:tasks.rados.rados.0.smithi012.stdout:3754: done (2 left) 2024-09-10T18:10:02.656 INFO:tasks.rados.rados.0.smithi012.stdout:3756: done (1 left) 2024-09-10T18:10:02.656 INFO:tasks.rados.rados.0.smithi012.stdout:3757: done (0 left) 2024-09-10T18:10:02.657 INFO:tasks.rados.rados.0.smithi012.stdout:3758: read oid 34 snap -1 2024-09-10T18:10:02.657 INFO:tasks.rados.rados.0.smithi012.stdout:3758: expect (ObjNum 1142 snap 376 seq_num 1142) 2024-09-10T18:10:02.657 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 21 current snap is 376 2024-09-10T18:10:02.657 INFO:tasks.rados.rados.0.smithi012.stdout:3759: seq_num 1143 ranges {3702784=753664,4456448=450560,4907008=507904,5414912=589824,6004736=57344} 2024-09-10T18:10:02.680 INFO:tasks.rados.rados.0.smithi012.stdout:3759: writing smithi01278544-21 from 3702784 to 4456448 tid 1 2024-09-10T18:10:02.683 INFO:tasks.rados.rados.0.smithi012.stdout:3759: writing smithi01278544-21 from 4456448 to 4907008 tid 2 2024-09-10T18:10:02.686 INFO:tasks.rados.rados.0.smithi012.stdout:3759: writing smithi01278544-21 from 4907008 to 5414912 tid 3 2024-09-10T18:10:02.690 INFO:tasks.rados.rados.0.smithi012.stdout:3759: writing smithi01278544-21 from 5414912 to 6004736 tid 4 2024-09-10T18:10:02.690 INFO:tasks.rados.rados.0.smithi012.stdout:3759: writing smithi01278544-21 from 6004736 to 6062080 tid 5 2024-09-10T18:10:02.690 INFO:tasks.rados.rados.0.smithi012.stdout:3760: snap_remove snap 373 2024-09-10T18:10:02.839 INFO:tasks.rados.rados.0.smithi012.stdout:3760: done (2 left) 2024-09-10T18:10:02.839 INFO:tasks.rados.rados.0.smithi012.stdout:3761: rollback oid 8 current snap is 376 2024-09-10T18:10:02.839 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 8 to 358 2024-09-10T18:10:02.839 INFO:tasks.rados.rados.0.smithi012.stdout:3758: expect (ObjNum 1142 snap 376 seq_num 1142) 2024-09-10T18:10:02.997 INFO:tasks.rados.rados.0.smithi012.stdout:3759: finishing write tid 1 to smithi01278544-21 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: finishing write tid 2 to smithi01278544-21 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: finishing write tid 3 to smithi01278544-21 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: finishing write tid 4 to smithi01278544-21 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: finishing write tid 5 to smithi01278544-21 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: finishing write tid 6 to smithi01278544-21 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: finishing write tid 7 to smithi01278544-21 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: oid 21 updating version 0 to 2358 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: oid 21 version 2358 is already newer than 2356 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: oid 21 version 2358 is already newer than 2355 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: oid 21 updating version 2358 to 2359 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: oid 21 updating version 2359 to 2360 2024-09-10T18:10:02.998 INFO:tasks.rados.rados.0.smithi012.stdout:3759: oid 21 version 2360 is already newer than 2357 2024-09-10T18:10:02.999 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 2360 (ObjNum 1143 snap 376 seq_num 1143) dirty exists 2024-09-10T18:10:02.999 INFO:tasks.rados.rados.0.smithi012.stdout:3759: left oid 21 (ObjNum 1143 snap 376 seq_num 1143) 2024-09-10T18:10:02.999 INFO:tasks.rados.rados.0.smithi012.stdout:3758: done (2 left) 2024-09-10T18:10:02.999 INFO:tasks.rados.rados.0.smithi012.stdout:3759: done (1 left) 2024-09-10T18:10:02.999 INFO:tasks.rados.rados.0.smithi012.stdout:3762: delete oid 15 current snap is 376 2024-09-10T18:10:02.999 INFO:tasks.rados.rados.0.smithi012.stdout:3761: finishing rollback tid 1 to smithi01278544-8 2024-09-10T18:10:02.999 INFO:tasks.rados.rados.0.smithi012.stdout:3761: finishing rollback tid 2 to smithi01278544-8 2024-09-10T18:10:02.999 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 8 v 2493 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:10:03.000 INFO:tasks.rados.rados.0.smithi012.stdout:3761: done (1 left) 2024-09-10T18:10:03.000 INFO:tasks.rados.rados.0.smithi012.stdout:3762: done (0 left) 2024-09-10T18:10:03.000 INFO:tasks.rados.rados.0.smithi012.stdout:3763: read oid 7 snap 364 2024-09-10T18:10:03.000 INFO:tasks.rados.rados.0.smithi012.stdout:3763: expect (ObjNum -798504400 snap 22079 seq_num 3496700544) 2024-09-10T18:10:03.000 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 376 2024-09-10T18:10:03.000 INFO:tasks.rados.rados.0.smithi012.stdout:3764: seq_num 1145 ranges {0=786432,786432=622592,1409024=516096,1925120=417792,2342912=49152} 2024-09-10T18:10:03.004 INFO:tasks.rados.rados.0.smithi012.stdout:3764: writing smithi01278544-31 from 0 to 786432 tid 1 2024-09-10T18:10:03.008 INFO:tasks.rados.rados.0.smithi012.stdout:3764: writing smithi01278544-31 from 786432 to 1409024 tid 2 2024-09-10T18:10:03.010 INFO:tasks.rados.rados.0.smithi012.stdout:3764: writing smithi01278544-31 from 1409024 to 1925120 tid 3 2024-09-10T18:10:03.013 INFO:tasks.rados.rados.0.smithi012.stdout:3764: writing smithi01278544-31 from 1925120 to 2342912 tid 4 2024-09-10T18:10:03.013 INFO:tasks.rados.rados.0.smithi012.stdout:3764: writing smithi01278544-31 from 2342912 to 2392064 tid 5 2024-09-10T18:10:03.013 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 376 2024-09-10T18:10:03.014 INFO:tasks.rados.rados.0.smithi012.stdout:3765: seq_num 1146 ranges {1572864=802816,2375680=499712,2875392=679936,3555328=425984} 2024-09-10T18:10:03.026 INFO:tasks.rados.rados.0.smithi012.stdout:3765: writing smithi01278544-45 from 1572864 to 2375680 tid 1 2024-09-10T18:10:03.030 INFO:tasks.rados.rados.0.smithi012.stdout:3765: writing smithi01278544-45 from 2375680 to 2875392 tid 2 2024-09-10T18:10:03.033 INFO:tasks.rados.rados.0.smithi012.stdout:3765: writing smithi01278544-45 from 2875392 to 3555328 tid 3 2024-09-10T18:10:03.036 INFO:tasks.rados.rados.0.smithi012.stdout:3765: writing smithi01278544-45 from 3555328 to 3981312 tid 4 2024-09-10T18:10:03.036 INFO:tasks.rados.rados.0.smithi012.stdout:3766: copy_from oid 48 from oid 41 current snap is 376 2024-09-10T18:10:03.036 INFO:tasks.rados.rados.0.smithi012.stdout:3763: expect (ObjNum -798504400 snap 22079 seq_num 3496700544) 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3764: finishing write tid 1 to smithi01278544-31 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3764: finishing write tid 2 to smithi01278544-31 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3764: finishing write tid 3 to smithi01278544-31 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3763: done (3 left) 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3767: snap_create 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3764: finishing write tid 4 to smithi01278544-31 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3764: finishing write tid 5 to smithi01278544-31 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3764: finishing write tid 6 to smithi01278544-31 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3764: finishing write tid 7 to smithi01278544-31 2024-09-10T18:10:03.043 INFO:tasks.rados.rados.0.smithi012.stdout:3764: oid 31 updating version 0 to 2330 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3764: oid 31 version 2330 is already newer than 2328 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3764: oid 31 version 2330 is already newer than 2327 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3764: oid 31 updating version 2330 to 2332 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3764: oid 31 version 2332 is already newer than 2329 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3764: oid 31 version 2332 is already newer than 2331 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2332 (ObjNum 1145 snap 376 seq_num 1145) dirty exists 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3764: left oid 31 (ObjNum 1145 snap 376 seq_num 1145) 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3765: finishing write tid 1 to smithi01278544-45 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3765: finishing write tid 2 to smithi01278544-45 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3765: finishing write tid 3 to smithi01278544-45 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3765: finishing write tid 4 to smithi01278544-45 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3765: finishing write tid 5 to smithi01278544-45 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3765: finishing write tid 6 to smithi01278544-45 2024-09-10T18:10:03.044 INFO:tasks.rados.rados.0.smithi012.stdout:3765: oid 45 updating version 0 to 2573 2024-09-10T18:10:03.045 INFO:tasks.rados.rados.0.smithi012.stdout:3765: oid 45 version 2573 is already newer than 2570 2024-09-10T18:10:03.045 INFO:tasks.rados.rados.0.smithi012.stdout:3765: oid 45 version 2573 is already newer than 2572 2024-09-10T18:10:03.045 INFO:tasks.rados.rados.0.smithi012.stdout:3765: oid 45 version 2573 is already newer than 2571 2024-09-10T18:10:03.045 INFO:tasks.rados.rados.0.smithi012.stdout:3765: oid 45 version 2573 is already newer than 2569 2024-09-10T18:10:03.045 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2573 (ObjNum 1146 snap 376 seq_num 1146) dirty exists 2024-09-10T18:10:03.045 INFO:tasks.rados.rados.0.smithi012.stdout:3765: left oid 45 (ObjNum 1146 snap 376 seq_num 1146) 2024-09-10T18:10:03.073 INFO:tasks.rados.rados.0.smithi012.stdout:3766: finishing copy_from racing read to smithi01278544-48 2024-09-10T18:10:03.073 INFO:tasks.rados.rados.0.smithi012.stdout:3766: finishing copy_from to smithi01278544-48 2024-09-10T18:10:03.073 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 2318 (ObjNum 809 snap 264 seq_num 809) dirty exists 2024-09-10T18:10:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:02 smithi012 ceph-mon[89611]: osdmap e840: 8 total, 8 up, 8 in 2024-09-10T18:10:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:02 smithi012 ceph-mon[89611]: osdmap e841: 8 total, 8 up, 8 in 2024-09-10T18:10:03.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:02 smithi012 ceph-mon[92029]: osdmap e840: 8 total, 8 up, 8 in 2024-09-10T18:10:03.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:02 smithi012 ceph-mon[92029]: osdmap e841: 8 total, 8 up, 8 in 2024-09-10T18:10:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:02 smithi089 ceph-mon[84132]: osdmap e840: 8 total, 8 up, 8 in 2024-09-10T18:10:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:02 smithi089 ceph-mon[84132]: osdmap e841: 8 total, 8 up, 8 in 2024-09-10T18:10:03.872 INFO:tasks.rados.rados.0.smithi012.stdout:3764: done (3 left) 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3765: done (2 left) 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3766: done (1 left) 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3767: done (0 left) 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3768: read oid 12 snap -1 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3768: expect deleted 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3769: setattr oid 10 current snap is 377 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3770: read oid 28 snap -1 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3770: expect (ObjNum 1117 snap 360 seq_num 1117) 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3771: copy_from oid 18 from oid 22 current snap is 377 2024-09-10T18:10:03.873 INFO:tasks.rados.rados.0.smithi012.stdout:3772: setattr oid 7 current snap is 377 2024-09-10T18:10:03.874 INFO:tasks.rados.rados.0.smithi012.stdout:3773: delete oid 30 current snap is 377 2024-09-10T18:10:03.881 INFO:tasks.rados.rados.0.smithi012.stdout:3768: done (5 left) 2024-09-10T18:10:03.881 INFO:tasks.rados.rados.0.smithi012.stdout:3773: done (4 left) 2024-09-10T18:10:03.881 INFO:tasks.rados.rados.0.smithi012.stdout:3774: rmattr oid 27 current snap is 377 2024-09-10T18:10:03.881 INFO:tasks.rados.rados.0.smithi012.stdout:3774: done (4 left) 2024-09-10T18:10:03.881 INFO:tasks.rados.rados.0.smithi012.stdout:3775: snap_create 2024-09-10T18:10:03.883 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 2486 (ObjNum 1138 snap 375 seq_num 1138) dirty exists 2024-09-10T18:10:03.886 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2871 (ObjNum 1133 snap 372 seq_num 1133) dirty exists 2024-09-10T18:10:03.898 INFO:tasks.rados.rados.0.smithi012.stdout:3771: finishing copy_from racing read to smithi01278544-18 2024-09-10T18:10:03.898 INFO:tasks.rados.rados.0.smithi012.stdout:3771: finishing copy_from to smithi01278544-18 2024-09-10T18:10:03.898 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 2780 (ObjNum 1128 snap 368 seq_num 1128) dirty exists 2024-09-10T18:10:03.904 INFO:tasks.rados.rados.0.smithi012.stdout:3770: expect (ObjNum 1117 snap 360 seq_num 1117) 2024-09-10T18:10:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:03 smithi012 ceph-mon[89611]: pgmap v950: 121 pgs: 121 active+clean; 256 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T18:10:04.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:03 smithi012 ceph-mon[92029]: pgmap v950: 121 pgs: 121 active+clean; 256 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T18:10:04.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:03 smithi089 ceph-mon[84132]: pgmap v950: 121 pgs: 121 active+clean; 256 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 9.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T18:10:04.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:10:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:10:04] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.51.0" 2024-09-10T18:10:04.879 INFO:tasks.rados.rados.0.smithi012.stdout:3769: done (4 left) 2024-09-10T18:10:04.879 INFO:tasks.rados.rados.0.smithi012.stdout:3770: done (3 left) 2024-09-10T18:10:04.879 INFO:tasks.rados.rados.0.smithi012.stdout:3771: done (2 left) 2024-09-10T18:10:04.879 INFO:tasks.rados.rados.0.smithi012.stdout:3772: done (1 left) 2024-09-10T18:10:04.879 INFO:tasks.rados.rados.0.smithi012.stdout:3775: done (0 left) 2024-09-10T18:10:04.879 INFO:tasks.rados.rados.0.smithi012.stdout:3776: snap_remove snap 370 2024-09-10T18:10:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:04 smithi012 ceph-mon[89611]: osdmap e842: 8 total, 8 up, 8 in 2024-09-10T18:10:05.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:04 smithi012 ceph-mon[92029]: osdmap e842: 8 total, 8 up, 8 in 2024-09-10T18:10:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:04 smithi089 ceph-mon[84132]: osdmap e842: 8 total, 8 up, 8 in 2024-09-10T18:10:05.886 INFO:tasks.rados.rados.0.smithi012.stdout:3776: done (0 left) 2024-09-10T18:10:05.887 INFO:tasks.rados.rados.0.smithi012.stdout:3777: read oid 49 snap -1 2024-09-10T18:10:05.887 INFO:tasks.rados.rados.0.smithi012.stdout:3777: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:10:05.887 INFO:tasks.rados.rados.0.smithi012.stdout:3778: read oid 48 snap -1 2024-09-10T18:10:05.887 INFO:tasks.rados.rados.0.smithi012.stdout:3778: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:10:05.887 INFO:tasks.rados.rados.0.smithi012.stdout:3779: copy_from oid 30 from oid 22 current snap is 378 2024-09-10T18:10:05.887 INFO:tasks.rados.rados.0.smithi012.stdout:3780: copy_from oid 37 from oid 3 current snap is 378 2024-09-10T18:10:05.887 INFO:tasks.rados.rados.0.smithi012.stdout:3781: snap_remove snap 377 2024-09-10T18:10:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:05 smithi012 ceph-mon[89611]: osdmap e843: 8 total, 8 up, 8 in 2024-09-10T18:10:06.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:05 smithi012 ceph-mon[89611]: pgmap v953: 121 pgs: 121 active+clean; 266 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-09-10T18:10:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:05 smithi012 ceph-mon[92029]: osdmap e843: 8 total, 8 up, 8 in 2024-09-10T18:10:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:05 smithi012 ceph-mon[92029]: pgmap v953: 121 pgs: 121 active+clean; 266 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-09-10T18:10:06.285 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:10:05 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[97326]: 2024-09-10T18:10:05.929+0000 7f853a04e640 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 1b6 after trimming was started 2024-09-10T18:10:06.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:05 smithi089 ceph-mon[84132]: osdmap e843: 8 total, 8 up, 8 in 2024-09-10T18:10:06.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:05 smithi089 ceph-mon[84132]: pgmap v953: 121 pgs: 121 active+clean; 266 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-09-10T18:10:06.889 INFO:tasks.rados.rados.0.smithi012.stdout:3781: done (4 left) 2024-09-10T18:10:06.890 INFO:tasks.rados.rados.0.smithi012.stdout:3782: read oid 46 snap -1 2024-09-10T18:10:06.890 INFO:tasks.rados.rados.0.smithi012.stdout:3782: expect (ObjNum 1031 snap 331 seq_num 1031) 2024-09-10T18:10:06.890 INFO:tasks.rados.rados.0.smithi012.stdout:3780: finishing copy_from racing read to smithi01278544-37 2024-09-10T18:10:06.890 INFO:tasks.rados.rados.0.smithi012.stdout:3779: finishing copy_from racing read to smithi01278544-30 2024-09-10T18:10:06.890 INFO:tasks.rados.rados.0.smithi012.stdout:3777: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:10:07.003 INFO:tasks.rados.rados.0.smithi012.stdout:3780: finishing copy_from to smithi01278544-37 2024-09-10T18:10:07.003 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 2517 (ObjNum 1104 snap 354 seq_num 1104) dirty exists 2024-09-10T18:10:07.003 INFO:tasks.rados.rados.0.smithi012.stdout:3779: finishing copy_from to smithi01278544-30 2024-09-10T18:10:07.003 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2780 (ObjNum 1128 snap 368 seq_num 1128) dirty exists 2024-09-10T18:10:07.003 INFO:tasks.rados.rados.0.smithi012.stdout:3777: done (4 left) 2024-09-10T18:10:07.003 INFO:tasks.rados.rados.0.smithi012.stdout:3779: done (3 left) 2024-09-10T18:10:07.004 INFO:tasks.rados.rados.0.smithi012.stdout:3780: done (2 left) 2024-09-10T18:10:07.004 INFO:tasks.rados.rados.0.smithi012.stdout:3783: read oid 31 snap 358 2024-09-10T18:10:07.004 INFO:tasks.rados.rados.0.smithi012.stdout:3783: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:10:07.004 INFO:tasks.rados.rados.0.smithi012.stdout:3784: read oid 5 snap -1 2024-09-10T18:10:07.004 INFO:tasks.rados.rados.0.smithi012.stdout:3784: expect (ObjNum 1097 snap 351 seq_num 1097) 2024-09-10T18:10:07.004 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 9 current snap is 378 2024-09-10T18:10:07.004 INFO:tasks.rados.rados.0.smithi012.stdout:3778: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:10:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:06 smithi012 ceph-mon[89611]: osdmap e844: 8 total, 8 up, 8 in 2024-09-10T18:10:07.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:06 smithi012 ceph-mon[92029]: osdmap e844: 8 total, 8 up, 8 in 2024-09-10T18:10:07.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:06 smithi089 ceph-mon[84132]: osdmap e844: 8 total, 8 up, 8 in 2024-09-10T18:10:07.875 INFO:tasks.rados.rados.0.smithi012.stdout:3783: expect (ObjNum 923 snap 296 seq_num 923) 2024-09-10T18:10:07.903 INFO:tasks.rados.rados.0.smithi012.stdout:3784: expect (ObjNum 1097 snap 351 seq_num 1097) 2024-09-10T18:10:07.946 INFO:tasks.rados.rados.0.smithi012.stdout:3782: expect (ObjNum 1031 snap 331 seq_num 1031) 2024-09-10T18:10:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:07 smithi012 ceph-mon[89611]: osdmap e845: 8 total, 8 up, 8 in 2024-09-10T18:10:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:07 smithi012 ceph-mon[89611]: pgmap v956: 121 pgs: 121 active+clean; 236 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-09-10T18:10:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:07 smithi012 ceph-mon[89611]: osdmap e846: 8 total, 8 up, 8 in 2024-09-10T18:10:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:07 smithi012 ceph-mon[92029]: osdmap e845: 8 total, 8 up, 8 in 2024-09-10T18:10:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:07 smithi012 ceph-mon[92029]: pgmap v956: 121 pgs: 121 active+clean; 236 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-09-10T18:10:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:07 smithi012 ceph-mon[92029]: osdmap e846: 8 total, 8 up, 8 in 2024-09-10T18:10:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:07 smithi089 ceph-mon[84132]: osdmap e845: 8 total, 8 up, 8 in 2024-09-10T18:10:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:07 smithi089 ceph-mon[84132]: pgmap v956: 121 pgs: 121 active+clean; 236 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-09-10T18:10:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:07 smithi089 ceph-mon[84132]: osdmap e846: 8 total, 8 up, 8 in 2024-09-10T18:10:08.300 INFO:tasks.rados.rados.0.smithi012.stdout:3785: seq_num 1148 ranges {0=32768} 2024-09-10T18:10:08.300 INFO:tasks.rados.rados.0.smithi012.stdout:3785: writing smithi01278544-9 from 0 to 32768 tid 1 2024-09-10T18:10:08.301 INFO:tasks.rados.rados.0.smithi012.stdout:3778: done (4 left) 2024-09-10T18:10:08.301 INFO:tasks.rados.rados.0.smithi012.stdout:3782: done (3 left) 2024-09-10T18:10:08.301 INFO:tasks.rados.rados.0.smithi012.stdout:3783: done (2 left) 2024-09-10T18:10:08.301 INFO:tasks.rados.rados.0.smithi012.stdout:3784: done (1 left) 2024-09-10T18:10:08.301 INFO:tasks.rados.rados.0.smithi012.stdout:3786: delete oid 38 current snap is 378 2024-09-10T18:10:08.303 INFO:tasks.rados.rados.0.smithi012.stdout:3785: finishing write tid 1 to smithi01278544-9 2024-09-10T18:10:08.303 INFO:tasks.rados.rados.0.smithi012.stdout:3785: finishing write tid 2 to smithi01278544-9 2024-09-10T18:10:08.304 INFO:tasks.rados.rados.0.smithi012.stdout:3786: done (1 left) 2024-09-10T18:10:08.304 INFO:tasks.rados.rados.0.smithi012.stdout:3787: read oid 41 snap -1 2024-09-10T18:10:08.304 INFO:tasks.rados.rados.0.smithi012.stdout:3787: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:10:08.304 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 378 2024-09-10T18:10:08.304 INFO:tasks.rados.rados.0.smithi012.stdout:3788: seq_num 1150 ranges {6176768=65536} 2024-09-10T18:10:08.339 INFO:tasks.rados.rados.0.smithi012.stdout:3788: writing smithi01278544-46 from 6176768 to 6242304 tid 1 2024-09-10T18:10:08.339 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 378 2024-09-10T18:10:08.339 INFO:tasks.rados.rados.0.smithi012.stdout:3789: seq_num 1151 ranges {6520832=81920} 2024-09-10T18:10:08.375 INFO:tasks.rados.rados.0.smithi012.stdout:3789: writing smithi01278544-27 from 6520832 to 6602752 tid 1 2024-09-10T18:10:08.375 INFO:tasks.rados.rados.0.smithi012.stdout:3790: read oid 6 snap -1 2024-09-10T18:10:08.375 INFO:tasks.rados.rados.0.smithi012.stdout:3790: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:08.376 INFO:tasks.rados.rados.0.smithi012.stdout:3791: rollback oid 44 current snap is 378 2024-09-10T18:10:08.376 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 44 to 358 2024-09-10T18:10:08.376 INFO:tasks.rados.rados.0.smithi012.stdout:3785: finishing write tid 3 to smithi01278544-9 2024-09-10T18:10:08.376 INFO:tasks.rados.rados.0.smithi012.stdout:3785: oid 9 updating version 0 to 2320 2024-09-10T18:10:08.376 INFO:tasks.rados.rados.0.smithi012.stdout:3785: oid 9 version 2320 is already newer than 2319 2024-09-10T18:10:08.376 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 2320 (ObjNum 1148 snap 378 seq_num 1148) dirty exists 2024-09-10T18:10:08.376 INFO:tasks.rados.rados.0.smithi012.stdout:3785: left oid 9 (ObjNum 1148 snap 378 seq_num 1148) 2024-09-10T18:10:08.376 INFO:tasks.rados.rados.0.smithi012.stdout:3787: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3788: finishing write tid 1 to smithi01278544-46 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3788: finishing write tid 2 to smithi01278544-46 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3785: done (5 left) 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3787: done (4 left) 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 378 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3788: finishing write tid 3 to smithi01278544-46 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3788: oid 46 updating version 0 to 2543 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3788: oid 46 updating version 2543 to 2544 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 2544 (ObjNum 1150 snap 378 seq_num 1150) dirty exists 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3788: left oid 46 (ObjNum 1150 snap 378 seq_num 1150) 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3789: finishing write tid 1 to smithi01278544-27 2024-09-10T18:10:09.245 INFO:tasks.rados.rados.0.smithi012.stdout:3789: finishing write tid 2 to smithi01278544-27 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3792: seq_num 1152 ranges {0=98304} 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3792: writing smithi01278544-12 from 0 to 98304 tid 1 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3788: done (4 left) 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3793: read oid 30 snap 358 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3793: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3794: read oid 10 snap -1 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3794: expect (ObjNum 1133 snap 372 seq_num 1133) 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3795: read oid 48 snap 368 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3795: expect (ObjNum 1127 snap 367 seq_num 1127) 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3796: delete oid 32 current snap is 378 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3791: finishing rollback tid 0 to smithi01278544-44 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3789: finishing write tid 3 to smithi01278544-27 2024-09-10T18:10:09.246 INFO:tasks.rados.rados.0.smithi012.stdout:3789: oid 27 updating version 0 to 2546 2024-09-10T18:10:09.247 INFO:tasks.rados.rados.0.smithi012.stdout:3789: oid 27 version 2546 is already newer than 2545 2024-09-10T18:10:09.247 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 2546 (ObjNum 1151 snap 378 seq_num 1151) dirty exists 2024-09-10T18:10:09.247 INFO:tasks.rados.rados.0.smithi012.stdout:3789: left oid 27 (ObjNum 1151 snap 378 seq_num 1151) 2024-09-10T18:10:09.247 INFO:tasks.rados.rados.0.smithi012.stdout:3791: finishing rollback tid 1 to smithi01278544-44 2024-09-10T18:10:09.247 INFO:tasks.rados.rados.0.smithi012.stdout:3790: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:09.326 INFO:tasks.rados.rados.0.smithi012.stdout:3791: finishing rollback tid 2 to smithi01278544-44 2024-09-10T18:10:09.326 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2549 (ObjNum 1106 snap 355 seq_num 1106) dirty exists 2024-09-10T18:10:09.326 INFO:tasks.rados.rados.0.smithi012.stdout:3789: done (7 left) 2024-09-10T18:10:09.326 INFO:tasks.rados.rados.0.smithi012.stdout:3790: done (6 left) 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3791: done (5 left) 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3796: done (4 left) 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3797: read oid 6 snap -1 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3797: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3798: read oid 20 snap -1 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3798: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3799: read oid 8 snap -1 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3799: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3800: delete oid 38 current snap is 378 2024-09-10T18:10:09.327 INFO:tasks.rados.rados.0.smithi012.stdout:3795: expect (ObjNum 1127 snap 367 seq_num 1127) 2024-09-10T18:10:09.384 INFO:tasks.rados.rados.0.smithi012.stdout:3792: finishing write tid 1 to smithi01278544-12 2024-09-10T18:10:09.384 INFO:tasks.rados.rados.0.smithi012.stdout:3792: finishing write tid 2 to smithi01278544-12 2024-09-10T18:10:09.384 INFO:tasks.rados.rados.0.smithi012.stdout:3795: done (7 left) 2024-09-10T18:10:09.384 INFO:tasks.rados.rados.0.smithi012.stdout:3800: done (6 left) 2024-09-10T18:10:09.384 INFO:tasks.rados.rados.0.smithi012.stdout:3801: delete oid 28 current snap is 378 2024-09-10T18:10:09.385 INFO:tasks.rados.rados.0.smithi012.stdout:3792: finishing write tid 3 to smithi01278544-12 2024-09-10T18:10:09.385 INFO:tasks.rados.rados.0.smithi012.stdout:3792: oid 12 updating version 0 to 2877 2024-09-10T18:10:09.385 INFO:tasks.rados.rados.0.smithi012.stdout:3792: oid 12 version 2877 is already newer than 2876 2024-09-10T18:10:09.385 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2877 (ObjNum 1152 snap 378 seq_num 1152) dirty exists 2024-09-10T18:10:09.385 INFO:tasks.rados.rados.0.smithi012.stdout:3792: left oid 12 (ObjNum 1152 snap 378 seq_num 1152) 2024-09-10T18:10:09.385 INFO:tasks.rados.rados.0.smithi012.stdout:3794: expect (ObjNum 1133 snap 372 seq_num 1133) 2024-09-10T18:10:09.509 INFO:tasks.rados.rados.0.smithi012.stdout:3793: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:10:09.745 INFO:tasks.rados.rados.0.smithi012.stdout:3797: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:09.821 INFO:tasks.rados.rados.0.smithi012.stdout:3799: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:10:09.825 INFO:tasks.rados.rados.0.smithi012.stdout:3798: expect (ObjNum 973 snap 308 seq_num 973) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3792: done (6 left) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3793: done (5 left) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3794: done (4 left) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3797: done (3 left) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3798: done (2 left) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3799: done (1 left) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3801: done (0 left) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3802: read oid 30 snap -1 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3802: expect (ObjNum 1128 snap 368 seq_num 1128) 2024-09-10T18:10:10.065 INFO:tasks.rados.rados.0.smithi012.stdout:3803: snap_remove snap 376 2024-09-10T18:10:10.201 INFO:tasks.rados.rados.0.smithi012.stdout:3803: done (1 left) 2024-09-10T18:10:10.201 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 38 current snap is 378 2024-09-10T18:10:10.201 INFO:tasks.rados.rados.0.smithi012.stdout:3804: seq_num 1156 ranges {0=163840} 2024-09-10T18:10:10.201 INFO:tasks.rados.rados.0.smithi012.stdout:3804: writing smithi01278544-38 from 0 to 163840 tid 1 2024-09-10T18:10:10.201 INFO:tasks.rados.rados.0.smithi012.stdout:3805: copy_from oid 24 from oid 33 current snap is 378 2024-09-10T18:10:10.201 INFO:tasks.rados.rados.0.smithi012.stdout:3802: expect (ObjNum 1128 snap 368 seq_num 1128) 2024-09-10T18:10:10.352 INFO:tasks.rados.rados.0.smithi012.stdout:3804: finishing write tid 1 to smithi01278544-38 2024-09-10T18:10:10.352 INFO:tasks.rados.rados.0.smithi012.stdout:3804: finishing write tid 2 to smithi01278544-38 2024-09-10T18:10:10.352 INFO:tasks.rados.rados.0.smithi012.stdout:3804: finishing write tid 3 to smithi01278544-38 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:3804: oid 38 updating version 0 to 2322 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:3804: oid 38 version 2322 is already newer than 2321 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 2322 (ObjNum 1156 snap 378 seq_num 1156) dirty exists 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:3804: left oid 38 (ObjNum 1156 snap 378 seq_num 1156) 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:3805: finishing copy_from racing read to smithi01278544-24 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:3805: finishing copy_from to smithi01278544-24 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 2487 (ObjNum 1112 snap 357 seq_num 1112) dirty exists 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:3802: done (2 left) 2024-09-10T18:10:10.353 INFO:tasks.rados.rados.0.smithi012.stdout:3804: done (1 left) 2024-09-10T18:10:10.354 INFO:tasks.rados.rados.0.smithi012.stdout:3805: done (0 left) 2024-09-10T18:10:10.354 INFO:tasks.rados.rados.0.smithi012.stdout:3806: read oid 7 snap -1 2024-09-10T18:10:10.354 INFO:tasks.rados.rados.0.smithi012.stdout:3806: expect (ObjNum 1138 snap 375 seq_num 1138) 2024-09-10T18:10:10.354 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 378 2024-09-10T18:10:10.354 INFO:tasks.rados.rados.0.smithi012.stdout:3807: seq_num 1157 ranges {98304=180224} 2024-09-10T18:10:10.355 INFO:tasks.rados.rados.0.smithi012.stdout:3807: writing smithi01278544-12 from 98304 to 278528 tid 1 2024-09-10T18:10:10.355 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 378 2024-09-10T18:10:10.355 INFO:tasks.rados.rados.0.smithi012.stdout:3808: seq_num 1158 ranges {10133504=196608} 2024-09-10T18:10:10.412 INFO:tasks.rados.rados.0.smithi012.stdout:3808: writing smithi01278544-48 from 10133504 to 10330112 tid 1 2024-09-10T18:10:10.412 INFO:tasks.rados.rados.0.smithi012.stdout:3809: snap_remove snap 358 2024-09-10T18:10:10.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:10 smithi012 ceph-mon[89611]: pgmap v958: 121 pgs: 121 active+clean; 240 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 4.0 MiB/s wr, 21 op/s 2024-09-10T18:10:10.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:10 smithi012 ceph-mon[92029]: pgmap v958: 121 pgs: 121 active+clean; 240 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 4.0 MiB/s wr, 21 op/s 2024-09-10T18:10:10.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:10 smithi089 ceph-mon[84132]: pgmap v958: 121 pgs: 121 active+clean; 240 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 4.0 MiB/s wr, 21 op/s 2024-09-10T18:10:11.215 INFO:tasks.rados.rados.0.smithi012.stdout:3809: done (3 left) 2024-09-10T18:10:11.215 INFO:tasks.rados.rados.0.smithi012.stdout:3810: read oid 49 snap -1 2024-09-10T18:10:11.215 INFO:tasks.rados.rados.0.smithi012.stdout:3810: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:10:11.215 INFO:tasks.rados.rados.0.smithi012.stdout:3811: snap_remove snap 364 2024-09-10T18:10:11.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:11 smithi012 ceph-mon[89611]: osdmap e847: 8 total, 8 up, 8 in 2024-09-10T18:10:11.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:11 smithi012 ceph-mon[92029]: osdmap e847: 8 total, 8 up, 8 in 2024-09-10T18:10:11.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:11 smithi089 ceph-mon[84132]: osdmap e847: 8 total, 8 up, 8 in 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3811: done (4 left) 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3812: rmattr oid 20 current snap is 378 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3807: finishing write tid 1 to smithi01278544-12 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3813: read oid 4 snap -1 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3813: expect deleted 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3814: copy_from oid 23 from oid 9 current snap is 378 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3815: read oid 6 snap 368 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3815: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:12.215 INFO:tasks.rados.rados.0.smithi012.stdout:3816: delete oid 30 current snap is 378 2024-09-10T18:10:12.216 INFO:tasks.rados.rados.0.smithi012.stdout:3807: finishing write tid 2 to smithi01278544-12 2024-09-10T18:10:12.216 INFO:tasks.rados.rados.0.smithi012.stdout:3807: finishing write tid 3 to smithi01278544-12 2024-09-10T18:10:12.216 INFO:tasks.rados.rados.0.smithi012.stdout:3807: oid 12 updating version 0 to 2881 2024-09-10T18:10:12.216 INFO:tasks.rados.rados.0.smithi012.stdout:3807: oid 12 version 2881 is already newer than 2880 2024-09-10T18:10:12.216 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2881 (ObjNum 1157 snap 378 seq_num 1157) dirty exists 2024-09-10T18:10:12.216 INFO:tasks.rados.rados.0.smithi012.stdout:3807: left oid 12 (ObjNum 1157 snap 378 seq_num 1157) 2024-09-10T18:10:12.216 INFO:tasks.rados.rados.0.smithi012.stdout:3806: expect (ObjNum 1138 snap 375 seq_num 1138) 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3808: finishing write tid 1 to smithi01278544-48 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3808: finishing write tid 2 to smithi01278544-48 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3808: finishing write tid 3 to smithi01278544-48 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3808: oid 48 updating version 0 to 2323 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3808: oid 48 updating version 2323 to 2324 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 2324 (ObjNum 1158 snap 378 seq_num 1158) dirty exists 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3808: left oid 48 (ObjNum 1158 snap 378 seq_num 1158) 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3806: done (8 left) 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3807: done (7 left) 2024-09-10T18:10:12.355 INFO:tasks.rados.rados.0.smithi012.stdout:3808: done (6 left) 2024-09-10T18:10:12.356 INFO:tasks.rados.rados.0.smithi012.stdout:3816: done (5 left) 2024-09-10T18:10:12.356 INFO:tasks.rados.rados.0.smithi012.stdout:3817: read oid 24 snap 368 2024-09-10T18:10:12.356 INFO:tasks.rados.rados.0.smithi012.stdout:3817: expect (ObjNum 1063 snap 342 seq_num 1063) 2024-09-10T18:10:12.356 INFO:tasks.rados.rados.0.smithi012.stdout:3818: snap_create 2024-09-10T18:10:12.356 INFO:tasks.rados.rados.0.smithi012.stdout:3810: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:10:12.469 INFO:tasks.rados.rados.0.smithi012.stdout:3814: finishing copy_from racing read to smithi01278544-23 2024-09-10T18:10:12.469 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2895 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:10:12.469 INFO:tasks.rados.rados.0.smithi012.stdout:3815: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:12.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:12 smithi012 ceph-mon[89611]: pgmap v960: 121 pgs: 121 active+clean; 242 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 25 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2024-09-10T18:10:12.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:12 smithi012 ceph-mon[89611]: osdmap e848: 8 total, 8 up, 8 in 2024-09-10T18:10:12.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:12 smithi012 ceph-mon[92029]: pgmap v960: 121 pgs: 121 active+clean; 242 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 25 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2024-09-10T18:10:12.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:12 smithi012 ceph-mon[92029]: osdmap e848: 8 total, 8 up, 8 in 2024-09-10T18:10:12.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:12 smithi089 ceph-mon[84132]: pgmap v960: 121 pgs: 121 active+clean; 242 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 25 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2024-09-10T18:10:12.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:12 smithi089 ceph-mon[84132]: osdmap e848: 8 total, 8 up, 8 in 2024-09-10T18:10:12.544 INFO:tasks.rados.rados.0.smithi012.stdout:3814: finishing copy_from to smithi01278544-23 2024-09-10T18:10:12.544 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 2320 (ObjNum 1148 snap 378 seq_num 1148) dirty exists 2024-09-10T18:10:12.544 INFO:tasks.rados.rados.0.smithi012.stdout:3817: expect (ObjNum 1063 snap 342 seq_num 1063) 2024-09-10T18:10:12.845 INFO:tasks.rados.rados.0.smithi012.stdout:3810: done (6 left) 2024-09-10T18:10:12.845 INFO:tasks.rados.rados.0.smithi012.stdout:3812: done (5 left) 2024-09-10T18:10:12.845 INFO:tasks.rados.rados.0.smithi012.stdout:3813: done (4 left) 2024-09-10T18:10:12.845 INFO:tasks.rados.rados.0.smithi012.stdout:3814: done (3 left) 2024-09-10T18:10:12.845 INFO:tasks.rados.rados.0.smithi012.stdout:3815: done (2 left) 2024-09-10T18:10:12.846 INFO:tasks.rados.rados.0.smithi012.stdout:3817: done (1 left) 2024-09-10T18:10:12.846 INFO:tasks.rados.rados.0.smithi012.stdout:3818: done (0 left) 2024-09-10T18:10:12.846 INFO:tasks.rados.rados.0.smithi012.stdout:3819: snap_remove snap 378 2024-09-10T18:10:13.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:13 smithi012 ceph-mon[89611]: osdmap e849: 8 total, 8 up, 8 in 2024-09-10T18:10:13.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:13 smithi012 ceph-mon[89611]: osdmap e850: 8 total, 8 up, 8 in 2024-09-10T18:10:13.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:13 smithi012 ceph-mon[92029]: osdmap e849: 8 total, 8 up, 8 in 2024-09-10T18:10:13.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:13 smithi012 ceph-mon[92029]: osdmap e850: 8 total, 8 up, 8 in 2024-09-10T18:10:13.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:13 smithi089 ceph-mon[84132]: osdmap e849: 8 total, 8 up, 8 in 2024-09-10T18:10:13.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:13 smithi089 ceph-mon[84132]: osdmap e850: 8 total, 8 up, 8 in 2024-09-10T18:10:13.849 INFO:tasks.rados.rados.0.smithi012.stdout:3819: done (0 left) 2024-09-10T18:10:13.849 INFO:tasks.rados.rados.0.smithi012.stdout:3820: delete oid 2 current snap is 379 2024-09-10T18:10:13.854 INFO:tasks.rados.rados.0.smithi012.stdout:3820: done (0 left) 2024-09-10T18:10:13.854 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 33 current snap is 379 2024-09-10T18:10:13.855 INFO:tasks.rados.rados.0.smithi012.stdout:3821: seq_num 1161 ranges {1835008=245760} 2024-09-10T18:10:13.866 INFO:tasks.rados.rados.0.smithi012.stdout:3821: writing smithi01278544-33 from 1835008 to 2080768 tid 1 2024-09-10T18:10:13.866 INFO:tasks.rados.rados.0.smithi012.stdout:3822: read oid 39 snap -1 2024-09-10T18:10:13.866 INFO:tasks.rados.rados.0.smithi012.stdout:3822: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:10:13.866 INFO:tasks.rados.rados.0.smithi012.stdout:3823: rmattr oid 3 current snap is 379 2024-09-10T18:10:13.866 INFO:tasks.rados.rados.0.smithi012.stdout:3823: done (2 left) 2024-09-10T18:10:13.866 INFO:tasks.rados.rados.0.smithi012.stdout:3824: copy_from oid 46 from oid 49 current snap is 379 2024-09-10T18:10:13.867 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 50 current snap is 379 2024-09-10T18:10:13.867 INFO:tasks.rados.rados.0.smithi012.stdout:3825: seq_num 1162 ranges {1114112=270336} 2024-09-10T18:10:13.874 INFO:tasks.rados.rados.0.smithi012.stdout:3825: writing smithi01278544-50 from 1114112 to 1384448 tid 1 2024-09-10T18:10:13.874 INFO:tasks.rados.rados.0.smithi012.stdout:3826: snap_create 2024-09-10T18:10:13.874 INFO:tasks.rados.rados.0.smithi012.stdout:3822: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:10:13.878 INFO:tasks.rados.rados.0.smithi012.stdout:3821: finishing write tid 1 to smithi01278544-33 2024-09-10T18:10:13.878 INFO:tasks.rados.rados.0.smithi012.stdout:3821: finishing write tid 2 to smithi01278544-33 2024-09-10T18:10:13.878 INFO:tasks.rados.rados.0.smithi012.stdout:3821: finishing write tid 3 to smithi01278544-33 2024-09-10T18:10:13.878 INFO:tasks.rados.rados.0.smithi012.stdout:3821: oid 33 updating version 0 to 2598 2024-09-10T18:10:13.878 INFO:tasks.rados.rados.0.smithi012.stdout:3821: oid 33 version 2598 is already newer than 2597 2024-09-10T18:10:13.878 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 33 v 2598 (ObjNum 1161 snap 379 seq_num 1161) dirty exists 2024-09-10T18:10:13.878 INFO:tasks.rados.rados.0.smithi012.stdout:3821: left oid 33 (ObjNum 1161 snap 379 seq_num 1161) 2024-09-10T18:10:13.878 INFO:tasks.rados.rados.0.smithi012.stdout:3825: finishing write tid 1 to smithi01278544-50 2024-09-10T18:10:13.880 INFO:tasks.rados.rados.0.smithi012.stdout:3825: finishing write tid 2 to smithi01278544-50 2024-09-10T18:10:13.880 INFO:tasks.rados.rados.0.smithi012.stdout:3824: finishing copy_from racing read to smithi01278544-46 2024-09-10T18:10:13.881 INFO:tasks.rados.rados.0.smithi012.stdout:3825: finishing write tid 3 to smithi01278544-50 2024-09-10T18:10:13.882 INFO:tasks.rados.rados.0.smithi012.stdout:3825: oid 50 updating version 0 to 2437 2024-09-10T18:10:13.882 INFO:tasks.rados.rados.0.smithi012.stdout:3825: oid 50 updating version 2437 to 2438 2024-09-10T18:10:13.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 50 v 2438 (ObjNum 1162 snap 379 seq_num 1162) dirty exists 2024-09-10T18:10:13.882 INFO:tasks.rados.rados.0.smithi012.stdout:3825: left oid 50 (ObjNum 1162 snap 379 seq_num 1162) 2024-09-10T18:10:13.884 INFO:tasks.rados.rados.0.smithi012.stdout:3824: finishing copy_from to smithi01278544-46 2024-09-10T18:10:13.884 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 2347 (ObjNum 1109 snap 357 seq_num 1109) dirty exists 2024-09-10T18:10:14.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:10:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:10:14] "GET /metrics HTTP/1.1" 200 36359 "" "Prometheus/2.51.0" 2024-09-10T18:10:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3821: done (4 left) 2024-09-10T18:10:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3822: done (3 left) 2024-09-10T18:10:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3824: done (2 left) 2024-09-10T18:10:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3825: done (1 left) 2024-09-10T18:10:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3826: done (0 left) 2024-09-10T18:10:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3827: read oid 45 snap -1 2024-09-10T18:10:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3827: expect (ObjNum 1146 snap 376 seq_num 1146) 2024-09-10T18:10:14.853 INFO:tasks.rados.rados.0.smithi012.stdout:3828: delete oid 44 current snap is 380 2024-09-10T18:10:14.860 INFO:tasks.rados.rados.0.smithi012.stdout:3828: done (1 left) 2024-09-10T18:10:14.860 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 10 current snap is 380 2024-09-10T18:10:14.860 INFO:tasks.rados.rados.0.smithi012.stdout:3829: seq_num 1164 ranges {3760128=303104} 2024-09-10T18:10:14.884 INFO:tasks.rados.rados.0.smithi012.stdout:3829: writing smithi01278544-10 from 3760128 to 4063232 tid 1 2024-09-10T18:10:14.884 INFO:tasks.rados.rados.0.smithi012.stdout:3830: read oid 3 snap -1 2024-09-10T18:10:14.884 INFO:tasks.rados.rados.0.smithi012.stdout:3830: expect (ObjNum 1104 snap 354 seq_num 1104) 2024-09-10T18:10:14.884 INFO:tasks.rados.rados.0.smithi012.stdout:3831: read oid 27 snap -1 2024-09-10T18:10:14.884 INFO:tasks.rados.rados.0.smithi012.stdout:3831: expect (ObjNum 1151 snap 378 seq_num 1151) 2024-09-10T18:10:14.884 INFO:tasks.rados.rados.0.smithi012.stdout:3832: snap_remove snap 379 2024-09-10T18:10:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:14 smithi012 ceph-mon[89611]: pgmap v964: 121 pgs: 121 active+clean; 235 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 38 MiB/s rd, 968 KiB/s wr, 19 op/s 2024-09-10T18:10:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:14 smithi012 ceph-mon[89611]: osdmap e851: 8 total, 8 up, 8 in 2024-09-10T18:10:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:14 smithi012 ceph-mon[92029]: pgmap v964: 121 pgs: 121 active+clean; 235 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 38 MiB/s rd, 968 KiB/s wr, 19 op/s 2024-09-10T18:10:15.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:14 smithi012 ceph-mon[92029]: osdmap e851: 8 total, 8 up, 8 in 2024-09-10T18:10:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:14 smithi089 ceph-mon[84132]: pgmap v964: 121 pgs: 121 active+clean; 235 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 38 MiB/s rd, 968 KiB/s wr, 19 op/s 2024-09-10T18:10:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:14 smithi089 ceph-mon[84132]: osdmap e851: 8 total, 8 up, 8 in 2024-09-10T18:10:15.860 INFO:tasks.rados.rados.0.smithi012.stdout:3832: done (4 left) 2024-09-10T18:10:15.861 INFO:tasks.rados.rados.0.smithi012.stdout:3833: rollback oid 22 current snap is 380 2024-09-10T18:10:15.861 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 22 to 371 2024-09-10T18:10:15.861 INFO:tasks.rados.rados.0.smithi012.stdout:3827: expect (ObjNum 1146 snap 376 seq_num 1146) 2024-09-10T18:10:15.993 INFO:tasks.rados.rados.0.smithi012.stdout:3829: finishing write tid 1 to smithi01278544-10 2024-09-10T18:10:15.993 INFO:tasks.rados.rados.0.smithi012.stdout:3829: finishing write tid 2 to smithi01278544-10 2024-09-10T18:10:15.993 INFO:tasks.rados.rados.0.smithi012.stdout:3829: finishing write tid 3 to smithi01278544-10 2024-09-10T18:10:15.993 INFO:tasks.rados.rados.0.smithi012.stdout:3829: oid 10 updating version 0 to 2905 2024-09-10T18:10:15.993 INFO:tasks.rados.rados.0.smithi012.stdout:3829: oid 10 updating version 2905 to 2906 2024-09-10T18:10:15.993 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2906 (ObjNum 1164 snap 380 seq_num 1164) dirty exists 2024-09-10T18:10:15.993 INFO:tasks.rados.rados.0.smithi012.stdout:3829: left oid 10 (ObjNum 1164 snap 380 seq_num 1164) 2024-09-10T18:10:15.993 INFO:tasks.rados.rados.0.smithi012.stdout:3830: expect (ObjNum 1104 snap 354 seq_num 1104) 2024-09-10T18:10:16.037 INFO:tasks.rados.rados.0.smithi012.stdout:3831: expect (ObjNum 1151 snap 378 seq_num 1151) 2024-09-10T18:10:16.188 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:15 smithi089 ceph-mon[84132]: osdmap e852: 8 total, 8 up, 8 in 2024-09-10T18:10:16.188 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:15 smithi089 ceph-mon[84132]: pgmap v967: 121 pgs: 121 active+clean; 235 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 28 MiB/s rd, 651 KiB/s wr, 16 op/s 2024-09-10T18:10:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:15 smithi012 ceph-mon[89611]: osdmap e852: 8 total, 8 up, 8 in 2024-09-10T18:10:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:15 smithi012 ceph-mon[89611]: pgmap v967: 121 pgs: 121 active+clean; 235 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 28 MiB/s rd, 651 KiB/s wr, 16 op/s 2024-09-10T18:10:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:15 smithi012 ceph-mon[92029]: osdmap e852: 8 total, 8 up, 8 in 2024-09-10T18:10:16.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:15 smithi012 ceph-mon[92029]: pgmap v967: 121 pgs: 121 active+clean; 235 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 28 MiB/s rd, 651 KiB/s wr, 16 op/s 2024-09-10T18:10:16.424 INFO:tasks.rados.rados.0.smithi012.stdout:3833: finishing rollback tid 0 to smithi01278544-22 2024-09-10T18:10:16.424 INFO:tasks.rados.rados.0.smithi012.stdout:3833: finishing rollback tid 1 to smithi01278544-22 2024-09-10T18:10:16.424 INFO:tasks.rados.rados.0.smithi012.stdout:3833: finishing rollback tid 2 to smithi01278544-22 2024-09-10T18:10:16.424 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2910 (ObjNum 1128 snap 368 seq_num 1128) dirty exists 2024-09-10T18:10:16.424 INFO:tasks.rados.rados.0.smithi012.stdout:3827: done (4 left) 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:3829: done (3 left) 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:3830: done (2 left) 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:3831: done (1 left) 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:3833: done (0 left) 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:3834: rollback oid 48 current snap is 380 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 48 to 368 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 32 current snap is 380 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:3835: seq_num 1165 ranges {0=319488} 2024-09-10T18:10:16.425 INFO:tasks.rados.rados.0.smithi012.stdout:3835: writing smithi01278544-32 from 0 to 319488 tid 1 2024-09-10T18:10:16.426 INFO:tasks.rados.rados.0.smithi012.stdout:3836: snap_create 2024-09-10T18:10:16.427 INFO:tasks.rados.rados.0.smithi012.stdout:3834: finishing rollback tid 0 to smithi01278544-48 2024-09-10T18:10:16.428 INFO:tasks.rados.rados.0.smithi012.stdout:3834: finishing rollback tid 1 to smithi01278544-48 2024-09-10T18:10:16.428 INFO:tasks.rados.rados.0.smithi012.stdout:3834: finishing rollback tid 2 to smithi01278544-48 2024-09-10T18:10:16.428 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 2327 (ObjNum 1127 snap 367 seq_num 1127) dirty exists 2024-09-10T18:10:16.429 INFO:tasks.rados.rados.0.smithi012.stdout:3835: finishing write tid 1 to smithi01278544-32 2024-09-10T18:10:16.429 INFO:tasks.rados.rados.0.smithi012.stdout:3835: finishing write tid 2 to smithi01278544-32 2024-09-10T18:10:16.431 INFO:tasks.rados.rados.0.smithi012.stdout:3835: finishing write tid 3 to smithi01278544-32 2024-09-10T18:10:16.431 INFO:tasks.rados.rados.0.smithi012.stdout:3835: oid 32 updating version 0 to 2783 2024-09-10T18:10:16.431 INFO:tasks.rados.rados.0.smithi012.stdout:3835: oid 32 updating version 2783 to 2784 2024-09-10T18:10:16.431 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2784 (ObjNum 1165 snap 380 seq_num 1165) dirty exists 2024-09-10T18:10:16.431 INFO:tasks.rados.rados.0.smithi012.stdout:3835: left oid 32 (ObjNum 1165 snap 380 seq_num 1165) 2024-09-10T18:10:16.863 INFO:tasks.rados.rados.0.smithi012.stdout:3834: done (2 left) 2024-09-10T18:10:16.864 INFO:tasks.rados.rados.0.smithi012.stdout:3835: done (1 left) 2024-09-10T18:10:16.864 INFO:tasks.rados.rados.0.smithi012.stdout:3836: done (0 left) 2024-09-10T18:10:16.864 INFO:tasks.rados.rados.0.smithi012.stdout:3837: snap_create 2024-09-10T18:10:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:16 smithi012 ceph-mon[89611]: osdmap e853: 8 total, 8 up, 8 in 2024-09-10T18:10:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:16 smithi012 ceph-mon[92029]: osdmap e853: 8 total, 8 up, 8 in 2024-09-10T18:10:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:16 smithi089 ceph-mon[84132]: osdmap e853: 8 total, 8 up, 8 in 2024-09-10T18:10:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:3837: done (0 left) 2024-09-10T18:10:17.843 INFO:tasks.rados.rados.0.smithi012.stdout:3838: snap_remove snap 368 2024-09-10T18:10:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:17 smithi012 ceph-mon[89611]: osdmap e854: 8 total, 8 up, 8 in 2024-09-10T18:10:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:17 smithi012 ceph-mon[89611]: pgmap v970: 121 pgs: 121 active+clean; 234 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2024-09-10T18:10:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:17 smithi012 ceph-mon[89611]: osdmap e855: 8 total, 8 up, 8 in 2024-09-10T18:10:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:17 smithi012 ceph-mon[92029]: osdmap e854: 8 total, 8 up, 8 in 2024-09-10T18:10:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:17 smithi012 ceph-mon[92029]: pgmap v970: 121 pgs: 121 active+clean; 234 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2024-09-10T18:10:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:17 smithi012 ceph-mon[92029]: osdmap e855: 8 total, 8 up, 8 in 2024-09-10T18:10:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:17 smithi089 ceph-mon[84132]: osdmap e854: 8 total, 8 up, 8 in 2024-09-10T18:10:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:17 smithi089 ceph-mon[84132]: pgmap v970: 121 pgs: 121 active+clean; 234 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2024-09-10T18:10:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:17 smithi089 ceph-mon[84132]: osdmap e855: 8 total, 8 up, 8 in 2024-09-10T18:10:18.846 INFO:tasks.rados.rados.0.smithi012.stdout:3838: done (0 left) 2024-09-10T18:10:18.846 INFO:tasks.rados.rados.0.smithi012.stdout:3839: read oid 44 snap -1 2024-09-10T18:10:18.846 INFO:tasks.rados.rados.0.smithi012.stdout:3839: expect deleted 2024-09-10T18:10:18.846 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 5 current snap is 382 2024-09-10T18:10:18.846 INFO:tasks.rados.rados.0.smithi012.stdout:3840: seq_num 1166 ranges {1581056=335872} 2024-09-10T18:10:18.860 INFO:tasks.rados.rados.0.smithi012.stdout:3840: writing smithi01278544-5 from 1581056 to 1916928 tid 1 2024-09-10T18:10:18.860 INFO:tasks.rados.rados.0.smithi012.stdout:3841: snap_remove snap 381 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3841: done (2 left) 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3842: read oid 27 snap 371 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3842: expect (ObjNum 1124 snap 365 seq_num 1124) 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3843: read oid 47 snap 371 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3843: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3844: read oid 2 snap -1 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3844: expect deleted 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3845: read oid 22 snap 371 2024-09-10T18:10:19.853 INFO:tasks.rados.rados.0.smithi012.stdout:3845: expect (ObjNum 1128 snap 368 seq_num 1128) 2024-09-10T18:10:19.854 INFO:tasks.rados.rados.0.smithi012.stdout:3846: delete oid 36 current snap is 382 2024-09-10T18:10:19.854 INFO:tasks.rados.rados.0.smithi012.stdout:3840: finishing write tid 1 to smithi01278544-5 2024-09-10T18:10:19.854 INFO:tasks.rados.rados.0.smithi012.stdout:3840: finishing write tid 2 to smithi01278544-5 2024-09-10T18:10:19.854 INFO:tasks.rados.rados.0.smithi012.stdout:3840: finishing write tid 3 to smithi01278544-5 2024-09-10T18:10:19.854 INFO:tasks.rados.rados.0.smithi012.stdout:3840: oid 5 updating version 0 to 2751 2024-09-10T18:10:19.854 INFO:tasks.rados.rados.0.smithi012.stdout:3840: oid 5 updating version 2751 to 2752 2024-09-10T18:10:19.854 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 2752 (ObjNum 1166 snap 382 seq_num 1166) dirty exists 2024-09-10T18:10:19.854 INFO:tasks.rados.rados.0.smithi012.stdout:3840: left oid 5 (ObjNum 1166 snap 382 seq_num 1166) 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3839: done (6 left) 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3840: done (5 left) 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3844: done (4 left) 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3846: done (3 left) 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3847: read oid 11 snap -1 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3847: expect (ObjNum 1134 snap 372 seq_num 1134) 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3848: read oid 40 snap -1 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3848: expect (ObjNum 1103 snap 354 seq_num 1103) 2024-09-10T18:10:19.859 INFO:tasks.rados.rados.0.smithi012.stdout:3849: snap_remove snap 380 2024-09-10T18:10:20.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:19 smithi012 ceph-mon[89611]: osdmap e856: 8 total, 8 up, 8 in 2024-09-10T18:10:20.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:19 smithi012 ceph-mon[92029]: osdmap e856: 8 total, 8 up, 8 in 2024-09-10T18:10:20.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:19 smithi089 ceph-mon[84132]: osdmap e856: 8 total, 8 up, 8 in 2024-09-10T18:10:20.858 INFO:tasks.rados.rados.0.smithi012.stdout:3849: done (5 left) 2024-09-10T18:10:20.859 INFO:tasks.rados.rados.0.smithi012.stdout:3850: snap_create 2024-09-10T18:10:20.859 INFO:tasks.rados.rados.0.smithi012.stdout:3843: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:10:20.865 INFO:tasks.rados.rados.0.smithi012.stdout:3848: expect (ObjNum 1103 snap 354 seq_num 1103) 2024-09-10T18:10:21.261 INFO:tasks.rados.rados.0.smithi012.stdout:3845: expect (ObjNum 1128 snap 368 seq_num 1128) 2024-09-10T18:10:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:20 smithi012 ceph-mon[89611]: pgmap v973: 121 pgs: 121 active+clean; 227 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 17 op/s 2024-09-10T18:10:21.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:20 smithi012 ceph-mon[89611]: osdmap e857: 8 total, 8 up, 8 in 2024-09-10T18:10:21.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:20 smithi012 ceph-mon[92029]: pgmap v973: 121 pgs: 121 active+clean; 227 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 17 op/s 2024-09-10T18:10:21.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:20 smithi012 ceph-mon[92029]: osdmap e857: 8 total, 8 up, 8 in 2024-09-10T18:10:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:20 smithi089 ceph-mon[84132]: pgmap v973: 121 pgs: 121 active+clean; 227 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 17 op/s 2024-09-10T18:10:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:20 smithi089 ceph-mon[84132]: osdmap e857: 8 total, 8 up, 8 in 2024-09-10T18:10:21.406 INFO:tasks.rados.rados.0.smithi012.stdout:3847: expect (ObjNum 1134 snap 372 seq_num 1134) 2024-09-10T18:10:21.464 INFO:tasks.rados.rados.0.smithi012.stdout:3842: expect (ObjNum 1124 snap 365 seq_num 1124) 2024-09-10T18:10:21.860 INFO:tasks.rados.rados.0.smithi012.stdout:3842: done (5 left) 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:3843: done (4 left) 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:3845: done (3 left) 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:3847: done (2 left) 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:3848: done (1 left) 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:3850: done (0 left) 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:3851: rollback oid 22 current snap is 383 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 22 to 371 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 24 current snap is 383 2024-09-10T18:10:21.861 INFO:tasks.rados.rados.0.smithi012.stdout:3852: seq_num 1168 ranges {1835008=368640} 2024-09-10T18:10:21.872 INFO:tasks.rados.rados.0.smithi012.stdout:3852: writing smithi01278544-24 from 1835008 to 2203648 tid 1 2024-09-10T18:10:21.872 INFO:tasks.rados.rados.0.smithi012.stdout:3853: copy_from oid 32 from oid 3 current snap is 383 2024-09-10T18:10:21.873 INFO:tasks.rados.rados.0.smithi012.stdout:3854: snap_create 2024-09-10T18:10:21.874 INFO:tasks.rados.rados.0.smithi012.stdout:3851: finishing rollback tid 0 to smithi01278544-22 2024-09-10T18:10:21.875 INFO:tasks.rados.rados.0.smithi012.stdout:3851: finishing rollback tid 1 to smithi01278544-22 2024-09-10T18:10:21.875 INFO:tasks.rados.rados.0.smithi012.stdout:3851: finishing rollback tid 2 to smithi01278544-22 2024-09-10T18:10:21.875 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 22 v 2924 (ObjNum 1128 snap 368 seq_num 1128) dirty exists 2024-09-10T18:10:21.878 INFO:tasks.rados.rados.0.smithi012.stdout:3852: finishing write tid 1 to smithi01278544-24 2024-09-10T18:10:21.879 INFO:tasks.rados.rados.0.smithi012.stdout:3852: finishing write tid 2 to smithi01278544-24 2024-09-10T18:10:21.881 INFO:tasks.rados.rados.0.smithi012.stdout:3852: finishing write tid 3 to smithi01278544-24 2024-09-10T18:10:21.882 INFO:tasks.rados.rados.0.smithi012.stdout:3852: oid 24 updating version 0 to 2489 2024-09-10T18:10:21.882 INFO:tasks.rados.rados.0.smithi012.stdout:3852: oid 24 updating version 2489 to 2490 2024-09-10T18:10:21.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 24 v 2490 (ObjNum 1168 snap 383 seq_num 1168) dirty exists 2024-09-10T18:10:21.882 INFO:tasks.rados.rados.0.smithi012.stdout:3852: left oid 24 (ObjNum 1168 snap 383 seq_num 1168) 2024-09-10T18:10:21.888 INFO:tasks.rados.rados.0.smithi012.stdout:3853: finishing copy_from racing read to smithi01278544-32 2024-09-10T18:10:21.888 INFO:tasks.rados.rados.0.smithi012.stdout:3853: finishing copy_from to smithi01278544-32 2024-09-10T18:10:21.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 32 v 2517 (ObjNum 1104 snap 354 seq_num 1104) dirty exists 2024-09-10T18:10:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:21 smithi012 ceph-mon[89611]: osdmap e858: 8 total, 8 up, 8 in 2024-09-10T18:10:22.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:21 smithi012 ceph-mon[89611]: pgmap v976: 121 pgs: 121 active+clean; 227 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 160 KiB/s wr, 3 op/s 2024-09-10T18:10:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:21 smithi012 ceph-mon[92029]: osdmap e858: 8 total, 8 up, 8 in 2024-09-10T18:10:22.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:21 smithi012 ceph-mon[92029]: pgmap v976: 121 pgs: 121 active+clean; 227 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 160 KiB/s wr, 3 op/s 2024-09-10T18:10:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:21 smithi089 ceph-mon[84132]: osdmap e858: 8 total, 8 up, 8 in 2024-09-10T18:10:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:21 smithi089 ceph-mon[84132]: pgmap v976: 121 pgs: 121 active+clean; 227 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 160 KiB/s wr, 3 op/s 2024-09-10T18:10:22.847 INFO:tasks.rados.rados.0.smithi012.stdout:3851: done (3 left) 2024-09-10T18:10:22.848 INFO:tasks.rados.rados.0.smithi012.stdout:3852: done (2 left) 2024-09-10T18:10:22.848 INFO:tasks.rados.rados.0.smithi012.stdout:3853: done (1 left) 2024-09-10T18:10:22.848 INFO:tasks.rados.rados.0.smithi012.stdout:3854: done (0 left) 2024-09-10T18:10:22.848 INFO:tasks.rados.rados.0.smithi012.stdout:3855: rmattr oid 38 current snap is 384 2024-09-10T18:10:22.848 INFO:tasks.rados.rados.0.smithi012.stdout:3855: done (0 left) 2024-09-10T18:10:22.848 INFO:tasks.rados.rados.0.smithi012.stdout:3856: snap_remove snap 383 2024-09-10T18:10:23.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:22 smithi012 ceph-mon[89611]: osdmap e859: 8 total, 8 up, 8 in 2024-09-10T18:10:23.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:22 smithi012 ceph-mon[89611]: osdmap e860: 8 total, 8 up, 8 in 2024-09-10T18:10:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:22 smithi012 ceph-mon[92029]: osdmap e859: 8 total, 8 up, 8 in 2024-09-10T18:10:23.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:22 smithi012 ceph-mon[92029]: osdmap e860: 8 total, 8 up, 8 in 2024-09-10T18:10:23.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:22 smithi089 ceph-mon[84132]: osdmap e859: 8 total, 8 up, 8 in 2024-09-10T18:10:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:22 smithi089 ceph-mon[84132]: osdmap e860: 8 total, 8 up, 8 in 2024-09-10T18:10:23.847 INFO:tasks.rados.rados.0.smithi012.stdout:3856: done (0 left) 2024-09-10T18:10:23.847 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 11 current snap is 384 2024-09-10T18:10:23.847 INFO:tasks.rados.rados.0.smithi012.stdout:3857: seq_num 1169 ranges {2203648=385024} 2024-09-10T18:10:23.861 INFO:tasks.rados.rados.0.smithi012.stdout:3857: writing smithi01278544-11 from 2203648 to 2588672 tid 1 2024-09-10T18:10:23.861 INFO:tasks.rados.rados.0.smithi012.stdout:3858: read oid 38 snap 371 2024-09-10T18:10:23.861 INFO:tasks.rados.rados.0.smithi012.stdout:3858: expect deleted 2024-09-10T18:10:23.861 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 31 current snap is 384 2024-09-10T18:10:23.861 INFO:tasks.rados.rados.0.smithi012.stdout:3859: seq_num 1170 ranges {2392064=401408} 2024-09-10T18:10:23.876 INFO:tasks.rados.rados.0.smithi012.stdout:3859: writing smithi01278544-31 from 2392064 to 2793472 tid 1 2024-09-10T18:10:23.876 INFO:tasks.rados.rados.0.smithi012.stdout:3860: snap_remove snap 382 2024-09-10T18:10:24.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:10:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:10:24] "GET /metrics HTTP/1.1" 200 36355 "" "Prometheus/2.51.0" 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3860: done (3 left) 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3861: delete oid 46 current snap is 384 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3857: finishing write tid 1 to smithi01278544-11 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3857: finishing write tid 2 to smithi01278544-11 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3857: finishing write tid 3 to smithi01278544-11 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3857: oid 11 updating version 0 to 2927 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3857: oid 11 version 2927 is already newer than 2926 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2927 (ObjNum 1169 snap 384 seq_num 1169) dirty exists 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3857: left oid 11 (ObjNum 1169 snap 384 seq_num 1169) 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3859: finishing write tid 1 to smithi01278544-31 2024-09-10T18:10:24.866 INFO:tasks.rados.rados.0.smithi012.stdout:3859: finishing write tid 2 to smithi01278544-31 2024-09-10T18:10:24.867 INFO:tasks.rados.rados.0.smithi012.stdout:3859: finishing write tid 3 to smithi01278544-31 2024-09-10T18:10:24.867 INFO:tasks.rados.rados.0.smithi012.stdout:3859: oid 31 updating version 0 to 2518 2024-09-10T18:10:24.867 INFO:tasks.rados.rados.0.smithi012.stdout:3859: oid 31 updating version 2518 to 2519 2024-09-10T18:10:24.867 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2519 (ObjNum 1170 snap 384 seq_num 1170) dirty exists 2024-09-10T18:10:24.867 INFO:tasks.rados.rados.0.smithi012.stdout:3859: left oid 31 (ObjNum 1170 snap 384 seq_num 1170) 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3857: done (3 left) 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3858: done (2 left) 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3859: done (1 left) 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3861: done (0 left) 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3862: read oid 6 snap -1 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3862: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3863: read oid 43 snap -1 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3863: expect (ObjNum 1025 snap 328 seq_num 1025) 2024-09-10T18:10:24.875 INFO:tasks.rados.rados.0.smithi012.stdout:3864: snap_create 2024-09-10T18:10:24.887 INFO:tasks.rados.rados.0.smithi012.stdout:3862: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:24.969 INFO:tasks.rados.rados.0.smithi012.stdout:3863: expect (ObjNum 1025 snap 328 seq_num 1025) 2024-09-10T18:10:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:24 smithi012 ceph-mon[89611]: pgmap v979: 121 pgs: 121 active+clean; 226 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 588 KiB/s wr, 7 op/s 2024-09-10T18:10:25.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:24 smithi012 ceph-mon[89611]: osdmap e861: 8 total, 8 up, 8 in 2024-09-10T18:10:25.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:24 smithi012 ceph-mon[92029]: pgmap v979: 121 pgs: 121 active+clean; 226 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 588 KiB/s wr, 7 op/s 2024-09-10T18:10:25.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:24 smithi012 ceph-mon[92029]: osdmap e861: 8 total, 8 up, 8 in 2024-09-10T18:10:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:24 smithi089 ceph-mon[84132]: pgmap v979: 121 pgs: 121 active+clean; 226 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 588 KiB/s wr, 7 op/s 2024-09-10T18:10:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:24 smithi089 ceph-mon[84132]: osdmap e861: 8 total, 8 up, 8 in 2024-09-10T18:10:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:25 smithi012 ceph-mon[89611]: osdmap e862: 8 total, 8 up, 8 in 2024-09-10T18:10:26.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:25 smithi012 ceph-mon[89611]: pgmap v982: 121 pgs: 121 active+clean; 226 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 9.2 MiB/s rd, 506 KiB/s wr, 4 op/s 2024-09-10T18:10:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:25 smithi012 ceph-mon[92029]: osdmap e862: 8 total, 8 up, 8 in 2024-09-10T18:10:26.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:25 smithi012 ceph-mon[92029]: pgmap v982: 121 pgs: 121 active+clean; 226 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 9.2 MiB/s rd, 506 KiB/s wr, 4 op/s 2024-09-10T18:10:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:25 smithi089 ceph-mon[84132]: osdmap e862: 8 total, 8 up, 8 in 2024-09-10T18:10:26.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:25 smithi089 ceph-mon[84132]: pgmap v982: 121 pgs: 121 active+clean; 226 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 9.2 MiB/s rd, 506 KiB/s wr, 4 op/s 2024-09-10T18:10:26.811 INFO:tasks.rados.rados.0.smithi012.stdout:3862: done (2 left) 2024-09-10T18:10:26.811 INFO:tasks.rados.rados.0.smithi012.stdout:3863: done (1 left) 2024-09-10T18:10:26.811 INFO:tasks.rados.rados.0.smithi012.stdout:3864: done (0 left) 2024-09-10T18:10:26.811 INFO:tasks.rados.rados.0.smithi012.stdout:3865: read oid 13 snap -1 2024-09-10T18:10:26.811 INFO:tasks.rados.rados.0.smithi012.stdout:3865: expect (ObjNum 1031 snap 331 seq_num 1031) 2024-09-10T18:10:26.812 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 46 current snap is 385 2024-09-10T18:10:26.812 INFO:tasks.rados.rados.0.smithi012.stdout:3866: seq_num 1172 ranges {0=434176} 2024-09-10T18:10:26.813 INFO:tasks.rados.rados.0.smithi012.stdout:3866: writing smithi01278544-46 from 0 to 434176 tid 1 2024-09-10T18:10:26.813 INFO:tasks.rados.rados.0.smithi012.stdout:3867: snap_create 2024-09-10T18:10:26.818 INFO:tasks.rados.rados.0.smithi012.stdout:3866: finishing write tid 1 to smithi01278544-46 2024-09-10T18:10:26.818 INFO:tasks.rados.rados.0.smithi012.stdout:3866: finishing write tid 2 to smithi01278544-46 2024-09-10T18:10:26.820 INFO:tasks.rados.rados.0.smithi012.stdout:3866: finishing write tid 3 to smithi01278544-46 2024-09-10T18:10:26.820 INFO:tasks.rados.rados.0.smithi012.stdout:3866: oid 46 updating version 0 to 2552 2024-09-10T18:10:26.820 INFO:tasks.rados.rados.0.smithi012.stdout:3866: oid 46 updating version 2552 to 2553 2024-09-10T18:10:26.820 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 2553 (ObjNum 1172 snap 385 seq_num 1172) dirty exists 2024-09-10T18:10:26.820 INFO:tasks.rados.rados.0.smithi012.stdout:3866: left oid 46 (ObjNum 1172 snap 385 seq_num 1172) 2024-09-10T18:10:26.831 INFO:tasks.rados.rados.0.smithi012.stdout:3865: expect (ObjNum 1031 snap 331 seq_num 1031) 2024-09-10T18:10:27.187 INFO:tasks.rados.rados.0.smithi012.stdout:3865: done (2 left) 2024-09-10T18:10:27.187 INFO:tasks.rados.rados.0.smithi012.stdout:3866: done (1 left) 2024-09-10T18:10:27.187 INFO:tasks.rados.rados.0.smithi012.stdout:3867: done (0 left) 2024-09-10T18:10:27.188 INFO:tasks.rados.rados.0.smithi012.stdout:3868: read oid 2 snap -1 2024-09-10T18:10:27.188 INFO:tasks.rados.rados.0.smithi012.stdout:3868: expect deleted 2024-09-10T18:10:27.188 INFO:tasks.rados.rados.0.smithi012.stdout:3869: rmattr oid 12 current snap is 386 2024-09-10T18:10:27.188 INFO:tasks.rados.rados.0.smithi012.stdout:3869: done (1 left) 2024-09-10T18:10:27.188 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 29 current snap is 386 2024-09-10T18:10:27.188 INFO:tasks.rados.rados.0.smithi012.stdout:3870: seq_num 1173 ranges {7659520=450560} 2024-09-10T18:10:27.231 INFO:tasks.rados.rados.0.smithi012.stdout:3870: writing smithi01278544-29 from 7659520 to 8110080 tid 1 2024-09-10T18:10:27.231 INFO:tasks.rados.rados.0.smithi012.stdout:3871: rmattr oid 38 current snap is 386 2024-09-10T18:10:27.231 INFO:tasks.rados.rados.0.smithi012.stdout:3871: done (2 left) 2024-09-10T18:10:27.231 INFO:tasks.rados.rados.0.smithi012.stdout:3872: snap_remove snap 384 2024-09-10T18:10:27.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:26 smithi012 ceph-mon[89611]: osdmap e863: 8 total, 8 up, 8 in 2024-09-10T18:10:27.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:26 smithi012 ceph-mon[92029]: osdmap e863: 8 total, 8 up, 8 in 2024-09-10T18:10:27.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:26 smithi089 ceph-mon[84132]: osdmap e863: 8 total, 8 up, 8 in 2024-09-10T18:10:27.847 INFO:tasks.rados.rados.0.smithi012.stdout:3868: done (2 left) 2024-09-10T18:10:27.847 INFO:tasks.rados.rados.0.smithi012.stdout:3872: done (1 left) 2024-09-10T18:10:27.847 INFO:tasks.rados.rados.0.smithi012.stdout:3873: rollback oid 11 current snap is 386 2024-09-10T18:10:27.847 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 11 to 385 2024-09-10T18:10:27.847 INFO:tasks.rados.rados.0.smithi012.stdout:3870: finishing write tid 1 to smithi01278544-29 2024-09-10T18:10:27.847 INFO:tasks.rados.rados.0.smithi012.stdout:3870: finishing write tid 2 to smithi01278544-29 2024-09-10T18:10:27.847 INFO:tasks.rados.rados.0.smithi012.stdout:3870: finishing write tid 3 to smithi01278544-29 2024-09-10T18:10:27.847 INFO:tasks.rados.rados.0.smithi012.stdout:3870: oid 29 updating version 0 to 1145 2024-09-10T18:10:27.848 INFO:tasks.rados.rados.0.smithi012.stdout:3870: oid 29 version 1145 is already newer than 1144 2024-09-10T18:10:27.848 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1145 (ObjNum 1173 snap 386 seq_num 1173) dirty exists 2024-09-10T18:10:27.848 INFO:tasks.rados.rados.0.smithi012.stdout:3870: left oid 29 (ObjNum 1173 snap 386 seq_num 1173) 2024-09-10T18:10:27.848 INFO:tasks.rados.rados.0.smithi012.stdout:3870: done (1 left) 2024-09-10T18:10:27.848 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 386 2024-09-10T18:10:27.848 INFO:tasks.rados.rados.0.smithi012.stdout:3874: seq_num 1174 ranges {6176768=466944} 2024-09-10T18:10:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3874: writing smithi01278544-13 from 6176768 to 6643712 tid 1 2024-09-10T18:10:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3875: snap_create 2024-09-10T18:10:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3873: finishing rollback tid 0 to smithi01278544-11 2024-09-10T18:10:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3873: finishing rollback tid 1 to smithi01278544-11 2024-09-10T18:10:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:3873: finishing rollback tid 2 to smithi01278544-11 2024-09-10T18:10:27.882 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2935 (ObjNum 1169 snap 384 seq_num 1169) dirty exists 2024-09-10T18:10:27.887 INFO:tasks.rados.rados.0.smithi012.stdout:3874: finishing write tid 1 to smithi01278544-13 2024-09-10T18:10:27.888 INFO:tasks.rados.rados.0.smithi012.stdout:3874: finishing write tid 2 to smithi01278544-13 2024-09-10T18:10:27.889 INFO:tasks.rados.rados.0.smithi012.stdout:3874: finishing write tid 3 to smithi01278544-13 2024-09-10T18:10:27.889 INFO:tasks.rados.rados.0.smithi012.stdout:3874: oid 13 updating version 0 to 2520 2024-09-10T18:10:27.889 INFO:tasks.rados.rados.0.smithi012.stdout:3874: oid 13 updating version 2520 to 2521 2024-09-10T18:10:27.890 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 2521 (ObjNum 1174 snap 386 seq_num 1174) dirty exists 2024-09-10T18:10:27.890 INFO:tasks.rados.rados.0.smithi012.stdout:3874: left oid 13 (ObjNum 1174 snap 386 seq_num 1174) 2024-09-10T18:10:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:27 smithi012 ceph-mon[89611]: osdmap e864: 8 total, 8 up, 8 in 2024-09-10T18:10:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:27 smithi012 ceph-mon[89611]: pgmap v985: 121 pgs: 121 active+clean; 224 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 298 KiB/s wr, 5 op/s 2024-09-10T18:10:28.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:27 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:10:28.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:27 smithi012 ceph-mon[89611]: osdmap e865: 8 total, 8 up, 8 in 2024-09-10T18:10:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:27 smithi012 ceph-mon[92029]: osdmap e864: 8 total, 8 up, 8 in 2024-09-10T18:10:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:27 smithi012 ceph-mon[92029]: pgmap v985: 121 pgs: 121 active+clean; 224 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 298 KiB/s wr, 5 op/s 2024-09-10T18:10:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:27 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:10:28.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:27 smithi012 ceph-mon[92029]: osdmap e865: 8 total, 8 up, 8 in 2024-09-10T18:10:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:27 smithi089 ceph-mon[84132]: osdmap e864: 8 total, 8 up, 8 in 2024-09-10T18:10:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:27 smithi089 ceph-mon[84132]: pgmap v985: 121 pgs: 121 active+clean; 224 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 298 KiB/s wr, 5 op/s 2024-09-10T18:10:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:27 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:10:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:27 smithi089 ceph-mon[84132]: osdmap e865: 8 total, 8 up, 8 in 2024-09-10T18:10:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3873: done (2 left) 2024-09-10T18:10:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3874: done (1 left) 2024-09-10T18:10:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3875: done (0 left) 2024-09-10T18:10:28.890 INFO:tasks.rados.rados.0.smithi012.stdout:3876: delete oid 18 current snap is 387 2024-09-10T18:10:28.898 INFO:tasks.rados.rados.0.smithi012.stdout:3876: done (0 left) 2024-09-10T18:10:28.898 INFO:tasks.rados.rados.0.smithi012.stdout:3877: read oid 15 snap 385 2024-09-10T18:10:28.898 INFO:tasks.rados.rados.0.smithi012.stdout:3877: expect deleted 2024-09-10T18:10:28.898 INFO:tasks.rados.rados.0.smithi012.stdout:3878: snap_create 2024-09-10T18:10:29.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:10:29.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:10:29.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:10:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:10:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:10:29.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:10:29.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:28 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:10:29.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:28 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:10:29.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:28 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:10:29.895 INFO:tasks.rados.rados.0.smithi012.stdout:3877: done (1 left) 2024-09-10T18:10:29.896 INFO:tasks.rados.rados.0.smithi012.stdout:3878: done (0 left) 2024-09-10T18:10:29.896 INFO:tasks.rados.rados.0.smithi012.stdout:3879: snap_remove snap 387 2024-09-10T18:10:30.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:29 smithi012 ceph-mon[89611]: osdmap e866: 8 total, 8 up, 8 in 2024-09-10T18:10:30.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:29 smithi012 ceph-mon[89611]: pgmap v988: 121 pgs: 121 active+clean; 223 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 298 KiB/s wr, 5 op/s 2024-09-10T18:10:30.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:29 smithi012 ceph-mon[92029]: osdmap e866: 8 total, 8 up, 8 in 2024-09-10T18:10:30.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:29 smithi012 ceph-mon[92029]: pgmap v988: 121 pgs: 121 active+clean; 223 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 298 KiB/s wr, 5 op/s 2024-09-10T18:10:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:29 smithi089 ceph-mon[84132]: osdmap e866: 8 total, 8 up, 8 in 2024-09-10T18:10:30.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:29 smithi089 ceph-mon[84132]: pgmap v988: 121 pgs: 121 active+clean; 223 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 298 KiB/s wr, 5 op/s 2024-09-10T18:10:30.897 INFO:tasks.rados.rados.0.smithi012.stdout:3879: done (0 left) 2024-09-10T18:10:30.897 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 388 2024-09-10T18:10:30.897 INFO:tasks.rados.rados.0.smithi012.stdout:3880: seq_num 1176 ranges {14540800=499712} 2024-09-10T18:10:30.978 INFO:tasks.rados.rados.0.smithi012.stdout:3880: writing smithi01278544-43 from 14540800 to 15040512 tid 1 2024-09-10T18:10:30.979 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 388 2024-09-10T18:10:30.979 INFO:tasks.rados.rados.0.smithi012.stdout:3881: seq_num 1177 ranges {0=516096} 2024-09-10T18:10:30.983 INFO:tasks.rados.rados.0.smithi012.stdout:3881: writing smithi01278544-18 from 0 to 516096 tid 1 2024-09-10T18:10:30.983 INFO:tasks.rados.rados.0.smithi012.stdout:3882: rollback oid 30 current snap is 388 2024-09-10T18:10:30.983 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 30 to 386 2024-09-10T18:10:30.983 INFO:tasks.rados.rados.0.smithi012.stdout:3883: rmattr oid 21 current snap is 388 2024-09-10T18:10:30.983 INFO:tasks.rados.rados.0.smithi012.stdout:3884: read oid 45 snap -1 2024-09-10T18:10:30.983 INFO:tasks.rados.rados.0.smithi012.stdout:3884: expect (ObjNum 1146 snap 376 seq_num 1146) 2024-09-10T18:10:30.983 INFO:tasks.rados.rados.0.smithi012.stdout:3885: rollback oid 26 current snap is 388 2024-09-10T18:10:30.984 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 26 to 371 2024-09-10T18:10:30.984 INFO:tasks.rados.rados.0.smithi012.stdout:3886: read oid 7 snap -1 2024-09-10T18:10:30.984 INFO:tasks.rados.rados.0.smithi012.stdout:3886: expect (ObjNum 1138 snap 375 seq_num 1138) 2024-09-10T18:10:30.984 INFO:tasks.rados.rados.0.smithi012.stdout:3887: read oid 6 snap -1 2024-09-10T18:10:30.984 INFO:tasks.rados.rados.0.smithi012.stdout:3887: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:30.984 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 388 2024-09-10T18:10:30.984 INFO:tasks.rados.rados.0.smithi012.stdout:3888: seq_num 1178 ranges {2088960=532480} 2024-09-10T18:10:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:3888: writing smithi01278544-48 from 2088960 to 2621440 tid 1 2024-09-10T18:10:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:3889: snap_create 2024-09-10T18:10:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:3882: finishing rollback tid 1 to smithi01278544-30 2024-09-10T18:10:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2782 (ObjNum 33 snap 0 seq_num 3497303888) dirty dne 2024-09-10T18:10:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:3880: finishing write tid 1 to smithi01278544-43 2024-09-10T18:10:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:3880: finishing write tid 2 to smithi01278544-43 2024-09-10T18:10:30.999 INFO:tasks.rados.rados.0.smithi012.stdout:3887: expect (ObjNum 950 snap 302 seq_num 950) 2024-09-10T18:10:31.078 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 21 v 2361 (ObjNum 1143 snap 376 seq_num 1143) dirty exists 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3881: finishing write tid 1 to smithi01278544-18 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3881: finishing write tid 2 to smithi01278544-18 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3885: finishing rollback tid 0 to smithi01278544-26 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3885: finishing rollback tid 1 to smithi01278544-26 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3885: finishing rollback tid 2 to smithi01278544-26 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2493 (ObjNum 1126 snap 366 seq_num 1126) dirty exists 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3881: finishing write tid 3 to smithi01278544-18 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3881: oid 18 updating version 0 to 2784 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3881: oid 18 version 2784 is already newer than 2783 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 2784 (ObjNum 1177 snap 388 seq_num 1177) dirty exists 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3881: left oid 18 (ObjNum 1177 snap 388 seq_num 1177) 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3888: finishing write tid 1 to smithi01278544-48 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3888: finishing write tid 2 to smithi01278544-48 2024-09-10T18:10:31.079 INFO:tasks.rados.rados.0.smithi012.stdout:3888: finishing write tid 3 to smithi01278544-48 2024-09-10T18:10:31.080 INFO:tasks.rados.rados.0.smithi012.stdout:3888: oid 48 updating version 0 to 2329 2024-09-10T18:10:31.080 INFO:tasks.rados.rados.0.smithi012.stdout:3888: oid 48 version 2329 is already newer than 2328 2024-09-10T18:10:31.080 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 2329 (ObjNum 1178 snap 388 seq_num 1178) dirty exists 2024-09-10T18:10:31.080 INFO:tasks.rados.rados.0.smithi012.stdout:3888: left oid 48 (ObjNum 1178 snap 388 seq_num 1178) 2024-09-10T18:10:31.080 INFO:tasks.rados.rados.0.smithi012.stdout:3884: expect (ObjNum 1146 snap 376 seq_num 1146) 2024-09-10T18:10:31.208 INFO:tasks.rados.rados.0.smithi012.stdout:3880: finishing write tid 3 to smithi01278544-43 2024-09-10T18:10:31.208 INFO:tasks.rados.rados.0.smithi012.stdout:3880: oid 43 updating version 0 to 2609 2024-09-10T18:10:31.208 INFO:tasks.rados.rados.0.smithi012.stdout:3880: oid 43 version 2609 is already newer than 2608 2024-09-10T18:10:31.208 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2609 (ObjNum 1176 snap 388 seq_num 1176) dirty exists 2024-09-10T18:10:31.209 INFO:tasks.rados.rados.0.smithi012.stdout:3880: left oid 43 (ObjNum 1176 snap 388 seq_num 1176) 2024-09-10T18:10:31.209 INFO:tasks.rados.rados.0.smithi012.stdout:3886: expect (ObjNum 1138 snap 375 seq_num 1138) 2024-09-10T18:10:31.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:30 smithi012 ceph-mon[89611]: osdmap e867: 8 total, 8 up, 8 in 2024-09-10T18:10:31.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:30 smithi012 ceph-mon[92029]: osdmap e867: 8 total, 8 up, 8 in 2024-09-10T18:10:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:30 smithi089 ceph-mon[84132]: osdmap e867: 8 total, 8 up, 8 in 2024-09-10T18:10:31.907 INFO:tasks.rados.rados.0.smithi012.stdout:3880: done (9 left) 2024-09-10T18:10:31.907 INFO:tasks.rados.rados.0.smithi012.stdout:3881: done (8 left) 2024-09-10T18:10:31.907 INFO:tasks.rados.rados.0.smithi012.stdout:3882: done (7 left) 2024-09-10T18:10:31.908 INFO:tasks.rados.rados.0.smithi012.stdout:3883: done (6 left) 2024-09-10T18:10:31.908 INFO:tasks.rados.rados.0.smithi012.stdout:3884: done (5 left) 2024-09-10T18:10:31.908 INFO:tasks.rados.rados.0.smithi012.stdout:3885: done (4 left) 2024-09-10T18:10:31.908 INFO:tasks.rados.rados.0.smithi012.stdout:3886: done (3 left) 2024-09-10T18:10:31.908 INFO:tasks.rados.rados.0.smithi012.stdout:3887: done (2 left) 2024-09-10T18:10:31.908 INFO:tasks.rados.rados.0.smithi012.stdout:3888: done (1 left) 2024-09-10T18:10:31.908 INFO:tasks.rados.rados.0.smithi012.stdout:3889: done (0 left) 2024-09-10T18:10:31.908 INFO:tasks.rados.rados.0.smithi012.stdout:3890: setattr oid 38 current snap is 389 2024-09-10T18:10:31.909 INFO:tasks.rados.rados.0.smithi012.stdout:3891: read oid 39 snap -1 2024-09-10T18:10:31.909 INFO:tasks.rados.rados.0.smithi012.stdout:3891: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:10:31.909 INFO:tasks.rados.rados.0.smithi012.stdout:3892: copy_from oid 35 from oid 9 current snap is 389 2024-09-10T18:10:31.909 INFO:tasks.rados.rados.0.smithi012.stdout:3893: snap_create 2024-09-10T18:10:31.912 INFO:tasks.rados.rados.0.smithi012.stdout:3891: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:10:31.915 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 38 v 2330 (ObjNum 1156 snap 378 seq_num 1156) dirty exists 2024-09-10T18:10:31.915 INFO:tasks.rados.rados.0.smithi012.stdout:3892: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:10:31.915 INFO:tasks.rados.rados.0.smithi012.stdout:3892: finishing copy_from to smithi01278544-35 2024-09-10T18:10:31.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2320 (ObjNum 1148 snap 378 seq_num 1148) dirty exists 2024-09-10T18:10:32.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:31 smithi012 ceph-mon[92029]: osdmap e868: 8 total, 8 up, 8 in 2024-09-10T18:10:32.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:31 smithi012 ceph-mon[92029]: pgmap v991: 121 pgs: 121 active+clean; 225 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.9 MiB/s rd, 346 KiB/s wr, 7 op/s 2024-09-10T18:10:32.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:32.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:31 smithi012 ceph-mon[89611]: osdmap e868: 8 total, 8 up, 8 in 2024-09-10T18:10:32.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:31 smithi012 ceph-mon[89611]: pgmap v991: 121 pgs: 121 active+clean; 225 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.9 MiB/s rd, 346 KiB/s wr, 7 op/s 2024-09-10T18:10:32.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:31 smithi089 ceph-mon[84132]: osdmap e868: 8 total, 8 up, 8 in 2024-09-10T18:10:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:31 smithi089 ceph-mon[84132]: pgmap v991: 121 pgs: 121 active+clean; 225 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.9 MiB/s rd, 346 KiB/s wr, 7 op/s 2024-09-10T18:10:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:32.847 INFO:tasks.rados.rados.0.smithi012.stdout:3890: done (3 left) 2024-09-10T18:10:32.847 INFO:tasks.rados.rados.0.smithi012.stdout:3891: done (2 left) 2024-09-10T18:10:32.847 INFO:tasks.rados.rados.0.smithi012.stdout:3892: done (1 left) 2024-09-10T18:10:32.847 INFO:tasks.rados.rados.0.smithi012.stdout:3893: done (0 left) 2024-09-10T18:10:32.848 INFO:tasks.rados.rados.0.smithi012.stdout:3894: snap_remove snap 386 2024-09-10T18:10:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:32 smithi012 ceph-mon[89611]: osdmap e869: 8 total, 8 up, 8 in 2024-09-10T18:10:33.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:32 smithi012 ceph-mon[89611]: osdmap e870: 8 total, 8 up, 8 in 2024-09-10T18:10:33.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:32 smithi012 ceph-mon[92029]: osdmap e869: 8 total, 8 up, 8 in 2024-09-10T18:10:33.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:32 smithi012 ceph-mon[92029]: osdmap e870: 8 total, 8 up, 8 in 2024-09-10T18:10:33.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:32 smithi089 ceph-mon[84132]: osdmap e869: 8 total, 8 up, 8 in 2024-09-10T18:10:33.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:32 smithi089 ceph-mon[84132]: osdmap e870: 8 total, 8 up, 8 in 2024-09-10T18:10:33.849 INFO:tasks.rados.rados.0.smithi012.stdout:3894: done (0 left) 2024-09-10T18:10:33.849 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 12 current snap is 390 2024-09-10T18:10:33.849 INFO:tasks.rados.rados.0.smithi012.stdout:3895: seq_num 1179 ranges {278528=548864} 2024-09-10T18:10:33.854 INFO:tasks.rados.rados.0.smithi012.stdout:3895: writing smithi01278544-12 from 278528 to 827392 tid 1 2024-09-10T18:10:33.855 INFO:tasks.rados.rados.0.smithi012.stdout:3896: snap_create 2024-09-10T18:10:33.863 INFO:tasks.rados.rados.0.smithi012.stdout:3895: finishing write tid 1 to smithi01278544-12 2024-09-10T18:10:33.863 INFO:tasks.rados.rados.0.smithi012.stdout:3895: finishing write tid 2 to smithi01278544-12 2024-09-10T18:10:33.866 INFO:tasks.rados.rados.0.smithi012.stdout:3895: finishing write tid 3 to smithi01278544-12 2024-09-10T18:10:33.866 INFO:tasks.rados.rados.0.smithi012.stdout:3895: oid 12 updating version 0 to 2938 2024-09-10T18:10:33.866 INFO:tasks.rados.rados.0.smithi012.stdout:3895: oid 12 version 2938 is already newer than 2937 2024-09-10T18:10:33.866 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2938 (ObjNum 1179 snap 390 seq_num 1179) dirty exists 2024-09-10T18:10:33.866 INFO:tasks.rados.rados.0.smithi012.stdout:3895: left oid 12 (ObjNum 1179 snap 390 seq_num 1179) 2024-09-10T18:10:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:33 smithi012 ceph-mon[89611]: pgmap v994: 121 pgs: 121 active+clean; 225 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 354 KiB/s wr, 10 op/s 2024-09-10T18:10:34.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:33 smithi012 ceph-mon[89611]: osdmap e871: 8 total, 8 up, 8 in 2024-09-10T18:10:34.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:33 smithi012 ceph-mon[92029]: pgmap v994: 121 pgs: 121 active+clean; 225 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 354 KiB/s wr, 10 op/s 2024-09-10T18:10:34.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:33 smithi012 ceph-mon[92029]: osdmap e871: 8 total, 8 up, 8 in 2024-09-10T18:10:34.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:33 smithi089 ceph-mon[84132]: pgmap v994: 121 pgs: 121 active+clean; 225 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 354 KiB/s wr, 10 op/s 2024-09-10T18:10:34.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:33 smithi089 ceph-mon[84132]: osdmap e871: 8 total, 8 up, 8 in 2024-09-10T18:10:34.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:10:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:10:34] "GET /metrics HTTP/1.1" 200 36354 "" "Prometheus/2.51.0" 2024-09-10T18:10:34.851 INFO:tasks.rados.rados.0.smithi012.stdout:3895: done (1 left) 2024-09-10T18:10:34.851 INFO:tasks.rados.rados.0.smithi012.stdout:3896: done (0 left) 2024-09-10T18:10:34.851 INFO:tasks.rados.rados.0.smithi012.stdout:3897: delete oid 29 current snap is 391 2024-09-10T18:10:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:3897: done (0 left) 2024-09-10T18:10:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:3898: rollback oid 10 current snap is 391 2024-09-10T18:10:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 10 to 371 2024-09-10T18:10:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:3899: read oid 9 snap -1 2024-09-10T18:10:34.855 INFO:tasks.rados.rados.0.smithi012.stdout:3899: expect (ObjNum 1148 snap 378 seq_num 1148) 2024-09-10T18:10:34.856 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 391 2024-09-10T18:10:34.856 INFO:tasks.rados.rados.0.smithi012.stdout:3900: seq_num 1181 ranges {0=581632} 2024-09-10T18:10:34.858 INFO:tasks.rados.rados.0.smithi012.stdout:3900: writing smithi01278544-44 from 0 to 581632 tid 1 2024-09-10T18:10:34.859 INFO:tasks.rados.rados.0.smithi012.stdout:3901: copy_from oid 16 from oid 37 current snap is 391 2024-09-10T18:10:34.859 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 19 current snap is 391 2024-09-10T18:10:34.859 INFO:tasks.rados.rados.0.smithi012.stdout:3902: seq_num 1182 ranges {9363456=606208} 2024-09-10T18:10:34.913 INFO:tasks.rados.rados.0.smithi012.stdout:3902: writing smithi01278544-19 from 9363456 to 9969664 tid 1 2024-09-10T18:10:34.913 INFO:tasks.rados.rados.0.smithi012.stdout:3903: rollback oid 29 current snap is 391 2024-09-10T18:10:34.913 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 29 to 385 2024-09-10T18:10:34.914 INFO:tasks.rados.rados.0.smithi012.stdout:3904: rollback oid 15 current snap is 391 2024-09-10T18:10:34.914 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 15 to 385 2024-09-10T18:10:34.914 INFO:tasks.rados.rados.0.smithi012.stdout:3899: expect (ObjNum 1148 snap 378 seq_num 1148) 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3898: finishing rollback tid 0 to smithi01278544-10 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3898: finishing rollback tid 1 to smithi01278544-10 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3899: done (6 left) 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 26 current snap is 391 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3900: finishing write tid 1 to smithi01278544-44 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3898: finishing rollback tid 2 to smithi01278544-10 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 10 v 2942 (ObjNum 953 snap 302 seq_num 953) dirty exists 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3900: finishing write tid 2 to smithi01278544-44 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3900: finishing write tid 3 to smithi01278544-44 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3900: oid 44 updating version 0 to 2555 2024-09-10T18:10:34.915 INFO:tasks.rados.rados.0.smithi012.stdout:3900: oid 44 version 2555 is already newer than 2554 2024-09-10T18:10:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2555 (ObjNum 1181 snap 391 seq_num 1181) dirty exists 2024-09-10T18:10:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:3900: left oid 44 (ObjNum 1181 snap 391 seq_num 1181) 2024-09-10T18:10:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:3901: finishing copy_from racing read to smithi01278544-16 2024-09-10T18:10:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:3901: finishing copy_from to smithi01278544-16 2024-09-10T18:10:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 16 v 2517 (ObjNum 1104 snap 354 seq_num 1104) dirty exists 2024-09-10T18:10:34.916 INFO:tasks.rados.rados.0.smithi012.stdout:3905: seq_num 1183 ranges {8724480=622592} 2024-09-10T18:10:34.966 INFO:tasks.rados.rados.0.smithi012.stdout:3905: writing smithi01278544-26 from 8724480 to 9347072 tid 1 2024-09-10T18:10:34.966 INFO:tasks.rados.rados.0.smithi012.stdout:3898: done (6 left) 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3900: done (5 left) 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3901: done (4 left) 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3906: read oid 49 snap -1 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3906: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3907: copy_from oid 35 from oid 11 current snap is 391 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3903: finishing rollback tid 1 to smithi01278544-29 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3904: finishing rollback tid 1 to smithi01278544-15 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2352 (ObjNum 65 snap 0 seq_num 1549493363) dirty dne 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3903: finishing rollback tid 2 to smithi01278544-29 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1148 (ObjNum 1141 snap 376 seq_num 1141) dirty exists 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3902: finishing write tid 1 to smithi01278544-19 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3902: finishing write tid 2 to smithi01278544-19 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3902: finishing write tid 3 to smithi01278544-19 2024-09-10T18:10:34.967 INFO:tasks.rados.rados.0.smithi012.stdout:3902: oid 19 updating version 0 to 2363 2024-09-10T18:10:34.968 INFO:tasks.rados.rados.0.smithi012.stdout:3902: oid 19 version 2363 is already newer than 2362 2024-09-10T18:10:34.968 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 19 v 2363 (ObjNum 1182 snap 391 seq_num 1182) dirty exists 2024-09-10T18:10:34.968 INFO:tasks.rados.rados.0.smithi012.stdout:3902: left oid 19 (ObjNum 1182 snap 391 seq_num 1182) 2024-09-10T18:10:34.968 INFO:tasks.rados.rados.0.smithi012.stdout:3902: done (5 left) 2024-09-10T18:10:34.968 INFO:tasks.rados.rados.0.smithi012.stdout:3903: done (4 left) 2024-09-10T18:10:34.968 INFO:tasks.rados.rados.0.smithi012.stdout:3904: done (3 left) 2024-09-10T18:10:34.968 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 45 current snap is 391 2024-09-10T18:10:34.968 INFO:tasks.rados.rados.0.smithi012.stdout:3908: seq_num 1184 ranges {3981312=638976} 2024-09-10T18:10:34.991 INFO:tasks.rados.rados.0.smithi012.stdout:3908: writing smithi01278544-45 from 3981312 to 4620288 tid 1 2024-09-10T18:10:34.991 INFO:tasks.rados.rados.0.smithi012.stdout:3909: snap_remove snap 371 2024-09-10T18:10:35.866 INFO:tasks.rados.rados.0.smithi012.stdout:3905: finishing write tid 1 to smithi01278544-26 2024-09-10T18:10:35.867 INFO:tasks.rados.rados.0.smithi012.stdout:3905: finishing write tid 2 to smithi01278544-26 2024-09-10T18:10:35.867 INFO:tasks.rados.rados.0.smithi012.stdout:3905: finishing write tid 3 to smithi01278544-26 2024-09-10T18:10:35.867 INFO:tasks.rados.rados.0.smithi012.stdout:3905: oid 26 updating version 0 to 2495 2024-09-10T18:10:35.867 INFO:tasks.rados.rados.0.smithi012.stdout:3905: oid 26 version 2495 is already newer than 2494 2024-09-10T18:10:35.867 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 26 v 2495 (ObjNum 1183 snap 391 seq_num 1183) dirty exists 2024-09-10T18:10:35.867 INFO:tasks.rados.rados.0.smithi012.stdout:3905: left oid 26 (ObjNum 1183 snap 391 seq_num 1183) 2024-09-10T18:10:35.867 INFO:tasks.rados.rados.0.smithi012.stdout:3907: finishing copy_from racing read to smithi01278544-35 2024-09-10T18:10:35.867 INFO:tasks.rados.rados.0.smithi012.stdout:3906: expect (ObjNum 1109 snap 357 seq_num 1109) 2024-09-10T18:10:35.987 INFO:tasks.rados.rados.0.smithi012.stdout:3907: finishing copy_from to smithi01278544-35 2024-09-10T18:10:35.987 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 35 v 2935 (ObjNum 1169 snap 384 seq_num 1169) dirty exists 2024-09-10T18:10:35.987 INFO:tasks.rados.rados.0.smithi012.stdout:3908: finishing write tid 1 to smithi01278544-45 2024-09-10T18:10:35.987 INFO:tasks.rados.rados.0.smithi012.stdout:3908: finishing write tid 2 to smithi01278544-45 2024-09-10T18:10:35.987 INFO:tasks.rados.rados.0.smithi012.stdout:3908: finishing write tid 3 to smithi01278544-45 2024-09-10T18:10:35.987 INFO:tasks.rados.rados.0.smithi012.stdout:3908: oid 45 updating version 0 to 2613 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3908: oid 45 updating version 2613 to 2614 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 45 v 2614 (ObjNum 1184 snap 391 seq_num 1184) dirty exists 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3908: left oid 45 (ObjNum 1184 snap 391 seq_num 1184) 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3905: done (4 left) 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3906: done (3 left) 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3907: done (2 left) 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3908: done (1 left) 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3909: done (0 left) 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3910: copy_from oid 13 from oid 8 current snap is 391 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 391 2024-09-10T18:10:35.988 INFO:tasks.rados.rados.0.smithi012.stdout:3911: seq_num 1185 ranges {1703936=655360} 2024-09-10T18:10:36.000 INFO:tasks.rados.rados.0.smithi012.stdout:3911: writing smithi01278544-37 from 1703936 to 2359296 tid 1 2024-09-10T18:10:36.000 INFO:tasks.rados.rados.0.smithi012.stdout:3912: snap_create 2024-09-10T18:10:36.000 INFO:tasks.rados.rados.0.smithi012.stdout:3910: finishing copy_from racing read to smithi01278544-13 2024-09-10T18:10:36.000 INFO:tasks.rados.rados.0.smithi012.stdout:3910: finishing copy_from to smithi01278544-13 2024-09-10T18:10:36.000 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 2493 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:10:36.003 INFO:tasks.rados.rados.0.smithi012.stdout:3911: finishing write tid 1 to smithi01278544-37 2024-09-10T18:10:36.003 INFO:tasks.rados.rados.0.smithi012.stdout:3911: finishing write tid 2 to smithi01278544-37 2024-09-10T18:10:36.004 INFO:tasks.rados.rados.0.smithi012.stdout:3911: finishing write tid 3 to smithi01278544-37 2024-09-10T18:10:36.004 INFO:tasks.rados.rados.0.smithi012.stdout:3911: oid 37 updating version 0 to 2522 2024-09-10T18:10:36.004 INFO:tasks.rados.rados.0.smithi012.stdout:3911: oid 37 updating version 2522 to 2523 2024-09-10T18:10:36.004 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 2523 (ObjNum 1185 snap 391 seq_num 1185) dirty exists 2024-09-10T18:10:36.005 INFO:tasks.rados.rados.0.smithi012.stdout:3911: left oid 37 (ObjNum 1185 snap 391 seq_num 1185) 2024-09-10T18:10:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:35 smithi012 ceph-mon[89611]: osdmap e872: 8 total, 8 up, 8 in 2024-09-10T18:10:36.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:35 smithi012 ceph-mon[89611]: pgmap v997: 121 pgs: 121 active+clean; 226 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 264 KiB/s wr, 9 op/s 2024-09-10T18:10:36.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:35 smithi012 ceph-mon[92029]: osdmap e872: 8 total, 8 up, 8 in 2024-09-10T18:10:36.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:35 smithi012 ceph-mon[92029]: pgmap v997: 121 pgs: 121 active+clean; 226 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 264 KiB/s wr, 9 op/s 2024-09-10T18:10:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:35 smithi089 ceph-mon[84132]: osdmap e872: 8 total, 8 up, 8 in 2024-09-10T18:10:36.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:35 smithi089 ceph-mon[84132]: pgmap v997: 121 pgs: 121 active+clean; 226 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 264 KiB/s wr, 9 op/s 2024-09-10T18:10:36.863 INFO:tasks.rados.rados.0.smithi012.stdout:3910: done (2 left) 2024-09-10T18:10:36.864 INFO:tasks.rados.rados.0.smithi012.stdout:3911: done (1 left) 2024-09-10T18:10:36.864 INFO:tasks.rados.rados.0.smithi012.stdout:3912: done (0 left) 2024-09-10T18:10:36.864 INFO:tasks.rados.rados.0.smithi012.stdout:3913: setattr oid 9 current snap is 392 2024-09-10T18:10:36.865 INFO:tasks.rados.rados.0.smithi012.stdout:3914: snap_create 2024-09-10T18:10:36.869 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 9 v 2331 (ObjNum 1148 snap 378 seq_num 1148) dirty exists 2024-09-10T18:10:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:36 smithi012 ceph-mon[89611]: osdmap e873: 8 total, 8 up, 8 in 2024-09-10T18:10:37.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:36 smithi012 ceph-mon[92029]: osdmap e873: 8 total, 8 up, 8 in 2024-09-10T18:10:37.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:36 smithi089 ceph-mon[84132]: osdmap e873: 8 total, 8 up, 8 in 2024-09-10T18:10:37.849 INFO:tasks.rados.rados.0.smithi012.stdout:3913: done (1 left) 2024-09-10T18:10:37.850 INFO:tasks.rados.rados.0.smithi012.stdout:3914: done (0 left) 2024-09-10T18:10:37.850 INFO:tasks.rados.rados.0.smithi012.stdout:3915: snap_create 2024-09-10T18:10:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:37 smithi012 ceph-mon[89611]: osdmap e874: 8 total, 8 up, 8 in 2024-09-10T18:10:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:37 smithi012 ceph-mon[89611]: pgmap v1000: 121 pgs: 121 active+clean; 223 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-10T18:10:38.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:37 smithi012 ceph-mon[89611]: osdmap e875: 8 total, 8 up, 8 in 2024-09-10T18:10:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:37 smithi012 ceph-mon[92029]: osdmap e874: 8 total, 8 up, 8 in 2024-09-10T18:10:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:37 smithi012 ceph-mon[92029]: pgmap v1000: 121 pgs: 121 active+clean; 223 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-10T18:10:38.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:37 smithi012 ceph-mon[92029]: osdmap e875: 8 total, 8 up, 8 in 2024-09-10T18:10:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:37 smithi089 ceph-mon[84132]: osdmap e874: 8 total, 8 up, 8 in 2024-09-10T18:10:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:37 smithi089 ceph-mon[84132]: pgmap v1000: 121 pgs: 121 active+clean; 223 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2024-09-10T18:10:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:37 smithi089 ceph-mon[84132]: osdmap e875: 8 total, 8 up, 8 in 2024-09-10T18:10:38.850 INFO:tasks.rados.rados.0.smithi012.stdout:3915: done (0 left) 2024-09-10T18:10:38.850 INFO:tasks.rados.rados.0.smithi012.stdout:3916: rollback oid 1 current snap is 394 2024-09-10T18:10:38.850 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 393 2024-09-10T18:10:38.850 INFO:tasks.rados.rados.0.smithi012.stdout:3917: read oid 41 snap -1 2024-09-10T18:10:38.850 INFO:tasks.rados.rados.0.smithi012.stdout:3917: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:10:38.850 INFO:tasks.rados.rados.0.smithi012.stdout:3918: setattr oid 2 current snap is 394 2024-09-10T18:10:38.853 INFO:tasks.rados.rados.0.smithi012.stdout:3919: delete oid 35 current snap is 394 2024-09-10T18:10:38.859 INFO:tasks.rados.rados.0.smithi012.stdout:3919: done (3 left) 2024-09-10T18:10:38.859 INFO:tasks.rados.rados.0.smithi012.stdout:3920: delete oid 38 current snap is 394 2024-09-10T18:10:38.860 INFO:tasks.rados.rados.0.smithi012.stdout:3916: finishing rollback tid 0 to smithi01278544-1 2024-09-10T18:10:38.862 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2785 (ObjNum 177 snap 0 seq_num 3497660608) dirty exists 2024-09-10T18:10:38.864 INFO:tasks.rados.rados.0.smithi012.stdout:3916: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:10:38.865 INFO:tasks.rados.rados.0.smithi012.stdout:3916: finishing rollback tid 2 to smithi01278544-1 2024-09-10T18:10:38.865 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2334 (ObjNum 129 snap 0 seq_num 3497835464) dirty exists 2024-09-10T18:10:38.865 INFO:tasks.rados.rados.0.smithi012.stdout:3916: done (3 left) 2024-09-10T18:10:38.865 INFO:tasks.rados.rados.0.smithi012.stdout:3918: done (2 left) 2024-09-10T18:10:38.865 INFO:tasks.rados.rados.0.smithi012.stdout:3920: done (1 left) 2024-09-10T18:10:38.865 INFO:tasks.rados.rados.0.smithi012.stdout:3921: rollback oid 1 current snap is 394 2024-09-10T18:10:38.865 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 1 to 389 2024-09-10T18:10:38.866 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 43 current snap is 394 2024-09-10T18:10:38.866 INFO:tasks.rados.rados.0.smithi012.stdout:3922: seq_num 1188 ranges {15040512=704512} 2024-09-10T18:10:38.953 INFO:tasks.rados.rados.0.smithi012.stdout:3922: writing smithi01278544-43 from 15040512 to 15745024 tid 1 2024-09-10T18:10:38.953 INFO:tasks.rados.rados.0.smithi012.stdout:3923: rollback oid 17 current snap is 394 2024-09-10T18:10:38.953 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 17 to 385 2024-09-10T18:10:38.953 INFO:tasks.rados.rados.0.smithi012.stdout:3921: finishing rollback tid 0 to smithi01278544-1 2024-09-10T18:10:38.953 INFO:tasks.rados.rados.0.smithi012.stdout:3921: finishing rollback tid 1 to smithi01278544-1 2024-09-10T18:10:38.953 INFO:tasks.rados.rados.0.smithi012.stdout:3921: finishing rollback tid 2 to smithi01278544-1 2024-09-10T18:10:38.953 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 1 v 2338 (ObjNum 129 snap 0 seq_num 3497835464) dirty exists 2024-09-10T18:10:38.954 INFO:tasks.rados.rados.0.smithi012.stdout:3917: expect (ObjNum 809 snap 264 seq_num 809) 2024-09-10T18:10:39.821 INFO:tasks.rados.rados.0.smithi012.stdout:3923: finishing rollback tid 0 to smithi01278544-17 2024-09-10T18:10:39.821 INFO:tasks.rados.rados.0.smithi012.stdout:3923: finishing rollback tid 1 to smithi01278544-17 2024-09-10T18:10:39.821 INFO:tasks.rados.rados.0.smithi012.stdout:3923: finishing rollback tid 2 to smithi01278544-17 2024-09-10T18:10:39.821 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2755 (ObjNum 33 snap 0 seq_num 3497328656) dirty exists 2024-09-10T18:10:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:3917: done (3 left) 2024-09-10T18:10:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:3921: done (2 left) 2024-09-10T18:10:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:3923: done (1 left) 2024-09-10T18:10:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 34 current snap is 394 2024-09-10T18:10:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:3922: finishing write tid 1 to smithi01278544-43 2024-09-10T18:10:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:3922: finishing write tid 2 to smithi01278544-43 2024-09-10T18:10:39.822 INFO:tasks.rados.rados.0.smithi012.stdout:3924: seq_num 1189 ranges {4317184=720896} 2024-09-10T18:10:39.848 INFO:tasks.rados.rados.0.smithi012.stdout:3924: writing smithi01278544-34 from 4317184 to 5038080 tid 1 2024-09-10T18:10:39.849 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 36 current snap is 394 2024-09-10T18:10:39.849 INFO:tasks.rados.rados.0.smithi012.stdout:3925: seq_num 1190 ranges {0=737280} 2024-09-10T18:10:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:3925: writing smithi01278544-36 from 0 to 737280 tid 1 2024-09-10T18:10:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 49 current snap is 394 2024-09-10T18:10:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:3922: finishing write tid 3 to smithi01278544-43 2024-09-10T18:10:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:3922: oid 43 updating version 0 to 2624 2024-09-10T18:10:39.853 INFO:tasks.rados.rados.0.smithi012.stdout:3922: oid 43 updating version 2624 to 2625 2024-09-10T18:10:39.854 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 43 v 2625 (ObjNum 1188 snap 394 seq_num 1188) dirty exists 2024-09-10T18:10:39.854 INFO:tasks.rados.rados.0.smithi012.stdout:3922: left oid 43 (ObjNum 1188 snap 394 seq_num 1188) 2024-09-10T18:10:39.854 INFO:tasks.rados.rados.0.smithi012.stdout:3926: seq_num 1191 ranges {3317760=753664} 2024-09-10T18:10:39.876 INFO:tasks.rados.rados.0.smithi012.stdout:3926: writing smithi01278544-49 from 3317760 to 4071424 tid 1 2024-09-10T18:10:39.876 INFO:tasks.rados.rados.0.smithi012.stdout:3922: done (3 left) 2024-09-10T18:10:39.876 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 37 current snap is 394 2024-09-10T18:10:39.876 INFO:tasks.rados.rados.0.smithi012.stdout:3927: seq_num 1192 ranges {2359296=770048} 2024-09-10T18:10:39.893 INFO:tasks.rados.rados.0.smithi012.stdout:3927: writing smithi01278544-37 from 2359296 to 3129344 tid 1 2024-09-10T18:10:39.893 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 7 current snap is 394 2024-09-10T18:10:39.893 INFO:tasks.rados.rados.0.smithi012.stdout:3928: seq_num 1193 ranges {3842048=786432} 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3928: writing smithi01278544-7 from 3842048 to 4628480 tid 1 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3929: rollback oid 25 current snap is 394 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 25 to 388 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3924: finishing write tid 1 to smithi01278544-34 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3924: finishing write tid 2 to smithi01278544-34 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3924: finishing write tid 3 to smithi01278544-34 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3924: oid 34 updating version 0 to 2365 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3924: oid 34 version 2365 is already newer than 2364 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 34 v 2365 (ObjNum 1189 snap 394 seq_num 1189) dirty exists 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3924: left oid 34 (ObjNum 1189 snap 394 seq_num 1189) 2024-09-10T18:10:39.922 INFO:tasks.rados.rados.0.smithi012.stdout:3925: finishing write tid 1 to smithi01278544-36 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3925: finishing write tid 2 to smithi01278544-36 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3925: finishing write tid 3 to smithi01278544-36 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3925: oid 36 updating version 0 to 2497 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3925: oid 36 version 2497 is already newer than 2496 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 36 v 2497 (ObjNum 1190 snap 394 seq_num 1190) dirty exists 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3925: left oid 36 (ObjNum 1190 snap 394 seq_num 1190) 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3926: finishing write tid 1 to smithi01278544-49 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3926: finishing write tid 2 to smithi01278544-49 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3924: done (5 left) 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3925: done (4 left) 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 44 current snap is 394 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3926: finishing write tid 3 to smithi01278544-49 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3926: oid 49 updating version 0 to 2786 2024-09-10T18:10:39.923 INFO:tasks.rados.rados.0.smithi012.stdout:3926: oid 49 updating version 2786 to 2787 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 49 v 2787 (ObjNum 1191 snap 394 seq_num 1191) dirty exists 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:3926: left oid 49 (ObjNum 1191 snap 394 seq_num 1191) 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:3927: finishing write tid 1 to smithi01278544-37 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:3927: finishing write tid 2 to smithi01278544-37 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:3927: finishing write tid 3 to smithi01278544-37 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:3927: oid 37 updating version 0 to 2525 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:3927: oid 37 version 2525 is already newer than 2524 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 37 v 2525 (ObjNum 1192 snap 394 seq_num 1192) dirty exists 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:3927: left oid 37 (ObjNum 1192 snap 394 seq_num 1192) 2024-09-10T18:10:39.924 INFO:tasks.rados.rados.0.smithi012.stdout:3930: seq_num 1194 ranges {581632=802816} 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3930: writing smithi01278544-44 from 581632 to 1384448 tid 1 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3926: done (4 left) 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3927: done (3 left) 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3931: copy_from oid 12 from oid 24 current snap is 394 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3929: finishing rollback tid 1 to smithi01278544-25 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 25 v 0 (ObjNum 33 snap 0 seq_num 3496721072) dirty dne 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3928: finishing write tid 1 to smithi01278544-7 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3928: finishing write tid 2 to smithi01278544-7 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3928: finishing write tid 3 to smithi01278544-7 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3928: oid 7 updating version 0 to 2487 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:3928: oid 7 updating version 2487 to 2488 2024-09-10T18:10:39.927 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 7 v 2488 (ObjNum 1193 snap 394 seq_num 1193) dirty exists 2024-09-10T18:10:39.928 INFO:tasks.rados.rados.0.smithi012.stdout:3928: left oid 7 (ObjNum 1193 snap 394 seq_num 1193) 2024-09-10T18:10:39.928 INFO:tasks.rados.rados.0.smithi012.stdout:3928: done (3 left) 2024-09-10T18:10:39.928 INFO:tasks.rados.rados.0.smithi012.stdout:3929: done (2 left) 2024-09-10T18:10:39.928 INFO:tasks.rados.rados.0.smithi012.stdout:3932: copy_from oid 40 from oid 2 current snap is 394 2024-09-10T18:10:39.928 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 27 current snap is 394 2024-09-10T18:10:39.928 INFO:tasks.rados.rados.0.smithi012.stdout:3933: seq_num 1195 ranges {6602752=417792,7020544=401408} 2024-09-10T18:10:39.965 INFO:tasks.rados.rados.0.smithi012.stdout:3933: writing smithi01278544-27 from 6602752 to 7020544 tid 1 2024-09-10T18:10:39.968 INFO:tasks.rados.rados.0.smithi012.stdout:3933: writing smithi01278544-27 from 7020544 to 7421952 tid 2 2024-09-10T18:10:39.968 INFO:tasks.rados.rados.0.smithi012.stdout:3934: rollback oid 39 current snap is 394 2024-09-10T18:10:39.968 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 39 to 392 2024-09-10T18:10:39.968 INFO:tasks.rados.rados.0.smithi012.stdout:3932: finishing copy_from racing read to smithi01278544-40 2024-09-10T18:10:39.968 INFO:tasks.rados.rados.0.smithi012.stdout:3930: finishing write tid 1 to smithi01278544-44 2024-09-10T18:10:39.968 INFO:tasks.rados.rados.0.smithi012.stdout:3930: finishing write tid 2 to smithi01278544-44 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3932: finishing copy_from to smithi01278544-40 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2785 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3930: finishing write tid 3 to smithi01278544-44 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3930: oid 44 updating version 0 to 2557 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3930: oid 44 version 2557 is already newer than 2556 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 44 v 2557 (ObjNum 1194 snap 394 seq_num 1194) dirty exists 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3930: left oid 44 (ObjNum 1194 snap 394 seq_num 1194) 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3931: finishing copy_from racing read to smithi01278544-12 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3930: done (4 left) 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3932: done (3 left) 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3935: read oid 38 snap -1 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3935: expect deleted 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3936: read oid 43 snap -1 2024-09-10T18:10:39.969 INFO:tasks.rados.rados.0.smithi012.stdout:3936: expect (ObjNum 1188 snap 394 seq_num 1188) 2024-09-10T18:10:39.970 INFO:tasks.rados.rados.0.smithi012.stdout:3937: copy_from oid 31 from oid 32 current snap is 394 2024-09-10T18:10:39.970 INFO:tasks.rados.rados.0.smithi012.stdout:3931: finishing copy_from to smithi01278544-12 2024-09-10T18:10:39.970 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2490 (ObjNum 1168 snap 383 seq_num 1168) dirty exists 2024-09-10T18:10:39.970 INFO:tasks.rados.rados.0.smithi012.stdout:3931: done (5 left) 2024-09-10T18:10:39.970 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 48 current snap is 394 2024-09-10T18:10:39.970 INFO:tasks.rados.rados.0.smithi012.stdout:3938: seq_num 1196 ranges {2621440=434176,3055616=401408} 2024-09-10T18:10:39.984 INFO:tasks.rados.rados.0.smithi012.stdout:3938: writing smithi01278544-48 from 2621440 to 3055616 tid 1 2024-09-10T18:10:39.987 INFO:tasks.rados.rados.0.smithi012.stdout:3938: writing smithi01278544-48 from 3055616 to 3457024 tid 2 2024-09-10T18:10:39.987 INFO:tasks.rados.rados.0.smithi012.stdout:3939: read oid 11 snap -1 2024-09-10T18:10:39.987 INFO:tasks.rados.rados.0.smithi012.stdout:3939: expect (ObjNum 1169 snap 384 seq_num 1169) 2024-09-10T18:10:39.987 INFO:tasks.rados.rados.0.smithi012.stdout:3940: snap_remove snap 389 2024-09-10T18:10:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:39 smithi012 ceph-mon[89611]: osdmap e876: 8 total, 8 up, 8 in 2024-09-10T18:10:40.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:39 smithi012 ceph-mon[89611]: pgmap v1003: 121 pgs: 121 active+clean; 199 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 42 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T18:10:40.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:39 smithi012 ceph-mon[92029]: osdmap e876: 8 total, 8 up, 8 in 2024-09-10T18:10:40.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:39 smithi012 ceph-mon[92029]: pgmap v1003: 121 pgs: 121 active+clean; 199 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 42 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T18:10:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:39 smithi089 ceph-mon[84132]: osdmap e876: 8 total, 8 up, 8 in 2024-09-10T18:10:40.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:39 smithi089 ceph-mon[84132]: pgmap v1003: 121 pgs: 121 active+clean; 199 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 42 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-09-10T18:10:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:3940: done (7 left) 2024-09-10T18:10:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:3941: read oid 35 snap -1 2024-09-10T18:10:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:3941: expect deleted 2024-09-10T18:10:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 28 current snap is 394 2024-09-10T18:10:40.866 INFO:tasks.rados.rados.0.smithi012.stdout:3942: seq_num 1197 ranges {0=450560,450560=401408} 2024-09-10T18:10:40.869 INFO:tasks.rados.rados.0.smithi012.stdout:3942: writing smithi01278544-28 from 0 to 450560 tid 1 2024-09-10T18:10:40.872 INFO:tasks.rados.rados.0.smithi012.stdout:3942: writing smithi01278544-28 from 450560 to 851968 tid 2 2024-09-10T18:10:40.872 INFO:tasks.rados.rados.0.smithi012.stdout:3943: read oid 12 snap -1 2024-09-10T18:10:40.872 INFO:tasks.rados.rados.0.smithi012.stdout:3943: expect (ObjNum 1168 snap 383 seq_num 1168) 2024-09-10T18:10:40.872 INFO:tasks.rados.rados.0.smithi012.stdout:3944: read oid 46 snap -1 2024-09-10T18:10:40.872 INFO:tasks.rados.rados.0.smithi012.stdout:3944: expect (ObjNum 1172 snap 385 seq_num 1172) 2024-09-10T18:10:40.872 INFO:tasks.rados.rados.0.smithi012.stdout:3945: snap_remove snap 388 2024-09-10T18:10:41.877 INFO:tasks.rados.rados.0.smithi012.stdout:3945: done (11 left) 2024-09-10T18:10:41.877 INFO:tasks.rados.rados.0.smithi012.stdout:3946: read oid 47 snap -1 2024-09-10T18:10:41.877 INFO:tasks.rados.rados.0.smithi012.stdout:3946: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:10:41.877 INFO:tasks.rados.rados.0.smithi012.stdout:3947: snap_remove snap 393 2024-09-10T18:10:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:41 smithi012 ceph-mon[89611]: osdmap e877: 8 total, 8 up, 8 in 2024-09-10T18:10:42.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:41 smithi012 ceph-mon[89611]: pgmap v1005: 121 pgs: 121 active+clean; 166 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2024-09-10T18:10:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:41 smithi012 ceph-mon[92029]: osdmap e877: 8 total, 8 up, 8 in 2024-09-10T18:10:42.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:41 smithi012 ceph-mon[92029]: pgmap v1005: 121 pgs: 121 active+clean; 166 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2024-09-10T18:10:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:41 smithi089 ceph-mon[84132]: osdmap e877: 8 total, 8 up, 8 in 2024-09-10T18:10:42.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:41 smithi089 ceph-mon[84132]: pgmap v1005: 121 pgs: 121 active+clean; 166 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 17 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2024-09-10T18:10:42.859 INFO:tasks.rados.rados.0.smithi012.stdout:3947: done (12 left) 2024-09-10T18:10:42.859 INFO:tasks.rados.rados.0.smithi012.stdout:3948: read oid 9 snap -1 2024-09-10T18:10:42.859 INFO:tasks.rados.rados.0.smithi012.stdout:3948: expect (ObjNum 1148 snap 378 seq_num 1148) 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3949: read oid 45 snap 391 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3949: expect (ObjNum 1184 snap 391 seq_num 1184) 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3950: setattr oid 20 current snap is 394 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3933: finishing write tid 1 to smithi01278544-27 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3934: finishing rollback tid 0 to smithi01278544-39 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3933: finishing write tid 2 to smithi01278544-27 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3934: finishing rollback tid 1 to smithi01278544-39 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3933: finishing write tid 3 to smithi01278544-27 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3934: finishing rollback tid 2 to smithi01278544-39 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 39 v 2956 (ObjNum 65 snap 0 seq_num 3498068944) dirty exists 2024-09-10T18:10:42.860 INFO:tasks.rados.rados.0.smithi012.stdout:3933: finishing write tid 4 to smithi01278544-27 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3933: oid 27 updating version 0 to 2559 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3933: oid 27 updating version 2559 to 2560 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3933: oid 27 version 2560 is already newer than 2558 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 27 v 2560 (ObjNum 1195 snap 394 seq_num 1195) dirty exists 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3933: left oid 27 (ObjNum 1195 snap 394 seq_num 1195) 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3937: finishing copy_from racing read to smithi01278544-31 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3937: finishing copy_from to smithi01278544-31 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 31 v 2517 (ObjNum 1104 snap 354 seq_num 1104) dirty exists 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3938: finishing write tid 1 to smithi01278544-48 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3938: finishing write tid 2 to smithi01278544-48 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3938: finishing write tid 3 to smithi01278544-48 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3938: finishing write tid 4 to smithi01278544-48 2024-09-10T18:10:42.861 INFO:tasks.rados.rados.0.smithi012.stdout:3938: oid 48 updating version 0 to 2339 2024-09-10T18:10:42.862 INFO:tasks.rados.rados.0.smithi012.stdout:3938: oid 48 updating version 2339 to 2341 2024-09-10T18:10:42.862 INFO:tasks.rados.rados.0.smithi012.stdout:3938: oid 48 version 2341 is already newer than 2340 2024-09-10T18:10:42.862 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 48 v 2341 (ObjNum 1196 snap 394 seq_num 1196) dirty exists 2024-09-10T18:10:42.862 INFO:tasks.rados.rados.0.smithi012.stdout:3938: left oid 48 (ObjNum 1196 snap 394 seq_num 1196) 2024-09-10T18:10:42.862 INFO:tasks.rados.rados.0.smithi012.stdout:3939: expect (ObjNum 1169 snap 384 seq_num 1169) 2024-09-10T18:10:42.971 INFO:tasks.rados.rados.0.smithi012.stdout:3936: expect (ObjNum 1188 snap 394 seq_num 1188) 2024-09-10T18:10:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:42 smithi012 ceph-mon[89611]: osdmap e878: 8 total, 8 up, 8 in 2024-09-10T18:10:43.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:42 smithi012 ceph-mon[89611]: osdmap e879: 8 total, 8 up, 8 in 2024-09-10T18:10:43.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:42 smithi012 ceph-mon[92029]: osdmap e878: 8 total, 8 up, 8 in 2024-09-10T18:10:43.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:42 smithi012 ceph-mon[92029]: osdmap e879: 8 total, 8 up, 8 in 2024-09-10T18:10:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:42 smithi089 ceph-mon[84132]: osdmap e878: 8 total, 8 up, 8 in 2024-09-10T18:10:43.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:42 smithi089 ceph-mon[84132]: osdmap e879: 8 total, 8 up, 8 in 2024-09-10T18:10:44.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:43 smithi012 ceph-mon[89611]: pgmap v1008: 121 pgs: 121 active+clean; 171 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 21 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2024-09-10T18:10:44.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:43 smithi012 ceph-mon[92029]: pgmap v1008: 121 pgs: 121 active+clean; 171 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 21 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2024-09-10T18:10:44.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:43 smithi089 ceph-mon[84132]: pgmap v1008: 121 pgs: 121 active+clean; 171 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 21 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2024-09-10T18:10:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:10:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:10:44] "GET /metrics HTTP/1.1" 200 36354 "" "Prometheus/2.51.0" 2024-09-10T18:10:45.334 INFO:tasks.rados.rados.0.smithi012.stdout:3942: finishing write tid 1 to smithi01278544-28 2024-09-10T18:10:45.334 INFO:tasks.rados.rados.0.smithi012.stdout:3942: finishing write tid 2 to smithi01278544-28 2024-09-10T18:10:45.334 INFO:tasks.rados.rados.0.smithi012.stdout:3942: finishing write tid 3 to smithi01278544-28 2024-09-10T18:10:45.334 INFO:tasks.rados.rados.0.smithi012.stdout:3944: expect (ObjNum 1172 snap 385 seq_num 1172) 2024-09-10T18:10:45.345 INFO:tasks.rados.rados.0.smithi012.stdout:3942: finishing write tid 4 to smithi01278544-28 2024-09-10T18:10:45.345 INFO:tasks.rados.rados.0.smithi012.stdout:3942: oid 28 updating version 0 to 1337 2024-09-10T18:10:45.345 INFO:tasks.rados.rados.0.smithi012.stdout:3942: oid 28 version 1337 is already newer than 1336 2024-09-10T18:10:45.345 INFO:tasks.rados.rados.0.smithi012.stdout:3942: oid 28 version 1337 is already newer than 1335 2024-09-10T18:10:45.345 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 28 v 1337 (ObjNum 1197 snap 394 seq_num 1197) dirty exists 2024-09-10T18:10:45.345 INFO:tasks.rados.rados.0.smithi012.stdout:3942: left oid 28 (ObjNum 1197 snap 394 seq_num 1197) 2024-09-10T18:10:45.346 INFO:tasks.rados.rados.0.smithi012.stdout:3943: expect (ObjNum 1168 snap 383 seq_num 1168) 2024-09-10T18:10:45.438 INFO:tasks.rados.rados.0.smithi012.stdout:3946: expect (ObjNum 1014 snap 323 seq_num 1014) 2024-09-10T18:10:45.443 INFO:tasks.rados.rados.0.smithi012.stdout:3949: expect (ObjNum 1184 snap 391 seq_num 1184) 2024-09-10T18:10:45.654 INFO:tasks.rados.rados.0.smithi012.stdout:3948: expect (ObjNum 1148 snap 378 seq_num 1148) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3933: done (14 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3934: done (13 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3935: done (12 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3936: done (11 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3937: done (10 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3938: done (9 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3939: done (8 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3941: done (7 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3942: done (6 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3943: done (5 left) 2024-09-10T18:10:45.659 INFO:tasks.rados.rados.0.smithi012.stdout:3944: done (4 left) 2024-09-10T18:10:45.660 INFO:tasks.rados.rados.0.smithi012.stdout:3946: done (3 left) 2024-09-10T18:10:45.660 INFO:tasks.rados.rados.0.smithi012.stdout:3948: done (2 left) 2024-09-10T18:10:45.660 INFO:tasks.rados.rados.0.smithi012.stdout:3949: done (1 left) 2024-09-10T18:10:45.660 INFO:tasks.rados.rados.0.smithi012.stdout:3951: setattr oid 17 current snap is 394 2024-09-10T18:10:45.660 INFO:tasks.rados.rados.0.smithi012.stdout:3952: snap_remove snap 392 2024-09-10T18:10:46.211 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 17 v 2756 (ObjNum 33 snap 0 seq_num 3497328656) dirty exists 2024-09-10T18:10:46.211 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2974 (ObjNum 973 snap 308 seq_num 973) dirty exists 2024-09-10T18:10:46.211 INFO:tasks.rados.rados.0.smithi012.stdout:3950: done (2 left) 2024-09-10T18:10:46.212 INFO:tasks.rados.rados.0.smithi012.stdout:3951: done (1 left) 2024-09-10T18:10:46.212 INFO:tasks.rados.rados.0.smithi012.stdout:3952: done (0 left) 2024-09-10T18:10:46.212 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 2 current snap is 394 2024-09-10T18:10:46.212 INFO:tasks.rados.rados.0.smithi012.stdout:3953: seq_num 1198 ranges {0=466944,466944=401408} 2024-09-10T18:10:46.214 INFO:tasks.rados.rados.0.smithi012.stdout:3953: writing smithi01278544-2 from 0 to 466944 tid 1 2024-09-10T18:10:46.217 INFO:tasks.rados.rados.0.smithi012.stdout:3953: writing smithi01278544-2 from 466944 to 868352 tid 2 2024-09-10T18:10:46.218 INFO:tasks.rados.rados.0.smithi012.stdout:3954: rmattr oid 14 current snap is 394 2024-09-10T18:10:46.218 INFO:tasks.rados.rados.0.smithi012.stdout:3955: snap_create 2024-09-10T18:10:46.225 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 14 v 2786 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-09-10T18:10:46.226 INFO:tasks.rados.rados.0.smithi012.stdout:3953: finishing write tid 1 to smithi01278544-2 2024-09-10T18:10:46.228 INFO:tasks.rados.rados.0.smithi012.stdout:3953: finishing write tid 2 to smithi01278544-2 2024-09-10T18:10:46.229 INFO:tasks.rados.rados.0.smithi012.stdout:3953: finishing write tid 3 to smithi01278544-2 2024-09-10T18:10:46.231 INFO:tasks.rados.rados.0.smithi012.stdout:3953: finishing write tid 4 to smithi01278544-2 2024-09-10T18:10:46.231 INFO:tasks.rados.rados.0.smithi012.stdout:3953: oid 2 updating version 0 to 2789 2024-09-10T18:10:46.232 INFO:tasks.rados.rados.0.smithi012.stdout:3953: oid 2 version 2789 is already newer than 2788 2024-09-10T18:10:46.232 INFO:tasks.rados.rados.0.smithi012.stdout:3953: oid 2 updating version 2789 to 2790 2024-09-10T18:10:46.232 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 2 v 2790 (ObjNum 1198 snap 394 seq_num 1198) dirty exists 2024-09-10T18:10:46.232 INFO:tasks.rados.rados.0.smithi012.stdout:3953: left oid 2 (ObjNum 1198 snap 394 seq_num 1198) 2024-09-10T18:10:46.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:46 smithi012 ceph-mon[89611]: pgmap v1009: 121 pgs: 121 active+clean; 172 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 15 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2024-09-10T18:10:46.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:46 smithi012 ceph-mon[92029]: pgmap v1009: 121 pgs: 121 active+clean; 172 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 15 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2024-09-10T18:10:46.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:46 smithi089 ceph-mon[84132]: pgmap v1009: 121 pgs: 121 active+clean; 172 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 15 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2024-09-10T18:10:47.224 INFO:tasks.rados.rados.0.smithi012.stdout:3953: done (2 left) 2024-09-10T18:10:47.224 INFO:tasks.rados.rados.0.smithi012.stdout:3954: done (1 left) 2024-09-10T18:10:47.224 INFO:tasks.rados.rados.0.smithi012.stdout:3955: done (0 left) 2024-09-10T18:10:47.224 INFO:tasks.rados.rados.0.smithi012.stdout:3956: read oid 44 snap -1 2024-09-10T18:10:47.224 INFO:tasks.rados.rados.0.smithi012.stdout:3956: expect (ObjNum 1194 snap 394 seq_num 1194) 2024-09-10T18:10:47.224 INFO:tasks.rados.rados.0.smithi012.stdout:3957: setattr oid 11 current snap is 395 2024-09-10T18:10:47.225 INFO:tasks.rados.rados.0.smithi012.stdout:3958: read oid 42 snap 390 2024-09-10T18:10:47.225 INFO:tasks.rados.rados.0.smithi012.stdout:3958: expect deleted 2024-09-10T18:10:47.225 INFO:tasks.rados.rados.0.smithi012.stdout:3959: read oid 7 snap -1 2024-09-10T18:10:47.225 INFO:tasks.rados.rados.0.smithi012.stdout:3959: expect (ObjNum 1193 snap 394 seq_num 1193) 2024-09-10T18:10:47.225 INFO:tasks.rados.rados.0.smithi012.stdout:3960: rollback oid 23 current snap is 395 2024-09-10T18:10:47.225 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 23 to 385 2024-09-10T18:10:47.226 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 18 current snap is 395 2024-09-10T18:10:47.226 INFO:tasks.rados.rados.0.smithi012.stdout:3961: seq_num 1199 ranges {516096=483328,999424=401408} 2024-09-10T18:10:47.231 INFO:tasks.rados.rados.0.smithi012.stdout:3961: writing smithi01278544-18 from 516096 to 999424 tid 1 2024-09-10T18:10:47.234 INFO:tasks.rados.rados.0.smithi012.stdout:3961: writing smithi01278544-18 from 999424 to 1400832 tid 2 2024-09-10T18:10:47.234 INFO:tasks.rados.rados.0.smithi012.stdout:3962: read oid 14 snap -1 2024-09-10T18:10:47.235 INFO:tasks.rados.rados.0.smithi012.stdout:3962: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:10:47.235 INFO:tasks.rados.rados.0.smithi012.stdout:3963: read oid 4 snap -1 2024-09-10T18:10:47.235 INFO:tasks.rados.rados.0.smithi012.stdout:3963: expect deleted 2024-09-10T18:10:47.235 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 20 current snap is 395 2024-09-10T18:10:47.235 INFO:tasks.rados.rados.0.smithi012.stdout:3964: seq_num 1200 ranges {5562368=499712,6062080=401408} 2024-09-10T18:10:47.268 INFO:tasks.rados.rados.0.smithi012.stdout:3964: writing smithi01278544-20 from 5562368 to 6062080 tid 1 2024-09-10T18:10:47.271 INFO:tasks.rados.rados.0.smithi012.stdout:3964: writing smithi01278544-20 from 6062080 to 6463488 tid 2 2024-09-10T18:10:47.271 INFO:tasks.rados.rados.0.smithi012.stdout:3965: rollback oid 12 current snap is 395 2024-09-10T18:10:47.271 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 12 to 385 2024-09-10T18:10:47.271 INFO:tasks.rados.rados.0.smithi012.stdout:3960: finishing rollback tid 0 to smithi01278544-23 2024-09-10T18:10:47.271 INFO:tasks.rados.rados.0.smithi012.stdout:3960: finishing rollback tid 1 to smithi01278544-23 2024-09-10T18:10:47.271 INFO:tasks.rados.rados.0.smithi012.stdout:3958: done (9 left) 2024-09-10T18:10:47.272 INFO:tasks.rados.rados.0.smithi012.stdout:3966: rmattr oid 15 current snap is 395 2024-09-10T18:10:47.272 INFO:tasks.rados.rados.0.smithi012.stdout:3966: done (9 left) 2024-09-10T18:10:47.272 INFO:tasks.rados.rados.0.smithi012.stdout:3967: copy_from oid 46 from oid 50 current snap is 395 2024-09-10T18:10:47.272 INFO:tasks.rados.rados.0.smithi012.stdout:3960: finishing rollback tid 2 to smithi01278544-23 2024-09-10T18:10:47.272 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 23 v 2368 (ObjNum 1148 snap 378 seq_num 1148) dirty exists 2024-09-10T18:10:47.272 INFO:tasks.rados.rados.0.smithi012.stdout:3962: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-10T18:10:47.276 INFO:tasks.rados.rados.0.smithi012.stdout:3956: expect (ObjNum 1194 snap 394 seq_num 1194) 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:3961: finishing write tid 1 to smithi01278544-18 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:3961: finishing write tid 2 to smithi01278544-18 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:3961: finishing write tid 3 to smithi01278544-18 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:3956: done (9 left) 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:3960: done (8 left) 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:3962: done (7 left) 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:3963: done (6 left) 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:3968: rollback oid 47 current snap is 395 2024-09-10T18:10:47.323 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 47 to 390 2024-09-10T18:10:47.324 INFO:tasks.rados.rados.0.smithi012.stdout:3961: finishing write tid 4 to smithi01278544-18 2024-09-10T18:10:47.324 INFO:tasks.rados.rados.0.smithi012.stdout:3961: oid 18 updating version 0 to 2792 2024-09-10T18:10:47.324 INFO:tasks.rados.rados.0.smithi012.stdout:3961: oid 18 updating version 2792 to 2793 2024-09-10T18:10:47.324 INFO:tasks.rados.rados.0.smithi012.stdout:3961: oid 18 version 2793 is already newer than 2791 2024-09-10T18:10:47.324 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 2793 (ObjNum 1199 snap 395 seq_num 1199) dirty exists 2024-09-10T18:10:47.324 INFO:tasks.rados.rados.0.smithi012.stdout:3961: left oid 18 (ObjNum 1199 snap 395 seq_num 1199) 2024-09-10T18:10:47.324 INFO:tasks.rados.rados.0.smithi012.stdout:3959: expect (ObjNum 1193 snap 394 seq_num 1193) 2024-09-10T18:10:47.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:47 smithi012 ceph-mon[89611]: osdmap e880: 8 total, 8 up, 8 in 2024-09-10T18:10:47.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:47 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:47.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:47 smithi012 ceph-mon[92029]: osdmap e880: 8 total, 8 up, 8 in 2024-09-10T18:10:47.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:47 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:47.536 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 11 v 2982 (ObjNum 1169 snap 384 seq_num 1169) dirty exists 2024-09-10T18:10:47.536 INFO:tasks.rados.rados.0.smithi012.stdout:3957: done (6 left) 2024-09-10T18:10:47.536 INFO:tasks.rados.rados.0.smithi012.stdout:3959: done (5 left) 2024-09-10T18:10:47.536 INFO:tasks.rados.rados.0.smithi012.stdout:3961: done (4 left) 2024-09-10T18:10:47.536 INFO:tasks.rados.rados.0.smithi012.stdout:3969: snap_create 2024-09-10T18:10:47.536 INFO:tasks.rados.rados.0.smithi012.stdout:3964: finishing write tid 1 to smithi01278544-20 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3964: finishing write tid 2 to smithi01278544-20 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3967: finishing copy_from racing read to smithi01278544-46 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3964: finishing write tid 3 to smithi01278544-20 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3967: finishing copy_from to smithi01278544-46 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 46 v 2438 (ObjNum 1162 snap 379 seq_num 1162) dirty exists 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3965: finishing rollback tid 0 to smithi01278544-12 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3964: finishing write tid 4 to smithi01278544-20 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3964: oid 20 updating version 0 to 2986 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3964: oid 20 version 2986 is already newer than 2984 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3964: oid 20 version 2986 is already newer than 2985 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 20 v 2986 (ObjNum 1200 snap 395 seq_num 1200) dirty exists 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3964: left oid 20 (ObjNum 1200 snap 395 seq_num 1200) 2024-09-10T18:10:47.537 INFO:tasks.rados.rados.0.smithi012.stdout:3965: finishing rollback tid 1 to smithi01278544-12 2024-09-10T18:10:47.538 INFO:tasks.rados.rados.0.smithi012.stdout:3965: finishing rollback tid 2 to smithi01278544-12 2024-09-10T18:10:47.538 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 12 v 2990 (ObjNum 1157 snap 378 seq_num 1157) dirty exists 2024-09-10T18:10:47.538 INFO:tasks.rados.rados.0.smithi012.stdout:3968: finishing rollback tid 0 to smithi01278544-47 2024-09-10T18:10:47.538 INFO:tasks.rados.rados.0.smithi012.stdout:3968: finishing rollback tid 1 to smithi01278544-47 2024-09-10T18:10:47.538 INFO:tasks.rados.rados.0.smithi012.stdout:3968: finishing rollback tid 2 to smithi01278544-47 2024-09-10T18:10:47.538 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 47 v 2789 (ObjNum 1014 snap 323 seq_num 1014) dirty exists 2024-09-10T18:10:47.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:47 smithi089 ceph-mon[84132]: osdmap e880: 8 total, 8 up, 8 in 2024-09-10T18:10:47.538 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:47 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:10:47.856 INFO:tasks.rados.rados.0.smithi012.stdout:3964: done (4 left) 2024-09-10T18:10:47.856 INFO:tasks.rados.rados.0.smithi012.stdout:3965: done (3 left) 2024-09-10T18:10:47.857 INFO:tasks.rados.rados.0.smithi012.stdout:3967: done (2 left) 2024-09-10T18:10:47.857 INFO:tasks.rados.rados.0.smithi012.stdout:3968: done (1 left) 2024-09-10T18:10:47.857 INFO:tasks.rados.rados.0.smithi012.stdout:3969: done (0 left) 2024-09-10T18:10:47.857 INFO:tasks.rados.rados.0.smithi012.stdout:3970: rollback oid 29 current snap is 396 2024-09-10T18:10:47.857 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 29 to 391 2024-09-10T18:10:47.857 INFO:tasks.rados.rados.0.smithi012.stdout:3971: snap_remove snap 395 2024-09-10T18:10:48.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:48 smithi012 ceph-mon[89611]: pgmap v1011: 121 pgs: 121 active+clean; 172 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-09-10T18:10:48.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:48 smithi012 ceph-mon[89611]: osdmap e881: 8 total, 8 up, 8 in 2024-09-10T18:10:48.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:48 smithi012 ceph-mon[89611]: osdmap e882: 8 total, 8 up, 8 in 2024-09-10T18:10:48.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:48 smithi012 ceph-mon[92029]: pgmap v1011: 121 pgs: 121 active+clean; 172 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-09-10T18:10:48.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:48 smithi012 ceph-mon[92029]: osdmap e881: 8 total, 8 up, 8 in 2024-09-10T18:10:48.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:48 smithi012 ceph-mon[92029]: osdmap e882: 8 total, 8 up, 8 in 2024-09-10T18:10:48.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:48 smithi089 ceph-mon[84132]: pgmap v1011: 121 pgs: 121 active+clean; 172 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2024-09-10T18:10:48.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:48 smithi089 ceph-mon[84132]: osdmap e881: 8 total, 8 up, 8 in 2024-09-10T18:10:48.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:48 smithi089 ceph-mon[84132]: osdmap e882: 8 total, 8 up, 8 in 2024-09-10T18:10:48.855 INFO:tasks.rados.rados.0.smithi012.stdout:3971: done (1 left) 2024-09-10T18:10:48.856 INFO:tasks.rados.rados.0.smithi012.stdout:3972: read oid 42 snap 390 2024-09-10T18:10:48.856 INFO:tasks.rados.rados.0.smithi012.stdout:3972: expect deleted 2024-09-10T18:10:48.856 INFO:tasks.rados.rados.0.smithi012.stdout:3973: snap_remove snap 385 2024-09-10T18:10:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:3973: done (2 left) 2024-09-10T18:10:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 13 current snap is 396 2024-09-10T18:10:49.861 INFO:tasks.rados.rados.0.smithi012.stdout:3974: seq_num 1201 ranges {188416=524288,712704=401408} 2024-09-10T18:10:49.866 INFO:tasks.rados.rados.0.smithi012.stdout:3974: writing smithi01278544-13 from 188416 to 712704 tid 1 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:3974: writing smithi01278544-13 from 712704 to 1114112 tid 2 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:3970: finishing rollback tid 0 to smithi01278544-29 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:3970: finishing rollback tid 1 to smithi01278544-29 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:3970: finishing rollback tid 2 to smithi01278544-29 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 29 v 1151 (ObjNum 1141 snap 376 seq_num 1141) dirty exists 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:3970: done (2 left) 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:3972: done (1 left) 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 30 current snap is 396 2024-09-10T18:10:49.870 INFO:tasks.rados.rados.0.smithi012.stdout:3975: seq_num 1202 ranges {0=540672,540672=401408} 2024-09-10T18:10:49.873 INFO:tasks.rados.rados.0.smithi012.stdout:3975: writing smithi01278544-30 from 0 to 540672 tid 1 2024-09-10T18:10:49.876 INFO:tasks.rados.rados.0.smithi012.stdout:3975: writing smithi01278544-30 from 540672 to 942080 tid 2 2024-09-10T18:10:49.877 INFO:tasks.rados.rados.0.smithi012.stdout:3976: read oid 11 snap 394 2024-09-10T18:10:49.877 INFO:tasks.rados.rados.0.smithi012.stdout:3976: expect (ObjNum 1169 snap 384 seq_num 1169) 2024-09-10T18:10:49.877 INFO:tasks.rados.rados.0.smithi012.stdout:3977: delete oid 15 current snap is 396 2024-09-10T18:10:49.879 INFO:tasks.rados.rados.0.smithi012.stdout:3974: finishing write tid 1 to smithi01278544-13 2024-09-10T18:10:49.879 INFO:tasks.rados.rados.0.smithi012.stdout:3974: finishing write tid 2 to smithi01278544-13 2024-09-10T18:10:49.880 INFO:tasks.rados.rados.0.smithi012.stdout:3974: finishing write tid 3 to smithi01278544-13 2024-09-10T18:10:49.881 INFO:tasks.rados.rados.0.smithi012.stdout:3975: finishing write tid 1 to smithi01278544-30 2024-09-10T18:10:49.883 INFO:tasks.rados.rados.0.smithi012.stdout:3977: done (3 left) 2024-09-10T18:10:49.883 INFO:tasks.rados.rados.0.smithi012.stdout:3978: delete oid 29 current snap is 396 2024-09-10T18:10:49.883 INFO:tasks.rados.rados.0.smithi012.stdout:3974: finishing write tid 4 to smithi01278544-13 2024-09-10T18:10:49.883 INFO:tasks.rados.rados.0.smithi012.stdout:3974: oid 13 updating version 0 to 2526 2024-09-10T18:10:49.883 INFO:tasks.rados.rados.0.smithi012.stdout:3974: oid 13 updating version 2526 to 2528 2024-09-10T18:10:49.883 INFO:tasks.rados.rados.0.smithi012.stdout:3974: oid 13 version 2528 is already newer than 2527 2024-09-10T18:10:49.884 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 13 v 2528 (ObjNum 1201 snap 396 seq_num 1201) dirty exists 2024-09-10T18:10:49.884 INFO:tasks.rados.rados.0.smithi012.stdout:3974: left oid 13 (ObjNum 1201 snap 396 seq_num 1201) 2024-09-10T18:10:49.884 INFO:tasks.rados.rados.0.smithi012.stdout:3975: finishing write tid 2 to smithi01278544-30 2024-09-10T18:10:49.886 INFO:tasks.rados.rados.0.smithi012.stdout:3975: finishing write tid 3 to smithi01278544-30 2024-09-10T18:10:49.888 INFO:tasks.rados.rados.0.smithi012.stdout:3975: finishing write tid 4 to smithi01278544-30 2024-09-10T18:10:49.888 INFO:tasks.rados.rados.0.smithi012.stdout:3975: oid 30 updating version 0 to 2939 2024-09-10T18:10:49.888 INFO:tasks.rados.rados.0.smithi012.stdout:3975: oid 30 version 2939 is already newer than 2938 2024-09-10T18:10:49.888 INFO:tasks.rados.rados.0.smithi012.stdout:3975: oid 30 version 2939 is already newer than 2937 2024-09-10T18:10:49.888 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 30 v 2939 (ObjNum 1202 snap 396 seq_num 1202) dirty exists 2024-09-10T18:10:49.888 INFO:tasks.rados.rados.0.smithi012.stdout:3975: left oid 30 (ObjNum 1202 snap 396 seq_num 1202) 2024-09-10T18:10:49.889 INFO:tasks.rados.rados.0.smithi012.stdout:3974: done (3 left) 2024-09-10T18:10:49.889 INFO:tasks.rados.rados.0.smithi012.stdout:3975: done (2 left) 2024-09-10T18:10:49.889 INFO:tasks.rados.rados.0.smithi012.stdout:3978: done (1 left) 2024-09-10T18:10:49.889 INFO:tasks.rados.rados.0.smithi012.stdout:3979: delete oid 2 current snap is 396 2024-09-10T18:10:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:3979: done (1 left) 2024-09-10T18:10:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:3980: read oid 45 snap 394 2024-09-10T18:10:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:3980: expect (ObjNum 1184 snap 391 seq_num 1184) 2024-09-10T18:10:49.894 INFO:tasks.rados.rados.0.smithi012.stdout:3981: read oid 24 snap -1 2024-09-10T18:10:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:3981: expect (ObjNum 1168 snap 383 seq_num 1168) 2024-09-10T18:10:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:3982: read oid 32 snap -1 2024-09-10T18:10:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:3982: expect (ObjNum 1104 snap 354 seq_num 1104) 2024-09-10T18:10:49.895 INFO:tasks.rados.rados.0.smithi012.stdout:3983: snap_create 2024-09-10T18:10:49.903 INFO:tasks.rados.rados.0.smithi012.stdout:3976: expect (ObjNum 1169 snap 384 seq_num 1169) 2024-09-10T18:10:50.008 INFO:tasks.rados.rados.0.smithi012.stdout:3982: expect (ObjNum 1104 snap 354 seq_num 1104) 2024-09-10T18:10:50.053 INFO:tasks.rados.rados.0.smithi012.stdout:3981: expect (ObjNum 1168 snap 383 seq_num 1168) 2024-09-10T18:10:50.145 INFO:tasks.rados.rados.0.smithi012.stdout:3980: expect (ObjNum 1184 snap 391 seq_num 1184) 2024-09-10T18:10:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:49 smithi012 ceph-mon[89611]: osdmap e883: 8 total, 8 up, 8 in 2024-09-10T18:10:50.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:49 smithi012 ceph-mon[89611]: pgmap v1015: 121 pgs: 121 active+clean; 172 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T18:10:50.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:49 smithi012 ceph-mon[92029]: osdmap e883: 8 total, 8 up, 8 in 2024-09-10T18:10:50.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:49 smithi012 ceph-mon[92029]: pgmap v1015: 121 pgs: 121 active+clean; 172 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T18:10:50.285 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:10:49 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[102098]: 2024-09-10T18:10:49.881+0000 7f6059b00640 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 1c5 after trimming was started 2024-09-10T18:10:50.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:49 smithi089 ceph-mon[84132]: osdmap e883: 8 total, 8 up, 8 in 2024-09-10T18:10:50.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:49 smithi089 ceph-mon[84132]: pgmap v1015: 121 pgs: 121 active+clean; 172 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T18:10:50.865 INFO:tasks.rados.rados.0.smithi012.stdout:3976: done (4 left) 2024-09-10T18:10:50.865 INFO:tasks.rados.rados.0.smithi012.stdout:3980: done (3 left) 2024-09-10T18:10:50.865 INFO:tasks.rados.rados.0.smithi012.stdout:3981: done (2 left) 2024-09-10T18:10:50.865 INFO:tasks.rados.rados.0.smithi012.stdout:3982: done (1 left) 2024-09-10T18:10:50.865 INFO:tasks.rados.rados.0.smithi012.stdout:3983: done (0 left) 2024-09-10T18:10:50.865 INFO:tasks.rados.rados.0.smithi012.stdout:3984: snap_create 2024-09-10T18:10:51.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:50 smithi012 ceph-mon[89611]: osdmap e884: 8 total, 8 up, 8 in 2024-09-10T18:10:51.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:50 smithi012 ceph-mon[92029]: osdmap e884: 8 total, 8 up, 8 in 2024-09-10T18:10:51.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:50 smithi089 ceph-mon[84132]: osdmap e884: 8 total, 8 up, 8 in 2024-09-10T18:10:51.872 INFO:tasks.rados.rados.0.smithi012.stdout:3984: done (0 left) 2024-09-10T18:10:51.872 INFO:tasks.rados.rados.0.smithi012.stdout:3985: snap_remove snap 391 2024-09-10T18:10:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:51 smithi012 ceph-mon[89611]: osdmap e885: 8 total, 8 up, 8 in 2024-09-10T18:10:52.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:51 smithi012 ceph-mon[89611]: pgmap v1018: 121 pgs: 121 active+clean; 171 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 667 KiB/s wr, 17 op/s 2024-09-10T18:10:52.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:51 smithi012 ceph-mon[92029]: osdmap e885: 8 total, 8 up, 8 in 2024-09-10T18:10:52.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:51 smithi012 ceph-mon[92029]: pgmap v1018: 121 pgs: 121 active+clean; 171 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 667 KiB/s wr, 17 op/s 2024-09-10T18:10:52.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:51 smithi089 ceph-mon[84132]: osdmap e885: 8 total, 8 up, 8 in 2024-09-10T18:10:52.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:51 smithi089 ceph-mon[84132]: pgmap v1018: 121 pgs: 121 active+clean; 171 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.4 MiB/s rd, 667 KiB/s wr, 17 op/s 2024-09-10T18:10:52.854 INFO:tasks.rados.rados.0.smithi012.stdout:3985: done (0 left) 2024-09-10T18:10:52.854 INFO:tasks.rados.rados.0.smithi012.stdout:3986: copy_from oid 47 from oid 38 current snap is 398 2024-09-10T18:10:52.854 INFO:tasks.rados.rados.0.smithi012.stdout:3987: snap_create 2024-09-10T18:10:52.866 INFO:tasks.rados.rados.0.smithi012.stdout:3986: finishing copy_from to smithi01278544-47 2024-09-10T18:10:52.866 INFO:tasks.rados.rados.0.smithi012.stdout:3986: got expected ENOENT (src dne) 2024-09-10T18:10:52.866 INFO:tasks.rados.rados.0.smithi012.stdout:3986: finishing copy_from racing read to smithi01278544-47 2024-09-10T18:10:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:52 smithi012 ceph-mon[89611]: osdmap e886: 8 total, 8 up, 8 in 2024-09-10T18:10:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:52 smithi012 ceph-mon[89611]: osdmap e887: 8 total, 8 up, 8 in 2024-09-10T18:10:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:52 smithi012 ceph-mon[92029]: osdmap e886: 8 total, 8 up, 8 in 2024-09-10T18:10:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:52 smithi012 ceph-mon[92029]: osdmap e887: 8 total, 8 up, 8 in 2024-09-10T18:10:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:52 smithi089 ceph-mon[84132]: osdmap e886: 8 total, 8 up, 8 in 2024-09-10T18:10:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:52 smithi089 ceph-mon[84132]: osdmap e887: 8 total, 8 up, 8 in 2024-09-10T18:10:53.856 INFO:tasks.rados.rados.0.smithi012.stdout:3986: done (1 left) 2024-09-10T18:10:53.856 INFO:tasks.rados.rados.0.smithi012.stdout:3987: done (0 left) 2024-09-10T18:10:53.856 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 15 current snap is 399 2024-09-10T18:10:53.856 INFO:tasks.rados.rados.0.smithi012.stdout:3988: seq_num 1206 ranges {0=606208,606208=401408} 2024-09-10T18:10:53.858 INFO:tasks.rados.rados.0.smithi012.stdout:3988: writing smithi01278544-15 from 0 to 606208 tid 1 2024-09-10T18:10:53.861 INFO:tasks.rados.rados.0.smithi012.stdout:3988: writing smithi01278544-15 from 606208 to 1007616 tid 2 2024-09-10T18:10:53.861 INFO:tasks.rados.rados.0.smithi012.stdout:3989: rmattr oid 29 current snap is 399 2024-09-10T18:10:53.861 INFO:tasks.rados.rados.0.smithi012.stdout:3989: done (1 left) 2024-09-10T18:10:53.861 INFO:tasks.rados.rados.0.smithi012.stdout:3990: read oid 43 snap 396 2024-09-10T18:10:53.861 INFO:tasks.rados.rados.0.smithi012.stdout:3990: expect (ObjNum 1188 snap 394 seq_num 1188) 2024-09-10T18:10:53.862 INFO:tasks.rados.rados.0.smithi012.stdout:append oid 40 current snap is 399 2024-09-10T18:10:53.862 INFO:tasks.rados.rados.0.smithi012.stdout:3991: seq_num 1207 ranges {0=622592,622592=401408} 2024-09-10T18:10:53.865 INFO:tasks.rados.rados.0.smithi012.stdout:3991: writing smithi01278544-40 from 0 to 622592 tid 1 2024-09-10T18:10:53.867 INFO:tasks.rados.rados.0.smithi012.stdout:3991: writing smithi01278544-40 from 622592 to 1024000 tid 2 2024-09-10T18:10:53.868 INFO:tasks.rados.rados.0.smithi012.stdout:3992: copy_from oid 5 from oid 48 current snap is 399 2024-09-10T18:10:53.868 INFO:tasks.rados.rados.0.smithi012.stdout:3993: snap_remove snap 390 2024-09-10T18:10:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:53 smithi012 ceph-mon[89611]: pgmap v1021: 121 pgs: 121 active+clean; 171 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-09-10T18:10:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:53 smithi012 ceph-mon[89611]: osdmap e888: 8 total, 8 up, 8 in 2024-09-10T18:10:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:53 smithi012 ceph-mon[92029]: pgmap v1021: 121 pgs: 121 active+clean; 171 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-09-10T18:10:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:53 smithi012 ceph-mon[92029]: osdmap e888: 8 total, 8 up, 8 in 2024-09-10T18:10:54.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:53 smithi089 ceph-mon[84132]: pgmap v1021: 121 pgs: 121 active+clean; 171 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-09-10T18:10:54.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:53 smithi089 ceph-mon[84132]: osdmap e888: 8 total, 8 up, 8 in 2024-09-10T18:10:54.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:10:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:10:54] "GET /metrics HTTP/1.1" 200 36357 "" "Prometheus/2.51.0" 2024-09-10T18:10:54.861 INFO:tasks.rados.rados.0.smithi012.stdout:3988: finishing write tid 1 to smithi01278544-15 2024-09-10T18:10:54.861 INFO:tasks.rados.rados.0.smithi012.stdout:3988: finishing write tid 2 to smithi01278544-15 2024-09-10T18:10:54.861 INFO:tasks.rados.rados.0.smithi012.stdout:3988: finishing write tid 3 to smithi01278544-15 2024-09-10T18:10:54.861 INFO:tasks.rados.rados.0.smithi012.stdout:3988: finishing write tid 4 to smithi01278544-15 2024-09-10T18:10:54.861 INFO:tasks.rados.rados.0.smithi012.stdout:3988: oid 15 updating version 0 to 2797 2024-09-10T18:10:54.862 INFO:tasks.rados.rados.0.smithi012.stdout:3988: oid 15 version 2797 is already newer than 2795 2024-09-10T18:10:54.862 INFO:tasks.rados.rados.0.smithi012.stdout:3988: oid 15 version 2797 is already newer than 2796 2024-09-10T18:10:54.862 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 15 v 2797 (ObjNum 1206 snap 399 seq_num 1206) dirty exists 2024-09-10T18:10:54.862 INFO:tasks.rados.rados.0.smithi012.stdout:3988: left oid 15 (ObjNum 1206 snap 399 seq_num 1206) 2024-09-10T18:10:54.862 INFO:tasks.rados.rados.0.smithi012.stdout:3992: finishing copy_from racing read to smithi01278544-5 2024-09-10T18:10:54.862 INFO:tasks.rados.rados.0.smithi012.stdout:3992: finishing copy_from to smithi01278544-5 2024-09-10T18:10:54.862 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 5 v 2341 (ObjNum 1196 snap 394 seq_num 1196) dirty exists 2024-09-10T18:10:54.862 INFO:tasks.rados.rados.0.smithi012.stdout:3990: expect (ObjNum 1188 snap 394 seq_num 1188) 2024-09-10T18:10:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:55 smithi012 ceph-mon[89611]: osdmap e889: 8 total, 8 up, 8 in 2024-09-10T18:10:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:55 smithi012 ceph-mon[89611]: pgmap v1024: 121 pgs: 121 active+clean; 175 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2024-09-10T18:10:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:55 smithi012 ceph-mon[92029]: osdmap e889: 8 total, 8 up, 8 in 2024-09-10T18:10:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:55 smithi012 ceph-mon[92029]: pgmap v1024: 121 pgs: 121 active+clean; 175 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2024-09-10T18:10:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:55 smithi089 ceph-mon[84132]: osdmap e889: 8 total, 8 up, 8 in 2024-09-10T18:10:56.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:55 smithi089 ceph-mon[84132]: pgmap v1024: 121 pgs: 121 active+clean; 175 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2024-09-10T18:10:57.231 INFO:tasks.rados.rados.0.smithi012.stdout:3991: finishing write tid 1 to smithi01278544-40 2024-09-10T18:10:57.231 INFO:tasks.rados.rados.0.smithi012.stdout:3991: finishing write tid 2 to smithi01278544-40 2024-09-10T18:10:57.231 INFO:tasks.rados.rados.0.smithi012.stdout:3988: done (4 left) 2024-09-10T18:10:57.231 INFO:tasks.rados.rados.0.smithi012.stdout:3990: done (3 left) 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3992: done (2 left) 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3993: done (1 left) 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3994: rollback oid 18 current snap is 399 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:rollback oid 18 to 397 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3991: finishing write tid 3 to smithi01278544-40 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3991: finishing write tid 4 to smithi01278544-40 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3991: oid 40 updating version 0 to 2791 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3991: oid 40 updating version 2791 to 2792 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3991: oid 40 version 2792 is already newer than 2790 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 40 v 2792 (ObjNum 1207 snap 399 seq_num 1207) dirty exists 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3991: left oid 40 (ObjNum 1207 snap 399 seq_num 1207) 2024-09-10T18:10:57.232 INFO:tasks.rados.rados.0.smithi012.stdout:3991: done (1 left) 2024-09-10T18:10:57.233 INFO:tasks.rados.rados.0.smithi012.stdout:3995: rmattr oid 25 current snap is 399 2024-09-10T18:10:57.233 INFO:tasks.rados.rados.0.smithi012.stdout:3995: done (1 left) 2024-09-10T18:10:57.233 INFO:tasks.rados.rados.0.smithi012.stdout:3996: snap_remove snap 398 2024-09-10T18:10:57.856 INFO:tasks.rados.rados.0.smithi012.stdout:3996: done (1 left) 2024-09-10T18:10:57.856 INFO:tasks.rados.rados.0.smithi012.stdout:3997: snap_remove snap 394 2024-09-10T18:10:58.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:58 smithi012 ceph-mon[89611]: pgmap v1025: 121 pgs: 121 active+clean; 135 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-09-10T18:10:58.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:58 smithi012 ceph-mon[89611]: osdmap e890: 8 total, 8 up, 8 in 2024-09-10T18:10:58.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:58 smithi012 ceph-mon[92029]: pgmap v1025: 121 pgs: 121 active+clean; 135 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-09-10T18:10:58.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:58 smithi012 ceph-mon[92029]: osdmap e890: 8 total, 8 up, 8 in 2024-09-10T18:10:58.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:58 smithi089 ceph-mon[84132]: pgmap v1025: 121 pgs: 121 active+clean; 135 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-09-10T18:10:58.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:58 smithi089 ceph-mon[84132]: osdmap e890: 8 total, 8 up, 8 in 2024-09-10T18:10:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:3997: done (1 left) 2024-09-10T18:10:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:3998: delete oid 38 current snap is 399 2024-09-10T18:10:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:3994: finishing rollback tid 0 to smithi01278544-18 2024-09-10T18:10:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:3994: finishing rollback tid 1 to smithi01278544-18 2024-09-10T18:10:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:3994: finishing rollback tid 2 to smithi01278544-18 2024-09-10T18:10:58.858 INFO:tasks.rados.rados.0.smithi012.stdout:update_object_version oid 18 v 2800 (ObjNum 1199 snap 395 seq_num 1199) dirty exists 2024-09-10T18:10:58.864 INFO:tasks.rados.rados.0.smithi012.stdout:3994: done (1 left) 2024-09-10T18:10:58.864 INFO:tasks.rados.rados.0.smithi012.stdout:3998: done (0 left) 2024-09-10T18:10:58.864 INFO:tasks.rados.rados.0.smithi012.stdout:3999: read oid 35 snap 396 2024-09-10T18:10:58.864 INFO:tasks.rados.rados.0.smithi012.stdout:3999: expect deleted 2024-09-10T18:10:58.864 INFO:tasks.rados.rados.0.smithi012.stdout: waiting on 1 2024-09-10T18:10:58.864 INFO:tasks.rados.rados.0.smithi012.stdout:3999: done (0 left) 2024-09-10T18:10:58.869 INFO:tasks.rados.rados.0.smithi012.stderr:0 errors. 2024-09-10T18:10:58.869 INFO:tasks.rados.rados.0.smithi012.stderr: 2024-09-10T18:10:58.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T18:10:59.088 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:11:00.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:59 smithi012 ceph-mon[89611]: osdmap e891: 8 total, 8 up, 8 in 2024-09-10T18:11:00.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:10:59 smithi012 ceph-mon[89611]: pgmap v1028: 121 pgs: 121 active+clean; 134 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.5 MiB/s rd, 1012 KiB/s wr, 2 op/s 2024-09-10T18:11:00.281 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:59 smithi012 ceph-mon[92029]: osdmap e891: 8 total, 8 up, 8 in 2024-09-10T18:11:00.281 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:10:59 smithi012 ceph-mon[92029]: pgmap v1028: 121 pgs: 121 active+clean; 134 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.5 MiB/s rd, 1012 KiB/s wr, 2 op/s 2024-09-10T18:11:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:59 smithi089 ceph-mon[84132]: osdmap e891: 8 total, 8 up, 8 in 2024-09-10T18:11:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:10:59 smithi089 ceph-mon[84132]: pgmap v1028: 121 pgs: 121 active+clean; 134 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 8.5 MiB/s rd, 1012 KiB/s wr, 2 op/s 2024-09-10T18:11:00.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T18:11:00.998 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":891,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T18:10:58.849514+0000","last_up_change":"2024-09-10T18:04:20.839976+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T17:52:35.123712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T17:52:38.563420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-09-10T17:53:44.896711+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":74,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_0","create_time":"2024-09-10T17:56:30.666232+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"891","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":466,"snap_epoch":891,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":286,"up_from":300,"up_thru":529,"down_at":287,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1262065593},{"type":"v1","addr":"172.21.15.12:6803","nonce":1262065593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1262065593},{"type":"v1","addr":"172.21.15.12:6805","nonce":1262065593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1262065593},{"type":"v1","addr":"172.21.15.12:6809","nonce":1262065593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1262065593},{"type":"v1","addr":"172.21.15.12:6807","nonce":1262065593}]},"public_addr":"172.21.15.12:6803/1262065593","cluster_addr":"172.21.15.12:6805/1262065593","heartbeat_back_addr":"172.21.15.12:6809/1262065593","heartbeat_front_addr":"172.21.15.12:6807/1262065593","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":319,"up_from":332,"up_thru":529,"down_at":320,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1400604299},{"type":"v1","addr":"172.21.15.12:6811","nonce":1400604299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1400604299},{"type":"v1","addr":"172.21.15.12:6813","nonce":1400604299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1400604299},{"type":"v1","addr":"172.21.15.12:6817","nonce":1400604299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1400604299},{"type":"v1","addr":"172.21.15.12:6815","nonce":1400604299}]},"public_addr":"172.21.15.12:6811/1400604299","cluster_addr":"172.21.15.12:6813/1400604299","heartbeat_back_addr":"172.21.15.12:6817/1400604299","heartbeat_front_addr":"172.21.15.12:6815/1400604299","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":353,"up_from":367,"up_thru":529,"down_at":354,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1808679130},{"type":"v1","addr":"172.21.15.12:6819","nonce":1808679130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1808679130},{"type":"v1","addr":"172.21.15.12:6821","nonce":1808679130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1808679130},{"type":"v1","addr":"172.21.15.12:6825","nonce":1808679130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1808679130},{"type":"v1","addr":"172.21.15.12:6823","nonce":1808679130}]},"public_addr":"172.21.15.12:6819/1808679130","cluster_addr":"172.21.15.12:6821/1808679130","heartbeat_back_addr":"172.21.15.12:6825/1808679130","heartbeat_front_addr":"172.21.15.12:6823/1808679130","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":387,"up_from":400,"up_thru":529,"down_at":388,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":74911827},{"type":"v1","addr":"172.21.15.12:6827","nonce":74911827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":74911827},{"type":"v1","addr":"172.21.15.12:6829","nonce":74911827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":74911827},{"type":"v1","addr":"172.21.15.12:6833","nonce":74911827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":74911827},{"type":"v1","addr":"172.21.15.12:6831","nonce":74911827}]},"public_addr":"172.21.15.12:6827/74911827","cluster_addr":"172.21.15.12:6829/74911827","heartbeat_back_addr":"172.21.15.12:6833/74911827","heartbeat_front_addr":"172.21.15.12:6831/74911827","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":420,"up_from":434,"up_thru":529,"down_at":421,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2682567246},{"type":"v1","addr":"172.21.15.89:6801","nonce":2682567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2682567246},{"type":"v1","addr":"172.21.15.89:6803","nonce":2682567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2682567246},{"type":"v1","addr":"172.21.15.89:6807","nonce":2682567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2682567246},{"type":"v1","addr":"172.21.15.89:6805","nonce":2682567246}]},"public_addr":"172.21.15.89:6801/2682567246","cluster_addr":"172.21.15.89:6803/2682567246","heartbeat_back_addr":"172.21.15.89:6807/2682567246","heartbeat_front_addr":"172.21.15.89:6805/2682567246","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":452,"up_from":466,"up_thru":529,"down_at":453,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2898627055},{"type":"v1","addr":"172.21.15.89:6809","nonce":2898627055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2898627055},{"type":"v1","addr":"172.21.15.89:6811","nonce":2898627055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2898627055},{"type":"v1","addr":"172.21.15.89:6815","nonce":2898627055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2898627055},{"type":"v1","addr":"172.21.15.89:6813","nonce":2898627055}]},"public_addr":"172.21.15.89:6809/2898627055","cluster_addr":"172.21.15.89:6811/2898627055","heartbeat_back_addr":"172.21.15.89:6815/2898627055","heartbeat_front_addr":"172.21.15.89:6813/2898627055","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":46,"last_clean_end":486,"up_from":498,"up_thru":529,"down_at":487,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":730345999},{"type":"v1","addr":"172.21.15.89:6817","nonce":730345999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":730345999},{"type":"v1","addr":"172.21.15.89:6819","nonce":730345999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":730345999},{"type":"v1","addr":"172.21.15.89:6823","nonce":730345999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":730345999},{"type":"v1","addr":"172.21.15.89:6821","nonce":730345999}]},"public_addr":"172.21.15.89:6817/730345999","cluster_addr":"172.21.15.89:6819/730345999","heartbeat_back_addr":"172.21.15.89:6823/730345999","heartbeat_front_addr":"172.21.15.89:6821/730345999","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":54,"last_clean_end":516,"up_from":529,"up_thru":529,"down_at":517,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":476453873},{"type":"v1","addr":"172.21.15.89:6825","nonce":476453873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":476453873},{"type":"v1","addr":"172.21.15.89:6827","nonce":476453873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":476453873},{"type":"v1","addr":"172.21.15.89:6831","nonce":476453873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":476453873},{"type":"v1","addr":"172.21.15.89:6829","nonce":476453873}]},"public_addr":"172.21.15.89:6825/476453873","cluster_addr":"172.21.15.89:6827/476453873","heartbeat_back_addr":"172.21.15.89:6831/476453873","heartbeat_front_addr":"172.21.15.89:6829/476453873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":286},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":319},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":353},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":387},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":420},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":452},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":486},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":516}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6833/3197689939":"2024-09-11T18:04:40.962564+0000","172.21.15.89:0/1887654905":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/3454597613":"2024-09-11T17:57:47.934302+0000","172.21.15.12:6800/2938079971":"2024-09-11T17:57:47.934302+0000","172.21.15.12:0/1190692835":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/270930125":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/2072251878":"2024-09-11T17:57:47.934302+0000","172.21.15.12:0/2776327378":"2024-09-11T17:57:47.934302+0000","172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/2177785153":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1590054246":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/1927024573":"2024-09-11T17:57:47.934302+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/89737520":"2024-09-11T17:59:00.959618+0000","172.21.15.89:0/1794147058":"2024-09-11T17:58:18.794440+0000","172.21.15.89:0/761725011":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:6801/2938079971":"2024-09-11T17:57:47.934302+0000","172.21.15.89:0/2591871814":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/4039283761":"2024-09-11T17:57:47.934302+0000","172.21.15.12:0/3394020603":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/1331323785":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/4040448008":"2024-09-11T17:53:42.652060+0000","172.21.15.89:6834/3612163982":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/2654768069":"2024-09-11T17:59:00.959618+0000","172.21.15.89:6835/3612163982":"2024-09-11T17:58:18.794440+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:6800/4225839466":"2024-09-11T17:59:00.959618+0000","172.21.15.12:6801/4225839466":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.89:6832/3197689939":"2024-09-11T18:04:40.962564+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/135454569":"2024-09-11T17:53:42.652060+0000","172.21.15.89:0/1147431406":"2024-09-11T17:58:18.794440+0000","172.21.15.89:0/2540225892":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.89:0/2793592953":"2024-09-11T17:58:18.794440+0000","172.21.15.12:6801/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6800/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:0/3881499084":"2024-09-11T17:53:42.652060+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":458,"length":1},{"begin":462,"length":1},{"begin":466,"length":1}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":462,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T18:11:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:01 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2871718326' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T18:11:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:01 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2871718326' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T18:11:01.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:01 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2871718326' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T18:11:01.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T18:11:01.847 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:11:02.222 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:02 smithi012 ceph-mon[89611]: pgmap v1029: 121 pgs: 121 active+clean; 126 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.2 MiB/s rd, 852 KiB/s wr, 2 op/s 2024-09-10T18:11:02.223 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:02.223 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:02 smithi012 ceph-mon[92029]: pgmap v1029: 121 pgs: 121 active+clean; 126 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.2 MiB/s rd, 852 KiB/s wr, 2 op/s 2024-09-10T18:11:02.223 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:02.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:02 smithi089 ceph-mon[84132]: pgmap v1029: 121 pgs: 121 active+clean; 126 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.2 MiB/s rd, 852 KiB/s wr, 2 op/s 2024-09-10T18:11:02.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:03.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T18:11:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T18:11:04.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:03 smithi012 ceph-mon[89611]: osdmap e892: 8 total, 8 up, 8 in 2024-09-10T18:11:04.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:03 smithi012 ceph-mon[89611]: pgmap v1031: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:04.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:03 smithi012 ceph-mon[89611]: from='client.34665 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T18:11:04.227 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:03 smithi012 ceph-mon[92029]: osdmap e892: 8 total, 8 up, 8 in 2024-09-10T18:11:04.227 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:03 smithi012 ceph-mon[92029]: pgmap v1031: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:04.227 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:03 smithi012 ceph-mon[92029]: from='client.34665 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T18:11:04.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:03 smithi089 ceph-mon[84132]: osdmap e892: 8 total, 8 up, 8 in 2024-09-10T18:11:04.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:03 smithi089 ceph-mon[84132]: pgmap v1031: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:04.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:03 smithi089 ceph-mon[84132]: from='client.34665 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T18:11:04.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:11:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:11:04] "GET /metrics HTTP/1.1" 200 36352 "" "Prometheus/2.51.0" 2024-09-10T18:11:04.562 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":1031,"stamp":"2024-09-10T18:11:03.146377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129784847,"num_objects":72,"num_object_clones":3,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":4916,"num_read_kb":6811676,"num_write":9087,"num_write_kb":1818982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":459974240,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20481,"ondisk_log_size":20481,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":4229264,"kb_used_data":298280,"kb_used_omap":249,"kb_used_meta":3930630,"kb_avail":745731952,"statfs":{"total":767960285184,"available":763629518848,"internally_reserved":0,"allocated":305438720,"data_stored":261295747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":255727,"internal_metadata":4024965393},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11362304,"num_objects":-19,"num_object_clones":-15,"num_object_copies":-57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":-4,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001523"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1202,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184444+0000","last_change":"2024-09-10T18:04:21.874851+0000","last_active":"2024-09-10T18:10:59.184444+0000","last_peered":"2024-09-10T18:10:59.184444+0000","last_clean":"2024-09-10T18:10:59.184444+0000","last_became_active":"2024-09-10T18:04:21.874138+0000","last_became_peered":"2024-09-10T18:04:21.874138+0000","last_unstale":"2024-09-10T18:10:59.184444+0000","last_undegraded":"2024-09-10T18:10:59.184444+0000","last_fullsized":"2024-09-10T18:10:59.184444+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:46.185338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1402,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.858995+0000","last_change":"2024-09-10T18:03:48.907787+0000","last_active":"2024-09-10T18:10:58.858995+0000","last_peered":"2024-09-10T18:10:58.858995+0000","last_clean":"2024-09-10T18:10:58.858995+0000","last_became_active":"2024-09-10T18:03:48.907416+0000","last_became_peered":"2024-09-10T18:03:48.907416+0000","last_unstale":"2024-09-10T18:10:58.858995+0000","last_undegraded":"2024-09-10T18:10:58.858995+0000","last_fullsized":"2024-09-10T18:10:58.858995+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:59.688957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1429,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.853865+0000","last_change":"2024-09-10T18:01:33.030917+0000","last_active":"2024-09-10T18:10:57.853865+0000","last_peered":"2024-09-10T18:10:57.853865+0000","last_clean":"2024-09-10T18:10:57.853865+0000","last_became_active":"2024-09-10T18:01:33.030596+0000","last_became_peered":"2024-09-10T18:01:33.030596+0000","last_unstale":"2024-09-10T18:10:57.853865+0000","last_undegraded":"2024-09-10T18:10:57.853865+0000","last_fullsized":"2024-09-10T18:10:57.853865+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:56.348432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1273,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865454+0000","last_change":"2024-09-10T18:04:21.857293+0000","last_active":"2024-09-10T18:10:58.865454+0000","last_peered":"2024-09-10T18:10:58.865454+0000","last_clean":"2024-09-10T18:10:58.865454+0000","last_became_active":"2024-09-10T18:04:21.856999+0000","last_became_peered":"2024-09-10T18:04:21.856999+0000","last_unstale":"2024-09-10T18:10:58.865454+0000","last_undegraded":"2024-09-10T18:10:58.865454+0000","last_fullsized":"2024-09-10T18:10:58.865454+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:33.508827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1179,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184021+0000","last_change":"2024-09-10T18:04:21.869420+0000","last_active":"2024-09-10T18:10:59.184021+0000","last_peered":"2024-09-10T18:10:59.184021+0000","last_clean":"2024-09-10T18:10:59.184021+0000","last_became_active":"2024-09-10T18:04:21.867717+0000","last_became_peered":"2024-09-10T18:04:21.867717+0000","last_unstale":"2024-09-10T18:10:59.184021+0000","last_undegraded":"2024-09-10T18:10:59.184021+0000","last_fullsized":"2024-09-10T18:10:59.184021+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:13.784262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1249,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865414+0000","last_change":"2024-09-10T18:03:13.802906+0000","last_active":"2024-09-10T18:10:58.865414+0000","last_peered":"2024-09-10T18:10:58.865414+0000","last_clean":"2024-09-10T18:10:58.865414+0000","last_became_active":"2024-09-10T18:03:13.802077+0000","last_became_peered":"2024-09-10T18:03:13.802077+0000","last_unstale":"2024-09-10T18:10:58.865414+0000","last_undegraded":"2024-09-10T18:10:58.865414+0000","last_fullsized":"2024-09-10T18:10:58.865414+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:50.185813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1194,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183784+0000","last_change":"2024-09-10T18:04:21.873637+0000","last_active":"2024-09-10T18:10:59.183784+0000","last_peered":"2024-09-10T18:10:59.183784+0000","last_clean":"2024-09-10T18:10:59.183784+0000","last_became_active":"2024-09-10T18:04:21.872074+0000","last_became_peered":"2024-09-10T18:04:21.872074+0000","last_unstale":"2024-09-10T18:10:59.183784+0000","last_undegraded":"2024-09-10T18:10:59.183784+0000","last_fullsized":"2024-09-10T18:10:59.183784+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:10.287447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1308,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864473+0000","last_change":"2024-09-10T18:03:48.897943+0000","last_active":"2024-09-10T18:10:57.864473+0000","last_peered":"2024-09-10T18:10:57.864473+0000","last_clean":"2024-09-10T18:10:57.864473+0000","last_became_active":"2024-09-10T18:03:48.897629+0000","last_became_peered":"2024-09-10T18:03:48.897629+0000","last_unstale":"2024-09-10T18:10:57.864473+0000","last_undegraded":"2024-09-10T18:10:57.864473+0000","last_fullsized":"2024-09-10T18:10:57.864473+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:58.139136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1210,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184307+0000","last_change":"2024-09-10T18:04:21.876827+0000","last_active":"2024-09-10T18:10:59.184307+0000","last_peered":"2024-09-10T18:10:59.184307+0000","last_clean":"2024-09-10T18:10:59.184307+0000","last_became_active":"2024-09-10T18:04:21.876505+0000","last_became_peered":"2024-09-10T18:04:21.876505+0000","last_unstale":"2024-09-10T18:10:59.184307+0000","last_undegraded":"2024-09-10T18:10:59.184307+0000","last_fullsized":"2024-09-10T18:10:59.184307+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:43.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1235,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.863039+0000","last_change":"2024-09-10T18:03:48.911307+0000","last_active":"2024-09-10T18:10:58.863039+0000","last_peered":"2024-09-10T18:10:58.863039+0000","last_clean":"2024-09-10T18:10:58.863039+0000","last_became_active":"2024-09-10T18:03:48.910747+0000","last_became_peered":"2024-09-10T18:03:48.910747+0000","last_unstale":"2024-09-10T18:10:58.863039+0000","last_undegraded":"2024-09-10T18:10:58.863039+0000","last_fullsized":"2024-09-10T18:10:58.863039+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:19.538271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1235,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862554+0000","last_change":"2024-09-10T18:03:48.903803+0000","last_active":"2024-09-10T18:10:58.862554+0000","last_peered":"2024-09-10T18:10:58.862554+0000","last_clean":"2024-09-10T18:10:58.862554+0000","last_became_active":"2024-09-10T18:03:48.896108+0000","last_became_peered":"2024-09-10T18:03:48.896108+0000","last_unstale":"2024-09-10T18:10:58.862554+0000","last_undegraded":"2024-09-10T18:10:58.862554+0000","last_fullsized":"2024-09-10T18:10:58.862554+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:15.407374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1369,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183168+0000","last_change":"2024-09-10T18:03:48.897997+0000","last_active":"2024-09-10T18:10:59.183168+0000","last_peered":"2024-09-10T18:10:59.183168+0000","last_clean":"2024-09-10T18:10:59.183168+0000","last_became_active":"2024-09-10T18:03:48.897405+0000","last_became_peered":"2024-09-10T18:03:48.897405+0000","last_unstale":"2024-09-10T18:10:59.183168+0000","last_undegraded":"2024-09-10T18:10:59.183168+0000","last_fullsized":"2024-09-10T18:10:59.183168+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:40.374322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1335,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864518+0000","last_change":"2024-09-10T18:03:48.893422+0000","last_active":"2024-09-10T18:10:57.864518+0000","last_peered":"2024-09-10T18:10:57.864518+0000","last_clean":"2024-09-10T18:10:57.864518+0000","last_became_active":"2024-09-10T18:03:48.892615+0000","last_became_peered":"2024-09-10T18:03:48.892615+0000","last_unstale":"2024-09-10T18:10:57.864518+0000","last_undegraded":"2024-09-10T18:10:57.864518+0000","last_fullsized":"2024-09-10T18:10:57.864518+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:44.647819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1428,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.852545+0000","last_change":"2024-09-10T18:03:13.788567+0000","last_active":"2024-09-10T18:10:57.852545+0000","last_peered":"2024-09-10T18:10:57.852545+0000","last_clean":"2024-09-10T18:10:57.852545+0000","last_became_active":"2024-09-10T18:03:13.788275+0000","last_became_peered":"2024-09-10T18:03:13.788275+0000","last_unstale":"2024-09-10T18:10:57.852545+0000","last_undegraded":"2024-09-10T18:10:57.852545+0000","last_fullsized":"2024-09-10T18:10:57.852545+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:39.595928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1407,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859640+0000","last_change":"2024-09-10T18:03:13.785061+0000","last_active":"2024-09-10T18:10:58.859640+0000","last_peered":"2024-09-10T18:10:58.859640+0000","last_clean":"2024-09-10T18:10:58.859640+0000","last_became_active":"2024-09-10T18:03:13.784739+0000","last_became_peered":"2024-09-10T18:03:13.784739+0000","last_unstale":"2024-09-10T18:10:58.859640+0000","last_undegraded":"2024-09-10T18:10:58.859640+0000","last_fullsized":"2024-09-10T18:10:58.859640+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:33.730114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1254,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.864635+0000","last_change":"2024-09-10T18:04:21.868132+0000","last_active":"2024-09-10T18:10:58.864635+0000","last_peered":"2024-09-10T18:10:58.864635+0000","last_clean":"2024-09-10T18:10:58.864635+0000","last_became_active":"2024-09-10T18:04:21.867810+0000","last_became_peered":"2024-09-10T18:04:21.867810+0000","last_unstale":"2024-09-10T18:10:58.864635+0000","last_undegraded":"2024-09-10T18:10:58.864635+0000","last_fullsized":"2024-09-10T18:10:58.864635+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:59:54.782169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1264,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865706+0000","last_change":"2024-09-10T18:04:21.869078+0000","last_active":"2024-09-10T18:10:58.865706+0000","last_peered":"2024-09-10T18:10:58.865706+0000","last_clean":"2024-09-10T18:10:58.865706+0000","last_became_active":"2024-09-10T18:04:21.868808+0000","last_became_peered":"2024-09-10T18:04:21.868808+0000","last_unstale":"2024-09-10T18:10:58.865706+0000","last_undegraded":"2024-09-10T18:10:58.865706+0000","last_fullsized":"2024-09-10T18:10:58.865706+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:39:16.499188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1377,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183662+0000","last_change":"2024-09-10T18:04:21.873456+0000","last_active":"2024-09-10T18:10:59.183662+0000","last_peered":"2024-09-10T18:10:59.183662+0000","last_clean":"2024-09-10T18:10:59.183662+0000","last_became_active":"2024-09-10T18:04:21.871555+0000","last_became_peered":"2024-09-10T18:04:21.871555+0000","last_unstale":"2024-09-10T18:10:59.183662+0000","last_undegraded":"2024-09-10T18:10:59.183662+0000","last_fullsized":"2024-09-10T18:10:59.183662+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:32:38.091923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1200,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184211+0000","last_change":"2024-09-10T18:04:21.879323+0000","last_active":"2024-09-10T18:10:59.184211+0000","last_peered":"2024-09-10T18:10:59.184211+0000","last_clean":"2024-09-10T18:10:59.184211+0000","last_became_active":"2024-09-10T18:04:21.877636+0000","last_became_peered":"2024-09-10T18:04:21.877636+0000","last_unstale":"2024-09-10T18:10:59.184211+0000","last_undegraded":"2024-09-10T18:10:59.184211+0000","last_fullsized":"2024-09-10T18:10:59.184211+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:38.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1245,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862431+0000","last_change":"2024-09-10T18:03:48.904747+0000","last_active":"2024-09-10T18:10:58.862431+0000","last_peered":"2024-09-10T18:10:58.862431+0000","last_clean":"2024-09-10T18:10:58.862431+0000","last_became_active":"2024-09-10T18:03:48.903899+0000","last_became_peered":"2024-09-10T18:03:48.903899+0000","last_unstale":"2024-09-10T18:10:58.862431+0000","last_undegraded":"2024-09-10T18:10:58.862431+0000","last_fullsized":"2024-09-10T18:10:58.862431+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:42.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1428,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.853401+0000","last_change":"2024-09-10T18:04:21.872827+0000","last_active":"2024-09-10T18:10:57.853401+0000","last_peered":"2024-09-10T18:10:57.853401+0000","last_clean":"2024-09-10T18:10:57.853401+0000","last_became_active":"2024-09-10T18:04:21.872155+0000","last_became_peered":"2024-09-10T18:04:21.872155+0000","last_unstale":"2024-09-10T18:10:57.853401+0000","last_undegraded":"2024-09-10T18:10:57.853401+0000","last_fullsized":"2024-09-10T18:10:57.853401+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:51.460666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1259,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865246+0000","last_change":"2024-09-10T18:04:21.858014+0000","last_active":"2024-09-10T18:10:58.865246+0000","last_peered":"2024-09-10T18:10:58.865246+0000","last_clean":"2024-09-10T18:10:58.865246+0000","last_became_active":"2024-09-10T18:04:21.857686+0000","last_became_peered":"2024-09-10T18:04:21.857686+0000","last_unstale":"2024-09-10T18:10:58.865246+0000","last_undegraded":"2024-09-10T18:10:58.865246+0000","last_fullsized":"2024-09-10T18:10:58.865246+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:05.954395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1335,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864626+0000","last_change":"2024-09-10T18:02:39.802180+0000","last_active":"2024-09-10T18:10:57.864626+0000","last_peered":"2024-09-10T18:10:57.864626+0000","last_clean":"2024-09-10T18:10:57.864626+0000","last_became_active":"2024-09-10T18:02:39.801835+0000","last_became_peered":"2024-09-10T18:02:39.801835+0000","last_unstale":"2024-09-10T18:10:57.864626+0000","last_undegraded":"2024-09-10T18:10:57.864626+0000","last_fullsized":"2024-09-10T18:10:57.864626+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:38.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1276,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.864864+0000","last_change":"2024-09-10T18:03:13.792594+0000","last_active":"2024-09-10T18:10:58.864864+0000","last_peered":"2024-09-10T18:10:58.864864+0000","last_clean":"2024-09-10T18:10:58.864864+0000","last_became_active":"2024-09-10T18:03:13.792306+0000","last_became_peered":"2024-09-10T18:03:13.792306+0000","last_unstale":"2024-09-10T18:10:58.864864+0000","last_undegraded":"2024-09-10T18:10:58.864864+0000","last_fullsized":"2024-09-10T18:10:58.864864+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:48.391248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1330,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.865499+0000","last_change":"2024-09-10T18:02:39.801389+0000","last_active":"2024-09-10T18:10:57.865499+0000","last_peered":"2024-09-10T18:10:57.865499+0000","last_clean":"2024-09-10T18:10:57.865499+0000","last_became_active":"2024-09-10T18:02:39.801092+0000","last_became_peered":"2024-09-10T18:02:39.801092+0000","last_unstale":"2024-09-10T18:10:57.865499+0000","last_undegraded":"2024-09-10T18:10:57.865499+0000","last_fullsized":"2024-09-10T18:10:57.865499+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:46.138525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1241,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862718+0000","last_change":"2024-09-10T18:04:21.865786+0000","last_active":"2024-09-10T18:10:58.862718+0000","last_peered":"2024-09-10T18:10:58.862718+0000","last_clean":"2024-09-10T18:10:58.862718+0000","last_became_active":"2024-09-10T18:04:21.865463+0000","last_became_peered":"2024-09-10T18:04:21.865463+0000","last_unstale":"2024-09-10T18:10:58.862718+0000","last_undegraded":"2024-09-10T18:10:58.862718+0000","last_fullsized":"2024-09-10T18:10:58.862718+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:27.789044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1407,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.858754+0000","last_change":"2024-09-10T18:02:05.734527+0000","last_active":"2024-09-10T18:10:58.858754+0000","last_peered":"2024-09-10T18:10:58.858754+0000","last_clean":"2024-09-10T18:10:58.858754+0000","last_became_active":"2024-09-10T18:02:05.733699+0000","last_became_peered":"2024-09-10T18:02:05.733699+0000","last_unstale":"2024-09-10T18:10:58.858754+0000","last_undegraded":"2024-09-10T18:10:58.858754+0000","last_fullsized":"2024-09-10T18:10:58.858754+0000","mapping_epoch":400,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":401,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:50.034905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1346,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864907+0000","last_change":"2024-09-10T18:02:39.801285+0000","last_active":"2024-09-10T18:10:57.864907+0000","last_peered":"2024-09-10T18:10:57.864907+0000","last_clean":"2024-09-10T18:10:57.864907+0000","last_became_active":"2024-09-10T18:02:39.800968+0000","last_became_peered":"2024-09-10T18:02:39.800968+0000","last_unstale":"2024-09-10T18:10:57.864907+0000","last_undegraded":"2024-09-10T18:10:57.864907+0000","last_fullsized":"2024-09-10T18:10:57.864907+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:22.600541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1429,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.853627+0000","last_change":"2024-09-10T18:02:39.808218+0000","last_active":"2024-09-10T18:10:57.853627+0000","last_peered":"2024-09-10T18:10:57.853627+0000","last_clean":"2024-09-10T18:10:57.853627+0000","last_became_active":"2024-09-10T18:02:39.806738+0000","last_became_peered":"2024-09-10T18:02:39.806738+0000","last_unstale":"2024-09-10T18:10:57.853627+0000","last_undegraded":"2024-09-10T18:10:57.853627+0000","last_fullsized":"2024-09-10T18:10:57.853627+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:06.576190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1276,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865187+0000","last_change":"2024-09-10T18:03:13.802422+0000","last_active":"2024-09-10T18:10:58.865187+0000","last_peered":"2024-09-10T18:10:58.865187+0000","last_clean":"2024-09-10T18:10:58.865187+0000","last_became_active":"2024-09-10T18:03:13.800484+0000","last_became_peered":"2024-09-10T18:03:13.800484+0000","last_unstale":"2024-09-10T18:10:58.865187+0000","last_undegraded":"2024-09-10T18:10:58.865187+0000","last_fullsized":"2024-09-10T18:10:58.865187+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:04:15.369853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1378,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183001+0000","last_change":"2024-09-10T18:03:48.899692+0000","last_active":"2024-09-10T18:10:59.183001+0000","last_peered":"2024-09-10T18:10:59.183001+0000","last_clean":"2024-09-10T18:10:59.183001+0000","last_became_active":"2024-09-10T18:03:48.898619+0000","last_became_peered":"2024-09-10T18:03:48.898619+0000","last_unstale":"2024-09-10T18:10:59.183001+0000","last_undegraded":"2024-09-10T18:10:59.183001+0000","last_fullsized":"2024-09-10T18:10:59.183001+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:33.417224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1236,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.861850+0000","last_change":"2024-09-10T18:03:48.908369+0000","last_active":"2024-09-10T18:10:58.861850+0000","last_peered":"2024-09-10T18:10:58.861850+0000","last_clean":"2024-09-10T18:10:58.861850+0000","last_became_active":"2024-09-10T18:03:48.892248+0000","last_became_peered":"2024-09-10T18:03:48.892248+0000","last_unstale":"2024-09-10T18:10:58.861850+0000","last_undegraded":"2024-09-10T18:10:58.861850+0000","last_fullsized":"2024-09-10T18:10:58.861850+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:38.566613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1316,"reported_epoch":892,"state":"active+clean","last_fresh":"2024-09-10T18:11:02.855883+0000","last_change":"2024-09-10T18:02:39.802925+0000","last_active":"2024-09-10T18:11:02.855883+0000","last_peered":"2024-09-10T18:11:02.855883+0000","last_clean":"2024-09-10T18:11:02.855883+0000","last_became_active":"2024-09-10T18:02:39.801752+0000","last_became_peered":"2024-09-10T18:02:39.801752+0000","last_unstale":"2024-09-10T18:11:02.855883+0000","last_undegraded":"2024-09-10T18:11:02.855883+0000","last_fullsized":"2024-09-10T18:11:02.855883+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:41.313675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"548'2","reported_seq":1314,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864688+0000","last_change":"2024-09-10T18:04:21.863688+0000","last_active":"2024-09-10T18:10:57.864688+0000","last_peered":"2024-09-10T18:10:57.864688+0000","last_clean":"2024-09-10T18:10:57.864688+0000","last_became_active":"2024-09-10T18:04:21.863267+0000","last_became_peered":"2024-09-10T18:04:21.863267+0000","last_unstale":"2024-09-10T18:10:57.864688+0000","last_undegraded":"2024-09-10T18:10:57.864688+0000","last_fullsized":"2024-09-10T18:10:57.864688+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:19.723070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1337,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183169+0000","last_change":"2024-09-10T18:04:21.873375+0000","last_active":"2024-09-10T18:10:59.183169+0000","last_peered":"2024-09-10T18:10:59.183169+0000","last_clean":"2024-09-10T18:10:59.183169+0000","last_became_active":"2024-09-10T18:04:21.871495+0000","last_became_peered":"2024-09-10T18:04:21.871495+0000","last_unstale":"2024-09-10T18:10:59.183169+0000","last_undegraded":"2024-09-10T18:10:59.183169+0000","last_fullsized":"2024-09-10T18:10:59.183169+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:57.013300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"548'2","reported_seq":1245,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862078+0000","last_change":"2024-09-10T18:04:21.855288+0000","last_active":"2024-09-10T18:10:58.862078+0000","last_peered":"2024-09-10T18:10:58.862078+0000","last_clean":"2024-09-10T18:10:58.862078+0000","last_became_active":"2024-09-10T18:04:21.854916+0000","last_became_peered":"2024-09-10T18:04:21.854916+0000","last_unstale":"2024-09-10T18:10:58.862078+0000","last_undegraded":"2024-09-10T18:10:58.862078+0000","last_fullsized":"2024-09-10T18:10:58.862078+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:04.541941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1347,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864295+0000","last_change":"2024-09-10T18:03:48.899420+0000","last_active":"2024-09-10T18:10:57.864295+0000","last_peered":"2024-09-10T18:10:57.864295+0000","last_clean":"2024-09-10T18:10:57.864295+0000","last_became_active":"2024-09-10T18:03:48.899088+0000","last_became_peered":"2024-09-10T18:03:48.899088+0000","last_unstale":"2024-09-10T18:10:57.864295+0000","last_undegraded":"2024-09-10T18:10:57.864295+0000","last_fullsized":"2024-09-10T18:10:57.864295+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:07.163969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1339,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864572+0000","last_change":"2024-09-10T18:02:05.726155+0000","last_active":"2024-09-10T18:10:57.864572+0000","last_peered":"2024-09-10T18:10:57.864572+0000","last_clean":"2024-09-10T18:10:57.864572+0000","last_became_active":"2024-09-10T18:02:05.725011+0000","last_became_peered":"2024-09-10T18:02:05.725011+0000","last_unstale":"2024-09-10T18:10:57.864572+0000","last_undegraded":"2024-09-10T18:10:57.864572+0000","last_fullsized":"2024-09-10T18:10:57.864572+0000","mapping_epoch":400,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":401,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:25.742406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1267,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.864825+0000","last_change":"2024-09-10T18:04:21.869052+0000","last_active":"2024-09-10T18:10:58.864825+0000","last_peered":"2024-09-10T18:10:58.864825+0000","last_clean":"2024-09-10T18:10:58.864825+0000","last_became_active":"2024-09-10T18:04:21.868767+0000","last_became_peered":"2024-09-10T18:04:21.868767+0000","last_unstale":"2024-09-10T18:10:58.864825+0000","last_undegraded":"2024-09-10T18:10:58.864825+0000","last_fullsized":"2024-09-10T18:10:58.864825+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:41.018456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1407,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859291+0000","last_change":"2024-09-10T18:02:39.810032+0000","last_active":"2024-09-10T18:10:58.859291+0000","last_peered":"2024-09-10T18:10:58.859291+0000","last_clean":"2024-09-10T18:10:58.859291+0000","last_became_active":"2024-09-10T18:02:39.808155+0000","last_became_peered":"2024-09-10T18:02:39.808155+0000","last_unstale":"2024-09-10T18:10:58.859291+0000","last_undegraded":"2024-09-10T18:10:58.859291+0000","last_fullsized":"2024-09-10T18:10:58.859291+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:27.724990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1238,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862949+0000","last_change":"2024-09-10T18:03:48.907764+0000","last_active":"2024-09-10T18:10:58.862949+0000","last_peered":"2024-09-10T18:10:58.862949+0000","last_clean":"2024-09-10T18:10:58.862949+0000","last_became_active":"2024-09-10T18:03:48.907392+0000","last_became_peered":"2024-09-10T18:03:48.907392+0000","last_unstale":"2024-09-10T18:10:58.862949+0000","last_undegraded":"2024-09-10T18:10:58.862949+0000","last_fullsized":"2024-09-10T18:10:58.862949+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:30.990051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1246,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865706+0000","last_change":"2024-09-10T18:04:21.868234+0000","last_active":"2024-09-10T18:10:58.865706+0000","last_peered":"2024-09-10T18:10:58.865706+0000","last_clean":"2024-09-10T18:10:58.865706+0000","last_became_active":"2024-09-10T18:04:21.867973+0000","last_became_peered":"2024-09-10T18:04:21.867973+0000","last_unstale":"2024-09-10T18:10:58.865706+0000","last_undegraded":"2024-09-10T18:10:58.865706+0000","last_fullsized":"2024-09-10T18:10:58.865706+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:05.336844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1283,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865871+0000","last_change":"2024-09-10T18:03:48.909203+0000","last_active":"2024-09-10T18:10:58.865871+0000","last_peered":"2024-09-10T18:10:58.865871+0000","last_clean":"2024-09-10T18:10:58.865871+0000","last_became_active":"2024-09-10T18:03:48.908916+0000","last_became_peered":"2024-09-10T18:03:48.908916+0000","last_unstale":"2024-09-10T18:10:58.865871+0000","last_undegraded":"2024-09-10T18:10:58.865871+0000","last_fullsized":"2024-09-10T18:10:58.865871+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:02.010359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1427,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.854639+0000","last_change":"2024-09-10T18:03:13.798350+0000","last_active":"2024-09-10T18:10:57.854639+0000","last_peered":"2024-09-10T18:10:57.854639+0000","last_clean":"2024-09-10T18:10:57.854639+0000","last_became_active":"2024-09-10T18:03:13.797657+0000","last_became_peered":"2024-09-10T18:03:13.797657+0000","last_unstale":"2024-09-10T18:10:57.854639+0000","last_undegraded":"2024-09-10T18:10:57.854639+0000","last_fullsized":"2024-09-10T18:10:57.854639+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:17.694472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"65'3","reported_seq":1411,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859128+0000","last_change":"2024-09-10T18:03:13.786111+0000","last_active":"2024-09-10T18:10:58.859128+0000","last_peered":"2024-09-10T18:10:58.859128+0000","last_clean":"2024-09-10T18:10:58.859128+0000","last_became_active":"2024-09-10T18:03:13.785759+0000","last_became_peered":"2024-09-10T18:03:13.785759+0000","last_unstale":"2024-09-10T18:10:58.859128+0000","last_undegraded":"2024-09-10T18:10:58.859128+0000","last_fullsized":"2024-09-10T18:10:58.859128+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:53.865031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1290,"reported_epoch":892,"state":"active+clean","last_fresh":"2024-09-10T18:11:02.856588+0000","last_change":"2024-09-10T18:04:21.859112+0000","last_active":"2024-09-10T18:11:02.856588+0000","last_peered":"2024-09-10T18:11:02.856588+0000","last_clean":"2024-09-10T18:11:02.856588+0000","last_became_active":"2024-09-10T18:04:21.858819+0000","last_became_peered":"2024-09-10T18:04:21.858819+0000","last_unstale":"2024-09-10T18:11:02.856588+0000","last_undegraded":"2024-09-10T18:11:02.856588+0000","last_fullsized":"2024-09-10T18:11:02.856588+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:06.542797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"548'29","reported_seq":1273,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862558+0000","last_change":"2024-09-10T18:03:48.897418+0000","last_active":"2024-09-10T18:10:58.862558+0000","last_peered":"2024-09-10T18:10:58.862558+0000","last_clean":"2024-09-10T18:10:58.862558+0000","last_became_active":"2024-09-10T18:03:48.897089+0000","last_became_peered":"2024-09-10T18:03:48.897089+0000","last_unstale":"2024-09-10T18:10:58.862558+0000","last_undegraded":"2024-09-10T18:10:58.862558+0000","last_fullsized":"2024-09-10T18:10:58.862558+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:19.468781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5822,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1179,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184069+0000","last_change":"2024-09-10T18:04:21.864531+0000","last_active":"2024-09-10T18:10:59.184069+0000","last_peered":"2024-09-10T18:10:59.184069+0000","last_clean":"2024-09-10T18:10:59.184069+0000","last_became_active":"2024-09-10T18:04:21.864280+0000","last_became_peered":"2024-09-10T18:04:21.864280+0000","last_unstale":"2024-09-10T18:10:59.184069+0000","last_undegraded":"2024-09-10T18:10:59.184069+0000","last_fullsized":"2024-09-10T18:10:59.184069+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:51.796555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"65'2","reported_seq":1437,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.853487+0000","last_change":"2024-09-10T18:02:39.809654+0000","last_active":"2024-09-10T18:10:57.853487+0000","last_peered":"2024-09-10T18:10:57.853487+0000","last_clean":"2024-09-10T18:10:57.853487+0000","last_became_active":"2024-09-10T18:02:39.806696+0000","last_became_peered":"2024-09-10T18:02:39.806696+0000","last_unstale":"2024-09-10T18:10:57.853487+0000","last_undegraded":"2024-09-10T18:10:57.853487+0000","last_fullsized":"2024-09-10T18:10:57.853487+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:45.217140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1428,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.851985+0000","last_change":"2024-09-10T18:04:21.871704+0000","last_active":"2024-09-10T18:10:57.851985+0000","last_peered":"2024-09-10T18:10:57.851985+0000","last_clean":"2024-09-10T18:10:57.851985+0000","last_became_active":"2024-09-10T18:04:21.871376+0000","last_became_peered":"2024-09-10T18:04:21.871376+0000","last_unstale":"2024-09-10T18:10:57.851985+0000","last_undegraded":"2024-09-10T18:10:57.851985+0000","last_fullsized":"2024-09-10T18:10:57.851985+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:49.092596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1275,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865492+0000","last_change":"2024-09-10T18:04:21.857976+0000","last_active":"2024-09-10T18:10:58.865492+0000","last_peered":"2024-09-10T18:10:58.865492+0000","last_clean":"2024-09-10T18:10:58.865492+0000","last_became_active":"2024-09-10T18:04:21.857673+0000","last_became_peered":"2024-09-10T18:04:21.857673+0000","last_unstale":"2024-09-10T18:10:58.865492+0000","last_undegraded":"2024-09-10T18:10:58.865492+0000","last_fullsized":"2024-09-10T18:10:58.865492+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:07:30.718425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1179,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183948+0000","last_change":"2024-09-10T18:04:21.869717+0000","last_active":"2024-09-10T18:10:59.183948+0000","last_peered":"2024-09-10T18:10:59.183948+0000","last_clean":"2024-09-10T18:10:59.183948+0000","last_became_active":"2024-09-10T18:04:21.869376+0000","last_became_peered":"2024-09-10T18:04:21.869376+0000","last_unstale":"2024-09-10T18:10:59.183948+0000","last_undegraded":"2024-09-10T18:10:59.183948+0000","last_fullsized":"2024-09-10T18:10:59.183948+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:44.825667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1248,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862107+0000","last_change":"2024-09-10T18:03:48.907481+0000","last_active":"2024-09-10T18:10:58.862107+0000","last_peered":"2024-09-10T18:10:58.862107+0000","last_clean":"2024-09-10T18:10:58.862107+0000","last_became_active":"2024-09-10T18:03:48.901870+0000","last_became_peered":"2024-09-10T18:03:48.901870+0000","last_unstale":"2024-09-10T18:10:58.862107+0000","last_undegraded":"2024-09-10T18:10:58.862107+0000","last_fullsized":"2024-09-10T18:10:58.862107+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:47:17.500022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1235,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.861872+0000","last_change":"2024-09-10T18:03:48.897440+0000","last_active":"2024-09-10T18:10:58.861872+0000","last_peered":"2024-09-10T18:10:58.861872+0000","last_clean":"2024-09-10T18:10:58.861872+0000","last_became_active":"2024-09-10T18:03:48.891850+0000","last_became_peered":"2024-09-10T18:03:48.891850+0000","last_unstale":"2024-09-10T18:10:58.861872+0000","last_undegraded":"2024-09-10T18:10:58.861872+0000","last_fullsized":"2024-09-10T18:10:58.861872+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:10.989857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"65'8","reported_seq":1387,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183030+0000","last_change":"2024-09-10T18:01:33.038359+0000","last_active":"2024-09-10T18:10:59.183030+0000","last_peered":"2024-09-10T18:10:59.183030+0000","last_clean":"2024-09-10T18:10:59.183030+0000","last_became_active":"2024-09-10T18:01:33.033858+0000","last_became_peered":"2024-09-10T18:01:33.033858+0000","last_unstale":"2024-09-10T18:10:59.183030+0000","last_undegraded":"2024-09-10T18:10:59.183030+0000","last_fullsized":"2024-09-10T18:10:59.183030+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:20.124482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1200,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183628+0000","last_change":"2024-09-10T18:04:21.862392+0000","last_active":"2024-09-10T18:10:59.183628+0000","last_peered":"2024-09-10T18:10:59.183628+0000","last_clean":"2024-09-10T18:10:59.183628+0000","last_became_active":"2024-09-10T18:04:21.862069+0000","last_became_peered":"2024-09-10T18:04:21.862069+0000","last_unstale":"2024-09-10T18:10:59.183628+0000","last_undegraded":"2024-09-10T18:10:59.183628+0000","last_fullsized":"2024-09-10T18:10:59.183628+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:10.962026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"889'1049","reported_seq":4560,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183542+0000","last_change":"2024-09-10T18:10:59.183945+0000","last_active":"2024-09-10T18:10:59.183542+0000","last_peered":"2024-09-10T18:10:59.183542+0000","last_clean":"2024-09-10T18:10:59.183542+0000","last_became_active":"2024-09-10T18:01:33.032388+0000","last_became_peered":"2024-09-10T18:01:33.032388+0000","last_unstale":"2024-09-10T18:10:59.183542+0000","last_undegraded":"2024-09-10T18:10:59.183542+0000","last_fullsized":"2024-09-10T18:10:59.183542+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:03.018609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066489999999999995,"stat_sum":{"num_bytes":4227072,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":340643,"num_write":329,"num_write_kb":69800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33382400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"2.f","version":"65'1","reported_seq":1292,"reported_epoch":892,"state":"active+clean","last_fresh":"2024-09-10T18:11:02.856888+0000","last_change":"2024-09-10T18:04:21.863234+0000","last_active":"2024-09-10T18:11:02.856888+0000","last_peered":"2024-09-10T18:11:02.856888+0000","last_clean":"2024-09-10T18:11:02.856888+0000","last_became_active":"2024-09-10T18:04:21.862720+0000","last_became_peered":"2024-09-10T18:04:21.862720+0000","last_unstale":"2024-09-10T18:11:02.856888+0000","last_undegraded":"2024-09-10T18:11:02.856888+0000","last_fullsized":"2024-09-10T18:11:02.856888+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:50.259815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1361,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183194+0000","last_change":"2024-09-10T18:02:39.805012+0000","last_active":"2024-09-10T18:10:59.183194+0000","last_peered":"2024-09-10T18:10:59.183194+0000","last_clean":"2024-09-10T18:10:59.183194+0000","last_became_active":"2024-09-10T18:02:39.804661+0000","last_became_peered":"2024-09-10T18:02:39.804661+0000","last_unstale":"2024-09-10T18:10:59.183194+0000","last_undegraded":"2024-09-10T18:10:59.183194+0000","last_fullsized":"2024-09-10T18:10:59.183194+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:10.912853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"891'1758","reported_seq":4883,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.188326+0000","last_change":"2024-09-10T18:10:59.189582+0000","last_active":"2024-09-10T18:10:59.188326+0000","last_peered":"2024-09-10T18:10:59.188326+0000","last_clean":"2024-09-10T18:10:59.188326+0000","last_became_active":"2024-09-10T18:04:21.868515+0000","last_became_peered":"2024-09-10T18:04:21.868515+0000","last_unstale":"2024-09-10T18:10:59.188326+0000","last_undegraded":"2024-09-10T18:10:59.188326+0000","last_fullsized":"2024-09-10T18:10:59.188326+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:55:10.257045+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0060217450000000002,"stat_sum":{"num_bytes":6479872,"num_objects":4,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":294,"num_read_kb":413507,"num_write":749,"num_write_kb":165368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":28360704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"2.e","version":"65'2","reported_seq":1385,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183555+0000","last_change":"2024-09-10T18:04:21.873829+0000","last_active":"2024-09-10T18:10:59.183555+0000","last_peered":"2024-09-10T18:10:59.183555+0000","last_clean":"2024-09-10T18:10:59.183555+0000","last_became_active":"2024-09-10T18:04:21.873060+0000","last_became_peered":"2024-09-10T18:04:21.873060+0000","last_unstale":"2024-09-10T18:10:59.183555+0000","last_undegraded":"2024-09-10T18:10:59.183555+0000","last_fullsized":"2024-09-10T18:10:59.183555+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:18.511148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1179,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184549+0000","last_change":"2024-09-10T18:04:21.871788+0000","last_active":"2024-09-10T18:10:59.184549+0000","last_peered":"2024-09-10T18:10:59.184549+0000","last_clean":"2024-09-10T18:10:59.184549+0000","last_became_active":"2024-09-10T18:04:21.870716+0000","last_became_peered":"2024-09-10T18:04:21.870716+0000","last_unstale":"2024-09-10T18:10:59.184549+0000","last_undegraded":"2024-09-10T18:10:59.184549+0000","last_fullsized":"2024-09-10T18:10:59.184549+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:14.638873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"891'2691","reported_seq":6090,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.188237+0000","last_change":"2024-09-10T18:10:59.189962+0000","last_active":"2024-09-10T18:10:59.188237+0000","last_peered":"2024-09-10T18:10:59.188237+0000","last_clean":"2024-09-10T18:10:59.188237+0000","last_became_active":"2024-09-10T18:02:39.806251+0000","last_became_peered":"2024-09-10T18:02:39.806251+0000","last_unstale":"2024-09-10T18:10:59.188237+0000","last_undegraded":"2024-09-10T18:10:59.188237+0000","last_fullsized":"2024-09-10T18:10:59.188237+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":2691,"log_dups_size":0,"ondisk_log_size":2691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:35.517809+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0068435960000000004,"stat_sum":{"num_bytes":23658496,"num_objects":7,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":563,"num_read_kb":1529497,"num_write":1360,"num_write_kb":247080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":59039744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"2.d","version":"65'1","reported_seq":1414,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859256+0000","last_change":"2024-09-10T18:02:39.804255+0000","last_active":"2024-09-10T18:10:58.859256+0000","last_peered":"2024-09-10T18:10:58.859256+0000","last_clean":"2024-09-10T18:10:58.859256+0000","last_became_active":"2024-09-10T18:02:39.803341+0000","last_became_peered":"2024-09-10T18:02:39.803341+0000","last_unstale":"2024-09-10T18:10:58.859256+0000","last_undegraded":"2024-09-10T18:10:58.859256+0000","last_fullsized":"2024-09-10T18:10:58.859256+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:10.180807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1272,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865866+0000","last_change":"2024-09-10T18:03:48.902926+0000","last_active":"2024-09-10T18:10:58.865866+0000","last_peered":"2024-09-10T18:10:58.865866+0000","last_clean":"2024-09-10T18:10:58.865866+0000","last_became_active":"2024-09-10T18:03:48.902485+0000","last_became_peered":"2024-09-10T18:03:48.902485+0000","last_unstale":"2024-09-10T18:10:58.865866+0000","last_undegraded":"2024-09-10T18:10:58.865866+0000","last_fullsized":"2024-09-10T18:10:58.865866+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:39.432692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"891'1667","reported_seq":5144,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.187274+0000","last_change":"2024-09-10T18:10:59.189331+0000","last_active":"2024-09-10T18:10:59.187274+0000","last_peered":"2024-09-10T18:10:59.187274+0000","last_clean":"2024-09-10T18:10:59.187274+0000","last_became_active":"2024-09-10T18:03:13.798659+0000","last_became_peered":"2024-09-10T18:03:13.798659+0000","last_unstale":"2024-09-10T18:10:59.187274+0000","last_undegraded":"2024-09-10T18:10:59.187274+0000","last_fullsized":"2024-09-10T18:10:59.187274+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":1667,"log_dups_size":0,"ondisk_log_size":1667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:06.886707+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0052385260000000003,"stat_sum":{"num_bytes":21102592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":304,"num_read_kb":220626,"num_write":683,"num_write_kb":148512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":16646144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1376,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183323+0000","last_change":"2024-09-10T18:03:13.798215+0000","last_active":"2024-09-10T18:10:59.183323+0000","last_peered":"2024-09-10T18:10:59.183323+0000","last_clean":"2024-09-10T18:10:59.183323+0000","last_became_active":"2024-09-10T18:03:13.797923+0000","last_became_peered":"2024-09-10T18:03:13.797923+0000","last_unstale":"2024-09-10T18:10:59.183323+0000","last_undegraded":"2024-09-10T18:10:59.183323+0000","last_fullsized":"2024-09-10T18:10:59.183323+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:26.021657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1200,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184322+0000","last_change":"2024-09-10T18:04:21.873641+0000","last_active":"2024-09-10T18:10:59.184322+0000","last_peered":"2024-09-10T18:10:59.184322+0000","last_clean":"2024-09-10T18:10:59.184322+0000","last_became_active":"2024-09-10T18:04:21.873358+0000","last_became_peered":"2024-09-10T18:04:21.873358+0000","last_unstale":"2024-09-10T18:10:59.184322+0000","last_undegraded":"2024-09-10T18:10:59.184322+0000","last_fullsized":"2024-09-10T18:10:59.184322+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:38.121292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"891'790","reported_seq":4009,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.187495+0000","last_change":"2024-09-10T18:10:59.188327+0000","last_active":"2024-09-10T18:10:59.187495+0000","last_peered":"2024-09-10T18:10:59.187495+0000","last_clean":"2024-09-10T18:10:59.187495+0000","last_became_active":"2024-09-10T18:04:21.871203+0000","last_became_peered":"2024-09-10T18:04:21.871203+0000","last_unstale":"2024-09-10T18:10:59.187495+0000","last_undegraded":"2024-09-10T18:10:59.187495+0000","last_fullsized":"2024-09-10T18:10:59.187495+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:11.952125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003904383,"stat_sum":{"num_bytes":5373952,"num_objects":3,"num_object_clones":1,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":245861,"num_write":329,"num_write_kb":69568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":38027264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"4.5","version":"0'0","reported_seq":1239,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862762+0000","last_change":"2024-09-10T18:04:21.865274+0000","last_active":"2024-09-10T18:10:58.862762+0000","last_peered":"2024-09-10T18:10:58.862762+0000","last_clean":"2024-09-10T18:10:58.862762+0000","last_became_active":"2024-09-10T18:04:21.864925+0000","last_became_peered":"2024-09-10T18:04:21.864925+0000","last_unstale":"2024-09-10T18:10:58.862762+0000","last_undegraded":"2024-09-10T18:10:58.862762+0000","last_fullsized":"2024-09-10T18:10:58.862762+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:11.706683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010232780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"245'213","reported_seq":1759,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183454+0000","last_change":"2024-09-10T18:04:21.871104+0000","last_active":"2024-09-10T18:10:59.183454+0000","last_peered":"2024-09-10T18:10:59.183454+0000","last_clean":"2024-09-10T18:10:59.183454+0000","last_became_active":"2024-09-10T18:04:21.870715+0000","last_became_peered":"2024-09-10T18:04:21.870715+0000","last_unstale":"2024-09-10T18:10:59.183454+0000","last_undegraded":"2024-09-10T18:10:59.183454+0000","last_fullsized":"2024-09-10T18:10:59.183454+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:50:14.084625+0000","last_clean_scrub_stamp":"2024-09-10T17:50:14.084625+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:47.842982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":976,"num_read_kb":1826,"num_write":343,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1283,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865066+0000","last_change":"2024-09-10T18:04:21.868321+0000","last_active":"2024-09-10T18:10:58.865066+0000","last_peered":"2024-09-10T18:10:58.865066+0000","last_clean":"2024-09-10T18:10:58.865066+0000","last_became_active":"2024-09-10T18:04:21.868066+0000","last_became_peered":"2024-09-10T18:04:21.868066+0000","last_unstale":"2024-09-10T18:10:58.865066+0000","last_undegraded":"2024-09-10T18:10:58.865066+0000","last_fullsized":"2024-09-10T18:10:58.865066+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:17.580943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1310,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.865115+0000","last_change":"2024-09-10T18:03:48.911699+0000","last_active":"2024-09-10T18:10:57.865115+0000","last_peered":"2024-09-10T18:10:57.865115+0000","last_clean":"2024-09-10T18:10:57.865115+0000","last_became_active":"2024-09-10T18:03:48.911402+0000","last_became_peered":"2024-09-10T18:03:48.911402+0000","last_unstale":"2024-09-10T18:10:57.865115+0000","last_undegraded":"2024-09-10T18:10:57.865115+0000","last_fullsized":"2024-09-10T18:10:57.865115+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:22.960505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"889'446","reported_seq":3804,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.866471+0000","last_change":"2024-09-10T18:10:58.866781+0000","last_active":"2024-09-10T18:10:58.866471+0000","last_peered":"2024-09-10T18:10:58.866471+0000","last_clean":"2024-09-10T18:10:58.866471+0000","last_became_active":"2024-09-10T18:03:13.797762+0000","last_became_peered":"2024-09-10T18:03:13.797762+0000","last_unstale":"2024-09-10T18:10:58.866471+0000","last_undegraded":"2024-09-10T18:10:58.866471+0000","last_fullsized":"2024-09-10T18:10:58.866471+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.733538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051897399999999995,"stat_sum":{"num_bytes":4628480,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":150196,"num_write":186,"num_write_kb":50648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":20365312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1437,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.853127+0000","last_change":"2024-09-10T18:01:33.033235+0000","last_active":"2024-09-10T18:10:57.853127+0000","last_peered":"2024-09-10T18:10:57.853127+0000","last_clean":"2024-09-10T18:10:57.853127+0000","last_became_active":"2024-09-10T18:01:33.032918+0000","last_became_peered":"2024-09-10T18:01:33.032918+0000","last_unstale":"2024-09-10T18:10:57.853127+0000","last_undegraded":"2024-09-10T18:10:57.853127+0000","last_fullsized":"2024-09-10T18:10:57.853127+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:50.968814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1365,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.182956+0000","last_change":"2024-09-10T18:01:33.034187+0000","last_active":"2024-09-10T18:10:59.182956+0000","last_peered":"2024-09-10T18:10:59.182956+0000","last_clean":"2024-09-10T18:10:59.182956+0000","last_became_active":"2024-09-10T18:01:33.033378+0000","last_became_peered":"2024-09-10T18:01:33.033378+0000","last_unstale":"2024-09-10T18:10:59.182956+0000","last_undegraded":"2024-09-10T18:10:59.182956+0000","last_fullsized":"2024-09-10T18:10:59.182956+0000","mapping_epoch":367,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":368,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:20.593851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1429,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.852056+0000","last_change":"2024-09-10T18:02:39.802962+0000","last_active":"2024-09-10T18:10:57.852056+0000","last_peered":"2024-09-10T18:10:57.852056+0000","last_clean":"2024-09-10T18:10:57.852056+0000","last_became_active":"2024-09-10T18:02:39.802635+0000","last_became_peered":"2024-09-10T18:02:39.802635+0000","last_unstale":"2024-09-10T18:10:57.852056+0000","last_undegraded":"2024-09-10T18:10:57.852056+0000","last_fullsized":"2024-09-10T18:10:57.852056+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:00:51.822137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"873'415","reported_seq":3937,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.190045+0000","last_change":"2024-09-10T18:10:59.190423+0000","last_active":"2024-09-10T18:10:59.190045+0000","last_peered":"2024-09-10T18:10:59.190045+0000","last_clean":"2024-09-10T18:10:59.190045+0000","last_became_active":"2024-09-10T18:03:13.798859+0000","last_became_peered":"2024-09-10T18:03:13.798859+0000","last_unstale":"2024-09-10T18:10:59.190045+0000","last_undegraded":"2024-09-10T18:10:59.190045+0000","last_fullsized":"2024-09-10T18:10:59.190045+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:38.223263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065541760000000001,"stat_sum":{"num_bytes":1384448,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":22057,"num_write":169,"num_write_kb":41336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":2875392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1400,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.858867+0000","last_change":"2024-09-10T18:03:13.790833+0000","last_active":"2024-09-10T18:10:58.858867+0000","last_peered":"2024-09-10T18:10:58.858867+0000","last_clean":"2024-09-10T18:10:58.858867+0000","last_became_active":"2024-09-10T18:03:13.790549+0000","last_became_peered":"2024-09-10T18:03:13.790549+0000","last_unstale":"2024-09-10T18:10:58.858867+0000","last_undegraded":"2024-09-10T18:10:58.858867+0000","last_fullsized":"2024-09-10T18:10:58.858867+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:54.898181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073360500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1377,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183067+0000","last_change":"2024-09-10T18:02:05.727541+0000","last_active":"2024-09-10T18:10:59.183067+0000","last_peered":"2024-09-10T18:10:59.183067+0000","last_clean":"2024-09-10T18:10:59.183067+0000","last_became_active":"2024-09-10T18:02:05.727165+0000","last_became_peered":"2024-09-10T18:02:05.727165+0000","last_unstale":"2024-09-10T18:10:59.183067+0000","last_undegraded":"2024-09-10T18:10:59.183067+0000","last_fullsized":"2024-09-10T18:10:59.183067+0000","mapping_epoch":400,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":401,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:07:16.027054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1408,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859423+0000","last_change":"2024-09-10T18:03:48.892454+0000","last_active":"2024-09-10T18:10:58.859423+0000","last_peered":"2024-09-10T18:10:58.859423+0000","last_clean":"2024-09-10T18:10:58.859423+0000","last_became_active":"2024-09-10T18:03:48.892138+0000","last_became_peered":"2024-09-10T18:03:48.892138+0000","last_unstale":"2024-09-10T18:10:58.859423+0000","last_undegraded":"2024-09-10T18:10:58.859423+0000","last_fullsized":"2024-09-10T18:10:58.859423+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:16.912926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":3601,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.855635+0000","last_change":"2024-09-10T18:10:57.856276+0000","last_active":"2024-09-10T18:10:57.855635+0000","last_peered":"2024-09-10T18:10:57.855635+0000","last_clean":"2024-09-10T18:10:57.855635+0000","last_became_active":"2024-09-10T18:02:39.801093+0000","last_became_peered":"2024-09-10T18:02:39.801093+0000","last_unstale":"2024-09-10T18:10:57.855635+0000","last_undegraded":"2024-09-10T18:10:57.855635+0000","last_fullsized":"2024-09-10T18:10:57.855635+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:39.923942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001303327,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":1375,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859493+0000","last_change":"2024-09-10T18:02:05.721226+0000","last_active":"2024-09-10T18:10:58.859493+0000","last_peered":"2024-09-10T18:10:58.859493+0000","last_clean":"2024-09-10T18:10:58.859493+0000","last_became_active":"2024-09-10T18:02:05.720873+0000","last_became_peered":"2024-09-10T18:02:05.720873+0000","last_unstale":"2024-09-10T18:10:58.859493+0000","last_undegraded":"2024-09-10T18:10:58.859493+0000","last_fullsized":"2024-09-10T18:10:58.859493+0000","mapping_epoch":400,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":401,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:19.001862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1249,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865364+0000","last_change":"2024-09-10T18:03:48.909521+0000","last_active":"2024-09-10T18:10:58.865364+0000","last_peered":"2024-09-10T18:10:58.865364+0000","last_clean":"2024-09-10T18:10:58.865364+0000","last_became_active":"2024-09-10T18:03:48.908733+0000","last_became_peered":"2024-09-10T18:03:48.908733+0000","last_unstale":"2024-09-10T18:10:58.865364+0000","last_undegraded":"2024-09-10T18:10:58.865364+0000","last_fullsized":"2024-09-10T18:10:58.865364+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:33.705283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1288,"reported_epoch":892,"state":"active+clean","last_fresh":"2024-09-10T18:11:02.856016+0000","last_change":"2024-09-10T18:03:48.894447+0000","last_active":"2024-09-10T18:11:02.856016+0000","last_peered":"2024-09-10T18:11:02.856016+0000","last_clean":"2024-09-10T18:11:02.856016+0000","last_became_active":"2024-09-10T18:03:48.892823+0000","last_became_peered":"2024-09-10T18:03:48.892823+0000","last_unstale":"2024-09-10T18:11:02.856016+0000","last_undegraded":"2024-09-10T18:11:02.856016+0000","last_fullsized":"2024-09-10T18:11:02.856016+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:35.860848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3","version":"889'1559","reported_seq":5159,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.855568+0000","last_change":"2024-09-10T18:10:57.856157+0000","last_active":"2024-09-10T18:10:57.855568+0000","last_peered":"2024-09-10T18:10:57.855568+0000","last_clean":"2024-09-10T18:10:57.855568+0000","last_became_active":"2024-09-10T18:03:48.892046+0000","last_became_peered":"2024-09-10T18:03:48.892046+0000","last_unstale":"2024-09-10T18:10:57.855568+0000","last_undegraded":"2024-09-10T18:10:57.855568+0000","last_fullsized":"2024-09-10T18:10:57.855568+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":1559,"log_dups_size":0,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:42:27.677761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012066360000000001,"stat_sum":{"num_bytes":3489792,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":328,"num_read_kb":490115,"num_write":579,"num_write_kb":167096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46620672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"4.2","version":"74'2","reported_seq":1378,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.858946+0000","last_change":"2024-09-10T18:03:13.788151+0000","last_active":"2024-09-10T18:10:58.858946+0000","last_peered":"2024-09-10T18:10:58.858946+0000","last_clean":"2024-09-10T18:10:58.858946+0000","last_became_active":"2024-09-10T18:03:13.787791+0000","last_became_peered":"2024-09-10T18:03:13.787791+0000","last_unstale":"2024-09-10T18:10:58.858946+0000","last_undegraded":"2024-09-10T18:10:58.858946+0000","last_fullsized":"2024-09-10T18:10:58.858946+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:04.282581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062133499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1405,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859300+0000","last_change":"2024-09-10T18:04:21.869262+0000","last_active":"2024-09-10T18:10:58.859300+0000","last_peered":"2024-09-10T18:10:58.859300+0000","last_clean":"2024-09-10T18:10:58.859300+0000","last_became_active":"2024-09-10T18:04:21.868256+0000","last_became_peered":"2024-09-10T18:04:21.868256+0000","last_unstale":"2024-09-10T18:10:58.859300+0000","last_undegraded":"2024-09-10T18:10:58.859300+0000","last_fullsized":"2024-09-10T18:10:58.859300+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:32:10.068770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1276,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865663+0000","last_change":"2024-09-10T18:03:13.794452+0000","last_active":"2024-09-10T18:10:58.865663+0000","last_peered":"2024-09-10T18:10:58.865663+0000","last_clean":"2024-09-10T18:10:58.865663+0000","last_became_active":"2024-09-10T18:03:13.792263+0000","last_became_peered":"2024-09-10T18:03:13.792263+0000","last_unstale":"2024-09-10T18:10:58.865663+0000","last_undegraded":"2024-09-10T18:10:58.865663+0000","last_fullsized":"2024-09-10T18:10:58.865663+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:44.500761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"891'1731","reported_seq":4909,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.866025+0000","last_change":"2024-09-10T18:10:58.867440+0000","last_active":"2024-09-10T18:10:58.866025+0000","last_peered":"2024-09-10T18:10:58.866025+0000","last_clean":"2024-09-10T18:10:58.866025+0000","last_became_active":"2024-09-10T18:03:48.908120+0000","last_became_peered":"2024-09-10T18:03:48.908120+0000","last_unstale":"2024-09-10T18:10:58.866025+0000","last_undegraded":"2024-09-10T18:10:58.866025+0000","last_fullsized":"2024-09-10T18:10:58.866025+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":1731,"log_dups_size":0,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:01.070547+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0049562429999999999,"stat_sum":{"num_bytes":11894784,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":281,"num_read_kb":396041,"num_write":779,"num_write_kb":150864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":48619520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"4.3","version":"72'1","reported_seq":1440,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.853575+0000","last_change":"2024-09-10T18:04:21.872544+0000","last_active":"2024-09-10T18:10:57.853575+0000","last_peered":"2024-09-10T18:10:57.853575+0000","last_clean":"2024-09-10T18:10:57.853575+0000","last_became_active":"2024-09-10T18:04:21.871513+0000","last_became_peered":"2024-09-10T18:04:21.871513+0000","last_unstale":"2024-09-10T18:10:57.853575+0000","last_undegraded":"2024-09-10T18:10:57.853575+0000","last_fullsized":"2024-09-10T18:10:57.853575+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:32.305565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1184,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184257+0000","last_change":"2024-09-10T18:04:21.874726+0000","last_active":"2024-09-10T18:10:59.184257+0000","last_peered":"2024-09-10T18:10:59.184257+0000","last_clean":"2024-09-10T18:10:59.184257+0000","last_became_active":"2024-09-10T18:04:21.874286+0000","last_became_peered":"2024-09-10T18:04:21.874286+0000","last_unstale":"2024-09-10T18:10:59.184257+0000","last_undegraded":"2024-09-10T18:10:59.184257+0000","last_fullsized":"2024-09-10T18:10:59.184257+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:18.804267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1407,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.858837+0000","last_change":"2024-09-10T18:03:13.785826+0000","last_active":"2024-09-10T18:10:58.858837+0000","last_peered":"2024-09-10T18:10:58.858837+0000","last_clean":"2024-09-10T18:10:58.858837+0000","last_became_active":"2024-09-10T18:03:13.785480+0000","last_became_peered":"2024-09-10T18:03:13.785480+0000","last_unstale":"2024-09-10T18:10:58.858837+0000","last_undegraded":"2024-09-10T18:10:58.858837+0000","last_fullsized":"2024-09-10T18:10:58.858837+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:23.320769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"889'1158","reported_seq":4550,"reported_epoch":892,"state":"active+clean","last_fresh":"2024-09-10T18:11:02.856011+0000","last_change":"2024-09-10T18:10:58.854914+0000","last_active":"2024-09-10T18:11:02.856011+0000","last_peered":"2024-09-10T18:11:02.856011+0000","last_clean":"2024-09-10T18:11:02.856011+0000","last_became_active":"2024-09-10T18:04:21.858855+0000","last_became_peered":"2024-09-10T18:04:21.858855+0000","last_unstale":"2024-09-10T18:11:02.856011+0000","last_undegraded":"2024-09-10T18:11:02.856011+0000","last_fullsized":"2024-09-10T18:11:02.856011+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":1158,"log_dups_size":0,"ondisk_log_size":1158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:08.464830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012786729999999999,"stat_sum":{"num_bytes":12288000,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":293531,"num_write":556,"num_write_kb":85664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":19898368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1343,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864428+0000","last_change":"2024-09-10T18:04:21.864529+0000","last_active":"2024-09-10T18:10:57.864428+0000","last_peered":"2024-09-10T18:10:57.864428+0000","last_clean":"2024-09-10T18:10:57.864428+0000","last_became_active":"2024-09-10T18:04:21.864194+0000","last_became_peered":"2024-09-10T18:04:21.864194+0000","last_unstale":"2024-09-10T18:10:57.864428+0000","last_undegraded":"2024-09-10T18:10:57.864428+0000","last_fullsized":"2024-09-10T18:10:57.864428+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:02.275748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001168997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"551'2","reported_seq":1415,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859199+0000","last_change":"2024-09-10T18:03:48.913203+0000","last_active":"2024-09-10T18:10:58.859199+0000","last_peered":"2024-09-10T18:10:58.859199+0000","last_clean":"2024-09-10T18:10:58.859199+0000","last_became_active":"2024-09-10T18:03:48.912834+0000","last_became_peered":"2024-09-10T18:03:48.912834+0000","last_unstale":"2024-09-10T18:10:58.859199+0000","last_undegraded":"2024-09-10T18:10:58.859199+0000","last_fullsized":"2024-09-10T18:10:58.859199+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:06.147119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1346,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.865502+0000","last_change":"2024-09-10T18:04:21.868369+0000","last_active":"2024-09-10T18:10:57.865502+0000","last_peered":"2024-09-10T18:10:57.865502+0000","last_clean":"2024-09-10T18:10:57.865502+0000","last_became_active":"2024-09-10T18:04:21.867994+0000","last_became_peered":"2024-09-10T18:04:21.867994+0000","last_unstale":"2024-09-10T18:10:57.865502+0000","last_undegraded":"2024-09-10T18:10:57.865502+0000","last_fullsized":"2024-09-10T18:10:57.865502+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:41.089128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"877'393","reported_seq":3882,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.865927+0000","last_change":"2024-09-10T18:10:57.866675+0000","last_active":"2024-09-10T18:10:57.865927+0000","last_peered":"2024-09-10T18:10:57.865927+0000","last_clean":"2024-09-10T18:10:57.865927+0000","last_became_active":"2024-09-10T18:02:39.800245+0000","last_became_peered":"2024-09-10T18:02:39.800245+0000","last_unstale":"2024-09-10T18:10:57.865927+0000","last_undegraded":"2024-09-10T18:10:57.865927+0000","last_fullsized":"2024-09-10T18:10:57.865927+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:44.083048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065243,"stat_sum":{"num_bytes":851968,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":228874,"num_write":95,"num_write_kb":34760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7069696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1302,"reported_epoch":892,"state":"active+clean","last_fresh":"2024-09-10T18:11:02.856217+0000","last_change":"2024-09-10T18:03:48.902735+0000","last_active":"2024-09-10T18:11:02.856217+0000","last_peered":"2024-09-10T18:11:02.856217+0000","last_clean":"2024-09-10T18:11:02.856217+0000","last_became_active":"2024-09-10T18:03:48.902442+0000","last_became_peered":"2024-09-10T18:03:48.902442+0000","last_unstale":"2024-09-10T18:11:02.856217+0000","last_undegraded":"2024-09-10T18:11:02.856217+0000","last_fullsized":"2024-09-10T18:11:02.856217+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:53:44.946861+0000","last_clean_scrub_stamp":"2024-09-10T17:53:44.946861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:08.852994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"65'2","reported_seq":1222,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862726+0000","last_change":"2024-09-10T18:04:21.866603+0000","last_active":"2024-09-10T18:10:58.862726+0000","last_peered":"2024-09-10T18:10:58.862726+0000","last_clean":"2024-09-10T18:10:58.862726+0000","last_became_active":"2024-09-10T18:04:21.865889+0000","last_became_peered":"2024-09-10T18:04:21.865889+0000","last_unstale":"2024-09-10T18:10:58.862726+0000","last_undegraded":"2024-09-10T18:10:58.862726+0000","last_fullsized":"2024-09-10T18:10:58.862726+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:31.250785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1428,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.852977+0000","last_change":"2024-09-10T18:02:39.802468+0000","last_active":"2024-09-10T18:10:57.852977+0000","last_peered":"2024-09-10T18:10:57.852977+0000","last_clean":"2024-09-10T18:10:57.852977+0000","last_became_active":"2024-09-10T18:02:39.802126+0000","last_became_peered":"2024-09-10T18:02:39.802126+0000","last_unstale":"2024-09-10T18:10:57.852977+0000","last_undegraded":"2024-09-10T18:10:57.852977+0000","last_fullsized":"2024-09-10T18:10:57.852977+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:43:08.921947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"891'3024","reported_seq":6218,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.877801+0000","last_change":"2024-09-10T18:10:58.879435+0000","last_active":"2024-09-10T18:10:58.877801+0000","last_peered":"2024-09-10T18:10:58.877801+0000","last_clean":"2024-09-10T18:10:58.877801+0000","last_became_active":"2024-09-10T18:03:48.903625+0000","last_became_peered":"2024-09-10T18:03:48.903625+0000","last_unstale":"2024-09-10T18:10:58.877801+0000","last_undegraded":"2024-09-10T18:10:58.877801+0000","last_fullsized":"2024-09-10T18:10:58.877801+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":3024,"log_dups_size":0,"ondisk_log_size":3024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:06.335621+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.013370933,"stat_sum":{"num_bytes":15081472,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":710942,"num_write":1351,"num_write_kb":250936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":43466752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1204,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183531+0000","last_change":"2024-09-10T18:04:21.876461+0000","last_active":"2024-09-10T18:10:59.183531+0000","last_peered":"2024-09-10T18:10:59.183531+0000","last_clean":"2024-09-10T18:10:59.183531+0000","last_became_active":"2024-09-10T18:04:21.876165+0000","last_became_peered":"2024-09-10T18:04:21.876165+0000","last_unstale":"2024-09-10T18:10:59.183531+0000","last_undegraded":"2024-09-10T18:10:59.183531+0000","last_fullsized":"2024-09-10T18:10:59.183531+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:59:09.536140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1313,"reported_epoch":892,"state":"active+clean","last_fresh":"2024-09-10T18:11:02.856440+0000","last_change":"2024-09-10T18:04:21.860952+0000","last_active":"2024-09-10T18:11:02.856440+0000","last_peered":"2024-09-10T18:11:02.856440+0000","last_clean":"2024-09-10T18:11:02.856440+0000","last_became_active":"2024-09-10T18:04:21.860663+0000","last_became_peered":"2024-09-10T18:04:21.860663+0000","last_unstale":"2024-09-10T18:11:02.856440+0000","last_undegraded":"2024-09-10T18:11:02.856440+0000","last_fullsized":"2024-09-10T18:11:02.856440+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:12.509474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"889'1138","reported_seq":4547,"reported_epoch":892,"state":"active+clean","last_fresh":"2024-09-10T18:11:02.856856+0000","last_change":"2024-09-10T18:10:58.855270+0000","last_active":"2024-09-10T18:11:02.856856+0000","last_peered":"2024-09-10T18:11:02.856856+0000","last_clean":"2024-09-10T18:11:02.856856+0000","last_became_active":"2024-09-10T18:03:13.798272+0000","last_became_peered":"2024-09-10T18:03:13.798272+0000","last_unstale":"2024-09-10T18:11:02.856856+0000","last_undegraded":"2024-09-10T18:11:02.856856+0000","last_fullsized":"2024-09-10T18:11:02.856856+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":1138,"log_dups_size":0,"ondisk_log_size":1138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:50.526907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089234399999999999,"stat_sum":{"num_bytes":2646016,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":751076,"num_write":466,"num_write_kb":131392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":28868608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1408,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.859702+0000","last_change":"2024-09-10T18:04:21.868519+0000","last_active":"2024-09-10T18:10:58.859702+0000","last_peered":"2024-09-10T18:10:58.859702+0000","last_clean":"2024-09-10T18:10:58.859702+0000","last_became_active":"2024-09-10T18:04:21.868033+0000","last_became_peered":"2024-09-10T18:04:21.868033+0000","last_unstale":"2024-09-10T18:10:58.859702+0000","last_undegraded":"2024-09-10T18:10:58.859702+0000","last_fullsized":"2024-09-10T18:10:58.859702+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:03.068347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1337,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.865280+0000","last_change":"2024-09-10T18:04:21.866365+0000","last_active":"2024-09-10T18:10:57.865280+0000","last_peered":"2024-09-10T18:10:57.865280+0000","last_clean":"2024-09-10T18:10:57.865280+0000","last_became_active":"2024-09-10T18:04:21.865868+0000","last_became_peered":"2024-09-10T18:04:21.865868+0000","last_unstale":"2024-09-10T18:10:57.865280+0000","last_undegraded":"2024-09-10T18:10:57.865280+0000","last_fullsized":"2024-09-10T18:10:57.865280+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:27.559299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"891'438","reported_seq":3968,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.190913+0000","last_change":"2024-09-10T18:10:59.191549+0000","last_active":"2024-09-10T18:10:59.190913+0000","last_peered":"2024-09-10T18:10:59.190913+0000","last_clean":"2024-09-10T18:10:59.190913+0000","last_became_active":"2024-09-10T18:04:21.871868+0000","last_became_peered":"2024-09-10T18:04:21.871868+0000","last_unstale":"2024-09-10T18:10:59.190913+0000","last_undegraded":"2024-09-10T18:10:59.190913+0000","last_fullsized":"2024-09-10T18:10:59.190913+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:50.542676+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0081135180000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":166490,"num_write":208,"num_write_kb":42576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":17317888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1408,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.858708+0000","last_change":"2024-09-10T18:04:21.865588+0000","last_active":"2024-09-10T18:10:58.858708+0000","last_peered":"2024-09-10T18:10:58.858708+0000","last_clean":"2024-09-10T18:10:58.858708+0000","last_became_active":"2024-09-10T18:04:21.865266+0000","last_became_peered":"2024-09-10T18:04:21.865266+0000","last_unstale":"2024-09-10T18:10:58.858708+0000","last_undegraded":"2024-09-10T18:10:58.858708+0000","last_fullsized":"2024-09-10T18:10:58.858708+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:22.602087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1345,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.864803+0000","last_change":"2024-09-10T18:02:39.805844+0000","last_active":"2024-09-10T18:10:57.864803+0000","last_peered":"2024-09-10T18:10:57.864803+0000","last_clean":"2024-09-10T18:10:57.864803+0000","last_became_active":"2024-09-10T18:02:39.805516+0000","last_became_peered":"2024-09-10T18:02:39.805516+0000","last_unstale":"2024-09-10T18:10:57.864803+0000","last_undegraded":"2024-09-10T18:10:57.864803+0000","last_fullsized":"2024-09-10T18:10:57.864803+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:05:08.114970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"891'1940","reported_seq":5462,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.863908+0000","last_change":"2024-09-10T18:10:58.865934+0000","last_active":"2024-09-10T18:10:58.863908+0000","last_peered":"2024-09-10T18:10:58.863908+0000","last_clean":"2024-09-10T18:10:58.863908+0000","last_became_active":"2024-09-10T18:02:39.808190+0000","last_became_peered":"2024-09-10T18:02:39.808190+0000","last_unstale":"2024-09-10T18:10:58.863908+0000","last_undegraded":"2024-09-10T18:10:58.863908+0000","last_fullsized":"2024-09-10T18:10:58.863908+0000","mapping_epoch":434,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:56:31.193780+0000","last_clean_scrub_stamp":"2024-09-10T17:56:31.193780+0000","objects_scrubbed":0,"log_size":1940,"log_dups_size":0,"ondisk_log_size":1940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:47.885665+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0068717530000000004,"stat_sum":{"num_bytes":16080896,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":350,"num_read_kb":850307,"num_write":835,"num_write_kb":160928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":47644672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1ca","length":"1"},{"start":"1ce","length":"1"},{"start":"1d2","length":"1"}]},{"pgid":"2.b","version":"548'3","reported_seq":1218,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183755+0000","last_change":"2024-09-10T18:04:21.873243+0000","last_active":"2024-09-10T18:10:59.183755+0000","last_peered":"2024-09-10T18:10:59.183755+0000","last_clean":"2024-09-10T18:10:59.183755+0000","last_became_active":"2024-09-10T18:04:21.872909+0000","last_became_peered":"2024-09-10T18:04:21.872909+0000","last_unstale":"2024-09-10T18:10:59.183755+0000","last_undegraded":"2024-09-10T18:10:59.183755+0000","last_fullsized":"2024-09-10T18:10:59.183755+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:45.096395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1245,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.862379+0000","last_change":"2024-09-10T18:03:48.909305+0000","last_active":"2024-09-10T18:10:58.862379+0000","last_peered":"2024-09-10T18:10:58.862379+0000","last_clean":"2024-09-10T18:10:58.862379+0000","last_became_active":"2024-09-10T18:03:48.908095+0000","last_became_peered":"2024-09-10T18:03:48.908095+0000","last_unstale":"2024-09-10T18:10:58.862379+0000","last_undegraded":"2024-09-10T18:10:58.862379+0000","last_fullsized":"2024-09-10T18:10:58.862379+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:36.548214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1263,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865714+0000","last_change":"2024-09-10T18:03:48.902559+0000","last_active":"2024-09-10T18:10:58.865714+0000","last_peered":"2024-09-10T18:10:58.865714+0000","last_clean":"2024-09-10T18:10:58.865714+0000","last_became_active":"2024-09-10T18:03:48.902186+0000","last_became_peered":"2024-09-10T18:03:48.902186+0000","last_unstale":"2024-09-10T18:10:58.865714+0000","last_undegraded":"2024-09-10T18:10:58.865714+0000","last_fullsized":"2024-09-10T18:10:58.865714+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:40.564477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"65'2","reported_seq":1217,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.183772+0000","last_change":"2024-09-10T18:04:21.872740+0000","last_active":"2024-09-10T18:10:59.183772+0000","last_peered":"2024-09-10T18:10:59.183772+0000","last_clean":"2024-09-10T18:10:59.183772+0000","last_became_active":"2024-09-10T18:04:21.872359+0000","last_became_peered":"2024-09-10T18:04:21.872359+0000","last_unstale":"2024-09-10T18:10:59.183772+0000","last_undegraded":"2024-09-10T18:10:59.183772+0000","last_fullsized":"2024-09-10T18:10:59.183772+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:03.680456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1267,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:58.865875+0000","last_change":"2024-09-10T18:03:13.784530+0000","last_active":"2024-09-10T18:10:58.865875+0000","last_peered":"2024-09-10T18:10:58.865875+0000","last_clean":"2024-09-10T18:10:58.865875+0000","last_became_active":"2024-09-10T18:03:13.782760+0000","last_became_peered":"2024-09-10T18:03:13.782760+0000","last_unstale":"2024-09-10T18:10:58.865875+0000","last_undegraded":"2024-09-10T18:10:58.865875+0000","last_fullsized":"2024-09-10T18:10:58.865875+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:01.565947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"65'2","reported_seq":1207,"reported_epoch":891,"state":"active+clean","last_fresh":"2024-09-10T18:10:59.184022+0000","last_change":"2024-09-10T18:04:21.878112+0000","last_active":"2024-09-10T18:10:59.184022+0000","last_peered":"2024-09-10T18:10:59.184022+0000","last_clean":"2024-09-10T18:10:59.184022+0000","last_became_active":"2024-09-10T18:04:21.877135+0000","last_became_peered":"2024-09-10T18:04:21.877135+0000","last_unstale":"2024-09-10T18:10:59.184022+0000","last_undegraded":"2024-09-10T18:10:59.184022+0000","last_fullsized":"2024-09-10T18:10:59.184022+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:16.016077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1429,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.854403+0000","last_change":"2024-09-10T18:03:13.798644+0000","last_active":"2024-09-10T18:10:57.854403+0000","last_peered":"2024-09-10T18:10:57.854403+0000","last_clean":"2024-09-10T18:10:57.854403+0000","last_became_active":"2024-09-10T18:03:13.798071+0000","last_became_peered":"2024-09-10T18:03:13.798071+0000","last_unstale":"2024-09-10T18:10:57.854403+0000","last_undegraded":"2024-09-10T18:10:57.854403+0000","last_fullsized":"2024-09-10T18:10:57.854403+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:30.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"548'2","reported_seq":1351,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.865508+0000","last_change":"2024-09-10T18:03:13.797512+0000","last_active":"2024-09-10T18:10:57.865508+0000","last_peered":"2024-09-10T18:10:57.865508+0000","last_clean":"2024-09-10T18:10:57.865508+0000","last_became_active":"2024-09-10T18:03:13.797156+0000","last_became_peered":"2024-09-10T18:03:13.797156+0000","last_unstale":"2024-09-10T18:10:57.865508+0000","last_undegraded":"2024-09-10T18:10:57.865508+0000","last_fullsized":"2024-09-10T18:10:57.865508+0000","mapping_epoch":466,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":467,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:39:27.658241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1330,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.865374+0000","last_change":"2024-09-10T18:03:48.912368+0000","last_active":"2024-09-10T18:10:57.865374+0000","last_peered":"2024-09-10T18:10:57.865374+0000","last_clean":"2024-09-10T18:10:57.865374+0000","last_became_active":"2024-09-10T18:03:48.912072+0000","last_became_peered":"2024-09-10T18:03:48.912072+0000","last_unstale":"2024-09-10T18:10:57.865374+0000","last_undegraded":"2024-09-10T18:10:57.865374+0000","last_fullsized":"2024-09-10T18:10:57.865374+0000","mapping_epoch":498,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":499,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:38.613602+0000","last_clean_scrub_stamp":"2024-09-10T17:52:38.613602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:52.122896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"548'5","reported_seq":1441,"reported_epoch":890,"state":"active+clean","last_fresh":"2024-09-10T18:10:57.854936+0000","last_change":"2024-09-10T18:04:21.872539+0000","last_active":"2024-09-10T18:10:57.854936+0000","last_peered":"2024-09-10T18:10:57.854936+0000","last_clean":"2024-09-10T18:10:57.854936+0000","last_became_active":"2024-09-10T18:04:21.872074+0000","last_became_peered":"2024-09-10T18:04:21.872074+0000","last_unstale":"2024-09-10T18:10:57.854936+0000","last_undegraded":"2024-09-10T18:10:57.854936+0000","last_fullsized":"2024-09-10T18:10:57.854936+0000","mapping_epoch":529,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":530,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T17:52:35.173921+0000","last_clean_scrub_stamp":"2024-09-10T17:52:35.173921+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:34.910719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":129187840,"num_objects":46,"num_object_clones":3,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3861,"num_read_kb":6809763,"num_write":8674,"num_write_kb":1816528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":458203136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":193998848,"data_stored":196304896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20197,"ondisk_log_size":20197,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6620,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43557,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":976,"num_read_kb":1826,"num_write":343,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":367,"seq":1576252997747,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":427872,"kb_used_data":40596,"kb_used_omap":26,"kb_used_meta":387237,"kb_avail":93317280,"statfs":{"total":95995035648,"available":95556894720,"internally_reserved":0,"allocated":41570304,"data_stored":35775931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27073,"internal_metadata":396531263},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":332,"seq":1425929142394,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":564104,"kb_used_data":29816,"kb_used_omap":18,"kb_used_meta":534253,"kb_avail":93181048,"statfs":{"total":95995035648,"available":95417393152,"internally_reserved":0,"allocated":30531584,"data_stored":25429341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19163,"internal_metadata":547075365},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":529,"seq":2272037699665,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":213924,"kb_used_data":25752,"kb_used_omap":26,"kb_used_meta":188133,"kb_avail":93531228,"statfs":{"total":95995035648,"available":95775977472,"internally_reserved":0,"allocated":26370048,"data_stored":21264893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27628,"internal_metadata":192648212},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":498,"seq":2138893713496,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":436176,"kb_used_data":32008,"kb_used_omap":45,"kb_used_meta":404114,"kb_avail":93308976,"statfs":{"total":95995035648,"available":95548391424,"internally_reserved":0,"allocated":32776192,"data_stored":27671886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46198,"internal_metadata":413813642},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":466,"seq":2001454760031,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":652756,"kb_used_data":43716,"kb_used_omap":43,"kb_used_meta":608980,"kb_avail":93092396,"statfs":{"total":95995035648,"available":95326613504,"internally_reserved":0,"allocated":44765184,"data_stored":38961785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44665,"internal_metadata":623595911},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":434,"seq":1864015806566,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":706196,"kb_used_data":47876,"kb_used_omap":38,"kb_used_meta":658265,"kb_avail":93038956,"statfs":{"total":95995035648,"available":95271890944,"internally_reserved":0,"allocated":49025024,"data_stored":43207075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39843,"internal_metadata":674063453},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":400,"seq":1717986918508,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":342512,"kb_used_data":33060,"kb_used_omap":24,"kb_used_meta":309415,"kb_avail":93402640,"statfs":{"total":95995035648,"available":95644303360,"internally_reserved":0,"allocated":33853440,"data_stored":28137753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24718,"internal_metadata":316841842},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":300,"seq":1288490188928,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":885724,"kb_used_data":45456,"kb_used_omap":25,"kb_used_meta":840230,"kb_avail":92859428,"statfs":{"total":95995035648,"available":95088054272,"internally_reserved":0,"allocated":46546944,"data_stored":40847083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26439,"internal_metadata":860395705},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6080,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4215,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5457,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5298,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5792,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5187,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6177,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32251904,"data_stored":32362496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":17526784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27873280,"data_stored":27873280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20144128,"data_stored":20238336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35303424,"data_stored":35303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":31055872,"data_stored":31055872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18472960,"data_stored":19173376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12070912,"data_stored":12771328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T18:11:04.569 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-10T18:11:04.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-10T18:11:04.784 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:11:06.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:06 smithi012 ceph-mon[89611]: pgmap v1032: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:06.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:06 smithi012 ceph-mon[92029]: pgmap v1032: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:06.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:06 smithi089 ceph-mon[84132]: pgmap v1032: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:07.218 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'unique_pool_0' removed 2024-09-10T18:11:07.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:07 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2202144185' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:11:07.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:07 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2202144185' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:11:07.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:07 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2202144185' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:11:07.875 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-09-10T18:11:07.875 INFO:teuthology.task.print:**** done end ec-rados-default.yaml 2024-09-10T18:11:07.875 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-09-10T18:11:07.875 INFO:teuthology.task.print:**** done start rados_api.yaml 2024-09-10T18:11:07.875 INFO:teuthology.task.full_sequential:In full_sequential, running task workunit... 2024-09-10T18:11:07.876 INFO:tasks.workunit:Pulling workunits from ref reef 2024-09-10T18:11:07.877 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T18:11:07.877 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T18:11:07.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T18:11:07.897 INFO:teuthology.orchestra.run.smithi012.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-10T18:11:07.897 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T18:11:07.955 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-10T18:11:07.955 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-10T18:11:08.011 INFO:tasks.workunit:timeout=3h 2024-09-10T18:11:08.011 INFO:tasks.workunit:cleanup=True 2024-09-10T18:11:08.011 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch reef https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 2024-09-10T18:11:08.067 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T18:11:08.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:08 smithi012 ceph-mon[89611]: pgmap v1033: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:08.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:08 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2202144185' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:11:08.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:08 smithi012 ceph-mon[89611]: osdmap e893: 8 total, 8 up, 8 in 2024-09-10T18:11:08.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:08 smithi012 ceph-mon[92029]: pgmap v1033: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:08.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:08 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2202144185' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:11:08.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:08 smithi012 ceph-mon[92029]: osdmap e893: 8 total, 8 up, 8 in 2024-09-10T18:11:08.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:08 smithi089 ceph-mon[84132]: pgmap v1033: 121 pgs: 121 active+clean; 124 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-09-10T18:11:08.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:08 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2202144185' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:11:08.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:08 smithi089 ceph-mon[84132]: osdmap e893: 8 total, 8 up, 8 in 2024-09-10T18:11:10.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:10 smithi012 ceph-mon[89611]: pgmap v1035: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:10.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:10 smithi012 ceph-mon[92029]: pgmap v1035: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:10.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:10 smithi089 ceph-mon[84132]: pgmap v1035: 105 pgs: 105 active+clean; 583 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:12.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:12 smithi012 ceph-mon[89611]: pgmap v1036: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:12.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:12 smithi012 ceph-mon[92029]: pgmap v1036: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:12.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:12 smithi089 ceph-mon[84132]: pgmap v1036: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:14.510 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T18:11:14.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:14 smithi012 ceph-mon[89611]: pgmap v1037: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:14.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:14 smithi012 ceph-mon[92029]: pgmap v1037: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:14.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:11:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:11:14] "GET /metrics HTTP/1.1" 200 36352 "" "Prometheus/2.51.0" 2024-09-10T18:11:14.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:14 smithi089 ceph-mon[84132]: pgmap v1037: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:14.550 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T18:11:14.552 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T18:11:14.552 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T18:11:14.602 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T18:11:14.652 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T18:11:14.692 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T18:11:14.694 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T18:11:14.694 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T18:11:14.734 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T18:11:14.737 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T18:11:14.738 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T18:11:14.794 INFO:tasks.workunit:Running workunits matching cls on client.0... 2024-09-10T18:11:14.795 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-10T18:11:14.796 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-10T18:11:14.866 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:11:14.866 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 22 tests from 1 test suite. 2024-09-10T18:11:14.866 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:11:14.866 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 22 tests from TestCls2PCQueue 2024-09-10T18:11:14.867 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-10T18:11:16.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:16 smithi012 ceph-mon[89611]: pgmap v1038: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:16.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:16 smithi012 ceph-mon[89611]: osdmap e894: 8 total, 8 up, 8 in 2024-09-10T18:11:16.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:16 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3341528030' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:16.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:16 smithi012 ceph-mon[92029]: pgmap v1038: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:16.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:16 smithi012 ceph-mon[92029]: osdmap e894: 8 total, 8 up, 8 in 2024-09-10T18:11:16.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:16 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3341528030' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:16.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:16 smithi089 ceph-mon[84132]: pgmap v1038: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:16.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:16 smithi089 ceph-mon[84132]: osdmap e894: 8 total, 8 up, 8 in 2024-09-10T18:11:16.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:16 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3341528030' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:17.259 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2393 ms) 2024-09-10T18:11:17.259 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-10T18:11:17.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:17 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3341528030' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:17.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:17 smithi012 ceph-mon[89611]: osdmap e895: 8 total, 8 up, 8 in 2024-09-10T18:11:17.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:17.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:17 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3341528030' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:17.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:17 smithi012 ceph-mon[92029]: osdmap e895: 8 total, 8 up, 8 in 2024-09-10T18:11:17.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:17 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3341528030' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:17 smithi089 ceph-mon[84132]: osdmap e895: 8 total, 8 up, 8 in 2024-09-10T18:11:17.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:18.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:18 smithi012 ceph-mon[89611]: pgmap v1041: 137 pgs: 5 creating+peering, 23 unknown, 109 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:18.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:18 smithi012 ceph-mon[89611]: osdmap e896: 8 total, 8 up, 8 in 2024-09-10T18:11:18.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:18 smithi012 ceph-mon[92029]: pgmap v1041: 137 pgs: 5 creating+peering, 23 unknown, 109 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:18.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:18 smithi012 ceph-mon[92029]: osdmap e896: 8 total, 8 up, 8 in 2024-09-10T18:11:18.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:18 smithi089 ceph-mon[84132]: pgmap v1041: 137 pgs: 5 creating+peering, 23 unknown, 109 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:18.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:18 smithi089 ceph-mon[84132]: osdmap e896: 8 total, 8 up, 8 in 2024-09-10T18:11:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:19 smithi012 ceph-mon[89611]: osdmap e897: 8 total, 8 up, 8 in 2024-09-10T18:11:19.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:19 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2229001485' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:19.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:19 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:19 smithi012 ceph-mon[92029]: osdmap e897: 8 total, 8 up, 8 in 2024-09-10T18:11:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:19 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2229001485' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:19.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:19 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:19.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:19 smithi089 ceph-mon[84132]: osdmap e897: 8 total, 8 up, 8 in 2024-09-10T18:11:19.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:19 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2229001485' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:19.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:19 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:20.279 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3019 ms) 2024-09-10T18:11:20.279 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-10T18:11:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:20 smithi012 ceph-mon[89611]: pgmap v1044: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:20 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:20.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:20 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:20.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:20 smithi012 ceph-mon[89611]: osdmap e898: 8 total, 8 up, 8 in 2024-09-10T18:11:20.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:20 smithi012 ceph-mon[92029]: pgmap v1044: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:20.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:20 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:20.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:20 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:20.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:20 smithi012 ceph-mon[92029]: osdmap e898: 8 total, 8 up, 8 in 2024-09-10T18:11:20.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:20 smithi089 ceph-mon[84132]: pgmap v1044: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:20.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:20 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:20.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:20 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:20.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:20 smithi089 ceph-mon[84132]: osdmap e898: 8 total, 8 up, 8 in 2024-09-10T18:11:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:21 smithi012 ceph-mon[89611]: osdmap e899: 8 total, 8 up, 8 in 2024-09-10T18:11:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:21 smithi012 ceph-mon[92029]: osdmap e899: 8 total, 8 up, 8 in 2024-09-10T18:11:21.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:21 smithi089 ceph-mon[84132]: osdmap e899: 8 total, 8 up, 8 in 2024-09-10T18:11:22.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[89611]: pgmap v1047: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:22.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:22.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:11:22.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[89611]: osdmap e900: 8 total, 8 up, 8 in 2024-09-10T18:11:22.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/400965358' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:22.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[92029]: pgmap v1047: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:22.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:22.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:11:22.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[92029]: osdmap e900: 8 total, 8 up, 8 in 2024-09-10T18:11:22.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:22 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/400965358' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:22.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:22 smithi089 ceph-mon[84132]: pgmap v1047: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:22.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:22 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:22.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:22 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:11:22.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:22 smithi089 ceph-mon[84132]: osdmap e900: 8 total, 8 up, 8 in 2024-09-10T18:11:22.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:22 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/400965358' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:23.298 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.Reserve (3019 ms) 2024-09-10T18:11:23.298 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-10T18:11:23.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:23 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/400965358' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:23.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:23 smithi012 ceph-mon[92029]: osdmap e901: 8 total, 8 up, 8 in 2024-09-10T18:11:23.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:23 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/400965358' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:23.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:23 smithi012 ceph-mon[89611]: osdmap e901: 8 total, 8 up, 8 in 2024-09-10T18:11:23.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:23 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/400965358' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:23.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:23 smithi089 ceph-mon[84132]: osdmap e901: 8 total, 8 up, 8 in 2024-09-10T18:11:24.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:11:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:11:24] "GET /metrics HTTP/1.1" 200 36316 "" "Prometheus/2.51.0" 2024-09-10T18:11:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:24 smithi012 ceph-mon[92029]: pgmap v1050: 137 pgs: 9 creating+peering, 19 unknown, 109 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:24 smithi012 ceph-mon[92029]: osdmap e902: 8 total, 8 up, 8 in 2024-09-10T18:11:24.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:24 smithi012 ceph-mon[89611]: pgmap v1050: 137 pgs: 9 creating+peering, 19 unknown, 109 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:24.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:24 smithi012 ceph-mon[89611]: osdmap e902: 8 total, 8 up, 8 in 2024-09-10T18:11:24.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:24 smithi089 ceph-mon[84132]: pgmap v1050: 137 pgs: 9 creating+peering, 19 unknown, 109 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:24.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:24 smithi089 ceph-mon[84132]: osdmap e902: 8 total, 8 up, 8 in 2024-09-10T18:11:25.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:25 smithi012 ceph-mon[89611]: osdmap e903: 8 total, 8 up, 8 in 2024-09-10T18:11:25.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:25 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3622723375' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:25.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:25 smithi012 ceph-mon[92029]: osdmap e903: 8 total, 8 up, 8 in 2024-09-10T18:11:25.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:25 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3622723375' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:25 smithi089 ceph-mon[84132]: osdmap e903: 8 total, 8 up, 8 in 2024-09-10T18:11:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:25 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3622723375' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:26.328 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3030 ms) 2024-09-10T18:11:26.328 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-10T18:11:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:26 smithi012 ceph-mon[89611]: pgmap v1053: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:26 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:26 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3622723375' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:26 smithi012 ceph-mon[89611]: osdmap e904: 8 total, 8 up, 8 in 2024-09-10T18:11:26.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:26 smithi012 ceph-mon[92029]: pgmap v1053: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:26.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:26 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:26.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:26 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3622723375' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:26.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:26 smithi012 ceph-mon[92029]: osdmap e904: 8 total, 8 up, 8 in 2024-09-10T18:11:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:26 smithi089 ceph-mon[84132]: pgmap v1053: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:26 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:26 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3622723375' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:26 smithi089 ceph-mon[84132]: osdmap e904: 8 total, 8 up, 8 in 2024-09-10T18:11:27.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:27 smithi012 ceph-mon[89611]: osdmap e905: 8 total, 8 up, 8 in 2024-09-10T18:11:27.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:27 smithi012 ceph-mon[92029]: osdmap e905: 8 total, 8 up, 8 in 2024-09-10T18:11:27.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:27 smithi089 ceph-mon[84132]: osdmap e905: 8 total, 8 up, 8 in 2024-09-10T18:11:28.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[92029]: pgmap v1056: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:28.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:28.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[92029]: osdmap e906: 8 total, 8 up, 8 in 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1771407228' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[89611]: pgmap v1056: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[89611]: osdmap e906: 8 total, 8 up, 8 in 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1771407228' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:28 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:11:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:28 smithi089 ceph-mon[84132]: pgmap v1056: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:28 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:28 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:11:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:28 smithi089 ceph-mon[84132]: osdmap e906: 8 total, 8 up, 8 in 2024-09-10T18:11:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:28 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1771407228' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:28 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:11:29.344 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.Commit (3014 ms) 2024-09-10T18:11:29.345 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-10T18:11:29.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1771407228' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[89611]: osdmap e907: 8 total, 8 up, 8 in 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1771407228' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[92029]: osdmap e907: 8 total, 8 up, 8 in 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:11:29.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:29.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:29 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1771407228' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:29.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:29 smithi089 ceph-mon[84132]: osdmap e907: 8 total, 8 up, 8 in 2024-09-10T18:11:29.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:11:29.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:11:29.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:30.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:30 smithi012 ceph-mon[89611]: pgmap v1059: 137 pgs: 5 creating+peering, 22 unknown, 110 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:30.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:30 smithi012 ceph-mon[89611]: osdmap e908: 8 total, 8 up, 8 in 2024-09-10T18:11:30.687 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:30 smithi012 ceph-mon[92029]: pgmap v1059: 137 pgs: 5 creating+peering, 22 unknown, 110 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:30.687 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:30 smithi012 ceph-mon[92029]: osdmap e908: 8 total, 8 up, 8 in 2024-09-10T18:11:30.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:30 smithi089 ceph-mon[84132]: pgmap v1059: 137 pgs: 5 creating+peering, 22 unknown, 110 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:30.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:30 smithi089 ceph-mon[84132]: osdmap e908: 8 total, 8 up, 8 in 2024-09-10T18:11:31.701 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:31 smithi012 ceph-mon[92029]: osdmap e909: 8 total, 8 up, 8 in 2024-09-10T18:11:31.701 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:31 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1911318377' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:31.701 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:31 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:31.701 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:31 smithi012 ceph-mon[89611]: osdmap e909: 8 total, 8 up, 8 in 2024-09-10T18:11:31.702 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:31 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1911318377' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:31.702 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:31 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:31 smithi089 ceph-mon[84132]: osdmap e909: 8 total, 8 up, 8 in 2024-09-10T18:11:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:31 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1911318377' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:31 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:32.369 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.Abort (3027 ms) 2024-09-10T18:11:32.369 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-10T18:11:32.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[89611]: pgmap v1062: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:32.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:32.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[89611]: osdmap e910: 8 total, 8 up, 8 in 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[92029]: pgmap v1062: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[92029]: osdmap e910: 8 total, 8 up, 8 in 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:32 smithi089 ceph-mon[84132]: pgmap v1062: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:32 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:32 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:32 smithi089 ceph-mon[84132]: osdmap e910: 8 total, 8 up, 8 in 2024-09-10T18:11:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:33.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:33 smithi012 ceph-mon[89611]: osdmap e911: 8 total, 8 up, 8 in 2024-09-10T18:11:33.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:33 smithi012 ceph-mon[92029]: osdmap e911: 8 total, 8 up, 8 in 2024-09-10T18:11:33.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:33 smithi089 ceph-mon[84132]: osdmap e911: 8 total, 8 up, 8 in 2024-09-10T18:11:34.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:11:34] "GET /metrics HTTP/1.1" 200 36445 "" "Prometheus/2.51.0" 2024-09-10T18:11:34.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[89611]: pgmap v1065: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:34.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:34.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:11:34.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[89611]: osdmap e912: 8 total, 8 up, 8 in 2024-09-10T18:11:34.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2835112790' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:34.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:34.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[92029]: pgmap v1065: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:34.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:34.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:11:34.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[92029]: osdmap e912: 8 total, 8 up, 8 in 2024-09-10T18:11:34.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2835112790' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:34.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:34 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:34 smithi089 ceph-mon[84132]: pgmap v1065: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:34 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:34 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:11:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:34 smithi089 ceph-mon[84132]: osdmap e912: 8 total, 8 up, 8 in 2024-09-10T18:11:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:34 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2835112790' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:34.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:34 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:35.393 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ReserveError (3024 ms) 2024-09-10T18:11:35.393 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-10T18:11:35.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:35 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:35.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:35 smithi012 ceph-mon[89611]: osdmap e913: 8 total, 8 up, 8 in 2024-09-10T18:11:35.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:35 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:35.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:35 smithi012 ceph-mon[92029]: osdmap e913: 8 total, 8 up, 8 in 2024-09-10T18:11:35.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:35 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:35.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:35 smithi089 ceph-mon[84132]: osdmap e913: 8 total, 8 up, 8 in 2024-09-10T18:11:36.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:36 smithi012 ceph-mon[89611]: pgmap v1068: 137 pgs: 10 creating+peering, 21 unknown, 106 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:36.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:36 smithi012 ceph-mon[89611]: osdmap e914: 8 total, 8 up, 8 in 2024-09-10T18:11:36.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:36 smithi012 ceph-mon[92029]: pgmap v1068: 137 pgs: 10 creating+peering, 21 unknown, 106 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:36.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:36 smithi012 ceph-mon[92029]: osdmap e914: 8 total, 8 up, 8 in 2024-09-10T18:11:36.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:36 smithi089 ceph-mon[84132]: pgmap v1068: 137 pgs: 10 creating+peering, 21 unknown, 106 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:36.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:36 smithi089 ceph-mon[84132]: osdmap e914: 8 total, 8 up, 8 in 2024-09-10T18:11:37.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:37 smithi012 ceph-mon[89611]: osdmap e915: 8 total, 8 up, 8 in 2024-09-10T18:11:37.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:37 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2468193432' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:37.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:37 smithi012 ceph-mon[92029]: osdmap e915: 8 total, 8 up, 8 in 2024-09-10T18:11:37.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:37 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2468193432' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:37.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:37 smithi089 ceph-mon[84132]: osdmap e915: 8 total, 8 up, 8 in 2024-09-10T18:11:37.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:37 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2468193432' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:38.419 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.CommitError (3026 ms) 2024-09-10T18:11:38.419 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-10T18:11:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:38 smithi012 ceph-mon[89611]: pgmap v1071: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:38.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:38 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2468193432' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:38 smithi012 ceph-mon[89611]: osdmap e916: 8 total, 8 up, 8 in 2024-09-10T18:11:38.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:38 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:38.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:38 smithi012 ceph-mon[92029]: pgmap v1071: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:38.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:38 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2468193432' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:38.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:38 smithi012 ceph-mon[92029]: osdmap e916: 8 total, 8 up, 8 in 2024-09-10T18:11:38.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:38 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:38.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:38 smithi089 ceph-mon[84132]: pgmap v1071: 137 pgs: 9 creating+peering, 23 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:38.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:38 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2468193432' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:38.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:38 smithi089 ceph-mon[84132]: osdmap e916: 8 total, 8 up, 8 in 2024-09-10T18:11:38.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:38 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:39.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:39 smithi012 ceph-mon[89611]: osdmap e917: 8 total, 8 up, 8 in 2024-09-10T18:11:39.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:39 smithi012 ceph-mon[92029]: osdmap e917: 8 total, 8 up, 8 in 2024-09-10T18:11:39.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:39 smithi089 ceph-mon[84132]: osdmap e917: 8 total, 8 up, 8 in 2024-09-10T18:11:40.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[89611]: pgmap v1074: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:40.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[89611]: osdmap e918: 8 total, 8 up, 8 in 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/71285744' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[92029]: pgmap v1074: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[92029]: osdmap e918: 8 total, 8 up, 8 in 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/71285744' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:40.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:40 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:40.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:40 smithi089 ceph-mon[84132]: pgmap v1074: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:40.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:40 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:40.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:40 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:11:40.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:40 smithi089 ceph-mon[84132]: osdmap e918: 8 total, 8 up, 8 in 2024-09-10T18:11:40.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:40 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/71285744' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:40.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:40 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:41.449 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AbortError (3031 ms) 2024-09-10T18:11:41.450 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-10T18:11:41.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:41 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:41.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:41 smithi012 ceph-mon[89611]: osdmap e919: 8 total, 8 up, 8 in 2024-09-10T18:11:41.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:41 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:41.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:41 smithi012 ceph-mon[92029]: osdmap e919: 8 total, 8 up, 8 in 2024-09-10T18:11:41.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:41 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:41.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:41 smithi089 ceph-mon[84132]: osdmap e919: 8 total, 8 up, 8 in 2024-09-10T18:11:42.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:42 smithi012 ceph-mon[89611]: pgmap v1077: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:42.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:42 smithi012 ceph-mon[89611]: osdmap e920: 8 total, 8 up, 8 in 2024-09-10T18:11:42.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:42 smithi012 ceph-mon[92029]: pgmap v1077: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:42.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:42 smithi012 ceph-mon[92029]: osdmap e920: 8 total, 8 up, 8 in 2024-09-10T18:11:42.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:42 smithi089 ceph-mon[84132]: pgmap v1077: 137 pgs: 3 creating+peering, 22 unknown, 112 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:42.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:42 smithi089 ceph-mon[84132]: osdmap e920: 8 total, 8 up, 8 in 2024-09-10T18:11:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:43 smithi012 ceph-mon[89611]: osdmap e921: 8 total, 8 up, 8 in 2024-09-10T18:11:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:43 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/139831641' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:43.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:43 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:43 smithi012 ceph-mon[92029]: osdmap e921: 8 total, 8 up, 8 in 2024-09-10T18:11:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:43 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/139831641' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:43 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:43.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:43 smithi089 ceph-mon[84132]: osdmap e921: 8 total, 8 up, 8 in 2024-09-10T18:11:43.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:43 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/139831641' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:43.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:43 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:44.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3023 ms) 2024-09-10T18:11:44.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-10T18:11:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:11:44] "GET /metrics HTTP/1.1" 200 36445 "" "Prometheus/2.51.0" 2024-09-10T18:11:44.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-mon[89611]: pgmap v1080: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:44.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:44.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:44.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-mon[89611]: osdmap e922: 8 total, 8 up, 8 in 2024-09-10T18:11:44.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-mon[92029]: pgmap v1080: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:44.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:44.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:44.787 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:44 smithi012 ceph-mon[92029]: osdmap e922: 8 total, 8 up, 8 in 2024-09-10T18:11:44.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:44 smithi089 ceph-mon[84132]: pgmap v1080: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:44.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:44 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:44.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:44 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:44.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:44 smithi089 ceph-mon[84132]: osdmap e922: 8 total, 8 up, 8 in 2024-09-10T18:11:45.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:45 smithi012 ceph-mon[89611]: osdmap e923: 8 total, 8 up, 8 in 2024-09-10T18:11:45.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:45 smithi012 ceph-mon[92029]: osdmap e923: 8 total, 8 up, 8 in 2024-09-10T18:11:45.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:45 smithi089 ceph-mon[84132]: osdmap e923: 8 total, 8 up, 8 in 2024-09-10T18:11:46.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[89611]: pgmap v1083: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:11:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[89611]: osdmap e924: 8 total, 8 up, 8 in 2024-09-10T18:11:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1051863725' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:46.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:46.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[92029]: pgmap v1083: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:11:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[92029]: osdmap e924: 8 total, 8 up, 8 in 2024-09-10T18:11:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1051863725' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:46.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:46.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:46 smithi089 ceph-mon[84132]: pgmap v1083: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:46.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:46 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:46.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:46 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:11:46.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:46 smithi089 ceph-mon[84132]: osdmap e924: 8 total, 8 up, 8 in 2024-09-10T18:11:46.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:46 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1051863725' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:46.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:11:46.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:11:47.496 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3024 ms) 2024-09-10T18:11:47.497 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-10T18:11:47.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:47 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1051863725' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:47.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:47 smithi012 ceph-mon[89611]: osdmap e925: 8 total, 8 up, 8 in 2024-09-10T18:11:47.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:47 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1051863725' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:47.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:47 smithi012 ceph-mon[92029]: osdmap e925: 8 total, 8 up, 8 in 2024-09-10T18:11:47.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:47 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1051863725' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:47.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:47 smithi089 ceph-mon[84132]: osdmap e925: 8 total, 8 up, 8 in 2024-09-10T18:11:48.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:48 smithi012 ceph-mon[89611]: pgmap v1086: 137 pgs: 10 creating+peering, 14 unknown, 113 active+clean; 668 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 213 KiB/s rd, 688 KiB/s wr, 743 op/s 2024-09-10T18:11:48.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:48 smithi012 ceph-mon[89611]: osdmap e926: 8 total, 8 up, 8 in 2024-09-10T18:11:48.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:48 smithi012 ceph-mon[92029]: pgmap v1086: 137 pgs: 10 creating+peering, 14 unknown, 113 active+clean; 668 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 213 KiB/s rd, 688 KiB/s wr, 743 op/s 2024-09-10T18:11:48.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:48 smithi012 ceph-mon[92029]: osdmap e926: 8 total, 8 up, 8 in 2024-09-10T18:11:48.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:48 smithi089 ceph-mon[84132]: pgmap v1086: 137 pgs: 10 creating+peering, 14 unknown, 113 active+clean; 668 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 213 KiB/s rd, 688 KiB/s wr, 743 op/s 2024-09-10T18:11:48.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:48 smithi089 ceph-mon[84132]: osdmap e926: 8 total, 8 up, 8 in 2024-09-10T18:11:49.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:49 smithi012 ceph-mon[89611]: osdmap e927: 8 total, 8 up, 8 in 2024-09-10T18:11:49.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:49 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/4114827387' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:49.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:49 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:49.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:49 smithi012 ceph-mon[92029]: osdmap e927: 8 total, 8 up, 8 in 2024-09-10T18:11:49.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:49 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/4114827387' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:49.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:49 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:49.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:49 smithi089 ceph-mon[84132]: osdmap e927: 8 total, 8 up, 8 in 2024-09-10T18:11:49.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:49 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/4114827387' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:49.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:49 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:50.518 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3021 ms) 2024-09-10T18:11:50.518 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-10T18:11:50.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:50 smithi012 ceph-mon[89611]: pgmap v1089: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:50.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:50 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:50.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:50 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:50.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:50 smithi012 ceph-mon[89611]: osdmap e928: 8 total, 8 up, 8 in 2024-09-10T18:11:50.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:50 smithi012 ceph-mon[92029]: pgmap v1089: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:50.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:50 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:50.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:50 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:50.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:50 smithi012 ceph-mon[92029]: osdmap e928: 8 total, 8 up, 8 in 2024-09-10T18:11:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:50 smithi089 ceph-mon[84132]: pgmap v1089: 137 pgs: 12 creating+peering, 20 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:50 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:50 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:50.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:50 smithi089 ceph-mon[84132]: osdmap e928: 8 total, 8 up, 8 in 2024-09-10T18:11:51.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:51 smithi012 ceph-mon[89611]: osdmap e929: 8 total, 8 up, 8 in 2024-09-10T18:11:51.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:51 smithi012 ceph-mon[92029]: osdmap e929: 8 total, 8 up, 8 in 2024-09-10T18:11:51.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:51 smithi089 ceph-mon[84132]: osdmap e929: 8 total, 8 up, 8 in 2024-09-10T18:11:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[89611]: pgmap v1092: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:11:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[89611]: osdmap e930: 8 total, 8 up, 8 in 2024-09-10T18:11:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1955395316' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:52.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:52.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[92029]: pgmap v1092: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:11:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[92029]: osdmap e930: 8 total, 8 up, 8 in 2024-09-10T18:11:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1955395316' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:52.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:52 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:52 smithi089 ceph-mon[84132]: pgmap v1092: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:52 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:52.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:52 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:11:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:52 smithi089 ceph-mon[84132]: osdmap e930: 8 total, 8 up, 8 in 2024-09-10T18:11:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:52 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1955395316' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:52.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:52 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:53.535 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3017 ms) 2024-09-10T18:11:53.535 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-10T18:11:53.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:53 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:53.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:53 smithi012 ceph-mon[89611]: osdmap e931: 8 total, 8 up, 8 in 2024-09-10T18:11:53.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:53 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:53.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:53 smithi012 ceph-mon[92029]: osdmap e931: 8 total, 8 up, 8 in 2024-09-10T18:11:53.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:53 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:53.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:53 smithi089 ceph-mon[84132]: osdmap e931: 8 total, 8 up, 8 in 2024-09-10T18:11:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:54 smithi012 ceph-mon[89611]: pgmap v1095: 137 pgs: 8 creating+peering, 22 unknown, 107 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:54.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:54 smithi012 ceph-mon[89611]: osdmap e932: 8 total, 8 up, 8 in 2024-09-10T18:11:54.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:11:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:11:54] "GET /metrics HTTP/1.1" 200 36446 "" "Prometheus/2.51.0" 2024-09-10T18:11:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:54 smithi012 ceph-mon[92029]: pgmap v1095: 137 pgs: 8 creating+peering, 22 unknown, 107 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:54.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:54 smithi012 ceph-mon[92029]: osdmap e932: 8 total, 8 up, 8 in 2024-09-10T18:11:54.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:54 smithi089 ceph-mon[84132]: pgmap v1095: 137 pgs: 8 creating+peering, 22 unknown, 107 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:54.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:54 smithi089 ceph-mon[84132]: osdmap e932: 8 total, 8 up, 8 in 2024-09-10T18:11:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:55 smithi012 ceph-mon[89611]: osdmap e933: 8 total, 8 up, 8 in 2024-09-10T18:11:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:55 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3886782307' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:56.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:55 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:55 smithi012 ceph-mon[92029]: osdmap e933: 8 total, 8 up, 8 in 2024-09-10T18:11:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:55 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3886782307' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:55 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:56.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:55 smithi089 ceph-mon[84132]: osdmap e933: 8 total, 8 up, 8 in 2024-09-10T18:11:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:55 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3886782307' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:55 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:56.559 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3024 ms) 2024-09-10T18:11:56.559 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-10T18:11:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:56 smithi012 ceph-mon[89611]: pgmap v1098: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:56 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:56 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:57.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:56 smithi012 ceph-mon[89611]: osdmap e934: 8 total, 8 up, 8 in 2024-09-10T18:11:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:56 smithi012 ceph-mon[92029]: pgmap v1098: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:56 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:56 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:56 smithi012 ceph-mon[92029]: osdmap e934: 8 total, 8 up, 8 in 2024-09-10T18:11:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:56 smithi089 ceph-mon[84132]: pgmap v1098: 137 pgs: 7 creating+peering, 25 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:56 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:11:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:56 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:11:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:56 smithi089 ceph-mon[84132]: osdmap e934: 8 total, 8 up, 8 in 2024-09-10T18:11:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:57 smithi012 ceph-mon[89611]: osdmap e935: 8 total, 8 up, 8 in 2024-09-10T18:11:58.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:57 smithi012 ceph-mon[92029]: osdmap e935: 8 total, 8 up, 8 in 2024-09-10T18:11:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:57 smithi089 ceph-mon[84132]: osdmap e935: 8 total, 8 up, 8 in 2024-09-10T18:11:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[89611]: pgmap v1101: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[89611]: osdmap e936: 8 total, 8 up, 8 in 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/440419208' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[92029]: pgmap v1101: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[92029]: osdmap e936: 8 total, 8 up, 8 in 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/440419208' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:58 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:58 smithi089 ceph-mon[84132]: pgmap v1101: 105 pgs: 105 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:11:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:58 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:11:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:58 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:11:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:58 smithi089 ceph-mon[84132]: osdmap e936: 8 total, 8 up, 8 in 2024-09-10T18:11:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:58 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/440419208' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:58 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:11:59.592 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3032 ms) 2024-09-10T18:11:59.592 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-10T18:12:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:59 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:11:59 smithi012 ceph-mon[89611]: osdmap e937: 8 total, 8 up, 8 in 2024-09-10T18:12:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:59 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:11:59 smithi012 ceph-mon[92029]: osdmap e937: 8 total, 8 up, 8 in 2024-09-10T18:12:00.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:59 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:00.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:11:59 smithi089 ceph-mon[84132]: osdmap e937: 8 total, 8 up, 8 in 2024-09-10T18:12:00.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:00 smithi012 ceph-mon[89611]: pgmap v1104: 137 pgs: 3 creating+peering, 21 unknown, 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:00.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:00 smithi012 ceph-mon[89611]: osdmap e938: 8 total, 8 up, 8 in 2024-09-10T18:12:00.936 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:00 smithi012 ceph-mon[92029]: pgmap v1104: 137 pgs: 3 creating+peering, 21 unknown, 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:00.936 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:00 smithi012 ceph-mon[92029]: osdmap e938: 8 total, 8 up, 8 in 2024-09-10T18:12:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:00 smithi089 ceph-mon[84132]: pgmap v1104: 137 pgs: 3 creating+peering, 21 unknown, 113 active+clean; 583 KiB data, 3.8 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:00 smithi089 ceph-mon[84132]: osdmap e938: 8 total, 8 up, 8 in 2024-09-10T18:12:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:01 smithi012 ceph-mon[89611]: osdmap e939: 8 total, 8 up, 8 in 2024-09-10T18:12:02.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:01 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1866380139' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:02.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:01 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:02.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:02.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:01 smithi012 ceph-mon[92029]: osdmap e939: 8 total, 8 up, 8 in 2024-09-10T18:12:02.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:01 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1866380139' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:02.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:01 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:02.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:01 smithi089 ceph-mon[84132]: osdmap e939: 8 total, 8 up, 8 in 2024-09-10T18:12:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:01 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1866380139' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:01 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:02.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:02.612 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.Cleanup (3021 ms) 2024-09-10T18:12:02.612 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-10T18:12:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:02 smithi012 ceph-mon[89611]: pgmap v1107: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:02 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:02 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:03.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:02 smithi012 ceph-mon[89611]: osdmap e940: 8 total, 8 up, 8 in 2024-09-10T18:12:03.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:02 smithi012 ceph-mon[92029]: pgmap v1107: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:03.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:02 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:03.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:02 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:03.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:02 smithi012 ceph-mon[92029]: osdmap e940: 8 total, 8 up, 8 in 2024-09-10T18:12:03.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:02 smithi089 ceph-mon[84132]: pgmap v1107: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:03.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:02 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:03.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:02 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:03.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:02 smithi089 ceph-mon[84132]: osdmap e940: 8 total, 8 up, 8 in 2024-09-10T18:12:04.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:03 smithi012 ceph-mon[89611]: osdmap e941: 8 total, 8 up, 8 in 2024-09-10T18:12:04.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:03 smithi012 ceph-mon[92029]: osdmap e941: 8 total, 8 up, 8 in 2024-09-10T18:12:04.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:03 smithi089 ceph-mon[84132]: osdmap e941: 8 total, 8 up, 8 in 2024-09-10T18:12:04.622 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:12:04] "GET /metrics HTTP/1.1" 200 36445 "" "Prometheus/2.51.0" 2024-09-10T18:12:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[89611]: pgmap v1110: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:12:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[89611]: osdmap e942: 8 total, 8 up, 8 in 2024-09-10T18:12:05.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2856068148' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:05.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[92029]: pgmap v1110: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:12:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[92029]: osdmap e942: 8 total, 8 up, 8 in 2024-09-10T18:12:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2856068148' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:04 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:04 smithi089 ceph-mon[84132]: pgmap v1110: 105 pgs: 105 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:04 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:04 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:12:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:04 smithi089 ceph-mon[84132]: osdmap e942: 8 total, 8 up, 8 in 2024-09-10T18:12:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:04 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2856068148' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:04 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:05 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:05 smithi012 ceph-mon[89611]: osdmap e943: 8 total, 8 up, 8 in 2024-09-10T18:12:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:05 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:05 smithi012 ceph-mon[92029]: osdmap e943: 8 total, 8 up, 8 in 2024-09-10T18:12:06.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:05 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:05 smithi089 ceph-mon[84132]: osdmap e943: 8 total, 8 up, 8 in 2024-09-10T18:12:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:06 smithi012 ceph-mon[89611]: pgmap v1113: 137 pgs: 4 creating+peering, 23 unknown, 110 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:06 smithi012 ceph-mon[89611]: osdmap e944: 8 total, 8 up, 8 in 2024-09-10T18:12:07.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:06 smithi012 ceph-mon[92029]: pgmap v1113: 137 pgs: 4 creating+peering, 23 unknown, 110 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:06 smithi012 ceph-mon[92029]: osdmap e944: 8 total, 8 up, 8 in 2024-09-10T18:12:07.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:06 smithi089 ceph-mon[84132]: pgmap v1113: 137 pgs: 4 creating+peering, 23 unknown, 110 active+clean; 583 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:06 smithi089 ceph-mon[84132]: osdmap e944: 8 total, 8 up, 8 in 2024-09-10T18:12:09.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:08 smithi012 ceph-mon[89611]: pgmap v1115: 137 pgs: 4 creating+peering, 6 unknown, 127 active+clean; 975 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 3.5 MiB/s wr, 3.90k op/s 2024-09-10T18:12:09.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:08 smithi012 ceph-mon[92029]: pgmap v1115: 137 pgs: 4 creating+peering, 6 unknown, 127 active+clean; 975 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 3.5 MiB/s wr, 3.90k op/s 2024-09-10T18:12:09.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:08 smithi089 ceph-mon[84132]: pgmap v1115: 137 pgs: 4 creating+peering, 6 unknown, 127 active+clean; 975 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 3.5 MiB/s wr, 3.90k op/s 2024-09-10T18:12:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:10 smithi012 ceph-mon[89611]: pgmap v1116: 137 pgs: 137 active+clean; 975 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 4.1 MiB/s rd, 2.6 MiB/s wr, 2.97k op/s 2024-09-10T18:12:11.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:10 smithi012 ceph-mon[92029]: pgmap v1116: 137 pgs: 137 active+clean; 975 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 4.1 MiB/s rd, 2.6 MiB/s wr, 2.97k op/s 2024-09-10T18:12:11.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:10 smithi089 ceph-mon[84132]: pgmap v1116: 137 pgs: 137 active+clean; 975 KiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 4.1 MiB/s rd, 2.6 MiB/s wr, 2.97k op/s 2024-09-10T18:12:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:12 smithi012 ceph-mon[89611]: pgmap v1117: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 42 MiB/s rd, 8.1 MiB/s wr, 9.16k op/s 2024-09-10T18:12:13.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:12 smithi012 ceph-mon[92029]: pgmap v1117: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 42 MiB/s rd, 8.1 MiB/s wr, 9.16k op/s 2024-09-10T18:12:13.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:12 smithi089 ceph-mon[84132]: pgmap v1117: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 42 MiB/s rd, 8.1 MiB/s wr, 9.16k op/s 2024-09-10T18:12:14.640 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:12:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:12:14] "GET /metrics HTTP/1.1" 200 36445 "" "Prometheus/2.51.0" 2024-09-10T18:12:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:14 smithi012 ceph-mon[89611]: pgmap v1118: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 37 MiB/s rd, 7.2 MiB/s wr, 8.10k op/s 2024-09-10T18:12:15.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:14 smithi012 ceph-mon[92029]: pgmap v1118: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 37 MiB/s rd, 7.2 MiB/s wr, 8.10k op/s 2024-09-10T18:12:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:14 smithi089 ceph-mon[84132]: pgmap v1118: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 37 MiB/s rd, 7.2 MiB/s wr, 8.10k op/s 2024-09-10T18:12:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:16 smithi012 ceph-mon[89611]: pgmap v1119: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 31 MiB/s rd, 6.1 MiB/s wr, 6.92k op/s 2024-09-10T18:12:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:16 smithi012 ceph-mon[92029]: pgmap v1119: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 31 MiB/s rd, 6.1 MiB/s wr, 6.92k op/s 2024-09-10T18:12:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:16 smithi089 ceph-mon[84132]: pgmap v1119: 137 pgs: 137 active+clean; 2.0 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 31 MiB/s rd, 6.1 MiB/s wr, 6.92k op/s 2024-09-10T18:12:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:17.654 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiProducer (15042 ms) 2024-09-10T18:12:17.654 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-10T18:12:19.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:18 smithi012 ceph-mon[89611]: pgmap v1120: 137 pgs: 137 active+clean; 2.3 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 197 MiB/s rd, 6.5 MiB/s wr, 7.71k op/s 2024-09-10T18:12:19.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:18 smithi012 ceph-mon[89611]: osdmap e945: 8 total, 8 up, 8 in 2024-09-10T18:12:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:18 smithi012 ceph-mon[92029]: pgmap v1120: 137 pgs: 137 active+clean; 2.3 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 197 MiB/s rd, 6.5 MiB/s wr, 7.71k op/s 2024-09-10T18:12:19.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:18 smithi012 ceph-mon[92029]: osdmap e945: 8 total, 8 up, 8 in 2024-09-10T18:12:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:18 smithi089 ceph-mon[84132]: pgmap v1120: 137 pgs: 137 active+clean; 2.3 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 197 MiB/s rd, 6.5 MiB/s wr, 7.71k op/s 2024-09-10T18:12:19.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:18 smithi089 ceph-mon[84132]: osdmap e945: 8 total, 8 up, 8 in 2024-09-10T18:12:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:19 smithi012 ceph-mon[89611]: osdmap e946: 8 total, 8 up, 8 in 2024-09-10T18:12:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:19 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1949526843' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:20.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:19 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:19 smithi012 ceph-mon[92029]: osdmap e946: 8 total, 8 up, 8 in 2024-09-10T18:12:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:19 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1949526843' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:20.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:19 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:19 smithi089 ceph-mon[84132]: osdmap e946: 8 total, 8 up, 8 in 2024-09-10T18:12:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:19 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1949526843' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:20.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:19 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:20 smithi012 ceph-mon[89611]: pgmap v1123: 137 pgs: 15 creating+peering, 17 unknown, 105 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:20 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:21.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:20 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:21.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:20 smithi012 ceph-mon[89611]: osdmap e947: 8 total, 8 up, 8 in 2024-09-10T18:12:21.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:20 smithi012 ceph-mon[92029]: pgmap v1123: 137 pgs: 15 creating+peering, 17 unknown, 105 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:21.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:20 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:21.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:20 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:21.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:20 smithi012 ceph-mon[92029]: osdmap e947: 8 total, 8 up, 8 in 2024-09-10T18:12:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:20 smithi089 ceph-mon[84132]: pgmap v1123: 137 pgs: 15 creating+peering, 17 unknown, 105 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:20 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:20 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:21.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:20 smithi089 ceph-mon[84132]: osdmap e947: 8 total, 8 up, 8 in 2024-09-10T18:12:21.678 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (4024 ms) 2024-09-10T18:12:21.678 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-10T18:12:22.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:21 smithi012 ceph-mon[89611]: osdmap e948: 8 total, 8 up, 8 in 2024-09-10T18:12:22.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:21 smithi012 ceph-mon[92029]: osdmap e948: 8 total, 8 up, 8 in 2024-09-10T18:12:22.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:21 smithi089 ceph-mon[84132]: osdmap e948: 8 total, 8 up, 8 in 2024-09-10T18:12:23.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:22 smithi012 ceph-mon[89611]: pgmap v1126: 137 pgs: 1 creating+activating, 15 creating+peering, 12 unknown, 109 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:23.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:22 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:23.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:22 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:12:23.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:22 smithi012 ceph-mon[89611]: osdmap e949: 8 total, 8 up, 8 in 2024-09-10T18:12:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:22 smithi012 ceph-mon[92029]: pgmap v1126: 137 pgs: 1 creating+activating, 15 creating+peering, 12 unknown, 109 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:22 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:22 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:12:23.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:22 smithi012 ceph-mon[92029]: osdmap e949: 8 total, 8 up, 8 in 2024-09-10T18:12:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:22 smithi089 ceph-mon[84132]: pgmap v1126: 137 pgs: 1 creating+activating, 15 creating+peering, 12 unknown, 109 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:22 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:22 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:12:23.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:22 smithi089 ceph-mon[84132]: osdmap e949: 8 total, 8 up, 8 in 2024-09-10T18:12:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:23 smithi012 ceph-mon[89611]: osdmap e950: 8 total, 8 up, 8 in 2024-09-10T18:12:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:23 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3726606623' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:24.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:23 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:23 smithi012 ceph-mon[92029]: osdmap e950: 8 total, 8 up, 8 in 2024-09-10T18:12:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:23 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3726606623' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:24.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:23 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:23 smithi089 ceph-mon[84132]: osdmap e950: 8 total, 8 up, 8 in 2024-09-10T18:12:24.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:23 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3726606623' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:24.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:23 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:24.684 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:12:24] "GET /metrics HTTP/1.1" 200 36506 "" "Prometheus/2.51.0" 2024-09-10T18:12:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-mon[89611]: pgmap v1129: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-mon[89611]: osdmap e951: 8 total, 8 up, 8 in 2024-09-10T18:12:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-mon[92029]: pgmap v1129: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:24 smithi012 ceph-mon[92029]: osdmap e951: 8 total, 8 up, 8 in 2024-09-10T18:12:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:24 smithi089 ceph-mon[84132]: pgmap v1129: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:24 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:24 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:25.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:24 smithi089 ceph-mon[84132]: osdmap e951: 8 total, 8 up, 8 in 2024-09-10T18:12:26.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:25 smithi012 ceph-mon[89611]: osdmap e952: 8 total, 8 up, 8 in 2024-09-10T18:12:26.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:25 smithi012 ceph-mon[92029]: osdmap e952: 8 total, 8 up, 8 in 2024-09-10T18:12:26.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:25 smithi089 ceph-mon[84132]: osdmap e952: 8 total, 8 up, 8 in 2024-09-10T18:12:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:26 smithi012 ceph-mon[92029]: pgmap v1132: 137 pgs: 2 creating+peering, 17 unknown, 118 active+clean; 629 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 251 KiB/s wr, 274 op/s 2024-09-10T18:12:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:26 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:27.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:26 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:12:27.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:26 smithi012 ceph-mon[89611]: pgmap v1132: 137 pgs: 2 creating+peering, 17 unknown, 118 active+clean; 629 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 251 KiB/s wr, 274 op/s 2024-09-10T18:12:27.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:26 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:27.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:26 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:12:27.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:26 smithi089 ceph-mon[84132]: pgmap v1132: 137 pgs: 2 creating+peering, 17 unknown, 118 active+clean; 629 KiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 78 KiB/s rd, 251 KiB/s wr, 274 op/s 2024-09-10T18:12:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:26 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:27.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:26 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:12:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:28 smithi012 ceph-mon[89611]: pgmap v1133: 137 pgs: 2 creating+peering, 135 active+clean; 629 KiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 57 KiB/s rd, 183 KiB/s wr, 199 op/s 2024-09-10T18:12:29.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:28 smithi012 ceph-mon[92029]: pgmap v1133: 137 pgs: 2 creating+peering, 135 active+clean; 629 KiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 57 KiB/s rd, 183 KiB/s wr, 199 op/s 2024-09-10T18:12:29.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:28 smithi089 ceph-mon[84132]: pgmap v1133: 137 pgs: 2 creating+peering, 135 active+clean; 629 KiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 57 KiB/s rd, 183 KiB/s wr, 199 op/s 2024-09-10T18:12:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:12:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:12:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:12:30.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:29 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:12:30.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:12:30.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:12:30.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:12:30.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:29 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:12:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:12:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:12:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:12:30.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:29 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:12:31.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:30 smithi012 ceph-mon[89611]: pgmap v1134: 137 pgs: 137 active+clean; 1.5 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 59 MiB/s rd, 6.2 MiB/s wr, 7.41k op/s 2024-09-10T18:12:31.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:30 smithi012 ceph-mon[92029]: pgmap v1134: 137 pgs: 137 active+clean; 1.5 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 59 MiB/s rd, 6.2 MiB/s wr, 7.41k op/s 2024-09-10T18:12:31.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:30 smithi089 ceph-mon[84132]: pgmap v1134: 137 pgs: 137 active+clean; 1.5 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 59 MiB/s rd, 6.2 MiB/s wr, 7.41k op/s 2024-09-10T18:12:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:32.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:32.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:32 smithi012 ceph-mon[89611]: pgmap v1135: 137 pgs: 137 active+clean; 1.5 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 48 MiB/s rd, 5.1 MiB/s wr, 6.01k op/s 2024-09-10T18:12:33.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:32 smithi012 ceph-mon[92029]: pgmap v1135: 137 pgs: 137 active+clean; 1.5 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 48 MiB/s rd, 5.1 MiB/s wr, 6.01k op/s 2024-09-10T18:12:33.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:32 smithi089 ceph-mon[84132]: pgmap v1135: 137 pgs: 137 active+clean; 1.5 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 48 MiB/s rd, 5.1 MiB/s wr, 6.01k op/s 2024-09-10T18:12:34.715 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:12:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:12:34] "GET /metrics HTTP/1.1" 200 36505 "" "Prometheus/2.51.0" 2024-09-10T18:12:35.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:34 smithi012 ceph-mon[89611]: pgmap v1136: 137 pgs: 137 active+clean; 1.5 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 40 MiB/s rd, 4.3 MiB/s wr, 5.07k op/s 2024-09-10T18:12:35.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:34 smithi012 ceph-mon[92029]: pgmap v1136: 137 pgs: 137 active+clean; 1.5 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 40 MiB/s rd, 4.3 MiB/s wr, 5.07k op/s 2024-09-10T18:12:35.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:34 smithi089 ceph-mon[84132]: pgmap v1136: 137 pgs: 137 active+clean; 1.5 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 40 MiB/s rd, 4.3 MiB/s wr, 5.07k op/s 2024-09-10T18:12:37.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:36 smithi012 ceph-mon[89611]: pgmap v1137: 137 pgs: 137 active+clean; 1.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 74 MiB/s rd, 5.6 MiB/s wr, 6.70k op/s 2024-09-10T18:12:37.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:36 smithi012 ceph-mon[92029]: pgmap v1137: 137 pgs: 137 active+clean; 1.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 74 MiB/s rd, 5.6 MiB/s wr, 6.70k op/s 2024-09-10T18:12:37.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:36 smithi089 ceph-mon[84132]: pgmap v1137: 137 pgs: 137 active+clean; 1.6 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 74 MiB/s rd, 5.6 MiB/s wr, 6.70k op/s 2024-09-10T18:12:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:38 smithi012 ceph-mon[89611]: pgmap v1138: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 MiB/s rd, 4.9 MiB/s wr, 5.85k op/s 2024-09-10T18:12:39.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:38 smithi012 ceph-mon[92029]: pgmap v1138: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 MiB/s rd, 4.9 MiB/s wr, 5.85k op/s 2024-09-10T18:12:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:38 smithi089 ceph-mon[84132]: pgmap v1138: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 MiB/s rd, 4.9 MiB/s wr, 5.85k op/s 2024-09-10T18:12:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:40 smithi012 ceph-mon[89611]: pgmap v1139: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 97 MiB/s rd, 5.9 MiB/s wr, 7.26k op/s 2024-09-10T18:12:41.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:40 smithi012 ceph-mon[92029]: pgmap v1139: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 97 MiB/s rd, 5.9 MiB/s wr, 7.26k op/s 2024-09-10T18:12:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:40 smithi089 ceph-mon[84132]: pgmap v1139: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 97 MiB/s rd, 5.9 MiB/s wr, 7.26k op/s 2024-09-10T18:12:41.736 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (20057 ms) 2024-09-10T18:12:41.736 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-10T18:12:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:42 smithi012 ceph-mon[89611]: pgmap v1140: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 MiB/s rd, 2.6 MiB/s wr, 3.34k op/s 2024-09-10T18:12:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:42 smithi012 ceph-mon[89611]: osdmap e953: 8 total, 8 up, 8 in 2024-09-10T18:12:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:42 smithi012 ceph-mon[92029]: pgmap v1140: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 MiB/s rd, 2.6 MiB/s wr, 3.34k op/s 2024-09-10T18:12:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:42 smithi012 ceph-mon[92029]: osdmap e953: 8 total, 8 up, 8 in 2024-09-10T18:12:43.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:42 smithi089 ceph-mon[84132]: pgmap v1140: 137 pgs: 137 active+clean; 1.6 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 65 MiB/s rd, 2.6 MiB/s wr, 3.34k op/s 2024-09-10T18:12:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:42 smithi089 ceph-mon[84132]: osdmap e953: 8 total, 8 up, 8 in 2024-09-10T18:12:44.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:43 smithi012 ceph-mon[89611]: osdmap e954: 8 total, 8 up, 8 in 2024-09-10T18:12:44.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:43 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/868095021' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:44.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:43 smithi012 ceph-mon[92029]: osdmap e954: 8 total, 8 up, 8 in 2024-09-10T18:12:44.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:43 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/868095021' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:44.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:43 smithi089 ceph-mon[84132]: osdmap e954: 8 total, 8 up, 8 in 2024-09-10T18:12:44.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:43 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/868095021' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:44.743 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:12:44] "GET /metrics HTTP/1.1" 200 36505 "" "Prometheus/2.51.0" 2024-09-10T18:12:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-mon[89611]: pgmap v1143: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:45.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/868095021' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:45.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-mon[89611]: osdmap e955: 8 total, 8 up, 8 in 2024-09-10T18:12:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-mon[92029]: pgmap v1143: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/868095021' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:45.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:44 smithi012 ceph-mon[92029]: osdmap e955: 8 total, 8 up, 8 in 2024-09-10T18:12:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:44 smithi089 ceph-mon[84132]: pgmap v1143: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:44 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:44 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/868095021' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:44 smithi089 ceph-mon[84132]: osdmap e955: 8 total, 8 up, 8 in 2024-09-10T18:12:45.762 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4027 ms) 2024-09-10T18:12:45.762 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-10T18:12:46.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:45 smithi012 ceph-mon[89611]: osdmap e956: 8 total, 8 up, 8 in 2024-09-10T18:12:46.083 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:45 smithi012 ceph-mon[92029]: osdmap e956: 8 total, 8 up, 8 in 2024-09-10T18:12:46.084 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:45 smithi089 ceph-mon[84132]: osdmap e956: 8 total, 8 up, 8 in 2024-09-10T18:12:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[89611]: pgmap v1146: 137 pgs: 5 creating+peering, 12 unknown, 120 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:47.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:12:47.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[89611]: osdmap e957: 8 total, 8 up, 8 in 2024-09-10T18:12:47.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[92029]: pgmap v1146: 137 pgs: 5 creating+peering, 12 unknown, 120 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:12:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[92029]: osdmap e957: 8 total, 8 up, 8 in 2024-09-10T18:12:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:46 smithi089 ceph-mon[84132]: pgmap v1146: 137 pgs: 5 creating+peering, 12 unknown, 120 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:46 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:46 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:12:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:46 smithi089 ceph-mon[84132]: osdmap e957: 8 total, 8 up, 8 in 2024-09-10T18:12:47.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:12:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:47 smithi012 ceph-mon[89611]: osdmap e958: 8 total, 8 up, 8 in 2024-09-10T18:12:48.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:47 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/4250505634' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:48.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:47 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:47 smithi012 ceph-mon[92029]: osdmap e958: 8 total, 8 up, 8 in 2024-09-10T18:12:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:47 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/4250505634' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:47 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:47 smithi089 ceph-mon[84132]: osdmap e958: 8 total, 8 up, 8 in 2024-09-10T18:12:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:47 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/4250505634' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:47 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:48 smithi012 ceph-mon[89611]: pgmap v1149: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:49.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:48 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:49.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:48 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:49.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:48 smithi012 ceph-mon[89611]: osdmap e959: 8 total, 8 up, 8 in 2024-09-10T18:12:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:48 smithi012 ceph-mon[92029]: pgmap v1149: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:48 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:48 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:48 smithi012 ceph-mon[92029]: osdmap e959: 8 total, 8 up, 8 in 2024-09-10T18:12:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:48 smithi089 ceph-mon[84132]: pgmap v1149: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:48 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:48 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:48 smithi089 ceph-mon[84132]: osdmap e959: 8 total, 8 up, 8 in 2024-09-10T18:12:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:49 smithi012 ceph-mon[89611]: osdmap e960: 8 total, 8 up, 8 in 2024-09-10T18:12:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:49 smithi012 ceph-mon[92029]: osdmap e960: 8 total, 8 up, 8 in 2024-09-10T18:12:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:49 smithi089 ceph-mon[84132]: osdmap e960: 8 total, 8 up, 8 in 2024-09-10T18:12:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:50 smithi089 ceph-mon[84132]: pgmap v1152: 137 pgs: 5 creating+peering, 16 unknown, 116 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:50 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:50 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:12:51.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:50 smithi012 ceph-mon[89611]: pgmap v1152: 137 pgs: 5 creating+peering, 16 unknown, 116 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:51.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:50 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:51.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:50 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:12:51.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:50 smithi012 ceph-mon[92029]: pgmap v1152: 137 pgs: 5 creating+peering, 16 unknown, 116 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:51.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:50 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:51.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:50 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:12:51.802 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6040 ms) 2024-09-10T18:12:51.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-10T18:12:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:52 smithi012 ceph-mon[89611]: pgmap v1153: 137 pgs: 5 creating+peering, 7 unknown, 125 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:53.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:52 smithi012 ceph-mon[89611]: osdmap e961: 8 total, 8 up, 8 in 2024-09-10T18:12:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:52 smithi012 ceph-mon[92029]: pgmap v1153: 137 pgs: 5 creating+peering, 7 unknown, 125 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:53.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:52 smithi012 ceph-mon[92029]: osdmap e961: 8 total, 8 up, 8 in 2024-09-10T18:12:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:52 smithi089 ceph-mon[84132]: pgmap v1153: 137 pgs: 5 creating+peering, 7 unknown, 125 active+clean; 583 KiB data, 4.5 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:53.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:52 smithi089 ceph-mon[84132]: osdmap e961: 8 total, 8 up, 8 in 2024-09-10T18:12:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:53 smithi012 ceph-mon[89611]: osdmap e962: 8 total, 8 up, 8 in 2024-09-10T18:12:54.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:53 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/846315540' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:53 smithi012 ceph-mon[92029]: osdmap e962: 8 total, 8 up, 8 in 2024-09-10T18:12:54.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:53 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/846315540' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:54.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:53 smithi089 ceph-mon[84132]: osdmap e962: 8 total, 8 up, 8 in 2024-09-10T18:12:54.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:53 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/846315540' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:54.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:12:54] "GET /metrics HTTP/1.1" 200 34078 "" "Prometheus/2.51.0" 2024-09-10T18:12:55.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-mon[92029]: pgmap v1156: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:55.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:55.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/846315540' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:55.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-mon[92029]: osdmap e963: 8 total, 8 up, 8 in 2024-09-10T18:12:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-mon[89611]: pgmap v1156: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/846315540' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:55.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:54 smithi012 ceph-mon[89611]: osdmap e963: 8 total, 8 up, 8 in 2024-09-10T18:12:55.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:54 smithi089 ceph-mon[84132]: pgmap v1156: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:54 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:12:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:54 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/846315540' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-130965-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:12:55.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:54 smithi089 ceph-mon[84132]: osdmap e963: 8 total, 8 up, 8 in 2024-09-10T18:12:56.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:55 smithi012 ceph-mon[89611]: osdmap e964: 8 total, 8 up, 8 in 2024-09-10T18:12:56.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:55 smithi012 ceph-mon[92029]: osdmap e964: 8 total, 8 up, 8 in 2024-09-10T18:12:56.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:55 smithi089 ceph-mon[84132]: osdmap e964: 8 total, 8 up, 8 in 2024-09-10T18:12:56.833 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5031 ms) 2024-09-10T18:12:56.834 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 22 tests from TestCls2PCQueue (101967 ms total) 2024-09-10T18:12:56.834 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:12:56.834 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:12:56.834 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 22 tests from 1 test suite ran. (101967 ms total) 2024-09-10T18:12:56.834 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 22 tests. 2024-09-10T18:12:56.837 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T18:12:56.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:12:56.867 INFO:tasks.workunit:Running workunit cls/test_cls_cas.sh... 2024-09-10T18:12:56.867 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_cas.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cas.sh 2024-09-10T18:12:56.940 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:12:56.940 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 6 tests from 2 test suites. 2024-09-10T18:12:56.940 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:12:56.940 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 5 tests from cls_cas 2024-09-10T18:12:56.940 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_cas.get_put 2024-09-10T18:12:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:56 smithi012 ceph-mon[89611]: pgmap v1159: 137 pgs: 9 creating+peering, 15 unknown, 113 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:56 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:57.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:56 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:12:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:56 smithi012 ceph-mon[92029]: pgmap v1159: 137 pgs: 9 creating+peering, 15 unknown, 113 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:56 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:57.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:56 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:12:57.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:56 smithi089 ceph-mon[84132]: pgmap v1159: 137 pgs: 9 creating+peering, 15 unknown, 113 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:57.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:56 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:12:57.288 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:56 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:12:58.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:57 smithi012 ceph-mon[89611]: osdmap e965: 8 total, 8 up, 8 in 2024-09-10T18:12:58.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:57 smithi012 ceph-mon[92029]: osdmap e965: 8 total, 8 up, 8 in 2024-09-10T18:12:58.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:57 smithi089 ceph-mon[84132]: osdmap e965: 8 total, 8 up, 8 in 2024-09-10T18:12:59.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:58 smithi012 ceph-mon[89611]: pgmap v1161: 105 pgs: 105 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:58 smithi012 ceph-mon[89611]: osdmap e966: 8 total, 8 up, 8 in 2024-09-10T18:12:59.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:58 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/4045987422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:59.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:58 smithi012 ceph-mon[92029]: pgmap v1161: 105 pgs: 105 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:59.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:58 smithi012 ceph-mon[92029]: osdmap e966: 8 total, 8 up, 8 in 2024-09-10T18:12:59.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:58 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/4045987422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:59.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:58 smithi089 ceph-mon[84132]: pgmap v1161: 105 pgs: 105 active+clean; 583 KiB data, 4.6 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:12:59.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:58 smithi089 ceph-mon[84132]: osdmap e966: 8 total, 8 up, 8 in 2024-09-10T18:12:59.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:58 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/4045987422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:12:59.866 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_cas.get_put (2926 ms) 2024-09-10T18:12:59.866 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_cas.wrong_put 2024-09-10T18:13:00.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:59 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/4045987422' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:00.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:12:59 smithi012 ceph-mon[89611]: osdmap e967: 8 total, 8 up, 8 in 2024-09-10T18:13:00.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:59 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/4045987422' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:00.186 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:12:59 smithi012 ceph-mon[92029]: osdmap e967: 8 total, 8 up, 8 in 2024-09-10T18:13:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:59 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/4045987422' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:00.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:12:59 smithi089 ceph-mon[84132]: osdmap e967: 8 total, 8 up, 8 in 2024-09-10T18:13:01.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:00 smithi012 ceph-mon[89611]: pgmap v1164: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:01.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:00 smithi012 ceph-mon[89611]: osdmap e968: 8 total, 8 up, 8 in 2024-09-10T18:13:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:00 smithi012 ceph-mon[92029]: pgmap v1164: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:01.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:00 smithi012 ceph-mon[92029]: osdmap e968: 8 total, 8 up, 8 in 2024-09-10T18:13:01.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:00 smithi089 ceph-mon[84132]: pgmap v1164: 137 pgs: 11 creating+peering, 21 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:01.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:00 smithi089 ceph-mon[84132]: osdmap e968: 8 total, 8 up, 8 in 2024-09-10T18:13:02.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:01 smithi012 ceph-mon[89611]: osdmap e969: 8 total, 8 up, 8 in 2024-09-10T18:13:02.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:01 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2011669684' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:02.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:01 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:02.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:01 smithi012 ceph-mon[92029]: osdmap e969: 8 total, 8 up, 8 in 2024-09-10T18:13:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:01 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2011669684' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:01 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:02.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:01 smithi089 ceph-mon[84132]: osdmap e969: 8 total, 8 up, 8 in 2024-09-10T18:13:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:01 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2011669684' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:01 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:02.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:02.889 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_cas.wrong_put (3023 ms) 2024-09-10T18:13:02.889 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_cas.dup_get 2024-09-10T18:13:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:02 smithi012 ceph-mon[89611]: pgmap v1167: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:03.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:02 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:02 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:03.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:02 smithi012 ceph-mon[89611]: osdmap e970: 8 total, 8 up, 8 in 2024-09-10T18:13:03.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:02 smithi012 ceph-mon[92029]: pgmap v1167: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:03.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:02 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:03.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:02 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:03.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:02 smithi012 ceph-mon[92029]: osdmap e970: 8 total, 8 up, 8 in 2024-09-10T18:13:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:02 smithi089 ceph-mon[84132]: pgmap v1167: 137 pgs: 3 creating+peering, 29 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:02 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:02 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:03.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:02 smithi089 ceph-mon[84132]: osdmap e970: 8 total, 8 up, 8 in 2024-09-10T18:13:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:03 smithi012 ceph-mon[89611]: osdmap e971: 8 total, 8 up, 8 in 2024-09-10T18:13:04.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:03 smithi012 ceph-mon[89611]: pgmap v1170: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:04.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:03 smithi012 ceph-mon[92029]: osdmap e971: 8 total, 8 up, 8 in 2024-09-10T18:13:04.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:03 smithi012 ceph-mon[92029]: pgmap v1170: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:04.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:03 smithi089 ceph-mon[84132]: osdmap e971: 8 total, 8 up, 8 in 2024-09-10T18:13:04.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:03 smithi089 ceph-mon[84132]: pgmap v1170: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:04.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:13:04] "GET /metrics HTTP/1.1" 200 36441 "" "Prometheus/2.51.0" 2024-09-10T18:13:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:05.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:05.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[89611]: osdmap e972: 8 total, 8 up, 8 in 2024-09-10T18:13:05.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2371032464' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:05.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:05.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:05.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:05.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[92029]: osdmap e972: 8 total, 8 up, 8 in 2024-09-10T18:13:05.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2371032464' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:05.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:04 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:04 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:04 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:04 smithi089 ceph-mon[84132]: osdmap e972: 8 total, 8 up, 8 in 2024-09-10T18:13:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:04 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2371032464' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:05.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:04 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:05.907 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_cas.dup_get (3018 ms) 2024-09-10T18:13:05.907 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_cas.dup_put 2024-09-10T18:13:06.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:05 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:06.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:05 smithi012 ceph-mon[89611]: osdmap e973: 8 total, 8 up, 8 in 2024-09-10T18:13:06.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:05 smithi012 ceph-mon[89611]: pgmap v1173: 137 pgs: 29 unknown, 108 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:05 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:06.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:05 smithi012 ceph-mon[92029]: osdmap e973: 8 total, 8 up, 8 in 2024-09-10T18:13:06.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:05 smithi012 ceph-mon[92029]: pgmap v1173: 137 pgs: 29 unknown, 108 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:06.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:05 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:06.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:05 smithi089 ceph-mon[84132]: osdmap e973: 8 total, 8 up, 8 in 2024-09-10T18:13:06.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:05 smithi089 ceph-mon[84132]: pgmap v1173: 137 pgs: 29 unknown, 108 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:07.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:06 smithi012 ceph-mon[89611]: osdmap e974: 8 total, 8 up, 8 in 2024-09-10T18:13:07.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:06 smithi012 ceph-mon[92029]: osdmap e974: 8 total, 8 up, 8 in 2024-09-10T18:13:07.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:06 smithi089 ceph-mon[84132]: osdmap e974: 8 total, 8 up, 8 in 2024-09-10T18:13:08.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:07 smithi012 ceph-mon[89611]: osdmap e975: 8 total, 8 up, 8 in 2024-09-10T18:13:08.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:07 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3845154042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:08.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:07 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:08.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:07 smithi012 ceph-mon[89611]: pgmap v1176: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:07 smithi012 ceph-mon[92029]: osdmap e975: 8 total, 8 up, 8 in 2024-09-10T18:13:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:07 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3845154042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:07 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:08.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:07 smithi012 ceph-mon[92029]: pgmap v1176: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:07 smithi089 ceph-mon[84132]: osdmap e975: 8 total, 8 up, 8 in 2024-09-10T18:13:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:07 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3845154042' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:07 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:08.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:07 smithi089 ceph-mon[84132]: pgmap v1176: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:08.928 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_cas.dup_put (3021 ms) 2024-09-10T18:13:08.928 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_cas.get_wrong_data 2024-09-10T18:13:09.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:08 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:09.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:08 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:09.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:08 smithi012 ceph-mon[89611]: osdmap e976: 8 total, 8 up, 8 in 2024-09-10T18:13:09.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:08 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:09.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:08 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:09.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:08 smithi012 ceph-mon[92029]: osdmap e976: 8 total, 8 up, 8 in 2024-09-10T18:13:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:08 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:08 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:09.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:08 smithi089 ceph-mon[84132]: osdmap e976: 8 total, 8 up, 8 in 2024-09-10T18:13:10.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:09 smithi012 ceph-mon[89611]: osdmap e977: 8 total, 8 up, 8 in 2024-09-10T18:13:10.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:09 smithi012 ceph-mon[89611]: pgmap v1179: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:10.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:09 smithi012 ceph-mon[92029]: osdmap e977: 8 total, 8 up, 8 in 2024-09-10T18:13:10.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:09 smithi012 ceph-mon[92029]: pgmap v1179: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:10.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:09 smithi089 ceph-mon[84132]: osdmap e977: 8 total, 8 up, 8 in 2024-09-10T18:13:10.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:09 smithi089 ceph-mon[84132]: pgmap v1179: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:10 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:11.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:10 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:11.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:10 smithi012 ceph-mon[89611]: osdmap e978: 8 total, 8 up, 8 in 2024-09-10T18:13:11.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:10 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3682886156' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:10 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:10 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:10 smithi012 ceph-mon[92029]: osdmap e978: 8 total, 8 up, 8 in 2024-09-10T18:13:11.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:10 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3682886156' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:10 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:10 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:10 smithi089 ceph-mon[84132]: osdmap e978: 8 total, 8 up, 8 in 2024-09-10T18:13:11.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:10 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3682886156' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:11.957 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_cas.get_wrong_data (3027 ms) 2024-09-10T18:13:11.957 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 5 tests from cls_cas (15015 ms total) 2024-09-10T18:13:11.957 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:13:11.957 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 1 test from chunk_refs_t 2024-09-10T18:13:11.958 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] chunk_refs_t.size 2024-09-10T18:13:11.958 INFO:tasks.workunit.client.0.smithi012.stdout:1 60 by_object 2024-09-10T18:13:11.958 INFO:tasks.workunit.client.0.smithi012.stdout:2 103 by_object 2024-09-10T18:13:11.958 INFO:tasks.workunit.client.0.smithi012.stdout:4 189 by_object 2024-09-10T18:13:11.959 INFO:tasks.workunit.client.0.smithi012.stdout:8 361 by_object 2024-09-10T18:13:11.959 INFO:tasks.workunit.client.0.smithi012.stdout:16 112 by_hash(32 bits) 2024-09-10T18:13:11.959 INFO:tasks.workunit.client.0.smithi012.stdout:32 208 by_hash(32 bits) 2024-09-10T18:13:11.959 INFO:tasks.workunit.client.0.smithi012.stdout:64 400 by_hash(32 bits) 2024-09-10T18:13:11.960 INFO:tasks.workunit.client.0.smithi012.stdout:128 509 by_hash(10 bits) 2024-09-10T18:13:11.960 INFO:tasks.workunit.client.0.smithi012.stdout:256 499 by_hash(7 bits) 2024-09-10T18:13:11.961 INFO:tasks.workunit.client.0.smithi012.stdout:512 462 by_hash(5 bits) 2024-09-10T18:13:11.961 INFO:tasks.workunit.client.0.smithi012.stdout:1024 466 by_hash(5 bits) 2024-09-10T18:13:11.961 INFO:tasks.workunit.client.0.smithi012.stdout:2048 466 by_hash(5 bits) 2024-09-10T18:13:11.961 INFO:tasks.workunit.client.0.smithi012.stdout:4096 470 by_hash(5 bits) 2024-09-10T18:13:11.961 INFO:tasks.workunit.client.0.smithi012.stdout:8192 498 by_hash(4 bits) 2024-09-10T18:13:11.961 INFO:tasks.workunit.client.0.smithi012.stdout:16384 278 by_hash(3 bits) 2024-09-10T18:13:11.962 INFO:tasks.workunit.client.0.smithi012.stdout:32768 337 by_hash(2 bits) 2024-09-10T18:13:11.967 INFO:tasks.workunit.client.0.smithi012.stdout:65536 367 by_hash(2 bits) 2024-09-10T18:13:11.974 INFO:tasks.workunit.client.0.smithi012.stdout:131072 387 by_hash(1 bits) 2024-09-10T18:13:11.989 INFO:tasks.workunit.client.0.smithi012.stdout:262144 331 by_pool 2024-09-10T18:13:12.017 INFO:tasks.workunit.client.0.smithi012.stdout:524288 21 count 2024-09-10T18:13:12.066 INFO:tasks.workunit.client.0.smithi012.stdout:1048576 21 count 2024-09-10T18:13:12.165 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] chunk_refs_t.size (210 ms) 2024-09-10T18:13:12.165 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 1 test from chunk_refs_t (210 ms total) 2024-09-10T18:13:12.165 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:13:12.165 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:13:12.165 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 6 tests from 2 test suites ran. (15225 ms total) 2024-09-10T18:13:12.165 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 6 tests. 2024-09-10T18:13:12.167 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T18:13:12.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:13:12.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:11 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3682886156' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:12.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:11 smithi012 ceph-mon[89611]: osdmap e979: 8 total, 8 up, 8 in 2024-09-10T18:13:12.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:11 smithi012 ceph-mon[89611]: pgmap v1182: 137 pgs: 3 creating+peering, 25 unknown, 109 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:12.231 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:11 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3682886156' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:12.231 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:11 smithi012 ceph-mon[92029]: osdmap e979: 8 total, 8 up, 8 in 2024-09-10T18:13:12.231 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:11 smithi012 ceph-mon[92029]: pgmap v1182: 137 pgs: 3 creating+peering, 25 unknown, 109 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:12.234 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-10T18:13:12.235 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-10T18:13:12.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:11 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3682886156' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131757-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:12.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:11 smithi089 ceph-mon[84132]: osdmap e979: 8 total, 8 up, 8 in 2024-09-10T18:13:12.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:11 smithi089 ceph-mon[84132]: pgmap v1182: 137 pgs: 3 creating+peering, 25 unknown, 109 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:12.307 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:13:12.307 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-10T18:13:12.307 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:13:13.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:12 smithi012 ceph-mon[89611]: osdmap e980: 8 total, 8 up, 8 in 2024-09-10T18:13:13.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:12 smithi012 ceph-mon[92029]: osdmap e980: 8 total, 8 up, 8 in 2024-09-10T18:13:13.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:12 smithi089 ceph-mon[84132]: osdmap e980: 8 total, 8 up, 8 in 2024-09-10T18:13:13.960 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 31 tests from CmpOmap 2024-09-10T18:13:13.960 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-10T18:13:13.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (13 ms) 2024-09-10T18:13:13.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-10T18:13:13.985 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (12 ms) 2024-09-10T18:13:13.986 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-10T18:13:13.989 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-10T18:13:13.989 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-10T18:13:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-10T18:13:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-10T18:13:13.998 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-10T18:13:13.998 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-10T18:13:14.006 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64 (9 ms) 2024-09-10T18:13:14.006 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-10T18:13:14.010 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-10T18:13:14.010 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-10T18:13:14.012 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-10T18:13:14.013 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-10T18:13:14.015 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-09-10T18:13:14.015 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-10T18:13:14.019 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (3 ms) 2024-09-10T18:13:14.019 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-10T18:13:14.020 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-10T18:13:14.020 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-10T18:13:14.020 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-10T18:13:14.020 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-10T18:13:14.027 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-09-10T18:13:14.027 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-10T18:13:14.033 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-10T18:13:14.033 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-10T18:13:14.040 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-10T18:13:14.040 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-10T18:13:14.048 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (8 ms) 2024-09-10T18:13:14.048 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-10T18:13:14.055 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_str (7 ms) 2024-09-10T18:13:14.055 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-10T18:13:14.063 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-10T18:13:14.063 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-10T18:13:14.065 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-10T18:13:14.065 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-10T18:13:14.068 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-10T18:13:14.068 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-10T18:13:14.069 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-10T18:13:14.069 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-10T18:13:14.069 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-10T18:13:14.069 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-10T18:13:14.077 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-10T18:13:14.077 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-10T18:13:14.083 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-10T18:13:14.084 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-10T18:13:14.091 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-10T18:13:14.091 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-10T18:13:14.102 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-10T18:13:14.102 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-10T18:13:14.102 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-10T18:13:14.102 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-10T18:13:14.103 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-10T18:13:14.103 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-10T18:13:14.104 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-10T18:13:14.104 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-10T18:13:14.105 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-10T18:13:14.105 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-10T18:13:14.113 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (9 ms) 2024-09-10T18:13:14.113 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 31 tests from CmpOmap (154 ms total) 2024-09-10T18:13:14.113 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:13:14.114 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:13:14.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[92029]: osdmap e981: 8 total, 8 up, 8 in 2024-09-10T18:13:14.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3048333699' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[92029]: pgmap v1185: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[92029]: osdmap e982: 8 total, 8 up, 8 in 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[89611]: osdmap e981: 8 total, 8 up, 8 in 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3048333699' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[89611]: pgmap v1185: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:14.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:13 smithi012 ceph-mon[89611]: osdmap e982: 8 total, 8 up, 8 in 2024-09-10T18:13:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:13 smithi089 ceph-mon[84132]: osdmap e981: 8 total, 8 up, 8 in 2024-09-10T18:13:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:13 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3048333699' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:13 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:13 smithi089 ceph-mon[84132]: pgmap v1185: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:13 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131880-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:14.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:13 smithi089 ceph-mon[84132]: osdmap e982: 8 total, 8 up, 8 in 2024-09-10T18:13:14.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:13:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:13:14] "GET /metrics HTTP/1.1" 200 36441 "" "Prometheus/2.51.0" 2024-09-10T18:13:14.982 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 31 tests from 1 test suite ran. (2675 ms total) 2024-09-10T18:13:14.982 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 31 tests. 2024-09-10T18:13:14.985 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T18:13:14.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:13:15.056 INFO:tasks.workunit:Running workunit cls/test_cls_hello.sh... 2024-09-10T18:13:15.057 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_hello.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_hello.sh 2024-09-10T18:13:15.131 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:13:15.132 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-10T18:13:15.132 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:13:15.132 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 6 tests from ClsHello 2024-09-10T18:13:15.132 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsHello.SayHello 2024-09-10T18:13:15.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:14 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:15.284 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:14 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:15.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:14 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:15 smithi012 ceph-mon[89611]: osdmap e983: 8 total, 8 up, 8 in 2024-09-10T18:13:16.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:15 smithi012 ceph-mon[89611]: pgmap v1188: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:16.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:15 smithi012 ceph-mon[92029]: osdmap e983: 8 total, 8 up, 8 in 2024-09-10T18:13:16.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:15 smithi012 ceph-mon[92029]: pgmap v1188: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:15 smithi089 ceph-mon[84132]: osdmap e983: 8 total, 8 up, 8 in 2024-09-10T18:13:16.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:15 smithi089 ceph-mon[84132]: pgmap v1188: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:17.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[89611]: osdmap e984: 8 total, 8 up, 8 in 2024-09-10T18:13:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1377514678' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:17.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:17.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[92029]: osdmap e984: 8 total, 8 up, 8 in 2024-09-10T18:13:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1377514678' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:17.286 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:16 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:16 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:16 smithi089 ceph-mon[84132]: osdmap e984: 8 total, 8 up, 8 in 2024-09-10T18:13:17.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:16 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1377514678' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:17.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:16 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:17.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:18.018 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsHello.SayHello (2886 ms) 2024-09-10T18:13:18.018 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsHello.RecordHello 2024-09-10T18:13:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:18 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:18 smithi012 ceph-mon[89611]: osdmap e985: 8 total, 8 up, 8 in 2024-09-10T18:13:18.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:18 smithi012 ceph-mon[89611]: pgmap v1191: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:18 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:18 smithi012 ceph-mon[92029]: osdmap e985: 8 total, 8 up, 8 in 2024-09-10T18:13:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:18 smithi012 ceph-mon[92029]: pgmap v1191: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:18 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:18 smithi089 ceph-mon[84132]: osdmap e985: 8 total, 8 up, 8 in 2024-09-10T18:13:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:18 smithi089 ceph-mon[84132]: pgmap v1191: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:19.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:19 smithi012 ceph-mon[89611]: osdmap e986: 8 total, 8 up, 8 in 2024-09-10T18:13:19.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:19 smithi012 ceph-mon[92029]: osdmap e986: 8 total, 8 up, 8 in 2024-09-10T18:13:19.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:19 smithi089 ceph-mon[84132]: osdmap e986: 8 total, 8 up, 8 in 2024-09-10T18:13:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:20 smithi012 ceph-mon[89611]: osdmap e987: 8 total, 8 up, 8 in 2024-09-10T18:13:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:20 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2305917230' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:20 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:20.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:20 smithi012 ceph-mon[89611]: pgmap v1194: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:20 smithi012 ceph-mon[92029]: osdmap e987: 8 total, 8 up, 8 in 2024-09-10T18:13:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:20 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2305917230' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:20 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:20.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:20 smithi012 ceph-mon[92029]: pgmap v1194: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:20.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:20 smithi089 ceph-mon[84132]: osdmap e987: 8 total, 8 up, 8 in 2024-09-10T18:13:20.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:20 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2305917230' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:20.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:20 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:20.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:20 smithi089 ceph-mon[84132]: pgmap v1194: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:21.037 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsHello.RecordHello (3019 ms) 2024-09-10T18:13:21.037 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsHello.WriteReturnData 2024-09-10T18:13:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:21 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:21 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:21 smithi089 ceph-mon[84132]: osdmap e988: 8 total, 8 up, 8 in 2024-09-10T18:13:21.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:21 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:21.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:21 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:21.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:21 smithi012 ceph-mon[89611]: osdmap e988: 8 total, 8 up, 8 in 2024-09-10T18:13:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:21 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:21 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:21.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:21 smithi012 ceph-mon[92029]: osdmap e988: 8 total, 8 up, 8 in 2024-09-10T18:13:22.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:22 smithi012 ceph-mon[89611]: osdmap e989: 8 total, 8 up, 8 in 2024-09-10T18:13:22.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:22 smithi012 ceph-mon[89611]: pgmap v1197: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:22.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:22 smithi012 ceph-mon[92029]: osdmap e989: 8 total, 8 up, 8 in 2024-09-10T18:13:22.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:22 smithi012 ceph-mon[92029]: pgmap v1197: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:22.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:22 smithi089 ceph-mon[84132]: osdmap e989: 8 total, 8 up, 8 in 2024-09-10T18:13:22.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:22 smithi089 ceph-mon[84132]: pgmap v1197: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:23.061 INFO:tasks.workunit.client.0.smithi012.stdout:require_osd_release = squid 2024-09-10T18:13:23.065 INFO:tasks.workunit.client.0.smithi012.stdout:0 2024-09-10T18:13:23.110 INFO:tasks.workunit.client.0.smithi012.stdout:1 2024-09-10T18:13:23.111 INFO:tasks.workunit.client.0.smithi012.stdout:2 2024-09-10T18:13:23.112 INFO:tasks.workunit.client.0.smithi012.stdout:3 2024-09-10T18:13:23.113 INFO:tasks.workunit.client.0.smithi012.stdout:4 2024-09-10T18:13:23.114 INFO:tasks.workunit.client.0.smithi012.stdout:5 2024-09-10T18:13:23.115 INFO:tasks.workunit.client.0.smithi012.stdout:6 2024-09-10T18:13:23.116 INFO:tasks.workunit.client.0.smithi012.stdout:7 2024-09-10T18:13:23.117 INFO:tasks.workunit.client.0.smithi012.stdout:8 2024-09-10T18:13:23.118 INFO:tasks.workunit.client.0.smithi012.stdout:9 2024-09-10T18:13:23.119 INFO:tasks.workunit.client.0.smithi012.stdout:10 2024-09-10T18:13:23.120 INFO:tasks.workunit.client.0.smithi012.stdout:11 2024-09-10T18:13:23.121 INFO:tasks.workunit.client.0.smithi012.stdout:12 2024-09-10T18:13:23.122 INFO:tasks.workunit.client.0.smithi012.stdout:13 2024-09-10T18:13:23.123 INFO:tasks.workunit.client.0.smithi012.stdout:14 2024-09-10T18:13:23.124 INFO:tasks.workunit.client.0.smithi012.stdout:15 2024-09-10T18:13:23.125 INFO:tasks.workunit.client.0.smithi012.stdout:16 2024-09-10T18:13:23.126 INFO:tasks.workunit.client.0.smithi012.stdout:17 2024-09-10T18:13:23.127 INFO:tasks.workunit.client.0.smithi012.stdout:18 2024-09-10T18:13:23.128 INFO:tasks.workunit.client.0.smithi012.stdout:19 2024-09-10T18:13:23.129 INFO:tasks.workunit.client.0.smithi012.stdout:20 2024-09-10T18:13:23.130 INFO:tasks.workunit.client.0.smithi012.stdout:21 2024-09-10T18:13:23.130 INFO:tasks.workunit.client.0.smithi012.stdout:22 2024-09-10T18:13:23.131 INFO:tasks.workunit.client.0.smithi012.stdout:23 2024-09-10T18:13:23.132 INFO:tasks.workunit.client.0.smithi012.stdout:24 2024-09-10T18:13:23.133 INFO:tasks.workunit.client.0.smithi012.stdout:25 2024-09-10T18:13:23.134 INFO:tasks.workunit.client.0.smithi012.stdout:26 2024-09-10T18:13:23.135 INFO:tasks.workunit.client.0.smithi012.stdout:27 2024-09-10T18:13:23.136 INFO:tasks.workunit.client.0.smithi012.stdout:28 2024-09-10T18:13:23.137 INFO:tasks.workunit.client.0.smithi012.stdout:29 2024-09-10T18:13:23.138 INFO:tasks.workunit.client.0.smithi012.stdout:30 2024-09-10T18:13:23.139 INFO:tasks.workunit.client.0.smithi012.stdout:31 2024-09-10T18:13:23.140 INFO:tasks.workunit.client.0.smithi012.stdout:32 2024-09-10T18:13:23.141 INFO:tasks.workunit.client.0.smithi012.stdout:33 2024-09-10T18:13:23.142 INFO:tasks.workunit.client.0.smithi012.stdout:34 2024-09-10T18:13:23.143 INFO:tasks.workunit.client.0.smithi012.stdout:35 2024-09-10T18:13:23.144 INFO:tasks.workunit.client.0.smithi012.stdout:36 2024-09-10T18:13:23.144 INFO:tasks.workunit.client.0.smithi012.stdout:37 2024-09-10T18:13:23.145 INFO:tasks.workunit.client.0.smithi012.stdout:38 2024-09-10T18:13:23.146 INFO:tasks.workunit.client.0.smithi012.stdout:39 2024-09-10T18:13:23.147 INFO:tasks.workunit.client.0.smithi012.stdout:40 2024-09-10T18:13:23.148 INFO:tasks.workunit.client.0.smithi012.stdout:41 2024-09-10T18:13:23.149 INFO:tasks.workunit.client.0.smithi012.stdout:42 2024-09-10T18:13:23.150 INFO:tasks.workunit.client.0.smithi012.stdout:43 2024-09-10T18:13:23.151 INFO:tasks.workunit.client.0.smithi012.stdout:44 2024-09-10T18:13:23.152 INFO:tasks.workunit.client.0.smithi012.stdout:45 2024-09-10T18:13:23.153 INFO:tasks.workunit.client.0.smithi012.stdout:46 2024-09-10T18:13:23.154 INFO:tasks.workunit.client.0.smithi012.stdout:47 2024-09-10T18:13:23.155 INFO:tasks.workunit.client.0.smithi012.stdout:48 2024-09-10T18:13:23.156 INFO:tasks.workunit.client.0.smithi012.stdout:49 2024-09-10T18:13:23.156 INFO:tasks.workunit.client.0.smithi012.stdout:50 2024-09-10T18:13:23.157 INFO:tasks.workunit.client.0.smithi012.stdout:51 2024-09-10T18:13:23.158 INFO:tasks.workunit.client.0.smithi012.stdout:52 2024-09-10T18:13:23.159 INFO:tasks.workunit.client.0.smithi012.stdout:53 2024-09-10T18:13:23.160 INFO:tasks.workunit.client.0.smithi012.stdout:54 2024-09-10T18:13:23.161 INFO:tasks.workunit.client.0.smithi012.stdout:55 2024-09-10T18:13:23.162 INFO:tasks.workunit.client.0.smithi012.stdout:56 2024-09-10T18:13:23.163 INFO:tasks.workunit.client.0.smithi012.stdout:57 2024-09-10T18:13:23.164 INFO:tasks.workunit.client.0.smithi012.stdout:58 2024-09-10T18:13:23.165 INFO:tasks.workunit.client.0.smithi012.stdout:59 2024-09-10T18:13:23.166 INFO:tasks.workunit.client.0.smithi012.stdout:60 2024-09-10T18:13:23.167 INFO:tasks.workunit.client.0.smithi012.stdout:61 2024-09-10T18:13:23.168 INFO:tasks.workunit.client.0.smithi012.stdout:62 2024-09-10T18:13:23.169 INFO:tasks.workunit.client.0.smithi012.stdout:63 2024-09-10T18:13:23.170 INFO:tasks.workunit.client.0.smithi012.stdout:64 2024-09-10T18:13:23.171 INFO:tasks.workunit.client.0.smithi012.stdout:65 2024-09-10T18:13:23.172 INFO:tasks.workunit.client.0.smithi012.stdout:66 2024-09-10T18:13:23.172 INFO:tasks.workunit.client.0.smithi012.stdout:67 2024-09-10T18:13:23.173 INFO:tasks.workunit.client.0.smithi012.stdout:68 2024-09-10T18:13:23.174 INFO:tasks.workunit.client.0.smithi012.stdout:69 2024-09-10T18:13:23.175 INFO:tasks.workunit.client.0.smithi012.stdout:70 2024-09-10T18:13:23.176 INFO:tasks.workunit.client.0.smithi012.stdout:71 2024-09-10T18:13:23.177 INFO:tasks.workunit.client.0.smithi012.stdout:72 2024-09-10T18:13:23.178 INFO:tasks.workunit.client.0.smithi012.stdout:73 2024-09-10T18:13:23.179 INFO:tasks.workunit.client.0.smithi012.stdout:74 2024-09-10T18:13:23.179 INFO:tasks.workunit.client.0.smithi012.stdout:75 2024-09-10T18:13:23.180 INFO:tasks.workunit.client.0.smithi012.stdout:76 2024-09-10T18:13:23.181 INFO:tasks.workunit.client.0.smithi012.stdout:77 2024-09-10T18:13:23.182 INFO:tasks.workunit.client.0.smithi012.stdout:78 2024-09-10T18:13:23.183 INFO:tasks.workunit.client.0.smithi012.stdout:79 2024-09-10T18:13:23.184 INFO:tasks.workunit.client.0.smithi012.stdout:80 2024-09-10T18:13:23.185 INFO:tasks.workunit.client.0.smithi012.stdout:81 2024-09-10T18:13:23.186 INFO:tasks.workunit.client.0.smithi012.stdout:82 2024-09-10T18:13:23.187 INFO:tasks.workunit.client.0.smithi012.stdout:83 2024-09-10T18:13:23.188 INFO:tasks.workunit.client.0.smithi012.stdout:84 2024-09-10T18:13:23.189 INFO:tasks.workunit.client.0.smithi012.stdout:85 2024-09-10T18:13:23.189 INFO:tasks.workunit.client.0.smithi012.stdout:86 2024-09-10T18:13:23.190 INFO:tasks.workunit.client.0.smithi012.stdout:87 2024-09-10T18:13:23.191 INFO:tasks.workunit.client.0.smithi012.stdout:88 2024-09-10T18:13:23.192 INFO:tasks.workunit.client.0.smithi012.stdout:89 2024-09-10T18:13:23.193 INFO:tasks.workunit.client.0.smithi012.stdout:90 2024-09-10T18:13:23.194 INFO:tasks.workunit.client.0.smithi012.stdout:91 2024-09-10T18:13:23.195 INFO:tasks.workunit.client.0.smithi012.stdout:92 2024-09-10T18:13:23.196 INFO:tasks.workunit.client.0.smithi012.stdout:93 2024-09-10T18:13:23.196 INFO:tasks.workunit.client.0.smithi012.stdout:94 2024-09-10T18:13:23.197 INFO:tasks.workunit.client.0.smithi012.stdout:95 2024-09-10T18:13:23.198 INFO:tasks.workunit.client.0.smithi012.stdout:96 2024-09-10T18:13:23.199 INFO:tasks.workunit.client.0.smithi012.stdout:97 2024-09-10T18:13:23.200 INFO:tasks.workunit.client.0.smithi012.stdout:98 2024-09-10T18:13:23.201 INFO:tasks.workunit.client.0.smithi012.stdout:99 2024-09-10T18:13:23.202 INFO:tasks.workunit.client.0.smithi012.stdout:100 2024-09-10T18:13:23.203 INFO:tasks.workunit.client.0.smithi012.stdout:101 2024-09-10T18:13:23.204 INFO:tasks.workunit.client.0.smithi012.stdout:102 2024-09-10T18:13:23.204 INFO:tasks.workunit.client.0.smithi012.stdout:103 2024-09-10T18:13:23.206 INFO:tasks.workunit.client.0.smithi012.stdout:104 2024-09-10T18:13:23.206 INFO:tasks.workunit.client.0.smithi012.stdout:105 2024-09-10T18:13:23.207 INFO:tasks.workunit.client.0.smithi012.stdout:106 2024-09-10T18:13:23.208 INFO:tasks.workunit.client.0.smithi012.stdout:107 2024-09-10T18:13:23.209 INFO:tasks.workunit.client.0.smithi012.stdout:108 2024-09-10T18:13:23.210 INFO:tasks.workunit.client.0.smithi012.stdout:109 2024-09-10T18:13:23.210 INFO:tasks.workunit.client.0.smithi012.stdout:110 2024-09-10T18:13:23.211 INFO:tasks.workunit.client.0.smithi012.stdout:111 2024-09-10T18:13:23.212 INFO:tasks.workunit.client.0.smithi012.stdout:112 2024-09-10T18:13:23.213 INFO:tasks.workunit.client.0.smithi012.stdout:113 2024-09-10T18:13:23.214 INFO:tasks.workunit.client.0.smithi012.stdout:114 2024-09-10T18:13:23.215 INFO:tasks.workunit.client.0.smithi012.stdout:115 2024-09-10T18:13:23.216 INFO:tasks.workunit.client.0.smithi012.stdout:116 2024-09-10T18:13:23.217 INFO:tasks.workunit.client.0.smithi012.stdout:117 2024-09-10T18:13:23.217 INFO:tasks.workunit.client.0.smithi012.stdout:118 2024-09-10T18:13:23.218 INFO:tasks.workunit.client.0.smithi012.stdout:119 2024-09-10T18:13:23.219 INFO:tasks.workunit.client.0.smithi012.stdout:120 2024-09-10T18:13:23.220 INFO:tasks.workunit.client.0.smithi012.stdout:121 2024-09-10T18:13:23.221 INFO:tasks.workunit.client.0.smithi012.stdout:122 2024-09-10T18:13:23.223 INFO:tasks.workunit.client.0.smithi012.stdout:123 2024-09-10T18:13:23.224 INFO:tasks.workunit.client.0.smithi012.stdout:124 2024-09-10T18:13:23.224 INFO:tasks.workunit.client.0.smithi012.stdout:125 2024-09-10T18:13:23.224 INFO:tasks.workunit.client.0.smithi012.stdout:126 2024-09-10T18:13:23.225 INFO:tasks.workunit.client.0.smithi012.stdout:127 2024-09-10T18:13:23.226 INFO:tasks.workunit.client.0.smithi012.stdout:128 2024-09-10T18:13:23.227 INFO:tasks.workunit.client.0.smithi012.stdout:129 2024-09-10T18:13:23.228 INFO:tasks.workunit.client.0.smithi012.stdout:130 2024-09-10T18:13:23.229 INFO:tasks.workunit.client.0.smithi012.stdout:131 2024-09-10T18:13:23.230 INFO:tasks.workunit.client.0.smithi012.stdout:132 2024-09-10T18:13:23.231 INFO:tasks.workunit.client.0.smithi012.stdout:133 2024-09-10T18:13:23.231 INFO:tasks.workunit.client.0.smithi012.stdout:134 2024-09-10T18:13:23.232 INFO:tasks.workunit.client.0.smithi012.stdout:135 2024-09-10T18:13:23.233 INFO:tasks.workunit.client.0.smithi012.stdout:136 2024-09-10T18:13:23.234 INFO:tasks.workunit.client.0.smithi012.stdout:137 2024-09-10T18:13:23.235 INFO:tasks.workunit.client.0.smithi012.stdout:138 2024-09-10T18:13:23.236 INFO:tasks.workunit.client.0.smithi012.stdout:139 2024-09-10T18:13:23.237 INFO:tasks.workunit.client.0.smithi012.stdout:140 2024-09-10T18:13:23.237 INFO:tasks.workunit.client.0.smithi012.stdout:141 2024-09-10T18:13:23.238 INFO:tasks.workunit.client.0.smithi012.stdout:142 2024-09-10T18:13:23.239 INFO:tasks.workunit.client.0.smithi012.stdout:143 2024-09-10T18:13:23.240 INFO:tasks.workunit.client.0.smithi012.stdout:144 2024-09-10T18:13:23.241 INFO:tasks.workunit.client.0.smithi012.stdout:145 2024-09-10T18:13:23.241 INFO:tasks.workunit.client.0.smithi012.stdout:146 2024-09-10T18:13:23.242 INFO:tasks.workunit.client.0.smithi012.stdout:147 2024-09-10T18:13:23.243 INFO:tasks.workunit.client.0.smithi012.stdout:148 2024-09-10T18:13:23.244 INFO:tasks.workunit.client.0.smithi012.stdout:149 2024-09-10T18:13:23.244 INFO:tasks.workunit.client.0.smithi012.stdout:150 2024-09-10T18:13:23.245 INFO:tasks.workunit.client.0.smithi012.stdout:151 2024-09-10T18:13:23.247 INFO:tasks.workunit.client.0.smithi012.stdout:152 2024-09-10T18:13:23.248 INFO:tasks.workunit.client.0.smithi012.stdout:153 2024-09-10T18:13:23.248 INFO:tasks.workunit.client.0.smithi012.stdout:154 2024-09-10T18:13:23.249 INFO:tasks.workunit.client.0.smithi012.stdout:155 2024-09-10T18:13:23.250 INFO:tasks.workunit.client.0.smithi012.stdout:156 2024-09-10T18:13:23.250 INFO:tasks.workunit.client.0.smithi012.stdout:157 2024-09-10T18:13:23.251 INFO:tasks.workunit.client.0.smithi012.stdout:158 2024-09-10T18:13:23.252 INFO:tasks.workunit.client.0.smithi012.stdout:159 2024-09-10T18:13:23.253 INFO:tasks.workunit.client.0.smithi012.stdout:160 2024-09-10T18:13:23.254 INFO:tasks.workunit.client.0.smithi012.stdout:161 2024-09-10T18:13:23.254 INFO:tasks.workunit.client.0.smithi012.stdout:162 2024-09-10T18:13:23.255 INFO:tasks.workunit.client.0.smithi012.stdout:163 2024-09-10T18:13:23.256 INFO:tasks.workunit.client.0.smithi012.stdout:164 2024-09-10T18:13:23.257 INFO:tasks.workunit.client.0.smithi012.stdout:165 2024-09-10T18:13:23.258 INFO:tasks.workunit.client.0.smithi012.stdout:166 2024-09-10T18:13:23.259 INFO:tasks.workunit.client.0.smithi012.stdout:167 2024-09-10T18:13:23.259 INFO:tasks.workunit.client.0.smithi012.stdout:168 2024-09-10T18:13:23.260 INFO:tasks.workunit.client.0.smithi012.stdout:169 2024-09-10T18:13:23.261 INFO:tasks.workunit.client.0.smithi012.stdout:170 2024-09-10T18:13:23.262 INFO:tasks.workunit.client.0.smithi012.stdout:171 2024-09-10T18:13:23.263 INFO:tasks.workunit.client.0.smithi012.stdout:172 2024-09-10T18:13:23.264 INFO:tasks.workunit.client.0.smithi012.stdout:173 2024-09-10T18:13:23.264 INFO:tasks.workunit.client.0.smithi012.stdout:174 2024-09-10T18:13:23.265 INFO:tasks.workunit.client.0.smithi012.stdout:175 2024-09-10T18:13:23.266 INFO:tasks.workunit.client.0.smithi012.stdout:176 2024-09-10T18:13:23.267 INFO:tasks.workunit.client.0.smithi012.stdout:177 2024-09-10T18:13:23.268 INFO:tasks.workunit.client.0.smithi012.stdout:178 2024-09-10T18:13:23.269 INFO:tasks.workunit.client.0.smithi012.stdout:179 2024-09-10T18:13:23.269 INFO:tasks.workunit.client.0.smithi012.stdout:180 2024-09-10T18:13:23.270 INFO:tasks.workunit.client.0.smithi012.stdout:181 2024-09-10T18:13:23.271 INFO:tasks.workunit.client.0.smithi012.stdout:182 2024-09-10T18:13:23.272 INFO:tasks.workunit.client.0.smithi012.stdout:183 2024-09-10T18:13:23.273 INFO:tasks.workunit.client.0.smithi012.stdout:184 2024-09-10T18:13:23.274 INFO:tasks.workunit.client.0.smithi012.stdout:185 2024-09-10T18:13:23.275 INFO:tasks.workunit.client.0.smithi012.stdout:186 2024-09-10T18:13:23.276 INFO:tasks.workunit.client.0.smithi012.stdout:187 2024-09-10T18:13:23.276 INFO:tasks.workunit.client.0.smithi012.stdout:188 2024-09-10T18:13:23.277 INFO:tasks.workunit.client.0.smithi012.stdout:189 2024-09-10T18:13:23.278 INFO:tasks.workunit.client.0.smithi012.stdout:190 2024-09-10T18:13:23.279 INFO:tasks.workunit.client.0.smithi012.stdout:191 2024-09-10T18:13:23.280 INFO:tasks.workunit.client.0.smithi012.stdout:192 2024-09-10T18:13:23.281 INFO:tasks.workunit.client.0.smithi012.stdout:193 2024-09-10T18:13:23.281 INFO:tasks.workunit.client.0.smithi012.stdout:194 2024-09-10T18:13:23.282 INFO:tasks.workunit.client.0.smithi012.stdout:195 2024-09-10T18:13:23.283 INFO:tasks.workunit.client.0.smithi012.stdout:196 2024-09-10T18:13:23.284 INFO:tasks.workunit.client.0.smithi012.stdout:197 2024-09-10T18:13:23.285 INFO:tasks.workunit.client.0.smithi012.stdout:198 2024-09-10T18:13:23.286 INFO:tasks.workunit.client.0.smithi012.stdout:199 2024-09-10T18:13:23.287 INFO:tasks.workunit.client.0.smithi012.stdout:200 2024-09-10T18:13:23.287 INFO:tasks.workunit.client.0.smithi012.stdout:201 2024-09-10T18:13:23.288 INFO:tasks.workunit.client.0.smithi012.stdout:202 2024-09-10T18:13:23.289 INFO:tasks.workunit.client.0.smithi012.stdout:203 2024-09-10T18:13:23.290 INFO:tasks.workunit.client.0.smithi012.stdout:204 2024-09-10T18:13:23.291 INFO:tasks.workunit.client.0.smithi012.stdout:205 2024-09-10T18:13:23.292 INFO:tasks.workunit.client.0.smithi012.stdout:206 2024-09-10T18:13:23.293 INFO:tasks.workunit.client.0.smithi012.stdout:207 2024-09-10T18:13:23.293 INFO:tasks.workunit.client.0.smithi012.stdout:208 2024-09-10T18:13:23.294 INFO:tasks.workunit.client.0.smithi012.stdout:209 2024-09-10T18:13:23.295 INFO:tasks.workunit.client.0.smithi012.stdout:210 2024-09-10T18:13:23.296 INFO:tasks.workunit.client.0.smithi012.stdout:211 2024-09-10T18:13:23.297 INFO:tasks.workunit.client.0.smithi012.stdout:212 2024-09-10T18:13:23.298 INFO:tasks.workunit.client.0.smithi012.stdout:213 2024-09-10T18:13:23.299 INFO:tasks.workunit.client.0.smithi012.stdout:214 2024-09-10T18:13:23.299 INFO:tasks.workunit.client.0.smithi012.stdout:215 2024-09-10T18:13:23.301 INFO:tasks.workunit.client.0.smithi012.stdout:216 2024-09-10T18:13:23.301 INFO:tasks.workunit.client.0.smithi012.stdout:217 2024-09-10T18:13:23.302 INFO:tasks.workunit.client.0.smithi012.stdout:218 2024-09-10T18:13:23.303 INFO:tasks.workunit.client.0.smithi012.stdout:219 2024-09-10T18:13:23.304 INFO:tasks.workunit.client.0.smithi012.stdout:220 2024-09-10T18:13:23.305 INFO:tasks.workunit.client.0.smithi012.stdout:221 2024-09-10T18:13:23.306 INFO:tasks.workunit.client.0.smithi012.stdout:222 2024-09-10T18:13:23.307 INFO:tasks.workunit.client.0.smithi012.stdout:223 2024-09-10T18:13:23.308 INFO:tasks.workunit.client.0.smithi012.stdout:224 2024-09-10T18:13:23.309 INFO:tasks.workunit.client.0.smithi012.stdout:225 2024-09-10T18:13:23.310 INFO:tasks.workunit.client.0.smithi012.stdout:226 2024-09-10T18:13:23.311 INFO:tasks.workunit.client.0.smithi012.stdout:227 2024-09-10T18:13:23.312 INFO:tasks.workunit.client.0.smithi012.stdout:228 2024-09-10T18:13:23.313 INFO:tasks.workunit.client.0.smithi012.stdout:229 2024-09-10T18:13:23.314 INFO:tasks.workunit.client.0.smithi012.stdout:230 2024-09-10T18:13:23.314 INFO:tasks.workunit.client.0.smithi012.stdout:231 2024-09-10T18:13:23.315 INFO:tasks.workunit.client.0.smithi012.stdout:232 2024-09-10T18:13:23.316 INFO:tasks.workunit.client.0.smithi012.stdout:233 2024-09-10T18:13:23.317 INFO:tasks.workunit.client.0.smithi012.stdout:234 2024-09-10T18:13:23.318 INFO:tasks.workunit.client.0.smithi012.stdout:235 2024-09-10T18:13:23.319 INFO:tasks.workunit.client.0.smithi012.stdout:236 2024-09-10T18:13:23.320 INFO:tasks.workunit.client.0.smithi012.stdout:237 2024-09-10T18:13:23.320 INFO:tasks.workunit.client.0.smithi012.stdout:238 2024-09-10T18:13:23.321 INFO:tasks.workunit.client.0.smithi012.stdout:239 2024-09-10T18:13:23.322 INFO:tasks.workunit.client.0.smithi012.stdout:240 2024-09-10T18:13:23.323 INFO:tasks.workunit.client.0.smithi012.stdout:241 2024-09-10T18:13:23.324 INFO:tasks.workunit.client.0.smithi012.stdout:242 2024-09-10T18:13:23.325 INFO:tasks.workunit.client.0.smithi012.stdout:243 2024-09-10T18:13:23.326 INFO:tasks.workunit.client.0.smithi012.stdout:244 2024-09-10T18:13:23.326 INFO:tasks.workunit.client.0.smithi012.stdout:245 2024-09-10T18:13:23.327 INFO:tasks.workunit.client.0.smithi012.stdout:246 2024-09-10T18:13:23.328 INFO:tasks.workunit.client.0.smithi012.stdout:247 2024-09-10T18:13:23.329 INFO:tasks.workunit.client.0.smithi012.stdout:248 2024-09-10T18:13:23.330 INFO:tasks.workunit.client.0.smithi012.stdout:249 2024-09-10T18:13:23.331 INFO:tasks.workunit.client.0.smithi012.stdout:250 2024-09-10T18:13:23.332 INFO:tasks.workunit.client.0.smithi012.stdout:251 2024-09-10T18:13:23.333 INFO:tasks.workunit.client.0.smithi012.stdout:252 2024-09-10T18:13:23.333 INFO:tasks.workunit.client.0.smithi012.stdout:253 2024-09-10T18:13:23.334 INFO:tasks.workunit.client.0.smithi012.stdout:254 2024-09-10T18:13:23.335 INFO:tasks.workunit.client.0.smithi012.stdout:255 2024-09-10T18:13:23.336 INFO:tasks.workunit.client.0.smithi012.stdout:256 2024-09-10T18:13:23.337 INFO:tasks.workunit.client.0.smithi012.stdout:257 2024-09-10T18:13:23.338 INFO:tasks.workunit.client.0.smithi012.stdout:258 2024-09-10T18:13:23.339 INFO:tasks.workunit.client.0.smithi012.stdout:259 2024-09-10T18:13:23.340 INFO:tasks.workunit.client.0.smithi012.stdout:260 2024-09-10T18:13:23.341 INFO:tasks.workunit.client.0.smithi012.stdout:261 2024-09-10T18:13:23.342 INFO:tasks.workunit.client.0.smithi012.stdout:262 2024-09-10T18:13:23.343 INFO:tasks.workunit.client.0.smithi012.stdout:263 2024-09-10T18:13:23.343 INFO:tasks.workunit.client.0.smithi012.stdout:264 2024-09-10T18:13:23.344 INFO:tasks.workunit.client.0.smithi012.stdout:265 2024-09-10T18:13:23.345 INFO:tasks.workunit.client.0.smithi012.stdout:266 2024-09-10T18:13:23.346 INFO:tasks.workunit.client.0.smithi012.stdout:267 2024-09-10T18:13:23.347 INFO:tasks.workunit.client.0.smithi012.stdout:268 2024-09-10T18:13:23.348 INFO:tasks.workunit.client.0.smithi012.stdout:269 2024-09-10T18:13:23.349 INFO:tasks.workunit.client.0.smithi012.stdout:270 2024-09-10T18:13:23.350 INFO:tasks.workunit.client.0.smithi012.stdout:271 2024-09-10T18:13:23.351 INFO:tasks.workunit.client.0.smithi012.stdout:272 2024-09-10T18:13:23.352 INFO:tasks.workunit.client.0.smithi012.stdout:273 2024-09-10T18:13:23.353 INFO:tasks.workunit.client.0.smithi012.stdout:274 2024-09-10T18:13:23.354 INFO:tasks.workunit.client.0.smithi012.stdout:275 2024-09-10T18:13:23.355 INFO:tasks.workunit.client.0.smithi012.stdout:276 2024-09-10T18:13:23.355 INFO:tasks.workunit.client.0.smithi012.stdout:277 2024-09-10T18:13:23.356 INFO:tasks.workunit.client.0.smithi012.stdout:278 2024-09-10T18:13:23.357 INFO:tasks.workunit.client.0.smithi012.stdout:279 2024-09-10T18:13:23.358 INFO:tasks.workunit.client.0.smithi012.stdout:280 2024-09-10T18:13:23.359 INFO:tasks.workunit.client.0.smithi012.stdout:281 2024-09-10T18:13:23.360 INFO:tasks.workunit.client.0.smithi012.stdout:282 2024-09-10T18:13:23.361 INFO:tasks.workunit.client.0.smithi012.stdout:283 2024-09-10T18:13:23.362 INFO:tasks.workunit.client.0.smithi012.stdout:284 2024-09-10T18:13:23.363 INFO:tasks.workunit.client.0.smithi012.stdout:285 2024-09-10T18:13:23.364 INFO:tasks.workunit.client.0.smithi012.stdout:286 2024-09-10T18:13:23.365 INFO:tasks.workunit.client.0.smithi012.stdout:287 2024-09-10T18:13:23.365 INFO:tasks.workunit.client.0.smithi012.stdout:288 2024-09-10T18:13:23.366 INFO:tasks.workunit.client.0.smithi012.stdout:289 2024-09-10T18:13:23.367 INFO:tasks.workunit.client.0.smithi012.stdout:290 2024-09-10T18:13:23.368 INFO:tasks.workunit.client.0.smithi012.stdout:291 2024-09-10T18:13:23.369 INFO:tasks.workunit.client.0.smithi012.stdout:292 2024-09-10T18:13:23.370 INFO:tasks.workunit.client.0.smithi012.stdout:293 2024-09-10T18:13:23.371 INFO:tasks.workunit.client.0.smithi012.stdout:294 2024-09-10T18:13:23.372 INFO:tasks.workunit.client.0.smithi012.stdout:295 2024-09-10T18:13:23.373 INFO:tasks.workunit.client.0.smithi012.stdout:296 2024-09-10T18:13:23.374 INFO:tasks.workunit.client.0.smithi012.stdout:297 2024-09-10T18:13:23.375 INFO:tasks.workunit.client.0.smithi012.stdout:298 2024-09-10T18:13:23.375 INFO:tasks.workunit.client.0.smithi012.stdout:299 2024-09-10T18:13:23.376 INFO:tasks.workunit.client.0.smithi012.stdout:300 2024-09-10T18:13:23.377 INFO:tasks.workunit.client.0.smithi012.stdout:301 2024-09-10T18:13:23.378 INFO:tasks.workunit.client.0.smithi012.stdout:302 2024-09-10T18:13:23.379 INFO:tasks.workunit.client.0.smithi012.stdout:303 2024-09-10T18:13:23.380 INFO:tasks.workunit.client.0.smithi012.stdout:304 2024-09-10T18:13:23.381 INFO:tasks.workunit.client.0.smithi012.stdout:305 2024-09-10T18:13:23.382 INFO:tasks.workunit.client.0.smithi012.stdout:306 2024-09-10T18:13:23.383 INFO:tasks.workunit.client.0.smithi012.stdout:307 2024-09-10T18:13:23.384 INFO:tasks.workunit.client.0.smithi012.stdout:308 2024-09-10T18:13:23.385 INFO:tasks.workunit.client.0.smithi012.stdout:309 2024-09-10T18:13:23.386 INFO:tasks.workunit.client.0.smithi012.stdout:310 2024-09-10T18:13:23.386 INFO:tasks.workunit.client.0.smithi012.stdout:311 2024-09-10T18:13:23.387 INFO:tasks.workunit.client.0.smithi012.stdout:312 2024-09-10T18:13:23.388 INFO:tasks.workunit.client.0.smithi012.stdout:313 2024-09-10T18:13:23.389 INFO:tasks.workunit.client.0.smithi012.stdout:314 2024-09-10T18:13:23.390 INFO:tasks.workunit.client.0.smithi012.stdout:315 2024-09-10T18:13:23.391 INFO:tasks.workunit.client.0.smithi012.stdout:316 2024-09-10T18:13:23.392 INFO:tasks.workunit.client.0.smithi012.stdout:317 2024-09-10T18:13:23.393 INFO:tasks.workunit.client.0.smithi012.stdout:318 2024-09-10T18:13:23.394 INFO:tasks.workunit.client.0.smithi012.stdout:319 2024-09-10T18:13:23.395 INFO:tasks.workunit.client.0.smithi012.stdout:320 2024-09-10T18:13:23.396 INFO:tasks.workunit.client.0.smithi012.stdout:321 2024-09-10T18:13:23.397 INFO:tasks.workunit.client.0.smithi012.stdout:322 2024-09-10T18:13:23.399 INFO:tasks.workunit.client.0.smithi012.stdout:323 2024-09-10T18:13:23.399 INFO:tasks.workunit.client.0.smithi012.stdout:324 2024-09-10T18:13:23.400 INFO:tasks.workunit.client.0.smithi012.stdout:325 2024-09-10T18:13:23.401 INFO:tasks.workunit.client.0.smithi012.stdout:326 2024-09-10T18:13:23.402 INFO:tasks.workunit.client.0.smithi012.stdout:327 2024-09-10T18:13:23.403 INFO:tasks.workunit.client.0.smithi012.stdout:328 2024-09-10T18:13:23.403 INFO:tasks.workunit.client.0.smithi012.stdout:329 2024-09-10T18:13:23.404 INFO:tasks.workunit.client.0.smithi012.stdout:330 2024-09-10T18:13:23.405 INFO:tasks.workunit.client.0.smithi012.stdout:331 2024-09-10T18:13:23.406 INFO:tasks.workunit.client.0.smithi012.stdout:332 2024-09-10T18:13:23.408 INFO:tasks.workunit.client.0.smithi012.stdout:333 2024-09-10T18:13:23.408 INFO:tasks.workunit.client.0.smithi012.stdout:334 2024-09-10T18:13:23.410 INFO:tasks.workunit.client.0.smithi012.stdout:335 2024-09-10T18:13:23.410 INFO:tasks.workunit.client.0.smithi012.stdout:336 2024-09-10T18:13:23.412 INFO:tasks.workunit.client.0.smithi012.stdout:337 2024-09-10T18:13:23.413 INFO:tasks.workunit.client.0.smithi012.stdout:338 2024-09-10T18:13:23.414 INFO:tasks.workunit.client.0.smithi012.stdout:339 2024-09-10T18:13:23.415 INFO:tasks.workunit.client.0.smithi012.stdout:340 2024-09-10T18:13:23.416 INFO:tasks.workunit.client.0.smithi012.stdout:341 2024-09-10T18:13:23.417 INFO:tasks.workunit.client.0.smithi012.stdout:342 2024-09-10T18:13:23.422 INFO:tasks.workunit.client.0.smithi012.stdout:343 2024-09-10T18:13:23.423 INFO:tasks.workunit.client.0.smithi012.stdout:344 2024-09-10T18:13:23.424 INFO:tasks.workunit.client.0.smithi012.stdout:345 2024-09-10T18:13:23.425 INFO:tasks.workunit.client.0.smithi012.stdout:346 2024-09-10T18:13:23.426 INFO:tasks.workunit.client.0.smithi012.stdout:347 2024-09-10T18:13:23.428 INFO:tasks.workunit.client.0.smithi012.stdout:348 2024-09-10T18:13:23.428 INFO:tasks.workunit.client.0.smithi012.stdout:349 2024-09-10T18:13:23.429 INFO:tasks.workunit.client.0.smithi012.stdout:350 2024-09-10T18:13:23.430 INFO:tasks.workunit.client.0.smithi012.stdout:351 2024-09-10T18:13:23.431 INFO:tasks.workunit.client.0.smithi012.stdout:352 2024-09-10T18:13:23.432 INFO:tasks.workunit.client.0.smithi012.stdout:353 2024-09-10T18:13:23.433 INFO:tasks.workunit.client.0.smithi012.stdout:354 2024-09-10T18:13:23.434 INFO:tasks.workunit.client.0.smithi012.stdout:355 2024-09-10T18:13:23.435 INFO:tasks.workunit.client.0.smithi012.stdout:356 2024-09-10T18:13:23.436 INFO:tasks.workunit.client.0.smithi012.stdout:357 2024-09-10T18:13:23.437 INFO:tasks.workunit.client.0.smithi012.stdout:358 2024-09-10T18:13:23.438 INFO:tasks.workunit.client.0.smithi012.stdout:359 2024-09-10T18:13:23.439 INFO:tasks.workunit.client.0.smithi012.stdout:360 2024-09-10T18:13:23.440 INFO:tasks.workunit.client.0.smithi012.stdout:361 2024-09-10T18:13:23.441 INFO:tasks.workunit.client.0.smithi012.stdout:362 2024-09-10T18:13:23.443 INFO:tasks.workunit.client.0.smithi012.stdout:363 2024-09-10T18:13:23.443 INFO:tasks.workunit.client.0.smithi012.stdout:364 2024-09-10T18:13:23.444 INFO:tasks.workunit.client.0.smithi012.stdout:365 2024-09-10T18:13:23.445 INFO:tasks.workunit.client.0.smithi012.stdout:366 2024-09-10T18:13:23.446 INFO:tasks.workunit.client.0.smithi012.stdout:367 2024-09-10T18:13:23.447 INFO:tasks.workunit.client.0.smithi012.stdout:368 2024-09-10T18:13:23.448 INFO:tasks.workunit.client.0.smithi012.stdout:369 2024-09-10T18:13:23.449 INFO:tasks.workunit.client.0.smithi012.stdout:370 2024-09-10T18:13:23.450 INFO:tasks.workunit.client.0.smithi012.stdout:371 2024-09-10T18:13:23.451 INFO:tasks.workunit.client.0.smithi012.stdout:372 2024-09-10T18:13:23.452 INFO:tasks.workunit.client.0.smithi012.stdout:373 2024-09-10T18:13:23.453 INFO:tasks.workunit.client.0.smithi012.stdout:374 2024-09-10T18:13:23.455 INFO:tasks.workunit.client.0.smithi012.stdout:375 2024-09-10T18:13:23.455 INFO:tasks.workunit.client.0.smithi012.stdout:376 2024-09-10T18:13:23.456 INFO:tasks.workunit.client.0.smithi012.stdout:377 2024-09-10T18:13:23.457 INFO:tasks.workunit.client.0.smithi012.stdout:378 2024-09-10T18:13:23.458 INFO:tasks.workunit.client.0.smithi012.stdout:379 2024-09-10T18:13:23.459 INFO:tasks.workunit.client.0.smithi012.stdout:380 2024-09-10T18:13:23.461 INFO:tasks.workunit.client.0.smithi012.stdout:381 2024-09-10T18:13:23.462 INFO:tasks.workunit.client.0.smithi012.stdout:382 2024-09-10T18:13:23.463 INFO:tasks.workunit.client.0.smithi012.stdout:383 2024-09-10T18:13:23.464 INFO:tasks.workunit.client.0.smithi012.stdout:384 2024-09-10T18:13:23.465 INFO:tasks.workunit.client.0.smithi012.stdout:385 2024-09-10T18:13:23.466 INFO:tasks.workunit.client.0.smithi012.stdout:386 2024-09-10T18:13:23.467 INFO:tasks.workunit.client.0.smithi012.stdout:387 2024-09-10T18:13:23.469 INFO:tasks.workunit.client.0.smithi012.stdout:388 2024-09-10T18:13:23.470 INFO:tasks.workunit.client.0.smithi012.stdout:389 2024-09-10T18:13:23.471 INFO:tasks.workunit.client.0.smithi012.stdout:390 2024-09-10T18:13:23.472 INFO:tasks.workunit.client.0.smithi012.stdout:391 2024-09-10T18:13:23.473 INFO:tasks.workunit.client.0.smithi012.stdout:392 2024-09-10T18:13:23.474 INFO:tasks.workunit.client.0.smithi012.stdout:393 2024-09-10T18:13:23.475 INFO:tasks.workunit.client.0.smithi012.stdout:394 2024-09-10T18:13:23.476 INFO:tasks.workunit.client.0.smithi012.stdout:395 2024-09-10T18:13:23.477 INFO:tasks.workunit.client.0.smithi012.stdout:396 2024-09-10T18:13:23.478 INFO:tasks.workunit.client.0.smithi012.stdout:397 2024-09-10T18:13:23.479 INFO:tasks.workunit.client.0.smithi012.stdout:398 2024-09-10T18:13:23.480 INFO:tasks.workunit.client.0.smithi012.stdout:399 2024-09-10T18:13:23.481 INFO:tasks.workunit.client.0.smithi012.stdout:400 2024-09-10T18:13:23.482 INFO:tasks.workunit.client.0.smithi012.stdout:401 2024-09-10T18:13:23.483 INFO:tasks.workunit.client.0.smithi012.stdout:402 2024-09-10T18:13:23.485 INFO:tasks.workunit.client.0.smithi012.stdout:403 2024-09-10T18:13:23.486 INFO:tasks.workunit.client.0.smithi012.stdout:404 2024-09-10T18:13:23.487 INFO:tasks.workunit.client.0.smithi012.stdout:405 2024-09-10T18:13:23.488 INFO:tasks.workunit.client.0.smithi012.stdout:406 2024-09-10T18:13:23.489 INFO:tasks.workunit.client.0.smithi012.stdout:407 2024-09-10T18:13:23.490 INFO:tasks.workunit.client.0.smithi012.stdout:408 2024-09-10T18:13:23.491 INFO:tasks.workunit.client.0.smithi012.stdout:409 2024-09-10T18:13:23.492 INFO:tasks.workunit.client.0.smithi012.stdout:410 2024-09-10T18:13:23.494 INFO:tasks.workunit.client.0.smithi012.stdout:411 2024-09-10T18:13:23.495 INFO:tasks.workunit.client.0.smithi012.stdout:412 2024-09-10T18:13:23.497 INFO:tasks.workunit.client.0.smithi012.stdout:413 2024-09-10T18:13:23.498 INFO:tasks.workunit.client.0.smithi012.stdout:414 2024-09-10T18:13:23.499 INFO:tasks.workunit.client.0.smithi012.stdout:415 2024-09-10T18:13:23.500 INFO:tasks.workunit.client.0.smithi012.stdout:416 2024-09-10T18:13:23.501 INFO:tasks.workunit.client.0.smithi012.stdout:417 2024-09-10T18:13:23.502 INFO:tasks.workunit.client.0.smithi012.stdout:418 2024-09-10T18:13:23.503 INFO:tasks.workunit.client.0.smithi012.stdout:419 2024-09-10T18:13:23.505 INFO:tasks.workunit.client.0.smithi012.stdout:420 2024-09-10T18:13:23.506 INFO:tasks.workunit.client.0.smithi012.stdout:421 2024-09-10T18:13:23.507 INFO:tasks.workunit.client.0.smithi012.stdout:422 2024-09-10T18:13:23.508 INFO:tasks.workunit.client.0.smithi012.stdout:423 2024-09-10T18:13:23.509 INFO:tasks.workunit.client.0.smithi012.stdout:424 2024-09-10T18:13:23.510 INFO:tasks.workunit.client.0.smithi012.stdout:425 2024-09-10T18:13:23.511 INFO:tasks.workunit.client.0.smithi012.stdout:426 2024-09-10T18:13:23.512 INFO:tasks.workunit.client.0.smithi012.stdout:427 2024-09-10T18:13:23.513 INFO:tasks.workunit.client.0.smithi012.stdout:428 2024-09-10T18:13:23.514 INFO:tasks.workunit.client.0.smithi012.stdout:429 2024-09-10T18:13:23.515 INFO:tasks.workunit.client.0.smithi012.stdout:430 2024-09-10T18:13:23.516 INFO:tasks.workunit.client.0.smithi012.stdout:431 2024-09-10T18:13:23.518 INFO:tasks.workunit.client.0.smithi012.stdout:432 2024-09-10T18:13:23.519 INFO:tasks.workunit.client.0.smithi012.stdout:433 2024-09-10T18:13:23.520 INFO:tasks.workunit.client.0.smithi012.stdout:434 2024-09-10T18:13:23.521 INFO:tasks.workunit.client.0.smithi012.stdout:435 2024-09-10T18:13:23.522 INFO:tasks.workunit.client.0.smithi012.stdout:436 2024-09-10T18:13:23.523 INFO:tasks.workunit.client.0.smithi012.stdout:437 2024-09-10T18:13:23.525 INFO:tasks.workunit.client.0.smithi012.stdout:438 2024-09-10T18:13:23.526 INFO:tasks.workunit.client.0.smithi012.stdout:439 2024-09-10T18:13:23.527 INFO:tasks.workunit.client.0.smithi012.stdout:440 2024-09-10T18:13:23.528 INFO:tasks.workunit.client.0.smithi012.stdout:441 2024-09-10T18:13:23.529 INFO:tasks.workunit.client.0.smithi012.stdout:442 2024-09-10T18:13:23.530 INFO:tasks.workunit.client.0.smithi012.stdout:443 2024-09-10T18:13:23.531 INFO:tasks.workunit.client.0.smithi012.stdout:444 2024-09-10T18:13:23.533 INFO:tasks.workunit.client.0.smithi012.stdout:445 2024-09-10T18:13:23.534 INFO:tasks.workunit.client.0.smithi012.stdout:446 2024-09-10T18:13:23.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:23.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:23.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[89611]: osdmap e990: 8 total, 8 up, 8 in 2024-09-10T18:13:23.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/762990978' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:23.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:23.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:23.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:23.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[92029]: osdmap e990: 8 total, 8 up, 8 in 2024-09-10T18:13:23.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/762990978' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:23.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:23 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:23.535 INFO:tasks.workunit.client.0.smithi012.stdout:447 2024-09-10T18:13:23.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:23 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:23.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:23 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:23.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:23 smithi089 ceph-mon[84132]: osdmap e990: 8 total, 8 up, 8 in 2024-09-10T18:13:23.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:23 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/762990978' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:23.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:23 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:23.536 INFO:tasks.workunit.client.0.smithi012.stdout:448 2024-09-10T18:13:23.537 INFO:tasks.workunit.client.0.smithi012.stdout:449 2024-09-10T18:13:23.538 INFO:tasks.workunit.client.0.smithi012.stdout:450 2024-09-10T18:13:23.539 INFO:tasks.workunit.client.0.smithi012.stdout:451 2024-09-10T18:13:23.540 INFO:tasks.workunit.client.0.smithi012.stdout:452 2024-09-10T18:13:23.541 INFO:tasks.workunit.client.0.smithi012.stdout:453 2024-09-10T18:13:23.542 INFO:tasks.workunit.client.0.smithi012.stdout:454 2024-09-10T18:13:23.543 INFO:tasks.workunit.client.0.smithi012.stdout:455 2024-09-10T18:13:23.544 INFO:tasks.workunit.client.0.smithi012.stdout:456 2024-09-10T18:13:23.545 INFO:tasks.workunit.client.0.smithi012.stdout:457 2024-09-10T18:13:23.546 INFO:tasks.workunit.client.0.smithi012.stdout:458 2024-09-10T18:13:23.547 INFO:tasks.workunit.client.0.smithi012.stdout:459 2024-09-10T18:13:23.548 INFO:tasks.workunit.client.0.smithi012.stdout:460 2024-09-10T18:13:23.549 INFO:tasks.workunit.client.0.smithi012.stdout:461 2024-09-10T18:13:23.550 INFO:tasks.workunit.client.0.smithi012.stdout:462 2024-09-10T18:13:23.551 INFO:tasks.workunit.client.0.smithi012.stdout:463 2024-09-10T18:13:23.552 INFO:tasks.workunit.client.0.smithi012.stdout:464 2024-09-10T18:13:23.553 INFO:tasks.workunit.client.0.smithi012.stdout:465 2024-09-10T18:13:23.555 INFO:tasks.workunit.client.0.smithi012.stdout:466 2024-09-10T18:13:23.556 INFO:tasks.workunit.client.0.smithi012.stdout:467 2024-09-10T18:13:23.557 INFO:tasks.workunit.client.0.smithi012.stdout:468 2024-09-10T18:13:23.557 INFO:tasks.workunit.client.0.smithi012.stdout:469 2024-09-10T18:13:23.558 INFO:tasks.workunit.client.0.smithi012.stdout:470 2024-09-10T18:13:23.559 INFO:tasks.workunit.client.0.smithi012.stdout:471 2024-09-10T18:13:23.560 INFO:tasks.workunit.client.0.smithi012.stdout:472 2024-09-10T18:13:23.561 INFO:tasks.workunit.client.0.smithi012.stdout:473 2024-09-10T18:13:23.562 INFO:tasks.workunit.client.0.smithi012.stdout:474 2024-09-10T18:13:23.563 INFO:tasks.workunit.client.0.smithi012.stdout:475 2024-09-10T18:13:23.564 INFO:tasks.workunit.client.0.smithi012.stdout:476 2024-09-10T18:13:23.565 INFO:tasks.workunit.client.0.smithi012.stdout:477 2024-09-10T18:13:23.566 INFO:tasks.workunit.client.0.smithi012.stdout:478 2024-09-10T18:13:23.567 INFO:tasks.workunit.client.0.smithi012.stdout:479 2024-09-10T18:13:23.568 INFO:tasks.workunit.client.0.smithi012.stdout:480 2024-09-10T18:13:23.569 INFO:tasks.workunit.client.0.smithi012.stdout:481 2024-09-10T18:13:23.570 INFO:tasks.workunit.client.0.smithi012.stdout:482 2024-09-10T18:13:23.571 INFO:tasks.workunit.client.0.smithi012.stdout:483 2024-09-10T18:13:23.572 INFO:tasks.workunit.client.0.smithi012.stdout:484 2024-09-10T18:13:23.573 INFO:tasks.workunit.client.0.smithi012.stdout:485 2024-09-10T18:13:23.574 INFO:tasks.workunit.client.0.smithi012.stdout:486 2024-09-10T18:13:23.575 INFO:tasks.workunit.client.0.smithi012.stdout:487 2024-09-10T18:13:23.576 INFO:tasks.workunit.client.0.smithi012.stdout:488 2024-09-10T18:13:23.577 INFO:tasks.workunit.client.0.smithi012.stdout:489 2024-09-10T18:13:23.578 INFO:tasks.workunit.client.0.smithi012.stdout:490 2024-09-10T18:13:23.579 INFO:tasks.workunit.client.0.smithi012.stdout:491 2024-09-10T18:13:23.580 INFO:tasks.workunit.client.0.smithi012.stdout:492 2024-09-10T18:13:23.580 INFO:tasks.workunit.client.0.smithi012.stdout:493 2024-09-10T18:13:23.582 INFO:tasks.workunit.client.0.smithi012.stdout:494 2024-09-10T18:13:23.583 INFO:tasks.workunit.client.0.smithi012.stdout:495 2024-09-10T18:13:23.584 INFO:tasks.workunit.client.0.smithi012.stdout:496 2024-09-10T18:13:23.585 INFO:tasks.workunit.client.0.smithi012.stdout:497 2024-09-10T18:13:23.586 INFO:tasks.workunit.client.0.smithi012.stdout:498 2024-09-10T18:13:23.587 INFO:tasks.workunit.client.0.smithi012.stdout:499 2024-09-10T18:13:23.588 INFO:tasks.workunit.client.0.smithi012.stdout:500 2024-09-10T18:13:23.589 INFO:tasks.workunit.client.0.smithi012.stdout:501 2024-09-10T18:13:23.590 INFO:tasks.workunit.client.0.smithi012.stdout:502 2024-09-10T18:13:23.591 INFO:tasks.workunit.client.0.smithi012.stdout:503 2024-09-10T18:13:23.592 INFO:tasks.workunit.client.0.smithi012.stdout:504 2024-09-10T18:13:23.593 INFO:tasks.workunit.client.0.smithi012.stdout:505 2024-09-10T18:13:23.594 INFO:tasks.workunit.client.0.smithi012.stdout:506 2024-09-10T18:13:23.595 INFO:tasks.workunit.client.0.smithi012.stdout:507 2024-09-10T18:13:23.596 INFO:tasks.workunit.client.0.smithi012.stdout:508 2024-09-10T18:13:23.597 INFO:tasks.workunit.client.0.smithi012.stdout:509 2024-09-10T18:13:23.598 INFO:tasks.workunit.client.0.smithi012.stdout:510 2024-09-10T18:13:23.599 INFO:tasks.workunit.client.0.smithi012.stdout:511 2024-09-10T18:13:23.600 INFO:tasks.workunit.client.0.smithi012.stdout:512 2024-09-10T18:13:23.601 INFO:tasks.workunit.client.0.smithi012.stdout:513 2024-09-10T18:13:23.602 INFO:tasks.workunit.client.0.smithi012.stdout:514 2024-09-10T18:13:23.603 INFO:tasks.workunit.client.0.smithi012.stdout:515 2024-09-10T18:13:23.604 INFO:tasks.workunit.client.0.smithi012.stdout:516 2024-09-10T18:13:23.605 INFO:tasks.workunit.client.0.smithi012.stdout:517 2024-09-10T18:13:23.607 INFO:tasks.workunit.client.0.smithi012.stdout:518 2024-09-10T18:13:23.608 INFO:tasks.workunit.client.0.smithi012.stdout:519 2024-09-10T18:13:23.609 INFO:tasks.workunit.client.0.smithi012.stdout:520 2024-09-10T18:13:23.609 INFO:tasks.workunit.client.0.smithi012.stdout:521 2024-09-10T18:13:23.611 INFO:tasks.workunit.client.0.smithi012.stdout:522 2024-09-10T18:13:23.612 INFO:tasks.workunit.client.0.smithi012.stdout:523 2024-09-10T18:13:23.613 INFO:tasks.workunit.client.0.smithi012.stdout:524 2024-09-10T18:13:23.614 INFO:tasks.workunit.client.0.smithi012.stdout:525 2024-09-10T18:13:23.615 INFO:tasks.workunit.client.0.smithi012.stdout:526 2024-09-10T18:13:23.616 INFO:tasks.workunit.client.0.smithi012.stdout:527 2024-09-10T18:13:23.616 INFO:tasks.workunit.client.0.smithi012.stdout:528 2024-09-10T18:13:23.617 INFO:tasks.workunit.client.0.smithi012.stdout:529 2024-09-10T18:13:23.619 INFO:tasks.workunit.client.0.smithi012.stdout:530 2024-09-10T18:13:23.620 INFO:tasks.workunit.client.0.smithi012.stdout:531 2024-09-10T18:13:23.621 INFO:tasks.workunit.client.0.smithi012.stdout:532 2024-09-10T18:13:23.622 INFO:tasks.workunit.client.0.smithi012.stdout:533 2024-09-10T18:13:23.624 INFO:tasks.workunit.client.0.smithi012.stdout:534 2024-09-10T18:13:23.625 INFO:tasks.workunit.client.0.smithi012.stdout:535 2024-09-10T18:13:23.626 INFO:tasks.workunit.client.0.smithi012.stdout:536 2024-09-10T18:13:23.627 INFO:tasks.workunit.client.0.smithi012.stdout:537 2024-09-10T18:13:23.628 INFO:tasks.workunit.client.0.smithi012.stdout:538 2024-09-10T18:13:23.629 INFO:tasks.workunit.client.0.smithi012.stdout:539 2024-09-10T18:13:23.630 INFO:tasks.workunit.client.0.smithi012.stdout:540 2024-09-10T18:13:23.630 INFO:tasks.workunit.client.0.smithi012.stdout:541 2024-09-10T18:13:23.632 INFO:tasks.workunit.client.0.smithi012.stdout:542 2024-09-10T18:13:23.633 INFO:tasks.workunit.client.0.smithi012.stdout:543 2024-09-10T18:13:23.634 INFO:tasks.workunit.client.0.smithi012.stdout:544 2024-09-10T18:13:23.635 INFO:tasks.workunit.client.0.smithi012.stdout:545 2024-09-10T18:13:23.636 INFO:tasks.workunit.client.0.smithi012.stdout:546 2024-09-10T18:13:23.637 INFO:tasks.workunit.client.0.smithi012.stdout:547 2024-09-10T18:13:23.638 INFO:tasks.workunit.client.0.smithi012.stdout:548 2024-09-10T18:13:23.639 INFO:tasks.workunit.client.0.smithi012.stdout:549 2024-09-10T18:13:23.640 INFO:tasks.workunit.client.0.smithi012.stdout:550 2024-09-10T18:13:23.641 INFO:tasks.workunit.client.0.smithi012.stdout:551 2024-09-10T18:13:23.642 INFO:tasks.workunit.client.0.smithi012.stdout:552 2024-09-10T18:13:23.643 INFO:tasks.workunit.client.0.smithi012.stdout:553 2024-09-10T18:13:23.644 INFO:tasks.workunit.client.0.smithi012.stdout:554 2024-09-10T18:13:23.645 INFO:tasks.workunit.client.0.smithi012.stdout:555 2024-09-10T18:13:23.646 INFO:tasks.workunit.client.0.smithi012.stdout:556 2024-09-10T18:13:23.647 INFO:tasks.workunit.client.0.smithi012.stdout:557 2024-09-10T18:13:23.648 INFO:tasks.workunit.client.0.smithi012.stdout:558 2024-09-10T18:13:23.649 INFO:tasks.workunit.client.0.smithi012.stdout:559 2024-09-10T18:13:23.650 INFO:tasks.workunit.client.0.smithi012.stdout:560 2024-09-10T18:13:23.651 INFO:tasks.workunit.client.0.smithi012.stdout:561 2024-09-10T18:13:23.652 INFO:tasks.workunit.client.0.smithi012.stdout:562 2024-09-10T18:13:23.653 INFO:tasks.workunit.client.0.smithi012.stdout:563 2024-09-10T18:13:23.654 INFO:tasks.workunit.client.0.smithi012.stdout:564 2024-09-10T18:13:23.655 INFO:tasks.workunit.client.0.smithi012.stdout:565 2024-09-10T18:13:23.656 INFO:tasks.workunit.client.0.smithi012.stdout:566 2024-09-10T18:13:23.657 INFO:tasks.workunit.client.0.smithi012.stdout:567 2024-09-10T18:13:23.658 INFO:tasks.workunit.client.0.smithi012.stdout:568 2024-09-10T18:13:23.660 INFO:tasks.workunit.client.0.smithi012.stdout:569 2024-09-10T18:13:23.660 INFO:tasks.workunit.client.0.smithi012.stdout:570 2024-09-10T18:13:23.661 INFO:tasks.workunit.client.0.smithi012.stdout:571 2024-09-10T18:13:23.662 INFO:tasks.workunit.client.0.smithi012.stdout:572 2024-09-10T18:13:23.664 INFO:tasks.workunit.client.0.smithi012.stdout:573 2024-09-10T18:13:23.665 INFO:tasks.workunit.client.0.smithi012.stdout:574 2024-09-10T18:13:23.666 INFO:tasks.workunit.client.0.smithi012.stdout:575 2024-09-10T18:13:23.667 INFO:tasks.workunit.client.0.smithi012.stdout:576 2024-09-10T18:13:23.668 INFO:tasks.workunit.client.0.smithi012.stdout:577 2024-09-10T18:13:23.669 INFO:tasks.workunit.client.0.smithi012.stdout:578 2024-09-10T18:13:23.670 INFO:tasks.workunit.client.0.smithi012.stdout:579 2024-09-10T18:13:23.671 INFO:tasks.workunit.client.0.smithi012.stdout:580 2024-09-10T18:13:23.672 INFO:tasks.workunit.client.0.smithi012.stdout:581 2024-09-10T18:13:23.673 INFO:tasks.workunit.client.0.smithi012.stdout:582 2024-09-10T18:13:23.674 INFO:tasks.workunit.client.0.smithi012.stdout:583 2024-09-10T18:13:23.675 INFO:tasks.workunit.client.0.smithi012.stdout:584 2024-09-10T18:13:23.676 INFO:tasks.workunit.client.0.smithi012.stdout:585 2024-09-10T18:13:23.677 INFO:tasks.workunit.client.0.smithi012.stdout:586 2024-09-10T18:13:23.678 INFO:tasks.workunit.client.0.smithi012.stdout:587 2024-09-10T18:13:23.679 INFO:tasks.workunit.client.0.smithi012.stdout:588 2024-09-10T18:13:23.680 INFO:tasks.workunit.client.0.smithi012.stdout:589 2024-09-10T18:13:23.681 INFO:tasks.workunit.client.0.smithi012.stdout:590 2024-09-10T18:13:23.682 INFO:tasks.workunit.client.0.smithi012.stdout:591 2024-09-10T18:13:23.683 INFO:tasks.workunit.client.0.smithi012.stdout:592 2024-09-10T18:13:23.684 INFO:tasks.workunit.client.0.smithi012.stdout:593 2024-09-10T18:13:23.685 INFO:tasks.workunit.client.0.smithi012.stdout:594 2024-09-10T18:13:23.686 INFO:tasks.workunit.client.0.smithi012.stdout:595 2024-09-10T18:13:23.687 INFO:tasks.workunit.client.0.smithi012.stdout:596 2024-09-10T18:13:23.689 INFO:tasks.workunit.client.0.smithi012.stdout:597 2024-09-10T18:13:23.690 INFO:tasks.workunit.client.0.smithi012.stdout:598 2024-09-10T18:13:23.691 INFO:tasks.workunit.client.0.smithi012.stdout:599 2024-09-10T18:13:23.692 INFO:tasks.workunit.client.0.smithi012.stdout:600 2024-09-10T18:13:23.693 INFO:tasks.workunit.client.0.smithi012.stdout:601 2024-09-10T18:13:23.694 INFO:tasks.workunit.client.0.smithi012.stdout:602 2024-09-10T18:13:23.695 INFO:tasks.workunit.client.0.smithi012.stdout:603 2024-09-10T18:13:23.696 INFO:tasks.workunit.client.0.smithi012.stdout:604 2024-09-10T18:13:23.697 INFO:tasks.workunit.client.0.smithi012.stdout:605 2024-09-10T18:13:23.698 INFO:tasks.workunit.client.0.smithi012.stdout:606 2024-09-10T18:13:23.698 INFO:tasks.workunit.client.0.smithi012.stdout:607 2024-09-10T18:13:23.700 INFO:tasks.workunit.client.0.smithi012.stdout:608 2024-09-10T18:13:23.700 INFO:tasks.workunit.client.0.smithi012.stdout:609 2024-09-10T18:13:23.702 INFO:tasks.workunit.client.0.smithi012.stdout:610 2024-09-10T18:13:23.702 INFO:tasks.workunit.client.0.smithi012.stdout:611 2024-09-10T18:13:23.703 INFO:tasks.workunit.client.0.smithi012.stdout:612 2024-09-10T18:13:23.704 INFO:tasks.workunit.client.0.smithi012.stdout:613 2024-09-10T18:13:23.705 INFO:tasks.workunit.client.0.smithi012.stdout:614 2024-09-10T18:13:23.706 INFO:tasks.workunit.client.0.smithi012.stdout:615 2024-09-10T18:13:23.707 INFO:tasks.workunit.client.0.smithi012.stdout:616 2024-09-10T18:13:23.708 INFO:tasks.workunit.client.0.smithi012.stdout:617 2024-09-10T18:13:23.709 INFO:tasks.workunit.client.0.smithi012.stdout:618 2024-09-10T18:13:23.710 INFO:tasks.workunit.client.0.smithi012.stdout:619 2024-09-10T18:13:23.712 INFO:tasks.workunit.client.0.smithi012.stdout:620 2024-09-10T18:13:23.712 INFO:tasks.workunit.client.0.smithi012.stdout:621 2024-09-10T18:13:23.713 INFO:tasks.workunit.client.0.smithi012.stdout:622 2024-09-10T18:13:23.714 INFO:tasks.workunit.client.0.smithi012.stdout:623 2024-09-10T18:13:23.715 INFO:tasks.workunit.client.0.smithi012.stdout:624 2024-09-10T18:13:23.716 INFO:tasks.workunit.client.0.smithi012.stdout:625 2024-09-10T18:13:23.717 INFO:tasks.workunit.client.0.smithi012.stdout:626 2024-09-10T18:13:23.718 INFO:tasks.workunit.client.0.smithi012.stdout:627 2024-09-10T18:13:23.719 INFO:tasks.workunit.client.0.smithi012.stdout:628 2024-09-10T18:13:23.721 INFO:tasks.workunit.client.0.smithi012.stdout:629 2024-09-10T18:13:23.721 INFO:tasks.workunit.client.0.smithi012.stdout:630 2024-09-10T18:13:23.722 INFO:tasks.workunit.client.0.smithi012.stdout:631 2024-09-10T18:13:23.723 INFO:tasks.workunit.client.0.smithi012.stdout:632 2024-09-10T18:13:23.724 INFO:tasks.workunit.client.0.smithi012.stdout:633 2024-09-10T18:13:23.726 INFO:tasks.workunit.client.0.smithi012.stdout:634 2024-09-10T18:13:23.726 INFO:tasks.workunit.client.0.smithi012.stdout:635 2024-09-10T18:13:23.728 INFO:tasks.workunit.client.0.smithi012.stdout:636 2024-09-10T18:13:23.728 INFO:tasks.workunit.client.0.smithi012.stdout:637 2024-09-10T18:13:23.729 INFO:tasks.workunit.client.0.smithi012.stdout:638 2024-09-10T18:13:23.730 INFO:tasks.workunit.client.0.smithi012.stdout:639 2024-09-10T18:13:23.731 INFO:tasks.workunit.client.0.smithi012.stdout:640 2024-09-10T18:13:23.733 INFO:tasks.workunit.client.0.smithi012.stdout:641 2024-09-10T18:13:23.733 INFO:tasks.workunit.client.0.smithi012.stdout:642 2024-09-10T18:13:23.735 INFO:tasks.workunit.client.0.smithi012.stdout:643 2024-09-10T18:13:23.736 INFO:tasks.workunit.client.0.smithi012.stdout:644 2024-09-10T18:13:23.737 INFO:tasks.workunit.client.0.smithi012.stdout:645 2024-09-10T18:13:23.738 INFO:tasks.workunit.client.0.smithi012.stdout:646 2024-09-10T18:13:23.739 INFO:tasks.workunit.client.0.smithi012.stdout:647 2024-09-10T18:13:23.740 INFO:tasks.workunit.client.0.smithi012.stdout:648 2024-09-10T18:13:23.741 INFO:tasks.workunit.client.0.smithi012.stdout:649 2024-09-10T18:13:23.742 INFO:tasks.workunit.client.0.smithi012.stdout:650 2024-09-10T18:13:23.743 INFO:tasks.workunit.client.0.smithi012.stdout:651 2024-09-10T18:13:23.743 INFO:tasks.workunit.client.0.smithi012.stdout:652 2024-09-10T18:13:23.745 INFO:tasks.workunit.client.0.smithi012.stdout:653 2024-09-10T18:13:23.746 INFO:tasks.workunit.client.0.smithi012.stdout:654 2024-09-10T18:13:23.747 INFO:tasks.workunit.client.0.smithi012.stdout:655 2024-09-10T18:13:23.748 INFO:tasks.workunit.client.0.smithi012.stdout:656 2024-09-10T18:13:23.749 INFO:tasks.workunit.client.0.smithi012.stdout:657 2024-09-10T18:13:23.750 INFO:tasks.workunit.client.0.smithi012.stdout:658 2024-09-10T18:13:23.751 INFO:tasks.workunit.client.0.smithi012.stdout:659 2024-09-10T18:13:23.752 INFO:tasks.workunit.client.0.smithi012.stdout:660 2024-09-10T18:13:23.753 INFO:tasks.workunit.client.0.smithi012.stdout:661 2024-09-10T18:13:23.754 INFO:tasks.workunit.client.0.smithi012.stdout:662 2024-09-10T18:13:23.755 INFO:tasks.workunit.client.0.smithi012.stdout:663 2024-09-10T18:13:23.756 INFO:tasks.workunit.client.0.smithi012.stdout:664 2024-09-10T18:13:23.757 INFO:tasks.workunit.client.0.smithi012.stdout:665 2024-09-10T18:13:23.758 INFO:tasks.workunit.client.0.smithi012.stdout:666 2024-09-10T18:13:23.759 INFO:tasks.workunit.client.0.smithi012.stdout:667 2024-09-10T18:13:23.760 INFO:tasks.workunit.client.0.smithi012.stdout:668 2024-09-10T18:13:23.761 INFO:tasks.workunit.client.0.smithi012.stdout:669 2024-09-10T18:13:23.763 INFO:tasks.workunit.client.0.smithi012.stdout:670 2024-09-10T18:13:23.763 INFO:tasks.workunit.client.0.smithi012.stdout:671 2024-09-10T18:13:23.764 INFO:tasks.workunit.client.0.smithi012.stdout:672 2024-09-10T18:13:23.765 INFO:tasks.workunit.client.0.smithi012.stdout:673 2024-09-10T18:13:23.766 INFO:tasks.workunit.client.0.smithi012.stdout:674 2024-09-10T18:13:23.767 INFO:tasks.workunit.client.0.smithi012.stdout:675 2024-09-10T18:13:23.768 INFO:tasks.workunit.client.0.smithi012.stdout:676 2024-09-10T18:13:23.769 INFO:tasks.workunit.client.0.smithi012.stdout:677 2024-09-10T18:13:23.770 INFO:tasks.workunit.client.0.smithi012.stdout:678 2024-09-10T18:13:23.771 INFO:tasks.workunit.client.0.smithi012.stdout:679 2024-09-10T18:13:23.772 INFO:tasks.workunit.client.0.smithi012.stdout:680 2024-09-10T18:13:23.774 INFO:tasks.workunit.client.0.smithi012.stdout:681 2024-09-10T18:13:23.775 INFO:tasks.workunit.client.0.smithi012.stdout:682 2024-09-10T18:13:23.776 INFO:tasks.workunit.client.0.smithi012.stdout:683 2024-09-10T18:13:23.777 INFO:tasks.workunit.client.0.smithi012.stdout:684 2024-09-10T18:13:23.778 INFO:tasks.workunit.client.0.smithi012.stdout:685 2024-09-10T18:13:23.779 INFO:tasks.workunit.client.0.smithi012.stdout:686 2024-09-10T18:13:23.780 INFO:tasks.workunit.client.0.smithi012.stdout:687 2024-09-10T18:13:23.781 INFO:tasks.workunit.client.0.smithi012.stdout:688 2024-09-10T18:13:23.782 INFO:tasks.workunit.client.0.smithi012.stdout:689 2024-09-10T18:13:23.783 INFO:tasks.workunit.client.0.smithi012.stdout:690 2024-09-10T18:13:23.784 INFO:tasks.workunit.client.0.smithi012.stdout:691 2024-09-10T18:13:23.786 INFO:tasks.workunit.client.0.smithi012.stdout:692 2024-09-10T18:13:23.787 INFO:tasks.workunit.client.0.smithi012.stdout:693 2024-09-10T18:13:23.788 INFO:tasks.workunit.client.0.smithi012.stdout:694 2024-09-10T18:13:23.789 INFO:tasks.workunit.client.0.smithi012.stdout:695 2024-09-10T18:13:23.790 INFO:tasks.workunit.client.0.smithi012.stdout:696 2024-09-10T18:13:23.791 INFO:tasks.workunit.client.0.smithi012.stdout:697 2024-09-10T18:13:23.793 INFO:tasks.workunit.client.0.smithi012.stdout:698 2024-09-10T18:13:23.794 INFO:tasks.workunit.client.0.smithi012.stdout:699 2024-09-10T18:13:23.795 INFO:tasks.workunit.client.0.smithi012.stdout:700 2024-09-10T18:13:23.796 INFO:tasks.workunit.client.0.smithi012.stdout:701 2024-09-10T18:13:23.797 INFO:tasks.workunit.client.0.smithi012.stdout:702 2024-09-10T18:13:23.798 INFO:tasks.workunit.client.0.smithi012.stdout:703 2024-09-10T18:13:23.799 INFO:tasks.workunit.client.0.smithi012.stdout:704 2024-09-10T18:13:23.800 INFO:tasks.workunit.client.0.smithi012.stdout:705 2024-09-10T18:13:23.801 INFO:tasks.workunit.client.0.smithi012.stdout:706 2024-09-10T18:13:23.802 INFO:tasks.workunit.client.0.smithi012.stdout:707 2024-09-10T18:13:23.803 INFO:tasks.workunit.client.0.smithi012.stdout:708 2024-09-10T18:13:23.804 INFO:tasks.workunit.client.0.smithi012.stdout:709 2024-09-10T18:13:23.805 INFO:tasks.workunit.client.0.smithi012.stdout:710 2024-09-10T18:13:23.806 INFO:tasks.workunit.client.0.smithi012.stdout:711 2024-09-10T18:13:23.807 INFO:tasks.workunit.client.0.smithi012.stdout:712 2024-09-10T18:13:23.808 INFO:tasks.workunit.client.0.smithi012.stdout:713 2024-09-10T18:13:23.809 INFO:tasks.workunit.client.0.smithi012.stdout:714 2024-09-10T18:13:23.811 INFO:tasks.workunit.client.0.smithi012.stdout:715 2024-09-10T18:13:23.812 INFO:tasks.workunit.client.0.smithi012.stdout:716 2024-09-10T18:13:23.813 INFO:tasks.workunit.client.0.smithi012.stdout:717 2024-09-10T18:13:23.814 INFO:tasks.workunit.client.0.smithi012.stdout:718 2024-09-10T18:13:23.815 INFO:tasks.workunit.client.0.smithi012.stdout:719 2024-09-10T18:13:23.816 INFO:tasks.workunit.client.0.smithi012.stdout:720 2024-09-10T18:13:23.817 INFO:tasks.workunit.client.0.smithi012.stdout:721 2024-09-10T18:13:23.818 INFO:tasks.workunit.client.0.smithi012.stdout:722 2024-09-10T18:13:23.819 INFO:tasks.workunit.client.0.smithi012.stdout:723 2024-09-10T18:13:23.820 INFO:tasks.workunit.client.0.smithi012.stdout:724 2024-09-10T18:13:23.821 INFO:tasks.workunit.client.0.smithi012.stdout:725 2024-09-10T18:13:23.822 INFO:tasks.workunit.client.0.smithi012.stdout:726 2024-09-10T18:13:23.823 INFO:tasks.workunit.client.0.smithi012.stdout:727 2024-09-10T18:13:23.824 INFO:tasks.workunit.client.0.smithi012.stdout:728 2024-09-10T18:13:23.826 INFO:tasks.workunit.client.0.smithi012.stdout:729 2024-09-10T18:13:23.827 INFO:tasks.workunit.client.0.smithi012.stdout:730 2024-09-10T18:13:23.828 INFO:tasks.workunit.client.0.smithi012.stdout:731 2024-09-10T18:13:23.829 INFO:tasks.workunit.client.0.smithi012.stdout:732 2024-09-10T18:13:23.831 INFO:tasks.workunit.client.0.smithi012.stdout:733 2024-09-10T18:13:23.832 INFO:tasks.workunit.client.0.smithi012.stdout:734 2024-09-10T18:13:23.833 INFO:tasks.workunit.client.0.smithi012.stdout:735 2024-09-10T18:13:23.834 INFO:tasks.workunit.client.0.smithi012.stdout:736 2024-09-10T18:13:23.835 INFO:tasks.workunit.client.0.smithi012.stdout:737 2024-09-10T18:13:23.836 INFO:tasks.workunit.client.0.smithi012.stdout:738 2024-09-10T18:13:23.838 INFO:tasks.workunit.client.0.smithi012.stdout:739 2024-09-10T18:13:23.839 INFO:tasks.workunit.client.0.smithi012.stdout:740 2024-09-10T18:13:23.840 INFO:tasks.workunit.client.0.smithi012.stdout:741 2024-09-10T18:13:23.841 INFO:tasks.workunit.client.0.smithi012.stdout:742 2024-09-10T18:13:23.842 INFO:tasks.workunit.client.0.smithi012.stdout:743 2024-09-10T18:13:23.843 INFO:tasks.workunit.client.0.smithi012.stdout:744 2024-09-10T18:13:23.844 INFO:tasks.workunit.client.0.smithi012.stdout:745 2024-09-10T18:13:23.845 INFO:tasks.workunit.client.0.smithi012.stdout:746 2024-09-10T18:13:23.846 INFO:tasks.workunit.client.0.smithi012.stdout:747 2024-09-10T18:13:23.847 INFO:tasks.workunit.client.0.smithi012.stdout:748 2024-09-10T18:13:23.849 INFO:tasks.workunit.client.0.smithi012.stdout:749 2024-09-10T18:13:23.850 INFO:tasks.workunit.client.0.smithi012.stdout:750 2024-09-10T18:13:23.851 INFO:tasks.workunit.client.0.smithi012.stdout:751 2024-09-10T18:13:23.852 INFO:tasks.workunit.client.0.smithi012.stdout:752 2024-09-10T18:13:23.853 INFO:tasks.workunit.client.0.smithi012.stdout:753 2024-09-10T18:13:23.854 INFO:tasks.workunit.client.0.smithi012.stdout:754 2024-09-10T18:13:23.855 INFO:tasks.workunit.client.0.smithi012.stdout:755 2024-09-10T18:13:23.857 INFO:tasks.workunit.client.0.smithi012.stdout:756 2024-09-10T18:13:23.858 INFO:tasks.workunit.client.0.smithi012.stdout:757 2024-09-10T18:13:23.859 INFO:tasks.workunit.client.0.smithi012.stdout:758 2024-09-10T18:13:23.860 INFO:tasks.workunit.client.0.smithi012.stdout:759 2024-09-10T18:13:23.861 INFO:tasks.workunit.client.0.smithi012.stdout:760 2024-09-10T18:13:23.862 INFO:tasks.workunit.client.0.smithi012.stdout:761 2024-09-10T18:13:23.863 INFO:tasks.workunit.client.0.smithi012.stdout:762 2024-09-10T18:13:23.864 INFO:tasks.workunit.client.0.smithi012.stdout:763 2024-09-10T18:13:23.865 INFO:tasks.workunit.client.0.smithi012.stdout:764 2024-09-10T18:13:23.866 INFO:tasks.workunit.client.0.smithi012.stdout:765 2024-09-10T18:13:23.867 INFO:tasks.workunit.client.0.smithi012.stdout:766 2024-09-10T18:13:23.869 INFO:tasks.workunit.client.0.smithi012.stdout:767 2024-09-10T18:13:23.870 INFO:tasks.workunit.client.0.smithi012.stdout:768 2024-09-10T18:13:23.871 INFO:tasks.workunit.client.0.smithi012.stdout:769 2024-09-10T18:13:23.872 INFO:tasks.workunit.client.0.smithi012.stdout:770 2024-09-10T18:13:23.873 INFO:tasks.workunit.client.0.smithi012.stdout:771 2024-09-10T18:13:23.874 INFO:tasks.workunit.client.0.smithi012.stdout:772 2024-09-10T18:13:23.875 INFO:tasks.workunit.client.0.smithi012.stdout:773 2024-09-10T18:13:23.877 INFO:tasks.workunit.client.0.smithi012.stdout:774 2024-09-10T18:13:23.878 INFO:tasks.workunit.client.0.smithi012.stdout:775 2024-09-10T18:13:23.879 INFO:tasks.workunit.client.0.smithi012.stdout:776 2024-09-10T18:13:23.880 INFO:tasks.workunit.client.0.smithi012.stdout:777 2024-09-10T18:13:23.881 INFO:tasks.workunit.client.0.smithi012.stdout:778 2024-09-10T18:13:23.882 INFO:tasks.workunit.client.0.smithi012.stdout:779 2024-09-10T18:13:23.883 INFO:tasks.workunit.client.0.smithi012.stdout:780 2024-09-10T18:13:23.884 INFO:tasks.workunit.client.0.smithi012.stdout:781 2024-09-10T18:13:23.885 INFO:tasks.workunit.client.0.smithi012.stdout:782 2024-09-10T18:13:23.886 INFO:tasks.workunit.client.0.smithi012.stdout:783 2024-09-10T18:13:23.887 INFO:tasks.workunit.client.0.smithi012.stdout:784 2024-09-10T18:13:23.888 INFO:tasks.workunit.client.0.smithi012.stdout:785 2024-09-10T18:13:23.890 INFO:tasks.workunit.client.0.smithi012.stdout:786 2024-09-10T18:13:23.891 INFO:tasks.workunit.client.0.smithi012.stdout:787 2024-09-10T18:13:23.892 INFO:tasks.workunit.client.0.smithi012.stdout:788 2024-09-10T18:13:23.893 INFO:tasks.workunit.client.0.smithi012.stdout:789 2024-09-10T18:13:23.895 INFO:tasks.workunit.client.0.smithi012.stdout:790 2024-09-10T18:13:23.896 INFO:tasks.workunit.client.0.smithi012.stdout:791 2024-09-10T18:13:23.898 INFO:tasks.workunit.client.0.smithi012.stdout:792 2024-09-10T18:13:23.899 INFO:tasks.workunit.client.0.smithi012.stdout:793 2024-09-10T18:13:23.900 INFO:tasks.workunit.client.0.smithi012.stdout:794 2024-09-10T18:13:23.901 INFO:tasks.workunit.client.0.smithi012.stdout:795 2024-09-10T18:13:23.902 INFO:tasks.workunit.client.0.smithi012.stdout:796 2024-09-10T18:13:23.903 INFO:tasks.workunit.client.0.smithi012.stdout:797 2024-09-10T18:13:23.905 INFO:tasks.workunit.client.0.smithi012.stdout:798 2024-09-10T18:13:23.906 INFO:tasks.workunit.client.0.smithi012.stdout:799 2024-09-10T18:13:23.907 INFO:tasks.workunit.client.0.smithi012.stdout:800 2024-09-10T18:13:23.909 INFO:tasks.workunit.client.0.smithi012.stdout:801 2024-09-10T18:13:23.910 INFO:tasks.workunit.client.0.smithi012.stdout:802 2024-09-10T18:13:23.911 INFO:tasks.workunit.client.0.smithi012.stdout:803 2024-09-10T18:13:23.912 INFO:tasks.workunit.client.0.smithi012.stdout:804 2024-09-10T18:13:23.913 INFO:tasks.workunit.client.0.smithi012.stdout:805 2024-09-10T18:13:23.915 INFO:tasks.workunit.client.0.smithi012.stdout:806 2024-09-10T18:13:23.916 INFO:tasks.workunit.client.0.smithi012.stdout:807 2024-09-10T18:13:23.917 INFO:tasks.workunit.client.0.smithi012.stdout:808 2024-09-10T18:13:23.918 INFO:tasks.workunit.client.0.smithi012.stdout:809 2024-09-10T18:13:23.919 INFO:tasks.workunit.client.0.smithi012.stdout:810 2024-09-10T18:13:23.920 INFO:tasks.workunit.client.0.smithi012.stdout:811 2024-09-10T18:13:23.922 INFO:tasks.workunit.client.0.smithi012.stdout:812 2024-09-10T18:13:23.923 INFO:tasks.workunit.client.0.smithi012.stdout:813 2024-09-10T18:13:23.924 INFO:tasks.workunit.client.0.smithi012.stdout:814 2024-09-10T18:13:23.926 INFO:tasks.workunit.client.0.smithi012.stdout:815 2024-09-10T18:13:23.927 INFO:tasks.workunit.client.0.smithi012.stdout:816 2024-09-10T18:13:23.928 INFO:tasks.workunit.client.0.smithi012.stdout:817 2024-09-10T18:13:23.929 INFO:tasks.workunit.client.0.smithi012.stdout:818 2024-09-10T18:13:23.930 INFO:tasks.workunit.client.0.smithi012.stdout:819 2024-09-10T18:13:23.932 INFO:tasks.workunit.client.0.smithi012.stdout:820 2024-09-10T18:13:23.932 INFO:tasks.workunit.client.0.smithi012.stdout:821 2024-09-10T18:13:23.934 INFO:tasks.workunit.client.0.smithi012.stdout:822 2024-09-10T18:13:23.935 INFO:tasks.workunit.client.0.smithi012.stdout:823 2024-09-10T18:13:23.936 INFO:tasks.workunit.client.0.smithi012.stdout:824 2024-09-10T18:13:23.937 INFO:tasks.workunit.client.0.smithi012.stdout:825 2024-09-10T18:13:23.938 INFO:tasks.workunit.client.0.smithi012.stdout:826 2024-09-10T18:13:23.939 INFO:tasks.workunit.client.0.smithi012.stdout:827 2024-09-10T18:13:23.941 INFO:tasks.workunit.client.0.smithi012.stdout:828 2024-09-10T18:13:23.942 INFO:tasks.workunit.client.0.smithi012.stdout:829 2024-09-10T18:13:23.943 INFO:tasks.workunit.client.0.smithi012.stdout:830 2024-09-10T18:13:23.944 INFO:tasks.workunit.client.0.smithi012.stdout:831 2024-09-10T18:13:23.945 INFO:tasks.workunit.client.0.smithi012.stdout:832 2024-09-10T18:13:23.946 INFO:tasks.workunit.client.0.smithi012.stdout:833 2024-09-10T18:13:23.948 INFO:tasks.workunit.client.0.smithi012.stdout:834 2024-09-10T18:13:23.949 INFO:tasks.workunit.client.0.smithi012.stdout:835 2024-09-10T18:13:23.950 INFO:tasks.workunit.client.0.smithi012.stdout:836 2024-09-10T18:13:23.951 INFO:tasks.workunit.client.0.smithi012.stdout:837 2024-09-10T18:13:23.953 INFO:tasks.workunit.client.0.smithi012.stdout:838 2024-09-10T18:13:23.954 INFO:tasks.workunit.client.0.smithi012.stdout:839 2024-09-10T18:13:23.956 INFO:tasks.workunit.client.0.smithi012.stdout:840 2024-09-10T18:13:23.957 INFO:tasks.workunit.client.0.smithi012.stdout:841 2024-09-10T18:13:23.959 INFO:tasks.workunit.client.0.smithi012.stdout:842 2024-09-10T18:13:23.960 INFO:tasks.workunit.client.0.smithi012.stdout:843 2024-09-10T18:13:23.962 INFO:tasks.workunit.client.0.smithi012.stdout:844 2024-09-10T18:13:23.963 INFO:tasks.workunit.client.0.smithi012.stdout:845 2024-09-10T18:13:23.964 INFO:tasks.workunit.client.0.smithi012.stdout:846 2024-09-10T18:13:23.966 INFO:tasks.workunit.client.0.smithi012.stdout:847 2024-09-10T18:13:23.967 INFO:tasks.workunit.client.0.smithi012.stdout:848 2024-09-10T18:13:23.969 INFO:tasks.workunit.client.0.smithi012.stdout:849 2024-09-10T18:13:23.969 INFO:tasks.workunit.client.0.smithi012.stdout:850 2024-09-10T18:13:23.971 INFO:tasks.workunit.client.0.smithi012.stdout:851 2024-09-10T18:13:23.972 INFO:tasks.workunit.client.0.smithi012.stdout:852 2024-09-10T18:13:23.974 INFO:tasks.workunit.client.0.smithi012.stdout:853 2024-09-10T18:13:23.975 INFO:tasks.workunit.client.0.smithi012.stdout:854 2024-09-10T18:13:23.976 INFO:tasks.workunit.client.0.smithi012.stdout:855 2024-09-10T18:13:23.977 INFO:tasks.workunit.client.0.smithi012.stdout:856 2024-09-10T18:13:23.978 INFO:tasks.workunit.client.0.smithi012.stdout:857 2024-09-10T18:13:23.980 INFO:tasks.workunit.client.0.smithi012.stdout:858 2024-09-10T18:13:23.981 INFO:tasks.workunit.client.0.smithi012.stdout:859 2024-09-10T18:13:23.982 INFO:tasks.workunit.client.0.smithi012.stdout:860 2024-09-10T18:13:23.983 INFO:tasks.workunit.client.0.smithi012.stdout:861 2024-09-10T18:13:23.985 INFO:tasks.workunit.client.0.smithi012.stdout:862 2024-09-10T18:13:23.986 INFO:tasks.workunit.client.0.smithi012.stdout:863 2024-09-10T18:13:23.987 INFO:tasks.workunit.client.0.smithi012.stdout:864 2024-09-10T18:13:23.988 INFO:tasks.workunit.client.0.smithi012.stdout:865 2024-09-10T18:13:23.989 INFO:tasks.workunit.client.0.smithi012.stdout:866 2024-09-10T18:13:23.990 INFO:tasks.workunit.client.0.smithi012.stdout:867 2024-09-10T18:13:23.991 INFO:tasks.workunit.client.0.smithi012.stdout:868 2024-09-10T18:13:23.993 INFO:tasks.workunit.client.0.smithi012.stdout:869 2024-09-10T18:13:23.994 INFO:tasks.workunit.client.0.smithi012.stdout:870 2024-09-10T18:13:23.995 INFO:tasks.workunit.client.0.smithi012.stdout:871 2024-09-10T18:13:23.996 INFO:tasks.workunit.client.0.smithi012.stdout:872 2024-09-10T18:13:23.997 INFO:tasks.workunit.client.0.smithi012.stdout:873 2024-09-10T18:13:23.998 INFO:tasks.workunit.client.0.smithi012.stdout:874 2024-09-10T18:13:23.999 INFO:tasks.workunit.client.0.smithi012.stdout:875 2024-09-10T18:13:24.000 INFO:tasks.workunit.client.0.smithi012.stdout:876 2024-09-10T18:13:24.001 INFO:tasks.workunit.client.0.smithi012.stdout:877 2024-09-10T18:13:24.003 INFO:tasks.workunit.client.0.smithi012.stdout:878 2024-09-10T18:13:24.004 INFO:tasks.workunit.client.0.smithi012.stdout:879 2024-09-10T18:13:24.005 INFO:tasks.workunit.client.0.smithi012.stdout:880 2024-09-10T18:13:24.006 INFO:tasks.workunit.client.0.smithi012.stdout:881 2024-09-10T18:13:24.007 INFO:tasks.workunit.client.0.smithi012.stdout:882 2024-09-10T18:13:24.009 INFO:tasks.workunit.client.0.smithi012.stdout:883 2024-09-10T18:13:24.010 INFO:tasks.workunit.client.0.smithi012.stdout:884 2024-09-10T18:13:24.011 INFO:tasks.workunit.client.0.smithi012.stdout:885 2024-09-10T18:13:24.012 INFO:tasks.workunit.client.0.smithi012.stdout:886 2024-09-10T18:13:24.013 INFO:tasks.workunit.client.0.smithi012.stdout:887 2024-09-10T18:13:24.015 INFO:tasks.workunit.client.0.smithi012.stdout:888 2024-09-10T18:13:24.016 INFO:tasks.workunit.client.0.smithi012.stdout:889 2024-09-10T18:13:24.017 INFO:tasks.workunit.client.0.smithi012.stdout:890 2024-09-10T18:13:24.018 INFO:tasks.workunit.client.0.smithi012.stdout:891 2024-09-10T18:13:24.019 INFO:tasks.workunit.client.0.smithi012.stdout:892 2024-09-10T18:13:24.020 INFO:tasks.workunit.client.0.smithi012.stdout:893 2024-09-10T18:13:24.021 INFO:tasks.workunit.client.0.smithi012.stdout:894 2024-09-10T18:13:24.023 INFO:tasks.workunit.client.0.smithi012.stdout:895 2024-09-10T18:13:24.024 INFO:tasks.workunit.client.0.smithi012.stdout:896 2024-09-10T18:13:24.025 INFO:tasks.workunit.client.0.smithi012.stdout:897 2024-09-10T18:13:24.026 INFO:tasks.workunit.client.0.smithi012.stdout:898 2024-09-10T18:13:24.027 INFO:tasks.workunit.client.0.smithi012.stdout:899 2024-09-10T18:13:24.028 INFO:tasks.workunit.client.0.smithi012.stdout:900 2024-09-10T18:13:24.030 INFO:tasks.workunit.client.0.smithi012.stdout:901 2024-09-10T18:13:24.031 INFO:tasks.workunit.client.0.smithi012.stdout:902 2024-09-10T18:13:24.032 INFO:tasks.workunit.client.0.smithi012.stdout:903 2024-09-10T18:13:24.033 INFO:tasks.workunit.client.0.smithi012.stdout:904 2024-09-10T18:13:24.034 INFO:tasks.workunit.client.0.smithi012.stdout:905 2024-09-10T18:13:24.035 INFO:tasks.workunit.client.0.smithi012.stdout:906 2024-09-10T18:13:24.037 INFO:tasks.workunit.client.0.smithi012.stdout:907 2024-09-10T18:13:24.038 INFO:tasks.workunit.client.0.smithi012.stdout:908 2024-09-10T18:13:24.039 INFO:tasks.workunit.client.0.smithi012.stdout:909 2024-09-10T18:13:24.040 INFO:tasks.workunit.client.0.smithi012.stdout:910 2024-09-10T18:13:24.041 INFO:tasks.workunit.client.0.smithi012.stdout:911 2024-09-10T18:13:24.042 INFO:tasks.workunit.client.0.smithi012.stdout:912 2024-09-10T18:13:24.043 INFO:tasks.workunit.client.0.smithi012.stdout:913 2024-09-10T18:13:24.045 INFO:tasks.workunit.client.0.smithi012.stdout:914 2024-09-10T18:13:24.046 INFO:tasks.workunit.client.0.smithi012.stdout:915 2024-09-10T18:13:24.047 INFO:tasks.workunit.client.0.smithi012.stdout:916 2024-09-10T18:13:24.048 INFO:tasks.workunit.client.0.smithi012.stdout:917 2024-09-10T18:13:24.051 INFO:tasks.workunit.client.0.smithi012.stdout:918 2024-09-10T18:13:24.056 INFO:tasks.workunit.client.0.smithi012.stdout:919 2024-09-10T18:13:24.058 INFO:tasks.workunit.client.0.smithi012.stdout:920 2024-09-10T18:13:24.063 INFO:tasks.workunit.client.0.smithi012.stdout:921 2024-09-10T18:13:24.065 INFO:tasks.workunit.client.0.smithi012.stdout:922 2024-09-10T18:13:24.066 INFO:tasks.workunit.client.0.smithi012.stdout:923 2024-09-10T18:13:24.068 INFO:tasks.workunit.client.0.smithi012.stdout:924 2024-09-10T18:13:24.069 INFO:tasks.workunit.client.0.smithi012.stdout:925 2024-09-10T18:13:24.070 INFO:tasks.workunit.client.0.smithi012.stdout:926 2024-09-10T18:13:24.071 INFO:tasks.workunit.client.0.smithi012.stdout:927 2024-09-10T18:13:24.072 INFO:tasks.workunit.client.0.smithi012.stdout:928 2024-09-10T18:13:24.073 INFO:tasks.workunit.client.0.smithi012.stdout:929 2024-09-10T18:13:24.075 INFO:tasks.workunit.client.0.smithi012.stdout:930 2024-09-10T18:13:24.076 INFO:tasks.workunit.client.0.smithi012.stdout:931 2024-09-10T18:13:24.077 INFO:tasks.workunit.client.0.smithi012.stdout:932 2024-09-10T18:13:24.078 INFO:tasks.workunit.client.0.smithi012.stdout:933 2024-09-10T18:13:24.079 INFO:tasks.workunit.client.0.smithi012.stdout:934 2024-09-10T18:13:24.080 INFO:tasks.workunit.client.0.smithi012.stdout:935 2024-09-10T18:13:24.081 INFO:tasks.workunit.client.0.smithi012.stdout:936 2024-09-10T18:13:24.082 INFO:tasks.workunit.client.0.smithi012.stdout:937 2024-09-10T18:13:24.083 INFO:tasks.workunit.client.0.smithi012.stdout:938 2024-09-10T18:13:24.085 INFO:tasks.workunit.client.0.smithi012.stdout:939 2024-09-10T18:13:24.086 INFO:tasks.workunit.client.0.smithi012.stdout:940 2024-09-10T18:13:24.087 INFO:tasks.workunit.client.0.smithi012.stdout:941 2024-09-10T18:13:24.088 INFO:tasks.workunit.client.0.smithi012.stdout:942 2024-09-10T18:13:24.089 INFO:tasks.workunit.client.0.smithi012.stdout:943 2024-09-10T18:13:24.091 INFO:tasks.workunit.client.0.smithi012.stdout:944 2024-09-10T18:13:24.092 INFO:tasks.workunit.client.0.smithi012.stdout:945 2024-09-10T18:13:24.093 INFO:tasks.workunit.client.0.smithi012.stdout:946 2024-09-10T18:13:24.094 INFO:tasks.workunit.client.0.smithi012.stdout:947 2024-09-10T18:13:24.095 INFO:tasks.workunit.client.0.smithi012.stdout:948 2024-09-10T18:13:24.096 INFO:tasks.workunit.client.0.smithi012.stdout:949 2024-09-10T18:13:24.098 INFO:tasks.workunit.client.0.smithi012.stdout:950 2024-09-10T18:13:24.099 INFO:tasks.workunit.client.0.smithi012.stdout:951 2024-09-10T18:13:24.100 INFO:tasks.workunit.client.0.smithi012.stdout:952 2024-09-10T18:13:24.101 INFO:tasks.workunit.client.0.smithi012.stdout:953 2024-09-10T18:13:24.102 INFO:tasks.workunit.client.0.smithi012.stdout:954 2024-09-10T18:13:24.103 INFO:tasks.workunit.client.0.smithi012.stdout:955 2024-09-10T18:13:24.104 INFO:tasks.workunit.client.0.smithi012.stdout:956 2024-09-10T18:13:24.105 INFO:tasks.workunit.client.0.smithi012.stdout:957 2024-09-10T18:13:24.106 INFO:tasks.workunit.client.0.smithi012.stdout:958 2024-09-10T18:13:24.107 INFO:tasks.workunit.client.0.smithi012.stdout:959 2024-09-10T18:13:24.109 INFO:tasks.workunit.client.0.smithi012.stdout:960 2024-09-10T18:13:24.110 INFO:tasks.workunit.client.0.smithi012.stdout:961 2024-09-10T18:13:24.111 INFO:tasks.workunit.client.0.smithi012.stdout:962 2024-09-10T18:13:24.112 INFO:tasks.workunit.client.0.smithi012.stdout:963 2024-09-10T18:13:24.113 INFO:tasks.workunit.client.0.smithi012.stdout:964 2024-09-10T18:13:24.114 INFO:tasks.workunit.client.0.smithi012.stdout:965 2024-09-10T18:13:24.115 INFO:tasks.workunit.client.0.smithi012.stdout:966 2024-09-10T18:13:24.116 INFO:tasks.workunit.client.0.smithi012.stdout:967 2024-09-10T18:13:24.117 INFO:tasks.workunit.client.0.smithi012.stdout:968 2024-09-10T18:13:24.119 INFO:tasks.workunit.client.0.smithi012.stdout:969 2024-09-10T18:13:24.120 INFO:tasks.workunit.client.0.smithi012.stdout:970 2024-09-10T18:13:24.121 INFO:tasks.workunit.client.0.smithi012.stdout:971 2024-09-10T18:13:24.122 INFO:tasks.workunit.client.0.smithi012.stdout:972 2024-09-10T18:13:24.123 INFO:tasks.workunit.client.0.smithi012.stdout:973 2024-09-10T18:13:24.124 INFO:tasks.workunit.client.0.smithi012.stdout:974 2024-09-10T18:13:24.125 INFO:tasks.workunit.client.0.smithi012.stdout:975 2024-09-10T18:13:24.126 INFO:tasks.workunit.client.0.smithi012.stdout:976 2024-09-10T18:13:24.127 INFO:tasks.workunit.client.0.smithi012.stdout:977 2024-09-10T18:13:24.129 INFO:tasks.workunit.client.0.smithi012.stdout:978 2024-09-10T18:13:24.130 INFO:tasks.workunit.client.0.smithi012.stdout:979 2024-09-10T18:13:24.131 INFO:tasks.workunit.client.0.smithi012.stdout:980 2024-09-10T18:13:24.132 INFO:tasks.workunit.client.0.smithi012.stdout:981 2024-09-10T18:13:24.133 INFO:tasks.workunit.client.0.smithi012.stdout:982 2024-09-10T18:13:24.135 INFO:tasks.workunit.client.0.smithi012.stdout:983 2024-09-10T18:13:24.136 INFO:tasks.workunit.client.0.smithi012.stdout:984 2024-09-10T18:13:24.137 INFO:tasks.workunit.client.0.smithi012.stdout:985 2024-09-10T18:13:24.138 INFO:tasks.workunit.client.0.smithi012.stdout:986 2024-09-10T18:13:24.140 INFO:tasks.workunit.client.0.smithi012.stdout:987 2024-09-10T18:13:24.140 INFO:tasks.workunit.client.0.smithi012.stdout:988 2024-09-10T18:13:24.141 INFO:tasks.workunit.client.0.smithi012.stdout:989 2024-09-10T18:13:24.143 INFO:tasks.workunit.client.0.smithi012.stdout:990 2024-09-10T18:13:24.144 INFO:tasks.workunit.client.0.smithi012.stdout:991 2024-09-10T18:13:24.145 INFO:tasks.workunit.client.0.smithi012.stdout:992 2024-09-10T18:13:24.146 INFO:tasks.workunit.client.0.smithi012.stdout:993 2024-09-10T18:13:24.148 INFO:tasks.workunit.client.0.smithi012.stdout:994 2024-09-10T18:13:24.149 INFO:tasks.workunit.client.0.smithi012.stdout:995 2024-09-10T18:13:24.150 INFO:tasks.workunit.client.0.smithi012.stdout:996 2024-09-10T18:13:24.151 INFO:tasks.workunit.client.0.smithi012.stdout:997 2024-09-10T18:13:24.152 INFO:tasks.workunit.client.0.smithi012.stdout:998 2024-09-10T18:13:24.153 INFO:tasks.workunit.client.0.smithi012.stdout:999 2024-09-10T18:13:24.323 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:24.323 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-mon[89611]: osdmap e991: 8 total, 8 up, 8 in 2024-09-10T18:13:24.323 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/762990978' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-10T18:13:24.323 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-mon[89611]: pgmap v1200: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:24.323 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:24.323 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-mon[92029]: osdmap e991: 8 total, 8 up, 8 in 2024-09-10T18:13:24.324 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/762990978' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-10T18:13:24.324 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-mon[92029]: pgmap v1200: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:24.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:24 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:24.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:24 smithi089 ceph-mon[84132]: osdmap e991: 8 total, 8 up, 8 in 2024-09-10T18:13:24.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:24 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/762990978' entity='client.admin' cmd={"prefix": "osd dump","format":"json"} : dispatch 2024-09-10T18:13:24.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:24 smithi089 ceph-mon[84132]: pgmap v1200: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:24.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:13:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:13:24] "GET /metrics HTTP/1.1" 200 36446 "" "Prometheus/2.51.0" 2024-09-10T18:13:25.062 INFO:tasks.workunit.client.0.smithi012.stdout:00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-09-10T18:13:25.062 INFO:tasks.workunit.client.0.smithi012.stdout:00000010 69 73 |is| 2024-09-10T18:13:25.063 INFO:tasks.workunit.client.0.smithi012.stdout:00000012 2024-09-10T18:13:25.063 INFO:tasks.workunit.client.0.smithi012.stdout:00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-09-10T18:13:25.063 INFO:tasks.workunit.client.0.smithi012.stdout:00000010 69 73 |is| 2024-09-10T18:13:25.063 INFO:tasks.workunit.client.0.smithi012.stdout:00000012 2024-09-10T18:13:25.063 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsHello.WriteReturnData (4025 ms) 2024-09-10T18:13:25.063 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsHello.Loud 2024-09-10T18:13:25.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:25 smithi012 ceph-mon[89611]: osdmap e992: 8 total, 8 up, 8 in 2024-09-10T18:13:25.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:25 smithi012 ceph-mon[92029]: osdmap e992: 8 total, 8 up, 8 in 2024-09-10T18:13:25.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:25 smithi089 ceph-mon[84132]: osdmap e992: 8 total, 8 up, 8 in 2024-09-10T18:13:26.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:26 smithi012 ceph-mon[89611]: osdmap e993: 8 total, 8 up, 8 in 2024-09-10T18:13:26.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:26 smithi012 ceph-mon[89611]: pgmap v1203: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:26.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:26 smithi012 ceph-mon[92029]: osdmap e993: 8 total, 8 up, 8 in 2024-09-10T18:13:26.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:26 smithi012 ceph-mon[92029]: pgmap v1203: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:26.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:26 smithi089 ceph-mon[84132]: osdmap e993: 8 total, 8 up, 8 in 2024-09-10T18:13:26.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:26 smithi089 ceph-mon[84132]: pgmap v1203: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:27.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:27 smithi012 ceph-mon[89611]: osdmap e994: 8 total, 8 up, 8 in 2024-09-10T18:13:27.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:27 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1339510003' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:27.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:27 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:27.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:27 smithi012 ceph-mon[92029]: osdmap e994: 8 total, 8 up, 8 in 2024-09-10T18:13:27.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:27 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1339510003' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:27.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:27 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:27.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:27 smithi089 ceph-mon[84132]: osdmap e994: 8 total, 8 up, 8 in 2024-09-10T18:13:27.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:27 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1339510003' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:27.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:27 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:28.094 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsHello.Loud (3032 ms) 2024-09-10T18:13:28.094 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsHello.BadMethods 2024-09-10T18:13:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:28 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:28 smithi012 ceph-mon[89611]: osdmap e995: 8 total, 8 up, 8 in 2024-09-10T18:13:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:28 smithi012 ceph-mon[89611]: pgmap v1206: 137 pgs: 14 creating+peering, 18 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:28.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:28 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:28.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:28 smithi012 ceph-mon[92029]: osdmap e995: 8 total, 8 up, 8 in 2024-09-10T18:13:28.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:28 smithi012 ceph-mon[92029]: pgmap v1206: 137 pgs: 14 creating+peering, 18 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:28 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:28 smithi089 ceph-mon[84132]: osdmap e995: 8 total, 8 up, 8 in 2024-09-10T18:13:28.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:28 smithi089 ceph-mon[84132]: pgmap v1206: 137 pgs: 14 creating+peering, 18 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 711 GiB / 715 GiB avail 2024-09-10T18:13:29.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:29 smithi012 ceph-mon[89611]: osdmap e996: 8 total, 8 up, 8 in 2024-09-10T18:13:29.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:29 smithi012 ceph-mon[92029]: osdmap e996: 8 total, 8 up, 8 in 2024-09-10T18:13:29.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:29 smithi089 ceph-mon[84132]: osdmap e996: 8 total, 8 up, 8 in 2024-09-10T18:13:30.436 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: osdmap e997: 8 total, 8 up, 8 in 2024-09-10T18:13:30.436 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2397147258' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:30.436 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: pgmap v1209: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:30.436 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:13:30.436 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:13:30.436 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:13:30.436 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:13:30.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2397147258' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:30.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[89611]: osdmap e998: 8 total, 8 up, 8 in 2024-09-10T18:13:30.437 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:13:30.104+0000 7f867ce61640 -1 osd.3 pg_epoch: 998 pg[38.2( v 998'1 (0'0,998'1] local-lis/les=997/998 n=1 ec=997/997 lis/c=997/997 les/c/f=998/998/0 sis=997) [3,7,5] r=0 lpr=997 crt=998'1 lcod 0'0 mlcod 0'0 active+clean] method hello.bad_reader tried to read object but is not marked RD 2024-09-10T18:13:30.437 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:13:30.109+0000 7f867ce61640 -1 osd.3 pg_epoch: 998 pg[38.2( v 998'2 (0'0,998'2] local-lis/les=997/998 n=1 ec=997/997 lis/c=997/997 les/c/f=998/998/0 sis=997) [3,7,5] r=0 lpr=997 crt=998'1 lcod 998'1 mlcod 998'1 active+clean] method hello.bad_writer tried to update object but is not marked WR 2024-09-10T18:13:30.437 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: osdmap e997: 8 total, 8 up, 8 in 2024-09-10T18:13:30.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2397147258' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:30.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: pgmap v1209: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:30.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:13:30.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:13:30.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:13:30.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:13:30.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2397147258' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:30.438 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:30 smithi012 ceph-mon[92029]: osdmap e998: 8 total, 8 up, 8 in 2024-09-10T18:13:30.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: osdmap e997: 8 total, 8 up, 8 in 2024-09-10T18:13:30.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2397147258' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:30.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: pgmap v1209: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:30.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:13:30.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:13:30.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:13:30.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:13:30.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2397147258' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:30.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:30 smithi089 ceph-mon[84132]: osdmap e998: 8 total, 8 up, 8 in 2024-09-10T18:13:31.107 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsHello.BadMethods (3013 ms) 2024-09-10T18:13:31.107 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsHello.Filter 2024-09-10T18:13:31.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:31 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:31.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:31 smithi012 ceph-mon[89611]: osdmap e999: 8 total, 8 up, 8 in 2024-09-10T18:13:31.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:31 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:31.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:31 smithi012 ceph-mon[92029]: osdmap e999: 8 total, 8 up, 8 in 2024-09-10T18:13:31.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:31 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:31.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:31 smithi089 ceph-mon[84132]: osdmap e999: 8 total, 8 up, 8 in 2024-09-10T18:13:32.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[92029]: pgmap v1212: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:13:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[92029]: osdmap e1000: 8 total, 8 up, 8 in 2024-09-10T18:13:32.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3955201246' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:32.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[89611]: pgmap v1212: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:32.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:13:32.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:32.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:32.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:32.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[89611]: osdmap e1000: 8 total, 8 up, 8 in 2024-09-10T18:13:32.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:32 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3955201246' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:32.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:32 smithi089 ceph-mon[84132]: pgmap v1212: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:32.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:13:32.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:32 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:32.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:32 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:32.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:32 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:32.789 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:32 smithi089 ceph-mon[84132]: osdmap e1000: 8 total, 8 up, 8 in 2024-09-10T18:13:32.789 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:32 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3955201246' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:34.132 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsHello.Filter (3025 ms) 2024-09-10T18:13:34.132 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 6 tests from ClsHello (19000 ms total) 2024-09-10T18:13:34.132 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:13:34.132 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:13:34.132 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 6 tests from 1 test suite ran. (19000 ms total) 2024-09-10T18:13:34.132 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 6 tests. 2024-09-10T18:13:34.135 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T18:13:34.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:13:34.209 INFO:tasks.workunit:Running workunit cls/test_cls_journal.sh... 2024-09-10T18:13:34.209 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_journal.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_journal.sh 2024-09-10T18:13:34.284 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:13:34.284 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 27 tests from 1 test suite. 2024-09-10T18:13:34.284 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:13:34.285 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 27 tests from TestClsJournal 2024-09-10T18:13:34.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:34 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3955201246' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:34.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:34 smithi012 ceph-mon[89611]: osdmap e1001: 8 total, 8 up, 8 in 2024-09-10T18:13:34.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:34 smithi012 ceph-mon[89611]: pgmap v1215: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:34.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:13:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:13:34] "GET /metrics HTTP/1.1" 200 34071 "" "Prometheus/2.51.0" 2024-09-10T18:13:34.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:34 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3955201246' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:34.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:34 smithi012 ceph-mon[92029]: osdmap e1001: 8 total, 8 up, 8 in 2024-09-10T18:13:34.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:34 smithi012 ceph-mon[92029]: pgmap v1215: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:34.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:34 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3955201246' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-131935-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:34.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:34 smithi089 ceph-mon[84132]: osdmap e1001: 8 total, 8 up, 8 in 2024-09-10T18:13:34.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:34 smithi089 ceph-mon[84132]: pgmap v1215: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:35.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:35 smithi012 ceph-mon[89611]: osdmap e1002: 8 total, 8 up, 8 in 2024-09-10T18:13:35.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:35 smithi012 ceph-mon[92029]: osdmap e1002: 8 total, 8 up, 8 in 2024-09-10T18:13:35.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:35 smithi089 ceph-mon[84132]: osdmap e1002: 8 total, 8 up, 8 in 2024-09-10T18:13:36.145 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.Create 2024-09-10T18:13:36.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.Create (15 ms) 2024-09-10T18:13:36.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.MinimumSet 2024-09-10T18:13:36.168 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.MinimumSet (7 ms) 2024-09-10T18:13:36.168 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.MinimumSetStale 2024-09-10T18:13:36.173 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.MinimumSetStale (6 ms) 2024-09-10T18:13:36.173 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.MinimumSetOrderConstraint 2024-09-10T18:13:36.176 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.MinimumSetOrderConstraint (3 ms) 2024-09-10T18:13:36.176 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ActiveSet 2024-09-10T18:13:36.179 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ActiveSet (3 ms) 2024-09-10T18:13:36.180 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ActiveSetStale 2024-09-10T18:13:36.183 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ActiveSetStale (3 ms) 2024-09-10T18:13:36.183 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.CreateDuplicate 2024-09-10T18:13:36.185 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.CreateDuplicate (3 ms) 2024-09-10T18:13:36.186 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.GetClient 2024-09-10T18:13:36.188 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.GetClient (2 ms) 2024-09-10T18:13:36.188 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientRegister 2024-09-10T18:13:36.191 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientRegister (3 ms) 2024-09-10T18:13:36.191 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientRegisterDuplicate 2024-09-10T18:13:36.194 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientRegisterDuplicate (4 ms) 2024-09-10T18:13:36.194 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientUpdateData 2024-09-10T18:13:36.198 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientUpdateData (4 ms) 2024-09-10T18:13:36.199 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientUpdateState 2024-09-10T18:13:36.204 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientUpdateState (5 ms) 2024-09-10T18:13:36.204 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientUnregister 2024-09-10T18:13:36.207 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientUnregister (3 ms) 2024-09-10T18:13:36.207 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientUnregisterDNE 2024-09-10T18:13:36.211 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientUnregisterDNE (4 ms) 2024-09-10T18:13:36.212 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientUnregisterPruneTags 2024-09-10T18:13:36.313 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientUnregisterPruneTags (102 ms) 2024-09-10T18:13:36.313 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientCommit 2024-09-10T18:13:36.317 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientCommit (4 ms) 2024-09-10T18:13:36.317 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientCommitInvalid 2024-09-10T18:13:36.319 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientCommitInvalid (3 ms) 2024-09-10T18:13:36.319 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientCommitDNE 2024-09-10T18:13:36.320 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientCommitDNE (0 ms) 2024-09-10T18:13:36.320 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.ClientList 2024-09-10T18:13:36.358 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.ClientList (38 ms) 2024-09-10T18:13:36.359 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.GetNextTagTid 2024-09-10T18:13:36.362 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.GetNextTagTid (5 ms) 2024-09-10T18:13:36.363 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.TagCreate 2024-09-10T18:13:36.371 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.TagCreate (9 ms) 2024-09-10T18:13:36.372 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.TagCreatePrunesTags 2024-09-10T18:13:36.378 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.TagCreatePrunesTags (7 ms) 2024-09-10T18:13:36.378 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.TagList 2024-09-10T18:13:36.469 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.TagList (90 ms) 2024-09-10T18:13:36.469 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.GuardAppend 2024-09-10T18:13:36.471 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.GuardAppend (2 ms) 2024-09-10T18:13:36.471 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.GuardAppendDNE 2024-09-10T18:13:36.472 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.GuardAppendDNE (1 ms) 2024-09-10T18:13:36.472 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.GuardAppendOverflow 2024-09-10T18:13:36.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.GuardAppendOverflow (2 ms) 2024-09-10T18:13:36.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsJournal.Append 2024-09-10T18:13:36.483 INFO:tasks.workunit.client.0.smithi012.stdout:padding is not enabled 2024-09-10T18:13:36.483 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsJournal.Append (9 ms) 2024-09-10T18:13:36.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:36 smithi012 ceph-mon[89611]: osdmap e1003: 8 total, 8 up, 8 in 2024-09-10T18:13:36.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:36 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1853835483' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132205-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:36.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:36 smithi012 ceph-mon[89611]: pgmap v1218: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:36 smithi012 ceph-mon[92029]: osdmap e1003: 8 total, 8 up, 8 in 2024-09-10T18:13:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:36 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1853835483' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132205-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:36.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:36 smithi012 ceph-mon[92029]: pgmap v1218: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:36.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:36 smithi089 ceph-mon[84132]: osdmap e1003: 8 total, 8 up, 8 in 2024-09-10T18:13:36.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:36 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1853835483' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132205-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:36.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:36 smithi089 ceph-mon[84132]: pgmap v1218: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:37.152 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 27 tests from TestClsJournal (337 ms total) 2024-09-10T18:13:37.152 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:13:37.152 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:13:37.152 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 27 tests from 1 test suite ran. (2868 ms total) 2024-09-10T18:13:37.152 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 27 tests. 2024-09-10T18:13:37.155 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T18:13:37.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:13:37.225 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-10T18:13:37.226 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-10T18:13:37.300 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:13:37.300 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-10T18:13:37.300 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:13:37.300 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 11 tests from ClsLock 2024-09-10T18:13:37.300 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-10T18:13:37.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:37 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:37.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:37 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1853835483' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132205-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:37.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:37 smithi012 ceph-mon[89611]: osdmap e1004: 8 total, 8 up, 8 in 2024-09-10T18:13:37.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:37 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:37.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:37 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1853835483' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132205-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:37.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:37 smithi012 ceph-mon[92029]: osdmap e1004: 8 total, 8 up, 8 in 2024-09-10T18:13:37.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:37 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:37.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:37 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1853835483' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132205-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:37.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:37 smithi089 ceph-mon[84132]: osdmap e1004: 8 total, 8 up, 8 in 2024-09-10T18:13:38.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:38 smithi012 ceph-mon[89611]: osdmap e1005: 8 total, 8 up, 8 in 2024-09-10T18:13:38.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:38 smithi012 ceph-mon[89611]: pgmap v1221: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:38.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:38 smithi012 ceph-mon[92029]: osdmap e1005: 8 total, 8 up, 8 in 2024-09-10T18:13:38.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:38 smithi012 ceph-mon[92029]: pgmap v1221: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:38.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:38 smithi089 ceph-mon[84132]: osdmap e1005: 8 total, 8 up, 8 in 2024-09-10T18:13:38.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:38 smithi089 ceph-mon[84132]: pgmap v1221: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:39.201 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2024-09-10T18:13:39.201 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: exclusive 2024-09-10T18:13:39.201 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2024-09-10T18:13:39.201 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2024-09-10T18:13:39.201 INFO:tasks.workunit.client.0.smithi012.stdout: client.34887 expiration=2024-09-10T18:15:39.196644+0000 addr=v1:172.21.15.12:0/1721780125 cookie= 2024-09-10T18:13:39.205 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2024-09-10T18:13:39.205 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: shared 2024-09-10T18:13:39.205 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2024-09-10T18:13:39.205 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2024-09-10T18:13:39.205 INFO:tasks.workunit.client.0.smithi012.stdout: client.34887 expiration=2024-09-10T18:15:39.203083+0000 addr=v1:172.21.15.12:0/1721780125 cookie= 2024-09-10T18:13:39.205 INFO:tasks.workunit.client.0.smithi012.stdout: client.34893 expiration=0.000000 addr=v1:172.21.15.12:0/3436214210 cookie= 2024-09-10T18:13:39.206 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2024-09-10T18:13:39.206 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: shared 2024-09-10T18:13:39.206 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2024-09-10T18:13:39.206 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2024-09-10T18:13:39.206 INFO:tasks.workunit.client.0.smithi012.stdout: client.34893 expiration=0.000000 addr=v1:172.21.15.12:0/3436214210 cookie= 2024-09-10T18:13:39.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:39 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:39.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:39 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:39.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:39 smithi012 ceph-mon[89611]: osdmap e1006: 8 total, 8 up, 8 in 2024-09-10T18:13:39.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:39 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1721780125' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:39.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:39 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:39.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:39 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:39.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:39 smithi012 ceph-mon[92029]: osdmap e1006: 8 total, 8 up, 8 in 2024-09-10T18:13:39.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:39 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1721780125' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:39.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:39 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:39.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:39 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:39.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:39 smithi089 ceph-mon[84132]: osdmap e1006: 8 total, 8 up, 8 in 2024-09-10T18:13:39.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:39 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1721780125' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:40.177 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestMultiLocking (2877 ms) 2024-09-10T18:13:40.177 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestMeta 2024-09-10T18:13:40.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:40 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1721780125' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:40.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:40 smithi012 ceph-mon[89611]: osdmap e1007: 8 total, 8 up, 8 in 2024-09-10T18:13:40.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:40 smithi012 ceph-mon[89611]: pgmap v1224: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:40.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:40 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1721780125' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:40.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:40 smithi012 ceph-mon[92029]: osdmap e1007: 8 total, 8 up, 8 in 2024-09-10T18:13:40.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:40 smithi012 ceph-mon[92029]: pgmap v1224: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:40.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:40 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1721780125' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:40.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:40 smithi089 ceph-mon[84132]: osdmap e1007: 8 total, 8 up, 8 in 2024-09-10T18:13:40.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:40 smithi089 ceph-mon[84132]: pgmap v1224: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:41.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:41 smithi012 ceph-mon[89611]: osdmap e1008: 8 total, 8 up, 8 in 2024-09-10T18:13:41.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:41 smithi012 ceph-mon[92029]: osdmap e1008: 8 total, 8 up, 8 in 2024-09-10T18:13:41.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:41 smithi089 ceph-mon[84132]: osdmap e1008: 8 total, 8 up, 8 in 2024-09-10T18:13:42.224 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2024-09-10T18:13:42.224 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: shared 2024-09-10T18:13:42.224 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2024-09-10T18:13:42.225 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2024-09-10T18:13:42.225 INFO:tasks.workunit.client.0.smithi012.stdout: client.34905 expiration=0.000000 addr=v1:172.21.15.12:0/2104843374 cookie= 2024-09-10T18:13:42.226 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2024-09-10T18:13:42.226 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: exclusive 2024-09-10T18:13:42.226 INFO:tasks.workunit.client.0.smithi012.stdout: tag: new_tag 2024-09-10T18:13:42.226 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2024-09-10T18:13:42.226 INFO:tasks.workunit.client.0.smithi012.stdout: client.44810 expiration=0.000000 addr=v1:172.21.15.12:0/2719655431 cookie= 2024-09-10T18:13:42.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:42 smithi012 ceph-mon[89611]: osdmap e1009: 8 total, 8 up, 8 in 2024-09-10T18:13:42.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:42 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2719655431' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:42.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:42 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:42.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:42 smithi012 ceph-mon[89611]: pgmap v1227: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:42.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:42 smithi012 ceph-mon[92029]: osdmap e1009: 8 total, 8 up, 8 in 2024-09-10T18:13:42.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:42 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2719655431' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:42.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:42 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:42.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:42 smithi012 ceph-mon[92029]: pgmap v1227: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:42.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:42 smithi089 ceph-mon[84132]: osdmap e1009: 8 total, 8 up, 8 in 2024-09-10T18:13:42.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:42 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2719655431' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:42.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:42 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:42.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:42 smithi089 ceph-mon[84132]: pgmap v1227: 137 pgs: 32 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:43.191 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestMeta (3014 ms) 2024-09-10T18:13:43.191 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestCookie 2024-09-10T18:13:43.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:43 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:43.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:43 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:43.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:43 smithi012 ceph-mon[89611]: osdmap e1010: 8 total, 8 up, 8 in 2024-09-10T18:13:43.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:43 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:43.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:43 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:43.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:43 smithi012 ceph-mon[92029]: osdmap e1010: 8 total, 8 up, 8 in 2024-09-10T18:13:43.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:43 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:43.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:43 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:43.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:43 smithi089 ceph-mon[84132]: osdmap e1010: 8 total, 8 up, 8 in 2024-09-10T18:13:44.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:44 smithi012 ceph-mon[89611]: osdmap e1011: 8 total, 8 up, 8 in 2024-09-10T18:13:44.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:44 smithi012 ceph-mon[89611]: pgmap v1230: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:44.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:13:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:13:44] "GET /metrics HTTP/1.1" 200 34071 "" "Prometheus/2.51.0" 2024-09-10T18:13:44.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:44 smithi012 ceph-mon[92029]: osdmap e1011: 8 total, 8 up, 8 in 2024-09-10T18:13:44.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:44 smithi012 ceph-mon[92029]: pgmap v1230: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:44.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:44 smithi089 ceph-mon[84132]: osdmap e1011: 8 total, 8 up, 8 in 2024-09-10T18:13:44.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:44 smithi089 ceph-mon[84132]: pgmap v1230: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:45.346 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2024-09-10T18:13:45.346 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: exclusive 2024-09-10T18:13:45.346 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2024-09-10T18:13:45.346 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2024-09-10T18:13:45.349 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2024-09-10T18:13:45.349 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: shared 2024-09-10T18:13:45.349 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2024-09-10T18:13:45.349 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2024-09-10T18:13:45.349 INFO:tasks.workunit.client.0.smithi012.stdout: client.34911 expiration=0.000000 addr=v1:172.21.15.12:0/3518783262 cookie= 2024-09-10T18:13:45.349 INFO:tasks.workunit.client.0.smithi012.stdout: client.34911 expiration=0.000000 addr=v1:172.21.15.12:0/3518783262 cookie=new cookie 2024-09-10T18:13:45.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:45 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:45.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:45 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:45.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:45 smithi012 ceph-mon[89611]: osdmap e1012: 8 total, 8 up, 8 in 2024-09-10T18:13:45.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:45 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3518783262' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:45.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:45 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:45.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:45 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:45.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:45 smithi012 ceph-mon[92029]: osdmap e1012: 8 total, 8 up, 8 in 2024-09-10T18:13:45.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:45 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3518783262' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:45.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:45 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:45.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:45 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:45.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:45 smithi089 ceph-mon[84132]: osdmap e1012: 8 total, 8 up, 8 in 2024-09-10T18:13:45.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:45 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3518783262' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:46.205 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestCookie (3014 ms) 2024-09-10T18:13:46.205 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-10T18:13:46.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:46 smithi012 ceph-mon[89611]: pgmap v1232: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:46.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:46 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3518783262' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:46.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:46 smithi012 ceph-mon[89611]: osdmap e1013: 8 total, 8 up, 8 in 2024-09-10T18:13:46.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:46 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:46.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:46 smithi012 ceph-mon[92029]: pgmap v1232: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:46.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:46 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3518783262' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:46.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:46 smithi012 ceph-mon[92029]: osdmap e1013: 8 total, 8 up, 8 in 2024-09-10T18:13:46.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:46 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:46.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:46 smithi089 ceph-mon[84132]: pgmap v1232: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:46.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:46 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3518783262' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:46.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:46 smithi089 ceph-mon[84132]: osdmap e1013: 8 total, 8 up, 8 in 2024-09-10T18:13:46.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:46 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:47.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:47 smithi012 ceph-mon[89611]: osdmap e1014: 8 total, 8 up, 8 in 2024-09-10T18:13:47.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:47 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:47.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:47 smithi012 ceph-mon[92029]: osdmap e1014: 8 total, 8 up, 8 in 2024-09-10T18:13:47.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:47 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:47.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:47 smithi089 ceph-mon[84132]: osdmap e1014: 8 total, 8 up, 8 in 2024-09-10T18:13:47.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:47 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:13:48.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[89611]: pgmap v1235: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:48.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:48.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:48.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[89611]: osdmap e1015: 8 total, 8 up, 8 in 2024-09-10T18:13:48.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2759330358' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:48.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:48.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[92029]: pgmap v1235: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:48.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:48.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:48.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[92029]: osdmap e1015: 8 total, 8 up, 8 in 2024-09-10T18:13:48.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2759330358' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:48.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:48 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:48.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:48 smithi089 ceph-mon[84132]: pgmap v1235: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:48.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:48 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:48.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:48 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:48.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:48 smithi089 ceph-mon[84132]: osdmap e1015: 8 total, 8 up, 8 in 2024-09-10T18:13:48.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:48 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2759330358' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:48.537 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:48 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:49.244 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestMultipleLocks (3039 ms) 2024-09-10T18:13:49.244 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-10T18:13:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:49 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:49.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:49 smithi012 ceph-mon[89611]: osdmap e1016: 8 total, 8 up, 8 in 2024-09-10T18:13:49.534 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:49 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:49.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:49 smithi012 ceph-mon[92029]: osdmap e1016: 8 total, 8 up, 8 in 2024-09-10T18:13:49.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:49 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:49.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:49 smithi089 ceph-mon[84132]: osdmap e1016: 8 total, 8 up, 8 in 2024-09-10T18:13:50.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:50 smithi012 ceph-mon[89611]: pgmap v1238: 137 pgs: 5 creating+peering, 18 unknown, 114 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:50.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:50 smithi012 ceph-mon[89611]: osdmap e1017: 8 total, 8 up, 8 in 2024-09-10T18:13:50.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:50 smithi012 ceph-mon[92029]: pgmap v1238: 137 pgs: 5 creating+peering, 18 unknown, 114 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:50.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:50 smithi012 ceph-mon[92029]: osdmap e1017: 8 total, 8 up, 8 in 2024-09-10T18:13:50.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:50 smithi089 ceph-mon[84132]: pgmap v1238: 137 pgs: 5 creating+peering, 18 unknown, 114 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:50.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:50 smithi089 ceph-mon[84132]: osdmap e1017: 8 total, 8 up, 8 in 2024-09-10T18:13:51.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:51 smithi012 ceph-mon[89611]: osdmap e1018: 8 total, 8 up, 8 in 2024-09-10T18:13:51.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:51 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3094910496' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:51.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:51 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:51.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:51 smithi012 ceph-mon[92029]: osdmap e1018: 8 total, 8 up, 8 in 2024-09-10T18:13:51.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:51 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3094910496' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:51.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:51 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:51.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:51 smithi089 ceph-mon[84132]: osdmap e1018: 8 total, 8 up, 8 in 2024-09-10T18:13:51.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:51 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3094910496' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:51.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:51 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:52.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:52 smithi012 ceph-mon[89611]: pgmap v1241: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:52.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:52 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:52.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:52 smithi012 ceph-mon[89611]: osdmap e1019: 8 total, 8 up, 8 in 2024-09-10T18:13:52.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:52 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:52.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:52 smithi012 ceph-mon[92029]: pgmap v1241: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:52.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:52 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:52.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:52 smithi012 ceph-mon[92029]: osdmap e1019: 8 total, 8 up, 8 in 2024-09-10T18:13:52.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:52 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:52.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:52 smithi089 ceph-mon[84132]: pgmap v1241: 137 pgs: 5 creating+peering, 27 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:52.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:52 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:13:52.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:52 smithi089 ceph-mon[84132]: osdmap e1019: 8 total, 8 up, 8 in 2024-09-10T18:13:52.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:52 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:13:53.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:53 smithi012 ceph-mon[89611]: osdmap e1020: 8 total, 8 up, 8 in 2024-09-10T18:13:53.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:53 smithi012 ceph-mon[92029]: osdmap e1020: 8 total, 8 up, 8 in 2024-09-10T18:13:53.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:53 smithi089 ceph-mon[84132]: osdmap e1020: 8 total, 8 up, 8 in 2024-09-10T18:13:54.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:13:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:13:54] "GET /metrics HTTP/1.1" 200 34079 "" "Prometheus/2.51.0" 2024-09-10T18:13:54.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:54 smithi012 ceph-mon[89611]: pgmap v1244: 137 pgs: 5 creating+peering, 11 unknown, 121 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:54.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:54 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:54.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:54 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:13:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:54 smithi012 ceph-mon[92029]: pgmap v1244: 137 pgs: 5 creating+peering, 11 unknown, 121 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:54.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:54 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:54.536 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:54 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:13:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:54 smithi089 ceph-mon[84132]: pgmap v1244: 137 pgs: 5 creating+peering, 11 unknown, 121 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:13:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:54 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:13:54.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:54 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:13:56.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:56 smithi012 ceph-mon[89611]: pgmap v1245: 137 pgs: 5 creating+peering, 132 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:13:56.535 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:56 smithi012 ceph-mon[92029]: pgmap v1245: 137 pgs: 5 creating+peering, 132 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:13:56.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:56 smithi089 ceph-mon[84132]: pgmap v1245: 137 pgs: 5 creating+peering, 132 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:13:57.294 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestLockDuration (8050 ms) 2024-09-10T18:13:57.294 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-10T18:13:58.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:58 smithi012 ceph-mon[89611]: pgmap v1246: 137 pgs: 137 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:13:58.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:58 smithi012 ceph-mon[89611]: osdmap e1021: 8 total, 8 up, 8 in 2024-09-10T18:13:58.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:58 smithi012 ceph-mon[92029]: pgmap v1246: 137 pgs: 137 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:13:58.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:58 smithi012 ceph-mon[92029]: osdmap e1021: 8 total, 8 up, 8 in 2024-09-10T18:13:58.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:58 smithi089 ceph-mon[84132]: pgmap v1246: 137 pgs: 137 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:13:58.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:58 smithi089 ceph-mon[84132]: osdmap e1021: 8 total, 8 up, 8 in 2024-09-10T18:13:59.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:59 smithi012 ceph-mon[89611]: osdmap e1022: 8 total, 8 up, 8 in 2024-09-10T18:13:59.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:59 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3807133434' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:59.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:13:59 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:59 smithi012 ceph-mon[92029]: osdmap e1022: 8 total, 8 up, 8 in 2024-09-10T18:13:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:59 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3807133434' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:59.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:13:59 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:59.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:59 smithi089 ceph-mon[84132]: osdmap e1022: 8 total, 8 up, 8 in 2024-09-10T18:13:59.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:59 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3807133434' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:13:59.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:13:59 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:00.320 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestAssertLocked (3026 ms) 2024-09-10T18:14:00.320 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-10T18:14:00.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:00 smithi012 ceph-mon[89611]: pgmap v1249: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:00.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:00 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:00.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:00 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:00.686 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:00 smithi012 ceph-mon[89611]: osdmap e1023: 8 total, 8 up, 8 in 2024-09-10T18:14:00.686 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:00 smithi012 ceph-mon[92029]: pgmap v1249: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:00.686 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:00 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:00.686 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:00 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:00.687 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:00 smithi012 ceph-mon[92029]: osdmap e1023: 8 total, 8 up, 8 in 2024-09-10T18:14:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:00 smithi089 ceph-mon[84132]: pgmap v1249: 137 pgs: 8 creating+peering, 24 unknown, 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:00 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:00 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:00.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:00 smithi089 ceph-mon[84132]: osdmap e1023: 8 total, 8 up, 8 in 2024-09-10T18:14:01.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:01 smithi012 ceph-mon[89611]: osdmap e1024: 8 total, 8 up, 8 in 2024-09-10T18:14:01.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:01 smithi012 ceph-mon[92029]: osdmap e1024: 8 total, 8 up, 8 in 2024-09-10T18:14:01.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:01 smithi089 ceph-mon[84132]: osdmap e1024: 8 total, 8 up, 8 in 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[89611]: pgmap v1252: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[89611]: osdmap e1025: 8 total, 8 up, 8 in 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3249550972' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:02.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[92029]: pgmap v1252: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[92029]: osdmap e1025: 8 total, 8 up, 8 in 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3249550972' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:02 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:02 smithi089 ceph-mon[84132]: pgmap v1252: 105 pgs: 105 active+clean; 583 KiB data, 4.7 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:02.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:02 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:02.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:02 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:14:02.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:02 smithi089 ceph-mon[84132]: osdmap e1025: 8 total, 8 up, 8 in 2024-09-10T18:14:02.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:02 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3249550972' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:02.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:02 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:02.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:14:02.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:02 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:03.341 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestSetCookie (3021 ms) 2024-09-10T18:14:03.341 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestRenew 2024-09-10T18:14:03.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:03 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:03.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:03 smithi012 ceph-mon[89611]: osdmap e1026: 8 total, 8 up, 8 in 2024-09-10T18:14:03.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:03 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:03.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:03 smithi012 ceph-mon[92029]: osdmap e1026: 8 total, 8 up, 8 in 2024-09-10T18:14:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:03 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:03.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:03 smithi089 ceph-mon[84132]: osdmap e1026: 8 total, 8 up, 8 in 2024-09-10T18:14:04.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:04 smithi012 ceph-mon[89611]: pgmap v1255: 137 pgs: 13 creating+peering, 14 unknown, 110 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:04.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:04 smithi012 ceph-mon[89611]: osdmap e1027: 8 total, 8 up, 8 in 2024-09-10T18:14:04.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:14:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:14:04] "GET /metrics HTTP/1.1" 200 36444 "" "Prometheus/2.51.0" 2024-09-10T18:14:04.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:04 smithi012 ceph-mon[92029]: pgmap v1255: 137 pgs: 13 creating+peering, 14 unknown, 110 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:04.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:04 smithi012 ceph-mon[92029]: osdmap e1027: 8 total, 8 up, 8 in 2024-09-10T18:14:04.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:04 smithi089 ceph-mon[84132]: pgmap v1255: 137 pgs: 13 creating+peering, 14 unknown, 110 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:04.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:04 smithi089 ceph-mon[84132]: osdmap e1027: 8 total, 8 up, 8 in 2024-09-10T18:14:05.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:05 smithi012 ceph-mon[89611]: osdmap e1028: 8 total, 8 up, 8 in 2024-09-10T18:14:05.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:05 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3873840664' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:05.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:05 smithi012 ceph-mon[92029]: osdmap e1028: 8 total, 8 up, 8 in 2024-09-10T18:14:05.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:05 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3873840664' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:05.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:05 smithi089 ceph-mon[84132]: osdmap e1028: 8 total, 8 up, 8 in 2024-09-10T18:14:05.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:05 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3873840664' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:06 smithi012 ceph-mon[89611]: pgmap v1258: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:06 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:06.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:06 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3873840664' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:06.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:06 smithi012 ceph-mon[89611]: osdmap e1029: 8 total, 8 up, 8 in 2024-09-10T18:14:06.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:06 smithi012 ceph-mon[92029]: pgmap v1258: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:06.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:06 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:06.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:06 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3873840664' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:06.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:06 smithi012 ceph-mon[92029]: osdmap e1029: 8 total, 8 up, 8 in 2024-09-10T18:14:06.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:06 smithi089 ceph-mon[84132]: pgmap v1258: 137 pgs: 4 creating+peering, 28 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:06.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:06 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:06.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:06 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3873840664' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:06.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:06 smithi089 ceph-mon[84132]: osdmap e1029: 8 total, 8 up, 8 in 2024-09-10T18:14:07.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:07 smithi012 ceph-mon[89611]: osdmap e1030: 8 total, 8 up, 8 in 2024-09-10T18:14:07.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:07 smithi012 ceph-mon[92029]: osdmap e1030: 8 total, 8 up, 8 in 2024-09-10T18:14:07.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:07 smithi089 ceph-mon[84132]: osdmap e1030: 8 total, 8 up, 8 in 2024-09-10T18:14:08.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:08 smithi012 ceph-mon[89611]: pgmap v1261: 137 pgs: 4 creating+peering, 11 unknown, 122 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:08.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:08 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:08.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:08 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:14:08.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:08 smithi012 ceph-mon[92029]: pgmap v1261: 137 pgs: 4 creating+peering, 11 unknown, 122 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:08.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:08 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:08.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:08 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:14:08.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:08 smithi089 ceph-mon[84132]: pgmap v1261: 137 pgs: 4 creating+peering, 11 unknown, 122 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:08.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:08 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:08.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:08 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:14:10.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:10 smithi012 ceph-mon[89611]: pgmap v1262: 137 pgs: 4 creating+peering, 133 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 174 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:10.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:10 smithi012 ceph-mon[92029]: pgmap v1262: 137 pgs: 4 creating+peering, 133 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 174 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:10.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:10 smithi089 ceph-mon[84132]: pgmap v1262: 137 pgs: 4 creating+peering, 133 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 174 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:12.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:12 smithi012 ceph-mon[89611]: pgmap v1263: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 149 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:12.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:12 smithi012 ceph-mon[92029]: pgmap v1263: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 149 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:12.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:12 smithi089 ceph-mon[84132]: pgmap v1263: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 149 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:14.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:14 smithi012 ceph-mon[89611]: pgmap v1264: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 127 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:14.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:14:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:14:14] "GET /metrics HTTP/1.1" 200 36444 "" "Prometheus/2.51.0" 2024-09-10T18:14:14.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:14 smithi012 ceph-mon[92029]: pgmap v1264: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 127 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:14.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:14 smithi089 ceph-mon[84132]: pgmap v1264: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 127 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:16.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:16 smithi012 ceph-mon[89611]: pgmap v1265: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 104 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:16.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:16 smithi012 ceph-mon[92029]: pgmap v1265: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 104 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:16.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:16 smithi089 ceph-mon[84132]: pgmap v1265: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 104 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:17.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:17 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:17.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:17 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:17.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:17 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:18.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:18 smithi012 ceph-mon[89611]: pgmap v1266: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 94 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:18.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:18 smithi012 ceph-mon[92029]: pgmap v1266: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 94 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:18.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:18 smithi089 ceph-mon[84132]: pgmap v1266: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 94 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:20.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:20 smithi012 ceph-mon[89611]: pgmap v1267: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 1 op/s 2024-09-10T18:14:20.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:20 smithi012 ceph-mon[92029]: pgmap v1267: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 1 op/s 2024-09-10T18:14:20.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:20 smithi089 ceph-mon[84132]: pgmap v1267: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 341 B/s rd, 0 B/s wr, 1 op/s 2024-09-10T18:14:22.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:22 smithi012 ceph-mon[89611]: pgmap v1268: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:22.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:22 smithi012 ceph-mon[92029]: pgmap v1268: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:22.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:22 smithi089 ceph-mon[84132]: pgmap v1268: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:23.465 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestRenew (20125 ms) 2024-09-10T18:14:23.466 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-10T18:14:24.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:24 smithi012 ceph-mon[89611]: pgmap v1269: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:24.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:24 smithi012 ceph-mon[89611]: osdmap e1031: 8 total, 8 up, 8 in 2024-09-10T18:14:24.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:14:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:14:24] "GET /metrics HTTP/1.1" 200 36450 "" "Prometheus/2.51.0" 2024-09-10T18:14:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:24 smithi012 ceph-mon[92029]: pgmap v1269: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:24.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:24 smithi012 ceph-mon[92029]: osdmap e1031: 8 total, 8 up, 8 in 2024-09-10T18:14:24.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:24 smithi089 ceph-mon[84132]: pgmap v1269: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:24.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:24 smithi089 ceph-mon[84132]: osdmap e1031: 8 total, 8 up, 8 in 2024-09-10T18:14:25.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:25 smithi012 ceph-mon[89611]: osdmap e1032: 8 total, 8 up, 8 in 2024-09-10T18:14:25.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:25 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/271869294' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:25.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:25 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:25.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:25 smithi012 ceph-mon[92029]: osdmap e1032: 8 total, 8 up, 8 in 2024-09-10T18:14:25.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:25 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/271869294' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:25.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:25 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:25 smithi089 ceph-mon[84132]: osdmap e1032: 8 total, 8 up, 8 in 2024-09-10T18:14:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:25 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/271869294' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:25.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:25 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:26 smithi012 ceph-mon[89611]: pgmap v1272: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:26 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:26 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:26 smithi012 ceph-mon[89611]: osdmap e1033: 8 total, 8 up, 8 in 2024-09-10T18:14:26.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:26 smithi012 ceph-mon[92029]: pgmap v1272: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:26.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:26 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:26.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:26 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:26.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:26 smithi012 ceph-mon[92029]: osdmap e1033: 8 total, 8 up, 8 in 2024-09-10T18:14:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:26 smithi089 ceph-mon[84132]: pgmap v1272: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:26 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:26 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:26.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:26 smithi089 ceph-mon[84132]: osdmap e1033: 8 total, 8 up, 8 in 2024-09-10T18:14:27.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:27 smithi012 ceph-mon[89611]: osdmap e1034: 8 total, 8 up, 8 in 2024-09-10T18:14:27.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:27 smithi012 ceph-mon[92029]: osdmap e1034: 8 total, 8 up, 8 in 2024-09-10T18:14:27.785 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:27 smithi089 ceph-mon[84132]: osdmap e1034: 8 total, 8 up, 8 in 2024-09-10T18:14:28.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:28 smithi012 ceph-mon[92029]: pgmap v1275: 137 pgs: 6 creating+peering, 9 unknown, 122 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:28.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:28 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:28.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:28 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:14:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:28 smithi012 ceph-mon[89611]: pgmap v1275: 137 pgs: 6 creating+peering, 9 unknown, 122 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:28 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:28.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:28 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:14:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:28 smithi089 ceph-mon[84132]: pgmap v1275: 137 pgs: 6 creating+peering, 9 unknown, 122 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:28 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:28.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:28 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:14:30.514 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7048 ms) 2024-09-10T18:14:30.514 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-10T18:14:30.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[92029]: pgmap v1276: 137 pgs: 6 creating+peering, 131 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:30.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:14:30.784 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:14:30.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:14:30.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:14:30.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[89611]: pgmap v1276: 137 pgs: 6 creating+peering, 131 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:30.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:14:30.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:14:30.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:14:30.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:14:30.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:30 smithi089 ceph-mon[84132]: pgmap v1276: 137 pgs: 6 creating+peering, 131 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:30.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:14:30.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:14:30.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:14:30.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:14:31.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:31 smithi012 ceph-mon[89611]: osdmap e1035: 8 total, 8 up, 8 in 2024-09-10T18:14:31.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:31.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:31 smithi012 ceph-mon[92029]: osdmap e1035: 8 total, 8 up, 8 in 2024-09-10T18:14:31.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:31 smithi089 ceph-mon[84132]: osdmap e1035: 8 total, 8 up, 8 in 2024-09-10T18:14:31.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:32.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:32 smithi012 ceph-mon[89611]: pgmap v1278: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:32.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:32 smithi012 ceph-mon[89611]: osdmap e1036: 8 total, 8 up, 8 in 2024-09-10T18:14:32.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:32 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/925994304' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:32.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:32 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:32 smithi012 ceph-mon[92029]: pgmap v1278: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:32 smithi012 ceph-mon[92029]: osdmap e1036: 8 total, 8 up, 8 in 2024-09-10T18:14:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:32 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/925994304' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:32.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:32 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:32 smithi089 ceph-mon[84132]: pgmap v1278: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:32 smithi089 ceph-mon[84132]: osdmap e1036: 8 total, 8 up, 8 in 2024-09-10T18:14:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:32 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/925994304' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:32.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:32 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:33.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:33 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:33.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:33 smithi012 ceph-mon[89611]: osdmap e1037: 8 total, 8 up, 8 in 2024-09-10T18:14:33.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:33 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:33.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:33 smithi012 ceph-mon[92029]: osdmap e1037: 8 total, 8 up, 8 in 2024-09-10T18:14:33.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:33 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:33.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:33 smithi089 ceph-mon[84132]: osdmap e1037: 8 total, 8 up, 8 in 2024-09-10T18:14:34.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:34 smithi012 ceph-mon[89611]: pgmap v1281: 137 pgs: 13 creating+peering, 15 unknown, 109 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:34.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:34 smithi012 ceph-mon[89611]: osdmap e1038: 8 total, 8 up, 8 in 2024-09-10T18:14:34.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:34 smithi012 ceph-mon[92029]: pgmap v1281: 137 pgs: 13 creating+peering, 15 unknown, 109 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:34.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:34 smithi012 ceph-mon[92029]: osdmap e1038: 8 total, 8 up, 8 in 2024-09-10T18:14:34.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:14:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:14:34] "GET /metrics HTTP/1.1" 200 34074 "" "Prometheus/2.51.0" 2024-09-10T18:14:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:34 smithi089 ceph-mon[84132]: pgmap v1281: 137 pgs: 13 creating+peering, 15 unknown, 109 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:34.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:34 smithi089 ceph-mon[84132]: osdmap e1038: 8 total, 8 up, 8 in 2024-09-10T18:14:36.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:36 smithi012 ceph-mon[89611]: pgmap v1283: 137 pgs: 13 creating+peering, 5 unknown, 119 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:36.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:36 smithi012 ceph-mon[92029]: pgmap v1283: 137 pgs: 13 creating+peering, 5 unknown, 119 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:36.786 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:36 smithi089 ceph-mon[84132]: pgmap v1283: 137 pgs: 13 creating+peering, 5 unknown, 119 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:38.544 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8030 ms) 2024-09-10T18:14:38.544 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-10T18:14:39.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:38 smithi012 ceph-mon[89611]: pgmap v1284: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:39.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:38 smithi012 ceph-mon[92029]: pgmap v1284: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:39.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:38 smithi089 ceph-mon[84132]: pgmap v1284: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:40.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:39 smithi012 ceph-mon[89611]: osdmap e1039: 8 total, 8 up, 8 in 2024-09-10T18:14:40.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:39 smithi012 ceph-mon[92029]: osdmap e1039: 8 total, 8 up, 8 in 2024-09-10T18:14:40.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:39 smithi089 ceph-mon[84132]: osdmap e1039: 8 total, 8 up, 8 in 2024-09-10T18:14:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:40 smithi012 ceph-mon[89611]: pgmap v1286: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:41.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:40 smithi012 ceph-mon[89611]: osdmap e1040: 8 total, 8 up, 8 in 2024-09-10T18:14:41.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:40 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/818237467' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:41.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:40 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:40 smithi012 ceph-mon[92029]: pgmap v1286: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:40 smithi012 ceph-mon[92029]: osdmap e1040: 8 total, 8 up, 8 in 2024-09-10T18:14:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:40 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/818237467' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:41.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:40 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:40 smithi089 ceph-mon[84132]: pgmap v1286: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:40 smithi089 ceph-mon[84132]: osdmap e1040: 8 total, 8 up, 8 in 2024-09-10T18:14:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:40 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/818237467' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:41.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:40 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:42.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:41 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:42.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:41 smithi012 ceph-mon[89611]: osdmap e1041: 8 total, 8 up, 8 in 2024-09-10T18:14:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:41 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:42.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:41 smithi012 ceph-mon[92029]: osdmap e1041: 8 total, 8 up, 8 in 2024-09-10T18:14:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:41 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132260-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:41 smithi089 ceph-mon[84132]: osdmap e1041: 8 total, 8 up, 8 in 2024-09-10T18:14:43.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:42 smithi012 ceph-mon[89611]: pgmap v1289: 137 pgs: 6 creating+peering, 25 unknown, 106 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:43.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:42 smithi012 ceph-mon[89611]: osdmap e1042: 8 total, 8 up, 8 in 2024-09-10T18:14:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:42 smithi012 ceph-mon[92029]: pgmap v1289: 137 pgs: 6 creating+peering, 25 unknown, 106 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:43.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:42 smithi012 ceph-mon[92029]: osdmap e1042: 8 total, 8 up, 8 in 2024-09-10T18:14:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:42 smithi089 ceph-mon[84132]: pgmap v1289: 137 pgs: 6 creating+peering, 25 unknown, 106 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:43.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:42 smithi089 ceph-mon[84132]: osdmap e1042: 8 total, 8 up, 8 in 2024-09-10T18:14:44.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:44 smithi012 ceph-mon[89611]: pgmap v1291: 137 pgs: 6 creating+peering, 12 unknown, 119 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:44.785 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:14:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:14:44] "GET /metrics HTTP/1.1" 200 34074 "" "Prometheus/2.51.0" 2024-09-10T18:14:44.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:44 smithi012 ceph-mon[92029]: pgmap v1291: 137 pgs: 6 creating+peering, 12 unknown, 119 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:45.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:44 smithi089 ceph-mon[84132]: pgmap v1291: 137 pgs: 6 creating+peering, 12 unknown, 119 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:46.584 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8040 ms) 2024-09-10T18:14:46.584 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 11 tests from ClsLock (69284 ms total) 2024-09-10T18:14:46.584 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:14:46.584 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:14:46.584 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 11 tests from 1 test suite ran. (69284 ms total) 2024-09-10T18:14:46.584 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 11 tests. 2024-09-10T18:14:46.588 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T18:14:46.588 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:14:46.659 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-10T18:14:46.659 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-10T18:14:46.735 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:14:46.735 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-10T18:14:46.735 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:14:46.735 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 4 tests from cls_log 2024-09-10T18:14:46.735 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-10T18:14:46.838 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:46 smithi089 ceph-mon[84132]: pgmap v1292: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:46.838 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:46 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:47.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:46 smithi012 ceph-mon[89611]: pgmap v1292: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:47.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:46 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:46 smithi012 ceph-mon[92029]: pgmap v1292: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-09-10T18:14:47.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:46 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:14:48.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:47 smithi012 ceph-mon[89611]: osdmap e1043: 8 total, 8 up, 8 in 2024-09-10T18:14:48.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:47 smithi012 ceph-mon[92029]: osdmap e1043: 8 total, 8 up, 8 in 2024-09-10T18:14:48.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:47 smithi089 ceph-mon[84132]: osdmap e1043: 8 total, 8 up, 8 in 2024-09-10T18:14:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:48 smithi012 ceph-mon[89611]: pgmap v1294: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:49.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:48 smithi012 ceph-mon[89611]: osdmap e1044: 8 total, 8 up, 8 in 2024-09-10T18:14:49.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:48 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3055305237' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:49.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:48 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:48 smithi012 ceph-mon[92029]: pgmap v1294: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:48 smithi012 ceph-mon[92029]: osdmap e1044: 8 total, 8 up, 8 in 2024-09-10T18:14:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:48 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3055305237' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:49.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:48 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:48 smithi089 ceph-mon[84132]: pgmap v1294: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:48 smithi089 ceph-mon[84132]: osdmap e1044: 8 total, 8 up, 8 in 2024-09-10T18:14:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:48 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3055305237' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:49.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:48 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:49.616 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_log.test_log_add_same_time (2881 ms) 2024-09-10T18:14:49.616 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-10T18:14:50.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:49 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:50.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:49 smithi012 ceph-mon[89611]: osdmap e1045: 8 total, 8 up, 8 in 2024-09-10T18:14:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:49 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:50.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:49 smithi012 ceph-mon[92029]: osdmap e1045: 8 total, 8 up, 8 in 2024-09-10T18:14:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:49 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:50.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:49 smithi089 ceph-mon[84132]: osdmap e1045: 8 total, 8 up, 8 in 2024-09-10T18:14:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:50 smithi012 ceph-mon[89611]: pgmap v1297: 137 pgs: 1 creating+peering, 21 unknown, 115 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-10T18:14:51.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:50 smithi012 ceph-mon[89611]: osdmap e1046: 8 total, 8 up, 8 in 2024-09-10T18:14:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:50 smithi012 ceph-mon[92029]: pgmap v1297: 137 pgs: 1 creating+peering, 21 unknown, 115 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-10T18:14:51.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:50 smithi012 ceph-mon[92029]: osdmap e1046: 8 total, 8 up, 8 in 2024-09-10T18:14:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:50 smithi089 ceph-mon[84132]: pgmap v1297: 137 pgs: 1 creating+peering, 21 unknown, 115 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-10T18:14:51.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:50 smithi089 ceph-mon[84132]: osdmap e1046: 8 total, 8 up, 8 in 2024-09-10T18:14:52.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:51 smithi012 ceph-mon[89611]: osdmap e1047: 8 total, 8 up, 8 in 2024-09-10T18:14:52.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:51 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2458351112' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:52.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:51 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:52.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:51 smithi012 ceph-mon[92029]: osdmap e1047: 8 total, 8 up, 8 in 2024-09-10T18:14:52.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:51 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2458351112' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:52.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:51 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:51 smithi089 ceph-mon[84132]: osdmap e1047: 8 total, 8 up, 8 in 2024-09-10T18:14:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:51 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2458351112' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:52.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:51 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:52.636 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_log.test_log_add_different_time (3019 ms) 2024-09-10T18:14:52.636 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_log.trim_by_time 2024-09-10T18:14:53.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:52 smithi012 ceph-mon[89611]: pgmap v1300: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:52 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:52 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:53.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:52 smithi012 ceph-mon[89611]: osdmap e1048: 8 total, 8 up, 8 in 2024-09-10T18:14:53.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:52 smithi012 ceph-mon[92029]: pgmap v1300: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:53.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:52 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:53.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:52 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:53.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:52 smithi012 ceph-mon[92029]: osdmap e1048: 8 total, 8 up, 8 in 2024-09-10T18:14:53.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:52 smithi089 ceph-mon[84132]: pgmap v1300: 137 pgs: 2 creating+peering, 30 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:53.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:52 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:53.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:52 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:53.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:52 smithi089 ceph-mon[84132]: osdmap e1048: 8 total, 8 up, 8 in 2024-09-10T18:14:54.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:53 smithi012 ceph-mon[89611]: osdmap e1049: 8 total, 8 up, 8 in 2024-09-10T18:14:54.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:53 smithi012 ceph-mon[92029]: osdmap e1049: 8 total, 8 up, 8 in 2024-09-10T18:14:54.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:53 smithi089 ceph-mon[84132]: osdmap e1049: 8 total, 8 up, 8 in 2024-09-10T18:14:54.631 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:14:54] "GET /metrics HTTP/1.1" 200 36447 "" "Prometheus/2.51.0" 2024-09-10T18:14:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[89611]: pgmap v1303: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:55.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[89611]: osdmap e1050: 8 total, 8 up, 8 in 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/62133867' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[92029]: pgmap v1303: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[92029]: osdmap e1050: 8 total, 8 up, 8 in 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/62133867' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:55.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:54 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:54 smithi089 ceph-mon[84132]: pgmap v1303: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:54 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:14:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:54 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:14:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:54 smithi089 ceph-mon[84132]: osdmap e1050: 8 total, 8 up, 8 in 2024-09-10T18:14:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:54 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/62133867' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:55.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:54 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:55.651 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_log.trim_by_time (3016 ms) 2024-09-10T18:14:55.651 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-10T18:14:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:55 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:56.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:55 smithi012 ceph-mon[89611]: osdmap e1051: 8 total, 8 up, 8 in 2024-09-10T18:14:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:55 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:56.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:55 smithi012 ceph-mon[92029]: osdmap e1051: 8 total, 8 up, 8 in 2024-09-10T18:14:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:55 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:56.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:55 smithi089 ceph-mon[84132]: osdmap e1051: 8 total, 8 up, 8 in 2024-09-10T18:14:57.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:56 smithi012 ceph-mon[89611]: pgmap v1306: 137 pgs: 10 creating+peering, 20 unknown, 107 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:57.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:56 smithi012 ceph-mon[89611]: osdmap e1052: 8 total, 8 up, 8 in 2024-09-10T18:14:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:56 smithi012 ceph-mon[92029]: pgmap v1306: 137 pgs: 10 creating+peering, 20 unknown, 107 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:57.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:56 smithi012 ceph-mon[92029]: osdmap e1052: 8 total, 8 up, 8 in 2024-09-10T18:14:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:56 smithi089 ceph-mon[84132]: pgmap v1306: 137 pgs: 10 creating+peering, 20 unknown, 107 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:57.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:56 smithi089 ceph-mon[84132]: osdmap e1052: 8 total, 8 up, 8 in 2024-09-10T18:14:58.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:57 smithi012 ceph-mon[89611]: osdmap e1053: 8 total, 8 up, 8 in 2024-09-10T18:14:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:57 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2140035489' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:58.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:57 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:57 smithi012 ceph-mon[92029]: osdmap e1053: 8 total, 8 up, 8 in 2024-09-10T18:14:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:57 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2140035489' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:58.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:57 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:57 smithi089 ceph-mon[84132]: osdmap e1053: 8 total, 8 up, 8 in 2024-09-10T18:14:58.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:57 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2140035489' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:58.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:57 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:14:58.669 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_log.trim_by_marker (3018 ms) 2024-09-10T18:14:58.670 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 4 tests from cls_log (11934 ms total) 2024-09-10T18:14:58.670 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:14:58.670 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:14:58.670 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 4 tests from 1 test suite ran. (11934 ms total) 2024-09-10T18:14:58.670 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 4 tests. 2024-09-10T18:14:58.673 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T18:14:58.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:14:58.746 INFO:tasks.workunit:Running workunit cls/test_cls_numops.sh... 2024-09-10T18:14:58.747 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_numops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_numops.sh 2024-09-10T18:14:58.822 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:14:58.822 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-10T18:14:58.822 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:14:58.822 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 4 tests from ClsNumOps 2024-09-10T18:14:58.822 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsNumOps.Add 2024-09-10T18:14:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:58 smithi012 ceph-mon[89611]: pgmap v1309: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:58 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:58 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:59.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:58 smithi012 ceph-mon[89611]: osdmap e1054: 8 total, 8 up, 8 in 2024-09-10T18:14:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:58 smithi012 ceph-mon[92029]: pgmap v1309: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:58 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:58 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:59.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:58 smithi012 ceph-mon[92029]: osdmap e1054: 8 total, 8 up, 8 in 2024-09-10T18:14:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:58 smithi089 ceph-mon[84132]: pgmap v1309: 137 pgs: 6 creating+peering, 26 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:14:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:58 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:14:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:58 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132645-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:14:59.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:58 smithi089 ceph-mon[84132]: osdmap e1054: 8 total, 8 up, 8 in 2024-09-10T18:15:00.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:14:59 smithi012 ceph-mon[89611]: osdmap e1055: 8 total, 8 up, 8 in 2024-09-10T18:15:00.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:14:59 smithi012 ceph-mon[92029]: osdmap e1055: 8 total, 8 up, 8 in 2024-09-10T18:15:00.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:14:59 smithi089 ceph-mon[84132]: osdmap e1055: 8 total, 8 up, 8 in 2024-09-10T18:15:00.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[89611]: pgmap v1312: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:00.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:00.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:15:00.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[89611]: osdmap e1056: 8 total, 8 up, 8 in 2024-09-10T18:15:00.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3085921797' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:00.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:00.935 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[92029]: pgmap v1312: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:00.936 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:00.936 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:15:00.936 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[92029]: osdmap e1056: 8 total, 8 up, 8 in 2024-09-10T18:15:00.936 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3085921797' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:00.936 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:00 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:00 smithi089 ceph-mon[84132]: pgmap v1312: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:00 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:00 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:15:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:00 smithi089 ceph-mon[84132]: osdmap e1056: 8 total, 8 up, 8 in 2024-09-10T18:15:01.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:00 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3085921797' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:01.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:00 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:01.695 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsNumOps.Add (2873 ms) 2024-09-10T18:15:01.695 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsNumOps.Sub 2024-09-10T18:15:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:01 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:02.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:01 smithi012 ceph-mon[89611]: osdmap e1057: 8 total, 8 up, 8 in 2024-09-10T18:15:02.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:01 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:01 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:01 smithi012 ceph-mon[92029]: osdmap e1057: 8 total, 8 up, 8 in 2024-09-10T18:15:02.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:01 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:01 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:01 smithi089 ceph-mon[84132]: osdmap e1057: 8 total, 8 up, 8 in 2024-09-10T18:15:02.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:01 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:02 smithi012 ceph-mon[89611]: pgmap v1315: 137 pgs: 3 creating+peering, 27 unknown, 107 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:03.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:02 smithi012 ceph-mon[89611]: osdmap e1058: 8 total, 8 up, 8 in 2024-09-10T18:15:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:02 smithi012 ceph-mon[92029]: pgmap v1315: 137 pgs: 3 creating+peering, 27 unknown, 107 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:03.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:02 smithi012 ceph-mon[92029]: osdmap e1058: 8 total, 8 up, 8 in 2024-09-10T18:15:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:02 smithi089 ceph-mon[84132]: pgmap v1315: 137 pgs: 3 creating+peering, 27 unknown, 107 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:03.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:02 smithi089 ceph-mon[84132]: osdmap e1058: 8 total, 8 up, 8 in 2024-09-10T18:15:04.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:03 smithi012 ceph-mon[89611]: osdmap e1059: 8 total, 8 up, 8 in 2024-09-10T18:15:04.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:03 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2599580713' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:04.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:03 smithi012 ceph-mon[92029]: osdmap e1059: 8 total, 8 up, 8 in 2024-09-10T18:15:04.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:03 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2599580713' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:04.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:03 smithi089 ceph-mon[84132]: osdmap e1059: 8 total, 8 up, 8 in 2024-09-10T18:15:04.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:03 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2599580713' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:04.702 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:15:04] "GET /metrics HTTP/1.1" 200 36445 "" "Prometheus/2.51.0" 2024-09-10T18:15:04.718 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsNumOps.Sub (3023 ms) 2024-09-10T18:15:04.719 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsNumOps.Mul 2024-09-10T18:15:05.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-mon[92029]: pgmap v1318: 137 pgs: 1 creating+peering, 31 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:15:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2599580713' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:05.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-mon[92029]: osdmap e1060: 8 total, 8 up, 8 in 2024-09-10T18:15:05.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-mon[89611]: pgmap v1318: 137 pgs: 1 creating+peering, 31 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:05.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:15:05.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2599580713' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:05.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:04 smithi012 ceph-mon[89611]: osdmap e1060: 8 total, 8 up, 8 in 2024-09-10T18:15:05.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:04 smithi089 ceph-mon[84132]: pgmap v1318: 137 pgs: 1 creating+peering, 31 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:04 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:15:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:04 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2599580713' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:05.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:04 smithi089 ceph-mon[84132]: osdmap e1060: 8 total, 8 up, 8 in 2024-09-10T18:15:06.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:05 smithi012 ceph-mon[89611]: osdmap e1061: 8 total, 8 up, 8 in 2024-09-10T18:15:06.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:05 smithi012 ceph-mon[92029]: osdmap e1061: 8 total, 8 up, 8 in 2024-09-10T18:15:06.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:05 smithi089 ceph-mon[84132]: osdmap e1061: 8 total, 8 up, 8 in 2024-09-10T18:15:07.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[89611]: pgmap v1321: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[89611]: osdmap e1062: 8 total, 8 up, 8 in 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/435899819' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[92029]: pgmap v1321: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[92029]: osdmap e1062: 8 total, 8 up, 8 in 2024-09-10T18:15:07.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/435899819' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:07.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:06 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:06 smithi089 ceph-mon[84132]: pgmap v1321: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:06 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:06 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:15:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:06 smithi089 ceph-mon[84132]: osdmap e1062: 8 total, 8 up, 8 in 2024-09-10T18:15:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:06 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/435899819' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:07.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:06 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:07.736 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsNumOps.Mul (3018 ms) 2024-09-10T18:15:07.737 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsNumOps.Div 2024-09-10T18:15:08.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:07 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:08.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:07 smithi012 ceph-mon[89611]: osdmap e1063: 8 total, 8 up, 8 in 2024-09-10T18:15:08.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:07 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:08.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:07 smithi012 ceph-mon[92029]: osdmap e1063: 8 total, 8 up, 8 in 2024-09-10T18:15:08.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:07 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:08.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:07 smithi089 ceph-mon[84132]: osdmap e1063: 8 total, 8 up, 8 in 2024-09-10T18:15:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:08 smithi012 ceph-mon[92029]: pgmap v1324: 137 pgs: 10 creating+peering, 16 unknown, 111 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-10T18:15:09.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:08 smithi012 ceph-mon[92029]: osdmap e1064: 8 total, 8 up, 8 in 2024-09-10T18:15:09.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:08 smithi012 ceph-mon[89611]: pgmap v1324: 137 pgs: 10 creating+peering, 16 unknown, 111 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-10T18:15:09.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:08 smithi012 ceph-mon[89611]: osdmap e1064: 8 total, 8 up, 8 in 2024-09-10T18:15:09.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:08 smithi089 ceph-mon[84132]: pgmap v1324: 137 pgs: 10 creating+peering, 16 unknown, 111 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-10T18:15:09.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:08 smithi089 ceph-mon[84132]: osdmap e1064: 8 total, 8 up, 8 in 2024-09-10T18:15:10.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:09 smithi012 ceph-mon[89611]: osdmap e1065: 8 total, 8 up, 8 in 2024-09-10T18:15:10.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:09 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/3974255753' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:10.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:09 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:09 smithi012 ceph-mon[92029]: osdmap e1065: 8 total, 8 up, 8 in 2024-09-10T18:15:10.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:09 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/3974255753' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:10.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:09 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:09 smithi089 ceph-mon[84132]: osdmap e1065: 8 total, 8 up, 8 in 2024-09-10T18:15:10.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:09 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/3974255753' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:10.037 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:09 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:10.759 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsNumOps.Div (3023 ms) 2024-09-10T18:15:10.759 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 4 tests from ClsNumOps (11937 ms total) 2024-09-10T18:15:10.759 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:15:10.759 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:15:10.759 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 4 tests from 1 test suite ran. (11937 ms total) 2024-09-10T18:15:10.759 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 4 tests. 2024-09-10T18:15:10.762 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T18:15:10.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:15:10.842 INFO:tasks.workunit:Running workunit cls/test_cls_rbd.sh... 2024-09-10T18:15:10.842 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_rbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh 2024-09-10T18:15:10.918 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2024-09-10T18:15:10.919 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 70 tests from 1 test suite. 2024-09-10T18:15:10.919 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2024-09-10T18:15:10.919 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 70 tests from TestClsRbd 2024-09-10T18:15:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:10 smithi012 ceph-mon[89611]: pgmap v1327: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:10 smithi012 ceph-mon[89611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:15:11.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:10 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:11.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:10 smithi012 ceph-mon[89611]: osdmap e1066: 8 total, 8 up, 8 in 2024-09-10T18:15:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:10 smithi012 ceph-mon[92029]: pgmap v1327: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:10 smithi012 ceph-mon[92029]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:15:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:10 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:11.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:10 smithi012 ceph-mon[92029]: osdmap e1066: 8 total, 8 up, 8 in 2024-09-10T18:15:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:10 smithi089 ceph-mon[84132]: pgmap v1327: 137 pgs: 10 creating+peering, 22 unknown, 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:10 smithi089 ceph-mon[84132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:15:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:10 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132751-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:11.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:10 smithi089 ceph-mon[84132]: osdmap e1066: 8 total, 8 up, 8 in 2024-09-10T18:15:12.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:11 smithi012 ceph-mon[89611]: osdmap e1067: 8 total, 8 up, 8 in 2024-09-10T18:15:12.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:11 smithi012 ceph-mon[92029]: osdmap e1067: 8 total, 8 up, 8 in 2024-09-10T18:15:12.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:11 smithi089 ceph-mon[84132]: osdmap e1067: 8 total, 8 up, 8 in 2024-09-10T18:15:12.776 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_all_features 2024-09-10T18:15:12.786 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_all_features (10 ms) 2024-09-10T18:15:12.787 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.copyup 2024-09-10T18:15:12.970 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.copyup (183 ms) 2024-09-10T18:15:12.970 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.sparse_copyup 2024-09-10T18:15:12.987 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.sparse_copyup (18 ms) 2024-09-10T18:15:12.987 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_and_set_id 2024-09-10T18:15:12.994 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_and_set_id (7 ms) 2024-09-10T18:15:12.994 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.add_remove_child 2024-09-10T18:15:13.007 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.add_remove_child (12 ms) 2024-09-10T18:15:13.007 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.directory_methods 2024-09-10T18:15:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[89611]: pgmap v1330: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[89611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:15:13.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[89611]: osdmap e1068: 8 total, 8 up, 8 in 2024-09-10T18:15:13.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1610959041' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:13.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[92029]: pgmap v1330: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[92029]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:15:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[92029]: osdmap e1068: 8 total, 8 up, 8 in 2024-09-10T18:15:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1610959041' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:13.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:12 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:13.035 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.directory_methods (28 ms) 2024-09-10T18:15:13.036 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.create 2024-09-10T18:15:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:12 smithi089 ceph-mon[84132]: pgmap v1330: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:12 smithi089 ceph-mon[84132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T18:15:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:12 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:15:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:12 smithi089 ceph-mon[84132]: osdmap e1068: 8 total, 8 up, 8 in 2024-09-10T18:15:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:12 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1610959041' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:13.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:12 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:13.048 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.create (13 ms) 2024-09-10T18:15:13.048 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_features 2024-09-10T18:15:13.049 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_features (1 ms) 2024-09-10T18:15:13.049 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_object_prefix 2024-09-10T18:15:13.050 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_object_prefix (2 ms) 2024-09-10T18:15:13.051 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_create_timestamp 2024-09-10T18:15:13.052 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_create_timestamp (2 ms) 2024-09-10T18:15:13.053 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_access_timestamp 2024-09-10T18:15:13.054 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_access_timestamp (1 ms) 2024-09-10T18:15:13.054 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_modify_timestamp 2024-09-10T18:15:13.055 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_modify_timestamp (2 ms) 2024-09-10T18:15:13.055 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_data_pool 2024-09-10T18:15:13.059 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_data_pool (3 ms) 2024-09-10T18:15:13.059 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.get_size 2024-09-10T18:15:13.063 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.get_size (4 ms) 2024-09-10T18:15:13.063 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.set_size 2024-09-10T18:15:13.067 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.set_size (5 ms) 2024-09-10T18:15:13.067 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.protection_status 2024-09-10T18:15:13.084 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.protection_status (16 ms) 2024-09-10T18:15:13.085 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.snapshot_limits 2024-09-10T18:15:13.091 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.snapshot_limits (8 ms) 2024-09-10T18:15:13.091 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.parents_v1 2024-09-10T18:15:13.132 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.parents_v1 (40 ms) 2024-09-10T18:15:13.132 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.parents_v2 2024-09-10T18:15:13.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.parents_v2 (31 ms) 2024-09-10T18:15:13.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.snapshots 2024-09-10T18:15:13.184 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.snapshots (21 ms) 2024-09-10T18:15:13.184 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.snapid_race 2024-09-10T18:15:13.191 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.snapid_race (7 ms) 2024-09-10T18:15:13.191 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.stripingv2 2024-09-10T18:15:13.201 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.stripingv2 (11 ms) 2024-09-10T18:15:13.201 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.object_map_save 2024-09-10T18:15:13.205 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.object_map_save (3 ms) 2024-09-10T18:15:13.205 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.object_map_resize 2024-09-10T18:15:13.213 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.object_map_resize (9 ms) 2024-09-10T18:15:13.214 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.object_map_update 2024-09-10T18:15:13.224 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.object_map_update (11 ms) 2024-09-10T18:15:13.225 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.object_map_load_enoent 2024-09-10T18:15:13.225 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.object_map_load_enoent (0 ms) 2024-09-10T18:15:13.225 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.object_map_snap_add 2024-09-10T18:15:13.236 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.object_map_snap_add (11 ms) 2024-09-10T18:15:13.236 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.object_map_snap_remove 2024-09-10T18:15:13.245 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.object_map_snap_remove (9 ms) 2024-09-10T18:15:13.245 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.flags 2024-09-10T18:15:13.249 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.flags (4 ms) 2024-09-10T18:15:13.249 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.metadata 2024-09-10T18:15:13.275 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.metadata (26 ms) 2024-09-10T18:15:13.275 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.set_features 2024-09-10T18:15:13.281 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.set_features (6 ms) 2024-09-10T18:15:13.281 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.mirror 2024-09-10T18:15:13.315 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.mirror (34 ms) 2024-09-10T18:15:13.315 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.mirror_image 2024-09-10T18:15:13.329 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.mirror_image (14 ms) 2024-09-10T18:15:13.329 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.mirror_image_status 2024-09-10T18:15:14.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:13 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:14.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:13 smithi012 ceph-mon[89611]: osdmap e1069: 8 total, 8 up, 8 in 2024-09-10T18:15:14.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:13 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:14.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:13 smithi012 ceph-mon[92029]: osdmap e1069: 8 total, 8 up, 8 in 2024-09-10T18:15:14.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:13 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi012-132857-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:14.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:13 smithi089 ceph-mon[84132]: osdmap e1069: 8 total, 8 up, 8 in 2024-09-10T18:15:14.771 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:14 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:15:14] "GET /metrics HTTP/1.1" 200 36445 "" "Prometheus/2.51.0" 2024-09-10T18:15:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:14 smithi012 ceph-mon[89611]: pgmap v1333: 137 pgs: 5 creating+peering, 20 unknown, 112 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:15.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:14 smithi012 ceph-mon[89611]: osdmap e1070: 8 total, 8 up, 8 in 2024-09-10T18:15:15.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:14 smithi012 ceph-mon[92029]: pgmap v1333: 137 pgs: 5 creating+peering, 20 unknown, 112 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:15.034 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:14 smithi012 ceph-mon[92029]: osdmap e1070: 8 total, 8 up, 8 in 2024-09-10T18:15:15.035 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:14 smithi089 ceph-mon[84132]: pgmap v1333: 137 pgs: 5 creating+peering, 20 unknown, 112 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:15.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:14 smithi089 ceph-mon[84132]: osdmap e1070: 8 total, 8 up, 8 in 2024-09-10T18:15:15.660 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.mirror_image_status (2331 ms) 2024-09-10T18:15:15.661 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.mirror_image_map 2024-09-10T18:15:15.741 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.mirror_image_map (81 ms) 2024-09-10T18:15:15.741 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.mirror_instances 2024-09-10T18:15:15.748 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.mirror_instances (7 ms) 2024-09-10T18:15:15.748 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.mirror_snapshot 2024-09-10T18:15:15.759 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.mirror_snapshot (11 ms) 2024-09-10T18:15:15.759 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_dir_list 2024-09-10T18:15:15.761 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_dir_list (3 ms) 2024-09-10T18:15:15.761 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_dir_add 2024-09-10T18:15:15.764 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_dir_add (2 ms) 2024-09-10T18:15:15.764 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.dir_add_already_existing 2024-09-10T18:15:15.767 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.dir_add_already_existing (3 ms) 2024-09-10T18:15:15.767 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_dir_rename 2024-09-10T18:15:15.773 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_dir_rename (7 ms) 2024-09-10T18:15:15.774 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_dir_remove 2024-09-10T18:15:15.776 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_dir_remove (3 ms) 2024-09-10T18:15:15.777 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_dir_remove_missing 2024-09-10T18:15:15.780 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_dir_remove_missing (4 ms) 2024-09-10T18:15:15.780 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_image_add 2024-09-10T18:15:15.782 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_image_add (2 ms) 2024-09-10T18:15:15.782 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_image_remove 2024-09-10T18:15:15.786 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_image_remove (3 ms) 2024-09-10T18:15:15.786 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_image_list 2024-09-10T18:15:15.789 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_image_list (3 ms) 2024-09-10T18:15:15.789 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_image_clean 2024-09-10T18:15:15.793 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_image_clean (4 ms) 2024-09-10T18:15:15.793 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.image_group_add 2024-09-10T18:15:15.795 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.image_group_add (2 ms) 2024-09-10T18:15:15.795 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.image_group_remove 2024-09-10T18:15:15.798 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.image_group_remove (3 ms) 2024-09-10T18:15:15.798 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.image_group_get 2024-09-10T18:15:15.801 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.image_group_get (3 ms) 2024-09-10T18:15:15.801 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_set_empty_name 2024-09-10T18:15:15.802 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_snap_set_empty_name (2 ms) 2024-09-10T18:15:15.802 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_set_empty_id 2024-09-10T18:15:15.805 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_snap_set_empty_id (2 ms) 2024-09-10T18:15:15.805 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_set_duplicate_id 2024-09-10T18:15:15.807 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_snap_set_duplicate_id (3 ms) 2024-09-10T18:15:15.807 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_set_duplicate_name 2024-09-10T18:15:15.810 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_snap_set_duplicate_name (2 ms) 2024-09-10T18:15:15.810 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_set 2024-09-10T18:15:15.812 INFO:tasks.workunit.client.0.smithi012.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.4-837-g7a853b17/rpm/el9/BUILD/ceph-18.2.4-837-g7a853b17/src/test/cls_rbd/test_cls_rbd.cc:2681: Failure 2024-09-10T18:15:15.813 INFO:tasks.workunit.client.0.smithi012.stdout:Expected equality of these values: 2024-09-10T18:15:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: 1U 2024-09-10T18:15:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: Which is: 1 2024-09-10T18:15:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: keys.size() 2024-09-10T18:15:15.813 INFO:tasks.workunit.client.0.smithi012.stdout: Which is: 3 2024-09-10T18:15:15.813 INFO:tasks.workunit.client.0.smithi012.stdout:[ FAILED ] TestClsRbd.group_snap_set (2 ms) 2024-09-10T18:15:15.813 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_list 2024-09-10T18:15:15.816 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_snap_list (3 ms) 2024-09-10T18:15:15.816 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_list_max_return 2024-09-10T18:15:15.833 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_snap_list_max_return (17 ms) 2024-09-10T18:15:15.833 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_list_max_read 2024-09-10T18:15:16.038 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_snap_list_max_read (205 ms) 2024-09-10T18:15:16.038 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_remove 2024-09-10T18:15:16.040 INFO:tasks.workunit.client.0.smithi012.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.4-837-g7a853b17/rpm/el9/BUILD/ceph-18.2.4-837-g7a853b17/src/test/cls_rbd/test_cls_rbd.cc:2792: Failure 2024-09-10T18:15:16.041 INFO:tasks.workunit.client.0.smithi012.stdout:Expected equality of these values: 2024-09-10T18:15:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: 1U 2024-09-10T18:15:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: Which is: 1 2024-09-10T18:15:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: keys.size() 2024-09-10T18:15:16.041 INFO:tasks.workunit.client.0.smithi012.stdout: Which is: 3 2024-09-10T18:15:16.041 INFO:tasks.workunit.client.0.smithi012.stdout:[ FAILED ] TestClsRbd.group_snap_remove (3 ms) 2024-09-10T18:15:16.041 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.group_snap_get_by_id 2024-09-10T18:15:16.043 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.group_snap_get_by_id (2 ms) 2024-09-10T18:15:16.043 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.trash_methods 2024-09-10T18:15:16.049 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.trash_methods (7 ms) 2024-09-10T18:15:16.049 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.op_features 2024-09-10T18:15:16.056 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.op_features (7 ms) 2024-09-10T18:15:16.056 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.clone_parent 2024-09-10T18:15:16.075 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.clone_parent (18 ms) 2024-09-10T18:15:16.075 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.clone_parent_ns 2024-09-10T18:15:16.083 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.clone_parent_ns (8 ms) 2024-09-10T18:15:16.083 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.clone_child 2024-09-10T18:15:16.095 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.clone_child (12 ms) 2024-09-10T18:15:16.095 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.namespace_methods 2024-09-10T18:15:16.102 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.namespace_methods (7 ms) 2024-09-10T18:15:16.102 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.migration 2024-09-10T18:15:16.111 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.migration (10 ms) 2024-09-10T18:15:16.112 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.migration_v1 2024-09-10T18:15:16.125 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.migration_v1 (13 ms) 2024-09-10T18:15:16.125 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.assert_snapc_seq 2024-09-10T18:15:17.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:16 smithi012 ceph-mon[89611]: pgmap v1335: 137 pgs: 5 creating+peering, 8 unknown, 124 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 59 KiB/s rd, 19 KiB/s wr, 67 op/s 2024-09-10T18:15:17.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:16 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:16 smithi012 ceph-mon[92029]: pgmap v1335: 137 pgs: 5 creating+peering, 8 unknown, 124 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 59 KiB/s rd, 19 KiB/s wr, 67 op/s 2024-09-10T18:15:17.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:16 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:16 smithi089 ceph-mon[84132]: pgmap v1335: 137 pgs: 5 creating+peering, 8 unknown, 124 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 59 KiB/s rd, 19 KiB/s wr, 67 op/s 2024-09-10T18:15:17.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:16 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:17.794 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.assert_snapc_seq (1669 ms) 2024-09-10T18:15:17.794 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestClsRbd.sparsify 2024-09-10T18:15:17.831 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestClsRbd.sparsify (37 ms) 2024-09-10T18:15:18.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:17 smithi012 ceph-mon[89611]: osdmap e1071: 8 total, 8 up, 8 in 2024-09-10T18:15:18.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:17 smithi012 ceph-mon[92029]: osdmap e1071: 8 total, 8 up, 8 in 2024-09-10T18:15:18.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:17 smithi089 ceph-mon[84132]: osdmap e1071: 8 total, 8 up, 8 in 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 70 tests from TestClsRbd (5055 ms total) 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 70 tests from 1 test suite ran. (7882 ms total) 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 68 tests. 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout:[ FAILED ] 2 tests, listed below: 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout:[ FAILED ] TestClsRbd.group_snap_set 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout:[ FAILED ] TestClsRbd.group_snap_remove 2024-09-10T18:15:18.801 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-10T18:15:18.802 INFO:tasks.workunit.client.0.smithi012.stdout: 2 FAILED TESTS 2024-09-10T18:15:18.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T18:15:18.804 INFO:tasks.workunit:Stopping ['cls'] on client.0... 2024-09-10T18:15:18.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T18:15:19.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:18 smithi012 ceph-mon[89611]: pgmap v1337: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.5 MiB/s wr, 2.51k op/s 2024-09-10T18:15:19.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:18 smithi012 ceph-mon[89611]: osdmap e1072: 8 total, 8 up, 8 in 2024-09-10T18:15:19.086 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:18 smithi012 ceph-mon[92029]: pgmap v1337: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.5 MiB/s wr, 2.51k op/s 2024-09-10T18:15:19.086 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:18 smithi012 ceph-mon[92029]: osdmap e1072: 8 total, 8 up, 8 in 2024-09-10T18:15:19.087 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/parallel.py", line 48, in task with parallel.parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/full_sequential.py", line 30, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 126, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test cls/test_cls_rbd.sh) on smithi012 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' 2024-09-10T18:15:19.341 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0a45b25607024687b26bb7277043b202 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/parallel.py", line 48, in task with parallel.parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/full_sequential.py", line 30, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 126, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test cls/test_cls_rbd.sh) on smithi012 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' 2024-09-10T18:15:19.344 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T18:15:19.354 INFO:tasks.cephadm:Teardown begin 2024-09-10T18:15:19.354 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T18:15:19.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T18:15:19.360 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:18 smithi089 ceph-mon[84132]: pgmap v1337: 137 pgs: 137 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.5 MiB/s wr, 2.51k op/s 2024-09-10T18:15:19.360 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:18 smithi089 ceph-mon[84132]: osdmap e1072: 8 total, 8 up, 8 in 2024-09-10T18:15:19.563 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:15:19.978 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:19 smithi012 ceph-mon[89611]: osdmap e1073: 8 total, 8 up, 8 in 2024-09-10T18:15:19.979 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:19 smithi012 ceph-mon[92029]: osdmap e1073: 8 total, 8 up, 8 in 2024-09-10T18:15:20.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:19 smithi089 ceph-mon[84132]: osdmap e1073: 8 total, 8 up, 8 in 2024-09-10T18:15:21.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:20 smithi012 ceph-mon[89611]: pgmap v1340: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:21.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:20 smithi012 ceph-mon[92029]: pgmap v1340: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:21.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:20 smithi089 ceph-mon[84132]: pgmap v1340: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:21.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T18:15:21.682 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"btime":"2024-09-10T18:04:49:021193+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54364,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3045602254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3045602254},{"type":"v1","addr":"172.21.15.89:6833","nonce":3045602254}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T17:52:41.361507+0000","modified":"2024-09-10T18:04:43.980760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":548,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":44444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_44444":{"gid":44444,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.12:6835/198565730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":198565730},{"type":"v1","addr":"172.21.15.12:6835","nonce":198565730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":44444,"qdb_cluster":[44444]},"id":1}]} 2024-09-10T18:15:21.683 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 15 2024-09-10T18:15:21.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:21 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2892318119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T18:15:21.980 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:21 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2892318119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T18:15:22.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:21 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2892318119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T18:15:22.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T18:15:22.557 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:15:22.997 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:22 smithi012 ceph-mon[89611]: pgmap v1341: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:22.998 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:22 smithi012 ceph-mon[92029]: pgmap v1341: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:23.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:22 smithi089 ceph-mon[84132]: pgmap v1341: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:24.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T18:15:24.773 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"btime":"2024-09-10T18:04:49:021193+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54364,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3045602254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3045602254},{"type":"v1","addr":"172.21.15.89:6833","nonce":3045602254}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T17:52:41.361507+0000","modified":"2024-09-10T18:04:43.980760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":548,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":44444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_44444":{"gid":44444,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.12:6835/198565730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":198565730},{"type":"v1","addr":"172.21.15.12:6835","nonce":198565730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":44444,"qdb_cluster":[44444]},"id":1}]} 2024-09-10T18:15:24.774 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 15 2024-09-10T18:15:24.774 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:24 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:15:24] "GET /metrics HTTP/1.1" 200 36482 "" "Prometheus/2.51.0" 2024-09-10T18:15:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:24 smithi012 ceph-mon[89611]: pgmap v1342: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:25.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:24 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/448832026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T18:15:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:24 smithi012 ceph-mon[92029]: pgmap v1342: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:25.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:24 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/448832026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T18:15:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:24 smithi089 ceph-mon[84132]: pgmap v1342: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:25.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:24 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/448832026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T18:15:25.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T18:15:25.654 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:15:27.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:26 smithi012 ceph-mon[89611]: pgmap v1343: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:27.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:26 smithi012 ceph-mon[92029]: pgmap v1343: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:27.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:26 smithi089 ceph-mon[84132]: pgmap v1343: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:27.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T18:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1073,"fsid":"9996668a-6f9c-11ef-bcea-c7b262605968","created":"2024-09-10T17:47:05.901686+0000","modified":"2024-09-10T18:15:18.786527+0000","last_up_change":"2024-09-10T18:04:20.839976+0000","last_in_change":"2024-09-10T17:51:52.098948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":60,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T17:50:13.537676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T17:52:35.123712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T17:52:38.563420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-09-10T17:53:44.896711+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":74,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6fd5e4af-3933-4e54-b5ae-0f55ac6e4c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":286,"up_from":300,"up_thru":1068,"down_at":287,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1262065593},{"type":"v1","addr":"172.21.15.12:6803","nonce":1262065593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1262065593},{"type":"v1","addr":"172.21.15.12:6805","nonce":1262065593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1262065593},{"type":"v1","addr":"172.21.15.12:6809","nonce":1262065593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1262065593},{"type":"v1","addr":"172.21.15.12:6807","nonce":1262065593}]},"public_addr":"172.21.15.12:6803/1262065593","cluster_addr":"172.21.15.12:6805/1262065593","heartbeat_back_addr":"172.21.15.12:6809/1262065593","heartbeat_front_addr":"172.21.15.12:6807/1262065593","state":["exists","up"]},{"osd":1,"uuid":"e85fa0bf-c39b-42af-9dc1-fdfa89bff20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":319,"up_from":332,"up_thru":1068,"down_at":320,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1400604299},{"type":"v1","addr":"172.21.15.12:6811","nonce":1400604299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1400604299},{"type":"v1","addr":"172.21.15.12:6813","nonce":1400604299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":1400604299},{"type":"v1","addr":"172.21.15.12:6817","nonce":1400604299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1400604299},{"type":"v1","addr":"172.21.15.12:6815","nonce":1400604299}]},"public_addr":"172.21.15.12:6811/1400604299","cluster_addr":"172.21.15.12:6813/1400604299","heartbeat_back_addr":"172.21.15.12:6817/1400604299","heartbeat_front_addr":"172.21.15.12:6815/1400604299","state":["exists","up"]},{"osd":2,"uuid":"0123bb74-5ee1-4cae-a398-a3d0f1baa7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":353,"up_from":367,"up_thru":1068,"down_at":354,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1808679130},{"type":"v1","addr":"172.21.15.12:6819","nonce":1808679130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1808679130},{"type":"v1","addr":"172.21.15.12:6821","nonce":1808679130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1808679130},{"type":"v1","addr":"172.21.15.12:6825","nonce":1808679130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1808679130},{"type":"v1","addr":"172.21.15.12:6823","nonce":1808679130}]},"public_addr":"172.21.15.12:6819/1808679130","cluster_addr":"172.21.15.12:6821/1808679130","heartbeat_back_addr":"172.21.15.12:6825/1808679130","heartbeat_front_addr":"172.21.15.12:6823/1808679130","state":["exists","up"]},{"osd":3,"uuid":"4a90d703-23ef-4088-a152-f27bce4c3270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":387,"up_from":400,"up_thru":1068,"down_at":388,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":74911827},{"type":"v1","addr":"172.21.15.12:6827","nonce":74911827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":74911827},{"type":"v1","addr":"172.21.15.12:6829","nonce":74911827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":74911827},{"type":"v1","addr":"172.21.15.12:6833","nonce":74911827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":74911827},{"type":"v1","addr":"172.21.15.12:6831","nonce":74911827}]},"public_addr":"172.21.15.12:6827/74911827","cluster_addr":"172.21.15.12:6829/74911827","heartbeat_back_addr":"172.21.15.12:6833/74911827","heartbeat_front_addr":"172.21.15.12:6831/74911827","state":["exists","up"]},{"osd":4,"uuid":"16019dce-e8f5-47eb-9d6c-e123ad974201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":420,"up_from":434,"up_thru":1068,"down_at":421,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2682567246},{"type":"v1","addr":"172.21.15.89:6801","nonce":2682567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2682567246},{"type":"v1","addr":"172.21.15.89:6803","nonce":2682567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2682567246},{"type":"v1","addr":"172.21.15.89:6807","nonce":2682567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2682567246},{"type":"v1","addr":"172.21.15.89:6805","nonce":2682567246}]},"public_addr":"172.21.15.89:6801/2682567246","cluster_addr":"172.21.15.89:6803/2682567246","heartbeat_back_addr":"172.21.15.89:6807/2682567246","heartbeat_front_addr":"172.21.15.89:6805/2682567246","state":["exists","up"]},{"osd":5,"uuid":"11b4a447-9dd0-4be0-a85e-8fb1b7fc3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":452,"up_from":466,"up_thru":1068,"down_at":453,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2898627055},{"type":"v1","addr":"172.21.15.89:6809","nonce":2898627055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2898627055},{"type":"v1","addr":"172.21.15.89:6811","nonce":2898627055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2898627055},{"type":"v1","addr":"172.21.15.89:6815","nonce":2898627055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2898627055},{"type":"v1","addr":"172.21.15.89:6813","nonce":2898627055}]},"public_addr":"172.21.15.89:6809/2898627055","cluster_addr":"172.21.15.89:6811/2898627055","heartbeat_back_addr":"172.21.15.89:6815/2898627055","heartbeat_front_addr":"172.21.15.89:6813/2898627055","state":["exists","up"]},{"osd":6,"uuid":"2cc71b00-da13-40b4-91b2-43218ec8cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":46,"last_clean_end":486,"up_from":498,"up_thru":1068,"down_at":487,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":730345999},{"type":"v1","addr":"172.21.15.89:6817","nonce":730345999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":730345999},{"type":"v1","addr":"172.21.15.89:6819","nonce":730345999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":730345999},{"type":"v1","addr":"172.21.15.89:6823","nonce":730345999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":730345999},{"type":"v1","addr":"172.21.15.89:6821","nonce":730345999}]},"public_addr":"172.21.15.89:6817/730345999","cluster_addr":"172.21.15.89:6819/730345999","heartbeat_back_addr":"172.21.15.89:6823/730345999","heartbeat_front_addr":"172.21.15.89:6821/730345999","state":["exists","up"]},{"osd":7,"uuid":"ad1f0c7c-dff5-45a3-baec-17c43d221ef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":54,"last_clean_end":516,"up_from":529,"up_thru":1068,"down_at":517,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":476453873},{"type":"v1","addr":"172.21.15.89:6825","nonce":476453873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":476453873},{"type":"v1","addr":"172.21.15.89:6827","nonce":476453873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":476453873},{"type":"v1","addr":"172.21.15.89:6831","nonce":476453873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":476453873},{"type":"v1","addr":"172.21.15.89:6829","nonce":476453873}]},"public_addr":"172.21.15.89:6825/476453873","cluster_addr":"172.21.15.89:6827/476453873","heartbeat_back_addr":"172.21.15.89:6831/476453873","heartbeat_front_addr":"172.21.15.89:6829/476453873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:23.135660+0000","dead_epoch":286},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:49:46.922095+0000","dead_epoch":319},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:11.221520+0000","dead_epoch":353},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:35.676484+0000","dead_epoch":387},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:50:56.707812+0000","dead_epoch":420},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:19.804194+0000","dead_epoch":452},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:51:43.395932+0000","dead_epoch":486},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T17:52:07.127469+0000","dead_epoch":516}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6833/3197689939":"2024-09-11T18:04:40.962564+0000","172.21.15.89:0/1887654905":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/3454597613":"2024-09-11T17:57:47.934302+0000","172.21.15.12:6800/2938079971":"2024-09-11T17:57:47.934302+0000","172.21.15.12:0/1190692835":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/544822738":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/270930125":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/2072251878":"2024-09-11T17:57:47.934302+0000","172.21.15.12:0/2776327378":"2024-09-11T17:57:47.934302+0000","172.21.15.12:6801/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/2177785153":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6800/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:0/1590054246":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/1927024573":"2024-09-11T17:57:47.934302+0000","172.21.15.12:6800/4163567702":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/89737520":"2024-09-11T17:59:00.959618+0000","172.21.15.89:0/1794147058":"2024-09-11T17:58:18.794440+0000","172.21.15.89:0/761725011":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/3820157522":"2024-09-11T17:47:39.748894+0000","172.21.15.12:6801/2938079971":"2024-09-11T17:57:47.934302+0000","172.21.15.89:0/2591871814":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/4039283761":"2024-09-11T17:57:47.934302+0000","172.21.15.12:0/3394020603":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/1331323785":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/3134439470":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/4040448008":"2024-09-11T17:53:42.652060+0000","172.21.15.89:6834/3612163982":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/2654768069":"2024-09-11T17:59:00.959618+0000","172.21.15.89:6835/3612163982":"2024-09-11T17:58:18.794440+0000","172.21.15.12:6801/2609035009":"2024-09-11T17:47:39.748894+0000","172.21.15.12:6800/4225839466":"2024-09-11T17:59:00.959618+0000","172.21.15.12:6801/4225839466":"2024-09-11T17:59:00.959618+0000","172.21.15.12:0/197068640":"2024-09-11T17:47:39.748894+0000","172.21.15.89:6832/3197689939":"2024-09-11T18:04:40.962564+0000","172.21.15.12:0/1340731415":"2024-09-11T17:48:03.035940+0000","172.21.15.12:0/135454569":"2024-09-11T17:53:42.652060+0000","172.21.15.89:0/1147431406":"2024-09-11T17:58:18.794440+0000","172.21.15.89:0/2540225892":"2024-09-11T17:58:18.794440+0000","172.21.15.12:0/857176933":"2024-09-11T17:48:03.035940+0000","172.21.15.89:0/2793592953":"2024-09-11T17:58:18.794440+0000","172.21.15.12:6801/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:6800/3973258955":"2024-09-11T17:53:42.652060+0000","172.21.15.12:0/3881499084":"2024-09-11T17:53:42.652060+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":462,"length":1},{"begin":466,"length":1}]},{"pool":60,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T18:15:28.165 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:27 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2683517778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T18:15:28.166 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:27 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2683517778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T18:15:28.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T18:15:28.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:27 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2683517778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T18:15:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:15:29.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:28 smithi012 ceph-mon[89611]: pgmap v1344: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:29.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:28 smithi012 ceph-mon[92029]: pgmap v1344: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:29.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:28 smithi089 ceph-mon[84132]: pgmap v1344: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T18:15:30.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a[89607]: 2024-09-10T18:15:30.250+0000 7ffb60229640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T18:15:30.535 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[117263]: -5299> 2024-09-10T18:04:45.917+0000 7fc58c3d1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T18:15:30.535 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[117263]: ignoring --setuser ceph since I am not root 2024-09-10T18:15:30.535 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[117263]: ignoring --setgroup ceph since I am not root 2024-09-10T18:15:30.535 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[117263]: starting mds.a at 2024-09-10T18:15:31.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: pgmap v1345: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:31.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1517166456' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T18:15:31.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T18:15:31.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T18:15:31.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T18:15:31.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T18:15:31.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: osdmap e1074: 8 total, 8 up, 8 in 2024-09-10T18:15:31.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-09-10T18:15:31.032 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:15:31.032 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: pgmap v1345: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:31.032 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1517166456' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T18:15:31.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T18:15:31.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T18:15:31.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T18:15:31.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T18:15:31.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: osdmap e1074: 8 total, 8 up, 8 in 2024-09-10T18:15:31.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-09-10T18:15:31.033 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:30 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:15:31.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T18:15:31.274 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:15:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: pgmap v1345: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1517166456' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T18:15:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T18:15:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T18:15:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T18:15:31.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T18:15:31.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: osdmap e1074: 8 total, 8 up, 8 in 2024-09-10T18:15:31.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-09-10T18:15:31.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:30 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T18:15:32.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:15:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:15:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:15:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[89611]: mds.? [v2:172.21.15.12:6834/1390722209,v1:172.21.15.12:6835/1390722209] up:boot 2024-09-10T18:15:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[89611]: fsmap cephfs:0/1 2 up:standby, 1 failed 2024-09-10T18:15:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T18:15:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:15:32.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[89611]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:15:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:15:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:15:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[92029]: mds.? [v2:172.21.15.12:6834/1390722209,v1:172.21.15.12:6835/1390722209] up:boot 2024-09-10T18:15:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[92029]: fsmap cephfs:0/1 2 up:standby, 1 failed 2024-09-10T18:15:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T18:15:32.036 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:15:32.037 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:31 smithi012 ceph-mon[92029]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T18:15:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T18:15:32.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:15:32.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:31 smithi089 ceph-mon[84132]: mds.? [v2:172.21.15.12:6834/1390722209,v1:172.21.15.12:6835/1390722209] up:boot 2024-09-10T18:15:32.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:31 smithi089 ceph-mon[84132]: fsmap cephfs:0/1 2 up:standby, 1 failed 2024-09-10T18:15:32.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T18:15:32.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' 2024-09-10T18:15:32.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:31 smithi089 ceph-mon[84132]: from='mgr.25039 172.21.15.12:0/3680715083' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-10T18:15:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:32 smithi012 ceph-mon[89611]: pgmap v1347: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:33.035 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:32 smithi012 ceph-mon[92029]: pgmap v1347: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:33.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:32 smithi089 ceph-mon[84132]: pgmap v1347: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:34.163 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:33 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/283101844' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:34.163 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:33 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:34.164 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:33 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/283101844' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:34.164 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:33 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:34.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:33 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/283101844' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:34.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:33 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T18:15:34.454 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:15:34] "GET /metrics HTTP/1.1" 200 34210 "" "Prometheus/2.51.0" 2024-09-10T18:15:34.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T18:15:34.692 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:15:35.141 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[89611]: pgmap v1348: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:35.142 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[89611]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T18:15:35.142 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[89611]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T18:15:35.142 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[89611]: Cluster is now healthy 2024-09-10T18:15:35.142 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:35.142 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[89611]: fsmap 2 up:standby 2024-09-10T18:15:35.142 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[92029]: pgmap v1348: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:35.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[92029]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T18:15:35.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[92029]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T18:15:35.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[92029]: Cluster is now healthy 2024-09-10T18:15:35.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:35.143 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:34 smithi012 ceph-mon[92029]: fsmap 2 up:standby 2024-09-10T18:15:35.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:34 smithi089 ceph-mon[84132]: pgmap v1348: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:35.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:34 smithi089 ceph-mon[84132]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T18:15:35.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:34 smithi089 ceph-mon[84132]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T18:15:35.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:34 smithi089 ceph-mon[84132]: Cluster is now healthy 2024-09-10T18:15:35.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:34 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T18:15:35.287 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:34 smithi089 ceph-mon[84132]: fsmap 2 up:standby 2024-09-10T18:15:36.855 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-10T18:15:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:36 smithi012 ceph-mon[89611]: pgmap v1349: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:37.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:36 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/2770341214' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:37.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:36 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:36 smithi012 ceph-mon[92029]: pgmap v1349: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:36 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/2770341214' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:37.285 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:36 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:37.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:36 smithi089 ceph-mon[84132]: pgmap v1349: 105 pgs: 105 active+clean; 583 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:37.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:36 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/2770341214' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:37.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:36 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:37.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T18:15:37.848 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T18:15:38.214 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:37 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:15:38.214 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:37 smithi012 ceph-mon[89611]: osdmap e1075: 8 total, 8 up, 8 in 2024-09-10T18:15:38.215 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:37 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:15:38.215 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:37 smithi012 ceph-mon[92029]: osdmap e1075: 8 total, 8 up, 8 in 2024-09-10T18:15:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:37 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:15:38.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:37 smithi089 ceph-mon[84132]: osdmap e1075: 8 total, 8 up, 8 in 2024-09-10T18:15:38.985 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:38 smithi012 ceph-mon[89611]: pgmap v1351: 73 pgs: 73 active+clean; 577 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:38.986 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:38 smithi012 ceph-mon[92029]: pgmap v1351: 73 pgs: 73 active+clean; 577 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:39.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:38 smithi089 ceph-mon[84132]: pgmap v1351: 73 pgs: 73 active+clean; 577 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-10T18:15:41.260 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:40 smithi012 ceph-mon[89611]: pgmap v1352: 73 pgs: 73 active+clean; 577 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:41.261 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:40 smithi012 ceph-mon[89611]: from='client.? 172.21.15.12:0/1652902717' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:41.261 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:40 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:41.261 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:40 smithi012 ceph-mon[92029]: pgmap v1352: 73 pgs: 73 active+clean; 577 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:41.262 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:40 smithi012 ceph-mon[92029]: from='client.? 172.21.15.12:0/1652902717' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:41.262 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:40 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:40 smithi089 ceph-mon[84132]: pgmap v1352: 73 pgs: 73 active+clean; 577 KiB data, 4.8 GiB used, 710 GiB / 715 GiB avail 2024-09-10T18:15:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:40 smithi089 ceph-mon[84132]: from='client.? 172.21.15.12:0/1652902717' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:41.286 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:40 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T18:15:41.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T18:15:41.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T18:15:41.663 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T18:15:41.663 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T18:15:41.687 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T18:15:41.722 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T18:15:41.723 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T18:15:41.723 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a 2024-09-10T18:15:41.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:41 smithi012 systemd[1]: Stopping Ceph mon.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:15:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:41 smithi089 ceph-mon[84132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:15:42.036 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:41 smithi089 ceph-mon[84132]: osdmap e1076: 8 total, 8 up, 8 in 2024-09-10T18:15:42.248 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:42] ENGINE Bus STOPPING 2024-09-10T18:15:42.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:41 smithi012 ceph-mon[89611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:15:42.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:41 smithi012 ceph-mon[89611]: osdmap e1076: 8 total, 8 up, 8 in 2024-09-10T18:15:42.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a[89607]: 2024-09-10T18:15:42.062+0000 7ffb65a34640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:15:42.249 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a[89607]: 2024-09-10T18:15:42.062+0000 7ffb65a34640 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-09-10T18:15:42.249 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:41 smithi012 ceph-mon[92029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T18:15:42.249 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:41 smithi012 ceph-mon[92029]: osdmap e1076: 8 total, 8 up, 8 in 2024-09-10T18:15:42.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:42 smithi012 podman[134224]: 2024-09-10 18:15:42.246773694 +0000 UTC m=+0.307334843 container died 1cb889155ac02839b59e81fa0f684ac75d1e3ec37581a33964539f206a4b909b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T18:15:42.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:42] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T18:15:42.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:42] ENGINE Bus STOPPED 2024-09-10T18:15:42.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:42] ENGINE Bus STARTING 2024-09-10T18:15:42.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:42] ENGINE Serving on http://:::9283 2024-09-10T18:15:42.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:42 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:42] ENGINE Bus STARTED 2024-09-10T18:15:42.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:42 smithi012 podman[134224]: 2024-09-10 18:15:42.646015579 +0000 UTC m=+0.706576738 container cleanup 1cb889155ac02839b59e81fa0f684ac75d1e3ec37581a33964539f206a4b909b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T18:15:42.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 10 18:15:42 smithi012 bash[134224]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-a 2024-09-10T18:15:43.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T18:15:43.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:15:43.126 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T18:15:43.126 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-10T18:15:43.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.c 2024-09-10T18:15:43.427 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:43 smithi012 systemd[1]: Stopping Ceph mon.c for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:15:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c[92025]: 2024-09-10T18:15:43.425+0000 7fcc4cbcd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:15:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c[92025]: 2024-09-10T18:15:43.425+0000 7fcc4cbcd640 -1 mon.c@2(peon) e4 *** Got Signal Terminated *** 2024-09-10T18:15:43.785 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:43 smithi012 podman[134359]: 2024-09-10 18:15:43.631050074 +0000 UTC m=+0.320858205 container died 9cece0ad58dabebf6d726086528f3d5146d68b35c16bd211469eed8cb80a46d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:15:43.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:43] ENGINE Bus STOPPING 2024-09-10T18:15:43.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:43] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-10T18:15:43.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:43] ENGINE Bus STOPPED 2024-09-10T18:15:43.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:43] ENGINE Bus STARTING 2024-09-10T18:15:43.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:43] ENGINE Serving on http://:::9283 2024-09-10T18:15:43.786 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:43 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: [10/Sep/2024:18:15:43] ENGINE Bus STARTED 2024-09-10T18:15:44.324 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:44 smithi012 podman[134359]: 2024-09-10 18:15:44.134303785 +0000 UTC m=+0.824111910 container cleanup 9cece0ad58dabebf6d726086528f3d5146d68b35c16bd211469eed8cb80a46d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:15:44.325 INFO:journalctl@ceph.mon.c.smithi012.stdout:Sep 10 18:15:44 smithi012 bash[134359]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-c 2024-09-10T18:15:44.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T18:15:44.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:15:44.547 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-10T18:15:44.547 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-10T18:15:44.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.b 2024-09-10T18:15:44.784 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:44 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: ::ffff:172.21.15.89 - - [10/Sep/2024:18:15:44] "GET /metrics HTTP/1.1" 200 34210 "" "Prometheus/2.51.0" 2024-09-10T18:15:44.890 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:44 smithi089 systemd[1]: Stopping Ceph mon.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:15:45.200 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b[84128]: 2024-09-10T18:15:44.887+0000 7f80b2f86640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:15:45.200 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b[84128]: 2024-09-10T18:15:44.887+0000 7f80b2f86640 -1 mon.b@1(peon) e4 *** Got Signal Terminated *** 2024-09-10T18:15:45.200 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:44 smithi089 podman[125435]: 2024-09-10 18:15:44.908854668 +0000 UTC m=+0.155517902 container died 9c846e5fd93fb49b319b6577e0d7cab16aec988a122b08c4bae45433ff44c63d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T18:15:45.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:45 smithi089 podman[125435]: 2024-09-10 18:15:45.397424186 +0000 UTC m=+0.644087404 container cleanup 9c846e5fd93fb49b319b6577e0d7cab16aec988a122b08c4bae45433ff44c63d (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T18:15:45.536 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 10 18:15:45 smithi089 bash[125435]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mon-b 2024-09-10T18:15:45.878 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T18:15:45.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:15:45.929 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-10T18:15:45.929 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T18:15:45.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y 2024-09-10T18:15:46.257 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:45 smithi012 systemd[1]: Stopping Ceph mgr.y for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:15:46.534 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:46 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:15:46.254+0000 7f7af991d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:15:46.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:46 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y[81351]: 2024-09-10T18:15:46.254+0000 7f7af991d640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-10T18:15:46.535 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:46 smithi012 podman[134490]: 2024-09-10 18:15:46.286797389 +0000 UTC m=+0.161719979 container died 5fc00b3b01dbc7b748bc9c36b8338080e3c7782d229335e8506890b1fcee649c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-10T18:15:46.916 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:46 smithi012 podman[134490]: 2024-09-10 18:15:46.680425405 +0000 UTC m=+0.555348004 container cleanup 5fc00b3b01dbc7b748bc9c36b8338080e3c7782d229335e8506890b1fcee649c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T18:15:46.917 INFO:journalctl@ceph.mgr.y.smithi012.stdout:Sep 10 18:15:46 smithi012 bash[134490]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-y 2024-09-10T18:15:47.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T18:15:47.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:15:47.108 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T18:15:47.108 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T18:15:47.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x 2024-09-10T18:15:47.385 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 18:15:47 smithi089 systemd[1]: Stopping Ceph mgr.x for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:15:47.738 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 18:15:47 smithi089 podman[125561]: 2024-09-10 18:15:47.460959169 +0000 UTC m=+0.161888374 container died 0de40d6da7f2364610b413a2984bb0cc508b81e98bd395c7899b3d17990a421e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T18:15:48.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 18:15:47 smithi089 podman[125561]: 2024-09-10 18:15:47.828113035 +0000 UTC m=+0.529042244 container cleanup 0de40d6da7f2364610b413a2984bb0cc508b81e98bd395c7899b3d17990a421e (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T18:15:48.036 INFO:journalctl@ceph.mgr.x.smithi089.stdout:Sep 10 18:15:47 smithi089 bash[125561]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mgr-x 2024-09-10T18:15:48.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T18:15:48.287 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:15:48.288 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T18:15:48.288 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T18:15:48.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.0 2024-09-10T18:15:48.612 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:48 smithi012 systemd[1]: Stopping Ceph osd.0 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:15:49.034 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[97326]: 2024-09-10T18:15:48.609+0000 7f8556284640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:15:49.035 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[97326]: 2024-09-10T18:15:48.609+0000 7f8556284640 -1 osd.0 1076 *** Got signal Terminated *** 2024-09-10T18:15:49.035 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:48 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0[97326]: 2024-09-10T18:15:48.609+0000 7f8556284640 -1 osd.0 1076 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:15:54.395 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:54 smithi012 podman[134611]: 2024-09-10 18:15:54.092920059 +0000 UTC m=+5.605520700 container died 9e9fabb2b979ae5352d1ce55df6c1ef03cae089bb936c00ed55778105b423d9c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True) 2024-09-10T18:15:54.712 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:54 smithi012 podman[134611]: 2024-09-10 18:15:54.492829252 +0000 UTC m=+6.005429888 container cleanup 9e9fabb2b979ae5352d1ce55df6c1ef03cae089bb936c00ed55778105b423d9c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:15:54.712 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:54 smithi012 bash[134611]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0 2024-09-10T18:15:55.034 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:54 smithi012 podman[134626]: 2024-09-10 18:15:54.711026604 +0000 UTC m=+0.611905100 container remove 9e9fabb2b979ae5352d1ce55df6c1ef03cae089bb936c00ed55778105b423d9c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:15:55.382 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:55 smithi012 podman[134716]: 2024-09-10 18:15:55.026948375 +0000 UTC m=+0.016718716 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:15:55.382 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:55 smithi012 podman[134716]: 2024-09-10 18:15:55.153606236 +0000 UTC m=+0.143376620 container create ff4f4a4c7932c826fd5ff4e4bc1b4530596393148064b2679cf204302717749c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T18:15:55.784 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:55 smithi012 podman[134716]: 2024-09-10 18:15:55.381323562 +0000 UTC m=+0.371093901 container init ff4f4a4c7932c826fd5ff4e4bc1b4530596393148064b2679cf204302717749c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T18:15:55.785 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:55 smithi012 podman[134716]: 2024-09-10 18:15:55.385279188 +0000 UTC m=+0.375049529 container start ff4f4a4c7932c826fd5ff4e4bc1b4530596393148064b2679cf204302717749c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T18:15:55.785 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:55 smithi012 podman[134716]: 2024-09-10 18:15:55.456288004 +0000 UTC m=+0.446058356 container attach ff4f4a4c7932c826fd5ff4e4bc1b4530596393148064b2679cf204302717749c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:15:55.785 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 10 18:15:55 smithi012 podman[134716]: 2024-09-10 18:15:55.579794745 +0000 UTC m=+0.569565086 container died ff4f4a4c7932c826fd5ff4e4bc1b4530596393148064b2679cf204302717749c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T18:15:56.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T18:15:56.228 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:15:56.228 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T18:15:56.229 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T18:15:56.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.1 2024-09-10T18:15:56.460 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:15:56 smithi012 systemd[1]: Stopping Ceph osd.1 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:15:56.784 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:15:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[102098]: 2024-09-10T18:15:56.598+0000 7f6076537640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:15:56.785 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:15:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[102098]: 2024-09-10T18:15:56.598+0000 7f6076537640 -1 osd.1 1076 *** Got signal Terminated *** 2024-09-10T18:15:56.785 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:15:56 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1[102098]: 2024-09-10T18:15:56.598+0000 7f6076537640 -1 osd.1 1076 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:16:02.499 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:02 smithi012 podman[134820]: 2024-09-10 18:16:02.202654203 +0000 UTC m=+5.771567737 container died 320b64c712887c614ba1110f0b10a667231556ad15ea247af8e02901edf064d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2) 2024-09-10T18:16:02.784 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:02 smithi012 podman[134820]: 2024-09-10 18:16:02.687962943 +0000 UTC m=+6.256876471 container cleanup 320b64c712887c614ba1110f0b10a667231556ad15ea247af8e02901edf064d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:16:02.784 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:02 smithi012 bash[134820]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1 2024-09-10T18:16:03.466 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:03 smithi012 podman[134848]: 2024-09-10 18:16:03.056152225 +0000 UTC m=+0.852531591 container remove 320b64c712887c614ba1110f0b10a667231556ad15ea247af8e02901edf064d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:16:03.784 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:03 smithi012 podman[134935]: 2024-09-10 18:16:03.368205635 +0000 UTC m=+0.017172118 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:16:03.785 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:03 smithi012 podman[134935]: 2024-09-10 18:16:03.490431491 +0000 UTC m=+0.139398027 container create 372ae09cf8a1cf7a372b54414274901570e538d7c7a8c43834cfa8288f48475c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T18:16:03.785 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:03 smithi012 podman[134935]: 2024-09-10 18:16:03.701350091 +0000 UTC m=+0.350316587 container init 372ae09cf8a1cf7a372b54414274901570e538d7c7a8c43834cfa8288f48475c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:16:03.785 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:03 smithi012 podman[134935]: 2024-09-10 18:16:03.704786859 +0000 UTC m=+0.353753340 container start 372ae09cf8a1cf7a372b54414274901570e538d7c7a8c43834cfa8288f48475c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T18:16:04.197 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:03 smithi012 podman[134935]: 2024-09-10 18:16:03.784503118 +0000 UTC m=+0.433469599 container attach 372ae09cf8a1cf7a372b54414274901570e538d7c7a8c43834cfa8288f48475c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:16:04.197 INFO:journalctl@ceph.osd.1.smithi012.stdout:Sep 10 18:16:03 smithi012 podman[134935]: 2024-09-10 18:16:03.901895633 +0000 UTC m=+0.550862117 container died 372ae09cf8a1cf7a372b54414274901570e538d7c7a8c43834cfa8288f48475c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:16:04.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T18:16:04.615 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:04.615 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T18:16:04.615 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T18:16:04.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.2 2024-09-10T18:16:04.960 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:04 smithi012 systemd[1]: Stopping Ceph osd.2 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:05.284 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:16:04.957+0000 7f1cbe5b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:16:05.285 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:16:04.957+0000 7f1cbe5b3640 -1 osd.2 1076 *** Got signal Terminated *** 2024-09-10T18:16:05.285 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:04 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2[106986]: 2024-09-10T18:16:04.957+0000 7f1cbe5b3640 -1 osd.2 1076 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:16:10.784 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:10 smithi012 podman[135038]: 2024-09-10 18:16:10.527593154 +0000 UTC m=+5.677471734 container died 0c6517cd615a1aa22e9c15d8d98ad245c8805fc4885339199ac51f5ef7c962ae (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:16:11.169 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:10 smithi012 podman[135038]: 2024-09-10 18:16:10.965621162 +0000 UTC m=+6.115499730 container cleanup 0c6517cd615a1aa22e9c15d8d98ad245c8805fc4885339199ac51f5ef7c962ae (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T18:16:11.169 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:10 smithi012 bash[135038]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2 2024-09-10T18:16:11.534 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:11 smithi012 podman[135055]: 2024-09-10 18:16:11.16712673 +0000 UTC m=+0.640083515 container remove 0c6517cd615a1aa22e9c15d8d98ad245c8805fc4885339199ac51f5ef7c962ae (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:11.905 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:11 smithi012 podman[135146]: 2024-09-10 18:16:11.492653434 +0000 UTC m=+0.016631404 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:16:11.905 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:11 smithi012 podman[135146]: 2024-09-10 18:16:11.60105592 +0000 UTC m=+0.125033880 container create ca18ea03eafb22805554a3cc7433163e63677cb99e204fb4b898513f495c9849 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T18:16:11.905 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:11 smithi012 podman[135146]: 2024-09-10 18:16:11.820616949 +0000 UTC m=+0.344594909 container init ca18ea03eafb22805554a3cc7433163e63677cb99e204fb4b898513f495c9849 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T18:16:11.906 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:11 smithi012 podman[135146]: 2024-09-10 18:16:11.823944514 +0000 UTC m=+0.347922480 container start ca18ea03eafb22805554a3cc7433163e63677cb99e204fb4b898513f495c9849 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T18:16:11.906 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:11 smithi012 podman[135146]: 2024-09-10 18:16:11.903767808 +0000 UTC m=+0.427745779 container attach ca18ea03eafb22805554a3cc7433163e63677cb99e204fb4b898513f495c9849 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:12.284 INFO:journalctl@ceph.osd.2.smithi012.stdout:Sep 10 18:16:12 smithi012 podman[135146]: 2024-09-10 18:16:12.02032193 +0000 UTC m=+0.544299893 container died ca18ea03eafb22805554a3cc7433163e63677cb99e204fb4b898513f495c9849 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD) 2024-09-10T18:16:12.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T18:16:12.712 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:12.712 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T18:16:12.713 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T18:16:12.713 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.3 2024-09-10T18:16:13.034 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:12 smithi012 systemd[1]: Stopping Ceph osd.3 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:13.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:16:13.042+0000 7f869488e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:16:13.535 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:16:13.042+0000 7f869488e640 -1 osd.3 1076 *** Got signal Terminated *** 2024-09-10T18:16:13.535 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:13 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:16:13.042+0000 7f869488e640 -1 osd.3 1076 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:16:14.537 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:16:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=cleanup t=2024-09-10T18:16:14.234124422Z level=info msg="Completed cleanup jobs" duration=16.849978ms 2024-09-10T18:16:14.538 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:16:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=plugins.update.checker t=2024-09-10T18:16:14.35852958Z level=info msg="Update check succeeded" duration=58.055781ms 2024-09-10T18:16:14.538 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:16:14 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=grafana.update.checker t=2024-09-10T18:16:14.374929154Z level=info msg="Update check succeeded" duration=60.83147ms 2024-09-10T18:16:15.536 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:15 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:15.105+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:16.109 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:15 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:15.793+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:16.378 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:16 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:16.107+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:16.378 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:16 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:16.115+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:17.036 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:16 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:16.769+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:17.536 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:17 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:17.121+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:17.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:17 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:17.156+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:18.034 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:17 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3[111840]: 2024-09-10T18:16:17.592+0000 7f8690ea3640 -1 osd.3 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:51.588500+0000 front 2024-09-10T18:15:51.588524+0000 (oldest deadline 2024-09-10T18:16:17.488566+0000) 2024-09-10T18:16:18.036 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:17 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:17.774+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:18.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:18 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:18.163+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:18.537 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:18 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:18.135+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:18.920 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:18 smithi012 podman[135248]: 2024-09-10 18:16:18.632776746 +0000 UTC m=+5.696435358 container died 6e4dd760071cb54faa2529a6a6391b55db79d49ae1fdd90a7e5752365f3a82a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T18:16:19.036 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:18 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:18.739+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:19.270 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:19 smithi012 podman[135248]: 2024-09-10 18:16:19.01805326 +0000 UTC m=+6.081711871 container cleanup 6e4dd760071cb54faa2529a6a6391b55db79d49ae1fdd90a7e5752365f3a82a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T18:16:19.271 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:19 smithi012 bash[135248]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3 2024-09-10T18:16:19.534 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:19 smithi012 podman[135264]: 2024-09-10 18:16:19.269387078 +0000 UTC m=+0.635217611 container remove 6e4dd760071cb54faa2529a6a6391b55db79d49ae1fdd90a7e5752365f3a82a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T18:16:19.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:19 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:19.147+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:19.536 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:19 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:19.096+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:19.890 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:19 smithi012 podman[135352]: 2024-09-10 18:16:19.540501067 +0000 UTC m=+0.016361640 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:16:19.890 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:19 smithi012 podman[135352]: 2024-09-10 18:16:19.653502903 +0000 UTC m=+0.129363459 container create 0f2ff332f39299c4bef3526d3e4baefd8a8dd70d3a010da4391e23e9c83f7995 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T18:16:19.891 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:19 smithi012 podman[135352]: 2024-09-10 18:16:19.889210457 +0000 UTC m=+0.365071023 container init 0f2ff332f39299c4bef3526d3e4baefd8a8dd70d3a010da4391e23e9c83f7995 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:20.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:19 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:19.720+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:48.953271+0000 front 2024-09-10T18:15:48.953121+0000 (oldest deadline 2024-09-10T18:16:18.953386+0000) 2024-09-10T18:16:20.036 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:19 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:19.726+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:20.284 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:19 smithi012 podman[135352]: 2024-09-10 18:16:19.892557026 +0000 UTC m=+0.368417583 container start 0f2ff332f39299c4bef3526d3e4baefd8a8dd70d3a010da4391e23e9c83f7995 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T18:16:20.285 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:19 smithi012 podman[135352]: 2024-09-10 18:16:19.972544978 +0000 UTC m=+0.448405540 container attach 0f2ff332f39299c4bef3526d3e4baefd8a8dd70d3a010da4391e23e9c83f7995 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T18:16:20.285 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 10 18:16:20 smithi012 podman[135352]: 2024-09-10 18:16:20.088697587 +0000 UTC m=+0.564558146 container died 0f2ff332f39299c4bef3526d3e4baefd8a8dd70d3a010da4391e23e9c83f7995 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T18:16:20.536 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:20 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:20.099+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:20.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:20 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:20.130+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:20.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T18:16:20.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:20.696 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T18:16:20.696 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T18:16:20.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.4 2024-09-10T18:16:21.036 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:20 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:20.763+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:21.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:20 smithi089 systemd[1]: Stopping Ceph osd.4 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:21.036 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:20 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:20.766+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:48.953271+0000 front 2024-09-10T18:15:48.953121+0000 (oldest deadline 2024-09-10T18:16:18.953386+0000) 2024-09-10T18:16:21.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:21 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:21.118+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:21.536 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:21 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:21.056+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:21.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:21 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:21.065+0000 7f6ef5001640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:16:21.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:21 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:21.065+0000 7f6ef5001640 -1 osd.4 1076 *** Got signal Terminated *** 2024-09-10T18:16:21.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:21 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:21.065+0000 7f6ef5001640 -1 osd.4 1076 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:16:22.113 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:21 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:21.784+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:48.953271+0000 front 2024-09-10T18:15:48.953121+0000 (oldest deadline 2024-09-10T18:16:18.953386+0000) 2024-09-10T18:16:22.113 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:21 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:21.802+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:22.114 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:22 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:22.019+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:22.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:22 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:22.111+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:23.143 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:22 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:22.798+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:23.144 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:22 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:22.786+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:48.953271+0000 front 2024-09-10T18:15:48.953121+0000 (oldest deadline 2024-09-10T18:16:18.953386+0000) 2024-09-10T18:16:23.144 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:22 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:22.983+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:23.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:23 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:23.140+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:24.159 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:23 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:23.799+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:48.953271+0000 front 2024-09-10T18:15:48.953121+0000 (oldest deadline 2024-09-10T18:16:18.953386+0000) 2024-09-10T18:16:24.159 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:23 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:23.788+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:24.160 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:23 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:23.788+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:24.160 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:23 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:23.990+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:24.160 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:23 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:23.990+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:24.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:24.157+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:25.198 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:24.828+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:25.198 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:24.828+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:25.198 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:25.026+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:25.198 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:25.026+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:25.199 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:24.801+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:48.953271+0000 front 2024-09-10T18:15:48.953121+0000 (oldest deadline 2024-09-10T18:16:18.953386+0000) 2024-09-10T18:16:25.199 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:24 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:24.801+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.654404+0000 front 2024-09-10T18:16:00.654412+0000 (oldest deadline 2024-09-10T18:16:24.654623+0000) 2024-09-10T18:16:25.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:25.195+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:26.198 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:25.805+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:48.953271+0000 front 2024-09-10T18:15:48.953121+0000 (oldest deadline 2024-09-10T18:16:18.953386+0000) 2024-09-10T18:16:26.198 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4[89882]: 2024-09-10T18:16:25.805+0000 7f6ef1616640 -1 osd.4 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.654404+0000 front 2024-09-10T18:16:00.654412+0000 (oldest deadline 2024-09-10T18:16:24.654623+0000) 2024-09-10T18:16:26.199 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:25.865+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:26.199 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:25 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:25.865+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:26.199 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:26 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:26.041+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:26.199 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:26 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:26.041+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:26.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:26 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:26.196+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:26.843 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:26 smithi089 podman[125707]: 2024-09-10 18:16:26.570140428 +0000 UTC m=+5.670927086 container died 75e9a99555f39973b4abc86ee4a179496d74ea910aef637cddab47285b7e1fd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T18:16:27.117 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:26 smithi089 podman[125707]: 2024-09-10 18:16:26.905709072 +0000 UTC m=+6.006495734 container cleanup 75e9a99555f39973b4abc86ee4a179496d74ea910aef637cddab47285b7e1fd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T18:16:27.117 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:26 smithi089 bash[125707]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4 2024-09-10T18:16:27.117 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:26 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:26.905+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:27.118 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:26 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:26.905+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:27.118 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:27 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:27.009+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:27.118 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:27 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:27.009+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:27.403 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:27 smithi089 podman[125722]: 2024-09-10 18:16:27.115865107 +0000 UTC m=+0.544695198 container remove 75e9a99555f39973b4abc86ee4a179496d74ea910aef637cddab47285b7e1fd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:16:27.403 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:27 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:27.183+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:27.403 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:27 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:27.183+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:27.708 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:27 smithi089 podman[125813]: 2024-09-10 18:16:27.469870761 +0000 UTC m=+0.016059131 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:16:27.709 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:27 smithi089 podman[125813]: 2024-09-10 18:16:27.583574453 +0000 UTC m=+0.129762814 container create bf4c991f0d04ce7d9dc787b0a643b84ce73b11e4ffbee91cb00ea59579e06a7f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T18:16:28.013 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:27 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:27.875+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:28.013 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:27 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:27.875+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:28.014 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:27 smithi089 podman[125813]: 2024-09-10 18:16:27.811538468 +0000 UTC m=+0.357726825 container init bf4c991f0d04ce7d9dc787b0a643b84ce73b11e4ffbee91cb00ea59579e06a7f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T18:16:28.014 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:27 smithi089 podman[125813]: 2024-09-10 18:16:27.814754501 +0000 UTC m=+0.360942860 container start bf4c991f0d04ce7d9dc787b0a643b84ce73b11e4ffbee91cb00ea59579e06a7f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:16:28.014 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:27 smithi089 podman[125813]: 2024-09-10 18:16:27.894591827 +0000 UTC m=+0.440780186 container attach bf4c991f0d04ce7d9dc787b0a643b84ce73b11e4ffbee91cb00ea59579e06a7f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:16:28.275 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 10 18:16:28 smithi089 podman[125813]: 2024-09-10 18:16:28.012593693 +0000 UTC m=+0.558782065 container died bf4c991f0d04ce7d9dc787b0a643b84ce73b11e4ffbee91cb00ea59579e06a7f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True) 2024-09-10T18:16:28.275 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:28 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:28.156+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:28.275 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:28 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:28.156+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:28.275 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:28 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:28.026+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:28.276 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:28 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:28.026+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:28.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T18:16:28.693 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:28.694 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T18:16:28.694 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T18:16:28.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.5 2024-09-10T18:16:28.907 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:28 smithi089 systemd[1]: Stopping Ceph osd.5 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:29.196 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:29.016+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:29.196 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:29.016+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:29.196 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:28 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:28.905+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:29.196 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:28 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:28.905+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:29.197 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:29.026+0000 7fca449a6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:16:29.197 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:29.026+0000 7fca449a6640 -1 osd.5 1076 *** Got signal Terminated *** 2024-09-10T18:16:29.197 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:29.026+0000 7fca449a6640 -1 osd.5 1076 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:16:29.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:29.193+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:29.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:29.193+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:30.217 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:29.872+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:30.217 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:29.872+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:30.218 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:29.973+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:30.218 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:29 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:29.973+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:30.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:30.215+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:30.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:30.215+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:31.247 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:30.825+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:31.247 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:30.825+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:31.248 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:30.925+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:31.248 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:30 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:30.925+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:31.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:31.245+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:31.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:31.245+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:32.269 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:31.836+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:32.269 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:31.836+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:32.270 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:31.906+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:32.270 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:31.906+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:32.270 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:31.964Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nfs msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=nfs\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T18:16:32.271 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:31.966Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T18:16:32.271 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:31.966Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T18:16:32.271 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:31.970Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T18:16:32.271 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:31.970Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T18:16:32.271 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:31.970Z caller=refresh.go:90 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T18:16:32.271 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:31 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:31.970Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=smb msg="Unable to refresh target groups" err="Get \"http://172.21.15.12:8765/sd/prometheus/sd-config?service=smb\": dial tcp 172.21.15.12:8765: connect: connection refused" 2024-09-10T18:16:32.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:32.267+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:32.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:32.267+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:33.286 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:32.836+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:33.286 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:32.836+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:33.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:32.923+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:33.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:32.923+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:33.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:32 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:32.923+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:33.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:33.303+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:33.787 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:33.303+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:34.286 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:33.798+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:50.192638+0000 front 2024-09-10T18:15:50.192854+0000 (oldest deadline 2024-09-10T18:16:15.492730+0000) 2024-09-10T18:16:34.286 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5[94519]: 2024-09-10T18:16:33.798+0000 7fca3cfb3640 -1 osd.5 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.294247+0000 front 2024-09-10T18:16:01.294325+0000 (oldest deadline 2024-09-10T18:16:22.994143+0000) 2024-09-10T18:16:34.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:33.896+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:34.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:33.896+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:34.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:33 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:33.896+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:34.599 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:34.331+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:34.599 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:34.331+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:34.862 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:34 smithi089 podman[125924]: 2024-09-10 18:16:34.598259175 +0000 UTC m=+5.672585215 container died 28c479f4ad600b95f2a5e0d8ced6872d2cdb19ad9df3dc64b0abd2811dc04906 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T18:16:35.238 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:34 smithi089 podman[125924]: 2024-09-10 18:16:34.96065399 +0000 UTC m=+6.034980023 container cleanup 28c479f4ad600b95f2a5e0d8ced6872d2cdb19ad9df3dc64b0abd2811dc04906 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T18:16:35.238 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:34 smithi089 bash[125924]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5 2024-09-10T18:16:35.239 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:34.862+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:35.239 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:34.862+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:35.239 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:34 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:34.862+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:35.536 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:35 smithi089 podman[125939]: 2024-09-10 18:16:35.23707529 +0000 UTC m=+0.633071347 container remove 28c479f4ad600b95f2a5e0d8ced6872d2cdb19ad9df3dc64b0abd2811dc04906 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:16:35.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:35 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:35.290+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:35.536 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:35 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:35.290+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:35.537 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:35 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:35.290+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.283831+0000 front 2024-09-10T18:16:09.283806+0000 (oldest deadline 2024-09-10T18:16:35.183669+0000) 2024-09-10T18:16:35.860 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:35 smithi089 podman[126028]: 2024-09-10 18:16:35.48998685 +0000 UTC m=+0.015966525 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:16:35.860 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:35 smithi089 podman[126028]: 2024-09-10 18:16:35.596445485 +0000 UTC m=+0.122425136 container create 73ade1b762c51c57a7fe4ee3a0a4478a7d53564f30735209e7103ee3d26fd98c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:16:35.860 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:35 smithi089 podman[126028]: 2024-09-10 18:16:35.807874698 +0000 UTC m=+0.333854367 container init 73ade1b762c51c57a7fe4ee3a0a4478a7d53564f30735209e7103ee3d26fd98c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T18:16:35.860 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:35 smithi089 podman[126028]: 2024-09-10 18:16:35.811492767 +0000 UTC m=+0.337472430 container start 73ade1b762c51c57a7fe4ee3a0a4478a7d53564f30735209e7103ee3d26fd98c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:36.286 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:35 smithi089 podman[126028]: 2024-09-10 18:16:35.895723729 +0000 UTC m=+0.421703399 container attach 73ade1b762c51c57a7fe4ee3a0a4478a7d53564f30735209e7103ee3d26fd98c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T18:16:36.286 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 10 18:16:36 smithi089 podman[126028]: 2024-09-10 18:16:36.003926748 +0000 UTC m=+0.529906435 container died 73ade1b762c51c57a7fe4ee3a0a4478a7d53564f30735209e7103ee3d26fd98c (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True) 2024-09-10T18:16:36.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:35 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:35.857+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:36.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:35 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:35.857+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:36.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:35 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:35.857+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:36.587 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:36.333+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:36.588 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:36.333+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:36.588 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:36.333+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.283831+0000 front 2024-09-10T18:16:09.283806+0000 (oldest deadline 2024-09-10T18:16:35.183669+0000) 2024-09-10T18:16:36.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T18:16:36.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:36.652 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T18:16:36.652 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T18:16:36.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.6 2024-09-10T18:16:36.974 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:36 smithi089 systemd[1]: Stopping Ceph osd.6 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:36.975 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:36.822+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:36.975 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:36.822+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:36.975 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:36.822+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:37.286 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:36.972+0000 7fad9c4dd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:16:37.286 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:36.972+0000 7fad9c4dd640 -1 osd.6 1076 *** Got signal Terminated *** 2024-09-10T18:16:37.286 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:36 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:36.972+0000 7fad9c4dd640 -1 osd.6 1076 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:16:37.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:37.366+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:37.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:37.366+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:37.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:37.366+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.283831+0000 front 2024-09-10T18:16:09.283806+0000 (oldest deadline 2024-09-10T18:16:35.183669+0000) 2024-09-10T18:16:38.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:37.799+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:38.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:37.799+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:38.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:37 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:37.799+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:38.757 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:38.375+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:38.761 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:38.375+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:38.761 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:38.375+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.283831+0000 front 2024-09-10T18:16:09.283806+0000 (oldest deadline 2024-09-10T18:16:35.183669+0000) 2024-09-10T18:16:39.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:38.815+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:39.037 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:38.815+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:39.037 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:38 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:38.815+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:39.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:39.408+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:39.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:39.408+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:39.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:39.408+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.283831+0000 front 2024-09-10T18:16:09.283806+0000 (oldest deadline 2024-09-10T18:16:35.183669+0000) 2024-09-10T18:16:40.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:39.828+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:40.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:39.828+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:40.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:39 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:39.828+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:40.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:40.456+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:40.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:40.456+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:40.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:40.456+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.283831+0000 front 2024-09-10T18:16:09.283806+0000 (oldest deadline 2024-09-10T18:16:35.183669+0000) 2024-09-10T18:16:41.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:40.868+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:41.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:40.868+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:41.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:40.868+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:41.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:40 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:40.868+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:41.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:41.500+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:53.482242+0000 front 2024-09-10T18:15:53.482165+0000 (oldest deadline 2024-09-10T18:16:15.782033+0000) 2024-09-10T18:16:41.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:41.500+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:00.483031+0000 front 2024-09-10T18:16:00.482974+0000 (oldest deadline 2024-09-10T18:16:26.382963+0000) 2024-09-10T18:16:41.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:41.500+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.283831+0000 front 2024-09-10T18:16:09.283806+0000 (oldest deadline 2024-09-10T18:16:35.183669+0000) 2024-09-10T18:16:41.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6[99019]: 2024-09-10T18:16:41.500+0000 7fad94aea640 -1 osd.6 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:15.184277+0000 front 2024-09-10T18:16:15.184231+0000 (oldest deadline 2024-09-10T18:16:41.084105+0000) 2024-09-10T18:16:42.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:41.827+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:42.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:41.827+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:42.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:41.827+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:42.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:41 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:41.827+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:42.742 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:42 smithi089 podman[126128]: 2024-09-10 18:16:42.443211503 +0000 UTC m=+5.569775363 container died 71e430ee4ba6f6b93690f8591b25ab52a001811200e5d6df8ddb390d8bdf8645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T18:16:43.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:42 smithi089 podman[126128]: 2024-09-10 18:16:42.856411747 +0000 UTC m=+5.982975607 container cleanup 71e430ee4ba6f6b93690f8591b25ab52a001811200e5d6df8ddb390d8bdf8645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:43.036 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:42 smithi089 bash[126128]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6 2024-09-10T18:16:43.037 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:42.794+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:43.037 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:42.794+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:43.037 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:42.794+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:43.037 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:42 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:42.794+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:43.519 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:43 smithi089 podman[126144]: 2024-09-10 18:16:43.078083396 +0000 UTC m=+0.638185975 container remove 71e430ee4ba6f6b93690f8591b25ab52a001811200e5d6df8ddb390d8bdf8645 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:43.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:43 smithi089 podman[126231]: 2024-09-10 18:16:43.421061304 +0000 UTC m=+0.016117166 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:16:43.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:43 smithi089 podman[126231]: 2024-09-10 18:16:43.5256692 +0000 UTC m=+0.120725047 container create 53175ef5a3fbc8ae7ca1fe64f3ca488e8eb7cdb9b920150b511c9f41b816abd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:16:43.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:43 smithi089 podman[126231]: 2024-09-10 18:16:43.728483087 +0000 UTC m=+0.323538939 container init 53175ef5a3fbc8ae7ca1fe64f3ca488e8eb7cdb9b920150b511c9f41b816abd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T18:16:43.786 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:43 smithi089 podman[126231]: 2024-09-10 18:16:43.731968562 +0000 UTC m=+0.327024411 container start 53175ef5a3fbc8ae7ca1fe64f3ca488e8eb7cdb9b920150b511c9f41b816abd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T18:16:44.258 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:43 smithi089 podman[126231]: 2024-09-10 18:16:43.819739114 +0000 UTC m=+0.414794980 container attach 53175ef5a3fbc8ae7ca1fe64f3ca488e8eb7cdb9b920150b511c9f41b816abd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T18:16:44.258 INFO:journalctl@ceph.osd.6.smithi089.stdout:Sep 10 18:16:43 smithi089 podman[126231]: 2024-09-10 18:16:43.92107595 +0000 UTC m=+0.516131806 container died 53175ef5a3fbc8ae7ca1fe64f3ca488e8eb7cdb9b920150b511c9f41b816abd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:44.259 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:43 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:43.822+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:44.259 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:43 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:43.822+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:44.259 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:43 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:43.822+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:44.259 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:43 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:43.822+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:44.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T18:16:44.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:44.594 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T18:16:44.595 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T18:16:44.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.7 2024-09-10T18:16:44.786 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:44 smithi089 systemd[1]: Stopping Ceph osd.7 for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:45.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:44.795+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:45.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:44.795+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:45.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:44.795+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:45.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:44.795+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:45.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:44.918+0000 7f703536e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:16:45.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:44.918+0000 7f703536e640 -1 osd.7 1076 *** Got signal Terminated *** 2024-09-10T18:16:45.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:44 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:44.918+0000 7f703536e640 -1 osd.7 1076 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T18:16:46.188 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:45 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:45.845+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:46.188 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:45 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:45.845+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:46.189 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:45 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:45.845+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:46.189 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:45 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:45.845+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:47.204 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:46 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:46.846+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:47.204 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:46 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:46.846+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:47.205 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:46 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:46.846+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:47.205 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:46 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:46.846+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:48.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:47 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:47.887+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:48.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:47 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:47.887+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:48.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:47 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:47.887+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:48.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:47 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:47.887+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:48.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:47 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:47.887+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.89:6804 osd.4 since back 2024-09-10T18:16:24.152255+0000 front 2024-09-10T18:16:24.152345+0000 (oldest deadline 2024-09-10T18:16:47.552750+0000) 2024-09-10T18:16:49.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:48.867+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:49.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:48.867+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:49.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:48.867+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:49.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:48.867+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:49.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:48 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:48.867+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.89:6804 osd.4 since back 2024-09-10T18:16:24.152255+0000 front 2024-09-10T18:16:24.152345+0000 (oldest deadline 2024-09-10T18:16:47.552750+0000) 2024-09-10T18:16:50.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:49.892+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-10T18:15:52.247408+0000 front 2024-09-10T18:15:52.247350+0000 (oldest deadline 2024-09-10T18:16:14.547245+0000) 2024-09-10T18:16:50.286 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:49.892+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6814 osd.1 since back 2024-09-10T18:16:01.449217+0000 front 2024-09-10T18:16:01.449233+0000 (oldest deadline 2024-09-10T18:16:23.749126+0000) 2024-09-10T18:16:50.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:49.892+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6822 osd.2 since back 2024-09-10T18:16:09.650257+0000 front 2024-09-10T18:16:09.650244+0000 (oldest deadline 2024-09-10T18:16:31.950195+0000) 2024-09-10T18:16:50.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:49.892+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.12:6830 osd.3 since back 2024-09-10T18:16:16.051147+0000 front 2024-09-10T18:16:16.051170+0000 (oldest deadline 2024-09-10T18:16:40.051529+0000) 2024-09-10T18:16:50.287 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:49 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7[103666]: 2024-09-10T18:16:49.892+0000 7f702d97b640 -1 osd.7 1076 heartbeat_check: no reply from 172.21.15.89:6804 osd.4 since back 2024-09-10T18:16:24.152255+0000 front 2024-09-10T18:16:24.152345+0000 (oldest deadline 2024-09-10T18:16:47.552750+0000) 2024-09-10T18:16:50.736 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:50 smithi089 podman[126333]: 2024-09-10 18:16:50.405390005 +0000 UTC m=+5.592323255 container died 1b26f245f7dcf69b914ff44d23cb2d2f3b7738a80071ad3107c6a47eb306da9b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True) 2024-09-10T18:16:50.736 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:50 smithi089 podman[126333]: 2024-09-10 18:16:50.734870303 +0000 UTC m=+5.921803538 container cleanup 1b26f245f7dcf69b914ff44d23cb2d2f3b7738a80071ad3107c6a47eb306da9b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T18:16:51.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:50 smithi089 bash[126333]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7 2024-09-10T18:16:51.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:50 smithi089 podman[126362]: 2024-09-10 18:16:50.936437147 +0000 UTC m=+0.531109485 container remove 1b26f245f7dcf69b914ff44d23cb2d2f3b7738a80071ad3107c6a47eb306da9b (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T18:16:51.602 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:51 smithi089 podman[126449]: 2024-09-10 18:16:51.254409525 +0000 UTC m=+0.016534380 image pull 542e6e6af07c2b89abb4ca6a0a4ee0f7b74b9b2e01b2470b0640b5a64ae8477c quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e 2024-09-10T18:16:51.603 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:51 smithi089 podman[126449]: 2024-09-10 18:16:51.362662046 +0000 UTC m=+0.124786941 container create 4f307c006d6312713f5f39d9808e19cf85d2612516ba97a71a3a13ba06412441 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:51.603 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:51 smithi089 podman[126449]: 2024-09-10 18:16:51.598251336 +0000 UTC m=+0.360376192 container init 4f307c006d6312713f5f39d9808e19cf85d2612516ba97a71a3a13ba06412441 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T18:16:51.603 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:51 smithi089 podman[126449]: 2024-09-10 18:16:51.601519881 +0000 UTC m=+0.363644733 container start 4f307c006d6312713f5f39d9808e19cf85d2612516ba97a71a3a13ba06412441 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, GIT_CLEAN=True) 2024-09-10T18:16:52.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:51 smithi089 podman[126449]: 2024-09-10 18:16:51.731094485 +0000 UTC m=+0.493219338 container attach 4f307c006d6312713f5f39d9808e19cf85d2612516ba97a71a3a13ba06412441 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T18:16:52.036 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:51 smithi089 podman[126449]: 2024-09-10 18:16:51.789627308 +0000 UTC m=+0.551752161 container died 4f307c006d6312713f5f39d9808e19cf85d2612516ba97a71a3a13ba06412441 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:16:52.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T18:16:52.350 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:52 smithi089 podman[126471]: 2024-09-10 18:16:52.310391245 +0000 UTC m=+0.514761584 container remove 4f307c006d6312713f5f39d9808e19cf85d2612516ba97a71a3a13ba06412441 (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:16:52.351 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:52 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.7.service: Deactivated successfully. 2024-09-10T18:16:52.351 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:52 smithi089 systemd[1]: Stopped Ceph osd.7 for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:16:52.351 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 10 18:16:52 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@osd.7.service: Consumed 31.476s CPU time. 2024-09-10T18:16:52.366 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:52.366 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T18:16:52.366 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T18:16:52.367 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.a 2024-09-10T18:16:52.666 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:16:52 smithi012 systemd[1]: Stopping Ceph mds.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:53.034 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:16:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[117263]: 2024-09-10T18:16:52.664+0000 7f09eeed6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:16:53.035 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:16:52 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a[117263]: 2024-09-10T18:16:52.664+0000 7f09eeed6640 -1 mds.a *** got signal Terminated *** 2024-09-10T18:16:54.591 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:16:54 smithi012 podman[135457]: 2024-09-10 18:16:54.314916411 +0000 UTC m=+1.752213569 container died 34b133ecae8a03d863de1d89b496a90dd2c894a78767e88b2ac6effd5fad110a (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55) 2024-09-10T18:16:54.941 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:16:54 smithi012 podman[135457]: 2024-09-10 18:16:54.689124779 +0000 UTC m=+2.126421937 container cleanup 34b133ecae8a03d863de1d89b496a90dd2c894a78767e88b2ac6effd5fad110a (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T18:16:54.942 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 10 18:16:54 smithi012 bash[135457]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-a 2024-09-10T18:16:55.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T18:16:55.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:55.130 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T18:16:55.131 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T18:16:55.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.b 2024-09-10T18:16:55.440 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:16:55 smithi089 systemd[1]: Stopping Ceph mds.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:55.786 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:16:55 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b[108118]: 2024-09-10T18:16:55.437+0000 7f942c7da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T18:16:55.786 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:16:55 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b[108118]: 2024-09-10T18:16:55.437+0000 7f942c7da640 -1 mds.b *** got signal Terminated *** 2024-09-10T18:16:56.873 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:16:56 smithi089 podman[126549]: 2024-09-10 18:16:56.594908714 +0000 UTC m=+1.273280029 container died fd9833aea5e48cc417fc36066d46e2d5b60a8b676ed2766458fa04f7ea93e57f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T18:16:57.265 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:16:56 smithi089 podman[126549]: 2024-09-10 18:16:56.955071086 +0000 UTC m=+1.633442391 container cleanup fd9833aea5e48cc417fc36066d46e2d5b60a8b676ed2766458fa04f7ea93e57f (image=quay.ceph.io/ceph-ci/ceph@sha256:45ec49c6faf718bfc56e86946f4c916c91e7dcdca26cd6ac6396132afc3def2e, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b, RELEASE=wip-bharath7-testing-2024-09-10-1409-bad1f55, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T18:16:57.266 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 10 18:16:56 smithi089 bash[126549]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-mds-b 2024-09-10T18:16:57.437 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T18:16:57.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:57.472 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T18:16:57.472 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-10T18:16:57.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a 2024-09-10T18:16:57.786 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 systemd[1]: Stopping Ceph prometheus.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:16:58.103 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.800Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-10T18:16:58.104 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.800Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2024-09-10T18:16:58.104 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.800Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2024-09-10T18:16:58.104 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.800Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-10T18:16:58.104 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.800Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2024-09-10T18:16:58.104 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.800Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2024-09-10T18:16:58.104 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.800Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2024-09-10T18:16:58.104 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.800Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2024-09-10T18:16:58.105 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.801Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2024-09-10T18:16:58.105 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.801Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2024-09-10T18:16:58.105 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.801Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2024-09-10T18:16:58.105 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a[116517]: ts=2024-09-10T18:16:57.801Z caller=main.go:1273 level=info msg="See you next time!" 2024-09-10T18:16:58.105 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:57 smithi089 podman[126670]: 2024-09-10 18:16:57.811320551 +0000 UTC m=+0.115042634 container died 876b047992b8b172cead92fbe9e770505389145c9796c79bcbf51ec80f166723 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T18:16:58.436 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:58 smithi089 podman[126670]: 2024-09-10 18:16:58.209513283 +0000 UTC m=+0.513235354 container cleanup 876b047992b8b172cead92fbe9e770505389145c9796c79bcbf51ec80f166723 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-10T18:16:58.437 INFO:journalctl@ceph.prometheus.a.smithi089.stdout:Sep 10 18:16:58 smithi089 bash[126670]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-prometheus-a 2024-09-10T18:16:58.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9996668a-6f9c-11ef-bcea-c7b262605968@prometheus.a.service' 2024-09-10T18:16:58.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T18:16:58.614 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-10T18:16:58.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T18:16:58.776 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T18:17:00.479 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:00 smithi012 systemd[1]: Stopping Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:17:00.784 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:00 smithi012 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a[125683]: ts=2024-09-10T18:17:00.477Z caller=main.go:542 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-10T18:17:00.785 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:00 smithi012 podman[135910]: 2024-09-10 18:17:00.518355568 +0000 UTC m=+0.124717804 container died eb5017cfa54234828b30d6bab5f8725f88047e14560a4814382006172e5a82b2 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:17:01.129 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:00 smithi012 podman[135910]: 2024-09-10 18:17:00.869175194 +0000 UTC m=+0.475537423 container cleanup eb5017cfa54234828b30d6bab5f8725f88047e14560a4814382006172e5a82b2 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:17:01.130 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:00 smithi012 bash[135910]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a 2024-09-10T18:17:01.531 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:01 smithi012 podman[135922]: 2024-09-10 18:17:01.12866014 +0000 UTC m=+0.601121052 container remove eb5017cfa54234828b30d6bab5f8725f88047e14560a4814382006172e5a82b2 (image=quay.io/prometheus/alertmanager:v0.27.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-10T18:17:01.531 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:01 smithi012 podman[135922]: 2024-09-10 18:17:01.212743029 +0000 UTC m=+0.685203903 volume remove e2acfcdcad8e402a79ee9d20d0d731c5ffebc2b35a6f3930b983f9dc0b70d594 2024-09-10T18:17:01.531 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:01 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-10T18:17:01.531 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:01 smithi012 systemd[1]: Stopped Ceph alertmanager.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:17:01.532 INFO:journalctl@ceph.alertmanager.a.smithi012.stdout:Sep 10 18:17:01 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@alertmanager.a.service: Consumed 1.232s CPU time. 2024-09-10T18:17:01.784 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:01 smithi012 systemd[1]: Stopping Ceph node-exporter.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:17:02.050 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:01 smithi012 podman[136027]: 2024-09-10 18:17:01.784181648 +0000 UTC m=+0.111308203 container died bb42e60bc4f1815fc079805a2d5153a0fa9d83679b33f7afe2bbf952b18b0cf8 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:17:02.409 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:02 smithi012 podman[136027]: 2024-09-10 18:17:02.156962986 +0000 UTC m=+0.484089539 container cleanup bb42e60bc4f1815fc079805a2d5153a0fa9d83679b33f7afe2bbf952b18b0cf8 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:17:02.410 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:02 smithi012 bash[136027]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a 2024-09-10T18:17:02.680 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:02 smithi012 podman[136039]: 2024-09-10 18:17:02.408532157 +0000 UTC m=+0.627093756 container remove bb42e60bc4f1815fc079805a2d5153a0fa9d83679b33f7afe2bbf952b18b0cf8 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-10T18:17:02.681 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:02 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-10T18:17:02.681 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:02 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-10T18:17:02.681 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:02 smithi012 systemd[1]: Stopped Ceph node-exporter.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:17:02.681 INFO:journalctl@ceph.node-exporter.a.smithi012.stdout:Sep 10 18:17:02 smithi012 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.a.service: Consumed 3.067s CPU time. 2024-09-10T18:17:03.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T18:17:03.322 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T18:17:05.001 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:04 smithi089 systemd[1]: Stopping Ceph grafana.a for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:17:05.697 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=server t=2024-09-10T18:17:04.998817533Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-09-10T18:17:05.698 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=ticker t=2024-09-10T18:17:04.999129518Z level=info msg=stopped last_tick=2024-09-10T18:17:00Z 2024-09-10T18:17:05.698 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=tracing t=2024-09-10T18:17:04.999129188Z level=info msg="Closing tracing" 2024-09-10T18:17:05.698 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:04 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=grafana-apiserver t=2024-09-10T18:17:04.99918426Z level=info msg="StorageObjectCountTracker pruner is exiting" 2024-09-10T18:17:05.698 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:05 smithi089 ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a[120404]: logger=sqlstore.transactions t=2024-09-10T18:17:05.010040242Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-10T18:17:05.698 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:05 smithi089 podman[127118]: 2024-09-10 18:17:05.019363405 +0000 UTC m=+0.126698278 container died bb062cb57fa336a99dc3fc58c37cb2239a54cf8b0bb32c6e00e1fb91cacfdf20 (image=quay.io/ceph/grafana:10.4.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-09-10T18:17:05.698 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:05 smithi089 podman[127118]: 2024-09-10 18:17:05.373403331 +0000 UTC m=+0.480738204 container cleanup bb062cb57fa336a99dc3fc58c37cb2239a54cf8b0bb32c6e00e1fb91cacfdf20 (image=quay.io/ceph/grafana:10.4.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-09-10T18:17:05.698 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:05 smithi089 bash[127118]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a 2024-09-10T18:17:05.932 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:05 smithi089 podman[127130]: 2024-09-10 18:17:05.607888089 +0000 UTC m=+0.586355923 container remove bb062cb57fa336a99dc3fc58c37cb2239a54cf8b0bb32c6e00e1fb91cacfdf20 (image=quay.io/ceph/grafana:10.4.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-09-10T18:17:05.932 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:05 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@grafana.a.service: Deactivated successfully. 2024-09-10T18:17:05.933 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:05 smithi089 systemd[1]: Stopped Ceph grafana.a for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:17:05.933 INFO:journalctl@ceph.grafana.a.smithi089.stdout:Sep 10 18:17:05 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@grafana.a.service: Consumed 7.087s CPU time. 2024-09-10T18:17:06.286 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:05 smithi089 systemd[1]: Stopping Ceph node-exporter.b for 9996668a-6f9c-11ef-bcea-c7b262605968... 2024-09-10T18:17:06.286 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:06 smithi089 podman[127240]: 2024-09-10 18:17:06.171308974 +0000 UTC m=+0.102277390 container died 3b018abc72f32f152abb33e2b7d91c72f7bcdc9baa03ab0e24af91773b6c2df7 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:17:06.786 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:06 smithi089 podman[127240]: 2024-09-10 18:17:06.511017576 +0000 UTC m=+0.441985991 container cleanup 3b018abc72f32f152abb33e2b7d91c72f7bcdc9baa03ab0e24af91773b6c2df7 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:17:06.786 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:06 smithi089 bash[127240]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b 2024-09-10T18:17:07.068 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:06 smithi089 podman[127251]: 2024-09-10 18:17:06.787246769 +0000 UTC m=+0.619936863 container remove 3b018abc72f32f152abb33e2b7d91c72f7bcdc9baa03ab0e24af91773b6c2df7 (image=quay.io/prometheus/node-exporter:v1.7.0, name=ceph-9996668a-6f9c-11ef-bcea-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-10T18:17:07.068 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:06 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-10T18:17:07.068 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:06 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-10T18:17:07.068 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:06 smithi089 systemd[1]: Stopped Ceph node-exporter.b for 9996668a-6f9c-11ef-bcea-c7b262605968. 2024-09-10T18:17:07.068 INFO:journalctl@ceph.node-exporter.b.smithi089.stdout:Sep 10 18:17:06 smithi089 systemd[1]: ceph-9996668a-6f9c-11ef-bcea-c7b262605968@node-exporter.b.service: Consumed 2.748s CPU time. 2024-09-10T18:17:07.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T18:17:07.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T18:17:07.654 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T18:17:07.656 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428/remote/smithi012/crash 2024-09-10T18:17:07.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/crash -- . 2024-09-10T18:17:07.710 INFO:teuthology.orchestra.run.smithi012.stderr:tar: /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T18:17:07.710 INFO:teuthology.orchestra.run.smithi012.stderr:tar: Error is not recoverable: exiting now 2024-09-10T18:17:07.712 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428/remote/smithi089/crash 2024-09-10T18:17:07.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/crash -- . 2024-09-10T18:17:07.759 INFO:teuthology.orchestra.run.smithi089.stderr:tar: /var/lib/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T18:17:07.759 INFO:teuthology.orchestra.run.smithi089.stderr:tar: Error is not recoverable: exiting now 2024-09-10T18:17:07.760 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T18:17:07.764 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v MON_DOWN | egrep -v 'out of quorum' | egrep -v PG_AVAILABILITY | head -n 1 2024-09-10T18:17:07.798 INFO:teuthology.orchestra.run.smithi012.stdout:2024-09-10T17:50:15.097091+0000 mon.a (mon.0) 367 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T18:17:07.798 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-10T18:17:07.798 INFO:tasks.cephadm:Compressing logs... 2024-09-10T18:17:07.799 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T18:17:07.840 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T18:17:07.873 INFO:teuthology.orchestra.run.smithi012.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T18:17:07.873 INFO:teuthology.orchestra.run.smithi012.stderr:: No such file or directory 2024-09-10T18:17:07.873 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T18:17:07.873 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.0.log: --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T18:17:07.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T18:17:07.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T18:17:07.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T18:17:07.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T18:17:07.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T18:17:07.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.cephadm.log: /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T18:17:07.875 INFO:teuthology.orchestra.run.smithi012.stderr: 91.6% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T18:17:07.875 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T18:17:07.877 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T18:17:07.877 INFO:teuthology.orchestra.run.smithi089.stderr:: No such file or directory 2024-09-10T18:17:07.877 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T18:17:07.878 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T18:17:07.878 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.7.log: /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T18:17:07.878 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T18:17:07.878 INFO:teuthology.orchestra.run.smithi089.stderr: 83.6% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T18:17:07.878 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T18:17:07.878 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T18:17:07.878 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T18:17:07.879 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.log 2024-09-10T18:17:07.879 INFO:teuthology.orchestra.run.smithi089.stderr: 84.9% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T18:17:07.879 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T18:17:07.879 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T18:17:07.879 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mgr.x.log: 91.1% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T18:17:07.879 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T18:17:07.879 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T18:17:07.880 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.2.log: 94.5% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T18:17:07.880 INFO:teuthology.orchestra.run.smithi012.stderr: 91.9% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T18:17:07.884 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.log 2024-09-10T18:17:07.884 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T18:17:07.891 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.log: 91.1% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T18:17:07.892 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.b.log: /var/log/ceph/cephadm.log: 91.2% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T18:17:07.893 INFO:teuthology.orchestra.run.smithi012.stderr: 92.3% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T18:17:07.893 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T18:17:07.895 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T18:17:07.899 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T18:17:07.918 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T18:17:08.389 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T18:17:08.401 INFO:teuthology.orchestra.run.smithi089.stderr: 92.1% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T18:17:08.701 INFO:teuthology.orchestra.run.smithi012.stderr: 91.8% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T18:17:10.044 INFO:teuthology.orchestra.run.smithi012.stderr: 90.8% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T18:17:12.879 INFO:teuthology.orchestra.run.smithi089.stderr: 94.3% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T18:17:13.152 INFO:teuthology.orchestra.run.smithi089.stderr: 94.3% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T18:17:13.553 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T18:17:13.895 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T18:17:13.897 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-10T18:17:13.897 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m6.042s 2024-09-10T18:17:13.897 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m21.814s 2024-09-10T18:17:13.897 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.818s 2024-09-10T18:17:14.000 INFO:teuthology.orchestra.run.smithi012.stderr: 93.8% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T18:17:14.564 INFO:teuthology.orchestra.run.smithi012.stderr: 93.9% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T18:17:15.966 INFO:teuthology.orchestra.run.smithi012.stderr: 94.5% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T18:17:16.738 INFO:teuthology.orchestra.run.smithi012.stderr: 94.3% -- replaced with /var/log/ceph/9996668a-6f9c-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T18:17:16.740 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-10T18:17:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m8.885s 2024-09-10T18:17:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m32.210s 2024-09-10T18:17:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m1.100s 2024-09-10T18:17:16.741 INFO:tasks.cephadm:Archiving logs... 2024-09-10T18:17:16.741 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428/remote/smithi012/log 2024-09-10T18:17:16.742 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T18:17:20.951 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428/remote/smithi089/log 2024-09-10T18:17:20.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T18:17:24.083 INFO:tasks.cephadm:Removing cluster... 2024-09-10T18:17:24.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 --force 2024-09-10T18:17:24.245 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T18:17:24.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9996668a-6f9c-11ef-bcea-c7b262605968 --force 2024-09-10T18:17:24.695 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: 9996668a-6f9c-11ef-bcea-c7b262605968 2024-09-10T18:17:24.989 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T18:17:24.990 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T18:17:25.006 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T18:17:25.021 INFO:tasks.cephadm:Teardown complete 2024-09-10T18:17:25.021 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T18:17:25.032 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T18:17:25.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T18:17:25.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T18:17:25.141 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T18:17:25.151 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T18:17:25.151 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T18:17:25.154 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T18:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-10T18:17:25.168 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-10T18:17:25.170 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T18:17:25.170 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-10T18:17:25.171 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +113us[ +112us] +/- 43ms 2024-09-10T18:17:25.171 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 +503us[ +503us] +/- 60ms 2024-09-10T18:17:25.171 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 -1003us[-1003us] +/- 87ms 2024-09-10T18:17:25.171 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T18:17:25.173 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T18:17:25.173 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-10T18:17:25.173 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +126us[ +129us] +/- 43ms 2024-09-10T18:17:25.174 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 +500us[ +502us] +/- 60ms 2024-09-10T18:17:25.174 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -1004us[-1004us] +/- 87ms 2024-09-10T18:17:25.174 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T18:17:25.174 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T18:17:25.184 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T18:17:25.184 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T18:17:25.211 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T18:17:25.296 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T18:17:25.371 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T18:17:25.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T18:17:25.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T18:17:25.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T18:17:25.429 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T18:17:25.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T18:17:25.470 INFO:teuthology.task.internal:Duration was 2200.137956 seconds 2024-09-10T18:17:25.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T18:17:25.503 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T18:17:25.503 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T18:17:25.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T18:17:25.543 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T18:17:25.544 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T18:17:25.822 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T18:17:25.823 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T18:17:25.823 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T18:17:25.884 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-10T18:17:25.884 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T18:17:25.914 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T18:17:25.914 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T18:17:25.927 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T18:17:25.980 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T18:17:25.980 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T18:17:25.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T18:17:26.493 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T18:17:26.505 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T18:17:26.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T18:17:26.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T18:17:26.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T18:17:26.577 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T18:17:26.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T18:17:26.602 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-10T18:17:26.621 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-10T18:17:26.649 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T18:17:26.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T18:17:26.672 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T18:17:26.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T18:17:26.704 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T18:17:26.716 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T18:17:26.717 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428/remote/smithi012 2024-09-10T18:17:26.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T18:17:26.766 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899428/remote/smithi089 2024-09-10T18:17:26.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T18:17:26.808 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T18:17:26.808 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T18:17:26.810 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T18:17:26.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T18:17:26.874 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T18:17:26.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T18:17:26.895 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T18:17:26.896 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T18:17:26.898 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T18:17:26.912 INFO:teuthology.orchestra.run.smithi012.stdout: 262169 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 10 18:17 /home/ubuntu/cephtest 2024-09-10T18:17:26.912 INFO:teuthology.orchestra.run.smithi012.stdout: 424663 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 10 18:11 /home/ubuntu/cephtest/mnt.0 2024-09-10T18:17:26.913 INFO:teuthology.orchestra.run.smithi012.stdout: 424712 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 10 18:15 /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T18:17:26.913 INFO:teuthology.orchestra.run.smithi012.stdout: 557441 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 18:15 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T18:17:26.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T18:17:26.916 INFO:teuthology.orchestra.run.smithi089.stdout: 266030 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 18:17 /home/ubuntu/cephtest 2024-09-10T18:17:26.917 INFO:teuthology.orchestra.run.smithi012.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-10T18:17:26.917 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-10T18:17:26.930 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T18:17:26.941 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T18:17:26.980 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi012 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-10T18:17:26.984 INFO:teuthology.run:Summary data: description: rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} duration: 2200.137955904007 failure_reason: 'Command failed (workunit test cls/test_cls_rbd.sh) on smithi012 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh''' flavor: default owner: scheduled_skanta@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0a45b25607024687b26bb7277043b202 status: fail success: false 2024-09-10T18:17:26.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T18:17:27.085 INFO:teuthology.run:FAIL